2024-09-18T12:32:16.189 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T12:32:16.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T12:32:16.330 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911385 branch: wip-guits-main-2024-09-17-1213 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@redhat.com first_in_suite: false job_id: '7911385' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-17-1213 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-main-2024-09-17-1213 sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e owner: scheduled_gabrioux@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 8982 sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-17-1213 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRl5RvcsLnaO7Luad3LTMHOH658ygxO114s7S164OQ8WeCkdAMFVZn1EmNycTw6nJgViLuT65JbzJqWsQwQFWo= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJjFR5yP8TtZ6ctUhYIPrzetkuTArvXSQ5Y/QW4g+GLu9+18jGIgnqR5pJpSG9sn0LzTAejfcYH1hH/PL5anK6M= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_12:14:13 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-18T12:32:16.330 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa; will attempt to use it 2024-09-18T12:32:16.331 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks 2024-09-18T12:32:16.331 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T12:32:16.333 INFO:teuthology.task.internal:Checking packages... 2024-09-18T12:32:16.355 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e' 2024-09-18T12:32:16.355 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:32:16.355 INFO:teuthology.packaging:ref: None 2024-09-18T12:32:16.355 INFO:teuthology.packaging:tag: None 2024-09-18T12:32:16.355 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-17-1213 2024-09-18T12:32:16.355 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:32:16.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-17-1213 2024-09-18T12:32:16.505 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4983.ge7fb7b56 2024-09-18T12:32:16.507 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T12:32:16.513 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T12:32:16.513 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T12:32:16.537 INFO:teuthology.task.internal:Saving configuration 2024-09-18T12:32:16.557 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T12:32:16.562 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T12:32:16.582 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911385', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 12:27:16.767492', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRl5RvcsLnaO7Luad3LTMHOH658ygxO114s7S164OQ8WeCkdAMFVZn1EmNycTw6nJgViLuT65JbzJqWsQwQFWo='} 2024-09-18T12:32:16.602 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911385', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 12:27:16.768804', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJjFR5yP8TtZ6ctUhYIPrzetkuTArvXSQ5Y/QW4g+GLu9+18jGIgnqR5pJpSG9sn0LzTAejfcYH1hH/PL5anK6M='} 2024-09-18T12:32:16.602 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T12:32:16.609 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-18T12:32:16.609 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-18T12:32:16.609 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T12:32:16.677 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1332933f40>, signals=[15]) 2024-09-18T12:32:16.677 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T12:32:16.683 INFO:teuthology.task.internal:Opening connections... 2024-09-18T12:32:16.683 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:32:16.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:32:16.766 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-09-18T12:32:16.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:32:16.842 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T12:32:16.849 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2024-09-18T12:32:16.867 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2024-09-18T12:32:16.868 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2024-09-18T12:32:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T12:32:16.927 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T12:32:16.927 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T12:32:16.927 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-09-18T12:32:16.947 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-09-18T12:32:16.966 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-09-18T12:32:16.966 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-09-18T12:32:17.023 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-09-18T12:32:17.023 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-09-18T12:32:17.023 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T12:32:17.024 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T12:32:17.025 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-09-18T12:32:17.047 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T12:32:17.056 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T12:32:17.079 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T12:32:17.080 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2024-09-18T12:32:17.082 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-09-18T12:32:17.099 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T12:32:17.104 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T12:32:17.104 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2024-09-18T12:32:17.140 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-09-18T12:32:17.248 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T12:32:17.296 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T12:32:17.310 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T12:32:17.310 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T12:32:17.310 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T12:32:17.311 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T12:32:17.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:32:17.328 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2024-09-18T12:32:17.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:32:17.329 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-09-18T12:32:17.386 INFO:teuthology.orchestra.run.smithi045.stdout:5.14.0-503.el9.x86_64 2024-09-18T12:32:17.386 INFO:teuthology.task.kernel:Running kernel on smithi045: 5.14.0-503.el9.x86_64 2024-09-18T12:32:17.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum install -y kernel 2024-09-18T12:32:17.388 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-503.el9.x86_64 2024-09-18T12:32:17.388 INFO:teuthology.task.kernel:Running kernel on smithi161: 5.14.0-503.el9.x86_64 2024-09-18T12:32:17.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y kernel 2024-09-18T12:32:19.870 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-18T12:32:20.870 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-18T12:32:22.610 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-18T12:32:26.562 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-18T12:32:27.094 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-18T12:32:29.345 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-18T12:32:30.774 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-18T12:32:30.779 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-18T12:32:32.363 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 19 kB 00:00 2024-09-18T12:32:34.026 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-18T12:32:36.438 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-18T12:32:38.469 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T12:32:38.469 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T12:32:38.560 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:32:38.564 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:32:38.565 INFO:teuthology.orchestra.run.smithi045.stdout:Install 4 Packages 2024-09-18T12:32:38.565 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:32:38.565 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 79 M 2024-09-18T12:32:38.565 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 126 M 2024-09-18T12:32:38.565 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:32:38.764 INFO:teuthology.orchestra.run.smithi045.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 445 kB/s | 36 kB 00:00 2024-09-18T12:32:39.423 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-18T12:32:39.514 INFO:teuthology.orchestra.run.smithi045.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-18T12:32:39.906 INFO:teuthology.orchestra.run.smithi045.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-18T12:32:41.273 INFO:teuthology.orchestra.run.smithi045.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-18T12:32:41.273 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:32:41.273 INFO:teuthology.orchestra.run.smithi045.stdout:Total 29 MB/s | 79 MB 00:02 2024-09-18T12:32:41.346 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T12:32:41.346 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T12:32:41.448 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:32:41.458 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:32:41.458 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-18T12:32:41.458 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:32:41.458 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:32:41.459 INFO:teuthology.orchestra.run.smithi161.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T12:32:41.459 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-18T12:32:41.459 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T12:32:41.459 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T12:32:41.459 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T12:32:41.459 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:32:41.459 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:32:41.459 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:32:41.459 INFO:teuthology.orchestra.run.smithi161.stdout:Install 4 Packages 2024-09-18T12:32:41.459 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:32:41.460 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 79 M 2024-09-18T12:32:41.460 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 126 M 2024-09-18T12:32:41.460 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:32:41.833 INFO:teuthology.orchestra.run.smithi161.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 303 kB/s | 36 kB 00:00 2024-09-18T12:32:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:32:42.379 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:32:42.380 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:32:43.389 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:32:43.390 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:32:44.166 INFO:teuthology.orchestra.run.smithi161.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-09-18T12:32:45.954 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:32:46.625 INFO:teuthology.orchestra.run.smithi161.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 7.0 MB/s | 35 MB 00:04 2024-09-18T12:32:46.626 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:32:46.717 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:32:47.367 INFO:teuthology.orchestra.run.smithi161.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.2 MB/s | 29 MB 00:05 2024-09-18T12:32:47.367 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:32:47.367 INFO:teuthology.orchestra.run.smithi161.stdout:Total 13 MB/s | 79 MB 00:05 2024-09-18T12:32:48.049 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:32:48.398 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:32:48.399 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:32:49.402 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:32:49.403 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:32:49.472 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:32:49.602 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:32:51.842 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:32:52.494 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:32:52.584 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:32:54.729 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:32:54.778 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:32:55.362 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:32:55.495 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:32:59.921 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:00.361 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:33:00.471 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:05.348 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:38.922 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:38.963 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:39.312 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:39.312 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:33:39.312 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:33:39.312 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:33:40.324 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:40.325 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:33:40.325 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:33:40.325 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T12:33:40.325 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T12:33:40.325 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T12:33:40.325 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T12:33:40.325 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:33:40.325 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:33:40.686 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:33:40.773 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:33:40.774 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:33:40.774 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T12:33:40.774 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T12:33:40.775 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T12:33:40.775 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-18T12:33:40.775 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T12:33:40.775 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:33:40.832 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:33:40.833 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:33:40.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -qi grub2-tools 2024-09-18T12:33:40.864 INFO:teuthology.orchestra.run.smithi045.stdout:Name : grub2-tools 2024-09-18T12:33:40.864 INFO:teuthology.orchestra.run.smithi045.stdout:Epoch : 1 2024-09-18T12:33:40.864 INFO:teuthology.orchestra.run.smithi045.stdout:Version : 2.06 2024-09-18T12:33:40.864 INFO:teuthology.orchestra.run.smithi045.stdout:Release : 82.el9 2024-09-18T12:33:40.864 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: x86_64 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Group : Unspecified 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Size : 8274670 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:License : GPLv3+ 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Packager : builder@centos.org 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Vendor : CentOS 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Summary : Support tools for GRUB. 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout:Description : 2024-09-18T12:33:40.865 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:33:40.866 INFO:teuthology.orchestra.run.smithi045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T12:33:40.866 INFO:teuthology.orchestra.run.smithi045.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T12:33:40.866 INFO:teuthology.orchestra.run.smithi045.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T12:33:40.866 INFO:teuthology.orchestra.run.smithi045.stdout:hardware devices. 2024-09-18T12:33:40.866 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:33:40.866 INFO:teuthology.orchestra.run.smithi045.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T12:33:40.867 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T12:33:40.867 INFO:teuthology.task.kernel:Updating grub on smithi045 to boot 5.14.0-508.el9.x86_64 2024-09-18T12:33:40.867 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T12:33:41.497 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2024-09-18T12:33:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T12:33:42.830 INFO:teuthology.orchestra.run.smithi045.stderr:done 2024-09-18T12:33:42.833 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2024-09-18T12:33:42.848 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.LodpMHPEAd 2024-09-18T12:33:42.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LodpMHPEAd 2024-09-18T12:33:42.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.LodpMHPEAd 2024-09-18T12:33:43.070 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.LodpMHPEAd is 6KB 2024-09-18T12:33:43.119 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.LodpMHPEAd 2024-09-18T12:33:43.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T12:33:43.198 INFO:teuthology.orchestra.run.smithi045.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T12:33:43.198 INFO:teuthology.orchestra.run.smithi045.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T12:33:43.198 INFO:teuthology.orchestra.run.smithi045.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T12:33:43.198 INFO:teuthology.orchestra.run.smithi045.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T12:33:43.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T12:33:43.345 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2024-09-18T12:33:44.161 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:44.201 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:44.494 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:44.494 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T12:33:44.495 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T12:33:44.495 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T12:33:45.387 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T12:33:45.387 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:33:45.387 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:33:45.387 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T12:33:45.387 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T12:33:45.387 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T12:33:45.388 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T12:33:45.388 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:33:45.388 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:33:45.755 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:33:45.846 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:33:45.846 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:33:45.846 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T12:33:45.846 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T12:33:45.846 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T12:33:45.846 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-18T12:33:45.846 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T12:33:45.846 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T12:33:45.905 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T12:33:45.906 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T12:33:45.906 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2024-09-18T12:33:45.947 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2024-09-18T12:33:45.947 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2024-09-18T12:33:45.947 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.06 2024-09-18T12:33:45.947 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 82.el9 2024-09-18T12:33:45.947 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2024-09-18T12:33:45.947 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T12:33:45.947 INFO:teuthology.orchestra.run.smithi161.stdout:Group : Unspecified 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 8274670 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : builder@centos.org 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : CentOS 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:33:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T12:33:45.949 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T12:33:45.949 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T12:33:45.949 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2024-09-18T12:33:45.949 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:33:45.949 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T12:33:45.950 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T12:33:45.950 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 5.14.0-508.el9.x86_64 2024-09-18T12:33:45.950 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T12:33:46.575 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-09-18T12:33:47.790 INFO:teuthology.orchestra.run.smithi161.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T12:33:47.834 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-09-18T12:33:47.837 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-09-18T12:33:47.852 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.KRal9U8AJ5 2024-09-18T12:33:47.853 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KRal9U8AJ5 2024-09-18T12:33:47.921 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.KRal9U8AJ5 2024-09-18T12:33:48.058 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.KRal9U8AJ5 is 6KB 2024-09-18T12:33:48.107 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.KRal9U8AJ5 2024-09-18T12:33:48.123 DEBUG:teuthology.orchestra.run.smithi161:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T12:33:48.185 INFO:teuthology.orchestra.run.smithi161.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T12:33:48.185 INFO:teuthology.orchestra.run.smithi161.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T12:33:48.185 INFO:teuthology.orchestra.run.smithi161.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T12:33:48.185 INFO:teuthology.orchestra.run.smithi161.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T12:33:48.187 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T12:33:48.337 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2024-09-18T12:34:13.354 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-18T12:34:13.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-18T12:34:13.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:34:18.345 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-18T12:34:18.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-18T12:34:18.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:34:52.865 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-18T12:35:01.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-18T12:35:01.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:35:13.369 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T12:35:20.253 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-18T12:35:22.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-18T12:35:22.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:35:22.822 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-09-18T12:35:23.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-18T12:35:23.234 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-18T12:35:23.234 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2024-09-18T12:35:23.249 INFO:teuthology.orchestra.run.smithi045.stdout:5.14.0-508.el9.x86_64 2024-09-18T12:35:23.250 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T12:35:23.250 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T12:35:23.250 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T12:35:24.251 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-18T12:35:24.251 DEBUG:teuthology.orchestra.run.smithi045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T12:35:24.353 INFO:teuthology.orchestra.run.smithi045.stdout:ttyS1 2024-09-18T12:35:24.379 DEBUG:teuthology.parallel:result is None 2024-09-18T12:35:32.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-18T12:35:32.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:35:32.639 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-18T12:35:33.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-18T12:35:33.029 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-18T12:35:33.030 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-09-18T12:35:33.044 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-508.el9.x86_64 2024-09-18T12:35:33.044 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T12:35:33.044 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T12:35:33.044 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T12:35:34.045 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-18T12:35:34.045 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T12:35:34.122 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2024-09-18T12:35:34.146 DEBUG:teuthology.parallel:result is None 2024-09-18T12:35:34.146 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T12:35:34.153 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T12:35:34.153 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T12:35:34.156 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T12:35:34.173 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T12:35:34.201 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T12:35:34.234 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T12:35:34.234 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T12:35:34.237 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T12:35:34.269 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T12:35:34.276 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T12:35:34.276 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T12:35:34.302 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T12:35:34.331 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:35:34.343 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:35:34.345 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:35:34.355 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:35:34.356 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T12:35:34.363 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T12:35:34.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T12:35:34.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T12:35:34.425 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T12:35:34.434 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T12:35:34.434 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T12:35:34.458 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T12:35:34.485 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:35:34.555 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:35:34.608 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:35:34.687 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:35:34.736 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:35:34.736 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T12:35:34.804 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:35:34.839 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:35:34.903 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:35:34.984 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:35:35.034 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:35:35.034 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T12:35:35.103 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2024-09-18T12:35:35.105 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-09-18T12:35:35.165 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T12:35:35.191 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T12:35:35.663 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T12:35:35.671 INFO:teuthology.task.internal:Starting timer... 2024-09-18T12:35:35.671 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T12:35:35.722 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T12:35:35.753 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-18T12:35:35.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2024-09-18T12:35:35.834 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2024-09-18T12:35:35.836 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2024-09-18T12:35:35.911 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2024-09-18T12:35:35.914 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T12:35:35.914 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2024-09-18T12:35:35.934 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2024-09-18T12:35:35.934 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2024-09-18T12:35:35.955 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2024-09-18T12:35:35.956 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive'} 2024-09-18T12:35:35.956 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T12:35:36.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:35:36.004 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T12:35:36.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:35:36.028 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T12:35:36.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2024-09-18T12:35:36.081 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2024-09-18T12:35:36.125 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T12:35:36.134 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-18T12:35:36.137 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-18T12:35:36.242 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T12:35:36.252 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T12:35:36.253 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T12:39:22.148 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2024-09-18T12:39:22.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-18T12:39:22.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:39:22.230 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-09-18T12:39:22.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-18T12:39:22.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-18T12:39:22.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:39:22.384 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-18T12:39:22.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-18T12:39:22.463 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T12:39:22.482 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T12:39:22.482 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T12:39:22.482 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:39:22.485 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T12:39:22.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:39:22.516 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T12:39:22.532 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T12:39:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T12:39:22.546 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T12:39:22.560 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2024-09-18T12:39:22.571 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2024-09-18T12:39:22.572 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2024-09-18T12:39:22.581 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2024-09-18T12:39:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T12:39:22.595 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T12:39:22.602 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T12:39:22.609 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T12:39:22.663 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-09-18T12:39:22.669 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T12:39:22.669 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-09-18T12:39:22.669 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:39:22.669 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:39:22.669 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:39:22.669 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:39:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2024-09-18T12:39:22.672 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T12:39:22.673 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-09-18T12:39:22.673 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:39:22.673 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:39:22.673 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:39:22.673 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T12:39:22.674 INFO:teuthology.run_tasks:Running task install... 2024-09-18T12:39:22.688 DEBUG:teuthology.task.install:project ceph 2024-09-18T12:39:22.688 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'}} 2024-09-18T12:39:22.688 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'} 2024-09-18T12:39:22.689 INFO:teuthology.task.install:Using flavor: default 2024-09-18T12:39:22.698 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T12:39:22.698 INFO:teuthology.task.install:extra packages: [] 2024-09-18T12:39:22.698 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e', 'tag': None, 'wait_for_package': False} 2024-09-18T12:39:22.699 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:39:22.699 INFO:teuthology.packaging:ref: None 2024-09-18T12:39:22.699 INFO:teuthology.packaging:tag: None 2024-09-18T12:39:22.699 INFO:teuthology.packaging:branch: squid 2024-09-18T12:39:22.699 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:39:22.699 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T12:39:22.701 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e', 'tag': None, 'wait_for_package': False} 2024-09-18T12:39:22.701 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:39:22.701 INFO:teuthology.packaging:ref: None 2024-09-18T12:39:22.701 INFO:teuthology.packaging:tag: None 2024-09-18T12:39:22.701 INFO:teuthology.packaging:branch: squid 2024-09-18T12:39:22.702 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:39:22.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T12:39:22.940 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/ 2024-09-18T12:39:22.941 INFO:teuthology.task.install.rpm:Package version is 19.2.0-0 2024-09-18T12:39:22.963 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/ 2024-09-18T12:39:22.963 INFO:teuthology.task.install.rpm:Package version is 19.2.0-0 2024-09-18T12:39:23.002 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T12:39:23.003 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:39:23.003 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T12:39:23.008 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T12:39:23.008 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:39:23.008 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T12:39:23.030 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T12:39:23.030 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:39:23.030 INFO:teuthology.packaging:ref: None 2024-09-18T12:39:23.030 INFO:teuthology.packaging:tag: None 2024-09-18T12:39:23.030 INFO:teuthology.packaging:branch: squid 2024-09-18T12:39:23.030 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:39:23.030 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T12:39:23.035 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T12:39:23.035 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:39:23.035 INFO:teuthology.packaging:ref: None 2024-09-18T12:39:23.035 INFO:teuthology.packaging:tag: None 2024-09-18T12:39:23.035 INFO:teuthology.packaging:branch: squid 2024-09-18T12:39:23.035 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:39:23.035 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T12:39:23.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T12:39:23.101 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T12:39:23.173 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T12:39:23.176 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T12:39:23.238 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2024-09-18T12:39:23.239 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2024-09-18T12:39:23.240 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2024-09-18T12:39:23.242 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2024-09-18T12:39:23.469 INFO:teuthology.orchestra.run.smithi161.stdout:45 files removed 2024-09-18T12:39:23.476 INFO:teuthology.orchestra.run.smithi045.stdout:45 files removed 2024-09-18T12:39:23.497 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw 2024-09-18T12:39:23.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw 2024-09-18T12:39:23.865 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 1.0 MB/s | 83 kB 00:00 2024-09-18T12:39:23.880 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 1.0 MB/s | 83 kB 00:00 2024-09-18T12:39:23.991 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 145 kB/s | 11 kB 00:00 2024-09-18T12:39:24.014 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 133 kB/s | 11 kB 00:00 2024-09-18T12:39:24.108 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 27 kB/s | 2.2 kB 00:00 2024-09-18T12:39:24.132 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 27 kB/s | 2.2 kB 00:00 2024-09-18T12:39:24.732 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-18T12:39:26.675 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-18T12:39:27.124 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.3 MB 00:02 2024-09-18T12:39:29.167 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-18T12:39:32.626 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:02 2024-09-18T12:39:33.468 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-18T12:39:34.460 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-18T12:39:35.205 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-18T12:39:35.865 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-18T12:39:36.648 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-18T12:39:41.541 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-18T12:39:42.137 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-18T12:39:43.857 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:39:43.867 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:39:43.867 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-09-18T12:39:43.867 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:39:43.867 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:39:43.867 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:19.2.0-0.el9 ceph 11 M 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:19.2.0-0.el9 ceph 3.4 M 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:19.2.0-0.el9 ceph 3.2 M 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:19.2.0-0.el9 ceph 21 M 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:19.2.0-0.el9 ceph 25 k 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T12:39:43.868 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:19.2.0-0.el9 ceph 751 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:19.2.0-0.el9 ceph 506 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:19.2.0-0.el9 ceph 45 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:19.2.0-0.el9 ceph 135 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:19.2.0-0.el9 ceph 161 k 2024-09-18T12:39:43.869 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:19.2.0-0.el9 ceph 320 k 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:19.2.0-0.el9 ceph 301 k 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:19.2.0-0.el9 ceph 99 k 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout:Installing weak dependencies: 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:39:43.870 INFO:teuthology.orchestra.run.smithi045.stdout:Install 30 Packages 2024-09-18T12:39:43.871 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 2 Packages 2024-09-18T12:39:43.871 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:39:43.871 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 60 M 2024-09-18T12:39:43.871 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:39:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:(1/32): ceph-base-19.2.0-0.el9.x86_64.rpm 43 MB/s | 5.4 MB 00:00 2024-09-18T12:39:44.180 INFO:teuthology.orchestra.run.smithi045.stdout:(2/32): ceph-selinux-19.2.0-0.el9.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-09-18T12:39:44.214 INFO:teuthology.orchestra.run.smithi045.stdout:(3/32): libcephfs2-19.2.0-0.el9.x86_64.rpm 22 MB/s | 751 kB 00:00 2024-09-18T12:39:44.256 INFO:teuthology.orchestra.run.smithi045.stdout:(4/32): libradosstriper1-19.2.0-0.el9.x86_64.rp 12 MB/s | 506 kB 00:00 2024-09-18T12:39:44.373 INFO:teuthology.orchestra.run.smithi045.stdout:(5/32): librgw2-19.2.0-0.el9.x86_64.rpm 46 MB/s | 5.4 MB 00:00 2024-09-18T12:39:44.398 INFO:teuthology.orchestra.run.smithi045.stdout:(6/32): python3-ceph-argparse-19.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-18T12:39:44.422 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:39:44.423 INFO:teuthology.orchestra.run.smithi045.stdout:(7/32): python3-ceph-common-19.2.0-0.el9.x86_64 5.3 MB/s | 135 kB 00:00 2024-09-18T12:39:44.434 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:39:44.434 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-09-18T12:39:44.434 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:19.2.0-0.el9 ceph 11 M 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:19.2.0-0.el9 ceph 3.4 M 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:19.2.0-0.el9 ceph 3.2 M 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:19.2.0-0.el9 ceph 21 M 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:19.2.0-0.el9 ceph 25 k 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-18T12:39:44.435 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:19.2.0-0.el9 ceph 751 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:19.2.0-0.el9 ceph 506 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:19.2.0-0.el9 ceph 45 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:19.2.0-0.el9 ceph 135 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:19.2.0-0.el9 ceph 161 k 2024-09-18T12:39:44.436 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:19.2.0-0.el9 ceph 320 k 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:19.2.0-0.el9 ceph 301 k 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:19.2.0-0.el9 ceph 99 k 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout:Installing weak dependencies: 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout:Install 30 Packages 2024-09-18T12:39:44.437 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 2 Packages 2024-09-18T12:39:44.438 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:39:44.438 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 60 M 2024-09-18T12:39:44.438 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:39:44.449 INFO:teuthology.orchestra.run.smithi045.stdout:(8/32): python3-cephfs-19.2.0-0.el9.x86_64.rpm 6.3 MB/s | 161 kB 00:00 2024-09-18T12:39:44.474 INFO:teuthology.orchestra.run.smithi045.stdout:(9/32): python3-rados-19.2.0-0.el9.x86_64.rpm 13 MB/s | 320 kB 00:00 2024-09-18T12:39:44.499 INFO:teuthology.orchestra.run.smithi045.stdout:(10/32): python3-rbd-19.2.0-0.el9.x86_64.rpm 12 MB/s | 301 kB 00:00 2024-09-18T12:39:44.525 INFO:teuthology.orchestra.run.smithi045.stdout:(11/32): python3-rgw-19.2.0-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-09-18T12:39:44.659 INFO:teuthology.orchestra.run.smithi045.stdout:(12/32): ceph-radosgw-19.2.0-0.el9.x86_64.rpm 17 MB/s | 11 MB 00:00 2024-09-18T12:39:44.941 INFO:teuthology.orchestra.run.smithi045.stdout:(13/32): ceph-common-19.2.0-0.el9.x86_64.rpm 23 MB/s | 21 MB 00:00 2024-09-18T12:39:44.992 INFO:teuthology.orchestra.run.smithi045.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 229 kB/s | 107 kB 00:00 2024-09-18T12:39:45.009 INFO:teuthology.orchestra.run.smithi161.stdout:(1/32): ceph-base-19.2.0-0.el9.x86_64.rpm 40 MB/s | 5.4 MB 00:00 2024-09-18T12:39:45.022 INFO:teuthology.orchestra.run.smithi161.stdout:(2/32): ceph-selinux-19.2.0-0.el9.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2024-09-18T12:39:45.027 INFO:teuthology.orchestra.run.smithi045.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 436 kB/s | 160 kB 00:00 2024-09-18T12:39:45.064 INFO:teuthology.orchestra.run.smithi161.stdout:(3/32): libcephfs2-19.2.0-0.el9.x86_64.rpm 18 MB/s | 751 kB 00:00 2024-09-18T12:39:45.093 INFO:teuthology.orchestra.run.smithi045.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 298 kB/s | 45 kB 00:00 2024-09-18T12:39:45.097 INFO:teuthology.orchestra.run.smithi161.stdout:(4/32): libradosstriper1-19.2.0-0.el9.x86_64.rp 15 MB/s | 506 kB 00:00 2024-09-18T12:39:45.136 INFO:teuthology.orchestra.run.smithi045.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-18T12:39:45.152 INFO:teuthology.orchestra.run.smithi045.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 716 kB/s | 42 kB 00:00 2024-09-18T12:39:45.186 INFO:teuthology.orchestra.run.smithi045.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.3 MB/s | 662 kB 00:00 2024-09-18T12:39:45.211 INFO:teuthology.orchestra.run.smithi045.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-18T12:39:45.228 INFO:teuthology.orchestra.run.smithi045.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 476 kB/s | 36 kB 00:00 2024-09-18T12:39:45.245 INFO:teuthology.orchestra.run.smithi045.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 805 kB/s | 47 kB 00:00 2024-09-18T12:39:45.256 INFO:teuthology.orchestra.run.smithi161.stdout:(5/32): ceph-radosgw-19.2.0-0.el9.x86_64.rpm 27 MB/s | 11 MB 00:00 2024-09-18T12:39:45.304 INFO:teuthology.orchestra.run.smithi045.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 600 kB/s | 26 kB 00:00 2024-09-18T12:39:45.323 INFO:teuthology.orchestra.run.smithi161.stdout:(6/32): librgw2-19.2.0-0.el9.x86_64.rpm 24 MB/s | 5.4 MB 00:00 2024-09-18T12:39:45.329 INFO:teuthology.orchestra.run.smithi045.stdout:(24/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-18T12:39:45.346 INFO:teuthology.orchestra.run.smithi045.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-18T12:39:45.348 INFO:teuthology.orchestra.run.smithi161.stdout:(7/32): python3-ceph-argparse-19.2.0-0.el9.x86_ 490 kB/s | 45 kB 00:00 2024-09-18T12:39:45.371 INFO:teuthology.orchestra.run.smithi045.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-18T12:39:45.382 INFO:teuthology.orchestra.run.smithi161.stdout:(8/32): python3-ceph-common-19.2.0-0.el9.x86_64 2.3 MB/s | 135 kB 00:00 2024-09-18T12:39:45.407 INFO:teuthology.orchestra.run.smithi161.stdout:(9/32): python3-cephfs-19.2.0-0.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-18T12:39:45.417 INFO:teuthology.orchestra.run.smithi045.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-18T12:39:45.432 INFO:teuthology.orchestra.run.smithi161.stdout:(10/32): python3-rados-19.2.0-0.el9.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2024-09-18T12:39:45.466 INFO:teuthology.orchestra.run.smithi161.stdout:(11/32): python3-rbd-19.2.0-0.el9.x86_64.rpm 5.0 MB/s | 301 kB 00:00 2024-09-18T12:39:45.491 INFO:teuthology.orchestra.run.smithi161.stdout:(12/32): python3-rgw-19.2.0-0.el9.x86_64.rpm 1.7 MB/s | 99 kB 00:00 2024-09-18T12:39:45.505 INFO:teuthology.orchestra.run.smithi045.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-18T12:39:45.572 INFO:teuthology.orchestra.run.smithi045.stdout:(29/32): librados2-19.2.0-0.el9.x86_64.rpm 51 MB/s | 3.4 MB 00:00 2024-09-18T12:39:45.625 INFO:teuthology.orchestra.run.smithi045.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-18T12:39:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:(31/32): librbd1-19.2.0-0.el9.x86_64.rpm 31 MB/s | 3.2 MB 00:00 2024-09-18T12:39:45.716 INFO:teuthology.orchestra.run.smithi161.stdout:(13/32): ceph-common-19.2.0-0.el9.x86_64.rpm 25 MB/s | 21 MB 00:00 2024-09-18T12:39:45.800 INFO:teuthology.orchestra.run.smithi161.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 320 kB/s | 107 kB 00:00 2024-09-18T12:39:45.829 INFO:teuthology.orchestra.run.smithi161.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 480 kB/s | 160 kB 00:00 2024-09-18T12:39:45.851 INFO:teuthology.orchestra.run.smithi161.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 338 kB/s | 45 kB 00:00 2024-09-18T12:39:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:(32/32): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-18T12:39:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:Total 30 MB/s | 60 MB 00:02 2024-09-18T12:39:45.909 INFO:teuthology.orchestra.run.smithi161.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-18T12:39:45.926 INFO:teuthology.orchestra.run.smithi161.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 561 kB/s | 42 kB 00:00 2024-09-18T12:39:45.968 INFO:teuthology.orchestra.run.smithi161.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-18T12:39:45.981 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:39:45.985 INFO:teuthology.orchestra.run.smithi161.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 612 kB/s | 36 kB 00:00 2024-09-18T12:39:46.019 INFO:teuthology.orchestra.run.smithi161.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-18T12:39:46.021 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:39:46.021 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:39:46.044 INFO:teuthology.orchestra.run.smithi161.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 625 kB/s | 47 kB 00:00 2024-09-18T12:39:46.094 INFO:teuthology.orchestra.run.smithi161.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-18T12:39:46.128 INFO:teuthology.orchestra.run.smithi161.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 371 kB/s | 26 kB 00:00 2024-09-18T12:39:46.153 INFO:teuthology.orchestra.run.smithi161.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 854 kB/s | 49 kB 00:00 2024-09-18T12:39:46.178 INFO:teuthology.orchestra.run.smithi161.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T12:39:46.220 INFO:teuthology.orchestra.run.smithi161.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-18T12:39:46.254 INFO:teuthology.orchestra.run.smithi161.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-18T12:39:46.329 INFO:teuthology.orchestra.run.smithi161.stdout:(29/32): librados2-19.2.0-0.el9.x86_64.rpm 46 MB/s | 3.4 MB 00:00 2024-09-18T12:39:46.405 INFO:teuthology.orchestra.run.smithi161.stdout:(30/32): librbd1-19.2.0-0.el9.x86_64.rpm 42 MB/s | 3.2 MB 00:00 2024-09-18T12:39:46.446 INFO:teuthology.orchestra.run.smithi161.stdout:(31/32): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-09-18T12:39:46.530 INFO:teuthology.orchestra.run.smithi161.stdout:(32/32): libarrow-9.0.0-11.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-09-18T12:39:46.534 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:39:46.534 INFO:teuthology.orchestra.run.smithi161.stdout:Total 29 MB/s | 60 MB 00:02 2024-09-18T12:39:46.631 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:39:46.667 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:39:46.667 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:39:46.712 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:39:46.713 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:39:47.344 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:39:47.344 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:39:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:39:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-18T12:39:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-18T12:39:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-18T12:39:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T12:39:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T12:39:48.772 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T12:39:48.833 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T12:39:48.863 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:39:48.939 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-18T12:39:48.969 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-18T12:39:48.993 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-18T12:39:49.016 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T12:39:49.039 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-18T12:39:49.185 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-18T12:39:49.210 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T12:39:49.263 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-18T12:39:49.297 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:39:49.390 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:39:49.490 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:19.2.0-0.el9.x86_64 8/34 2024-09-18T12:39:49.549 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:39:49.612 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:39:49.641 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-18T12:39:49.665 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-18T12:39:49.685 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 11/34 2024-09-18T12:39:49.712 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:39:49.755 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:19.2.0-0.el9.x86_64 12/34 2024-09-18T12:39:49.784 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:39:49.796 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:39:49.832 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:39:49.867 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-18T12:39:49.904 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:19.2.0-0.el9.x86_64 8/34 2024-09-18T12:39:49.930 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:39:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-18T12:39:49.993 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:39:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-18T12:39:50.030 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-18T12:39:50.059 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-18T12:39:50.074 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 11/34 2024-09-18T12:39:50.091 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-18T12:39:50.121 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-18T12:39:50.155 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:19.2.0-0.el9.x86_64 12/34 2024-09-18T12:39:50.175 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-18T12:39:50.190 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:39:50.255 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:39:50.289 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-18T12:39:50.396 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-18T12:39:50.432 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-18T12:39:50.480 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-18T12:39:50.509 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-18T12:39:50.521 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-18T12:39:50.550 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-18T12:39:50.558 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-18T12:39:50.600 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-18T12:39:50.650 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-18T12:39:50.680 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:19.2.0-0.el9.x86_64 23/34 2024-09-18T12:39:50.724 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-18T12:39:50.913 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-18T12:39:50.954 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-18T12:39:51.037 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-18T12:39:51.077 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:19.2.0-0.el9.x86_64 23/34 2024-09-18T12:39:51.120 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-18T12:39:51.227 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-18T12:39:51.261 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-18T12:39:51.333 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-18T12:39:51.421 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:19.2.0-0.el9.x86_64 27/34 2024-09-18T12:39:51.455 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:19.2.0-0.el9.x86_64 28/34 2024-09-18T12:39:51.615 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-18T12:39:51.640 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-18T12:39:51.712 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-18T12:39:51.788 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:19.2.0-0.el9.x86_64 27/34 2024-09-18T12:39:51.826 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:19.2.0-0.el9.x86_64 28/34 2024-09-18T12:39:53.890 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:39:53.927 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:39:54.145 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:39:54.180 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:39:54.533 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:39:54.573 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-18T12:39:54.678 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-18T12:39:54.678 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T12:39:54.678 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T12:39:54.678 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:39:54.716 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:39:54.764 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-18T12:39:54.809 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-18T12:39:54.906 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-18T12:39:54.906 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T12:39:54.906 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T12:39:54.907 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:39:54.952 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:40:04.947 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:40:04.947 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2024-09-18T12:40:04.947 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2024-09-18T12:40:04.947 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2024-09-18T12:40:04.947 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2024-09-18T12:40:04.947 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2024-09-18T12:40:04.947 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /root 2024-09-18T12:40:04.948 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2024-09-18T12:40:04.948 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:40:05.138 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2024-09-18T12:40:05.138 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2024-09-18T12:40:05.138 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2024-09-18T12:40:05.138 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2024-09-18T12:40:05.139 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2024-09-18T12:40:05.139 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /root 2024-09-18T12:40:05.139 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2024-09-18T12:40:05.139 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:05.943 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-18T12:40:05.969 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-18T12:40:05.969 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:05.969 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T12:40:05.969 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:40:05.969 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:40:05.969 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:05.971 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T12:40:06.062 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T12:40:06.062 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:40:06.132 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-18T12:40:06.159 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-18T12:40:06.159 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:06.159 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T12:40:06.159 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:40:06.159 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:40:06.159 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:06.161 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T12:40:06.252 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-18T12:40:06.252 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:40:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:40:07.335 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:19.2.0-0.el9.x86_64 1/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:19.2.0-0.el9.x86_64 2/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:19.2.0-0.el9.x86_64 3/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:19.2.0-0.el9.x86_64 4/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:19.2.0-0.el9.x86_64 5/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:19.2.0-0.el9.x86_64 6/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 8/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:19.2.0-0.el9.x86_64 10/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:19.2.0-0.el9.x86_64 11/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:19.2.0-0.el9.x86_64 12/34 2024-09-18T12:40:07.336 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-18T12:40:07.337 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-18T12:40:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-18T12:40:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-18T12:40:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-18T12:40:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:40:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-18T12:40:07.338 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:19.2.0-0.el9.x86_64 33/34 2024-09-18T12:40:07.408 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:40:07.408 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:19.2.0-0.el9.x86_64 1/34 2024-09-18T12:40:07.408 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:19.2.0-0.el9.x86_64 2/34 2024-09-18T12:40:07.408 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:19.2.0-0.el9.x86_64 3/34 2024-09-18T12:40:07.408 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:19.2.0-0.el9.x86_64 4/34 2024-09-18T12:40:07.408 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:19.2.0-0.el9.x86_64 5/34 2024-09-18T12:40:07.408 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:19.2.0-0.el9.x86_64 6/34 2024-09-18T12:40:07.408 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:19.2.0-0.el9.x86_64 7/34 2024-09-18T12:40:07.408 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 8/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:19.2.0-0.el9.x86_64 9/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:19.2.0-0.el9.x86_64 10/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:19.2.0-0.el9.x86_64 11/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:19.2.0-0.el9.x86_64 12/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:19.2.0-0.el9.x86_64 13/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-18T12:40:07.409 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-18T12:40:07.410 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-18T12:40:07.410 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-18T12:40:07.410 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-18T12:40:07.410 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-18T12:40:07.410 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-18T12:40:07.410 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-18T12:40:07.410 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-18T12:40:07.410 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-18T12:40:07.410 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-18T12:40:07.411 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:19.2.0-0.el9.x86_64 31/34 2024-09-18T12:40:07.411 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-18T12:40:07.411 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:19.2.0-0.el9.x86_64 33/34 2024-09-18T12:40:08.445 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:40:08.445 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:08.445 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2024-09-18T12:40:08.445 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:19.2.0-0.el9.x86_64 librbd1-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.445 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.446 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T12:40:08.447 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T12:40:08.448 INFO:teuthology.orchestra.run.smithi161.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T12:40:08.448 INFO:teuthology.orchestra.run.smithi161.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T12:40:08.448 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T12:40:08.448 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:08.448 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:40:08.462 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-18T12:40:08.462 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:08.462 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2024-09-18T12:40:08.462 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:19.2.0-0.el9.x86_64 librbd1-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.462 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:40:08.462 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-18T12:40:08.462 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-18T12:40:08.464 INFO:teuthology.orchestra.run.smithi045.stdout: re2-1:20211101-20.el9.x86_64 2024-09-18T12:40:08.465 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T12:40:08.465 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:08.465 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:40:08.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-test 2024-09-18T12:40:08.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-test 2024-09-18T12:40:09.367 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:40:09.477 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:28 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:40:09.507 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:40:09.507 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:09.507 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:09.507 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:09.507 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:40:09.508 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:19.2.0-0.el9 ceph 49 M 2024-09-18T12:40:09.508 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-18T12:40:09.508 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:19.2.0-0.el9 ceph 163 k 2024-09-18T12:40:09.508 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T12:40:09.508 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T12:40:09.508 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:09.508 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:40:09.508 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:09.508 INFO:teuthology.orchestra.run.smithi161.stdout:Install 4 Packages 2024-09-18T12:40:09.508 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:09.509 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 49 M 2024-09-18T12:40:09.509 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 208 M 2024-09-18T12:40:09.509 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:40:09.614 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:40:09.614 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:09.614 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:19.2.0-0.el9 ceph 49 M 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:19.2.0-0.el9 ceph 163 k 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout:Install 4 Packages 2024-09-18T12:40:09.615 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:09.616 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 49 M 2024-09-18T12:40:09.616 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 208 M 2024-09-18T12:40:09.616 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:40:09.675 INFO:teuthology.orchestra.run.smithi161.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-18T12:40:09.700 INFO:teuthology.orchestra.run.smithi161.stdout:(2/4): libcephsqlite-19.2.0-0.el9.x86_64.rpm 960 kB/s | 163 kB 00:00 2024-09-18T12:40:09.700 INFO:teuthology.orchestra.run.smithi045.stdout:(1/4): libcephsqlite-19.2.0-0.el9.x86_64.rpm 2.6 MB/s | 163 kB 00:00 2024-09-18T12:40:09.725 INFO:teuthology.orchestra.run.smithi161.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-18T12:40:09.817 INFO:teuthology.orchestra.run.smithi045.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.7 MB/s | 304 kB 00:00 2024-09-18T12:40:09.842 INFO:teuthology.orchestra.run.smithi045.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-18T12:40:10.234 INFO:teuthology.orchestra.run.smithi161.stdout:(4/4): ceph-test-19.2.0-0.el9.x86_64.rpm 69 MB/s | 49 MB 00:00 2024-09-18T12:40:10.236 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:10.237 INFO:teuthology.orchestra.run.smithi161.stdout:Total 68 MB/s | 49 MB 00:00 2024-09-18T12:40:10.264 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:40:10.284 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:40:10.285 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:40:10.401 INFO:teuthology.orchestra.run.smithi045.stdout:(4/4): ceph-test-19.2.0-0.el9.x86_64.rpm 64 MB/s | 49 MB 00:00 2024-09-18T12:40:10.403 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:10.403 INFO:teuthology.orchestra.run.smithi045.stdout:Total 62 MB/s | 49 MB 00:00 2024-09-18T12:40:10.431 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:40:10.453 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:40:10.454 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:40:10.660 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:40:10.660 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:40:10.843 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:40:10.844 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:40:11.196 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:40:11.277 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T12:40:11.333 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T12:40:11.378 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-18T12:40:11.397 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:40:11.488 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T12:40:11.543 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T12:40:11.570 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-18T12:40:15.976 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-18T12:40:16.059 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-18T12:40:16.423 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-18T12:40:16.505 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-18T12:40:18.395 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-18T12:40:18.395 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:19.2.0-0.el9.x86_64 1/4 2024-09-18T12:40:18.395 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:19.2.0-0.el9.x86_64 2/4 2024-09-18T12:40:18.395 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T12:40:18.698 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T12:40:18.698 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:18.698 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:40:18.698 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:19.2.0-0.el9.x86_64 libcephsqlite-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:18.698 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T12:40:18.698 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:18.698 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:40:18.923 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-18T12:40:18.923 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:19.2.0-0.el9.x86_64 1/4 2024-09-18T12:40:18.923 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:19.2.0-0.el9.x86_64 2/4 2024-09-18T12:40:18.923 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T12:40:19.017 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph 2024-09-18T12:40:19.242 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T12:40:19.242 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:19.242 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:40:19.242 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:19.2.0-0.el9.x86_64 libcephsqlite-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:19.242 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T12:40:19.242 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:19.242 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:40:19.554 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph 2024-09-18T12:40:19.620 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:40:19.761 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:40:19.764 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:19.764 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-09-18T12:40:19.764 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:19.764 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:40:19.764 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:19.2.0-0.el9 ceph 6.5 k 2024-09-18T12:40:19.764 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-18T12:40:19.764 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:19.2.0-0.el9 ceph 2.4 M 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:19.2.0-0.el9 ceph 1.5 M 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:19.2.0-0.el9 ceph-noarch 249 k 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:19.2.0-0.el9 ceph 4.7 M 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:19.2.0-0.el9 ceph 17 M 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T12:40:19.765 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T12:40:19.766 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:40:19.767 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:19.768 INFO:teuthology.orchestra.run.smithi161.stdout:Install 37 Packages 2024-09-18T12:40:19.768 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:19.768 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 30 M 2024-09-18T12:40:19.768 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 108 M 2024-09-18T12:40:19.768 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:40:20.167 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:40:20.271 INFO:teuthology.orchestra.run.smithi161.stdout:(1/37): ceph-19.2.0-0.el9.x86_64.rpm 108 kB/s | 6.5 kB 00:00 2024-09-18T12:40:20.310 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:40:20.312 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:20.312 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-09-18T12:40:20.312 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:20.312 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:19.2.0-0.el9 ceph 6.5 k 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:19.2.0-0.el9 ceph 2.4 M 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:19.2.0-0.el9 ceph 1.5 M 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:19.2.0-0.el9 ceph-noarch 249 k 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:19.2.0-0.el9 ceph 4.7 M 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:19.2.0-0.el9 ceph 17 M 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-18T12:40:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T12:40:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T12:40:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T12:40:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T12:40:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T12:40:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T12:40:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T12:40:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T12:40:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T12:40:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T12:40:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T12:40:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T12:40:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T12:40:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T12:40:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T12:40:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:20.316 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:40:20.316 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:20.316 INFO:teuthology.orchestra.run.smithi045.stdout:Install 37 Packages 2024-09-18T12:40:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:20.317 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 30 M 2024-09-18T12:40:20.317 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 108 M 2024-09-18T12:40:20.317 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:40:20.346 INFO:teuthology.orchestra.run.smithi161.stdout:(2/37): ceph-mds-19.2.0-0.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-09-18T12:40:20.388 INFO:teuthology.orchestra.run.smithi161.stdout:(3/37): ceph-mgr-19.2.0-0.el9.x86_64.rpm 8.6 MB/s | 1.5 MB 00:00 2024-09-18T12:40:20.413 INFO:teuthology.orchestra.run.smithi161.stdout:(4/37): ceph-mgr-modules-core-19.2.0-0.el9.noar 9.8 MB/s | 249 kB 00:00 2024-09-18T12:40:20.489 INFO:teuthology.orchestra.run.smithi161.stdout:(5/37): ceph-mon-19.2.0-0.el9.x86_64.rpm 22 MB/s | 4.7 MB 00:00 2024-09-18T12:40:20.581 INFO:teuthology.orchestra.run.smithi161.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-18T12:40:20.739 INFO:teuthology.orchestra.run.smithi161.stdout:(7/37): ceph-osd-19.2.0-0.el9.x86_64.rpm 43 MB/s | 17 MB 00:00 2024-09-18T12:40:20.765 INFO:teuthology.orchestra.run.smithi161.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 580 kB/s | 106 kB 00:00 2024-09-18T12:40:20.815 INFO:teuthology.orchestra.run.smithi161.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 3.8 MB/s | 1.2 MB 00:00 2024-09-18T12:40:20.840 INFO:teuthology.orchestra.run.smithi161.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-09-18T12:40:20.865 INFO:teuthology.orchestra.run.smithi045.stdout:(1/37): ceph-19.2.0-0.el9.x86_64.rpm 123 kB/s | 6.5 kB 00:00 2024-09-18T12:40:20.865 INFO:teuthology.orchestra.run.smithi161.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 1.1 MB/s | 135 kB 00:00 2024-09-18T12:40:20.890 INFO:teuthology.orchestra.run.smithi161.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-18T12:40:20.916 INFO:teuthology.orchestra.run.smithi161.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-18T12:40:20.933 INFO:teuthology.orchestra.run.smithi161.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 829 kB/s | 35 kB 00:00 2024-09-18T12:40:20.958 INFO:teuthology.orchestra.run.smithi161.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-18T12:40:20.975 INFO:teuthology.orchestra.run.smithi161.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2024-09-18T12:40:20.992 INFO:teuthology.orchestra.run.smithi161.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 866 kB/s | 51 kB 00:00 2024-09-18T12:40:21.004 INFO:teuthology.orchestra.run.smithi045.stdout:(2/37): ceph-mds-19.2.0-0.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-18T12:40:21.008 INFO:teuthology.orchestra.run.smithi161.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-09-18T12:40:21.025 INFO:teuthology.orchestra.run.smithi161.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 442 kB/s | 22 kB 00:00 2024-09-18T12:40:21.046 INFO:teuthology.orchestra.run.smithi045.stdout:(3/37): ceph-mgr-19.2.0-0.el9.x86_64.rpm 6.4 MB/s | 1.5 MB 00:00 2024-09-18T12:40:21.080 INFO:teuthology.orchestra.run.smithi045.stdout:(4/37): ceph-mgr-modules-core-19.2.0-0.el9.noar 7.3 MB/s | 249 kB 00:00 2024-09-18T12:40:21.084 INFO:teuthology.orchestra.run.smithi161.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-18T12:40:21.110 INFO:teuthology.orchestra.run.smithi161.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 519 kB/s | 43 kB 00:00 2024-09-18T12:40:21.135 INFO:teuthology.orchestra.run.smithi161.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-18T12:40:21.160 INFO:teuthology.orchestra.run.smithi161.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 706 kB/s | 18 kB 00:00 2024-09-18T12:40:21.172 INFO:teuthology.orchestra.run.smithi045.stdout:(5/37): ceph-mon-19.2.0-0.el9.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2024-09-18T12:40:21.185 INFO:teuthology.orchestra.run.smithi161.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-18T12:40:21.211 INFO:teuthology.orchestra.run.smithi161.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-18T12:40:21.236 INFO:teuthology.orchestra.run.smithi161.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-18T12:40:21.261 INFO:teuthology.orchestra.run.smithi161.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-18T12:40:21.287 INFO:teuthology.orchestra.run.smithi161.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-18T12:40:21.312 INFO:teuthology.orchestra.run.smithi161.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-09-18T12:40:21.337 INFO:teuthology.orchestra.run.smithi161.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-18T12:40:21.363 INFO:teuthology.orchestra.run.smithi161.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-18T12:40:21.380 INFO:teuthology.orchestra.run.smithi045.stdout:(6/37): ceph-osd-19.2.0-0.el9.x86_64.rpm 45 MB/s | 17 MB 00:00 2024-09-18T12:40:21.387 INFO:teuthology.orchestra.run.smithi161.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-18T12:40:21.413 INFO:teuthology.orchestra.run.smithi161.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 716 kB/s | 36 kB 00:00 2024-09-18T12:40:21.438 INFO:teuthology.orchestra.run.smithi161.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-18T12:40:21.463 INFO:teuthology.orchestra.run.smithi161.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 799 kB/s | 20 kB 00:00 2024-09-18T12:40:21.489 INFO:teuthology.orchestra.run.smithi161.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-18T12:40:21.514 INFO:teuthology.orchestra.run.smithi161.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-18T12:40:21.518 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:21.518 INFO:teuthology.orchestra.run.smithi161.stdout:Total 17 MB/s | 30 MB 00:01 2024-09-18T12:40:21.664 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:40:21.706 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:40:21.706 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:40:21.755 INFO:teuthology.orchestra.run.smithi045.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 375 kB/s | 253 kB 00:00 2024-09-18T12:40:21.848 INFO:teuthology.orchestra.run.smithi045.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 228 kB/s | 106 kB 00:00 2024-09-18T12:40:21.873 INFO:teuthology.orchestra.run.smithi045.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-18T12:40:21.990 INFO:teuthology.orchestra.run.smithi045.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-18T12:40:22.044 INFO:teuthology.orchestra.run.smithi045.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 637 kB/s | 125 kB 00:00 2024-09-18T12:40:22.182 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:40:22.182 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:40:22.253 INFO:teuthology.orchestra.run.smithi045.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 718 kB/s | 188 kB 00:00 2024-09-18T12:40:22.295 INFO:teuthology.orchestra.run.smithi045.stdout:(13/37): python3-cryptography-36.0.1-4.el9.x86_ 1.1 MB/s | 1.2 MB 00:01 2024-09-18T12:40:22.320 INFO:teuthology.orchestra.run.smithi045.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 520 kB/s | 35 kB 00:00 2024-09-18T12:40:22.345 INFO:teuthology.orchestra.run.smithi045.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 572 kB/s | 172 kB 00:00 2024-09-18T12:40:22.371 INFO:teuthology.orchestra.run.smithi045.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-18T12:40:22.412 INFO:teuthology.orchestra.run.smithi045.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 624 kB/s | 42 kB 00:00 2024-09-18T12:40:22.438 INFO:teuthology.orchestra.run.smithi045.stdout:(18/37): python3-packaging-20.9-5.el9.noarch.rp 541 kB/s | 77 kB 00:00 2024-09-18T12:40:22.463 INFO:teuthology.orchestra.run.smithi045.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-18T12:40:22.522 INFO:teuthology.orchestra.run.smithi045.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-18T12:40:22.547 INFO:teuthology.orchestra.run.smithi045.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 521 kB/s | 43 kB 00:00 2024-09-18T12:40:22.572 INFO:teuthology.orchestra.run.smithi045.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-18T12:40:22.597 INFO:teuthology.orchestra.run.smithi045.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-18T12:40:22.623 INFO:teuthology.orchestra.run.smithi045.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 351 kB/s | 18 kB 00:00 2024-09-18T12:40:22.648 INFO:teuthology.orchestra.run.smithi045.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-18T12:40:22.673 INFO:teuthology.orchestra.run.smithi045.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-18T12:40:22.699 INFO:teuthology.orchestra.run.smithi045.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.0 MB/s | 358 kB 00:00 2024-09-18T12:40:22.724 INFO:teuthology.orchestra.run.smithi045.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-09-18T12:40:22.749 INFO:teuthology.orchestra.run.smithi045.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 615 kB/s | 46 kB 00:00 2024-09-18T12:40:22.774 INFO:teuthology.orchestra.run.smithi045.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 662 kB/s | 16 kB 00:00 2024-09-18T12:40:22.800 INFO:teuthology.orchestra.run.smithi045.stdout:(31/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-18T12:40:22.825 INFO:teuthology.orchestra.run.smithi045.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-18T12:40:22.850 INFO:teuthology.orchestra.run.smithi045.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-18T12:40:22.876 INFO:teuthology.orchestra.run.smithi045.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-18T12:40:22.901 INFO:teuthology.orchestra.run.smithi045.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 808 kB/s | 20 kB 00:00 2024-09-18T12:40:22.927 INFO:teuthology.orchestra.run.smithi045.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-18T12:40:22.960 INFO:teuthology.orchestra.run.smithi045.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-18T12:40:22.965 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:22.965 INFO:teuthology.orchestra.run.smithi045.stdout:Total 11 MB/s | 30 MB 00:02 2024-09-18T12:40:23.120 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:40:23.166 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:40:23.166 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:40:23.546 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:40:23.600 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T12:40:23.647 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T12:40:23.677 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T12:40:23.685 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:40:23.686 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:40:23.750 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T12:40:23.785 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T12:40:23.826 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T12:40:23.927 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T12:40:24.005 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T12:40:24.045 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T12:40:24.080 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T12:40:24.110 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T12:40:24.144 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T12:40:24.178 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T12:40:24.226 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T12:40:24.278 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T12:40:24.321 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T12:40:24.369 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T12:40:24.402 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T12:40:24.483 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T12:40:24.623 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T12:40:24.709 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T12:40:24.763 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T12:40:24.809 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T12:40:24.866 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T12:40:24.925 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T12:40:25.074 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:40:25.119 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T12:40:25.146 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-18T12:40:25.171 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T12:40:25.180 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-18T12:40:25.207 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-18T12:40:25.258 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T12:40:25.283 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-18T12:40:25.324 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-18T12:40:25.355 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T12:40:25.374 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-18T12:40:25.395 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T12:40:25.470 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-18T12:40:25.514 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T12:40:25.563 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-18T12:40:25.618 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-18T12:40:25.653 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-18T12:40:25.676 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 32/37 2024-09-18T12:40:25.682 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-18T12:40:25.706 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-18T12:40:25.717 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-18T12:40:25.732 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-18T12:40:25.732 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:25.732 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T12:40:25.732 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:40:25.732 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:40:25.732 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:25.751 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-18T12:40:25.800 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-18T12:40:25.844 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-18T12:40:25.878 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-18T12:40:25.936 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-18T12:40:25.992 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-18T12:40:26.067 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-18T12:40:26.219 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-18T12:40:26.302 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-18T12:40:26.362 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-18T12:40:26.416 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-18T12:40:26.483 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-18T12:40:26.546 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-18T12:40:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-18T12:40:26.795 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-18T12:40:26.884 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-18T12:40:26.982 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-18T12:40:27.020 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-18T12:40:27.142 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-18T12:40:27.190 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-18T12:40:27.217 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-18T12:40:27.217 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:27.217 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T12:40:27.217 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:40:27.217 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:40:27.217 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:27.308 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 32/37 2024-09-18T12:40:27.338 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-18T12:40:27.366 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-18T12:40:27.367 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:27.367 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T12:40:27.367 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:40:27.367 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T12:40:27.367 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:27.666 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-18T12:40:27.690 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-18T12:40:27.690 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:27.690 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T12:40:27.690 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:40:27.690 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:40:27.690 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:27.916 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-18T12:40:27.940 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-18T12:40:27.940 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:27.940 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T12:40:27.940 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:40:27.940 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:40:27.940 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:28.004 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-18T12:40:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-18T12:40:28.927 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-18T12:40:28.927 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:28.927 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T12:40:28.927 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:40:28.928 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T12:40:28.928 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:29.398 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-18T12:40:29.424 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-18T12:40:29.424 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:29.424 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T12:40:29.424 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:40:29.424 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T12:40:29.424 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-18T12:40:29.691 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-18T12:40:29.691 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:29.691 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T12:40:29.691 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:40:29.691 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T12:40:29.691 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:29.757 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-18T12:40:29.808 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-18T12:40:29.808 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:19.2.0-0.el9.x86_64 1/37 2024-09-18T12:40:29.808 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:19.2.0-0.el9.x86_64 2/37 2024-09-18T12:40:29.808 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:19.2.0-0.el9.x86_64 3/37 2024-09-18T12:40:29.808 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:19.2.0-0.el9.x86_64 4/37 2024-09-18T12:40:29.808 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:19.2.0-0.el9.x86_64 5/37 2024-09-18T12:40:29.808 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 6/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T12:40:29.809 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T12:40:29.810 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T12:40:29.811 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T12:40:29.811 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T12:40:29.811 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T12:40:29.811 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T12:40:29.811 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T12:40:29.811 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T12:40:30.803 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T12:40:30.804 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:30.804 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:40:30.804 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:30.804 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:30.804 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:30.805 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 2024-09-18T12:40:30.805 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:30.805 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:30.805 INFO:teuthology.orchestra.run.smithi161.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T12:40:30.805 INFO:teuthology.orchestra.run.smithi161.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T12:40:30.806 INFO:teuthology.orchestra.run.smithi161.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T12:40:30.806 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T12:40:30.806 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T12:40:30.806 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T12:40:30.806 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T12:40:30.806 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T12:40:30.807 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T12:40:30.807 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T12:40:30.807 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T12:40:30.807 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T12:40:30.807 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T12:40:30.807 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T12:40:30.808 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T12:40:30.808 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T12:40:30.808 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T12:40:30.808 INFO:teuthology.orchestra.run.smithi161.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T12:40:30.808 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T12:40:30.809 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T12:40:30.809 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T12:40:30.809 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T12:40:30.809 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T12:40:30.809 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T12:40:30.809 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T12:40:30.810 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T12:40:30.810 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T12:40:30.810 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T12:40:30.810 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T12:40:30.810 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T12:40:30.810 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T12:40:30.810 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:30.810 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:40:31.184 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-base 2024-09-18T12:40:31.586 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-18T12:40:31.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:19.2.0-0.el9.x86_64 1/37 2024-09-18T12:40:31.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:19.2.0-0.el9.x86_64 2/37 2024-09-18T12:40:31.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:19.2.0-0.el9.x86_64 3/37 2024-09-18T12:40:31.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:19.2.0-0.el9.x86_64 4/37 2024-09-18T12:40:31.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:19.2.0-0.el9.x86_64 5/37 2024-09-18T12:40:31.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 6/37 2024-09-18T12:40:31.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-18T12:40:31.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-18T12:40:31.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-18T12:40:31.589 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-18T12:40:31.589 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-18T12:40:31.589 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-18T12:40:31.589 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-18T12:40:31.776 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:49 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:40:31.866 INFO:teuthology.orchestra.run.smithi161.stdout:Package ceph-base-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:40:31.909 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:40:31.910 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-09-18T12:40:31.910 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:40:31.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install cephadm 2024-09-18T12:40:32.551 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:40:32.627 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-18T12:40:32.628 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:32.628 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:40:32.628 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:32.628 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:32.628 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:32.628 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 2024-09-18T12:40:32.629 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:32.629 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:32.629 INFO:teuthology.orchestra.run.smithi045.stdout: lua-5.4.4-4.el9.x86_64 2024-09-18T12:40:32.629 INFO:teuthology.orchestra.run.smithi045.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-18T12:40:32.629 INFO:teuthology.orchestra.run.smithi045.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-18T12:40:32.630 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T12:40:32.630 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T12:40:32.630 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T12:40:32.630 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T12:40:32.630 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T12:40:32.631 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T12:40:32.631 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T12:40:32.631 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T12:40:32.631 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T12:40:32.631 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T12:40:32.631 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T12:40:32.632 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T12:40:32.632 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T12:40:32.632 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T12:40:32.632 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T12:40:32.632 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T12:40:32.633 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T12:40:32.633 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T12:40:32.633 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T12:40:32.633 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T12:40:32.633 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T12:40:32.633 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T12:40:32.634 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T12:40:32.634 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T12:40:32.634 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T12:40:32.634 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T12:40:32.634 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T12:40:32.635 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T12:40:32.635 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:32.635 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:40:32.684 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:19.2.0-0.el9 ceph-noarch 765 k 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:32.685 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 765 k 2024-09-18T12:40:32.686 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 771 k 2024-09-18T12:40:32.686 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:40:32.749 INFO:teuthology.orchestra.run.smithi161.stdout:cephadm-19.2.0-0.el9.noarch.rpm 12 MB/s | 765 kB 00:00 2024-09-18T12:40:32.750 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:32.750 INFO:teuthology.orchestra.run.smithi161.stdout:Total 11 MB/s | 765 kB 00:00 2024-09-18T12:40:32.750 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:40:32.755 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:40:32.755 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:40:32.761 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:40:32.762 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:40:32.839 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:40:33.057 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-base 2024-09-18T12:40:33.326 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:40:33.410 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:40:33.666 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:40:33.757 INFO:teuthology.orchestra.run.smithi045.stdout:Package ceph-base-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:40:33.779 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:40:33.802 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:40:33.803 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-09-18T12:40:33.803 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:40:33.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install cephadm 2024-09-18T12:40:34.026 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:40:34.026 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:34.026 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:40:34.026 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:19.2.0-0.el9.noarch 2024-09-18T12:40:34.026 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:34.026 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:40:34.278 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T12:40:34.476 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:40:34.615 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:40:34.616 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:34.616 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-09-18T12:40:34.616 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:34.617 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:40:34.617 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:19.2.0-0.el9 ceph-noarch 765 k 2024-09-18T12:40:34.617 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:34.617 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:40:34.617 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:34.617 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-09-18T12:40:34.617 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:34.617 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 765 k 2024-09-18T12:40:34.617 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 771 k 2024-09-18T12:40:34.617 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:40:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:cephadm-19.2.0-0.el9.noarch.rpm 12 MB/s | 765 kB 00:00 2024-09-18T12:40:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:Total 11 MB/s | 765 kB 00:00 2024-09-18T12:40:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:40:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:40:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:40:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:40:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:40:34.773 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:40:34.867 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:40:35.004 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:40:35.004 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:19.2.0-0.el9 ceph 145 k 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 145 k 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 435 k 2024-09-18T12:40:35.005 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:40:35.047 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-immutable-object-cache-19.2.0-0.el9.x86_64 3.4 MB/s | 145 kB 00:00 2024-09-18T12:40:35.048 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:35.048 INFO:teuthology.orchestra.run.smithi161.stdout:Total 3.3 MB/s | 145 kB 00:00 2024-09-18T12:40:35.048 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:40:35.056 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:40:35.056 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:40:35.115 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:40:35.115 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:40:35.254 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:40:35.276 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:40:35.347 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:40:35.357 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:40:35.383 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:40:35.383 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:35.383 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T12:40:35.383 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:35.707 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:40:35.964 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-18T12:40:35.965 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:35.965 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:40:35.965 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:19.2.0-0.el9.noarch 2024-09-18T12:40:35.965 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:35.965 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:40:36.225 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T12:40:36.315 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:40:36.315 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:36.316 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:40:36.316 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:36.316 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:36.316 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:40:36.534 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr 2024-09-18T12:40:36.833 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:40:36.973 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:40:36.974 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:36.974 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repo Size 2024-09-18T12:40:36.974 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:36.974 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:40:36.974 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:19.2.0-0.el9 ceph 145 k 2024-09-18T12:40:36.974 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:36.975 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:40:36.975 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:36.975 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-09-18T12:40:36.975 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:36.975 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 145 k 2024-09-18T12:40:36.975 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 435 k 2024-09-18T12:40:36.975 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:40:37.023 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-immutable-object-cache-19.2.0-0.el9.x86_64 3.0 MB/s | 145 kB 00:00 2024-09-18T12:40:37.024 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:37.024 INFO:teuthology.orchestra.run.smithi045.stdout:Total 2.9 MB/s | 145 kB 00:00 2024-09-18T12:40:37.024 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:40:37.032 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:40:37.032 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:40:37.093 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:40:37.093 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:40:37.243 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:40:37.255 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:40:37.316 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:40:37.342 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:40:37.342 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:40:37.342 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T12:40:37.342 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:37.344 INFO:teuthology.orchestra.run.smithi161.stdout:Package ceph-mgr-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:40:37.387 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:40:37.388 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-09-18T12:40:37.388 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:40:37.446 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T12:40:38.019 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:40:38.152 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:40:38.153 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:38.153 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-09-18T12:40:38.153 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:38.154 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:40:38.154 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:19.2.0-0.el9 ceph-noarch 3.6 M 2024-09-18T12:40:38.154 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-18T12:40:38.154 INFO:teuthology.orchestra.run.smithi161.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T12:40:38.154 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:19.2.0-0.el9 ceph-noarch 32 k 2024-09-18T12:40:38.154 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:19.2.0-0.el9 ceph-noarch 16 k 2024-09-18T12:40:38.155 INFO:teuthology.orchestra.run.smithi161.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T12:40:38.155 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T12:40:38.155 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T12:40:38.155 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T12:40:38.155 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T12:40:38.155 INFO:teuthology.orchestra.run.smithi161.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T12:40:38.156 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T12:40:38.156 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T12:40:38.156 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:38.156 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:40:38.156 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:38.156 INFO:teuthology.orchestra.run.smithi161.stdout:Install 12 Packages 2024-09-18T12:40:38.157 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:38.157 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 8.7 M 2024-09-18T12:40:38.158 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 104 M 2024-09-18T12:40:38.158 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:40:38.237 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:40:38.237 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:38.238 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:40:38.238 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 2024-09-18T12:40:38.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:38.238 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:40:38.342 INFO:teuthology.orchestra.run.smithi161.stdout:(1/12): ceph-grafana-dashboards-19.2.0-0.el9.no 487 kB/s | 32 kB 00:00 2024-09-18T12:40:38.359 INFO:teuthology.orchestra.run.smithi161.stdout:(2/12): ceph-prometheus-alerts-19.2.0-0.el9.noa 200 kB/s | 16 kB 00:00 2024-09-18T12:40:38.426 INFO:teuthology.orchestra.run.smithi161.stdout:(3/12): ceph-mgr-dashboard-19.2.0-0.el9.noarch. 24 MB/s | 3.6 MB 00:00 2024-09-18T12:40:38.486 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-mgr 2024-09-18T12:40:38.643 INFO:teuthology.orchestra.run.smithi161.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.9 MB/s | 863 kB 00:00 2024-09-18T12:40:38.743 INFO:teuthology.orchestra.run.smithi161.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.4 MB/s | 548 kB 00:00 2024-09-18T12:40:38.760 INFO:teuthology.orchestra.run.smithi161.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-18T12:40:38.994 INFO:teuthology.orchestra.run.smithi161.stdout:(7/12): python3-protobuf-3.14.0-13.el9.noarch.r 424 kB/s | 269 kB 00:00 2024-09-18T12:40:39.044 INFO:teuthology.orchestra.run.smithi161.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 7.2 MB/s | 2.0 MB 00:00 2024-09-18T12:40:39.078 INFO:teuthology.orchestra.run.smithi161.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.1 MB/s | 31 kB 00:00 2024-09-18T12:40:39.098 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:58 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:40:39.120 INFO:teuthology.orchestra.run.smithi161.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.1 MB/s | 144 kB 00:00 2024-09-18T12:40:39.145 INFO:teuthology.orchestra.run.smithi161.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-09-18T12:40:39.190 INFO:teuthology.orchestra.run.smithi045.stdout:Package ceph-mgr-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:40:39.234 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:40:39.235 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-09-18T12:40:39.235 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:40:39.270 INFO:teuthology.orchestra.run.smithi161.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-18T12:40:39.274 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:39.274 INFO:teuthology.orchestra.run.smithi161.stdout:Total 7.7 MB/s | 8.7 MB 00:01 2024-09-18T12:40:39.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T12:40:39.322 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:40:39.339 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:40:39.339 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:40:39.553 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:40:39.553 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:40:39.919 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:58 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:40:40.056 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:40:40.057 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:40.057 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:19.2.0-0.el9 ceph-noarch 3.6 M 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:19.2.0-0.el9 ceph-noarch 32 k 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:19.2.0-0.el9 ceph-noarch 16 k 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-18T12:40:40.058 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-18T12:40:40.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-18T12:40:40.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T12:40:40.059 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T12:40:40.059 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:40.059 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:40:40.059 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:40.059 INFO:teuthology.orchestra.run.smithi045.stdout:Install 12 Packages 2024-09-18T12:40:40.059 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:40.059 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 8.7 M 2024-09-18T12:40:40.060 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 104 M 2024-09-18T12:40:40.060 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:40:40.080 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:40:40.171 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-18T12:40:40.206 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-18T12:40:40.252 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-18T12:40:40.283 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-18T12:40:40.389 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-18T12:40:40.517 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-18T12:40:40.536 INFO:teuthology.orchestra.run.smithi045.stdout:(1/12): ceph-grafana-dashboards-19.2.0-0.el9.no 539 kB/s | 32 kB 00:00 2024-09-18T12:40:40.553 INFO:teuthology.orchestra.run.smithi045.stdout:(2/12): ceph-prometheus-alerts-19.2.0-0.el9.noa 216 kB/s | 16 kB 00:00 2024-09-18T12:40:40.610 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-18T12:40:40.628 INFO:teuthology.orchestra.run.smithi045.stdout:(3/12): ceph-mgr-dashboard-19.2.0-0.el9.noarch. 24 MB/s | 3.6 MB 00:00 2024-09-18T12:40:40.654 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-18T12:40:40.683 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-18T12:40:40.714 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 10/12 2024-09-18T12:40:40.828 INFO:teuthology.orchestra.run.smithi045.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.2 MB/s | 863 kB 00:00 2024-09-18T12:40:40.887 INFO:teuthology.orchestra.run.smithi045.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-18T12:40:40.912 INFO:teuthology.orchestra.run.smithi045.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-18T12:40:41.096 INFO:teuthology.orchestra.run.smithi045.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 11 MB/s | 2.0 MB 00:00 2024-09-18T12:40:41.138 INFO:teuthology.orchestra.run.smithi045.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.4 MB/s | 144 kB 00:00 2024-09-18T12:40:41.164 INFO:teuthology.orchestra.run.smithi045.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-18T12:40:41.206 INFO:teuthology.orchestra.run.smithi045.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-18T12:40:41.231 INFO:teuthology.orchestra.run.smithi045.stdout:(11/12): python3-protobuf-3.14.0-13.el9.noarch. 397 kB/s | 269 kB 00:00 2024-09-18T12:40:41.664 INFO:teuthology.orchestra.run.smithi045.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 916 kB/s | 1.0 MB 00:01 2024-09-18T12:40:41.668 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:41.668 INFO:teuthology.orchestra.run.smithi045.stdout:Total 5.4 MB/s | 8.7 MB 00:01 2024-09-18T12:40:41.722 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:40:41.742 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:40:41.742 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:40:41.771 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 11/12 2024-09-18T12:40:41.807 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-18T12:40:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:40:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:40:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:40:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-18T12:40:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-18T12:40:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-18T12:40:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-18T12:40:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-18T12:40:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-18T12:40:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-18T12:40:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 1/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 3/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-18T12:40:43.086 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-18T12:40:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-18T12:40:43.143 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 10/12 2024-09-18T12:40:43.405 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-18T12:40:43.405 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:43.405 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:40:43.405 INFO:teuthology.orchestra.run.smithi161.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T12:40:43.405 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 2024-09-18T12:40:43.405 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:43.406 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:40:43.676 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T12:40:44.254 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:02 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:40:44.261 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 11/12 2024-09-18T12:40:44.302 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-18T12:40:44.387 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:40:44.388 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:44.388 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-09-18T12:40:44.388 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:44.388 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:40:44.388 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.0-0.el9 ceph-noarch 7.4 M 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T12:40:44.389 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T12:40:44.390 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:44.390 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:40:44.390 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:44.390 INFO:teuthology.orchestra.run.smithi161.stdout:Install 12 Packages 2024-09-18T12:40:44.390 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:44.390 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 38 M 2024-09-18T12:40:44.390 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 212 M 2024-09-18T12:40:44.391 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:40:44.603 INFO:teuthology.orchestra.run.smithi161.stdout:(1/12): ceph-mgr-diskprediction-local-19.2.0-0. 52 MB/s | 7.4 MB 00:00 2024-09-18T12:40:44.661 INFO:teuthology.orchestra.run.smithi161.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 951 kB/s | 191 kB 00:00 2024-09-18T12:40:44.686 INFO:teuthology.orchestra.run.smithi161.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-18T12:40:44.720 INFO:teuthology.orchestra.run.smithi161.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.0 MB/s | 801 kB 00:00 2024-09-18T12:40:44.737 INFO:teuthology.orchestra.run.smithi161.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 362 kB/s | 18 kB 00:00 2024-09-18T12:40:44.821 INFO:teuthology.orchestra.run.smithi161.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 384 kB/s | 38 kB 00:00 2024-09-18T12:40:44.963 INFO:teuthology.orchestra.run.smithi161.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.9 MB/s | 3.0 MB 00:00 2024-09-18T12:40:44.988 INFO:teuthology.orchestra.run.smithi161.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-18T12:40:45.080 INFO:teuthology.orchestra.run.smithi161.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-18T12:40:45.105 INFO:teuthology.orchestra.run.smithi161.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-18T12:40:45.172 INFO:teuthology.orchestra.run.smithi161.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-09-18T12:40:45.581 INFO:teuthology.orchestra.run.smithi161.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-18T12:40:45.581 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:45.581 INFO:teuthology.orchestra.run.smithi161.stdout:Total 32 MB/s | 38 MB 00:01 2024-09-18T12:40:45.640 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-18T12:40:45.640 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 1/12 2024-09-18T12:40:45.640 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2/12 2024-09-18T12:40:45.640 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 3/12 2024-09-18T12:40:45.640 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-18T12:40:45.640 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-18T12:40:45.640 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-18T12:40:45.641 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-18T12:40:45.641 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-18T12:40:45.641 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-18T12:40:45.641 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-18T12:40:45.641 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-18T12:40:45.931 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:40:45.957 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:40:45.957 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-18T12:40:45.975 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-18T12:40:45.976 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-18T12:40:45.976 INFO:teuthology.orchestra.run.smithi045.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-18T12:40:45.976 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T12:40:45.976 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T12:40:45.976 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:45.976 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:40:46.197 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T12:40:46.409 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:40:46.409 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:40:46.801 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:05 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:40:46.940 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:40:46.941 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:46.941 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-09-18T12:40:46.941 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:46.941 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:40:46.941 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.0-0.el9 ceph-noarch 7.4 M 2024-09-18T12:40:46.941 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-18T12:40:46.941 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T12:40:46.942 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:46.943 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:40:46.943 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:46.943 INFO:teuthology.orchestra.run.smithi045.stdout:Install 12 Packages 2024-09-18T12:40:46.943 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:46.944 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 38 M 2024-09-18T12:40:46.944 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 212 M 2024-09-18T12:40:46.945 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:40:47.163 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:40:47.227 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T12:40:47.270 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:40:47.370 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:40:47.405 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T12:40:47.407 INFO:teuthology.orchestra.run.smithi045.stdout:(1/12): ceph-mgr-diskprediction-local-19.2.0-0. 45 MB/s | 7.4 MB 00:00 2024-09-18T12:40:47.466 INFO:teuthology.orchestra.run.smithi045.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 861 kB/s | 191 kB 00:00 2024-09-18T12:40:47.533 INFO:teuthology.orchestra.run.smithi045.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-18T12:40:47.550 INFO:teuthology.orchestra.run.smithi045.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-09-18T12:40:47.581 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T12:40:47.603 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T12:40:47.633 INFO:teuthology.orchestra.run.smithi045.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-18T12:40:47.650 INFO:teuthology.orchestra.run.smithi045.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 155 kB/s | 18 kB 00:00 2024-09-18T12:40:47.680 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T12:40:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-18T12:40:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.3 MB/s | 3.0 MB 00:00 2024-09-18T12:40:47.960 INFO:teuthology.orchestra.run.smithi045.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-18T12:40:48.068 INFO:teuthology.orchestra.run.smithi045.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 11 MB/s | 4.9 MB 00:00 2024-09-18T12:40:48.210 INFO:teuthology.orchestra.run.smithi045.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-18T12:40:48.333 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T12:40:48.458 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T12:40:48.719 INFO:teuthology.orchestra.run.smithi045.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-18T12:40:48.719 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:48.719 INFO:teuthology.orchestra.run.smithi045.stdout:Total 22 MB/s | 38 MB 00:01 2024-09-18T12:40:49.085 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:40:49.112 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:40:49.112 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:40:49.597 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:40:49.597 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:40:49.712 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:40:50.395 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:40:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T12:40:50.536 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:40:50.649 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:40:50.695 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T12:40:50.750 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T12:40:50.777 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-18T12:40:50.891 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T12:40:50.918 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T12:40:50.998 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T12:40:51.690 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T12:40:51.812 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T12:40:53.143 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:40:53.441 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 1/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:40:53.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T12:40:53.845 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T12:40:53.845 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarch 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T12:40:53.846 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T12:40:53.847 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:53.847 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:40:54.240 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-rook 2024-09-18T12:40:54.244 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T12:40:54.278 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-18T12:40:54.824 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:12 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:40:54.955 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:40:54.956 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:54.956 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-09-18T12:40:54.956 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:54.956 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:40:54.956 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:19.2.0-0.el9 ceph-noarch 49 k 2024-09-18T12:40:54.956 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T12:40:54.957 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:54.958 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:40:54.958 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:54.958 INFO:teuthology.orchestra.run.smithi161.stdout:Install 13 Packages 2024-09-18T12:40:54.958 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:54.958 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 2.2 M 2024-09-18T12:40:54.958 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 26 M 2024-09-18T12:40:54.958 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:40:55.162 INFO:teuthology.orchestra.run.smithi161.stdout:(1/13): ceph-mgr-rook-19.2.0-0.el9.noarch.rpm 1.1 MB/s | 49 kB 00:00 2024-09-18T12:40:55.237 INFO:teuthology.orchestra.run.smithi161.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 218 kB/s | 26 kB 00:00 2024-09-18T12:40:55.254 INFO:teuthology.orchestra.run.smithi161.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 142 kB/s | 19 kB 00:00 2024-09-18T12:40:55.387 INFO:teuthology.orchestra.run.smithi161.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 986 kB/s | 222 kB 00:00 2024-09-18T12:40:55.412 INFO:teuthology.orchestra.run.smithi161.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-18T12:40:55.438 INFO:teuthology.orchestra.run.smithi161.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-18T12:40:55.463 INFO:teuthology.orchestra.run.smithi161.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 711 kB/s | 54 kB 00:00 2024-09-18T12:40:55.513 INFO:teuthology.orchestra.run.smithi161.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-18T12:40:55.555 INFO:teuthology.orchestra.run.smithi161.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 120 kB/s | 14 kB 00:00 2024-09-18T12:40:55.589 INFO:teuthology.orchestra.run.smithi161.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-18T12:40:55.614 INFO:teuthology.orchestra.run.smithi161.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-18T12:40:55.639 INFO:teuthology.orchestra.run.smithi161.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-18T12:40:55.681 INFO:teuthology.orchestra.run.smithi161.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.2 MB/s | 1.0 MB 00:00 2024-09-18T12:40:55.684 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:55.684 INFO:teuthology.orchestra.run.smithi161.stdout:Total 3.0 MB/s | 2.2 MB 00:00 2024-09-18T12:40:55.746 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:40:55.761 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:40:55.761 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:40:55.851 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:40:55.851 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:40:56.369 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:40:56.535 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T12:40:56.582 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T12:40:56.654 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T12:40:56.700 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T12:40:56.741 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T12:40:56.753 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-18T12:40:56.753 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 1/12 2024-09-18T12:40:56.754 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T12:40:56.754 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T12:40:56.754 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T12:40:56.754 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T12:40:56.754 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T12:40:56.754 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T12:40:56.754 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T12:40:56.754 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T12:40:56.754 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T12:40:56.755 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T12:40:56.842 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T12:40:56.944 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T12:40:57.001 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T12:40:57.167 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T12:40:57.168 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:57.168 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:40:57.168 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarch 2024-09-18T12:40:57.168 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T12:40:57.168 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T12:40:57.168 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T12:40:57.168 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T12:40:57.169 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T12:40:57.169 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T12:40:57.170 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T12:40:57.170 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T12:40:57.170 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T12:40:57.170 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T12:40:57.170 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T12:40:57.170 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:57.171 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:40:57.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-mgr-rook 2024-09-18T12:40:57.711 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T12:40:57.765 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T12:40:57.799 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T12:40:57.856 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T12:40:57.877 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-18T12:40:58.200 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:17 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:40:58.339 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:40:58.340 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:58.340 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-09-18T12:40:58.340 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:58.340 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:40:58.340 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:19.2.0-0.el9 ceph-noarch 49 k 2024-09-18T12:40:58.340 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-18T12:40:58.340 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T12:40:58.340 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T12:40:58.340 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:40:58.341 INFO:teuthology.orchestra.run.smithi045.stdout:Install 13 Packages 2024-09-18T12:40:58.342 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:40:58.342 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 2.2 M 2024-09-18T12:40:58.342 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 26 M 2024-09-18T12:40:58.342 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:40:58.571 INFO:teuthology.orchestra.run.smithi045.stdout:(1/13): ceph-mgr-rook-19.2.0-0.el9.noarch.rpm 1.0 MB/s | 49 kB 00:00 2024-09-18T12:40:58.646 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-18T12:40:58.646 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:19.2.0-0.el9.noarch 1/13 2024-09-18T12:40:58.646 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T12:40:58.646 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T12:40:58.646 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T12:40:58.646 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T12:40:58.647 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T12:40:58.647 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T12:40:58.647 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T12:40:58.647 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T12:40:58.647 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T12:40:58.647 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T12:40:58.648 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T12:40:58.672 INFO:teuthology.orchestra.run.smithi045.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 129 kB/s | 19 kB 00:00 2024-09-18T12:40:58.697 INFO:teuthology.orchestra.run.smithi045.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 147 kB/s | 26 kB 00:00 2024-09-18T12:40:58.789 INFO:teuthology.orchestra.run.smithi045.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-18T12:40:58.814 INFO:teuthology.orchestra.run.smithi045.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 916 kB/s | 222 kB 00:00 2024-09-18T12:40:58.839 INFO:teuthology.orchestra.run.smithi045.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.9 MB/s | 279 kB 00:00 2024-09-18T12:40:58.865 INFO:teuthology.orchestra.run.smithi045.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 707 kB/s | 54 kB 00:00 2024-09-18T12:40:58.915 INFO:teuthology.orchestra.run.smithi045.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 319 kB/s | 32 kB 00:00 2024-09-18T12:40:58.940 INFO:teuthology.orchestra.run.smithi045.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-18T12:40:58.974 INFO:teuthology.orchestra.run.smithi045.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:19.2.0-0.el9.noarch 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T12:40:58.985 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T12:40:58.986 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T12:40:58.986 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T12:40:58.986 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T12:40:58.986 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T12:40:58.986 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:58.986 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:40:59.024 INFO:teuthology.orchestra.run.smithi045.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.5 MB/s | 220 kB 00:00 2024-09-18T12:40:59.049 INFO:teuthology.orchestra.run.smithi045.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-18T12:40:59.100 INFO:teuthology.orchestra.run.smithi045.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.6 MB/s | 1.0 MB 00:00 2024-09-18T12:40:59.102 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:40:59.102 INFO:teuthology.orchestra.run.smithi045.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-18T12:40:59.167 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:40:59.183 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:40:59.183 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:40:59.261 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T12:40:59.284 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:40:59.285 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:40:59.802 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:40:59.842 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:17 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:40:59.973 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:40:59.974 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:59.974 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-09-18T12:40:59.974 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:59.974 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:40:59.974 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:19.2.0-0.el9 ceph-noarch 146 k 2024-09-18T12:40:59.974 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-18T12:40:59.974 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T12:40:59.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T12:40:59.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T12:40:59.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T12:40:59.975 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T12:40:59.975 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:59.975 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:40:59.975 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:40:59.975 INFO:teuthology.orchestra.run.smithi161.stdout:Install 6 Packages 2024-09-18T12:40:59.975 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:40:59.976 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 7.0 M 2024-09-18T12:40:59.976 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 33 M 2024-09-18T12:40:59.976 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:40:59.982 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T12:41:00.045 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T12:41:00.117 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T12:41:00.161 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T12:41:00.204 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T12:41:00.320 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T12:41:00.383 INFO:teuthology.orchestra.run.smithi161.stdout:(1/6): ceph-mgr-cephadm-19.2.0-0.el9.noarch.rpm 2.8 MB/s | 146 kB 00:00 2024-09-18T12:41:00.429 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T12:41:00.481 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T12:41:00.483 INFO:teuthology.orchestra.run.smithi161.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.4 MB/s | 548 kB 00:00 2024-09-18T12:41:00.509 INFO:teuthology.orchestra.run.smithi161.stdout:(3/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-18T12:41:00.534 INFO:teuthology.orchestra.run.smithi161.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-18T12:41:00.584 INFO:teuthology.orchestra.run.smithi161.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 990 kB/s | 74 kB 00:00 2024-09-18T12:41:00.726 INFO:teuthology.orchestra.run.smithi161.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-18T12:41:00.728 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:00.728 INFO:teuthology.orchestra.run.smithi161.stdout:Total 9.3 MB/s | 7.0 MB 00:00 2024-09-18T12:41:00.799 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:41:00.810 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:41:00.811 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:41:00.909 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:41:00.910 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:41:01.211 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:41:01.271 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T12:41:01.327 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T12:41:01.361 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T12:41:01.392 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T12:41:01.411 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T12:41:01.439 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-18T12:41:01.444 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T12:41:01.966 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T12:41:02.056 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T12:41:02.127 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T12:41:02.157 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-18T12:41:02.201 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-18T12:41:02.201 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:19.2.0-0.el9.noarch 1/13 2024-09-18T12:41:02.201 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T12:41:02.201 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T12:41:02.202 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T12:41:02.202 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T12:41:02.202 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T12:41:02.202 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T12:41:02.202 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T12:41:02.202 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T12:41:02.202 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T12:41:02.202 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T12:41:02.202 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T12:41:02.539 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T12:41:02.539 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:02.539 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:41:02.539 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:19.2.0-0.el9.noarch 2024-09-18T12:41:02.539 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T12:41:02.539 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T12:41:02.539 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:02.540 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:02.790 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T12:41:02.955 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-18T12:41:02.955 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 1/6 2024-09-18T12:41:02.955 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T12:41:02.956 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T12:41:02.956 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T12:41:02.956 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:03.217 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:03.397 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:03.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-fuse 2024-09-18T12:41:03.535 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:03.535 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:19.2.0-0.el9 ceph-noarch 146 k 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:41:03.536 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:03.537 INFO:teuthology.orchestra.run.smithi045.stdout:Install 6 Packages 2024-09-18T12:41:03.537 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:03.537 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 7.0 M 2024-09-18T12:41:03.537 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 33 M 2024-09-18T12:41:03.537 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:41:03.787 INFO:teuthology.orchestra.run.smithi045.stdout:(1/6): ceph-mgr-cephadm-19.2.0-0.el9.noarch.rpm 2.4 MB/s | 146 kB 00:00 2024-09-18T12:41:03.887 INFO:teuthology.orchestra.run.smithi045.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.3 MB/s | 548 kB 00:00 2024-09-18T12:41:03.921 INFO:teuthology.orchestra.run.smithi045.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2024-09-18T12:41:03.955 INFO:teuthology.orchestra.run.smithi045.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-18T12:41:04.005 INFO:teuthology.orchestra.run.smithi045.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 899 kB/s | 248 kB 00:00 2024-09-18T12:41:04.068 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:04.202 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:04.203 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:04.203 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:04.203 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:41:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:19.2.0-0.el9 ceph 896 k 2024-09-18T12:41:04.203 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-18T12:41:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T12:41:04.203 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:04.204 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:41:04.204 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:04.204 INFO:teuthology.orchestra.run.smithi161.stdout:Install 2 Packages 2024-09-18T12:41:04.204 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:04.204 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 976 k 2024-09-18T12:41:04.204 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 2.9 M 2024-09-18T12:41:04.204 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:41:04.378 INFO:teuthology.orchestra.run.smithi161.stdout:(1/2): ceph-fuse-19.2.0-0.el9.x86_64.rpm 12 MB/s | 896 kB 00:00 2024-09-18T12:41:04.486 INFO:teuthology.orchestra.run.smithi161.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 444 kB/s | 80 kB 00:00 2024-09-18T12:41:04.487 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:04.487 INFO:teuthology.orchestra.run.smithi161.stdout:Total 3.4 MB/s | 976 kB 00:00 2024-09-18T12:41:04.499 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:41:04.521 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:41:04.521 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:41:04.601 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:41:04.602 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:41:04.797 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:41:04.947 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T12:41:05.010 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-18T12:41:05.657 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-18T12:41:05.657 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:19.2.0-0.el9.x86_64 1/2 2024-09-18T12:41:05.943 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T12:41:05.943 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:05.943 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:41:05.943 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:19.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T12:41:05.943 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:05.944 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:06.163 INFO:teuthology.orchestra.run.smithi045.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-18T12:41:06.165 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:06.166 INFO:teuthology.orchestra.run.smithi045.stdout:Total 2.7 MB/s | 7.0 MB 00:02 2024-09-18T12:41:06.241 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:41:06.254 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:41:06.254 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:41:06.264 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librados-devel 2024-09-18T12:41:06.360 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:41:06.361 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:41:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:41:06.861 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:24 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:06.870 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T12:41:06.916 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T12:41:06.998 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:06.998 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:06.998 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:06.998 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:06.998 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:41:06.999 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:19.2.0-0.el9 ceph 126 k 2024-09-18T12:41:06.999 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:06.999 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:41:06.999 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:06.999 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-09-18T12:41:06.999 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:07.000 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 126 k 2024-09-18T12:41:07.000 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 456 k 2024-09-18T12:41:07.000 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:41:07.041 INFO:teuthology.orchestra.run.smithi161.stdout:librados-devel-19.2.0-0.el9.x86_64.rpm 3.0 MB/s | 126 kB 00:00 2024-09-18T12:41:07.041 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:07.042 INFO:teuthology.orchestra.run.smithi161.stdout:Total 2.9 MB/s | 126 kB 00:00 2024-09-18T12:41:07.042 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:41:07.048 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:41:07.048 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:41:07.112 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:41:07.113 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:41:07.262 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:41:07.363 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:07.488 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T12:41:07.571 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T12:41:07.643 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T12:41:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-18T12:41:07.857 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:08.102 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:08.102 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:08.102 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:41:08.102 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:19.2.0-0.el9.x86_64 2024-09-18T12:41:08.103 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:08.103 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:08.386 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install libcephfs2 2024-09-18T12:41:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-18T12:41:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 1/6 2024-09-18T12:41:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T12:41:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T12:41:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T12:41:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T12:41:08.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T12:41:08.663 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:08.663 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:41:08.663 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 2024-09-18T12:41:08.663 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T12:41:08.663 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T12:41:08.663 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T12:41:08.663 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T12:41:08.663 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T12:41:08.664 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:08.664 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:08.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-fuse 2024-09-18T12:41:08.974 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:09.064 INFO:teuthology.orchestra.run.smithi161.stdout:Package libcephfs2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:09.110 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:09.111 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-09-18T12:41:09.111 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:09.173 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install libcephfs-devel 2024-09-18T12:41:09.503 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:28 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:09.642 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:09.642 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:09.642 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:09.642 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:09.643 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:41:09.643 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:19.2.0-0.el9 ceph 896 k 2024-09-18T12:41:09.643 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-18T12:41:09.643 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T12:41:09.643 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:09.643 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:41:09.643 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:09.643 INFO:teuthology.orchestra.run.smithi045.stdout:Install 2 Packages 2024-09-18T12:41:09.643 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:09.644 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 976 k 2024-09-18T12:41:09.644 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 2.9 M 2024-09-18T12:41:09.644 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:41:09.725 INFO:teuthology.orchestra.run.smithi045.stdout:(1/2): ceph-fuse-19.2.0-0.el9.x86_64.rpm 15 MB/s | 896 kB 00:00 2024-09-18T12:41:09.752 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:27 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:09.837 INFO:teuthology.orchestra.run.smithi045.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 474 kB/s | 80 kB 00:00 2024-09-18T12:41:09.838 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:09.838 INFO:teuthology.orchestra.run.smithi045.stdout:Total 5.0 MB/s | 976 kB 00:00 2024-09-18T12:41:09.846 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:41:09.868 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:41:09.868 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:41:09.884 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:09.885 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:09.885 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:09.885 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:09.885 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:41:09.885 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:19.2.0-0.el9 ceph 32 k 2024-09-18T12:41:09.885 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:09.885 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:41:09.885 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:09.885 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-09-18T12:41:09.885 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:09.886 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 32 k 2024-09-18T12:41:09.886 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 142 k 2024-09-18T12:41:09.886 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:41:09.945 INFO:teuthology.orchestra.run.smithi161.stdout:libcephfs-devel-19.2.0-0.el9.x86_64.rpm 539 kB/s | 32 kB 00:00 2024-09-18T12:41:09.945 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:09.945 INFO:teuthology.orchestra.run.smithi161.stdout:Total 528 kB/s | 32 kB 00:00 2024-09-18T12:41:09.945 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:41:09.949 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:41:09.949 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:41:09.953 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:41:09.954 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:41:09.970 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:41:09.971 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:41:10.061 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:41:10.146 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:41:10.166 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:10.298 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T12:41:10.369 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-18T12:41:10.532 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:10.765 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:10.765 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:41:10.765 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:19.2.0-0.el9.x86_64 2024-09-18T12:41:10.765 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:10.765 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:10.949 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librados2 2024-09-18T12:41:11.073 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-18T12:41:11.073 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:19.2.0-0.el9.x86_64 1/2 2024-09-18T12:41:11.346 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T12:41:11.347 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:11.347 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:41:11.347 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:19.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T12:41:11.347 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:11.347 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:11.528 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:11.616 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:11.623 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install librados-devel 2024-09-18T12:41:11.659 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:11.660 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-09-18T12:41:11.660 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:11.723 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librbd1 2024-09-18T12:41:12.238 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:12.300 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:12.374 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:12.375 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:12.375 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:12.375 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:12.376 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:41:12.376 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:19.2.0-0.el9 ceph 126 k 2024-09-18T12:41:12.376 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:12.376 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:41:12.376 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:12.376 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-09-18T12:41:12.376 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:12.376 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 126 k 2024-09-18T12:41:12.376 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 456 k 2024-09-18T12:41:12.376 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:41:12.389 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:12.414 INFO:teuthology.orchestra.run.smithi045.stdout:librados-devel-19.2.0-0.el9.x86_64.rpm 3.3 MB/s | 126 kB 00:00 2024-09-18T12:41:12.414 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:12.415 INFO:teuthology.orchestra.run.smithi045.stdout:Total 3.2 MB/s | 126 kB 00:00 2024-09-18T12:41:12.415 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:41:12.420 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:41:12.421 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:41:12.432 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:12.434 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-09-18T12:41:12.434 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:12.489 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:41:12.489 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:41:12.500 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rados 2024-09-18T12:41:12.643 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:41:12.749 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:13.079 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:13.153 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:13.168 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rados-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:13.211 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:13.212 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-09-18T12:41:13.212 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:13.282 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rgw 2024-09-18T12:41:13.400 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:13.400 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:13.400 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:41:13.401 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:19.2.0-0.el9.x86_64 2024-09-18T12:41:13.401 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:13.401 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:13.652 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install libcephfs2 2024-09-18T12:41:13.864 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:13.953 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rgw-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:13.996 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:13.997 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-09-18T12:41:13.997 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:14.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-cephfs 2024-09-18T12:41:14.260 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:14.355 INFO:teuthology.orchestra.run.smithi045.stdout:Package libcephfs2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:14.401 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:14.403 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-09-18T12:41:14.403 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:14.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install libcephfs-devel 2024-09-18T12:41:14.653 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:14.742 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-cephfs-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:14.785 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:14.786 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-09-18T12:41:14.786 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:14.850 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rbd 2024-09-18T12:41:15.092 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:15.230 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:15.231 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:15.231 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:15.231 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:15.231 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:41:15.231 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:19.2.0-0.el9 ceph 32 k 2024-09-18T12:41:15.231 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:15.231 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:41:15.231 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:15.231 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-09-18T12:41:15.231 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:15.232 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 32 k 2024-09-18T12:41:15.232 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 142 k 2024-09-18T12:41:15.232 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:41:15.277 INFO:teuthology.orchestra.run.smithi045.stdout:libcephfs-devel-19.2.0-0.el9.x86_64.rpm 696 kB/s | 32 kB 00:00 2024-09-18T12:41:15.278 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:15.278 INFO:teuthology.orchestra.run.smithi045.stdout:Total 677 kB/s | 32 kB 00:00 2024-09-18T12:41:15.278 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:41:15.282 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:41:15.282 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:41:15.297 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:41:15.297 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:41:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:41:15.430 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:15.503 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:15.520 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rbd-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:15.563 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:15.564 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-09-18T12:41:15.564 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:15.628 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-fuse 2024-09-18T12:41:15.902 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:16.144 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:16.144 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:16.144 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:41:16.144 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:19.2.0-0.el9.x86_64 2024-09-18T12:41:16.144 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:16.144 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:16.210 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:16.320 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install librados2 2024-09-18T12:41:16.343 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:16.344 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:16.344 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:16.344 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:16.344 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:41:16.344 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:19.2.0-0.el9 ceph 85 k 2024-09-18T12:41:16.344 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:16.344 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:41:16.344 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:16.344 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-09-18T12:41:16.344 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:16.345 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 85 k 2024-09-18T12:41:16.345 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 231 k 2024-09-18T12:41:16.345 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:41:16.389 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-fuse-19.2.0-0.el9.x86_64.rpm 1.9 MB/s | 85 kB 00:00 2024-09-18T12:41:16.390 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:16.390 INFO:teuthology.orchestra.run.smithi161.stdout:Total 1.8 MB/s | 85 kB 00:00 2024-09-18T12:41:16.390 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:41:16.397 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:41:16.397 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:41:16.459 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:41:16.460 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:41:16.615 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:41:16.720 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:16.922 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:17.014 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:17.060 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:17.061 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-09-18T12:41:17.061 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:17.130 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:17.142 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install librbd1 2024-09-18T12:41:17.392 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:17.392 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:17.392 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:41:17.392 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:19.2.0-0.el9.x86_64 2024-09-18T12:41:17.392 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:17.392 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:17.649 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-mirror 2024-09-18T12:41:17.744 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:17.836 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:17.883 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:17.884 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-09-18T12:41:17.884 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:17.961 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install python3-rados 2024-09-18T12:41:18.235 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:18.367 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:19.2.0-0.el9 ceph 3.1 M 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 3.1 M 2024-09-18T12:41:18.368 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 13 M 2024-09-18T12:41:18.369 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:41:18.484 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-mirror-19.2.0-0.el9.x86_64.rpm 27 MB/s | 3.1 MB 00:00 2024-09-18T12:41:18.485 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:18.485 INFO:teuthology.orchestra.run.smithi161.stdout:Total 27 MB/s | 3.1 MB 00:00 2024-09-18T12:41:18.485 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:41:18.493 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:41:18.494 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:41:18.561 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:18.573 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:41:18.574 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:41:18.652 INFO:teuthology.orchestra.run.smithi045.stdout:Package python3-rados-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:18.699 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:18.700 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-09-18T12:41:18.700 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:18.778 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install python3-rgw 2024-09-18T12:41:19.002 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:41:19.152 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:19.177 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:19.177 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:41:19.178 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T12:41:19.178 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:41:19.178 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:41:19.178 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:19.384 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:19.476 INFO:teuthology.orchestra.run.smithi045.stdout:Package python3-rgw-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:19.521 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:19.522 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-09-18T12:41:19.522 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:19.600 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install python3-cephfs 2024-09-18T12:41:20.188 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:20.189 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:20.189 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:41:20.189 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:19.2.0-0.el9.x86_64 2024-09-18T12:41:20.189 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:20.189 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:20.208 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:20.298 INFO:teuthology.orchestra.run.smithi045.stdout:Package python3-cephfs-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:20.343 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:20.344 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-09-18T12:41:20.345 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:20.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install python3-rbd 2024-09-18T12:41:20.437 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-nbd 2024-09-18T12:41:21.023 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:21.034 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 12:39:42 PM UTC. 2024-09-18T12:41:21.118 INFO:teuthology.orchestra.run.smithi045.stdout:Package python3-rbd-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-18T12:41:21.164 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:21.165 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-09-18T12:41:21.165 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:21.168 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-18T12:41:21.169 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:21.169 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:21.169 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:21.169 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-18T12:41:21.169 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:19.2.0-0.el9 ceph 170 k 2024-09-18T12:41:21.169 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:21.169 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-18T12:41:21.170 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-18T12:41:21.170 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-09-18T12:41:21.170 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:21.170 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 170 k 2024-09-18T12:41:21.170 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 494 k 2024-09-18T12:41:21.170 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-18T12:41:21.220 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-nbd-19.2.0-0.el9.x86_64.rpm 3.3 MB/s | 170 kB 00:00 2024-09-18T12:41:21.221 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:21.221 INFO:teuthology.orchestra.run.smithi161.stdout:Total 3.2 MB/s | 170 kB 00:00 2024-09-18T12:41:21.221 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-18T12:41:21.229 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-18T12:41:21.229 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-18T12:41:21.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install rbd-fuse 2024-09-18T12:41:21.296 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-18T12:41:21.297 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-18T12:41:21.462 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-18T12:41:21.570 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:21.856 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:21.995 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:21.996 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:21.996 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:21.996 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:21.996 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:41:21.996 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:19.2.0-0.el9 ceph 85 k 2024-09-18T12:41:21.996 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:21.996 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:41:21.996 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:21.997 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-09-18T12:41:21.997 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:21.997 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 85 k 2024-09-18T12:41:21.997 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 231 k 2024-09-18T12:41:21.997 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:41:22.012 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:22.048 INFO:teuthology.orchestra.run.smithi045.stdout:rbd-fuse-19.2.0-0.el9.x86_64.rpm 1.6 MB/s | 85 kB 00:00 2024-09-18T12:41:22.048 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:22.049 INFO:teuthology.orchestra.run.smithi045.stdout:Total 1.6 MB/s | 85 kB 00:00 2024-09-18T12:41:22.049 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:41:22.057 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:41:22.058 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:41:22.125 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:41:22.125 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:41:22.266 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:22.266 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:22.266 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-18T12:41:22.266 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:19.2.0-0.el9.x86_64 2024-09-18T12:41:22.266 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:41:22.266 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-18T12:41:22.290 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:41:22.399 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:22.536 DEBUG:teuthology.parallel:result is None 2024-09-18T12:41:22.799 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:23.068 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:23.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:23.069 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:41:23.069 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:19.2.0-0.el9.x86_64 2024-09-18T12:41:23.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:23.069 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:23.291 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install rbd-mirror 2024-09-18T12:41:23.894 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:42 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:24.032 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:24.033 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:24.033 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:24.033 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:24.033 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:41:24.033 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:19.2.0-0.el9 ceph 3.1 M 2024-09-18T12:41:24.033 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:24.033 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:41:24.034 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:24.034 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-09-18T12:41:24.034 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:24.034 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 3.1 M 2024-09-18T12:41:24.034 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 13 M 2024-09-18T12:41:24.034 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:41:24.128 INFO:teuthology.orchestra.run.smithi045.stdout:rbd-mirror-19.2.0-0.el9.x86_64.rpm 33 MB/s | 3.1 MB 00:00 2024-09-18T12:41:24.129 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:24.129 INFO:teuthology.orchestra.run.smithi045.stdout:Total 32 MB/s | 3.1 MB 00:00 2024-09-18T12:41:24.129 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:41:24.139 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:41:24.139 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:41:24.224 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:41:24.224 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:41:24.679 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:41:24.762 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:24.788 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T12:41:24.789 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T12:41:24.789 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:41:24.789 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T12:41:24.789 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:25.889 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:25.889 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:25.889 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:41:25.889 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:19.2.0-0.el9.x86_64 2024-09-18T12:41:25.889 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:25.889 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:26.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install rbd-nbd 2024-09-18T12:41:26.760 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:45 ago on Wed 18 Sep 2024 12:39:41 PM UTC. 2024-09-18T12:41:26.899 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-18T12:41:26.899 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:19.2.0-0.el9 ceph 170 k 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 170 k 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 494 k 2024-09-18T12:41:26.900 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-18T12:41:26.950 INFO:teuthology.orchestra.run.smithi045.stdout:rbd-nbd-19.2.0-0.el9.x86_64.rpm 3.4 MB/s | 170 kB 00:00 2024-09-18T12:41:26.950 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:41:26.951 INFO:teuthology.orchestra.run.smithi045.stdout:Total 3.3 MB/s | 170 kB 00:00 2024-09-18T12:41:26.951 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-18T12:41:26.959 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-18T12:41:26.959 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-18T12:41:27.026 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-18T12:41:27.028 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-18T12:41:27.203 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-18T12:41:27.309 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:27.728 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:28.001 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-18T12:41:28.001 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:28.002 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-18T12:41:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:19.2.0-0.el9.x86_64 2024-09-18T12:41:28.002 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:41:28.002 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-18T12:41:28.231 DEBUG:teuthology.parallel:result is None 2024-09-18T12:41:28.231 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:41:28.231 INFO:teuthology.packaging:ref: None 2024-09-18T12:41:28.232 INFO:teuthology.packaging:tag: None 2024-09-18T12:41:28.232 INFO:teuthology.packaging:branch: squid 2024-09-18T12:41:28.232 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:41:28.232 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T12:41:28.445 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T12:41:28.471 INFO:teuthology.orchestra.run.smithi045.stdout:19.2.0-0.el9 2024-09-18T12:41:28.472 INFO:teuthology.packaging:The installed version of ceph is 19.2.0-0.el9 2024-09-18T12:41:28.472 INFO:teuthology.task.install:The correct ceph version 19.2.0-0 is installed. 2024-09-18T12:41:28.475 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:41:28.475 INFO:teuthology.packaging:ref: None 2024-09-18T12:41:28.475 INFO:teuthology.packaging:tag: None 2024-09-18T12:41:28.476 INFO:teuthology.packaging:branch: squid 2024-09-18T12:41:28.476 INFO:teuthology.packaging:sha1: e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:41:28.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-18T12:41:28.718 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T12:41:28.745 INFO:teuthology.orchestra.run.smithi161.stdout:19.2.0-0.el9 2024-09-18T12:41:28.745 INFO:teuthology.packaging:The installed version of ceph is 19.2.0-0.el9 2024-09-18T12:41:28.745 INFO:teuthology.task.install:The correct ceph version 19.2.0-0 is installed. 2024-09-18T12:41:28.747 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T12:41:28.747 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:41:28.747 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T12:41:28.781 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:41:28.781 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T12:41:28.816 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T12:41:28.816 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:41:28.816 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T12:41:28.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T12:41:28.945 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:41:28.945 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T12:41:28.975 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T12:41:29.043 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T12:41:29.043 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:41:29.043 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T12:41:29.072 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T12:41:29.142 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:41:29.142 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T12:41:29.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T12:41:29.237 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T12:41:29.237 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:41:29.237 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T12:41:29.267 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T12:41:29.336 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:41:29.337 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T12:41:29.364 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T12:41:29.431 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:41:29.440 INFO:teuthology.task.print:**** done install task... 2024-09-18T12:41:29.441 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-18T12:41:29.588 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'} 2024-09-18T12:41:29.589 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-18T12:41:29.590 INFO:tasks.cephadm:Cluster fsid is 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:41:29.590 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-18T12:41:29.590 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-18T12:41:29.590 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi045': '172.21.15.45', 'mon.smithi161': '172.21.15.161'} 2024-09-18T12:41:29.590 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-18T12:41:29.590 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname $(hostname -s) 2024-09-18T12:41:29.622 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname $(hostname -s) 2024-09-18T12:41:29.649 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-18T12:41:29.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:41:29.790 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83115/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4983-ge7fb7b56', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4983.ge7fb7b56'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-17-1213/e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-17 17:21:57.325397', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-17-1213', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-17-1213/e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-18T12:41:30.003 INFO:tasks.util.chacra:got chacra host chacra.ceph.com, ref squid, sha1 8e98666cb045318799c9328f1ae906cc2d724fd2 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-18T12:41:30.004 INFO:tasks.cephadm:Discovered cachra url: https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm 2024-09-18T12:41:30.004 INFO:tasks.cephadm:Downloading cephadm from url: https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm 2024-09-18T12:41:30.005 DEBUG:teuthology.orchestra.run.smithi045:> curl --silent -L https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-18T12:41:30.350 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r--. 1 ubuntu ubuntu 784488 Sep 18 12:41 /home/ubuntu/cephtest/cephadm 2024-09-18T12:41:30.350 DEBUG:teuthology.orchestra.run.smithi161:> curl --silent -L https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-18T12:41:30.676 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r--. 1 ubuntu ubuntu 784488 Sep 18 12:41 /home/ubuntu/cephtest/cephadm 2024-09-18T12:41:30.676 DEBUG:teuthology.orchestra.run.smithi045:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-18T12:41:30.697 DEBUG:teuthology.orchestra.run.smithi161:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-18T12:41:30.731 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-18T12:41:30.731 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-18T12:41:30.739 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-18T12:41:32.286 INFO:teuthology.orchestra.run.smithi045.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-18T12:41:32.394 INFO:teuthology.orchestra.run.smithi161.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-18T12:42:06.817 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-18T12:42:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)", 2024-09-18T12:42:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: "image_id": "ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b", 2024-09-18T12:42:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: "repo_digests": [ 2024-09-18T12:42:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3" 2024-09-18T12:42:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-18T12:42:06.818 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-18T12:42:24.955 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:42:24.955 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)", 2024-09-18T12:42:24.956 INFO:teuthology.orchestra.run.smithi045.stdout: "image_id": "ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b", 2024-09-18T12:42:24.956 INFO:teuthology.orchestra.run.smithi045.stdout: "repo_digests": [ 2024-09-18T12:42:24.956 INFO:teuthology.orchestra.run.smithi045.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3" 2024-09-18T12:42:24.956 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-18T12:42:24.956 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:42:24.985 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph 2024-09-18T12:42:25.038 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph 2024-09-18T12:42:25.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /etc/ceph 2024-09-18T12:42:25.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /etc/ceph 2024-09-18T12:42:25.143 INFO:tasks.cephadm:Writing seed config... 2024-09-18T12:42:25.144 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-18T12:42:25.144 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-18T12:42:25.144 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-18T12:42:25.144 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-18T12:42:25.144 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-18T12:42:25.144 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-18T12:42:25.144 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-18T12:42:25.144 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-18T12:42:25.145 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-18T12:42:25.146 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-18T12:42:25.146 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-18T12:42:25.146 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-18T12:42:25.146 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-18T12:42:25.146 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-18T12:42:25.146 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:42:25.147 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-18T12:42:25.163 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 53bb6910-75bb-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-18T12:42:25.164 DEBUG:teuthology.orchestra.run.smithi045:mon.smithi045> sudo journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi045.service 2024-09-18T12:42:25.206 INFO:tasks.cephadm:Bootstrapping... 2024-09-18T12:42:25.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.45 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-18T12:42:25.417 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-18T12:42:25.417 INFO:teuthology.orchestra.run.smithi045.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.45', '--skip-admin-label'] 2024-09-18T12:42:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-18T12:42:25.417 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying podman|docker is present... 2024-09-18T12:42:25.440 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stdout 5.2.2 2024-09-18T12:42:25.440 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying lvm2 is present... 2024-09-18T12:42:25.441 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying time synchronization is in place... 2024-09-18T12:42:25.448 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-18T12:42:25.449 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-18T12:42:25.455 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-18T12:42:25.455 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-18T12:42:25.462 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout enabled 2024-09-18T12:42:25.469 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout active 2024-09-18T12:42:25.469 INFO:teuthology.orchestra.run.smithi045.stdout:Unit chronyd.service is enabled and running 2024-09-18T12:42:25.469 INFO:teuthology.orchestra.run.smithi045.stdout:Repeating the final host check... 2024-09-18T12:42:25.492 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stdout 5.2.2 2024-09-18T12:42:25.492 INFO:teuthology.orchestra.run.smithi045.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-18T12:42:25.492 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl is present 2024-09-18T12:42:25.492 INFO:teuthology.orchestra.run.smithi045.stdout:lvcreate is present 2024-09-18T12:42:25.499 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-18T12:42:25.499 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-18T12:42:25.505 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-18T12:42:25.506 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-18T12:42:25.513 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout enabled 2024-09-18T12:42:25.519 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout active 2024-09-18T12:42:25.519 INFO:teuthology.orchestra.run.smithi045.stdout:Unit chronyd.service is enabled and running 2024-09-18T12:42:25.520 INFO:teuthology.orchestra.run.smithi045.stdout:Host looks OK 2024-09-18T12:42:25.520 INFO:teuthology.orchestra.run.smithi045.stdout:Cluster fsid: 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:25.520 INFO:teuthology.orchestra.run.smithi045.stdout:Acquiring lock 140456770361184 on /run/cephadm/53bb6910-75bb-11ef-bceb-c7b262605968.lock 2024-09-18T12:42:25.520 INFO:teuthology.orchestra.run.smithi045.stdout:Lock 140456770361184 acquired on /run/cephadm/53bb6910-75bb-11ef-bceb-c7b262605968.lock 2024-09-18T12:42:25.520 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying IP 172.21.15.45 port 3300 ... 2024-09-18T12:42:25.520 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying IP 172.21.15.45 port 6789 ... 2024-09-18T12:42:25.521 INFO:teuthology.orchestra.run.smithi045.stdout:Base mon IP(s) is [172.21.15.45:3300, 172.21.15.45:6789], mon addrv is [v2:172.21.15.45:3300,v1:172.21.15.45:6789] 2024-09-18T12:42:25.523 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.45 metric 100 2024-09-18T12:42:25.523 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.45 metric 100 2024-09-18T12:42:25.526 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-18T12:42:25.526 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-18T12:42:25.527 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-09-18T12:42:25.529 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-18T12:42:25.529 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-18T12:42:25.530 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-18T12:42:25.530 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-18T12:42:25.530 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:12be/64 scope link 2024-09-18T12:42:25.530 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-18T12:42:25.530 INFO:teuthology.orchestra.run.smithi045.stdout:Mon IP `172.21.15.45` is in CIDR network `172.21.0.0/20` 2024-09-18T12:42:25.530 INFO:teuthology.orchestra.run.smithi045.stdout:Mon IP `172.21.15.45` is in CIDR network `172.21.0.0/20` 2024-09-18T12:42:25.530 INFO:teuthology.orchestra.run.smithi045.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-18T12:42:25.530 INFO:teuthology.orchestra.run.smithi045.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-18T12:42:25.531 INFO:teuthology.orchestra.run.smithi045.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-18T12:42:26.016 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stdout ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b 2024-09-18T12:42:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-18T12:42:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Getting image source signatures 2024-09-18T12:42:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Copying blob sha256:83d928f919f2c1e0c1bd6bccd6df0f26dec4d40362b4c5deccad70d7b002219d 2024-09-18T12:42:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-18T12:42:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Copying config sha256:ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b 2024-09-18T12:42:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-18T12:42:26.996 INFO:teuthology.orchestra.run.smithi045.stdout:ceph: stdout ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable) 2024-09-18T12:42:26.996 INFO:teuthology.orchestra.run.smithi045.stdout:Ceph version: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable) 2024-09-18T12:42:26.996 INFO:teuthology.orchestra.run.smithi045.stdout:Extracting ceph user uid/gid from container image... 2024-09-18T12:42:27.993 INFO:teuthology.orchestra.run.smithi045.stdout:stat: stdout 167 167 2024-09-18T12:42:27.994 INFO:teuthology.orchestra.run.smithi045.stdout:Creating initial keys... 2024-09-18T12:42:28.882 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph-authtool: stdout AQC0yupmiOdwEhAASiZjy3tLsJ/cJeezOo/X+A== 2024-09-18T12:42:29.781 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph-authtool: stdout AQC1yupmxnB0DBAAhcCVMoLRRinSw3m5H3wZ4A== 2024-09-18T12:42:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph-authtool: stdout AQC2yupmsEHaBRAAb/6ALwC5NN5Pj9hpbkvgFg== 2024-09-18T12:42:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:Creating initial monmap... 2024-09-18T12:42:31.751 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-18T12:42:31.751 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-18T12:42:31.751 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:31.751 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-18T12:42:31.752 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool for smithi045 [v2:172.21.15.45:3300,v1:172.21.15.45:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-18T12:42:31.752 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = quincy 2024-09-18T12:42:31.752 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: set fsid to 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:31.752 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-18T12:42:31.752 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:42:31.752 INFO:teuthology.orchestra.run.smithi045.stdout:Creating mon... 2024-09-18T12:42:32.641 INFO:teuthology.orchestra.run.smithi045.stdout:create mon.smithi045 on 2024-09-18T12:42:32.869 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-18T12:42:33.018 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-18T12:42:33.227 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-53bb6910-75bb-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-53bb6910-75bb-11ef-bceb-c7b262605968.target. 2024-09-18T12:42:33.227 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-53bb6910-75bb-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-53bb6910-75bb-11ef-bceb-c7b262605968.target. 2024-09-18T12:42:33.479 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi045 2024-09-18T12:42:33.479 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to reset failed state of unit ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi045.service: Unit ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi045.service not loaded. 2024-09-18T12:42:33.656 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-53bb6910-75bb-11ef-bceb-c7b262605968.target.wants/ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi045.service → /etc/systemd/system/ceph-53bb6910-75bb-11ef-bceb-c7b262605968@.service. 2024-09-18T12:42:34.198 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:42:34.199 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-09-18T12:42:34.206 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:42:34.206 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-18T12:42:34.206 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-09-18T12:42:34.206 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to enable service . firewalld.service is not available 2024-09-18T12:42:34.207 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mon to start... 2024-09-18T12:42:34.207 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mon... 2024-09-18T12:42:34.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:34 smithi045 systemd[1]: Started Ceph mon.smithi045 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:42:35.203 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout cluster: 2024-09-18T12:42:35.203 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout id: 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:35.203 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-18T12:42:35.203 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout services: 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi045 (age 0.537905s) 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout data: 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout pgs: 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:mon is available 2024-09-18T12:42:35.204 INFO:teuthology.orchestra.run.smithi045.stdout:Assimilating anything we can from ceph.conf... 2024-09-18T12:42:35.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: mon.smithi045 is new leader, mons smithi045 in quorum (ranks 0) 2024-09-18T12:42:35.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: monmap epoch 1 2024-09-18T12:42:35.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:35.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: last_changed 2024-09-18T12:42:31.142831+0000 2024-09-18T12:42:35.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: created 2024-09-18T12:42:31.142831+0000 2024-09-18T12:42:35.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: min_mon_release 19 (squid) 2024-09-18T12:42:35.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: election_strategy: 1 2024-09-18T12:42:35.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.smithi045 2024-09-18T12:42:35.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: fsmap 2024-09-18T12:42:35.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: osdmap e1: 0 total, 0 up, 0 in 2024-09-18T12:42:35.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: mgrmap e1: no daemons active 2024-09-18T12:42:35.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:35 smithi045 ceph-mon[27946]: from='client.? 172.21.15.45:0/1886233998' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-18T12:42:36.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:36.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [global] 2024-09-18T12:42:36.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout fsid = 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:36.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.45:3300,v1:172.21.15.45:6789] 2024-09-18T12:42:36.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-18T12:42:36.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [osd] 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-18T12:42:36.194 INFO:teuthology.orchestra.run.smithi045.stdout:Generating new minimal ceph.conf... 2024-09-18T12:42:36.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:36 smithi045 ceph-mon[27946]: from='client.? 172.21.15.45:0/4258006087' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-18T12:42:36.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:36 smithi045 ceph-mon[27946]: from='client.? 172.21.15.45:0/4258006087' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-18T12:42:37.207 INFO:teuthology.orchestra.run.smithi045.stdout:Restarting the monitor... 2024-09-18T12:42:37.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:37 smithi045 ceph-mon[27946]: from='client.? 172.21.15.45:0/1142029820' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:42:37.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:37 smithi045 systemd[1]: Stopping Ceph mon.smithi045 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:42:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:37 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045[27942]: 2024-09-18T12:42:37.480+0000 7f20f8ea7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi045 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:42:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:37 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045[27942]: 2024-09-18T12:42:37.480+0000 7f20f8ea7640 -1 mon.smithi045@0(leader) e1 *** Got Signal Terminated *** 2024-09-18T12:42:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:37 smithi045 podman[28188]: 2024-09-18 12:42:37.676135385 +0000 UTC m=+0.299466149 container died 8039444ea02fd21f07d100d945bd66571a1ba3522cc92f6ba72f9a1a27b1fd64 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:42:38.191 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 podman[28188]: 2024-09-18 12:42:38.022439303 +0000 UTC m=+0.645770065 container cleanup 8039444ea02fd21f07d100d945bd66571a1ba3522cc92f6ba72f9a1a27b1fd64 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-18T12:42:38.191 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 bash[28188]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045 2024-09-18T12:42:38.191 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 podman[28200]: 2024-09-18 12:42:38.19000889 +0000 UTC m=+0.508091747 container remove 8039444ea02fd21f07d100d945bd66571a1ba3522cc92f6ba72f9a1a27b1fd64 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-18T12:42:38.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi045.service: Deactivated successfully. 2024-09-18T12:42:38.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 systemd[1]: Stopped Ceph mon.smithi045 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:42:38.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 systemd[1]: Starting Ceph mon.smithi045 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:42:38.864 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 podman[28296]: 2024-09-18 12:42:38.516161592 +0000 UTC m=+0.016068942 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:squid 2024-09-18T12:42:38.864 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 podman[28296]: 2024-09-18 12:42:38.632670906 +0000 UTC m=+0.132578257 container create b2c8b9524366c919d136da33858df1aaa2c8c83f6be16e34470266b54a52337a (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 podman[28296]: 2024-09-18 12:42:38.826635233 +0000 UTC m=+0.326542591 container init b2c8b9524366c919d136da33858df1aaa2c8c83f6be16e34470266b54a52337a (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 podman[28296]: 2024-09-18 12:42:38.829797201 +0000 UTC m=+0.329704554 container start b2c8b9524366c919d136da33858df1aaa2c8c83f6be16e34470266b54a52337a (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: pidfile_write: ignore empty --pid-file 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: load: jerasure load: lrc 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: RocksDB version: 7.9.2 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Git sha 0 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: DB SUMMARY 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: DB Session ID: 3QKR9QK7R1QOL42HDDJL 2024-09-18T12:42:38.865 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: CURRENT file: CURRENT 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi045/store.db dir, Total Num: 1, files: 000008.sst 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi045/store.db: 000009.log size: 95837 ; 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.error_if_exists: 0 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.create_if_missing: 0 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.paranoid_checks: 1 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.env: 0x560ae09c9940 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T12:42:38.866 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.info_log: 0x560ae25a58c0 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.statistics: (nil) 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.use_fsync: 0 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_log_file_size: 0 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.allow_fallocate: 1 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.use_direct_reads: 0 2024-09-18T12:42:38.867 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.db_log_dir: 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.wal_dir: 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.write_buffer_manager: 0x560ae25b4dc0 2024-09-18T12:42:38.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T12:42:38.869 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T12:42:38.869 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T12:42:38.869 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T12:42:38.869 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T12:42:38.869 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T12:42:38.869 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T12:42:38.870 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T12:42:38.870 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.unordered_write: 0 2024-09-18T12:42:38.870 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T12:42:38.870 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T12:42:38.870 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.row_cache: None 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.wal_filter: None 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.two_write_queues: 0 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.wal_compression: 0 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.atomic_flush: 0 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T12:42:38.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.log_readahead_size: 0 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_background_jobs: 2 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_background_compactions: -1 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_subcompactions: 1 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T12:42:38.872 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_open_files: -1 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_background_flushes: -1 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Compression algorithms supported: 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: kZSTD supported: 0 2024-09-18T12:42:38.873 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: kXpressCompression supported: 0 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: kBZip2Compression supported: 0 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: kLZ4Compression supported: 1 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: kZlibCompression supported: 1 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: kSnappyCompression supported: 1 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi045/store.db/MANIFEST-000010 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.merge_operator: 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_filter: None 2024-09-18T12:42:38.874 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560ae25a5520) 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: cache_index_and_filter_blocks: 1 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: pin_top_level_index_and_filter: 1 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: index_type: 0 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: data_block_index_type: 0 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: index_shortening: 1 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: checksum: 4 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: no_block_cache: 0 2024-09-18T12:42:38.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_cache: 0x560ae25991f0 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_cache_name: BinnedLRUCache 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_cache_options: 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: capacity : 536870912 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: num_shard_bits : 4 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: strict_capacity_limit : 0 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: high_pri_pool_ratio: 0.000 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_cache_compressed: (nil) 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: persistent_cache: (nil) 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_size: 4096 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_size_deviation: 10 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_restart_interval: 16 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: index_block_restart_interval: 1 2024-09-18T12:42:38.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: metadata_block_size: 4096 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: partition_filters: 0 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: use_delta_encoding: 1 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: filter_policy: bloomfilter 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: whole_key_filtering: 1 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: verify_compression: 0 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: read_amp_bytes_per_bit: 0 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: format_version: 5 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: enable_index_compression: 1 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_align: 0 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: max_auto_readahead_size: 262144 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: prepopulate_block_cache: 0 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: initial_auto_readahead_size: 8192 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T12:42:38.877 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compression: NoCompression 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.num_levels: 7 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T12:42:38.878 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:42:38.879 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T12:42:38.880 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T12:42:38.881 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T12:42:38.881 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T12:42:38.881 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T12:42:38.881 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T12:42:38.881 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T12:42:38.881 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T12:42:38.881 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T12:42:38.881 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T12:42:38.881 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:42:38.882 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.ttl: 2592000 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:42:38.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi045/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 581d8cf1-85ad-4934-9ce5-71aad0cb895e 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663358857223, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663358858637, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91838, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89879, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11912, "raw_average_key_size": 48, "raw_value_size": 83247, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726663358, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "581d8cf1-85ad-4934-9ce5-71aad0cb895e", "db_session_id": "3QKR9QK7R1QOL42HDDJL", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:42:38.884 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663358858773, "job": 1, "event": "recovery_finished"} 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi045/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560ae25c6e00 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: DB pointer 0x560ae26c2000 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ** DB Stats ** 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:42:38.885 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ** Compaction Stats [default] ** 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: L0 2/0 91.58 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Sum 2/0 91.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ** Compaction Stats [default] ** 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 102.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:42:38.886 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Cumulative compaction: 0.00 GB write, 19.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Interval compaction: 0.00 GB write, 19.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Block cache BinnedLRUCache@0x560ae25991f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:42:38.887 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: starting mon.smithi045 rank 0 at public addrs [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] at bind addrs [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi045 fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: mon.smithi045@-1(???) e1 preinit fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: mon.smithi045@-1(???).mds e1 new map 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: mon.smithi045@-1(???).mds e1 print_map 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: e1 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: btime 2024-09-18T12:42:34:157662+0000 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: legacy client fscid: -1 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: No filesystems configured 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: mon.smithi045@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: mon.smithi045@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:42:38.888 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: mon.smithi045@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:42:38.889 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: mon.smithi045@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:42:38.889 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: mon.smithi045@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-18T12:42:38.932 INFO:teuthology.orchestra.run.smithi045.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-18T12:42:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: mon.smithi045 is new leader, mons smithi045 in quorum (ranks 0) 2024-09-18T12:42:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: monmap epoch 1 2024-09-18T12:42:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: last_changed 2024-09-18T12:42:31.142831+0000 2024-09-18T12:42:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: created 2024-09-18T12:42:31.142831+0000 2024-09-18T12:42:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: min_mon_release 19 (squid) 2024-09-18T12:42:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: election_strategy: 1 2024-09-18T12:42:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.smithi045 2024-09-18T12:42:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: fsmap 2024-09-18T12:42:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: osdmap e1: 0 total, 0 up, 0 in 2024-09-18T12:42:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 ceph-mon[28315]: mgrmap e1: no daemons active 2024-09-18T12:42:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 bash[28296]: b2c8b9524366c919d136da33858df1aaa2c8c83f6be16e34470266b54a52337a 2024-09-18T12:42:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:38 smithi045 systemd[1]: Started Ceph mon.smithi045 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:42:40.228 INFO:teuthology.orchestra.run.smithi045.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-18T12:42:40.249 INFO:teuthology.orchestra.run.smithi045.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-18T12:42:40.250 INFO:teuthology.orchestra.run.smithi045.stdout:Creating mgr... 2024-09-18T12:42:40.250 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-18T12:42:40.251 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-18T12:42:40.251 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-18T12:42:40.517 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mgr.smithi045.brvbvl 2024-09-18T12:42:40.517 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to reset failed state of unit ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mgr.smithi045.brvbvl.service: Unit ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mgr.smithi045.brvbvl.service not loaded. 2024-09-18T12:42:40.685 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-53bb6910-75bb-11ef-bceb-c7b262605968.target.wants/ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mgr.smithi045.brvbvl.service → /etc/systemd/system/ceph-53bb6910-75bb-11ef-bceb-c7b262605968@.service. 2024-09-18T12:42:40.936 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:40 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3023719089' entity='client.admin' 2024-09-18T12:42:41.252 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:42:41.252 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-09-18T12:42:41.259 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:42:41.260 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-18T12:42:41.260 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-09-18T12:42:41.260 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to enable service . firewalld.service is not available 2024-09-18T12:42:41.268 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:42:41.269 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-09-18T12:42:41.276 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:42:41.276 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-18T12:42:41.276 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-09-18T12:42:41.277 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-18T12:42:41.277 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr to start... 2024-09-18T12:42:41.277 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr... 2024-09-18T12:42:42.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:41 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/770768379' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T12:42:42.264 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsid": "53bb6910-75bb-11ef-bceb-c7b262605968", 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 0 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:42:42.270 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "smithi045" 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T12:42:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T12:42:42.272 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "btime": "2024-09-18T12:42:34:157662+0000", 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:42:42.273 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:42:42.274 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:42.274 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T12:42:42.274 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:42:42.274 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T12:42:34.158303+0000", 2024-09-18T12:42:42.274 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:42:42.274 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:42.274 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T12:42:42.274 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:42:42.274 INFO:teuthology.orchestra.run.smithi045.stdout:mgr not available, waiting (1/15)... 2024-09-18T12:42:46.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: Activating manager daemon smithi045.brvbvl 2024-09-18T12:42:46.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: mgrmap e2: smithi045.brvbvl(active, starting, since 0.00308313s) 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: from='mgr.14100 172.21.15.45:0/503987883' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: from='mgr.14100 172.21.15.45:0/503987883' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: from='mgr.14100 172.21.15.45:0/503987883' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: from='mgr.14100 172.21.15.45:0/503987883' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: from='mgr.14100 172.21.15.45:0/503987883' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi045.brvbvl", "id": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: Manager daemon smithi045.brvbvl is now available 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: from='mgr.14100 172.21.15.45:0/503987883' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: from='mgr.14100 172.21.15.45:0/503987883' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/trash_purge_schedule"}]: dispatch 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: from='mgr.14100 172.21.15.45:0/503987883' entity='mgr.smithi045.brvbvl' 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: from='mgr.14100 172.21.15.45:0/503987883' entity='mgr.smithi045.brvbvl' 2024-09-18T12:42:46.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:46 smithi045 ceph-mon[28315]: from='mgr.14100 172.21.15.45:0/503987883' entity='mgr.smithi045.brvbvl' 2024-09-18T12:42:48.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:48 smithi045 ceph-mon[28315]: mgrmap e3: smithi045.brvbvl(active, since 1.00717s) 2024-09-18T12:42:48.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:48 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3723874776' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T12:42:49.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:49 smithi045 ceph-mon[28315]: mgrmap e4: smithi045.brvbvl(active, since 2s) 2024-09-18T12:42:53.926 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:53.926 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:42:53.926 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsid": "53bb6910-75bb-11ef-bceb-c7b262605968", 2024-09-18T12:42:53.926 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T12:42:53.926 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T12:42:53.926 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T12:42:53.926 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T12:42:53.926 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:53.927 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T12:42:53.927 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T12:42:53.927 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 0 2024-09-18T12:42:53.927 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:42:53.927 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "smithi045" 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T12:42:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T12:42:53.929 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T12:42:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:42:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "btime": "2024-09-18T12:42:34:157662+0000", 2024-09-18T12:42:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T12:42:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T12:42:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T12:42:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T12:42:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T12:42:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T12:42:53.931 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T12:42:53.931 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T12:42:53.931 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T12:42:53.931 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-18T12:42:53.931 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:42:53.931 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:53.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T12:42:53.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T12:42:53.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T12:42:34.158303+0000", 2024-09-18T12:42:53.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T12:42:53.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-18T12:42:53.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T12:42:53.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:42:53.932 INFO:teuthology.orchestra.run.smithi045.stdout:mgr is available 2024-09-18T12:42:56.495 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:56 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2566891962' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-18T12:42:56.773 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:56.775 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [global] 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout fsid = 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.45:3300,v1:172.21.15.45:6789] 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [osd] 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-18T12:42:56.776 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-18T12:42:56.777 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-18T12:42:56.777 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-18T12:42:56.777 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-18T12:42:56.777 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling cephadm module... 2024-09-18T12:42:57.742 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:57 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/831455025' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-18T12:42:58.626 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:58 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/831455025' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-18T12:42:58.626 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:58 smithi045 ceph-mon[28315]: mgrmap e5: smithi045.brvbvl(active, since 11s) 2024-09-18T12:42:59.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:42:59.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-18T12:42:59.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T12:42:59.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "active_name": "smithi045.brvbvl", 2024-09-18T12:42:59.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-18T12:42:59.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:42:59.220 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for the mgr to restart... 2024-09-18T12:42:59.220 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr epoch 5... 2024-09-18T12:42:59.509 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:42:59 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2529789121' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-18T12:43:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: Active manager daemon smithi045.brvbvl restarted 2024-09-18T12:43:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: Activating manager daemon smithi045.brvbvl 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: osdmap e2: 0 total, 0 up, 0 in 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: mgrmap e6: smithi045.brvbvl(active, starting, since 0.00325451s) 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi045.brvbvl", "id": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: Manager daemon smithi045.brvbvl is now available 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: Found migration_current of "None". Setting to last migration. 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:43:02.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:02 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/trash_purge_schedule"}]: dispatch 2024-09-18T12:43:04.036 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:43:04.036 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-18T12:43:04.036 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-18T12:43:04.036 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:43:04.036 INFO:teuthology.orchestra.run.smithi045.stdout:mgr epoch 5 is available 2024-09-18T12:43:04.036 INFO:teuthology.orchestra.run.smithi045.stdout:Setting orchestrator backend to cephadm... 2024-09-18T12:43:04.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:04 smithi045 ceph-mon[28315]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-18T12:43:04.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:04 smithi045 ceph-mon[28315]: mgrmap e7: smithi045.brvbvl(active, since 1.00501s) 2024-09-18T12:43:04.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:04 smithi045 ceph-mon[28315]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-18T12:43:04.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:04 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:04.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:04 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:05.844 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:05 smithi045 ceph-mon[28315]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:05.844 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:05 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:05.844 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:05 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:05 smithi045 ceph-mon[28315]: mgrmap e8: smithi045.brvbvl(active, since 2s) 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:05 smithi045 ceph-mon[28315]: [18/Sep/2024:12:43:05] ENGINE Bus STARTING 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:05 smithi045 ceph-mon[28315]: [18/Sep/2024:12:43:05] ENGINE Serving on https://172.21.15.45:7150 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:05 smithi045 ceph-mon[28315]: [18/Sep/2024:12:43:05] ENGINE Error in HTTPServer.serve 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Traceback (most recent call last): 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._run(expiration_interval) 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:43:05.845 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:43:05.846 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:43:05.846 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: s = self.context.wrap_socket( 2024-09-18T12:43:05.846 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:43:05.846 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: return self.sslsocket_class._create( 2024-09-18T12:43:05.846 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:43:05.846 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self.do_handshake() 2024-09-18T12:43:05.846 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:43:05.846 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._sslobj.do_handshake() 2024-09-18T12:43:05.846 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:43:05.846 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:05 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:06.422 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-18T12:43:06.422 INFO:teuthology.orchestra.run.smithi045.stdout:Generating ssh key... 2024-09-18T12:43:06.731 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:06 smithi045 ceph-mon[28315]: [18/Sep/2024:12:43:05] ENGINE Serving on http://172.21.15.45:8765 2024-09-18T12:43:06.731 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:06 smithi045 ceph-mon[28315]: [18/Sep/2024:12:43:05] ENGINE Bus STARTED 2024-09-18T12:43:06.731 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:06 smithi045 ceph-mon[28315]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:08 smithi045 ceph-mon[28315]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:08 smithi045 ceph-mon[28315]: Generating ssh key... 2024-09-18T12:43:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:08 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:08 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:09.117 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdxrcV/RflLzOMGaJpPDb/b2NSS57POZsZmTXmQQc/eyaa/jy3aD1LJQF+mOAxmCBHrs2EEVqhgIUx+rMso6bxAkLTIWtsjvluPLr3xxs7Lc06woXWHKZgrVRvfyl4fXTQUQ5ExMumk6/CILSHcju5oAaiE0Tn3YGKblvcl+dGniVgdmMc2J7TGDdbnM8GEHnCxWUYiLs0gkaOrlqjjHIpPVpCNcQWyweDsix44fXm389N9zoSZu7NPJDuW/4Fl+lrXsC/s5tK37kNH1DCEEwqIpRCW3j6uEorD6Oo3CCTB8znBrxYRc3ZtORq0q+Ahy0TRudaoU8GoHj6YPcahWXjGuplIDoXcgLrBmZiCRgjf7e8ZvuKhInZ0wqJZBdNxzkQWtNq2OzfGkHKfcJIq8DAQQ6TgySAUHe6UIenxStBNIS3N4tZQ4R9T67OhGUJynhgWFi/sykHsYwnpRD8mfRs8ferRw67krrgWnRCMtP+kbeDUEoGMbbjIIOxNJFPFH0= ceph-53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:43:09.118 INFO:teuthology.orchestra.run.smithi045.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-18T12:43:09.118 INFO:teuthology.orchestra.run.smithi045.stdout:Adding key to root@localhost authorized_keys... 2024-09-18T12:43:09.128 INFO:teuthology.orchestra.run.smithi045.stdout:Adding host smithi045... 2024-09-18T12:43:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:09 smithi045 ceph-mon[28315]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:10.768 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:10 smithi045 ceph-mon[28315]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi045", "addr": "172.21.15.45", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:11.685 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:11 smithi045 ceph-mon[28315]: Deploying cephadm binary to smithi045 2024-09-18T12:43:14.492 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Added host 'smithi045' with addr '172.21.15.45' 2024-09-18T12:43:14.492 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying mon service with default placement... 2024-09-18T12:43:15.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:14 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:15.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:14 smithi045 ceph-mon[28315]: Added host smithi045 2024-09-18T12:43:15.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:14 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:15.883 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-18T12:43:15.883 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying mgr service with default placement... 2024-09-18T12:43:16.175 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:16 smithi045 ceph-mon[28315]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:16.175 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:16 smithi045 ceph-mon[28315]: Saving service mon spec with placement count:5 2024-09-18T12:43:16.175 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:16 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:17.401 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-18T12:43:17.401 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying crash service with default placement... 2024-09-18T12:43:17.717 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:17 smithi045 ceph-mon[28315]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:17.717 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:17 smithi045 ceph-mon[28315]: Saving service mgr spec with placement count:2 2024-09-18T12:43:17.717 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:17 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:18.750 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-18T12:43:18.750 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying ceph-exporter service with default placement... 2024-09-18T12:43:19.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:19 smithi045 ceph-mon[28315]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:19.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:19 smithi045 ceph-mon[28315]: Saving service crash spec with placement * 2024-09-18T12:43:19.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:19 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:19.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:19 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:19.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:19 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:20.440 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:20 smithi045 ceph-mon[28315]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:20.441 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:20 smithi045 ceph-mon[28315]: Saving service ceph-exporter spec with placement * 2024-09-18T12:43:20.441 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:20 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:20.441 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:20 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:20.442 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-18T12:43:20.442 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying prometheus service with default placement... 2024-09-18T12:43:21.682 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-18T12:43:21.682 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying grafana service with default placement... 2024-09-18T12:43:22.201 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:21 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:22.201 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:21 smithi045 ceph-mon[28315]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:22.201 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:21 smithi045 ceph-mon[28315]: Saving service prometheus spec with placement count:1 2024-09-18T12:43:22.201 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:21 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:22.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-18T12:43:22.807 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying node-exporter service with default placement... 2024-09-18T12:43:23.441 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:23 smithi045 ceph-mon[28315]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:23.441 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:23 smithi045 ceph-mon[28315]: Saving service grafana spec with placement count:1 2024-09-18T12:43:23.441 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:23 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:23.441 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:23 smithi045 ceph-mon[28315]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:24.055 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-18T12:43:24.055 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying alertmanager service with default placement... 2024-09-18T12:43:24.439 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:24 smithi045 ceph-mon[28315]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:24.439 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:24 smithi045 ceph-mon[28315]: Saving service node-exporter spec with placement * 2024-09-18T12:43:24.439 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:24 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:25.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-18T12:43:25.581 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:25 smithi045 ceph-mon[28315]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:25.581 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:25 smithi045 ceph-mon[28315]: from='mgr.14116 172.21.15.45:0/2760365195' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:26.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:26 smithi045 ceph-mon[28315]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:26.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:26 smithi045 ceph-mon[28315]: Saving service alertmanager spec with placement count:1 2024-09-18T12:43:26.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:26 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/369356338' entity='client.admin' 2024-09-18T12:43:27.646 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:27 smithi045 ceph-mon[28315]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:27.647 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:27 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/938318978' entity='client.admin' 2024-09-18T12:43:27.892 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling the dashboard module... 2024-09-18T12:43:29.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:28 smithi045 ceph-mon[28315]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:29.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:28 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1050179194' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-18T12:43:30.777 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:30 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1050179194' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-18T12:43:30.777 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:30 smithi045 ceph-mon[28315]: mgrmap e9: smithi045.brvbvl(active, since 27s) 2024-09-18T12:43:31.354 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:43:31.354 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-18T12:43:31.354 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T12:43:31.354 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "active_name": "smithi045.brvbvl", 2024-09-18T12:43:31.355 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-18T12:43:31.355 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:43:31.355 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for the mgr to restart... 2024-09-18T12:43:31.355 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr epoch 9... 2024-09-18T12:43:31.602 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:31 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1011243405' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-18T12:43:34.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: Active manager daemon smithi045.brvbvl restarted 2024-09-18T12:43:34.875 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: Activating manager daemon smithi045.brvbvl 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: osdmap e3: 0 total, 0 up, 0 in 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: mgrmap e10: smithi045.brvbvl(active, starting, since 0.00338644s) 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi045.brvbvl", "id": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: Manager daemon smithi045.brvbvl is now available 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:43:34.876 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:34 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/trash_purge_schedule"}]: dispatch 2024-09-18T12:43:36.554 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-18T12:43:36.554 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-18T12:43:36.554 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-18T12:43:36.554 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-18T12:43:36.554 INFO:teuthology.orchestra.run.smithi045.stdout:mgr epoch 9 is available 2024-09-18T12:43:36.554 INFO:teuthology.orchestra.run.smithi045.stdout:Generating a dashboard self-signed certificate... 2024-09-18T12:43:36.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:36 smithi045 ceph-mon[28315]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-18T12:43:36.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:36 smithi045 ceph-mon[28315]: mgrmap e11: smithi045.brvbvl(active, since 1.00586s) 2024-09-18T12:43:36.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:36 smithi045 ceph-mon[28315]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-18T12:43:36.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:36 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:38.010 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-18T12:43:38.010 INFO:teuthology.orchestra.run.smithi045.stdout:Creating initial admin user... 2024-09-18T12:43:38.242 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:37 smithi045 ceph-mon[28315]: mgrmap e12: smithi045.brvbvl(active, since 2s) 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:37 smithi045 ceph-mon[28315]: [18/Sep/2024:12:43:37] ENGINE Bus STARTING 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:37 smithi045 ceph-mon[28315]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:37 smithi045 ceph-mon[28315]: [18/Sep/2024:12:43:37] ENGINE Serving on http://172.21.15.45:8765 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:37 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:37 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:37 smithi045 ceph-mon[28315]: [18/Sep/2024:12:43:37] ENGINE Serving on https://172.21.15.45:7150 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:37 smithi045 ceph-mon[28315]: [18/Sep/2024:12:43:37] ENGINE Bus STARTED 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:37 smithi045 ceph-mon[28315]: [18/Sep/2024:12:43:37] ENGINE Error in HTTPServer.serve 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Traceback (most recent call last): 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:43:38.243 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._run(expiration_interval) 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: s = self.context.wrap_socket( 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: return self.sslsocket_class._create( 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self.do_handshake() 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._sslobj.do_handshake() 2024-09-18T12:43:38.244 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:43:38.245 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:37 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:40.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:39 smithi045 ceph-mon[28315]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:40.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:39 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:40.055 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$7ox7ALzSUK9/f6W1A8E4IugWYgS8i3N0y7d9457KJG3q1ahOGkrfq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726663418, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-18T12:43:40.055 INFO:teuthology.orchestra.run.smithi045.stdout:Fetching dashboard port number... 2024-09-18T12:43:41.132 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:40 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/63931817' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-18T12:43:41.135 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 8443 2024-09-18T12:43:41.145 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T12:43:41.145 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-09-18T12:43:41.153 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T12:43:41.153 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-18T12:43:41.153 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-09-18T12:43:41.153 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-18T12:43:41.155 INFO:teuthology.orchestra.run.smithi045.stdout:Ceph Dashboard is now available at: 2024-09-18T12:43:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: URL: https://smithi045.front.sepia.ceph.com:8443/ 2024-09-18T12:43:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: User: admin 2024-09-18T12:43:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: Password: bbxzu9c9bz 2024-09-18T12:43:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:41.156 INFO:teuthology.orchestra.run.smithi045.stdout:Saving cluster configuration to /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config directory 2024-09-18T12:43:42.129 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:41 smithi045 ceph-mon[28315]: mgrmap e13: smithi045.brvbvl(active, since 6s) 2024-09-18T12:43:42.130 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:41 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3213444205' entity='client.admin' 2024-09-18T12:43:42.391 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout:Or, if you are only running a single cluster on this host: 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: ceph telemetry on 2024-09-18T12:43:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:42.393 INFO:teuthology.orchestra.run.smithi045.stdout:For more information see: 2024-09-18T12:43:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-18T12:43:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:42.393 INFO:teuthology.orchestra.run.smithi045.stdout:Bootstrap complete. 2024-09-18T12:43:42.434 INFO:tasks.cephadm:Fetching config... 2024-09-18T12:43:42.434 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:43:42.434 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-18T12:43:42.451 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-18T12:43:42.451 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:43:42.451 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-18T12:43:42.507 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-18T12:43:42.507 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:43:42.507 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/keyring of=/dev/stdout 2024-09-18T12:43:42.573 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-18T12:43:42.573 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:43:42.573 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-18T12:43:42.628 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-18T12:43:42.629 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdxrcV/RflLzOMGaJpPDb/b2NSS57POZsZmTXmQQc/eyaa/jy3aD1LJQF+mOAxmCBHrs2EEVqhgIUx+rMso6bxAkLTIWtsjvluPLr3xxs7Lc06woXWHKZgrVRvfyl4fXTQUQ5ExMumk6/CILSHcju5oAaiE0Tn3YGKblvcl+dGniVgdmMc2J7TGDdbnM8GEHnCxWUYiLs0gkaOrlqjjHIpPVpCNcQWyweDsix44fXm389N9zoSZu7NPJDuW/4Fl+lrXsC/s5tK37kNH1DCEEwqIpRCW3j6uEorD6Oo3CCTB8znBrxYRc3ZtORq0q+Ahy0TRudaoU8GoHj6YPcahWXjGuplIDoXcgLrBmZiCRgjf7e8ZvuKhInZ0wqJZBdNxzkQWtNq2OzfGkHKfcJIq8DAQQ6TgySAUHe6UIenxStBNIS3N4tZQ4R9T67OhGUJynhgWFi/sykHsYwnpRD8mfRs8ferRw67krrgWnRCMtP+kbeDUEoGMbbjIIOxNJFPFH0= ceph-53bb6910-75bb-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-18T12:43:42.704 INFO:teuthology.orchestra.run.smithi045.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdxrcV/RflLzOMGaJpPDb/b2NSS57POZsZmTXmQQc/eyaa/jy3aD1LJQF+mOAxmCBHrs2EEVqhgIUx+rMso6bxAkLTIWtsjvluPLr3xxs7Lc06woXWHKZgrVRvfyl4fXTQUQ5ExMumk6/CILSHcju5oAaiE0Tn3YGKblvcl+dGniVgdmMc2J7TGDdbnM8GEHnCxWUYiLs0gkaOrlqjjHIpPVpCNcQWyweDsix44fXm389N9zoSZu7NPJDuW/4Fl+lrXsC/s5tK37kNH1DCEEwqIpRCW3j6uEorD6Oo3CCTB8znBrxYRc3ZtORq0q+Ahy0TRudaoU8GoHj6YPcahWXjGuplIDoXcgLrBmZiCRgjf7e8ZvuKhInZ0wqJZBdNxzkQWtNq2OzfGkHKfcJIq8DAQQ6TgySAUHe6UIenxStBNIS3N4tZQ4R9T67OhGUJynhgWFi/sykHsYwnpRD8mfRs8ferRw67krrgWnRCMtP+kbeDUEoGMbbjIIOxNJFPFH0= ceph-53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:43:42.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdxrcV/RflLzOMGaJpPDb/b2NSS57POZsZmTXmQQc/eyaa/jy3aD1LJQF+mOAxmCBHrs2EEVqhgIUx+rMso6bxAkLTIWtsjvluPLr3xxs7Lc06woXWHKZgrVRvfyl4fXTQUQ5ExMumk6/CILSHcju5oAaiE0Tn3YGKblvcl+dGniVgdmMc2J7TGDdbnM8GEHnCxWUYiLs0gkaOrlqjjHIpPVpCNcQWyweDsix44fXm389N9zoSZu7NPJDuW/4Fl+lrXsC/s5tK37kNH1DCEEwqIpRCW3j6uEorD6Oo3CCTB8znBrxYRc3ZtORq0q+Ahy0TRudaoU8GoHj6YPcahWXjGuplIDoXcgLrBmZiCRgjf7e8ZvuKhInZ0wqJZBdNxzkQWtNq2OzfGkHKfcJIq8DAQQ6TgySAUHe6UIenxStBNIS3N4tZQ4R9T67OhGUJynhgWFi/sykHsYwnpRD8mfRs8ferRw67krrgWnRCMtP+kbeDUEoGMbbjIIOxNJFPFH0= ceph-53bb6910-75bb-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-18T12:43:42.783 INFO:teuthology.orchestra.run.smithi161.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdxrcV/RflLzOMGaJpPDb/b2NSS57POZsZmTXmQQc/eyaa/jy3aD1LJQF+mOAxmCBHrs2EEVqhgIUx+rMso6bxAkLTIWtsjvluPLr3xxs7Lc06woXWHKZgrVRvfyl4fXTQUQ5ExMumk6/CILSHcju5oAaiE0Tn3YGKblvcl+dGniVgdmMc2J7TGDdbnM8GEHnCxWUYiLs0gkaOrlqjjHIpPVpCNcQWyweDsix44fXm389N9zoSZu7NPJDuW/4Fl+lrXsC/s5tK37kNH1DCEEwqIpRCW3j6uEorD6Oo3CCTB8znBrxYRc3ZtORq0q+Ahy0TRudaoU8GoHj6YPcahWXjGuplIDoXcgLrBmZiCRgjf7e8ZvuKhInZ0wqJZBdNxzkQWtNq2OzfGkHKfcJIq8DAQQ6TgySAUHe6UIenxStBNIS3N4tZQ4R9T67OhGUJynhgWFi/sykHsYwnpRD8mfRs8ferRw67krrgWnRCMtP+kbeDUEoGMbbjIIOxNJFPFH0= ceph-53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:43:42.796 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-18T12:43:43.053 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:43:44.320 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-18T12:43:44.320 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-18T12:43:44.823 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:43:44.969 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:44 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/865399328' entity='client.admin' 2024-09-18T12:43:46.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:45 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:46.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:45 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:46.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:45 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi045", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:43:46.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:45 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:46.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:45 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi045", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:43:46.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:45 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi045", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:43:46.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:45 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:46.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:45 smithi045 ceph-mon[28315]: Deploying daemon ceph-exporter.smithi045 on smithi045 2024-09-18T12:43:46.930 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi161 2024-09-18T12:43:46.931 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:43:46.931 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.conf 2024-09-18T12:43:46.949 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:43:46.949 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:43:47.007 INFO:tasks.cephadm:Adding host smithi161 to orchestrator... 2024-09-18T12:43:47.008 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph orch host add smithi161 2024-09-18T12:43:47.068 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:46 smithi045 ceph-mon[28315]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:47.068 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:46 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:48.118 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:43:50.709 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:50 smithi045 ceph-mon[28315]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:43:50.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:50 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:50.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:50 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:50.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:50 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:50.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:50 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:50.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:50 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi045", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:43:50.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:50 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi045", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-18T12:43:50.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:50 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:43:50.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:50 smithi045 ceph-mon[28315]: Deploying daemon crash.smithi045 on smithi045 2024-09-18T12:43:50.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:50 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:51.622 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:51 smithi045 ceph-mon[28315]: Deploying cephadm binary to smithi161 2024-09-18T12:43:52.875 INFO:teuthology.orchestra.run.smithi045.stdout:Added host 'smithi161' with addr '172.21.15.161' 2024-09-18T12:43:53.185 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:53 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:53.185 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:53 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:53.185 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:53 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:53.185 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:53 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:53.185 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:53 smithi045 ceph-mon[28315]: Deploying daemon node-exporter.smithi045 on smithi045 2024-09-18T12:43:53.185 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:53 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:53.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-18T12:43:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:43:54.189 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:54 smithi045 ceph-mon[28315]: Added host smithi161 2024-09-18T12:43:54.506 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:43:54.506 INFO:teuthology.orchestra.run.smithi045.stdout:[{"addr": "172.21.15.45", "hostname": "smithi045", "labels": [], "status": ""}, {"addr": "172.21.15.161", "hostname": "smithi161", "labels": [], "status": ""}] 2024-09-18T12:43:55.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:55 smithi045 ceph-mon[28315]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:43:55.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:55 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:55.914 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-18T12:43:55.914 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-18T12:43:56.142 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:56 smithi045 ceph-mon[28315]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:56.524 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:43:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2024-09-18T12:43:58.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:57 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:58.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:57 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:58.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:57 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:58.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:57 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:43:58.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:57 smithi045 ceph-mon[28315]: Deploying daemon alertmanager.smithi045 on smithi045 2024-09-18T12:43:58.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:57 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2929767010' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-18T12:43:58.563 INFO:tasks.cephadm:Adding mon.smithi045 on smithi045 2024-09-18T12:43:58.563 INFO:tasks.cephadm:Adding mon.smithi161 on smithi161 2024-09-18T12:43:58.563 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi045:172.21.15.45=smithi045;smithi161:172.21.15.161=smithi161' 2024-09-18T12:43:58.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:58 smithi045 ceph-mon[28315]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:43:58.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:58 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2929767010' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-18T12:43:58.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:43:58 smithi045 ceph-mon[28315]: osdmap e4: 0 total, 0 up, 0 in 2024-09-18T12:43:58.811 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:43:58.856 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:43:59.440 INFO:teuthology.orchestra.run.smithi161.stdout:Scheduled mon update... 2024-09-18T12:43:59.956 DEBUG:teuthology.orchestra.run.smithi161:mon.smithi161> sudo journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi161.service 2024-09-18T12:43:59.959 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:43:59.959 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:00.230 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:00.275 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:00.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:00 smithi045 ceph-mon[28315]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:00.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:00 smithi045 ceph-mon[28315]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi045:172.21.15.45=smithi045;smithi161:172.21.15.161=smithi161", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:44:00.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:00 smithi045 ceph-mon[28315]: Saving service mon spec with placement smithi045:172.21.15.45=smithi045;smithi161:172.21.15.161=smithi161;count:2 2024-09-18T12:44:00.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:00 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:00.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:00 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:00.873 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:00.873 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:00.873 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:01.663 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:01 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/2627535067' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:02.429 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:02.430 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:02.675 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:02.697 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:02 smithi045 ceph-mon[28315]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:02.719 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:03.405 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:03.405 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:03.405 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:03 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/9616859' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:04.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:04 smithi045 ceph-mon[28315]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:04.983 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:04.983 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:05.228 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:05.884 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:05.884 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:05.884 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:06.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:06.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:06.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:06.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:06.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:06.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:06.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:06.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-18T12:44:06.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:06.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:06.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T12:44:06.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T12:44:06.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:06.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: Deploying daemon grafana.smithi045 on smithi045 2024-09-18T12:44:06.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:06 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/993149121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:07.456 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:07.456 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:07.699 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:07.744 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:08.366 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:08.366 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:08.366 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:08.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:08 smithi045 ceph-mon[28315]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:09.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:09 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/3245389225' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:09.912 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:09.913 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:10.150 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:10.194 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:10.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:10 smithi045 ceph-mon[28315]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:10.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:10 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:10.819 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:10.819 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:10.820 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:11.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:11 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/3550416800' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:12.216 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:12 smithi045 ceph-mon[28315]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:12.424 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:12.425 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:12.667 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:12.712 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:13.460 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:13.460 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:13.460 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:14.194 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:14 smithi045 ceph-mon[28315]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:14.194 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:14 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/188435333' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:15.060 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:15.060 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:15.297 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:15.341 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:15.970 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:15.970 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:15.970 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:16.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:16.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:16.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:16.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:16.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:16.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:16.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:16.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:16.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:16.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: Deploying daemon prometheus.smithi045 on smithi045 2024-09-18T12:44:16.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:16 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/3987056246' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:17.504 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:17.504 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:17.749 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:17.792 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:18.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:18 smithi045 ceph-mon[28315]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:18.741 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:18.741 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:18.741 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:19.274 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:19 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/1236964502' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:20.251 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:20.251 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:20.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:20 smithi045 ceph-mon[28315]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:20.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:20 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:20.493 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:20.538 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:21.174 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:21.174 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:21.174 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:22.215 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:22 smithi045 ceph-mon[28315]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:22.215 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:22 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/3395098490' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:22.825 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:22.825 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:23.067 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:23.112 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:23.740 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:23.740 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:23.741 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:24.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:24 smithi045 ceph-mon[28315]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:24.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:24 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/3651818576' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:25.262 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:25.262 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:25.497 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:25.542 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:26.169 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:26.169 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:26.169 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:26.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:26 smithi045 ceph-mon[28315]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:26.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:26 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:26.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:26 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:26.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:26 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:26.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:26 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-18T12:44:26.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:26 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/3340889906' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:27.768 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:27.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:27 smithi045 ceph-mon[28315]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-18T12:44:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:27 smithi045 ceph-mon[28315]: mgrmap e14: smithi045.brvbvl(active, since 51s) 2024-09-18T12:44:28.014 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:28.691 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:28.691 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:28.691 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:29.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:28 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/4200581353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:30.281 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:30.282 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:30.528 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:30.572 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:31.195 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:31.195 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:31.195 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:31.529 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:31 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/1866345569' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: Active manager daemon smithi045.brvbvl restarted 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: Activating manager daemon smithi045.brvbvl 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: mgrmap e15: smithi045.brvbvl(active, starting, since 0.0031448s) 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi045.brvbvl", "id": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: Manager daemon smithi045.brvbvl is now available 2024-09-18T12:44:32.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:32.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:32.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:32.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:44:32.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/trash_purge_schedule"}]: dispatch 2024-09-18T12:44:32.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:32.830 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:32.830 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:33.104 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:33.777 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:33.777 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:33.777 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:33 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:33 smithi045 ceph-mon[28315]: mgrmap e16: smithi045.brvbvl(active, since 1.00654s) 2024-09-18T12:44:34.992 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:34 smithi045 ceph-mon[28315]: [18/Sep/2024:12:44:33] ENGINE Bus STARTING 2024-09-18T12:44:34.992 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:34 smithi045 ceph-mon[28315]: [18/Sep/2024:12:44:33] ENGINE Serving on http://172.21.15.45:8765 2024-09-18T12:44:34.992 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:34 smithi045 ceph-mon[28315]: [18/Sep/2024:12:44:33] ENGINE Serving on https://172.21.15.45:7150 2024-09-18T12:44:34.992 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:34 smithi045 ceph-mon[28315]: [18/Sep/2024:12:44:33] ENGINE Bus STARTED 2024-09-18T12:44:34.992 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:34 smithi045 ceph-mon[28315]: [18/Sep/2024:12:44:33] ENGINE Error in HTTPServer.serve 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Traceback (most recent call last): 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._run(expiration_interval) 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: s = self.context.wrap_socket( 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: return self.sslsocket_class._create( 2024-09-18T12:44:34.993 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:44:34.994 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self.do_handshake() 2024-09-18T12:44:34.994 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:44:34.994 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._sslobj.do_handshake() 2024-09-18T12:44:34.994 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:44:34.994 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:34 smithi045 ceph-mon[28315]: mgrmap e17: smithi045.brvbvl(active, since 2s) 2024-09-18T12:44:34.994 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:34 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/1380610876' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:34.994 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:34 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:35.370 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:35.370 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:35.733 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:35.785 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T12:44:36.465 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:36.465 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:36.465 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:37.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:37.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:37.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/3424729612' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi045", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:38.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-18T12:44:38.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-18T12:44:38.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:44:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:38.634 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:38.634 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:39.099 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:44:39.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:39 smithi045 ceph-mon[28315]: Deploying daemon ceph-exporter.smithi161 on smithi161 2024-09-18T12:44:39.891 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:39.891 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:39.891 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:40.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:40 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/1931445651' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:41.506 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:41.507 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:42.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:42.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:42.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:42.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:42.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:44:42.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-18T12:44:42.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:42.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:41 smithi045 ceph-mon[28315]: Deploying daemon crash.smithi161 on smithi161 2024-09-18T12:44:42.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:42.323 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:44:43.191 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:43.191 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:43.191 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:43.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:43 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/1618133927' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:44.975 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:44.975 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:45.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:44 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:45.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:44 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:45.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:44 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:45.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:44 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:45.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:44 smithi045 ceph-mon[28315]: Deploying daemon node-exporter.smithi161 on smithi161 2024-09-18T12:44:45.226 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:44:46.147 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:46.147 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:46.147 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:46.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:46 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/3370758608' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:48.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:47 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:48.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:47 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:48.392 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:48.392 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:49.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:48 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:49.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:48 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:49.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:48 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:49.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:48 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:49.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:48 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.yoflkm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:44:49.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:48 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.yoflkm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-18T12:44:49.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:48 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:44:49.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:48 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:49.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:48 smithi045 ceph-mon[28315]: Deploying daemon mgr.smithi161.yoflkm on smithi161 2024-09-18T12:44:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:44:50.104 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:50.104 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:50.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:50 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/1825582094' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:51.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:51.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:51.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:44:51.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:51.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:51 smithi045 ceph-mon[28315]: Deploying daemon mon.smithi161 on smithi161 2024-09-18T12:44:51.975 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:51.975 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:52.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:52 smithi045 ceph-mon[28315]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:52.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:44:53.693 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:44:53.694 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:42:31.142831Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T12:44:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-09-18T12:44:54.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:53 smithi045 ceph-mon[28315]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:54.893 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:44:54 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/4174803678' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:54.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:44:54.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:44:54.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:44:54.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:44:54.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:44:54.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:44:54.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:44:54.944 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:44:54.945 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.ttl: 2592000 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:44:54.946 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c5b14271-9da6-43ab-9834-34b7fa2680ed 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663494940283, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663494940689, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726663494, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c5b14271-9da6-43ab-9834-34b7fa2680ed", "db_session_id": "7Z1952JCCQCZJ1JEFV2U", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726663494940783, "job": 1, "event": "recovery_finished"} 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi161/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:44:54.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557a7c2f6e00 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: DB pointer 0x557a7c3f2000 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** DB Stats ** 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2024-09-18T12:44:54.948 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:44:54.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:44:54.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-18T12:44:54.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-18T12:44:54.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-18T12:44:54.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:44:54.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2024-09-18T12:44:54.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:44:54.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:44:54.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Block cache BinnedLRUCache@0x557a7c2c91f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-18T12:44:54.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-18T12:44:54.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:44:54.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:44:54.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161 does not exist in monmap, will attempt to join an existing cluster 2024-09-18T12:44:54.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: using public_addr v2:172.21.15.161:0/0 -> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] 2024-09-18T12:44:54.951 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: starting mon.smithi161 rank -1 at public addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] at bind addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi161 fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:44:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(???) e0 preinit fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:44:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).mds e1 new map 2024-09-18T12:44:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).mds e1 print_map 2024-09-18T12:44:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: e1 2024-09-18T12:44:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: btime 2024-09-18T12:42:34:157662+0000 2024-09-18T12:44:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:44:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:44:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: legacy client fscid: -1 2024-09-18T12:44:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:44:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: No filesystems configured 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Deploying daemon alertmanager.smithi045 on smithi045 2024-09-18T12:44:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2929767010' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-18T12:44:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2929767010' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-18T12:44:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: osdmap e4: 0 total, 0 up, 0 in 2024-09-18T12:44:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi045:172.21.15.45=smithi045;smithi161:172.21.15.161=smithi161", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:44:55.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Saving service mon spec with placement smithi045:172.21.15.45=smithi045;smithi161:172.21.15.161=smithi161;count:2 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/2627535067' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/9616859' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Deploying daemon grafana.smithi045 on smithi045 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/993149121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/3245389225' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/3550416800' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/188435333' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Deploying daemon prometheus.smithi045 on smithi045 2024-09-18T12:44:55.299 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/3987056246' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/1236964502' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/3395098490' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/3651818576' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.300 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/3340889906' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14160 172.21.15.45:0/1461087719' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mgrmap e14: smithi045.brvbvl(active, since 51s) 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/4200581353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/1866345569' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Active manager daemon smithi045.brvbvl restarted 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Activating manager daemon smithi045.brvbvl 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mgrmap e15: smithi045.brvbvl(active, starting, since 0.0031448s) 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi045.brvbvl", "id": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:44:55.301 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Manager daemon smithi045.brvbvl is now available 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/trash_purge_schedule"}]: dispatch 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mgrmap e16: smithi045.brvbvl(active, since 1.00654s) 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: [18/Sep/2024:12:44:33] ENGINE Bus STARTING 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: [18/Sep/2024:12:44:33] ENGINE Serving on http://172.21.15.45:8765 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: [18/Sep/2024:12:44:33] ENGINE Serving on https://172.21.15.45:7150 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: [18/Sep/2024:12:44:33] ENGINE Bus STARTED 2024-09-18T12:44:55.302 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: [18/Sep/2024:12:44:33] ENGINE Error in HTTPServer.serve 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Traceback (most recent call last): 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self._run(expiration_interval) 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: s = self.context.wrap_socket( 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: return self.sslsocket_class._create( 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:44:55.303 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self.do_handshake() 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self._sslobj.do_handshake() 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mgrmap e17: smithi045.brvbvl(active, since 2s) 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/1380610876' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/3424729612' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:55.304 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi045", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.305 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Deploying daemon ceph-exporter.smithi161 on smithi161 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/1931445651' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:44:55.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Deploying daemon crash.smithi161 on smithi161 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/1618133927' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Deploying daemon node-exporter.smithi161 on smithi161 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/3370758608' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.307 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.yoflkm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.yoflkm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Deploying daemon mgr.smithi161.yoflkm on smithi161 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/1825582094' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: Deploying daemon mon.smithi161 on smithi161 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:44:55.308 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:44:55.309 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/4174803678' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:44:55.309 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 ceph-mon[35784]: mon.smithi161@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-18T12:44:55.309 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 bash[35765]: 34d6a3464162a729e8e8c147ce3c5ee1e52895c8da5666407d112accd00fb3da 2024-09-18T12:44:55.309 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:44:54 smithi161 systemd[1]: Started Ceph mon.smithi161 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:44:55.515 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T12:44:55.515 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T12:44:55.760 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi161/config 2024-09-18T12:45:00.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:45:00.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: mon.smithi045 calling monitor election 2024-09-18T12:45:00.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/259658670' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/crt"}]: dispatch 2024-09-18T12:45:00.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:00.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: mon.smithi161 calling monitor election 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: mon.smithi045 is new leader, mons smithi045,smithi161 in quorum (ranks 0,1) 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: monmap epoch 2 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: last_changed 2024-09-18T12:44:54.970577+0000 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: created 2024-09-18T12:42:31.142831+0000 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: min_mon_release 19 (squid) 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: election_strategy: 1 2024-09-18T12:45:00.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.smithi045 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: 1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.smithi161 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: fsmap 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: mgrmap e17: smithi045.brvbvl(active, since 28s) 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: overall HEALTH_OK 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: Standby manager daemon smithi161.yoflkm started 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/259658670' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/259658670' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/key"}]: dispatch 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/259658670' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:00.287 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:00.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:45:00.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: mon.smithi045 calling monitor election 2024-09-18T12:45:00.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/259658670' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/crt"}]: dispatch 2024-09-18T12:45:00.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: mon.smithi161 calling monitor election 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: mon.smithi045 is new leader, mons smithi045,smithi161 in quorum (ranks 0,1) 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: monmap epoch 2 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: last_changed 2024-09-18T12:44:54.970577+0000 2024-09-18T12:45:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: created 2024-09-18T12:42:31.142831+0000 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: min_mon_release 19 (squid) 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: election_strategy: 1 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.smithi045 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: 1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.smithi161 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: fsmap 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: mgrmap e17: smithi045.brvbvl(active, since 28s) 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: overall HEALTH_OK 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: Standby manager daemon smithi161.yoflkm started 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/259658670' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/259658670' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/key"}]: dispatch 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/259658670' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:45:00.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:00.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:00.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:00.854 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:45:00.854 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":2,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","modified":"2024-09-18T12:44:54.970577Z","created":"2024-09-18T12:42:31.142831Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi045","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi161","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-18T12:45:00.854 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 2 2024-09-18T12:45:01.195 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:01 smithi161 ceph-mon[35784]: mgrmap e18: smithi045.brvbvl(active, since 28s), standbys: smithi161.yoflkm 2024-09-18T12:45:01.195 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:01 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi161.yoflkm", "id": "smithi161.yoflkm"}]: dispatch 2024-09-18T12:45:01.195 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:01 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:01.195 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:01 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/1129181244' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:45:01.195 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:01 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:01 smithi045 ceph-mon[28315]: mgrmap e18: smithi045.brvbvl(active, since 28s), standbys: smithi161.yoflkm 2024-09-18T12:45:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:01 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi161.yoflkm", "id": "smithi161.yoflkm"}]: dispatch 2024-09-18T12:45:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:01 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:01 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/1129181244' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T12:45:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:01 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:45:01.832 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-18T12:45:01.832 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-18T12:45:02.074 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:02 smithi161 ceph-mon[35784]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:02.074 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:02.074 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:02.103 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:02.224 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:02 smithi045 ceph-mon[28315]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:02.224 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:02.224 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:02.747 INFO:teuthology.orchestra.run.smithi045.stdout:# minimal ceph.conf for 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:45:02.747 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2024-09-18T12:45:02.748 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:45:02.748 INFO:teuthology.orchestra.run.smithi045.stdout: mon_host = [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] 2024-09-18T12:45:03.634 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-18T12:45:03.634 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:45:03.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.conf 2024-09-18T12:45:03.662 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:45:03.663 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:45:03.728 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:45:03.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.conf 2024-09-18T12:45:03.759 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:45:03.759 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:45:03.826 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-18T12:45:03.826 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-18T12:45:03.828 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-18T12:45:03.829 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set client debug_client 20 2024-09-18T12:45:03.848 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:03.848 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:03.848 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2251341024' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: Reconfiguring mon.smithi045 (unknown last config time)... 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:45:03.849 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:45:03.850 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:03.850 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: Reconfiguring daemon mon.smithi045 on smithi045 2024-09-18T12:45:03.850 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:03 smithi045 ceph-mon[28315]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:03.850 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-18T12:45:03.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set client debug_ms 1 2024-09-18T12:45:03.893 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-18T12:45:03.893 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-18T12:45:03.936 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-18T12:45:03.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-18T12:45:03.979 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-18T12:45:03.979 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-18T12:45:04.023 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-18T12:45:04.024 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-18T12:45:04.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:04.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:04.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:04.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2251341024' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: Reconfiguring mon.smithi045 (unknown last config time)... 2024-09-18T12:45:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:45:04.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:45:04.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:04.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: Reconfiguring daemon mon.smithi045 on smithi045 2024-09-18T12:45:04.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:03 smithi161 ceph-mon[35784]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:04.067 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-18T12:45:04.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-18T12:45:04.111 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-18T12:45:04.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-18T12:45:04.155 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-18T12:45:04.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-18T12:45:04.199 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-18T12:45:04.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-18T12:45:04.244 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-18T12:45:04.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-18T12:45:04.287 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-18T12:45:04.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-18T12:45:04.332 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-18T12:45:04.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-18T12:45:04.378 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-18T12:45:04.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-18T12:45:04.431 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-18T12:45:04.431 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-18T12:45:04.475 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-18T12:45:04.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-18T12:45:04.522 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-18T12:45:04.522 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-18T12:45:04.574 DEBUG:tasks.cephadm:set 18 configs 2024-09-18T12:45:04.574 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi045') 2024-09-18T12:45:05.243 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:05.248 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:05.253 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:05.253 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:05.260 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:05.260 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:05.260 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:05.270 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:06.276 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:06.277 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:06.277 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:06 smithi045 ceph-mon[28315]: Reconfiguring mgr.smithi045.brvbvl (unknown last config time)... 2024-09-18T12:45:06.277 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi045.brvbvl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:45:06.277 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:45:06.277 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:06.277 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:06 smithi045 ceph-mon[28315]: Reconfiguring daemon mgr.smithi045.brvbvl on smithi045 2024-09-18T12:45:06.277 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:06 smithi045 ceph-mon[28315]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:06.481 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:06.481 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:06.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:06.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:06.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:06 smithi161 ceph-mon[35784]: Reconfiguring mgr.smithi045.brvbvl (unknown last config time)... 2024-09-18T12:45:06.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi045.brvbvl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:45:06.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:45:06.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:06.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:06 smithi161 ceph-mon[35784]: Reconfiguring daemon mgr.smithi045.brvbvl on smithi045 2024-09-18T12:45:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:06 smithi161 ceph-mon[35784]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:06.585 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:06.593 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:07.361 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:07 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3121190517' entity='client.admin' 2024-09-18T12:45:07.361 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:07 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/652507074' entity='client.admin' 2024-09-18T12:45:07.361 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:07 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2958416543' entity='client.admin' 2024-09-18T12:45:07.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:07 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3121190517' entity='client.admin' 2024-09-18T12:45:07.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:07 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/652507074' entity='client.admin' 2024-09-18T12:45:07.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:07 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2958416543' entity='client.admin' 2024-09-18T12:45:08.141 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi045') 2024-09-18T12:45:08.390 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:08 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2819553944' entity='client.admin' 2024-09-18T12:45:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:08 smithi045 ceph-mon[28315]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:08 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2819553944' entity='client.admin' 2024-09-18T12:45:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:08 smithi161 ceph-mon[35784]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:09.729 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:09 smithi045 ceph-mon[28315]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:10.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:09 smithi161 ceph-mon[35784]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:11.201 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:10 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2971552248' entity='client.admin' 2024-09-18T12:45:11.201 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:10 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3639732265' entity='client.admin' 2024-09-18T12:45:11.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:10 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2971552248' entity='client.admin' 2024-09-18T12:45:11.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:10 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3639732265' entity='client.admin' 2024-09-18T12:45:12.283 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:11 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3774974323' entity='client.admin' 2024-09-18T12:45:12.283 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:11 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2370362947' entity='client.admin' 2024-09-18T12:45:12.283 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:11 smithi045 ceph-mon[28315]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:12.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:11 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3774974323' entity='client.admin' 2024-09-18T12:45:12.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:11 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2370362947' entity='client.admin' 2024-09-18T12:45:12.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:11 smithi161 ceph-mon[35784]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:13.818 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:13 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3540485649' entity='client.admin' 2024-09-18T12:45:13.818 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:13 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1679375486' entity='client.admin' 2024-09-18T12:45:13.819 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:13 smithi045 ceph-mon[28315]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:13 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3540485649' entity='client.admin' 2024-09-18T12:45:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:13 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1679375486' entity='client.admin' 2024-09-18T12:45:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:13 smithi161 ceph-mon[35784]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:16.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:15 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3363677019' entity='client.admin' 2024-09-18T12:45:16.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:15 smithi045 ceph-mon[28315]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:16.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:15 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3363677019' entity='client.admin' 2024-09-18T12:45:16.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:15 smithi161 ceph-mon[35784]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:16.323 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi045') 2024-09-18T12:45:17.267 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:17 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/4003069879' entity='client.admin' 2024-09-18T12:45:17.267 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:17.267 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:17 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1077760462' entity='client.admin' 2024-09-18T12:45:17.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:17 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/4003069879' entity='client.admin' 2024-09-18T12:45:17.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:17.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:17 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1077760462' entity='client.admin' 2024-09-18T12:45:18.240 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:18 smithi045 ceph-mon[28315]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:18.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:18 smithi161 ceph-mon[35784]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 -- 172.21.15.45:0/792056055 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7b8006e240 msgr2=0x7f7b80070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 --2- 172.21.15.45:0/792056055 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7b8006e240 0x7f7b80070700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b94198900 tx=0x7f7b7c007040 comp rx=0 tx=0).stop 2024-09-18T12:45:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 -- 172.21.15.45:0/792056055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b94102490 msgr2=0x7f7b94197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 --2- 172.21.15.45:0/792056055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b94102490 0x7f7b94197450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7b84006010 tx=0x7f7b840048f0 comp rx=0 tx=0).stop 2024-09-18T12:45:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 -- 172.21.15.45:0/792056055 shutdown_connections 2024-09-18T12:45:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 --2- 172.21.15.45:0/792056055 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7b8006e240 0x7f7b80070700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 --2- 172.21.15.45:0/792056055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b94104dc0 0x7f7b94197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 --2- 172.21.15.45:0/792056055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b94102490 0x7f7b94197450 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 -- 172.21.15.45:0/792056055 >> 172.21.15.45:0/792056055 conn(0x7f7b940fc010 msgr2=0x7f7b940fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:18.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 -- 172.21.15.45:0/792056055 shutdown_connections 2024-09-18T12:45:18.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:18.689+0000 7f7b98834640 1 -- 172.21.15.45:0/792056055 wait complete. 2024-09-18T12:45:20.017 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:19 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/4215657851' entity='client.admin' 2024-09-18T12:45:20.017 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:19 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/792056055' entity='client.admin' 2024-09-18T12:45:20.017 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:19 smithi045 ceph-mon[28315]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:20.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:19 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/4215657851' entity='client.admin' 2024-09-18T12:45:20.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:19 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/792056055' entity='client.admin' 2024-09-18T12:45:20.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:19 smithi161 ceph-mon[35784]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:20.248 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.200+0000 7faf0bdd2640 1 -- 172.21.15.45:0/3574406849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf04102450 msgr2=0x7faf04104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.200+0000 7faf0bdd2640 1 --2- 172.21.15.45:0/3574406849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf04102450 0x7faf04104840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faf00009880 tx=0x7faf0002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.200+0000 7faf0bdd2640 1 -- 172.21.15.45:0/3574406849 shutdown_connections 2024-09-18T12:45:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.200+0000 7faf0bdd2640 1 --2- 172.21.15.45:0/3574406849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf04104d80 0x7faf04107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.200+0000 7faf0bdd2640 1 --2- 172.21.15.45:0/3574406849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf04102450 0x7faf04104840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.200+0000 7faf0bdd2640 1 -- 172.21.15.45:0/3574406849 >> 172.21.15.45:0/3574406849 conn(0x7faf040fc010 msgr2=0x7faf040fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:21.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.201+0000 7faf0bdd2640 1 -- 172.21.15.45:0/3574406849 shutdown_connections 2024-09-18T12:45:21.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.201+0000 7faf0bdd2640 1 -- 172.21.15.45:0/3574406849 wait complete. 2024-09-18T12:45:21.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.201+0000 7faf0bdd2640 1 Processor -- start 2024-09-18T12:45:21.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.201+0000 7faf0bdd2640 1 -- start start 2024-09-18T12:45:21.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.201+0000 7faf0bdd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf04102450 0x7faf041974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:21.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.201+0000 7faf0bdd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf04104d80 0x7faf041979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:21.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.201+0000 7faf0bdd2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faf0410a750 con 0x7faf04104d80 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.201+0000 7faf0bdd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7faf0410a5d0 con 0x7faf04102450 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.201+0000 7faf0936d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf04104d80 0x7faf041979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faf0936d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf04104d80 0x7faf041979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47248/0 (socket says 172.21.15.45:47248) 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faf0936d640 1 -- 172.21.15.45:0/560807942 learned_addr learned my addr 172.21.15.45:0/560807942 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faf09b6e640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf04102450 0x7faf041974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faf0936d640 1 -- 172.21.15.45:0/560807942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf04102450 msgr2=0x7faf041974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faf0936d640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf04102450 0x7faf041974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faf0936d640 1 -- 172.21.15.45:0/560807942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf04198060 con 0x7faf04104d80 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faf09b6e640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf04102450 0x7faf041974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faf0936d640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf04104d80 0x7faf041979e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faef400c8f0 tx=0x7faef400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faefaffd640 1 -- 172.21.15.45:0/560807942 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faef40079b0 con 0x7faf04104d80 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faefaffd640 1 -- 172.21.15.45:0/560807942 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faef40054e0 con 0x7faf04104d80 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faf0bdd2640 1 -- 172.21.15.45:0/560807942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0419caa0 con 0x7faf04104d80 2024-09-18T12:45:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faefaffd640 1 -- 172.21.15.45:0/560807942 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faef4004e50 con 0x7faf04104d80 2024-09-18T12:45:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.202+0000 7faf0bdd2640 1 -- 172.21.15.45:0/560807942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0419d030 con 0x7faf04104d80 2024-09-18T12:45:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.203+0000 7faf0bdd2640 1 -- 172.21.15.45:0/560807942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf04102830 con 0x7faf04104d80 2024-09-18T12:45:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.204+0000 7faefaffd640 1 -- 172.21.15.45:0/560807942 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7faef4005000 con 0x7faf04104d80 2024-09-18T12:45:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.204+0000 7faefaffd640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7faef006e370 0x7faef0070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.204+0000 7faefaffd640 1 -- 172.21.15.45:0/560807942 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7faef408d040 con 0x7faf04104d80 2024-09-18T12:45:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.204+0000 7faf09b6e640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7faef006e370 0x7faef0070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.205+0000 7faf09b6e640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7faef006e370 0x7faef0070830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf00005ab0 tx=0x7faf00005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:21.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.209+0000 7faefaffd640 1 -- 172.21.15.45:0/560807942 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faef4014030 con 0x7faf04104d80 2024-09-18T12:45:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.386+0000 7faf0bdd2640 1 -- 172.21.15.45:0/560807942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7faf0419d320 con 0x7faf04104d80 2024-09-18T12:45:21.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.390+0000 7faefaffd640 1 -- 172.21.15.45:0/560807942 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7faef405ba80 con 0x7faf04104d80 2024-09-18T12:45:21.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 -- 172.21.15.45:0/560807942 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7faef006e370 msgr2=0x7faef0070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:21.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7faef006e370 0x7faef0070830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf00005ab0 tx=0x7faf00005a20 comp rx=0 tx=0).stop 2024-09-18T12:45:21.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 -- 172.21.15.45:0/560807942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf04104d80 msgr2=0x7faf041979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:21.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf04104d80 0x7faf041979e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faef400c8f0 tx=0x7faef400cdb0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 -- 172.21.15.45:0/560807942 shutdown_connections 2024-09-18T12:45:21.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7faef006e370 0x7faef0070830 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf04104d80 0x7faf041979e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 --2- 172.21.15.45:0/560807942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf04102450 0x7faf041974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 -- 172.21.15.45:0/560807942 >> 172.21.15.45:0/560807942 conn(0x7faf040fc010 msgr2=0x7faf040fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:21.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 -- 172.21.15.45:0/560807942 shutdown_connections 2024-09-18T12:45:21.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.392+0000 7faf0bdd2640 1 -- 172.21.15.45:0/560807942 wait complete. 2024-09-18T12:45:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.446+0000 7f6130b83640 1 -- 172.21.15.45:0/2211292422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f612c104d20 msgr2=0x7f612c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.446+0000 7f6130b83640 1 --2- 172.21.15.45:0/2211292422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f612c104d20 0x7f612c107110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f61200098b0 tx=0x7f612002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.446+0000 7f6130b83640 1 -- 172.21.15.45:0/2211292422 shutdown_connections 2024-09-18T12:45:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.446+0000 7f6130b83640 1 --2- 172.21.15.45:0/2211292422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f612c104d20 0x7f612c107110 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.446+0000 7f6130b83640 1 --2- 172.21.15.45:0/2211292422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c1023f0 0x7f612c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.446+0000 7f6130b83640 1 -- 172.21.15.45:0/2211292422 >> 172.21.15.45:0/2211292422 conn(0x7f612c0fc010 msgr2=0x7f612c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.446+0000 7f6130b83640 1 -- 172.21.15.45:0/2211292422 shutdown_connections 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.446+0000 7f6130b83640 1 -- 172.21.15.45:0/2211292422 wait complete. 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6130b83640 1 Processor -- start 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6130b83640 1 -- start start 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6130b83640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c1023f0 0x7f612c101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6130b83640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f612c104d20 0x7f612c1003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6130b83640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f612c10a7b0 con 0x7f612c104d20 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6130b83640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f612c10a630 con 0x7f612c1023f0 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6129d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f612c104d20 0x7f612c1003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6129d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f612c104d20 0x7f612c1003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47264/0 (socket says 172.21.15.45:47264) 2024-09-18T12:45:21.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6129d9b640 1 -- 172.21.15.45:0/3706405198 learned_addr learned my addr 172.21.15.45:0/3706405198 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6129d9b640 1 -- 172.21.15.45:0/3706405198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c1023f0 msgr2=0x7f612c101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6129d9b640 1 --2- 172.21.15.45:0/3706405198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c1023f0 0x7f612c101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6129d9b640 1 -- 172.21.15.45:0/3706405198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c1008e0 con 0x7f612c104d20 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.447+0000 7f6129d9b640 1 --2- 172.21.15.45:0/3706405198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f612c104d20 0x7f612c1003a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6120009230 tx=0x7f61200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.448+0000 7f611b7fe640 1 -- 172.21.15.45:0/3706405198 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f612003f070 con 0x7f612c104d20 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.448+0000 7f6130b83640 1 -- 172.21.15.45:0/3706405198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612c100b70 con 0x7f612c104d20 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.448+0000 7f611b7fe640 1 -- 172.21.15.45:0/3706405198 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6120004a50 con 0x7f612c104d20 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.448+0000 7f611b7fe640 1 -- 172.21.15.45:0/3706405198 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6120035030 con 0x7f612c104d20 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.448+0000 7f6130b83640 1 -- 172.21.15.45:0/3706405198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612c1010a0 con 0x7f612c104d20 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.449+0000 7f6130b83640 1 -- 172.21.15.45:0/3706405198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f612c1027d0 con 0x7f612c104d20 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.449+0000 7f611b7fe640 1 -- 172.21.15.45:0/3706405198 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f6120042070 con 0x7f612c104d20 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.450+0000 7f611b7fe640 1 --2- 172.21.15.45:0/3706405198 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f611406e230 0x7f61140706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.450+0000 7f611b7fe640 1 -- 172.21.15.45:0/3706405198 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f61200adbd0 con 0x7f612c104d20 2024-09-18T12:45:21.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.450+0000 7f612a59c640 1 --2- 172.21.15.45:0/3706405198 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f611406e230 0x7f61140706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:21.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.450+0000 7f612a59c640 1 --2- 172.21.15.45:0/3706405198 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f611406e230 0x7f61140706f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f611c005fd0 tx=0x7f611c005850 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:21.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.454+0000 7f611b7fe640 1 -- 172.21.15.45:0/3706405198 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f612007c610 con 0x7f612c104d20 2024-09-18T12:45:21.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.630+0000 7f6130b83640 1 -- 172.21.15.45:0/3706405198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f612c19f5a0 con 0x7f612c104d20 2024-09-18T12:45:21.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.633+0000 7f611b7fe640 1 -- 172.21.15.45:0/3706405198 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v27)=0 v27) ==== 119+0+0 (secure 0 0 0) 0x7f61200802c0 con 0x7f612c104d20 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 -- 172.21.15.45:0/3706405198 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f611406e230 msgr2=0x7f61140706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 --2- 172.21.15.45:0/3706405198 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f611406e230 0x7f61140706f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f611c005fd0 tx=0x7f611c005850 comp rx=0 tx=0).stop 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 -- 172.21.15.45:0/3706405198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f612c104d20 msgr2=0x7f612c1003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 --2- 172.21.15.45:0/3706405198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f612c104d20 0x7f612c1003a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6120009230 tx=0x7f61200045e0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 -- 172.21.15.45:0/3706405198 shutdown_connections 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 --2- 172.21.15.45:0/3706405198 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f611406e230 0x7f61140706f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 --2- 172.21.15.45:0/3706405198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f612c104d20 0x7f612c1003a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 --2- 172.21.15.45:0/3706405198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f612c1023f0 0x7f612c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 -- 172.21.15.45:0/3706405198 >> 172.21.15.45:0/3706405198 conn(0x7f612c0fc010 msgr2=0x7f612c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 -- 172.21.15.45:0/3706405198 shutdown_connections 2024-09-18T12:45:21.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:21.635+0000 7f6130b83640 1 -- 172.21.15.45:0/3706405198 wait complete. 2024-09-18T12:45:21.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:21.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:21.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:21 smithi045 ceph-mon[28315]: Reconfiguring ceph-exporter.smithi045 (monmap changed)... 2024-09-18T12:45:21.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi045", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:45:21.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:21.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:21 smithi045 ceph-mon[28315]: Reconfiguring daemon ceph-exporter.smithi045 on smithi045 2024-09-18T12:45:21.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:21 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/560807942' entity='client.admin' 2024-09-18T12:45:21.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:21 smithi045 ceph-mon[28315]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:21.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:21 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3706405198' entity='client.admin' 2024-09-18T12:45:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:22.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:22.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:21 smithi161 ceph-mon[35784]: Reconfiguring ceph-exporter.smithi045 (monmap changed)... 2024-09-18T12:45:22.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi045", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:45:22.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:22.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:21 smithi161 ceph-mon[35784]: Reconfiguring daemon ceph-exporter.smithi045 on smithi045 2024-09-18T12:45:22.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:21 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/560807942' entity='client.admin' 2024-09-18T12:45:22.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:21 smithi161 ceph-mon[35784]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:22.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:21 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3706405198' entity='client.admin' 2024-09-18T12:45:22.565 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi045') 2024-09-18T12:45:22.565 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi045') 2024-09-18T12:45:22.565 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi045') 2024-09-18T12:45:22.565 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi045') 2024-09-18T12:45:22.565 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi045') 2024-09-18T12:45:22.565 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi045') 2024-09-18T12:45:22.566 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi045') 2024-09-18T12:45:22.566 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi045') 2024-09-18T12:45:22.566 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi045') 2024-09-18T12:45:23.919 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:23.935 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi045') 2024-09-18T12:45:23.935 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi045') 2024-09-18T12:45:24.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.355+0000 7f183919a640 1 -- 172.21.15.45:0/3989839230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1834104d20 msgr2=0x7f1834107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:24.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.355+0000 7f183919a640 1 --2- 172.21.15.45:0/3989839230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1834104d20 0x7f1834107110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f181c0098b0 tx=0x7f181c02a4d0 comp rx=0 tx=0).stop 2024-09-18T12:45:24.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.355+0000 7f183919a640 1 -- 172.21.15.45:0/3989839230 shutdown_connections 2024-09-18T12:45:24.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.355+0000 7f183919a640 1 --2- 172.21.15.45:0/3989839230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1834104d20 0x7f1834107110 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:24.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.355+0000 7f183919a640 1 --2- 172.21.15.45:0/3989839230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18341023f0 0x7f18341047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.355+0000 7f183919a640 1 -- 172.21.15.45:0/3989839230 >> 172.21.15.45:0/3989839230 conn(0x7f18340fc010 msgr2=0x7f18340fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.355+0000 7f183919a640 1 -- 172.21.15.45:0/3989839230 shutdown_connections 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.355+0000 7f183919a640 1 -- 172.21.15.45:0/3989839230 wait complete. 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.356+0000 7f183919a640 1 Processor -- start 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.356+0000 7f183919a640 1 -- start start 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.356+0000 7f183919a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18341023f0 0x7f1834197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.356+0000 7f183919a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834104d20 0x7f1834197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.356+0000 7f183919a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f183410a790 con 0x7f18341023f0 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.356+0000 7f183919a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f183410a610 con 0x7f1834104d20 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.356+0000 7f1832d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18341023f0 0x7f1834197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f1832d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18341023f0 0x7f1834197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44604/0 (socket says 172.21.15.45:44604) 2024-09-18T12:45:24.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f1832d9d640 1 -- 172.21.15.45:0/1291273389 learned_addr learned my addr 172.21.15.45:0/1291273389 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f182a59c640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834104d20 0x7f1834197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f1832d9d640 1 -- 172.21.15.45:0/1291273389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834104d20 msgr2=0x7f1834197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f1832d9d640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834104d20 0x7f1834197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f1832d9d640 1 -- 172.21.15.45:0/1291273389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18341980d0 con 0x7f18341023f0 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f182a59c640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834104d20 0x7f1834197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f1832d9d640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18341023f0 0x7f1834197510 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f182400d8d0 tx=0x7f182400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f1830d99640 1 -- 172.21.15.45:0/1291273389 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1824017030 con 0x7f18341023f0 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f1830d99640 1 -- 172.21.15.45:0/1291273389 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1824004020 con 0x7f18341023f0 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f183919a640 1 -- 172.21.15.45:0/1291273389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183419cb10 con 0x7f18341023f0 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f1830d99640 1 -- 172.21.15.45:0/1291273389 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18240047a0 con 0x7f18341023f0 2024-09-18T12:45:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.357+0000 7f183919a640 1 -- 172.21.15.45:0/1291273389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183419d070 con 0x7f18341023f0 2024-09-18T12:45:24.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.358+0000 7f183919a640 1 -- 172.21.15.45:0/1291273389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183410af70 con 0x7f18341023f0 2024-09-18T12:45:24.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.359+0000 7f1830d99640 1 -- 172.21.15.45:0/1291273389 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f18240041d0 con 0x7f18341023f0 2024-09-18T12:45:24.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.360+0000 7f1830d99640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f182006e230 0x7f18200706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:24.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.360+0000 7f1830d99640 1 -- 172.21.15.45:0/1291273389 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1824018070 con 0x7f18341023f0 2024-09-18T12:45:24.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.360+0000 7f182a59c640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f182006e230 0x7f18200706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:24.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.360+0000 7f182a59c640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f182006e230 0x7f18200706f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f181c006010 tx=0x7f181c005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:24.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.364+0000 7f1830d99640 1 -- 172.21.15.45:0/1291273389 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f182405b960 con 0x7f18341023f0 2024-09-18T12:45:24.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.553+0000 7f183919a640 1 -- 172.21.15.45:0/1291273389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f18341027d0 con 0x7f18341023f0 2024-09-18T12:45:24.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.557+0000 7f1830d99640 1 -- 172.21.15.45:0/1291273389 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v28)=0 v28) ==== 120+0+0 (secure 0 0 0) 0x7f182405f610 con 0x7f18341023f0 2024-09-18T12:45:24.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.559+0000 7f183919a640 1 -- 172.21.15.45:0/1291273389 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f182006e230 msgr2=0x7f18200706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.559+0000 7f183919a640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f182006e230 0x7f18200706f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f181c006010 tx=0x7f181c005a20 comp rx=0 tx=0).stop 2024-09-18T12:45:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.559+0000 7f183919a640 1 -- 172.21.15.45:0/1291273389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18341023f0 msgr2=0x7f1834197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.559+0000 7f183919a640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18341023f0 0x7f1834197510 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f182400d8d0 tx=0x7f182400dd90 comp rx=0 tx=0).stop 2024-09-18T12:45:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.559+0000 7f183919a640 1 -- 172.21.15.45:0/1291273389 shutdown_connections 2024-09-18T12:45:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.559+0000 7f183919a640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f182006e230 0x7f18200706f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.559+0000 7f183919a640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834104d20 0x7f1834197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.559+0000 7f183919a640 1 --2- 172.21.15.45:0/1291273389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18341023f0 0x7f1834197510 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.559+0000 7f183919a640 1 -- 172.21.15.45:0/1291273389 >> 172.21.15.45:0/1291273389 conn(0x7f18340fc010 msgr2=0x7f18340fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.559+0000 7f183919a640 1 -- 172.21.15.45:0/1291273389 shutdown_connections 2024-09-18T12:45:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:24.560+0000 7f183919a640 1 -- 172.21.15.45:0/1291273389 wait complete. 2024-09-18T12:45:24.688 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:24 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:24.688 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:24 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:24.688 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:24 smithi045 ceph-mon[28315]: Reconfiguring crash.smithi045 (monmap changed)... 2024-09-18T12:45:24.688 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:24 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi045", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:45:24.689 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:24 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:24.689 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:24 smithi045 ceph-mon[28315]: Reconfiguring daemon crash.smithi045 on smithi045 2024-09-18T12:45:24.689 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:24 smithi045 ceph-mon[28315]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:24.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:24 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:24.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:24 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:24.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:24 smithi161 ceph-mon[35784]: Reconfiguring crash.smithi045 (monmap changed)... 2024-09-18T12:45:24.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:24 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi045", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:45:24.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:24 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:24.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:24 smithi161 ceph-mon[35784]: Reconfiguring daemon crash.smithi045 on smithi045 2024-09-18T12:45:24.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:24 smithi161 ceph-mon[35784]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:25.570 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:25 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1291273389' entity='client.admin' 2024-09-18T12:45:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:25 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1291273389' entity='client.admin' 2024-09-18T12:45:26.058 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi045') 2024-09-18T12:45:26.059 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi045') 2024-09-18T12:45:26.059 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi045') 2024-09-18T12:45:26.059 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '53bb6910-75bb-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi045') 2024-09-18T12:45:26.059 INFO:tasks.cephadm:Deploying OSDs... 2024-09-18T12:45:26.060 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:45:26.060 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T12:45:26.077 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T12:45:26.077 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2024-09-18T12:45:26.133 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T12:45:26.133 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:45:26.133 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-18T12:45:26.133 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:45:26.133 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:45:26.133 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-18 12:44:24.849355044 +0000 2024-09-18T12:45:26.133 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-18 12:39:03.320669307 +0000 2024-09-18T12:45:26.133 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-18 12:39:03.320669307 +0000 2024-09-18T12:45:26.133 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-18 12:39:03.320669307 +0000 2024-09-18T12:45:26.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T12:45:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-18T12:45:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-18T12:45:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000109878 s, 4.7 MB/s 2024-09-18T12:45:26.200 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T12:45:26.257 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2024-09-18T12:45:26.313 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T12:45:26.313 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:45:26.313 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-18T12:45:26.313 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:45:26.313 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:45:26.313 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-18 12:44:24.850355028 +0000 2024-09-18T12:45:26.313 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-18 12:39:03.652663823 +0000 2024-09-18T12:45:26.313 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-18 12:39:03.652663823 +0000 2024-09-18T12:45:26.313 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-18 12:39:03.652663823 +0000 2024-09-18T12:45:26.313 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T12:45:26.377 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-18T12:45:26.377 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-18T12:45:26.377 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 9.0467e-05 s, 5.7 MB/s 2024-09-18T12:45:26.378 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T12:45:26.435 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2024-09-18T12:45:26.491 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T12:45:26.491 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:45:26.491 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-18T12:45:26.492 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:45:26.492 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:45:26.492 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-18 12:44:24.850355028 +0000 2024-09-18T12:45:26.492 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-18 12:39:03.978658439 +0000 2024-09-18T12:45:26.492 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-18 12:39:03.978658439 +0000 2024-09-18T12:45:26.492 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-18 12:39:03.978658439 +0000 2024-09-18T12:45:26.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T12:45:26.559 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-18T12:45:26.559 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-18T12:45:26.559 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00010997 s, 4.7 MB/s 2024-09-18T12:45:26.561 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T12:45:26.618 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2024-09-18T12:45:26.674 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T12:45:26.674 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:45:26.674 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-18T12:45:26.674 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:45:26.674 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:45:26.674 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-18 12:44:24.851355011 +0000 2024-09-18T12:45:26.674 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-18 12:39:04.301653104 +0000 2024-09-18T12:45:26.674 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-18 12:39:04.301653104 +0000 2024-09-18T12:45:26.674 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-18 12:39:04.301653104 +0000 2024-09-18T12:45:26.675 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T12:45:26.677 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:26 smithi045 ceph-mon[28315]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:26.677 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:26 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:26.677 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:26 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:26.702 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-18T12:45:26.702 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-18T12:45:26.702 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000108317 s, 4.7 MB/s 2024-09-18T12:45:26.704 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T12:45:26.761 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:45:26.761 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T12:45:26.783 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T12:45:26.783 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-09-18T12:45:26.841 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T12:45:26.842 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:45:26.842 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-18T12:45:26.842 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:45:26.842 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:45:26.842 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-18 12:44:54.233849366 +0000 2024-09-18T12:45:26.842 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-18 12:39:00.099419559 +0000 2024-09-18T12:45:26.842 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-18 12:39:00.099419559 +0000 2024-09-18T12:45:26.842 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-18 12:39:00.099419559 +0000 2024-09-18T12:45:26.842 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T12:45:26.908 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:26 smithi161 ceph-mon[35784]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:26.908 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:26 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:26.908 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:26 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:26.912 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-18T12:45:26.912 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-18T12:45:26.912 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000214876 s, 2.4 MB/s 2024-09-18T12:45:26.913 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T12:45:26.973 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-09-18T12:45:27.030 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T12:45:27.030 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:45:27.030 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-18T12:45:27.031 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:45:27.031 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:45:27.031 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-18 12:44:54.233849366 +0000 2024-09-18T12:45:27.031 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-18 12:39:00.416413084 +0000 2024-09-18T12:45:27.031 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-18 12:39:00.416413084 +0000 2024-09-18T12:45:27.031 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-18 12:39:00.416413084 +0000 2024-09-18T12:45:27.031 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T12:45:27.097 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-18T12:45:27.097 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-18T12:45:27.097 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.00023853 s, 2.1 MB/s 2024-09-18T12:45:27.098 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T12:45:27.156 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-09-18T12:45:27.213 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T12:45:27.213 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:45:27.213 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-18T12:45:27.213 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:45:27.213 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:45:27.213 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-18 12:44:54.234849344 +0000 2024-09-18T12:45:27.214 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-18 12:39:00.743406404 +0000 2024-09-18T12:45:27.214 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-18 12:39:00.743406404 +0000 2024-09-18T12:45:27.214 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-18 12:39:00.743406404 +0000 2024-09-18T12:45:27.214 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T12:45:27.278 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-18T12:45:27.279 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-18T12:45:27.279 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000231234 s, 2.2 MB/s 2024-09-18T12:45:27.280 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T12:45:27.336 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-09-18T12:45:27.392 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T12:45:27.393 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:45:27.393 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-18T12:45:27.393 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:45:27.393 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T12:45:27.393 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-18 12:44:54.234849344 +0000 2024-09-18T12:45:27.393 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-18 12:39:01.086399398 +0000 2024-09-18T12:45:27.393 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-18 12:39:01.086399398 +0000 2024-09-18T12:45:27.393 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-18 12:39:01.086399398 +0000 2024-09-18T12:45:27.393 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T12:45:27.456 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-18T12:45:27.456 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-18T12:45:27.456 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000207985 s, 2.5 MB/s 2024-09-18T12:45:27.458 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T12:45:27.514 INFO:tasks.cephadm:Deploying osd.0 on smithi045 with /dev/vg_nvme/lv_4... 2024-09-18T12:45:27.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-18T12:45:27.791 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:27 smithi045 ceph-mon[28315]: Reconfiguring alertmanager.smithi045 (dependencies changed)... 2024-09-18T12:45:27.791 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:27 smithi045 ceph-mon[28315]: Reconfiguring daemon alertmanager.smithi045 on smithi045 2024-09-18T12:45:28.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:27 smithi161 ceph-mon[35784]: Reconfiguring alertmanager.smithi045 (dependencies changed)... 2024-09-18T12:45:28.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:27 smithi161 ceph-mon[35784]: Reconfiguring daemon alertmanager.smithi045 on smithi045 2024-09-18T12:45:28.628 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:28 smithi045 ceph-mon[28315]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:28.702 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:28 smithi161 ceph-mon[35784]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:29.739 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:29 smithi045 ceph-mon[28315]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:30.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:29 smithi161 ceph-mon[35784]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:32.770 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:32.770 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:32.770 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:32 smithi045 ceph-mon[28315]: Reconfiguring grafana.smithi045 (dependencies changed)... 2024-09-18T12:45:32.770 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:32 smithi045 ceph-mon[28315]: Reconfiguring daemon grafana.smithi045 on smithi045 2024-09-18T12:45:32.770 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:32 smithi045 ceph-mon[28315]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:32.770 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:32.773 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:45:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:32 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:32 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:32 smithi161 ceph-mon[35784]: Reconfiguring grafana.smithi045 (dependencies changed)... 2024-09-18T12:45:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:32 smithi161 ceph-mon[35784]: Reconfiguring daemon grafana.smithi045 on smithi045 2024-09-18T12:45:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:32 smithi161 ceph-mon[35784]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:32 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:32.807 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_4 2024-09-18T12:45:33.843 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:33 smithi045 ceph-mon[28315]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:34.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:33 smithi161 ceph-mon[35784]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:34.854 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:45:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.312+0000 7fdd84ec9640 1 -- 172.21.15.45:0/2623646122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd801023f0 msgr2=0x7fdd801047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.312+0000 7fdd84ec9640 1 --2- 172.21.15.45:0/2623646122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd801023f0 0x7fdd801047e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdd700098b0 tx=0x7fdd7002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:45:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.312+0000 7fdd84ec9640 1 -- 172.21.15.45:0/2623646122 shutdown_connections 2024-09-18T12:45:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.312+0000 7fdd84ec9640 1 --2- 172.21.15.45:0/2623646122 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd80104d20 0x7fdd80107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.312+0000 7fdd84ec9640 1 --2- 172.21.15.45:0/2623646122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd801023f0 0x7fdd801047e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.312+0000 7fdd84ec9640 1 -- 172.21.15.45:0/2623646122 >> 172.21.15.45:0/2623646122 conn(0x7fdd800fc010 msgr2=0x7fdd800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.312+0000 7fdd84ec9640 1 -- 172.21.15.45:0/2623646122 shutdown_connections 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.312+0000 7fdd84ec9640 1 -- 172.21.15.45:0/2623646122 wait complete. 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.313+0000 7fdd84ec9640 1 Processor -- start 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.313+0000 7fdd84ec9640 1 -- start start 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.313+0000 7fdd84ec9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd801023f0 0x7fdd80197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.313+0000 7fdd84ec9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd80104d20 0x7fdd80197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.313+0000 7fdd84ec9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8010a7e0 con 0x7fdd801023f0 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.313+0000 7fdd84ec9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8010a660 con 0x7fdd80104d20 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd7e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd801023f0 0x7fdd80197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd7e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd801023f0 0x7fdd80197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36186/0 (socket says 172.21.15.45:36186) 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd7e59c640 1 -- 172.21.15.45:0/1946371307 learned_addr learned my addr 172.21.15.45:0/1946371307 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd7dd9b640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd80104d20 0x7fdd80197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd7e59c640 1 -- 172.21.15.45:0/1946371307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd80104d20 msgr2=0x7fdd80197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:45:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd7e59c640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd80104d20 0x7fdd80197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:45:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd7e59c640 1 -- 172.21.15.45:0/1946371307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd80198130 con 0x7fdd801023f0 2024-09-18T12:45:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd7e59c640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd801023f0 0x7fdd80197570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdd700099d0 tx=0x7fdd700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd6f7fe640 1 -- 172.21.15.45:0/1946371307 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd7003f070 con 0x7fdd801023f0 2024-09-18T12:45:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd84ec9640 1 -- 172.21.15.45:0/1946371307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8019cb10 con 0x7fdd801023f0 2024-09-18T12:45:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd6f7fe640 1 -- 172.21.15.45:0/1946371307 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd700049d0 con 0x7fdd801023f0 2024-09-18T12:45:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd6f7fe640 1 -- 172.21.15.45:0/1946371307 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd70035030 con 0x7fdd801023f0 2024-09-18T12:45:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.314+0000 7fdd84ec9640 1 -- 172.21.15.45:0/1946371307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8019d0a0 con 0x7fdd801023f0 2024-09-18T12:45:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.316+0000 7fdd6f7fe640 1 -- 172.21.15.45:0/1946371307 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fdd70042070 con 0x7fdd801023f0 2024-09-18T12:45:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.316+0000 7fdd84ec9640 1 -- 172.21.15.45:0/1946371307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd801027d0 con 0x7fdd801023f0 2024-09-18T12:45:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.317+0000 7fdd6f7fe640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdd6806e230 0x7fdd680706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:45:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.317+0000 7fdd6f7fe640 1 -- 172.21.15.45:0/1946371307 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdd700adbf0 con 0x7fdd801023f0 2024-09-18T12:45:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.317+0000 7fdd7dd9b640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdd6806e230 0x7fdd680706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:45:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.317+0000 7fdd7dd9b640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdd6806e230 0x7fdd680706f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd80198a20 tx=0x7fdd74005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:45:35.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.322+0000 7fdd6f7fe640 1 -- 172.21.15.45:0/1946371307 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd7007c630 con 0x7fdd801023f0 2024-09-18T12:45:35.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:45:35.513+0000 7fdd84ec9640 1 -- 172.21.15.45:0/1946371307 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdd8019d2d0 con 0x7fdd6806e230 2024-09-18T12:45:35.756 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:35 smithi045 ceph-mon[28315]: from='client.14326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:45:35.756 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:35 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:45:35.756 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:35 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:45:35.756 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:35 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:35.757 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:35 smithi045 ceph-mon[28315]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:35.886 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:35 smithi161 ceph-mon[35784]: from='client.14326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:45:35.886 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:35 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:45:35.886 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:35 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:45:35.886 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:35 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:35.887 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:35 smithi161 ceph-mon[35784]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:37.883 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:37 smithi045 ceph-mon[28315]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:38.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:37 smithi161 ceph-mon[35784]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:39.022 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:39.023 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:39.023 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:38 smithi045 ceph-mon[28315]: Reconfiguring prometheus.smithi045 (dependencies changed)... 2024-09-18T12:45:39.023 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:38 smithi045 ceph-mon[28315]: Reconfiguring daemon prometheus.smithi045 on smithi045 2024-09-18T12:45:39.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:38 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:39.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:38 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:39.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:38 smithi161 ceph-mon[35784]: Reconfiguring prometheus.smithi045 (dependencies changed)... 2024-09-18T12:45:39.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:38 smithi161 ceph-mon[35784]: Reconfiguring daemon prometheus.smithi045 on smithi045 2024-09-18T12:45:40.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:39 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/980051282' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abc0345a-6b97-47e0-b114-e26dc66a74cb"}]: dispatch 2024-09-18T12:45:40.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:39 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/980051282' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abc0345a-6b97-47e0-b114-e26dc66a74cb"}]': finished 2024-09-18T12:45:40.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:39 smithi045 ceph-mon[28315]: osdmap e6: 1 total, 0 up, 1 in 2024-09-18T12:45:40.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:39 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:40.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:39 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1441871178' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:45:40.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:39 smithi045 ceph-mon[28315]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:39 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/980051282' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abc0345a-6b97-47e0-b114-e26dc66a74cb"}]: dispatch 2024-09-18T12:45:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:39 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/980051282' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abc0345a-6b97-47e0-b114-e26dc66a74cb"}]': finished 2024-09-18T12:45:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:39 smithi161 ceph-mon[35784]: osdmap e6: 1 total, 0 up, 1 in 2024-09-18T12:45:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:39 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:45:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:39 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1441871178' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:45:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:39 smithi161 ceph-mon[35784]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:41.910 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:41 smithi045 ceph-mon[28315]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:42.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:41 smithi161 ceph-mon[35784]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:43.737 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:43 smithi045 ceph-mon[28315]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:44.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:43 smithi161 ceph-mon[35784]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:45.887 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:45 smithi161 ceph-mon[35784]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:45.907 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:45 smithi045 ceph-mon[28315]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:46.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:46 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:47.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:46 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:45:47.955 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:47 smithi045 ceph-mon[28315]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:48.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:47 smithi161 ceph-mon[35784]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:50.670 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:50 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:50.670 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:50 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:50.670 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:50 smithi045 ceph-mon[28315]: Reconfiguring ceph-exporter.smithi161 (monmap changed)... 2024-09-18T12:45:50.670 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:50 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:45:50.670 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:50 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:50.670 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:50 smithi045 ceph-mon[28315]: Reconfiguring daemon ceph-exporter.smithi161 on smithi161 2024-09-18T12:45:50.670 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:50 smithi045 ceph-mon[28315]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:50.762 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:50 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:50.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:50 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:50.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:50 smithi161 ceph-mon[35784]: Reconfiguring ceph-exporter.smithi161 (monmap changed)... 2024-09-18T12:45:50.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:50 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:45:50.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:50 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:50.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:50 smithi161 ceph-mon[35784]: Reconfiguring daemon ceph-exporter.smithi161 on smithi161 2024-09-18T12:45:50.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:50 smithi161 ceph-mon[35784]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:51.772 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T12:45:51.772 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:51.773 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:51.773 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:51.773 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:45:51.773 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:51 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:51 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T12:45:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:51 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:51 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:51 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:51 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T12:45:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:51 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:52.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:52 smithi045 ceph-mon[28315]: Deploying daemon osd.0 on smithi045 2024-09-18T12:45:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:52 smithi045 ceph-mon[28315]: Reconfiguring crash.smithi161 (monmap changed)... 2024-09-18T12:45:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:52 smithi045 ceph-mon[28315]: Reconfiguring daemon crash.smithi161 on smithi161 2024-09-18T12:45:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:52 smithi045 ceph-mon[28315]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.yoflkm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:45:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:45:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:52 smithi161 ceph-mon[35784]: Deploying daemon osd.0 on smithi045 2024-09-18T12:45:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:52 smithi161 ceph-mon[35784]: Reconfiguring crash.smithi161 (monmap changed)... 2024-09-18T12:45:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:52 smithi161 ceph-mon[35784]: Reconfiguring daemon crash.smithi161 on smithi161 2024-09-18T12:45:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:52 smithi161 ceph-mon[35784]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.yoflkm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:45:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:45:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:53.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:53 smithi045 ceph-mon[28315]: Reconfiguring mgr.smithi161.yoflkm (monmap changed)... 2024-09-18T12:45:53.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:53 smithi045 ceph-mon[28315]: Reconfiguring daemon mgr.smithi161.yoflkm on smithi161 2024-09-18T12:45:53.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:53 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:53.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:53 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:53.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:53 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:45:53.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:53 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:45:53.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:53 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:53.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:53 smithi161 ceph-mon[35784]: Reconfiguring mgr.smithi161.yoflkm (monmap changed)... 2024-09-18T12:45:53.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:53 smithi161 ceph-mon[35784]: Reconfiguring daemon mgr.smithi161.yoflkm on smithi161 2024-09-18T12:45:53.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:53 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:53.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:53 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:53.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:53 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:45:53.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:53 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:45:53.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:53 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:45:54.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:54 smithi045 ceph-mon[28315]: Reconfiguring mon.smithi161 (monmap changed)... 2024-09-18T12:45:54.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:54 smithi045 ceph-mon[28315]: Reconfiguring daemon mon.smithi161 on smithi161 2024-09-18T12:45:54.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:54 smithi045 ceph-mon[28315]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:54.730 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:54 smithi161 ceph-mon[35784]: Reconfiguring mon.smithi161 (monmap changed)... 2024-09-18T12:45:54.730 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:54 smithi161 ceph-mon[35784]: Reconfiguring daemon mon.smithi161 on smithi161 2024-09-18T12:45:54.730 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:54 smithi161 ceph-mon[35784]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:56.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:56.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:56.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:45:56.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi045.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi045.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi045.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi045.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi045.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi045.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:45:56.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:56.037 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:56.037 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:55 smithi045 ceph-mon[28315]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:56.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:56.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:56.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:45:56.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:45:56.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi045.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi045.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi045.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi045.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi045.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi045.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:45:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:55 smithi161 ceph-mon[35784]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:57 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:57 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:57 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:57 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:57 smithi045 ceph-mon[28315]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:58.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:57 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:58.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:57 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:58.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:57 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:58.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:57 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:45:58.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:57 smithi161 ceph-mon[35784]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:45:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:45:59 smithi045 ceph-mon[28315]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:46:00.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:45:59 smithi161 ceph-mon[35784]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:46:02.428 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 0 on host 'smithi045' 2024-09-18T12:46:02.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.426+0000 7fdd6f7fe640 1 -- 172.21.15.45:0/1946371307 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdd8019d2d0 con 0x7fdd6806e230 2024-09-18T12:46:02.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 -- 172.21.15.45:0/1946371307 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdd6806e230 msgr2=0x7fdd680706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:02.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdd6806e230 0x7fdd680706f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd80198a20 tx=0x7fdd74005f90 comp rx=0 tx=0).stop 2024-09-18T12:46:02.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 -- 172.21.15.45:0/1946371307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd801023f0 msgr2=0x7fdd80197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:02.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd801023f0 0x7fdd80197570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdd700099d0 tx=0x7fdd700045e0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 -- 172.21.15.45:0/1946371307 shutdown_connections 2024-09-18T12:46:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdd6806e230 0x7fdd680706f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd80104d20 0x7fdd80197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 --2- 172.21.15.45:0/1946371307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd801023f0 0x7fdd80197570 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 -- 172.21.15.45:0/1946371307 >> 172.21.15.45:0/1946371307 conn(0x7fdd800fc010 msgr2=0x7fdd800fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 -- 172.21.15.45:0/1946371307 shutdown_connections 2024-09-18T12:46:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:02.429+0000 7fdd84ec9640 1 -- 172.21.15.45:0/1946371307 wait complete. 2024-09-18T12:46:02.646 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:02.646 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:02.646 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:02 smithi161 ceph-mon[35784]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:46:02.646 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:02.646 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:02.646 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:02.647 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:02.647 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:02 smithi045 ceph-mon[28315]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:46:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:03.142 DEBUG:teuthology.orchestra.run.smithi045:osd.0> sudo journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.0.service 2024-09-18T12:46:03.144 INFO:tasks.cephadm:Deploying osd.1 on smithi045 with /dev/vg_nvme/lv_3... 2024-09-18T12:46:03.144 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-18T12:46:03.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:03.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:03.714 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:46:03 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[49078]: 2024-09-18T12:46:03.468+0000 7f6bb0377640 -1 osd.0 0 log_to_monitors true 2024-09-18T12:46:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:04.014 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:46:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:04 smithi045 ceph-mon[28315]: from='osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-18T12:46:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:04 smithi045 ceph-mon[28315]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:46:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:04 smithi161 ceph-mon[35784]: from='osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-18T12:46:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:04 smithi161 ceph-mon[35784]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:46:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:05 smithi045 ceph-mon[28315]: from='osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:46:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:05 smithi045 ceph-mon[28315]: osdmap e7: 1 total, 0 up, 1 in 2024-09-18T12:46:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:05 smithi045 ceph-mon[28315]: from='osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-18T12:46:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:46:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:05 smithi161 ceph-mon[35784]: from='osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:46:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:05 smithi161 ceph-mon[35784]: osdmap e7: 1 total, 0 up, 1 in 2024-09-18T12:46:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:05 smithi161 ceph-mon[35784]: from='osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-18T12:46:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:46:06.481 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:46:06 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[49078]: 2024-09-18T12:46:06.205+0000 7f6babad7640 -1 osd.0 0 waiting for initial osdmap 2024-09-18T12:46:06.482 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:46:06 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[49078]: 2024-09-18T12:46:06.209+0000 7f6ba4109640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:46:06.482 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:06 smithi045 ceph-mon[28315]: from='osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-18T12:46:06.482 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:06 smithi045 ceph-mon[28315]: osdmap e8: 1 total, 0 up, 1 in 2024-09-18T12:46:06.482 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:46:06.482 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:46:06.482 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:06 smithi045 ceph-mon[28315]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:46:06.482 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:06 smithi045 ceph-mon[28315]: from='osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873]' entity='osd.0' 2024-09-18T12:46:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:06 smithi161 ceph-mon[35784]: from='osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-18T12:46:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:06 smithi161 ceph-mon[35784]: osdmap e8: 1 total, 0 up, 1 in 2024-09-18T12:46:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:46:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:46:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:06 smithi161 ceph-mon[35784]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T12:46:06.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:06 smithi161 ceph-mon[35784]: from='osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873]' entity='osd.0' 2024-09-18T12:46:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:07 smithi045 ceph-mon[28315]: purged_snaps scrub starts 2024-09-18T12:46:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:07 smithi045 ceph-mon[28315]: purged_snaps scrub ok 2024-09-18T12:46:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:07 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:46:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:07 smithi045 ceph-mon[28315]: osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873] boot 2024-09-18T12:46:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:07 smithi045 ceph-mon[28315]: osdmap e9: 1 total, 1 up, 1 in 2024-09-18T12:46:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:07 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:46:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:07 smithi161 ceph-mon[35784]: purged_snaps scrub starts 2024-09-18T12:46:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:07 smithi161 ceph-mon[35784]: purged_snaps scrub ok 2024-09-18T12:46:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:07 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:46:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:07 smithi161 ceph-mon[35784]: osd.0 [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873] boot 2024-09-18T12:46:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:07 smithi161 ceph-mon[35784]: osdmap e9: 1 total, 1 up, 1 in 2024-09-18T12:46:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:07 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:46:08.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:46:08.245 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_3 2024-09-18T12:46:08.495 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:08 smithi045 ceph-mon[28315]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:08 smithi161 ceph-mon[35784]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:09.018 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:46:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 -- 172.21.15.45:0/1561822452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c104da0 msgr2=0x7f2b5c107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 --2- 172.21.15.45:0/1561822452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c104da0 0x7f2b5c107190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009880 tx=0x7f2b5002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 -- 172.21.15.45:0/1561822452 shutdown_connections 2024-09-18T12:46:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 --2- 172.21.15.45:0/1561822452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c104da0 0x7f2b5c107190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 --2- 172.21.15.45:0/1561822452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c102470 0x7f2b5c104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 -- 172.21.15.45:0/1561822452 >> 172.21.15.45:0/1561822452 conn(0x7f2b5c0fc010 msgr2=0x7f2b5c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 -- 172.21.15.45:0/1561822452 shutdown_connections 2024-09-18T12:46:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 -- 172.21.15.45:0/1561822452 wait complete. 2024-09-18T12:46:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 Processor -- start 2024-09-18T12:46:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 -- start start 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c102470 0x7f2b5c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c104da0 0x7f2b5c199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c10a7a0 con 0x7f2b5c104da0 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.467+0000 7f2b62d5b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c10a620 con 0x7f2b5c102470 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b5bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c104da0 0x7f2b5c199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b5bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c104da0 0x7f2b5c199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33310/0 (socket says 172.21.15.45:33310) 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b5bfff640 1 -- 172.21.15.45:0/409918242 learned_addr learned my addr 172.21.15.45:0/409918242 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b60af7640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c102470 0x7f2b5c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b5bfff640 1 -- 172.21.15.45:0/409918242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c102470 msgr2=0x7f2b5c1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b5bfff640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c102470 0x7f2b5c1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b5bfff640 1 -- 172.21.15.45:0/409918242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c19a290 con 0x7f2b5c104da0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b5bfff640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c104da0 0x7f2b5c199c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2b50006010 tx=0x7f2b500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b59ffb640 1 -- 172.21.15.45:0/409918242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b5003f070 con 0x7f2b5c104da0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b59ffb640 1 -- 172.21.15.45:0/409918242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b50004a50 con 0x7f2b5c104da0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b62d5b640 1 -- 172.21.15.45:0/409918242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5c19ec70 con 0x7f2b5c104da0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.468+0000 7f2b59ffb640 1 -- 172.21.15.45:0/409918242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b50035030 con 0x7f2b5c104da0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.469+0000 7f2b62d5b640 1 -- 172.21.15.45:0/409918242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5c19f1b0 con 0x7f2b5c104da0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.470+0000 7f2b62d5b640 1 -- 172.21.15.45:0/409918242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5c102850 con 0x7f2b5c104da0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.470+0000 7f2b59ffb640 1 -- 172.21.15.45:0/409918242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f2b50042070 con 0x7f2b5c104da0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.471+0000 7f2b59ffb640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2b4406e230 0x7f2b440706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.471+0000 7f2b59ffb640 1 -- 172.21.15.45:0/409918242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7f2b500addf0 con 0x7f2b5c104da0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.471+0000 7f2b60af7640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2b4406e230 0x7f2b440706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.471+0000 7f2b60af7640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2b4406e230 0x7f2b440706f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c005fd0 tx=0x7f2b4c00b390 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.475+0000 7f2b59ffb640 1 -- 172.21.15.45:0/409918242 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b50004c00 con 0x7f2b5c104da0 2024-09-18T12:46:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:09.667+0000 7f2b62d5b640 1 -- 172.21.15.45:0/409918242 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2b5c062630 con 0x7f2b4406e230 2024-09-18T12:46:09.781 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:09 smithi045 ceph-mon[28315]: osdmap e10: 1 total, 1 up, 1 in 2024-09-18T12:46:09.781 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:09 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:09.781 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:09 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:09 smithi161 ceph-mon[35784]: osdmap e10: 1 total, 1 up, 1 in 2024-09-18T12:46:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:09 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:09 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:10.731 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:10 smithi045 ceph-mon[28315]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:10.731 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:10 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:46:10.731 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:10 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:46:10.731 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:10 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:10 smithi161 ceph-mon[35784]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:10 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:46:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:10 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:46:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:10 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:11.591 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:11 smithi045 ceph-mon[28315]: from='client.14344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:11 smithi161 ceph-mon[35784]: from='client.14344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:12.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:12 smithi045 ceph-mon[28315]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:12.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:12.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:12.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:12.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:12.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:12.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:12.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:12 smithi161 ceph-mon[35784]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:13.743 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:13 smithi045 ceph-mon[28315]: Detected new or changed devices on smithi045 2024-09-18T12:46:13.744 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:13 smithi045 ceph-mon[28315]: Adjusting osd_memory_target on smithi045 to 11844M 2024-09-18T12:46:13.744 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:13 smithi161 ceph-mon[35784]: Detected new or changed devices on smithi045 2024-09-18T12:46:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:13 smithi161 ceph-mon[35784]: Adjusting osd_memory_target on smithi045 to 11844M 2024-09-18T12:46:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:14.633 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:14 smithi045 ceph-mon[28315]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:14.633 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:14 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3346281910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d20b034b-671a-41a6-8b14-29708f221cc8"}]: dispatch 2024-09-18T12:46:14.633 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:14 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3346281910' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d20b034b-671a-41a6-8b14-29708f221cc8"}]': finished 2024-09-18T12:46:14.633 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:14 smithi045 ceph-mon[28315]: osdmap e11: 2 total, 1 up, 2 in 2024-09-18T12:46:14.634 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:14 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:46:14.634 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:14 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:14.634 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:14 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:14.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:14 smithi161 ceph-mon[35784]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:14.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:14 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3346281910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d20b034b-671a-41a6-8b14-29708f221cc8"}]: dispatch 2024-09-18T12:46:14.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:14 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3346281910' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d20b034b-671a-41a6-8b14-29708f221cc8"}]': finished 2024-09-18T12:46:14.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:14 smithi161 ceph-mon[35784]: osdmap e11: 2 total, 1 up, 2 in 2024-09-18T12:46:14.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:14 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:46:14.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:14 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:14.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:14 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:15.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:15 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1408297102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:46:15.709 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:15 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1408297102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:46:16.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:16 smithi045 ceph-mon[28315]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:16.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:16 smithi161 ceph-mon[35784]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:17.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:18.758 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:18 smithi045 ceph-mon[28315]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:18.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:18 smithi161 ceph-mon[35784]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:19.694 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:19 smithi045 ceph-mon[28315]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:20.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:19 smithi161 ceph-mon[35784]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:21.743 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:21 smithi045 ceph-mon[28315]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:21 smithi161 ceph-mon[35784]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:22.924 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T12:46:22.924 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:22.924 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:22 smithi045 ceph-mon[28315]: Deploying daemon osd.1 on smithi045 2024-09-18T12:46:23.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T12:46:23.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:23.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:22 smithi161 ceph-mon[35784]: Deploying daemon osd.1 on smithi045 2024-09-18T12:46:23.929 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:23 smithi045 ceph-mon[28315]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:24.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:23 smithi161 ceph-mon[35784]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:25.746 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:25 smithi045 ceph-mon[28315]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:25.890 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:25 smithi161 ceph-mon[35784]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:28.012 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:27 smithi045 ceph-mon[28315]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:28.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:27 smithi161 ceph-mon[35784]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:29.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:28 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:29.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:28 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:29.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:28 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:28 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:28 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:28 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:30.028 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:29 smithi161 ceph-mon[35784]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:30.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:29 smithi045 ceph-mon[28315]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:31.701 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:31.701 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:32.653 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:32 smithi045 ceph-mon[28315]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:32.654 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:32 smithi161 ceph-mon[35784]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:32 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:33.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.241+0000 7f2b59ffb640 1 -- 172.21.15.45:0/409918242 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2b5c062630 con 0x7f2b4406e230 2024-09-18T12:46:33.243 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 1 on host 'smithi045' 2024-09-18T12:46:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 -- 172.21.15.45:0/409918242 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2b4406e230 msgr2=0x7f2b440706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2b4406e230 0x7f2b440706f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c005fd0 tx=0x7f2b4c00b390 comp rx=0 tx=0).stop 2024-09-18T12:46:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 -- 172.21.15.45:0/409918242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c104da0 msgr2=0x7f2b5c199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c104da0 0x7f2b5c199c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2b50006010 tx=0x7f2b500045e0 comp rx=0 tx=0).stop 2024-09-18T12:46:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 -- 172.21.15.45:0/409918242 shutdown_connections 2024-09-18T12:46:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2b4406e230 0x7f2b440706f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c104da0 0x7f2b5c199c10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 --2- 172.21.15.45:0/409918242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b5c102470 0x7f2b5c1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 -- 172.21.15.45:0/409918242 >> 172.21.15.45:0/409918242 conn(0x7f2b5c0fc010 msgr2=0x7f2b5c101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 -- 172.21.15.45:0/409918242 shutdown_connections 2024-09-18T12:46:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:33.244+0000 7f2b62d5b640 1 -- 172.21.15.45:0/409918242 wait complete. 2024-09-18T12:46:33.831 DEBUG:teuthology.orchestra.run.smithi045:osd.1> sudo journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.1.service 2024-09-18T12:46:33.834 INFO:tasks.cephadm:Deploying osd.2 on smithi045 with /dev/vg_nvme/lv_2... 2024-09-18T12:46:33.834 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-18T12:46:34.238 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:33 smithi045 podman[57495]: 2024-09-18 12:46:33.893392004 +0000 UTC m=+2.182408862 container remove 3d451284382778c184c0724cd50eb16ce1da4fd69ae98a2630af5b3f31b53cbf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:46:34.238 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:33 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2024-09-18T12:46:34.514 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:34 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:34.514 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:34 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:34.514 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:34 smithi045 ceph-mon[28315]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:34 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:34 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:34 smithi161 ceph-mon[35784]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:34.809 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:46:35.258 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:35 smithi045 podman[57825]: 2024-09-18 12:46:35.134736203 +0000 UTC m=+0.328310524 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-18T12:46:35.258 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:35 smithi045 podman[57825]: 2024-09-18 12:46:35.258128087 +0000 UTC m=+0.451702401 container create ff2aa370469ac8e2deace0002b345aed7ac46129b509315e1f37a7d96ef0941f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97) 2024-09-18T12:46:35.890 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:35 smithi161 ceph-mon[35784]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:35.933 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:35 smithi045 ceph-mon[28315]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:37.207 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:37 smithi045 podman[57825]: 2024-09-18 12:46:37.123107201 +0000 UTC m=+2.316681512 container init ff2aa370469ac8e2deace0002b345aed7ac46129b509315e1f37a7d96ef0941f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-18T12:46:37.207 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:37 smithi045 podman[57825]: 2024-09-18 12:46:37.127616876 +0000 UTC m=+2.321191190 container start ff2aa370469ac8e2deace0002b345aed7ac46129b509315e1f37a7d96ef0941f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=) 2024-09-18T12:46:37.207 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:37 smithi045 podman[57825]: 2024-09-18 12:46:37.206030912 +0000 UTC m=+2.399605240 container attach ff2aa370469ac8e2deace0002b345aed7ac46129b509315e1f37a7d96ef0941f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-18T12:46:37.534 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:37 smithi045 podman[57825]: 2024-09-18 12:46:37.331975253 +0000 UTC m=+2.525549568 container died ff2aa370469ac8e2deace0002b345aed7ac46129b509315e1f37a7d96ef0941f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-c2ddf97, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-18T12:46:37.871 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:37 smithi045 ceph-mon[28315]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:38.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:37 smithi161 ceph-mon[35784]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:38.596 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:46:38.624 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_2 2024-09-18T12:46:39.284 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:38 smithi045 podman[57992]: 2024-09-18 12:46:38.984426573 +0000 UTC m=+1.649367701 container remove ff2aa370469ac8e2deace0002b345aed7ac46129b509315e1f37a7d96ef0941f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-18T12:46:39.284 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:39 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.1.service: Failed with result 'exit-code'. 2024-09-18T12:46:39.284 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:39 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.1.service: Consumed 1.166s CPU time. 2024-09-18T12:46:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:46:39.744 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:39 smithi045 ceph-mon[28315]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.828+0000 7fccdf036640 1 -- 172.21.15.45:0/4225345200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd8100860 msgr2=0x7fccd8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.828+0000 7fccdf036640 1 --2- 172.21.15.45:0/4225345200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd8100860 0x7fccd8100c60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009880 tx=0x7fccc802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:46:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.829+0000 7fccdf036640 1 -- 172.21.15.45:0/4225345200 shutdown_connections 2024-09-18T12:46:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.829+0000 7fccdf036640 1 --2- 172.21.15.45:0/4225345200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd8101a60 0x7fccd8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.829+0000 7fccdf036640 1 --2- 172.21.15.45:0/4225345200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd8100860 0x7fccd8100c60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.829+0000 7fccdf036640 1 -- 172.21.15.45:0/4225345200 >> 172.21.15.45:0/4225345200 conn(0x7fccd80fc010 msgr2=0x7fccd80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:46:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.829+0000 7fccdf036640 1 -- 172.21.15.45:0/4225345200 shutdown_connections 2024-09-18T12:46:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.829+0000 7fccdf036640 1 -- 172.21.15.45:0/4225345200 wait complete. 2024-09-18T12:46:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.829+0000 7fccdf036640 1 Processor -- start 2024-09-18T12:46:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.829+0000 7fccdf036640 1 -- start start 2024-09-18T12:46:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.829+0000 7fccdf036640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd8100860 0x7fccd806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.829+0000 7fccdf036640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd8101a60 0x7fccd819c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccdf036640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fccd8109700 con 0x7fccd8101a60 2024-09-18T12:46:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccdf036640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fccd8109580 con 0x7fccd8100860 2024-09-18T12:46:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd8101a60 0x7fccd819c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd8101a60 0x7fccd819c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39200/0 (socket says 172.21.15.45:39200) 2024-09-18T12:46:39.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccd7fff640 1 -- 172.21.15.45:0/4074114236 learned_addr learned my addr 172.21.15.45:0/4074114236 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:46:39.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccdcdd2640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd8100860 0x7fccd806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:39.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccd7fff640 1 -- 172.21.15.45:0/4074114236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd8100860 msgr2=0x7fccd806aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:46:39.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccd7fff640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd8100860 0x7fccd806aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:46:39.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccd7fff640 1 -- 172.21.15.45:0/4074114236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd819c850 con 0x7fccd8101a60 2024-09-18T12:46:39.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccdcdd2640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd8100860 0x7fccd806aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:46:39.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccd7fff640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd8101a60 0x7fccd819c290 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00b420 tx=0x7fcccc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:39.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccd5ffb640 1 -- 172.21.15.45:0/4074114236 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcccc011630 con 0x7fccd8101a60 2024-09-18T12:46:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccd5ffb640 1 -- 172.21.15.45:0/4074114236 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcccc016070 con 0x7fccd8101a60 2024-09-18T12:46:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccdf036640 1 -- 172.21.15.45:0/4074114236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd819cb40 con 0x7fccd8101a60 2024-09-18T12:46:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccd5ffb640 1 -- 172.21.15.45:0/4074114236 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcccc010d30 con 0x7fccd8101a60 2024-09-18T12:46:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.830+0000 7fccdf036640 1 -- 172.21.15.45:0/4074114236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd819d150 con 0x7fccd8101a60 2024-09-18T12:46:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.831+0000 7fccdf036640 1 -- 172.21.15.45:0/4074114236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd8100c60 con 0x7fccd8101a60 2024-09-18T12:46:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.832+0000 7fccd5ffb640 1 -- 172.21.15.45:0/4074114236 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fcccc01b460 con 0x7fccd8101a60 2024-09-18T12:46:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.832+0000 7fccd5ffb640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fccc006e230 0x7fccc00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:46:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.832+0000 7fccd5ffb640 1 -- 172.21.15.45:0/4074114236 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2097+0+0 (secure 0 0 0) 0x7fcccc08cc40 con 0x7fccd8101a60 2024-09-18T12:46:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.832+0000 7fccdcdd2640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fccc006e230 0x7fccc00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:46:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.833+0000 7fccdcdd2640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fccc006e230 0x7fccc00706f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fccc80096c0 tx=0x7fccc8009650 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:46:39.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:39.837+0000 7fccd5ffb640 1 -- 172.21.15.45:0/4074114236 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcccc05b310 con 0x7fccd8101a60 2024-09-18T12:46:40.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:46:40.030+0000 7fccdf036640 1 -- 172.21.15.45:0/4074114236 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fccd8062630 con 0x7fccc006e230 2024-09-18T12:46:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:39 smithi161 ceph-mon[35784]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:41.025 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:41.026 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:41.026 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:41 smithi045 ceph-mon[28315]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:41.026 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:46:41.026 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:46:41.026 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:41.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:41 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:41.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:41 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:41.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:41 smithi161 ceph-mon[35784]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:46:41.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:41 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:46:41.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:41 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:46:41.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:41 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:42.247 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:42 smithi045 ceph-mon[28315]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:42.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:42 smithi161 ceph-mon[35784]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:43 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/320274079' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2751347-83f5-4e3f-ba05-0af90ad01aae"}]: dispatch 2024-09-18T12:46:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:43 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/320274079' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2751347-83f5-4e3f-ba05-0af90ad01aae"}]': finished 2024-09-18T12:46:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:43 smithi045 ceph-mon[28315]: osdmap e12: 3 total, 1 up, 3 in 2024-09-18T12:46:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:43 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:46:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:43 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:43 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/320274079' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2751347-83f5-4e3f-ba05-0af90ad01aae"}]: dispatch 2024-09-18T12:46:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:43 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/320274079' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2751347-83f5-4e3f-ba05-0af90ad01aae"}]': finished 2024-09-18T12:46:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:43 smithi161 ceph-mon[35784]: osdmap e12: 3 total, 1 up, 3 in 2024-09-18T12:46:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:43 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:46:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:43 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:46:44.782 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:44 smithi045 ceph-mon[28315]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:44.782 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:44 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3964202156' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:46:44.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:44 smithi161 ceph-mon[35784]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:44.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:44 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3964202156' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:46:45.891 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:45 smithi161 ceph-mon[35784]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:46.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:45 smithi045 ceph-mon[28315]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:46.960 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:46 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:47.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:46 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:46:47.916 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:47 smithi161 ceph-mon[35784]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:48.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:47 smithi045 ceph-mon[28315]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:49.337 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:49 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.1.service: Scheduled restart job, restart counter is at 1. 2024-09-18T12:46:49.337 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:49 smithi045 systemd[1]: Stopped Ceph osd.1 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:46:49.337 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:49 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.1.service: Consumed 1.166s CPU time. 2024-09-18T12:46:49.337 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:49 smithi045 systemd[1]: Starting Ceph osd.1 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:46:49.601 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:49 smithi045 podman[60102]: 2024-09-18 12:46:49.247194756 +0000 UTC m=+0.020571696 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-18T12:46:49.912 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:49 smithi045 ceph-mon[28315]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:49.912 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:49 smithi045 podman[60102]: 2024-09-18 12:46:49.600270531 +0000 UTC m=+0.373647462 container create 354e405a44e035042a6a0e08cf7a4933d72eb0a3e65ff7b4616eaef954fe3700 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-18T12:46:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:49 smithi161 ceph-mon[35784]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:50.189 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:50 smithi045 podman[60102]: 2024-09-18 12:46:50.038129754 +0000 UTC m=+0.811506695 container init 354e405a44e035042a6a0e08cf7a4933d72eb0a3e65ff7b4616eaef954fe3700 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-09-18T12:46:50.189 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:50 smithi045 podman[60102]: 2024-09-18 12:46:50.043068163 +0000 UTC m=+0.816445102 container start 354e405a44e035042a6a0e08cf7a4933d72eb0a3e65ff7b4616eaef954fe3700 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:46:50.189 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:50 smithi045 podman[60102]: 2024-09-18 12:46:50.146220304 +0000 UTC m=+0.919597260 container attach 354e405a44e035042a6a0e08cf7a4933d72eb0a3e65ff7b4616eaef954fe3700 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:46:50.451 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:50 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[60169]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:46:50.451 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:50 smithi045 bash[60102]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:46:50.451 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:50 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[60169]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:46:50.451 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:50 smithi045 bash[60102]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:46:51.396 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[60169]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:46:51.397 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 bash[60102]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:46:51.397 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[60169]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:46:51.397 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 bash[60102]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:46:51.683 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[60169]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:46:51.684 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 bash[60102]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:46:51.684 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[60169]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:46:51.684 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 bash[60102]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:46:51.684 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[60169]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-18T12:46:51.684 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 bash[60102]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-18T12:46:51.684 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[60169]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:46:51.684 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 bash[60102]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:46:51.684 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[60169]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-18T12:46:51.684 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 bash[60102]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-18T12:46:52.034 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:51 smithi045 podman[60102]: 2024-09-18 12:46:51.879205711 +0000 UTC m=+2.652582645 container died 354e405a44e035042a6a0e08cf7a4933d72eb0a3e65ff7b4616eaef954fe3700 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-18T12:46:52.517 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: Detected new or changed devices on smithi045 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: Adjusting osd_memory_target on smithi045 to 5922M 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:52.518 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:52 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: Detected new or changed devices on smithi045 2024-09-18T12:46:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:46:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: Adjusting osd_memory_target on smithi045 to 5922M 2024-09-18T12:46:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:46:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:46:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:52 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:46:53.284 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:52 smithi045 podman[62627]: 2024-09-18 12:46:52.953741341 +0000 UTC m=+1.392937776 container remove 354e405a44e035042a6a0e08cf7a4933d72eb0a3e65ff7b4616eaef954fe3700 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-18T12:46:53.582 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:53 smithi045 ceph-mon[28315]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-18T12:46:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:53 smithi161 ceph-mon[35784]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-18T12:46:54.730 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:54 smithi045 ceph-mon[28315]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:54.731 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:54 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T12:46:54.731 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:54 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:54.731 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:54 smithi045 podman[63038]: 2024-09-18 12:46:54.379491932 +0000 UTC m=+0.020766332 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-18T12:46:54.731 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:54 smithi045 podman[63038]: 2024-09-18 12:46:54.505582363 +0000 UTC m=+0.146856797 container create 168e69ac7e62a0184ba9df0160fa6a281bb00cf1cb2ea457cf7b5a080bbb45aa (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:46:54.731 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:54 smithi045 podman[63038]: 2024-09-18 12:46:54.72983502 +0000 UTC m=+0.371109416 container init 168e69ac7e62a0184ba9df0160fa6a281bb00cf1cb2ea457cf7b5a080bbb45aa (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-18T12:46:54.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:54 smithi161 ceph-mon[35784]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:54.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T12:46:54.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:54 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:46:54.996 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:54 smithi045 podman[63038]: 2024-09-18 12:46:54.733671183 +0000 UTC m=+0.374945585 container start 168e69ac7e62a0184ba9df0160fa6a281bb00cf1cb2ea457cf7b5a080bbb45aa (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True) 2024-09-18T12:46:54.996 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:54 smithi045 ceph-osd[63090]: -- 172.21.15.45:0/1867415778 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a1f19a1e0 con 0x559a1f198000 2024-09-18T12:46:54.996 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:54 smithi045 bash[63038]: 168e69ac7e62a0184ba9df0160fa6a281bb00cf1cb2ea457cf7b5a080bbb45aa 2024-09-18T12:46:54.996 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:54 smithi045 systemd[1]: Started Ceph osd.1 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:46:55.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:55 smithi045 ceph-mon[28315]: Deploying daemon osd.2 on smithi045 2024-09-18T12:46:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:55 smithi161 ceph-mon[35784]: Deploying daemon osd.2 on smithi045 2024-09-18T12:46:56.627 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:56 smithi045 ceph-mon[28315]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:56.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:56 smithi161 ceph-mon[35784]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:56.989 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:46:56 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[63069]: 2024-09-18T12:46:56.639+0000 7f65c1ba9640 -1 Falling back to public interface 2024-09-18T12:46:58.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:46:58 smithi045 ceph-mon[28315]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:46:58.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:46:58 smithi161 ceph-mon[35784]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:47:00.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:00 smithi045 ceph-mon[28315]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:47:00.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:00.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:00.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:00.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:00.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:00 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:00.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:00 smithi161 ceph-mon[35784]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:47:00.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:00.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:00.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:00.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:00.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:00 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:01.506 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:01 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[63069]: 2024-09-18T12:47:01.209+0000 7f65c1ba9640 -1 osd.1 0 log_to_monitors true 2024-09-18T12:47:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:01 smithi045 ceph-mon[28315]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:47:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:01 smithi045 ceph-mon[28315]: from='osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-18T12:47:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:01 smithi045 ceph-mon[28315]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-18T12:47:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:01 smithi045 ceph-mon[28315]: Cluster is now healthy 2024-09-18T12:47:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:01 smithi161 ceph-mon[35784]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:47:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:01 smithi161 ceph-mon[35784]: from='osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-18T12:47:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:01 smithi161 ceph-mon[35784]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-18T12:47:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:01 smithi161 ceph-mon[35784]: Cluster is now healthy 2024-09-18T12:47:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:02 smithi045 ceph-mon[28315]: from='osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:47:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:02 smithi045 ceph-mon[28315]: osdmap e13: 3 total, 1 up, 3 in 2024-09-18T12:47:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:02 smithi045 ceph-mon[28315]: from='osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-18T12:47:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:47:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:02.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:02 smithi161 ceph-mon[35784]: from='osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:47:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:02 smithi161 ceph-mon[35784]: osdmap e13: 3 total, 1 up, 3 in 2024-09-18T12:47:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:02 smithi161 ceph-mon[35784]: from='osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-18T12:47:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:47:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:03.599 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[63069]: 2024-09-18T12:47:03.335+0000 7f65bd309640 -1 osd.1 0 waiting for initial osdmap 2024-09-18T12:47:03.600 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[63069]: 2024-09-18T12:47:03.339+0000 7f65b593b640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:47:03.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-mon[28315]: pgmap v77: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:47:03.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-mon[28315]: from='osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-18T12:47:03.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-mon[28315]: osdmap e14: 3 total, 1 up, 3 in 2024-09-18T12:47:03.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:47:03.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:03.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:47:03.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:03.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:03.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:03.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:03 smithi045 ceph-mon[28315]: from='osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799]' entity='osd.1' 2024-09-18T12:47:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:03 smithi161 ceph-mon[35784]: pgmap v77: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:47:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:03 smithi161 ceph-mon[35784]: from='osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-18T12:47:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:03 smithi161 ceph-mon[35784]: osdmap e14: 3 total, 1 up, 3 in 2024-09-18T12:47:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:47:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:47:03.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:03.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:03.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:03.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:03 smithi161 ceph-mon[35784]: from='osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799]' entity='osd.1' 2024-09-18T12:47:04.607 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:04 smithi045 ceph-mon[28315]: purged_snaps scrub starts 2024-09-18T12:47:04.607 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:04 smithi045 ceph-mon[28315]: purged_snaps scrub ok 2024-09-18T12:47:04.607 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:47:04.607 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:04 smithi045 ceph-mon[28315]: osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799] boot 2024-09-18T12:47:04.607 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:04 smithi045 ceph-mon[28315]: osdmap e15: 3 total, 2 up, 3 in 2024-09-18T12:47:04.608 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:47:04.608 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:04 smithi161 ceph-mon[35784]: purged_snaps scrub starts 2024-09-18T12:47:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:04 smithi161 ceph-mon[35784]: purged_snaps scrub ok 2024-09-18T12:47:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:47:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:04 smithi161 ceph-mon[35784]: osd.1 [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799] boot 2024-09-18T12:47:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:04 smithi161 ceph-mon[35784]: osdmap e15: 3 total, 2 up, 3 in 2024-09-18T12:47:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:47:04.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:05.747 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:05 smithi045 ceph-mon[28315]: pgmap v79: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:47:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:05 smithi161 ceph-mon[35784]: pgmap v79: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-18T12:47:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.061+0000 7fccd5ffb640 1 -- 172.21.15.45:0/4074114236 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fccd8062630 con 0x7fccc006e230 2024-09-18T12:47:06.063 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 2 on host 'smithi045' 2024-09-18T12:47:06.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 -- 172.21.15.45:0/4074114236 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fccc006e230 msgr2=0x7fccc00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:06.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fccc006e230 0x7fccc00706f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fccc80096c0 tx=0x7fccc8009650 comp rx=0 tx=0).stop 2024-09-18T12:47:06.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 -- 172.21.15.45:0/4074114236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd8101a60 msgr2=0x7fccd819c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:06.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd8101a60 0x7fccd819c290 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00b420 tx=0x7fcccc00b8e0 comp rx=0 tx=0).stop 2024-09-18T12:47:06.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 -- 172.21.15.45:0/4074114236 shutdown_connections 2024-09-18T12:47:06.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fccc006e230 0x7fccc00706f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd8101a60 0x7fccd819c290 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 --2- 172.21.15.45:0/4074114236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd8100860 0x7fccd806aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 -- 172.21.15.45:0/4074114236 >> 172.21.15.45:0/4074114236 conn(0x7fccd80fc010 msgr2=0x7fccd8104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 -- 172.21.15.45:0/4074114236 shutdown_connections 2024-09-18T12:47:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:47:06.065+0000 7fccdf036640 1 -- 172.21.15.45:0/4074114236 wait complete. 2024-09-18T12:47:06.637 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:06 smithi045 ceph-mon[28315]: osdmap e16: 3 total, 2 up, 3 in 2024-09-18T12:47:06.637 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:06.637 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:06.637 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:06.638 DEBUG:teuthology.orchestra.run.smithi045:osd.2> sudo journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.2.service 2024-09-18T12:47:06.641 INFO:tasks.cephadm:Deploying osd.3 on smithi161 with /dev/vg_nvme/lv_4... 2024-09-18T12:47:06.641 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-18T12:47:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:06 smithi161 ceph-mon[35784]: osdmap e16: 3 total, 2 up, 3 in 2024-09-18T12:47:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:06.897 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi161/config 2024-09-18T12:47:07.647 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:07 smithi161 ceph-mon[35784]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:47:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:07 smithi045 ceph-mon[28315]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:47:09.283 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:47:09.308 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi161:vg_nvme/lv_4 2024-09-18T12:47:09.529 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:09 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[64773]: 2024-09-18T12:47:09.111+0000 7f4f492f0640 -1 osd.2 0 log_to_monitors true 2024-09-18T12:47:09.530 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:09 smithi161 ceph-mon[35784]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:47:09.530 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:09 smithi161 ceph-mon[35784]: from='osd.2 [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T12:47:09.530 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:09 smithi161 ceph-mon[35784]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T12:47:09.564 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi161/config 2024-09-18T12:47:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:09 smithi045 ceph-mon[28315]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:47:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:09 smithi045 ceph-mon[28315]: from='osd.2 [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T12:47:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:09 smithi045 ceph-mon[28315]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T12:47:10.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.084+0000 7f1c91bb6640 1 -- 172.21.15.161:0/940763594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c8c101a60 msgr2=0x7f1c8c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:10.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.084+0000 7f1c91bb6640 1 --2- 172.21.15.161:0/940763594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c8c101a60 0x7f1c8c101ee0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009880 tx=0x7f1c7402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:47:10.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.084+0000 7f1c91bb6640 1 -- 172.21.15.161:0/940763594 shutdown_connections 2024-09-18T12:47:10.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.084+0000 7f1c91bb6640 1 --2- 172.21.15.161:0/940763594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c8c101a60 0x7f1c8c101ee0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:10.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.084+0000 7f1c91bb6640 1 --2- 172.21.15.161:0/940763594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c8c100860 0x7f1c8c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:10.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.084+0000 7f1c91bb6640 1 -- 172.21.15.161:0/940763594 >> 172.21.15.161:0/940763594 conn(0x7f1c8c0fc010 msgr2=0x7f1c8c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:10.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.085+0000 7f1c91bb6640 1 -- 172.21.15.161:0/940763594 shutdown_connections 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.085+0000 7f1c91bb6640 1 -- 172.21.15.161:0/940763594 wait complete. 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.085+0000 7f1c91bb6640 1 Processor -- start 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.085+0000 7f1c91bb6640 1 -- start start 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.085+0000 7f1c91bb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c8c100860 0x7f1c8c1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.085+0000 7f1c91bb6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c8c101a60 0x7f1c8c197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.085+0000 7f1c91bb6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c109680 con 0x7f1c8c100860 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.085+0000 7f1c91bb6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c109500 con 0x7f1c8c101a60 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c8affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c8c101a60 0x7f1c8c197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c8affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c8c101a60 0x7f1c8c197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45688/0 (socket says 172.21.15.161:45688) 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c8affd640 1 -- 172.21.15.161:0/91304110 learned_addr learned my addr 172.21.15.161:0/91304110 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c8b7fe640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c8c100860 0x7f1c8c1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c8affd640 1 -- 172.21.15.161:0/91304110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c8c100860 msgr2=0x7f1c8c1974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:10.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c8affd640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c8c100860 0x7f1c8c1974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:10.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c8affd640 1 -- 172.21.15.161:0/91304110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8c1980b0 con 0x7f1c8c101a60 2024-09-18T12:47:10.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c8affd640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c8c101a60 0x7f1c8c197a30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1c74006010 tx=0x7f1c740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c88ff9640 1 -- 172.21.15.161:0/91304110 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c7403f070 con 0x7f1c8c101a60 2024-09-18T12:47:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c88ff9640 1 -- 172.21.15.161:0/91304110 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c74004ac0 con 0x7f1c8c101a60 2024-09-18T12:47:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c91bb6640 1 -- 172.21.15.161:0/91304110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8c19ca90 con 0x7f1c8c101a60 2024-09-18T12:47:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.086+0000 7f1c88ff9640 1 -- 172.21.15.161:0/91304110 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c74035030 con 0x7f1c8c101a60 2024-09-18T12:47:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.087+0000 7f1c91bb6640 1 -- 172.21.15.161:0/91304110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8c19d020 con 0x7f1c8c101a60 2024-09-18T12:47:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.088+0000 7f1c91bb6640 1 -- 172.21.15.161:0/91304110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8c100c60 con 0x7f1c8c101a60 2024-09-18T12:47:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.088+0000 7f1c88ff9640 1 -- 172.21.15.161:0/91304110 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f1c74042070 con 0x7f1c8c101a60 2024-09-18T12:47:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.089+0000 7f1c88ff9640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1c7806e230 0x7f1c780706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.089+0000 7f1c88ff9640 1 -- 172.21.15.161:0/91304110 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2550+0+0 (secure 0 0 0) 0x7f1c740adfe0 con 0x7f1c8c101a60 2024-09-18T12:47:10.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.089+0000 7f1c8b7fe640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1c7806e230 0x7f1c780706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:10.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.090+0000 7f1c8b7fe640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1c7806e230 0x7f1c780706f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c005fd0 tx=0x7f1c7c00b410 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:10.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.093+0000 7f1c88ff9640 1 -- 172.21.15.161:0/91304110 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c74080230 con 0x7f1c8c101a60 2024-09-18T12:47:10.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:10.274+0000 7f1c91bb6640 1 -- 172.21.15.161:0/91304110 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1c8c06a420 con 0x7f1c7806e230 2024-09-18T12:47:10.754 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[64773]: 2024-09-18T12:47:10.543+0000 7f4f45a87640 -1 osd.2 0 waiting for initial osdmap 2024-09-18T12:47:10.754 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[64773]: 2024-09-18T12:47:10.547+0000 7f4f4108a640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:47:10.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-mon[28315]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:47:10.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-mon[28315]: osdmap e17: 3 total, 2 up, 3 in 2024-09-18T12:47:10.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:10.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-mon[28315]: from='osd.2 [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-18T12:47:10.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-mon[28315]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-18T12:47:10.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:10.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:10.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:47:10.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:47:10.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:10 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:10 smithi161 ceph-mon[35784]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:47:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:10 smithi161 ceph-mon[35784]: osdmap e17: 3 total, 2 up, 3 in 2024-09-18T12:47:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:10 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:10 smithi161 ceph-mon[35784]: from='osd.2 [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-18T12:47:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:10 smithi161 ceph-mon[35784]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-18T12:47:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:10 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:10 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:10 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:47:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:10 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:47:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:10 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:11.648 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:11 smithi045 ceph-mon[28315]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:11.648 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:11 smithi045 ceph-mon[28315]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:47:11.649 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:11 smithi045 ceph-mon[28315]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-18T12:47:11.649 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:11 smithi045 ceph-mon[28315]: osdmap e18: 3 total, 2 up, 3 in 2024-09-18T12:47:11.649 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:11 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:11.649 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:11 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:11.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:11 smithi161 ceph-mon[35784]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:11.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:11 smithi161 ceph-mon[35784]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:47:11.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:11 smithi161 ceph-mon[35784]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-18T12:47:11.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:11 smithi161 ceph-mon[35784]: osdmap e18: 3 total, 2 up, 3 in 2024-09-18T12:47:11.763 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:11 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:11.764 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:11 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:12.712 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: purged_snaps scrub starts 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: purged_snaps scrub ok 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: osd.2 [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968] boot 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: osdmap e19: 3 total, 3 up, 3 in 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/4014219964' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "112d636d-4dbc-494b-a7a0-0db054771763"}]: dispatch 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "112d636d-4dbc-494b-a7a0-0db054771763"}]: dispatch 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "112d636d-4dbc-494b-a7a0-0db054771763"}]': finished 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: osdmap e20: 4 total, 3 up, 4 in 2024-09-18T12:47:12.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:12.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:12 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:47:12.997 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: purged_snaps scrub starts 2024-09-18T12:47:12.997 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: purged_snaps scrub ok 2024-09-18T12:47:12.997 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: osd.2 [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968] boot 2024-09-18T12:47:12.997 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: osdmap e19: 3 total, 3 up, 3 in 2024-09-18T12:47:12.997 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:47:12.997 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:47:12.997 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/4014219964' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "112d636d-4dbc-494b-a7a0-0db054771763"}]: dispatch 2024-09-18T12:47:12.997 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "112d636d-4dbc-494b-a7a0-0db054771763"}]: dispatch 2024-09-18T12:47:12.997 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-18T12:47:12.998 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "112d636d-4dbc-494b-a7a0-0db054771763"}]': finished 2024-09-18T12:47:12.998 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: osdmap e20: 4 total, 3 up, 4 in 2024-09-18T12:47:12.998 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:12.998 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:12 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-18T12:47:14.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/776506109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:14.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:14.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:14.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:14.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:14.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-18T12:47:14.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: osdmap e21: 4 total, 3 up, 4 in 2024-09-18T12:47:14.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:13 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-18T12:47:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/776506109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:47:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:14.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:14.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:14.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:14.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:14.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:14.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:14.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:14.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-18T12:47:14.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: osdmap e21: 4 total, 3 up, 4 in 2024-09-18T12:47:14.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:13 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:14.510 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69528]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:47:14.510 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69528]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:47:14.510 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:47:14.510 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69528]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:47:14.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69531]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:47:14.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69531]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:47:14.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:47:14.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69531]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:47:14.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:14 smithi045 ceph-mon[28315]: Adjusting osd_memory_target on smithi045 to 3948M 2024-09-18T12:47:14.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:14 smithi045 ceph-mon[28315]: osdmap e22: 4 total, 3 up, 4 in 2024-09-18T12:47:14.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:14 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:14.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:14 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:15.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:14 smithi161 ceph-mon[35784]: Adjusting osd_memory_target on smithi045 to 3948M 2024-09-18T12:47:15.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:14 smithi161 ceph-mon[35784]: osdmap e22: 4 total, 3 up, 4 in 2024-09-18T12:47:15.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:14 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:15.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:14 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:15.285 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69534]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:47:15.285 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69534]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:47:15.285 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:47:15.286 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:14 smithi045 sudo[69534]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:47:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:15 smithi045 ceph-mon[28315]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:47:15.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:15 smithi045 sudo[69537]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:47:15.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:15 smithi045 sudo[69537]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:47:15.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:15 smithi045 sudo[69537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:47:15.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:47:15 smithi045 sudo[69537]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:47:15.894 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:15 smithi161 ceph-mon[35784]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:47:16.284 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:15 smithi045 sudo[69540]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:47:16.284 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:15 smithi045 sudo[69540]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:47:16.284 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:15 smithi045 sudo[69540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:47:16.284 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:15 smithi045 sudo[69540]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:47:16.782 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:16 smithi045 sudo[69543]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:47:16.782 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:16 smithi045 sudo[69543]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:47:16.782 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:16 smithi045 sudo[69543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:47:16.782 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:47:16 smithi045 sudo[69543]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:47:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:16 smithi045 sudo[69546]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:47:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:16 smithi045 sudo[69546]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:47:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:16 smithi045 sudo[69546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:47:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:16 smithi045 sudo[69546]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:47:17.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:17.250+0000 7f1c88ff9640 1 -- 172.21.15.161:0/91304110 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1c74003cd0 con 0x7f1c8c101a60 2024-09-18T12:47:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 sudo[69549]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:47:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 sudo[69549]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:47:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 sudo[69549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:47:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 sudo[69549]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:47:17.697 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 sudo[40986]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T12:47:17.697 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 sudo[40986]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:47:17.697 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 sudo[40986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:47:17.697 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 sudo[40986]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:47:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 ceph-mon[28315]: pgmap v93: 1 pgs: 1 active+clean; 449 KiB data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:47:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 ceph-mon[28315]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:47:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 ceph-mon[28315]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:47:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:47:18.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:47:18.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:18.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 ceph-mon[28315]: mgrmap e19: smithi045.brvbvl(active, since 2m), standbys: smithi161.yoflkm 2024-09-18T12:47:18.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:47:18.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:47:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 sudo[41016]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T12:47:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 sudo[41016]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T12:47:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 sudo[41016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T12:47:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 sudo[41016]: pam_unix(sudo:session): session closed for user root 2024-09-18T12:47:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 ceph-mon[35784]: pgmap v93: 1 pgs: 1 active+clean; 449 KiB data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:47:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 ceph-mon[35784]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:47:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 ceph-mon[35784]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:47:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:47:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:47:18.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:18.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 ceph-mon[35784]: mgrmap e19: smithi045.brvbvl(active, since 2m), standbys: smithi161.yoflkm 2024-09-18T12:47:18.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:47:18.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:47:19.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:18 smithi045 ceph-mon[28315]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:47:19.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:18 smithi045 ceph-mon[28315]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:47:19.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:18 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:19.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:18 smithi045 ceph-mon[28315]: pgmap v94: 1 pgs: 1 active+clean; 449 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:47:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:18 smithi161 ceph-mon[35784]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T12:47:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:18 smithi161 ceph-mon[35784]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T12:47:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:18 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:18 smithi161 ceph-mon[35784]: pgmap v94: 1 pgs: 1 active+clean; 449 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:47:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:21 smithi161 ceph-mon[35784]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 326 KiB/s wr, 20 op/s 2024-09-18T12:47:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T12:47:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:21 smithi161 ceph-mon[35784]: Deploying daemon osd.3 on smithi161 2024-09-18T12:47:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:21 smithi045 ceph-mon[28315]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 326 KiB/s wr, 20 op/s 2024-09-18T12:47:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T12:47:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:21 smithi045 ceph-mon[28315]: Deploying daemon osd.3 on smithi161 2024-09-18T12:47:23.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:23 smithi045 ceph-mon[28315]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 218 KiB/s wr, 13 op/s 2024-09-18T12:47:23.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:23 smithi161 ceph-mon[35784]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 218 KiB/s wr, 13 op/s 2024-09-18T12:47:25.528 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:25 smithi161 ceph-mon[35784]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-18T12:47:25.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:25 smithi045 ceph-mon[28315]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-18T12:47:27.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:27 smithi161 ceph-mon[35784]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-18T12:47:27.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:27 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:27.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:27 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:27.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:27 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:27 smithi045 ceph-mon[28315]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-18T12:47:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:27 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:27 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:27 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:29.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:29 smithi161 ceph-mon[35784]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 109 KiB/s wr, 6 op/s 2024-09-18T12:47:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:29 smithi045 ceph-mon[28315]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 109 KiB/s wr, 6 op/s 2024-09-18T12:47:31.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.096+0000 7f1c88ff9640 1 -- 172.21.15.161:0/91304110 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1c8c06a420 con 0x7f1c7806e230 2024-09-18T12:47:31.098 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 3 on host 'smithi161' 2024-09-18T12:47:31.098 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:31.098 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:31.098 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:31.098 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:31.098 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:31.098 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:31 smithi161 ceph-mon[35784]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 109 KiB/s wr, 6 op/s 2024-09-18T12:47:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 -- 172.21.15.161:0/91304110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1c7806e230 msgr2=0x7f1c780706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1c7806e230 0x7f1c780706f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c005fd0 tx=0x7f1c7c00b410 comp rx=0 tx=0).stop 2024-09-18T12:47:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 -- 172.21.15.161:0/91304110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c8c101a60 msgr2=0x7f1c8c197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c8c101a60 0x7f1c8c197a30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1c74006010 tx=0x7f1c740046c0 comp rx=0 tx=0).stop 2024-09-18T12:47:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 -- 172.21.15.161:0/91304110 shutdown_connections 2024-09-18T12:47:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1c7806e230 0x7f1c780706f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c8c101a60 0x7f1c8c197a30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:31.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 --2- 172.21.15.161:0/91304110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c8c100860 0x7f1c8c1974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:31.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 -- 172.21.15.161:0/91304110 >> 172.21.15.161:0/91304110 conn(0x7f1c8c0fc010 msgr2=0x7f1c8c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:31.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 -- 172.21.15.161:0/91304110 shutdown_connections 2024-09-18T12:47:31.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:31.099+0000 7f1c91bb6640 1 -- 172.21.15.161:0/91304110 wait complete. 2024-09-18T12:47:31.506 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:31.506 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:31.506 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:31.506 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:31.506 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:31.506 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:31 smithi045 ceph-mon[28315]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 109 KiB/s wr, 6 op/s 2024-09-18T12:47:31.760 DEBUG:teuthology.orchestra.run.smithi161:osd.3> sudo journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.3.service 2024-09-18T12:47:31.762 INFO:tasks.cephadm:Deploying osd.4 on smithi161 with /dev/vg_nvme/lv_3... 2024-09-18T12:47:31.762 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-18T12:47:32.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:32.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:32.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:32.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:32.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:32 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:32.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:32 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:32.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:32 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:32.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:32 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:32.461 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi161/config 2024-09-18T12:47:33.193 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:33 smithi161 ceph-mon[35784]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:47:33.193 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:33 smithi161 ceph-mon[35784]: from='osd.3 [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:47:33.194 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:33 smithi161 ceph-mon[35784]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:47:33.194 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:47:33 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[41738]: 2024-09-18T12:47:33.015+0000 7fdb1f48e640 -1 osd.3 0 log_to_monitors true 2024-09-18T12:47:33.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:33 smithi045 ceph-mon[28315]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:47:33.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:33 smithi045 ceph-mon[28315]: from='osd.3 [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:47:33.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:33 smithi045 ceph-mon[28315]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T12:47:34.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:34 smithi045 ceph-mon[28315]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:47:34.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:34 smithi045 ceph-mon[28315]: from='osd.3 [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:47:34.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:34 smithi045 ceph-mon[28315]: osdmap e23: 4 total, 3 up, 4 in 2024-09-18T12:47:34.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:34 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:34.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:34 smithi045 ceph-mon[28315]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:47:34.542 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:47:34 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[41738]: 2024-09-18T12:47:34.097+0000 7fdb1abee640 -1 osd.3 0 waiting for initial osdmap 2024-09-18T12:47:34.542 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:47:34 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[41738]: 2024-09-18T12:47:34.103+0000 7fdb17228640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:47:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:34 smithi161 ceph-mon[35784]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:47:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:34 smithi161 ceph-mon[35784]: from='osd.3 [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:47:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:34 smithi161 ceph-mon[35784]: osdmap e23: 4 total, 3 up, 4 in 2024-09-18T12:47:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:34 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:34 smithi161 ceph-mon[35784]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:47:35.470 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:35 smithi161 ceph-mon[35784]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-09-18T12:47:35.470 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:35 smithi161 ceph-mon[35784]: osdmap e24: 4 total, 3 up, 4 in 2024-09-18T12:47:35.470 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:35 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:35.470 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:35 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:35.470 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:35 smithi161 ceph-mon[35784]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:47:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:35 smithi045 ceph-mon[28315]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-09-18T12:47:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:35 smithi045 ceph-mon[28315]: osdmap e24: 4 total, 3 up, 4 in 2024-09-18T12:47:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:35 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:35 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:35 smithi045 ceph-mon[28315]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 268 GiB / 268 GiB avail 2024-09-18T12:47:36.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: purged_snaps scrub starts 2024-09-18T12:47:36.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: purged_snaps scrub ok 2024-09-18T12:47:36.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:36.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: osd.3 [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458] boot 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: osdmap e25: 4 total, 4 up, 4 in 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: Detected new or changed devices on smithi161 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: Adjusting osd_memory_target on smithi161 to 14912M 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:36.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:36 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:36.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: purged_snaps scrub starts 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: purged_snaps scrub ok 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: osd.3 [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458] boot 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: osdmap e25: 4 total, 4 up, 4 in 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: Detected new or changed devices on smithi161 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: Adjusting osd_memory_target on smithi161 to 14912M 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:47:36.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:36 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:36.830 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:47:36.857 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi161:vg_nvme/lv_3 2024-09-18T12:47:37.104 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi161/config 2024-09-18T12:47:37.374 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:37 smithi161 ceph-mon[35784]: osdmap e26: 4 total, 4 up, 4 in 2024-09-18T12:47:37.374 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:37 smithi161 ceph-mon[35784]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 -- 172.21.15.161:0/4217709689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b40102b60 msgr2=0x7f0b40102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 --2- 172.21.15.161:0/4217709689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b40102b60 0x7f0b40102fe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009880 tx=0x7f0b3402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 -- 172.21.15.161:0/4217709689 shutdown_connections 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 --2- 172.21.15.161:0/4217709689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b40102b60 0x7f0b40102fe0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 --2- 172.21.15.161:0/4217709689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b40101960 0x7f0b40101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 -- 172.21.15.161:0/4217709689 >> 172.21.15.161:0/4217709689 conn(0x7f0b400fd110 msgr2=0x7f0b400ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 -- 172.21.15.161:0/4217709689 shutdown_connections 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 -- 172.21.15.161:0/4217709689 wait complete. 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 Processor -- start 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 -- start start 2024-09-18T12:47:37.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b40101960 0x7f0b40075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b40102b60 0x7f0b400745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4010a780 con 0x7f0b40101960 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.528+0000 7f0b46cab640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4010a600 con 0x7f0b40102b60 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b3ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b40102b60 0x7f0b400745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b3ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b40102b60 0x7f0b400745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54834/0 (socket says 172.21.15.161:54834) 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b3ffff640 1 -- 172.21.15.161:0/2561349143 learned_addr learned my addr 172.21.15.161:0/2561349143 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b44a47640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b40101960 0x7f0b40075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b3ffff640 1 -- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b40101960 msgr2=0x7f0b40075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b3ffff640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b40101960 0x7f0b40075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b3ffff640 1 -- 172.21.15.161:0/2561349143 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b40074b20 con 0x7f0b40102b60 2024-09-18T12:47:37.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b44a47640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b40101960 0x7f0b40075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:47:37.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b3ffff640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b40102b60 0x7f0b400745e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b34006010 tx=0x7f0b340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:37.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b3dffb640 1 -- 172.21.15.161:0/2561349143 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b3403f070 con 0x7f0b40102b60 2024-09-18T12:47:37.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b46cab640 1 -- 172.21.15.161:0/2561349143 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b40074db0 con 0x7f0b40102b60 2024-09-18T12:47:37.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b3dffb640 1 -- 172.21.15.161:0/2561349143 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b34004ac0 con 0x7f0b40102b60 2024-09-18T12:47:37.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b3dffb640 1 -- 172.21.15.161:0/2561349143 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b34035030 con 0x7f0b40102b60 2024-09-18T12:47:37.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.529+0000 7f0b46cab640 1 -- 172.21.15.161:0/2561349143 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b400752e0 con 0x7f0b40102b60 2024-09-18T12:47:37.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.530+0000 7f0b46cab640 1 -- 172.21.15.161:0/2561349143 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b40101d60 con 0x7f0b40102b60 2024-09-18T12:47:37.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.531+0000 7f0b3dffb640 1 -- 172.21.15.161:0/2561349143 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0b34042070 con 0x7f0b40102b60 2024-09-18T12:47:37.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.531+0000 7f0b3dffb640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0b2806e2b0 0x7f0b28070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:47:37.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.531+0000 7f0b3dffb640 1 -- 172.21.15.161:0/2561349143 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3803+0+0 (secure 0 0 0) 0x7f0b340ae770 con 0x7f0b40102b60 2024-09-18T12:47:37.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.532+0000 7f0b44a47640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0b2806e2b0 0x7f0b28070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:47:37.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.532+0000 7f0b44a47640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0b2806e2b0 0x7f0b28070770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0b300058c0 tx=0x7f0b30005850 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:47:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:37 smithi045 ceph-mon[28315]: osdmap e26: 4 total, 4 up, 4 in 2024-09-18T12:47:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:37 smithi045 ceph-mon[28315]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:37.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.536+0000 7f0b3dffb640 1 -- 172.21.15.161:0/2561349143 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b3407c750 con 0x7f0b40102b60 2024-09-18T12:47:37.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:37.709+0000 7f0b46cab640 1 -- 172.21.15.161:0/2561349143 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0b40062630 con 0x7f0b2806e2b0 2024-09-18T12:47:38.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:38 smithi161 ceph-mon[35784]: osdmap e27: 4 total, 4 up, 4 in 2024-09-18T12:47:38.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:38 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:47:38.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:38 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:47:38.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:38 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:38.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:38 smithi045 ceph-mon[28315]: osdmap e27: 4 total, 4 up, 4 in 2024-09-18T12:47:38.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:47:38.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:47:38.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:38 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:39.358 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:39 smithi161 ceph-mon[35784]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:39.358 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:39 smithi161 ceph-mon[35784]: osdmap e28: 4 total, 4 up, 4 in 2024-09-18T12:47:39.358 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:39 smithi161 ceph-mon[35784]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:39.358 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:39 smithi161 ceph-mon[35784]: osdmap e29: 4 total, 4 up, 4 in 2024-09-18T12:47:39.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:39 smithi045 ceph-mon[28315]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:47:39.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:39 smithi045 ceph-mon[28315]: osdmap e28: 4 total, 4 up, 4 in 2024-09-18T12:47:39.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:39 smithi045 ceph-mon[28315]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:39.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:39 smithi045 ceph-mon[28315]: osdmap e29: 4 total, 4 up, 4 in 2024-09-18T12:47:40.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:40 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/1312861473' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a5fa04a-1e4e-4bf4-ae7f-e6d17118ebaf"}]: dispatch 2024-09-18T12:47:40.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:40 smithi045 ceph-mon[28315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a5fa04a-1e4e-4bf4-ae7f-e6d17118ebaf"}]: dispatch 2024-09-18T12:47:40.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:40 smithi045 ceph-mon[28315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a5fa04a-1e4e-4bf4-ae7f-e6d17118ebaf"}]': finished 2024-09-18T12:47:40.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:40 smithi045 ceph-mon[28315]: osdmap e30: 5 total, 4 up, 5 in 2024-09-18T12:47:40.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:40 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:47:40.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:40 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/1312861473' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a5fa04a-1e4e-4bf4-ae7f-e6d17118ebaf"}]: dispatch 2024-09-18T12:47:40.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:40 smithi161 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a5fa04a-1e4e-4bf4-ae7f-e6d17118ebaf"}]: dispatch 2024-09-18T12:47:40.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:40 smithi161 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a5fa04a-1e4e-4bf4-ae7f-e6d17118ebaf"}]': finished 2024-09-18T12:47:40.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:40 smithi161 ceph-mon[35784]: osdmap e30: 5 total, 4 up, 5 in 2024-09-18T12:47:40.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:40 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:47:41.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:41 smithi045 ceph-mon[28315]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-18T12:47:41.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:41 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/1434035257' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:47:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:41 smithi161 ceph-mon[35784]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-18T12:47:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:41 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/1434035257' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:47:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:43 smithi045 ceph-mon[28315]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-18T12:47:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:43 smithi161 ceph-mon[35784]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-18T12:47:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:45 smithi045 ceph-mon[28315]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-18T12:47:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:45 smithi161 ceph-mon[35784]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-18T12:47:47.677 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:47 smithi161 ceph-mon[35784]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-18T12:47:47.677 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:47 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:47 smithi045 ceph-mon[28315]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-18T12:47:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:47 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:47:49.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:49 smithi161 ceph-mon[35784]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-18T12:47:49.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:49 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T12:47:49.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:49 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:49 smithi045 ceph-mon[28315]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-18T12:47:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:49 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T12:47:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:49 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:47:50.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:50 smithi161 ceph-mon[35784]: Deploying daemon osd.4 on smithi161 2024-09-18T12:47:50.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:50 smithi045 ceph-mon[28315]: Deploying daemon osd.4 on smithi161 2024-09-18T12:47:51.505 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:51 smithi161 ceph-mon[35784]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:51 smithi045 ceph-mon[28315]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:53 smithi045 ceph-mon[28315]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:53 smithi161 ceph-mon[35784]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:55.718 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:55 smithi161 ceph-mon[35784]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:55.718 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:55.718 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:55.718 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:55 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:55 smithi045 ceph-mon[28315]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:47:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:55 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:57.679 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:57 smithi161 ceph-mon[35784]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:57 smithi045 ceph-mon[28315]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:58.564 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 4 on host 'smithi161' 2024-09-18T12:47:58.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.562+0000 7f0b3dffb640 1 -- 172.21.15.161:0/2561349143 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0b40062630 con 0x7f0b2806e2b0 2024-09-18T12:47:58.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 -- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0b2806e2b0 msgr2=0x7f0b28070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:58.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0b2806e2b0 0x7f0b28070770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0b300058c0 tx=0x7f0b30005850 comp rx=0 tx=0).stop 2024-09-18T12:47:58.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 -- 172.21.15.161:0/2561349143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b40102b60 msgr2=0x7f0b400745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:47:58.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b40102b60 0x7f0b400745e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b34006010 tx=0x7f0b340046c0 comp rx=0 tx=0).stop 2024-09-18T12:47:58.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 -- 172.21.15.161:0/2561349143 shutdown_connections 2024-09-18T12:47:58.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0b2806e2b0 0x7f0b28070770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:58.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b40102b60 0x7f0b400745e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:58.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 --2- 172.21.15.161:0/2561349143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b40101960 0x7f0b40075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:47:58.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 -- 172.21.15.161:0/2561349143 >> 172.21.15.161:0/2561349143 conn(0x7f0b400fd110 msgr2=0x7f0b40106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:47:58.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 -- 172.21.15.161:0/2561349143 shutdown_connections 2024-09-18T12:47:58.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:47:58.564+0000 7f0b46cab640 1 -- 172.21.15.161:0/2561349143 wait complete. 2024-09-18T12:47:59.214 DEBUG:teuthology.orchestra.run.smithi161:osd.4> sudo journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.4.service 2024-09-18T12:47:59.217 INFO:tasks.cephadm:Deploying osd.5 on smithi161 with /dev/vg_nvme/lv_2... 2024-09-18T12:47:59.218 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-18T12:47:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:59 smithi161 ceph-mon[35784]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:47:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:59 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:47:59 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:47:59.909 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi161/config 2024-09-18T12:48:00.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:59 smithi045 ceph-mon[28315]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:48:00.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:59 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:00.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:47:59 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:01.429 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:48:01 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[48586]: 2024-09-18T12:48:01.213+0000 7f8939893640 -1 osd.4 0 log_to_monitors true 2024-09-18T12:48:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:01 smithi161 ceph-mon[35784]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:48:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:01 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:01 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:01 smithi161 ceph-mon[35784]: from='osd.4 [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:48:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:01 smithi161 ceph-mon[35784]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:48:01.912 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:01 smithi045 ceph-mon[28315]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:48:01.912 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:01 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:01.912 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:01 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:01.912 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:01 smithi045 ceph-mon[28315]: from='osd.4 [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:48:01.912 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:01 smithi045 ceph-mon[28315]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T12:48:02.559 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-18T12:48:02.587 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi161:vg_nvme/lv_2 2024-09-18T12:48:02.857 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:02.857 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:02 smithi161 ceph-mon[35784]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:48:02.857 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:02 smithi161 ceph-mon[35784]: osdmap e31: 5 total, 4 up, 5 in 2024-09-18T12:48:02.857 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:48:02.857 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:02 smithi161 ceph-mon[35784]: from='osd.4 [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:48:02.857 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:02 smithi161 ceph-mon[35784]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:48:03.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:03.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:02 smithi045 ceph-mon[28315]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:48:03.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:02 smithi045 ceph-mon[28315]: osdmap e31: 5 total, 4 up, 5 in 2024-09-18T12:48:03.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:48:03.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:02 smithi045 ceph-mon[28315]: from='osd.4 [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:48:03.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:02 smithi045 ceph-mon[28315]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:48:03.522 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi161/config 2024-09-18T12:48:03.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:48:03 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[48586]: 2024-09-18T12:48:03.425+0000 7f8934ff3640 -1 osd.4 0 waiting for initial osdmap 2024-09-18T12:48:03.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:48:03 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[48586]: 2024-09-18T12:48:03.433+0000 7f892d625640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:48:03.872 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:03 smithi161 ceph-mon[35784]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:48:03.872 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:03 smithi161 ceph-mon[35784]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-09-18T12:48:03.872 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:03 smithi161 ceph-mon[35784]: osdmap e32: 5 total, 4 up, 5 in 2024-09-18T12:48:03.872 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:48:03.873 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:03 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:48:03.873 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:03 smithi161 ceph-mon[35784]: from='osd.4 ' entity='osd.4' 2024-09-18T12:48:04.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:03 smithi045 ceph-mon[28315]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:48:04.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:03 smithi045 ceph-mon[28315]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-09-18T12:48:04.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:03 smithi045 ceph-mon[28315]: osdmap e32: 5 total, 4 up, 5 in 2024-09-18T12:48:04.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:48:04.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:03 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:48:04.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:03 smithi045 ceph-mon[28315]: from='osd.4 ' entity='osd.4' 2024-09-18T12:48:04.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.426+0000 7f11a460f640 1 -- 172.21.15.161:0/2341276332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f119c102b70 msgr2=0x7f119c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:04.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.426+0000 7f11a460f640 1 --2- 172.21.15.161:0/2341276332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f119c102b70 0x7f119c102ff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f118c009880 tx=0x7f118c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.426+0000 7f11a460f640 1 -- 172.21.15.161:0/2341276332 shutdown_connections 2024-09-18T12:48:04.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.426+0000 7f11a460f640 1 --2- 172.21.15.161:0/2341276332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f119c102b70 0x7f119c102ff0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.426+0000 7f11a460f640 1 --2- 172.21.15.161:0/2341276332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119c101970 0x7f119c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.426+0000 7f11a460f640 1 -- 172.21.15.161:0/2341276332 >> 172.21.15.161:0/2341276332 conn(0x7f119c0fd140 msgr2=0x7f119c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:04.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.426+0000 7f11a460f640 1 -- 172.21.15.161:0/2341276332 shutdown_connections 2024-09-18T12:48:04.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.426+0000 7f11a460f640 1 -- 172.21.15.161:0/2341276332 wait complete. 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.427+0000 7f11a460f640 1 Processor -- start 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.427+0000 7f11a460f640 1 -- start start 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.427+0000 7f11a460f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119c101970 0x7f119c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.427+0000 7f11a460f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f119c102b70 0x7f119c197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.427+0000 7f11a460f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f119c10a7b0 con 0x7f119c101970 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.427+0000 7f11a460f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f119c10a630 con 0x7f119c102b70 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a1baa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f119c102b70 0x7f119c197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a1baa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f119c102b70 0x7f119c197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38466/0 (socket says 172.21.15.161:38466) 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a1baa640 1 -- 172.21.15.161:0/1406244564 learned_addr learned my addr 172.21.15.161:0/1406244564 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a23ab640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119c101970 0x7f119c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a1baa640 1 -- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119c101970 msgr2=0x7f119c1974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a1baa640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119c101970 0x7f119c1974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a1baa640 1 -- 172.21.15.161:0/1406244564 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c1980a0 con 0x7f119c102b70 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a23ab640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119c101970 0x7f119c1974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a1baa640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f119c102b70 0x7f119c197a20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f118c009230 tx=0x7f118c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11937fe640 1 -- 172.21.15.161:0/1406244564 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f118c03f070 con 0x7f119c102b70 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a460f640 1 -- 172.21.15.161:0/1406244564 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c19ca80 con 0x7f119c102b70 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11937fe640 1 -- 172.21.15.161:0/1406244564 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f118c004b80 con 0x7f119c102b70 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11937fe640 1 -- 172.21.15.161:0/1406244564 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f118c035030 con 0x7f119c102b70 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.428+0000 7f11a460f640 1 -- 172.21.15.161:0/1406244564 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c19d010 con 0x7f119c102b70 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.430+0000 7f11a460f640 1 -- 172.21.15.161:0/1406244564 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119c101d70 con 0x7f119c102b70 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.430+0000 7f11937fe640 1 -- 172.21.15.161:0/1406244564 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f118c042070 con 0x7f119c102b70 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.431+0000 7f11937fe640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f118806e2b0 0x7f1188070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.431+0000 7f11937fe640 1 -- 172.21.15.161:0/1406244564 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4206+0+0 (secure 0 0 0) 0x7f118c0ae8f0 con 0x7f119c102b70 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.431+0000 7f11a23ab640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f118806e2b0 0x7f1188070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.431+0000 7f11a23ab640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f118806e2b0 0x7f1188070770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f11980058c0 tx=0x7f1198005850 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:04.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.436+0000 7f11937fe640 1 -- 172.21.15.161:0/1406244564 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f118c07c740 con 0x7f119c102b70 2024-09-18T12:48:04.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:04.624+0000 7f11a460f640 1 -- 172.21.15.161:0/1406244564 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f119c062630 con 0x7f118806e2b0 2024-09-18T12:48:04.731 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:04 smithi161 ceph-mon[35784]: purged_snaps scrub starts 2024-09-18T12:48:04.731 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:04 smithi161 ceph-mon[35784]: purged_snaps scrub ok 2024-09-18T12:48:04.731 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:04 smithi161 ceph-mon[35784]: osd.4 [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638] boot 2024-09-18T12:48:04.731 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:04 smithi161 ceph-mon[35784]: osdmap e33: 5 total, 5 up, 5 in 2024-09-18T12:48:04.731 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:48:04.732 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:04 smithi161 ceph-mon[35784]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:48:04.732 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:48:04.732 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:48:04.732 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:05.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:04 smithi045 ceph-mon[28315]: purged_snaps scrub starts 2024-09-18T12:48:05.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:04 smithi045 ceph-mon[28315]: purged_snaps scrub ok 2024-09-18T12:48:05.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:04 smithi045 ceph-mon[28315]: osd.4 [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638] boot 2024-09-18T12:48:05.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:04 smithi045 ceph-mon[28315]: osdmap e33: 5 total, 5 up, 5 in 2024-09-18T12:48:05.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:48:05.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:04 smithi045 ceph-mon[28315]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-18T12:48:05.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T12:48:05.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T12:48:05.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:05.901 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:05.901 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: osdmap e34: 5 total, 5 up, 5 in 2024-09-18T12:48:05.901 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: Detected new or changed devices on smithi161 2024-09-18T12:48:05.901 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:05.901 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:05.901 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:48:05.901 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:48:05.901 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: Adjusting osd_memory_target on smithi161 to 7456M 2024-09-18T12:48:05.902 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:05.902 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:05.902 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:05.902 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:05.902 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:06.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:48:06.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: osdmap e34: 5 total, 5 up, 5 in 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: Detected new or changed devices on smithi161 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: Adjusting osd_memory_target on smithi161 to 7456M 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:06.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:06.855 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:06.855 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:06.855 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:06 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:06.856 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:06 smithi161 ceph-mon[35784]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:07.004 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:07.004 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:07.004 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:06 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:07.005 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:06 smithi045 ceph-mon[28315]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:08 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/2233608920' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bc9653a-794e-4716-a830-1bf624a1e115"}]: dispatch 2024-09-18T12:48:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:08 smithi045 ceph-mon[28315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bc9653a-794e-4716-a830-1bf624a1e115"}]: dispatch 2024-09-18T12:48:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:08 smithi045 ceph-mon[28315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0bc9653a-794e-4716-a830-1bf624a1e115"}]': finished 2024-09-18T12:48:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:08 smithi045 ceph-mon[28315]: osdmap e35: 6 total, 5 up, 6 in 2024-09-18T12:48:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:08 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:08 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/3696216367' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:48:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:08 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/2233608920' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bc9653a-794e-4716-a830-1bf624a1e115"}]: dispatch 2024-09-18T12:48:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:08 smithi161 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bc9653a-794e-4716-a830-1bf624a1e115"}]: dispatch 2024-09-18T12:48:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:08 smithi161 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0bc9653a-794e-4716-a830-1bf624a1e115"}]': finished 2024-09-18T12:48:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:08 smithi161 ceph-mon[35784]: osdmap e35: 6 total, 5 up, 6 in 2024-09-18T12:48:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:08 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:08 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/3696216367' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T12:48:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:09 smithi045 ceph-mon[28315]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:09 smithi161 ceph-mon[35784]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:11.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:11 smithi045 ceph-mon[28315]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:11 smithi161 ceph-mon[35784]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:13.705 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:13 smithi161 ceph-mon[35784]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:13 smithi045 ceph-mon[28315]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:15.434 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:15 smithi161 ceph-mon[35784]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:15 smithi045 ceph-mon[28315]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:16.701 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T12:48:16.701 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:16.701 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:16 smithi161 ceph-mon[35784]: Deploying daemon osd.5 on smithi161 2024-09-18T12:48:16.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T12:48:16.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:16.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:16 smithi045 ceph-mon[28315]: Deploying daemon osd.5 on smithi161 2024-09-18T12:48:17.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:17 smithi161 ceph-mon[35784]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:17.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:17 smithi045 ceph-mon[28315]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:19.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:19 smithi045 ceph-mon[28315]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:19 smithi161 ceph-mon[35784]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:21 smithi045 ceph-mon[28315]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:21 smithi161 ceph-mon[35784]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:22.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:22.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:22.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:22.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:22.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:22.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:23.846 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:23 smithi161 ceph-mon[35784]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:24.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:23 smithi045 ceph-mon[28315]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:24.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.703+0000 7f11937fe640 1 -- 172.21.15.161:0/1406244564 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f119c062630 con 0x7f118806e2b0 2024-09-18T12:48:24.704 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 5 on host 'smithi161' 2024-09-18T12:48:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 -- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f118806e2b0 msgr2=0x7f1188070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f118806e2b0 0x7f1188070770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f11980058c0 tx=0x7f1198005850 comp rx=0 tx=0).stop 2024-09-18T12:48:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 -- 172.21.15.161:0/1406244564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f119c102b70 msgr2=0x7f119c197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f119c102b70 0x7f119c197a20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f118c009230 tx=0x7f118c0046c0 comp rx=0 tx=0).stop 2024-09-18T12:48:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 -- 172.21.15.161:0/1406244564 shutdown_connections 2024-09-18T12:48:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f118806e2b0 0x7f1188070770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f119c102b70 0x7f119c197a20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 --2- 172.21.15.161:0/1406244564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119c101970 0x7f119c1974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:24.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 -- 172.21.15.161:0/1406244564 >> 172.21.15.161:0/1406244564 conn(0x7f119c0fd140 msgr2=0x7f119c106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:24.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 -- 172.21.15.161:0/1406244564 shutdown_connections 2024-09-18T12:48:24.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:24.705+0000 7f11a460f640 1 -- 172.21.15.161:0/1406244564 wait complete. 2024-09-18T12:48:25.323 DEBUG:teuthology.orchestra.run.smithi161:osd.5> sudo journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.5.service 2024-09-18T12:48:25.326 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-18T12:48:25.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-18T12:48:25.597 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:25.715 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:25 smithi045 ceph-mon[28315]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:25.715 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:25 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:25.715 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:25 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:25.880 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:25 smithi161 ceph-mon[35784]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:25.880 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:25 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:25.880 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:25 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.059+0000 7fb52d86e640 1 -- 172.21.15.45:0/3062278698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb528102b60 msgr2=0x7fb528102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.059+0000 7fb52d86e640 1 --2- 172.21.15.45:0/3062278698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb528102b60 0x7fb528102fe0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009880 tx=0x7fb51c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.059+0000 7fb52d86e640 1 -- 172.21.15.45:0/3062278698 shutdown_connections 2024-09-18T12:48:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.059+0000 7fb52d86e640 1 --2- 172.21.15.45:0/3062278698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb528102b60 0x7fb528102fe0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.059+0000 7fb52d86e640 1 --2- 172.21.15.45:0/3062278698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528101960 0x7fb528101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.059+0000 7fb52d86e640 1 -- 172.21.15.45:0/3062278698 >> 172.21.15.45:0/3062278698 conn(0x7fb5280fd0f0 msgr2=0x7fb5280ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.059+0000 7fb52d86e640 1 -- 172.21.15.45:0/3062278698 shutdown_connections 2024-09-18T12:48:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.059+0000 7fb52d86e640 1 -- 172.21.15.45:0/3062278698 wait complete. 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.060+0000 7fb52d86e640 1 Processor -- start 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb52d86e640 1 -- start start 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb52d86e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb528101960 0x7fb528197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb52d86e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528102b60 0x7fb5281979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb52d86e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb52810a780 con 0x7fb528101960 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb52d86e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb52810a600 con 0x7fb528102b60 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb526ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb528101960 0x7fb528197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb526ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb528101960 0x7fb528197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36716/0 (socket says 172.21.15.45:36716) 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb526ffd640 1 -- 172.21.15.45:0/1449127006 learned_addr learned my addr 172.21.15.45:0/1449127006 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb5267fc640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528102b60 0x7fb5281979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb526ffd640 1 -- 172.21.15.45:0/1449127006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528102b60 msgr2=0x7fb5281979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb526ffd640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528102b60 0x7fb5281979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb526ffd640 1 -- 172.21.15.45:0/1449127006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb528198030 con 0x7fb528101960 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.061+0000 7fb526ffd640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb528101960 0x7fb528197470 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb51800e940 tx=0x7fb51800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.062+0000 7fb52c86c640 1 -- 172.21.15.45:0/1449127006 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb51800cac0 con 0x7fb528101960 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.062+0000 7fb52c86c640 1 -- 172.21.15.45:0/1449127006 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb51800cc60 con 0x7fb528101960 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.062+0000 7fb52d86e640 1 -- 172.21.15.45:0/1449127006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb52819ca70 con 0x7fb528101960 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.062+0000 7fb52c86c640 1 -- 172.21.15.45:0/1449127006 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb518003de0 con 0x7fb528101960 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.062+0000 7fb52d86e640 1 -- 172.21.15.45:0/1449127006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb52819cfd0 con 0x7fb528101960 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.063+0000 7fb52d86e640 1 -- 172.21.15.45:0/1449127006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb52810af60 con 0x7fb528101960 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.063+0000 7fb52c86c640 1 -- 172.21.15.45:0/1449127006 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb518003f80 con 0x7fb528101960 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.064+0000 7fb52c86c640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb51006e310 0x7fb5100707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.064+0000 7fb5267fc640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb51006e310 0x7fb5100707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.064+0000 7fb52c86c640 1 -- 172.21.15.45:0/1449127006 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4321+0+0 (secure 0 0 0) 0x7fb51808e300 con 0x7fb528101960 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.065+0000 7fb5267fc640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb51006e310 0x7fb5100707d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb51c000c00 tx=0x7fb51c0058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:26.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.069+0000 7fb52c86c640 1 -- 172.21.15.45:0/1449127006 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb51805c150 con 0x7fb528101960 2024-09-18T12:48:26.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.247+0000 7fb52d86e640 1 -- 172.21.15.45:0/1449127006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb528101d60 con 0x7fb528101960 2024-09-18T12:48:26.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.247+0000 7fb52c86c640 1 -- 172.21.15.45:0/1449127006 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) ==== 74+0+130 (secure 0 0 0) 0x7fb51808e030 con 0x7fb528101960 2024-09-18T12:48:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:48:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.249+0000 7fb52d86e640 1 -- 172.21.15.45:0/1449127006 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb51006e310 msgr2=0x7fb5100707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.249+0000 7fb52d86e640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb51006e310 0x7fb5100707d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb51c000c00 tx=0x7fb51c0058d0 comp rx=0 tx=0).stop 2024-09-18T12:48:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.249+0000 7fb52d86e640 1 -- 172.21.15.45:0/1449127006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb528101960 msgr2=0x7fb528197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.249+0000 7fb52d86e640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb528101960 0x7fb528197470 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb51800e940 tx=0x7fb51800ee00 comp rx=0 tx=0).stop 2024-09-18T12:48:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.249+0000 7fb52d86e640 1 -- 172.21.15.45:0/1449127006 shutdown_connections 2024-09-18T12:48:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.249+0000 7fb52d86e640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb51006e310 0x7fb5100707d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.249+0000 7fb52d86e640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528102b60 0x7fb5281979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.249+0000 7fb52d86e640 1 --2- 172.21.15.45:0/1449127006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb528101960 0x7fb528197470 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.249+0000 7fb52d86e640 1 -- 172.21.15.45:0/1449127006 >> 172.21.15.45:0/1449127006 conn(0x7fb5280fd0f0 msgr2=0x7fb528106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.250+0000 7fb52d86e640 1 -- 172.21.15.45:0/1449127006 shutdown_connections 2024-09-18T12:48:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:26.250+0000 7fb52d86e640 1 -- 172.21.15.45:0/1449127006 wait complete. 2024-09-18T12:48:26.818 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:26 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1449127006' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:48:26.818 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:26 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:26.818 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:26 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:26.921 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:26 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1449127006' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:48:26.921 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:26 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:26.922 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:26 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:26.949 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1726663683,"num_in_osds":6,"osd_in_since":1726663687,"num_remapped_pgs":0} 2024-09-18T12:48:27.855 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:27 smithi161 ceph-mon[35784]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:27.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-18T12:48:27.977 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:27 smithi045 ceph-mon[28315]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:28.149 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:48:27 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[55425]: 2024-09-18T12:48:27.900+0000 7f46a01f2640 -1 osd.5 0 log_to_monitors true 2024-09-18T12:48:28.217 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:28.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:28 smithi045 ceph-mon[28315]: from='osd.5 [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:48:28.600 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:28 smithi045 ceph-mon[28315]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:48:28.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.681+0000 7f953b289640 1 -- 172.21.15.45:0/227051854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95341001e0 msgr2=0x7f95341025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:28.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.681+0000 7f953b289640 1 --2- 172.21.15.45:0/227051854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95341001e0 0x7f95341025f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9530009880 tx=0x7f953002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:28.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.681+0000 7f953b289640 1 -- 172.21.15.45:0/227051854 shutdown_connections 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.681+0000 7f953b289640 1 --2- 172.21.15.45:0/227051854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9534102b30 0x7f9534104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.681+0000 7f953b289640 1 --2- 172.21.15.45:0/227051854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95341001e0 0x7f95341025f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.681+0000 7f953b289640 1 -- 172.21.15.45:0/227051854 >> 172.21.15.45:0/227051854 conn(0x7f95340fc010 msgr2=0x7f95340fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.681+0000 7f953b289640 1 -- 172.21.15.45:0/227051854 shutdown_connections 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.681+0000 7f953b289640 1 -- 172.21.15.45:0/227051854 wait complete. 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f953b289640 1 Processor -- start 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f953b289640 1 -- start start 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f953b289640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95341001e0 0x7f953419dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f953b289640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9534102b30 0x7f953419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f953b289640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9534110d70 con 0x7f95341001e0 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f953b289640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9534110bf0 con 0x7f9534102b30 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f9539025640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95341001e0 0x7f953419dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:28.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f9539025640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95341001e0 0x7f953419dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36734/0 (socket says 172.21.15.45:36734) 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f9539025640 1 -- 172.21.15.45:0/1161883846 learned_addr learned my addr 172.21.15.45:0/1161883846 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f9538824640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9534102b30 0x7f953419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f9539025640 1 -- 172.21.15.45:0/1161883846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9534102b30 msgr2=0x7f953419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.682+0000 7f9539025640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9534102b30 0x7f953419e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.683+0000 7f9539025640 1 -- 172.21.15.45:0/1161883846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953419e680 con 0x7f95341001e0 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.683+0000 7f9539025640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95341001e0 0x7f953419dac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9530006010 tx=0x7f95300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.683+0000 7f952a7fc640 1 -- 172.21.15.45:0/1161883846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f953003f070 con 0x7f95341001e0 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.683+0000 7f952a7fc640 1 -- 172.21.15.45:0/1161883846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f95300044d0 con 0x7f95341001e0 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.683+0000 7f953b289640 1 -- 172.21.15.45:0/1161883846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95341a3060 con 0x7f95341001e0 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.683+0000 7f952a7fc640 1 -- 172.21.15.45:0/1161883846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9530035030 con 0x7f95341001e0 2024-09-18T12:48:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.683+0000 7f953b289640 1 -- 172.21.15.45:0/1161883846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95341a35f0 con 0x7f95341001e0 2024-09-18T12:48:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.684+0000 7f953b289640 1 -- 172.21.15.45:0/1161883846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95341005e0 con 0x7f95341001e0 2024-09-18T12:48:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.684+0000 7f952a7fc640 1 -- 172.21.15.45:0/1161883846 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9530042070 con 0x7f95341001e0 2024-09-18T12:48:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.685+0000 7f952a7fc640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f952006e310 0x7f95200707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.685+0000 7f9538824640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f952006e310 0x7f95200707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.685+0000 7f952a7fc640 1 -- 172.21.15.45:0/1161883846 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4342+0+0 (secure 0 0 0) 0x7f95300ae990 con 0x7f95341001e0 2024-09-18T12:48:28.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.685+0000 7f9538824640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f952006e310 0x7f95200707d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f953419ef70 tx=0x7f952400a4c0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:28.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.689+0000 7f952a7fc640 1 -- 172.21.15.45:0/1161883846 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f953007c7d0 con 0x7f95341001e0 2024-09-18T12:48:28.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.863+0000 7f953b289640 1 -- 172.21.15.45:0/1161883846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f95341a3ee0 con 0x7f95341001e0 2024-09-18T12:48:28.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.863+0000 7f952a7fc640 1 -- 172.21.15.45:0/1161883846 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) ==== 74+0+130 (secure 0 0 0) 0x7f9530080480 con 0x7f95341001e0 2024-09-18T12:48:28.865 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 -- 172.21.15.45:0/1161883846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f952006e310 msgr2=0x7f95200707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f952006e310 0x7f95200707d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f953419ef70 tx=0x7f952400a4c0 comp rx=0 tx=0).stop 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 -- 172.21.15.45:0/1161883846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95341001e0 msgr2=0x7f953419dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95341001e0 0x7f953419dac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9530006010 tx=0x7f95300048f0 comp rx=0 tx=0).stop 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 -- 172.21.15.45:0/1161883846 shutdown_connections 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f952006e310 0x7f95200707d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9534102b30 0x7f953419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 --2- 172.21.15.45:0/1161883846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95341001e0 0x7f953419dac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 -- 172.21.15.45:0/1161883846 >> 172.21.15.45:0/1161883846 conn(0x7f95340fc010 msgr2=0x7f95340fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 -- 172.21.15.45:0/1161883846 shutdown_connections 2024-09-18T12:48:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:28.865+0000 7f953b289640 1 -- 172.21.15.45:0/1161883846 wait complete. 2024-09-18T12:48:28.936 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:28 smithi161 ceph-mon[35784]: from='osd.5 [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:48:28.936 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:28 smithi161 ceph-mon[35784]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T12:48:29.592 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1726663683,"num_in_osds":6,"osd_in_since":1726663687,"num_remapped_pgs":0} 2024-09-18T12:48:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: osdmap e36: 6 total, 5 up, 6 in 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='osd.5 [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1161883846' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:29.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:29.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:29.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:29.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:29.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:29.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:30.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:30.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: osdmap e36: 6 total, 5 up, 6 in 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='osd.5 [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1161883846' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:30.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:30.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:48:30.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:48:30.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:48:30.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:48:30.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-18T12:48:30.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:48:30 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[55425]: 2024-09-18T12:48:30.403+0000 7f469c989640 -1 osd.5 0 waiting for initial osdmap 2024-09-18T12:48:30.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:48:30 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[55425]: 2024-09-18T12:48:30.414+0000 7f4693f84640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:48:30.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:30 smithi161 ceph-mon[35784]: Detected new or changed devices on smithi161 2024-09-18T12:48:30.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:30 smithi161 ceph-mon[35784]: Adjusting osd_memory_target on smithi161 to 4970M 2024-09-18T12:48:30.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:30 smithi161 ceph-mon[35784]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-09-18T12:48:30.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:30 smithi161 ceph-mon[35784]: osdmap e37: 6 total, 5 up, 6 in 2024-09-18T12:48:30.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:30 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:30.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:30 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:30.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:30 smithi161 ceph-mon[35784]: from='osd.5 ' entity='osd.5' 2024-09-18T12:48:30.861 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:30.983 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:30 smithi045 ceph-mon[28315]: Detected new or changed devices on smithi161 2024-09-18T12:48:30.983 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:30 smithi045 ceph-mon[28315]: Adjusting osd_memory_target on smithi161 to 4970M 2024-09-18T12:48:30.983 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:30 smithi045 ceph-mon[28315]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-09-18T12:48:30.983 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:30 smithi045 ceph-mon[28315]: osdmap e37: 6 total, 5 up, 6 in 2024-09-18T12:48:30.983 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:30 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:30.983 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:30 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:30.984 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:30 smithi045 ceph-mon[28315]: from='osd.5 ' entity='osd.5' 2024-09-18T12:48:31.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.279+0000 7f47635a4640 1 -- 172.21.15.45:0/179215487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f475c1023f0 msgr2=0x7f475c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.279+0000 7f47635a4640 1 --2- 172.21.15.45:0/179215487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f475c1023f0 0x7f475c1047e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f47580098b0 tx=0x7f475802a4d0 comp rx=0 tx=0).stop 2024-09-18T12:48:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.279+0000 7f47635a4640 1 -- 172.21.15.45:0/179215487 shutdown_connections 2024-09-18T12:48:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.279+0000 7f47635a4640 1 --2- 172.21.15.45:0/179215487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c104d20 0x7f475c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.279+0000 7f47635a4640 1 --2- 172.21.15.45:0/179215487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f475c1023f0 0x7f475c1047e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.279+0000 7f47635a4640 1 -- 172.21.15.45:0/179215487 >> 172.21.15.45:0/179215487 conn(0x7f475c0fc010 msgr2=0x7f475c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.279+0000 7f47635a4640 1 -- 172.21.15.45:0/179215487 shutdown_connections 2024-09-18T12:48:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.280+0000 7f47635a4640 1 -- 172.21.15.45:0/179215487 wait complete. 2024-09-18T12:48:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f47635a4640 1 Processor -- start 2024-09-18T12:48:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f47635a4640 1 -- start start 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f47635a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f475c1023f0 0x7f475c06bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f47635a4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c104d20 0x7f475c06c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f47635a4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f475c10a7c0 con 0x7f475c1023f0 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f47635a4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f475c10a640 con 0x7f475c104d20 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f4761340640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f475c1023f0 0x7f475c06bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f4761340640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f475c1023f0 0x7f475c06bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36744/0 (socket says 172.21.15.45:36744) 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f4761340640 1 -- 172.21.15.45:0/2713008130 learned_addr learned my addr 172.21.15.45:0/2713008130 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f4760b3f640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c104d20 0x7f475c06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f4761340640 1 -- 172.21.15.45:0/2713008130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c104d20 msgr2=0x7f475c06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.281+0000 7f4761340640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c104d20 0x7f475c06c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.282+0000 7f4761340640 1 -- 172.21.15.45:0/2713008130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c06cba0 con 0x7f475c1023f0 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.282+0000 7f4761340640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f475c1023f0 0x7f475c06bfe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f47580099d0 tx=0x7f47580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.282+0000 7f47527fc640 1 -- 172.21.15.45:0/2713008130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f475803f070 con 0x7f475c1023f0 2024-09-18T12:48:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.282+0000 7f47635a4640 1 -- 172.21.15.45:0/2713008130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c071580 con 0x7f475c1023f0 2024-09-18T12:48:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.282+0000 7f47527fc640 1 -- 172.21.15.45:0/2713008130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4758004c70 con 0x7f475c1023f0 2024-09-18T12:48:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.282+0000 7f47527fc640 1 -- 172.21.15.45:0/2713008130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4758035030 con 0x7f475c1023f0 2024-09-18T12:48:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.282+0000 7f47635a4640 1 -- 172.21.15.45:0/2713008130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c071b10 con 0x7f475c1023f0 2024-09-18T12:48:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.283+0000 7f47635a4640 1 -- 172.21.15.45:0/2713008130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475c1027d0 con 0x7f475c1023f0 2024-09-18T12:48:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.284+0000 7f47527fc640 1 -- 172.21.15.45:0/2713008130 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f4758042070 con 0x7f475c1023f0 2024-09-18T12:48:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.284+0000 7f47527fc640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f474806e2b0 0x7f4748070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.284+0000 7f47527fc640 1 -- 172.21.15.45:0/2713008130 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4358+0+0 (secure 0 0 0) 0x7f47580ae940 con 0x7f475c1023f0 2024-09-18T12:48:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.284+0000 7f4760b3f640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f474806e2b0 0x7f4748070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.285+0000 7f4760b3f640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f474806e2b0 0x7f4748070770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f475c06d490 tx=0x7f474c00a2d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.289+0000 7f47527fc640 1 -- 172.21.15.45:0/2713008130 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47580803a0 con 0x7f475c1023f0 2024-09-18T12:48:31.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.466+0000 7f47635a4640 1 -- 172.21.15.45:0/2713008130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f475c071e80 con 0x7f475c1023f0 2024-09-18T12:48:31.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.466+0000 7f47527fc640 1 -- 172.21.15.45:0/2713008130 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) ==== 74+0+130 (secure 0 0 0) 0x7f4758084bd0 con 0x7f475c1023f0 2024-09-18T12:48:31.467 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 -- 172.21.15.45:0/2713008130 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f474806e2b0 msgr2=0x7f4748070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f474806e2b0 0x7f4748070770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f475c06d490 tx=0x7f474c00a2d0 comp rx=0 tx=0).stop 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 -- 172.21.15.45:0/2713008130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f475c1023f0 msgr2=0x7f475c06bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f475c1023f0 0x7f475c06bfe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f47580099d0 tx=0x7f47580048f0 comp rx=0 tx=0).stop 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 -- 172.21.15.45:0/2713008130 shutdown_connections 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f474806e2b0 0x7f4748070770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c104d20 0x7f475c06c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 --2- 172.21.15.45:0/2713008130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f475c1023f0 0x7f475c06bfe0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 -- 172.21.15.45:0/2713008130 >> 172.21.15.45:0/2713008130 conn(0x7f475c0fc010 msgr2=0x7f475c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 -- 172.21.15.45:0/2713008130 shutdown_connections 2024-09-18T12:48:31.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:31.468+0000 7f47635a4640 1 -- 172.21.15.45:0/2713008130 wait complete. 2024-09-18T12:48:31.913 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:31 smithi045 ceph-mon[28315]: purged_snaps scrub starts 2024-09-18T12:48:31.913 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:31 smithi045 ceph-mon[28315]: purged_snaps scrub ok 2024-09-18T12:48:31.913 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:31 smithi045 ceph-mon[28315]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:31.913 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:31.913 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:31 smithi045 ceph-mon[28315]: osd.5 [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570] boot 2024-09-18T12:48:31.913 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:31 smithi045 ceph-mon[28315]: osdmap e38: 6 total, 6 up, 6 in 2024-09-18T12:48:31.913 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:31.913 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:31 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2713008130' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:48:31.914 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:31 smithi161 ceph-mon[35784]: purged_snaps scrub starts 2024-09-18T12:48:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:31 smithi161 ceph-mon[35784]: purged_snaps scrub ok 2024-09-18T12:48:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:31 smithi161 ceph-mon[35784]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-18T12:48:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:31 smithi161 ceph-mon[35784]: osd.5 [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570] boot 2024-09-18T12:48:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:31 smithi161 ceph-mon[35784]: osdmap e38: 6 total, 6 up, 6 in 2024-09-18T12:48:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:48:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:31 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2713008130' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T12:48:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:32.155 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726663711,"num_in_osds":6,"osd_in_since":1726663687,"num_remapped_pgs":0} 2024-09-18T12:48:32.156 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T12:48:32.412 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.887+0000 7f17ae1db640 1 -- 172.21.15.45:0/749538654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17a8103470 msgr2=0x7f17a810b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.887+0000 7f17ae1db640 1 --2- 172.21.15.45:0/749538654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17a8103470 0x7f17a810b960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f179c009880 tx=0x7f179c02a530 comp rx=0 tx=0).stop 2024-09-18T12:48:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.887+0000 7f17ae1db640 1 -- 172.21.15.45:0/749538654 shutdown_connections 2024-09-18T12:48:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.887+0000 7f17ae1db640 1 --2- 172.21.15.45:0/749538654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17a8103470 0x7f17a810b960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.887+0000 7f17ae1db640 1 --2- 172.21.15.45:0/749538654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17a8102b50 0x7f17a8102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.887+0000 7f17ae1db640 1 -- 172.21.15.45:0/749538654 >> 172.21.15.45:0/749538654 conn(0x7f17a80fc550 msgr2=0x7f17a80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.887+0000 7f17ae1db640 1 -- 172.21.15.45:0/749538654 shutdown_connections 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.887+0000 7f17ae1db640 1 -- 172.21.15.45:0/749538654 wait complete. 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.887+0000 7f17ae1db640 1 Processor -- start 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17ae1db640 1 -- start start 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17ae1db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17a8102b50 0x7f17a819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17ae1db640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17a8103470 0x7f17a819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17ae1db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f17a810ee40 con 0x7f17a8102b50 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17ae1db640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f17a810ecc0 con 0x7f17a8103470 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17a8102b50 0x7f17a819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17a8102b50 0x7f17a819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41304/0 (socket says 172.21.15.45:41304) 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17a77fe640 1 -- 172.21.15.45:0/2857081700 learned_addr learned my addr 172.21.15.45:0/2857081700 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17a6ffd640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17a8103470 0x7f17a819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17a77fe640 1 -- 172.21.15.45:0/2857081700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17a8103470 msgr2=0x7f17a819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17a77fe640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17a8103470 0x7f17a819dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17a77fe640 1 -- 172.21.15.45:0/2857081700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a8197890 con 0x7f17a8102b50 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.888+0000 7f17a77fe640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17a8102b50 0x7f17a819d6d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f179800b420 tx=0x7f179800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.889+0000 7f17a4ff9640 1 -- 172.21.15.45:0/2857081700 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1798011630 con 0x7f17a8102b50 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.889+0000 7f17a4ff9640 1 -- 172.21.15.45:0/2857081700 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1798016070 con 0x7f17a8102b50 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.889+0000 7f17ae1db640 1 -- 172.21.15.45:0/2857081700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a8197b80 con 0x7f17a8102b50 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.889+0000 7f17a4ff9640 1 -- 172.21.15.45:0/2857081700 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1798010d40 con 0x7f17a8102b50 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.889+0000 7f17ae1db640 1 -- 172.21.15.45:0/2857081700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a8198110 con 0x7f17a8102b50 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.890+0000 7f17ae1db640 1 -- 172.21.15.45:0/2857081700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a806a4e0 con 0x7f17a8102b50 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.890+0000 7f17a4ff9640 1 -- 172.21.15.45:0/2857081700 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f179801b460 con 0x7f17a8102b50 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.891+0000 7f17a4ff9640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f179006e310 0x7f17900707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.891+0000 7f17a4ff9640 1 -- 172.21.15.45:0/2857081700 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f179808d690 con 0x7f17a8102b50 2024-09-18T12:48:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.891+0000 7f17a6ffd640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f179006e310 0x7f17900707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:32.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.891+0000 7f17a6ffd640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f179006e310 0x7f17900707d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f179c004f90 tx=0x7f179c009560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:32.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:32.895+0000 7f17a4ff9640 1 -- 172.21.15.45:0/2857081700 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f179805b310 con 0x7f17a8102b50 2024-09-18T12:48:33.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.071+0000 7f17ae1db640 1 -- 172.21.15.45:0/2857081700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17a8198dc0 con 0x7f17a8102b50 2024-09-18T12:48:33.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.072+0000 7f17a4ff9640 1 -- 172.21.15.45:0/2857081700 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11356 (secure 0 0 0) 0x7f179805efc0 con 0x7f17a8102b50 2024-09-18T12:48:33.074 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:48:33.074 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","created":"2024-09-18T12:42:34.157830+0000","modified":"2024-09-18T12:48:32.588236+0000","last_up_change":"2024-09-18T12:48:31.405964+0000","last_in_change":"2024-09-18T12:48:07.544699+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:47:12.057699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abc0345a-6b97-47e0-b114-e26dc66a74cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6803","nonce":2326762873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6805","nonce":2326762873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6809","nonce":2326762873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6807","nonce":2326762873}]},"public_addr":"172.21.15.45:6803/2326762873","cluster_addr":"172.21.15.45:6805/2326762873","heartbeat_back_addr":"172.21.15.45:6809/2326762873","heartbeat_front_addr":"172.21.15.45:6807/2326762873","state":["exists","up"]},{"osd":1,"uuid":"d20b034b-671a-41a6-8b14-29708f221cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6811","nonce":2210413799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6813","nonce":2210413799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6817","nonce":2210413799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6815","nonce":2210413799}]},"public_addr":"172.21.15.45:6811/2210413799","cluster_addr":"172.21.15.45:6813/2210413799","heartbeat_back_addr":"172.21.15.45:6817/2210413799","heartbeat_front_addr":"172.21.15.45:6815/2210413799","state":["exists","up"]},{"osd":2,"uuid":"f2751347-83f5-4e3f-ba05-0af90ad01aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6819","nonce":878363968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6821","nonce":878363968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6825","nonce":878363968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6823","nonce":878363968}]},"public_addr":"172.21.15.45:6819/878363968","cluster_addr":"172.21.15.45:6821/878363968","heartbeat_back_addr":"172.21.15.45:6825/878363968","heartbeat_front_addr":"172.21.15.45:6823/878363968","state":["exists","up"]},{"osd":3,"uuid":"112d636d-4dbc-494b-a7a0-0db054771763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6801","nonce":2568825458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6803","nonce":2568825458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6807","nonce":2568825458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6805","nonce":2568825458}]},"public_addr":"172.21.15.161:6801/2568825458","cluster_addr":"172.21.15.161:6803/2568825458","heartbeat_back_addr":"172.21.15.161:6807/2568825458","heartbeat_front_addr":"172.21.15.161:6805/2568825458","state":["exists","up"]},{"osd":4,"uuid":"7a5fa04a-1e4e-4bf4-ae7f-e6d17118ebaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6809","nonce":3479703638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6811","nonce":3479703638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6815","nonce":3479703638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6813","nonce":3479703638}]},"public_addr":"172.21.15.161:6809/3479703638","cluster_addr":"172.21.15.161:6811/3479703638","heartbeat_back_addr":"172.21.15.161:6815/3479703638","heartbeat_front_addr":"172.21.15.161:6813/3479703638","state":["exists","up"]},{"osd":5,"uuid":"0bc9653a-794e-4716-a830-1bf624a1e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6817","nonce":5467570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6819","nonce":5467570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6823","nonce":5467570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6821","nonce":5467570}]},"public_addr":"172.21.15.161:6817/5467570","cluster_addr":"172.21.15.161:6819/5467570","heartbeat_back_addr":"172.21.15.161:6823/5467570","heartbeat_front_addr":"172.21.15.161:6821/5467570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:04.505507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:02.226350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:10.157095+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:34.032711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:48:02.258575+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:48:28.891662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/4239091440":"2024-09-19T12:44:31.530414+0000","172.21.15.45:6800/4239091440":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/3244778815":"2024-09-19T12:43:02.441203+0000","172.21.15.45:6800/865557257":"2024-09-19T12:43:34.610573+0000","172.21.15.45:6800/4029715284":"2024-09-19T12:43:02.441203+0000","172.21.15.45:6801/4029715284":"2024-09-19T12:43:02.441203+0000","172.21.15.45:0/3028834940":"2024-09-19T12:43:02.441203+0000","172.21.15.45:0/286550513":"2024-09-19T12:43:34.610573+0000","172.21.15.45:0/529444775":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/1773614817":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/3573172920":"2024-09-19T12:43:02.441203+0000","172.21.15.45:6801/865557257":"2024-09-19T12:43:34.610573+0000","172.21.15.45:0/2571293493":"2024-09-19T12:43:34.610573+0000","172.21.15.45:0/714422720":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/2088566729":"2024-09-19T12:43:34.610573+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.074+0000 7f17ae1db640 1 -- 172.21.15.45:0/2857081700 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f179006e310 msgr2=0x7f17900707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.074+0000 7f17ae1db640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f179006e310 0x7f17900707d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f179c004f90 tx=0x7f179c009560 comp rx=0 tx=0).stop 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.074+0000 7f17ae1db640 1 -- 172.21.15.45:0/2857081700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17a8102b50 msgr2=0x7f17a819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.074+0000 7f17ae1db640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17a8102b50 0x7f17a819d6d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f179800b420 tx=0x7f179800b8e0 comp rx=0 tx=0).stop 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.074+0000 7f17ae1db640 1 -- 172.21.15.45:0/2857081700 shutdown_connections 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.074+0000 7f17ae1db640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f179006e310 0x7f17900707d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.074+0000 7f17ae1db640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17a8103470 0x7f17a819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.074+0000 7f17ae1db640 1 --2- 172.21.15.45:0/2857081700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17a8102b50 0x7f17a819d6d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.074+0000 7f17ae1db640 1 -- 172.21.15.45:0/2857081700 >> 172.21.15.45:0/2857081700 conn(0x7f17a80fc550 msgr2=0x7f17a8107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.075+0000 7f17ae1db640 1 -- 172.21.15.45:0/2857081700 shutdown_connections 2024-09-18T12:48:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:33.075+0000 7f17ae1db640 1 -- 172.21.15.45:0/2857081700 wait complete. 2024-09-18T12:48:33.677 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:33 smithi045 ceph-mon[28315]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:33.677 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:33 smithi045 ceph-mon[28315]: osdmap e39: 6 total, 6 up, 6 in 2024-09-18T12:48:33.677 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:33 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2857081700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:48:33.708 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T12:47:12.057699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-18T12:48:33.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-18T12:48:33.966 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:34.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:33 smithi161 ceph-mon[35784]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:34.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:33 smithi161 ceph-mon[35784]: osdmap e39: 6 total, 6 up, 6 in 2024-09-18T12:48:34.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:33 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2857081700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:48:34.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.414+0000 7f1ff2349640 1 -- 172.21.15.45:0/236699579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec1067f0 msgr2=0x7f1fec106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:34.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.414+0000 7f1ff2349640 1 --2- 172.21.15.45:0/236699579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec1067f0 0x7f1fec106bd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009880 tx=0x7f1fdc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:34.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.414+0000 7f1ff2349640 1 -- 172.21.15.45:0/236699579 shutdown_connections 2024-09-18T12:48:34.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.414+0000 7f1ff2349640 1 --2- 172.21.15.45:0/236699579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fec1007f0 0x7f1fec100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:34.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.414+0000 7f1ff2349640 1 --2- 172.21.15.45:0/236699579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec1067f0 0x7f1fec106bd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.414+0000 7f1ff2349640 1 -- 172.21.15.45:0/236699579 >> 172.21.15.45:0/236699579 conn(0x7f1fec0fc550 msgr2=0x7f1fec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.414+0000 7f1ff2349640 1 -- 172.21.15.45:0/236699579 shutdown_connections 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.414+0000 7f1ff2349640 1 -- 172.21.15.45:0/236699579 wait complete. 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1ff2349640 1 Processor -- start 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1ff2349640 1 -- start start 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1ff2349640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fec1007f0 0x7f1fec19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1ff2349640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec1067f0 0x7f1fec19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1ff2349640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec10dca0 con 0x7f1fec1067f0 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1ff2349640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec10db20 con 0x7f1fec1007f0 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1fe3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec1067f0 0x7f1fec19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1fe3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec1067f0 0x7f1fec19fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41320/0 (socket says 172.21.15.45:41320) 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1fe3fff640 1 -- 172.21.15.45:0/1877930256 learned_addr learned my addr 172.21.15.45:0/1877930256 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1febfff640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fec1007f0 0x7f1fec19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1fe3fff640 1 -- 172.21.15.45:0/1877930256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fec1007f0 msgr2=0x7f1fec19f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1fe3fff640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fec1007f0 0x7f1fec19f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.415+0000 7f1fe3fff640 1 -- 172.21.15.45:0/1877930256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec199970 con 0x7f1fec1067f0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.416+0000 7f1fe3fff640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec1067f0 0x7f1fec19fcf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c810 tx=0x7f1fd400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.416+0000 7f1fe9ffb640 1 -- 172.21.15.45:0/1877930256 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1fd4004020 con 0x7f1fec1067f0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.416+0000 7f1fe9ffb640 1 -- 172.21.15.45:0/1877930256 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1fd40041c0 con 0x7f1fec1067f0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.416+0000 7f1ff2349640 1 -- 172.21.15.45:0/1877930256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec199c60 con 0x7f1fec1067f0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.416+0000 7f1fe9ffb640 1 -- 172.21.15.45:0/1877930256 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1fd40047a0 con 0x7f1fec1067f0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.416+0000 7f1ff2349640 1 -- 172.21.15.45:0/1877930256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec19a1f0 con 0x7f1fec1067f0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.417+0000 7f1ff2349640 1 -- 172.21.15.45:0/1877930256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec101f30 con 0x7f1fec1067f0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.417+0000 7f1fe9ffb640 1 -- 172.21.15.45:0/1877930256 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1fd40079b0 con 0x7f1fec1067f0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.418+0000 7f1fe9ffb640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1fd806e2b0 0x7f1fd8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.418+0000 7f1fe9ffb640 1 -- 172.21.15.45:0/1877930256 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1fd408dc60 con 0x7f1fec1067f0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.418+0000 7f1febfff640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1fd806e2b0 0x7f1fd8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.418+0000 7f1febfff640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1fd806e2b0 0x7f1fd8070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc000c00 tx=0x7f1fdc031400 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:34.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.422+0000 7f1fe9ffb640 1 -- 172.21.15.45:0/1877930256 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1fd4014030 con 0x7f1fec1067f0 2024-09-18T12:48:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.599+0000 7f1ff2349640 1 -- 172.21.15.45:0/1877930256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1fec19af80 con 0x7f1fec1067f0 2024-09-18T12:48:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.600+0000 7f1fe9ffb640 1 -- 172.21.15.45:0/1877930256 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f1fec19af80 con 0x7f1fec1067f0 2024-09-18T12:48:34.601 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-09-18T12:48:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.601+0000 7f1ff2349640 1 -- 172.21.15.45:0/1877930256 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1fd806e2b0 msgr2=0x7f1fd8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.601+0000 7f1ff2349640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1fd806e2b0 0x7f1fd8070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc000c00 tx=0x7f1fdc031400 comp rx=0 tx=0).stop 2024-09-18T12:48:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.601+0000 7f1ff2349640 1 -- 172.21.15.45:0/1877930256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec1067f0 msgr2=0x7f1fec19fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.601+0000 7f1ff2349640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec1067f0 0x7f1fec19fcf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c810 tx=0x7f1fd400ccd0 comp rx=0 tx=0).stop 2024-09-18T12:48:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.602+0000 7f1ff2349640 1 -- 172.21.15.45:0/1877930256 shutdown_connections 2024-09-18T12:48:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.602+0000 7f1ff2349640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f1fd806e2b0 0x7f1fd8070770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.602+0000 7f1ff2349640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec1067f0 0x7f1fec19fcf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.602+0000 7f1ff2349640 1 --2- 172.21.15.45:0/1877930256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fec1007f0 0x7f1fec19f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.602+0000 7f1ff2349640 1 -- 172.21.15.45:0/1877930256 >> 172.21.15.45:0/1877930256 conn(0x7f1fec0fc550 msgr2=0x7f1fec069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.602+0000 7f1ff2349640 1 -- 172.21.15.45:0/1877930256 shutdown_connections 2024-09-18T12:48:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:34.602+0000 7f1ff2349640 1 -- 172.21.15.45:0/1877930256 wait complete. 2024-09-18T12:48:34.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:34 smithi045 ceph-mon[28315]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:34.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:34 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1877930256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-18T12:48:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:34 smithi161 ceph-mon[35784]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:35.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:34 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1877930256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-18T12:48:35.147 INFO:tasks.cephadm:Setting up client nodes... 2024-09-18T12:48:35.147 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-18T12:48:35.404 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:35.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.842+0000 7f33a0b2e640 1 -- 172.21.15.45:0/3463696430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c101960 msgr2=0x7f339c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:35.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.842+0000 7f33a0b2e640 1 --2- 172.21.15.45:0/3463696430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c101960 0x7f339c101d60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f338c009c20 tx=0x7f338c02a970 comp rx=0 tx=0).stop 2024-09-18T12:48:35.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.842+0000 7f33a0b2e640 1 -- 172.21.15.45:0/3463696430 shutdown_connections 2024-09-18T12:48:35.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.842+0000 7f33a0b2e640 1 --2- 172.21.15.45:0/3463696430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f339c102b60 0x7f339c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:35.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.843+0000 7f33a0b2e640 1 --2- 172.21.15.45:0/3463696430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c101960 0x7f339c101d60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:35.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.843+0000 7f33a0b2e640 1 -- 172.21.15.45:0/3463696430 >> 172.21.15.45:0/3463696430 conn(0x7f339c0fd0f0 msgr2=0x7f339c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:35.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.843+0000 7f33a0b2e640 1 -- 172.21.15.45:0/3463696430 shutdown_connections 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.843+0000 7f33a0b2e640 1 -- 172.21.15.45:0/3463696430 wait complete. 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.843+0000 7f33a0b2e640 1 Processor -- start 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.843+0000 7f33a0b2e640 1 -- start start 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f33a0b2e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f339c101960 0x7f339c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f33a0b2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c102b60 0x7f339c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f33a0b2e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f339c10a7a0 con 0x7f339c102b60 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f33a0b2e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f339c10a620 con 0x7f339c101960 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f3399d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c102b60 0x7f339c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f3399d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c102b60 0x7f339c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41336/0 (socket says 172.21.15.45:41336) 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f3399d9b640 1 -- 172.21.15.45:0/2692911023 learned_addr learned my addr 172.21.15.45:0/2692911023 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f339a59c640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f339c101960 0x7f339c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f3399d9b640 1 -- 172.21.15.45:0/2692911023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f339c101960 msgr2=0x7f339c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f3399d9b640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f339c101960 0x7f339c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:35.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f3399d9b640 1 -- 172.21.15.45:0/2692911023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c074b20 con 0x7f339c102b60 2024-09-18T12:48:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f3399d9b640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c102b60 0x7f339c0745e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f339000d6f0 tx=0x7f339000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f338b7fe640 1 -- 172.21.15.45:0/2692911023 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3390017070 con 0x7f339c102b60 2024-09-18T12:48:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f338b7fe640 1 -- 172.21.15.45:0/2692911023 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f339000de00 con 0x7f339c102b60 2024-09-18T12:48:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f33a0b2e640 1 -- 172.21.15.45:0/2692911023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339c074e10 con 0x7f339c102b60 2024-09-18T12:48:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.844+0000 7f338b7fe640 1 -- 172.21.15.45:0/2692911023 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3390004bb0 con 0x7f339c102b60 2024-09-18T12:48:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.845+0000 7f33a0b2e640 1 -- 172.21.15.45:0/2692911023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f339c075420 con 0x7f339c102b60 2024-09-18T12:48:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.846+0000 7f33a0b2e640 1 -- 172.21.15.45:0/2692911023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f339c101d60 con 0x7f339c102b60 2024-09-18T12:48:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.846+0000 7f338b7fe640 1 -- 172.21.15.45:0/2692911023 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3390009a30 con 0x7f339c102b60 2024-09-18T12:48:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.847+0000 7f338b7fe640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f338406e310 0x7f33840707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:35.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.847+0000 7f339a59c640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f338406e310 0x7f33840707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:35.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.847+0000 7f338b7fe640 1 -- 172.21.15.45:0/2692911023 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f339008d980 con 0x7f339c102b60 2024-09-18T12:48:35.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.847+0000 7f339a59c640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f338406e310 0x7f33840707d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f338c000f80 tx=0x7f338c02f9f0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:35.851+0000 7f338b7fe640 1 -- 172.21.15.45:0/2692911023 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f339005b6a0 con 0x7f339c102b60 2024-09-18T12:48:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.092+0000 7f33a0b2e640 1 -- 172.21.15.45:0/2692911023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f339c19f890 con 0x7f339c102b60 2024-09-18T12:48:36.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.094+0000 7f338b7fe640 1 -- 172.21.15.45:0/2692911023 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7f339005f350 con 0x7f339c102b60 2024-09-18T12:48:36.095 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2024-09-18T12:48:36.095 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAkzOpmU0eUBRAAM2Fv22ce+BQoNPG2Y6pZUQ== 2024-09-18T12:48:36.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 -- 172.21.15.45:0/2692911023 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f338406e310 msgr2=0x7f33840707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f338406e310 0x7f33840707d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f338c000f80 tx=0x7f338c02f9f0 comp rx=0 tx=0).stop 2024-09-18T12:48:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 -- 172.21.15.45:0/2692911023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c102b60 msgr2=0x7f339c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c102b60 0x7f339c0745e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f339000d6f0 tx=0x7f339000dbb0 comp rx=0 tx=0).stop 2024-09-18T12:48:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 -- 172.21.15.45:0/2692911023 shutdown_connections 2024-09-18T12:48:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f338406e310 0x7f33840707d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c102b60 0x7f339c0745e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 --2- 172.21.15.45:0/2692911023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f339c101960 0x7f339c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 -- 172.21.15.45:0/2692911023 >> 172.21.15.45:0/2692911023 conn(0x7f339c0fd0f0 msgr2=0x7f339c0ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 -- 172.21.15.45:0/2692911023 shutdown_connections 2024-09-18T12:48:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:36.096+0000 7f33a0b2e640 1 -- 172.21.15.45:0/2692911023 wait complete. 2024-09-18T12:48:36.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:36 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2692911023' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:48:36.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:36 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2692911023' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:48:36.488 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:36 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2692911023' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:48:36.488 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:36 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2692911023' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:48:36.793 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:48:36.793 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-18T12:48:36.793 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T12:48:36.831 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-18T12:48:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi161/config 2024-09-18T12:48:37.420 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:37 smithi161 ceph-mon[35784]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:37.432 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:37 smithi045 ceph-mon[28315]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:37.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.628+0000 7f50794d9640 1 -- 172.21.15.161:0/2027503979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5074101a60 msgr2=0x7f5074101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:37.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.628+0000 7f50794d9640 1 --2- 172.21.15.161:0/2027503979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5074101a60 0x7f5074101ee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5068009880 tx=0x7f506802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.628+0000 7f50794d9640 1 -- 172.21.15.161:0/2027503979 shutdown_connections 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.628+0000 7f50794d9640 1 --2- 172.21.15.161:0/2027503979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5074101a60 0x7f5074101ee0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.628+0000 7f50794d9640 1 --2- 172.21.15.161:0/2027503979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5074100860 0x7f5074100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.628+0000 7f50794d9640 1 -- 172.21.15.161:0/2027503979 >> 172.21.15.161:0/2027503979 conn(0x7f50740fc010 msgr2=0x7f50740fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.628+0000 7f50794d9640 1 -- 172.21.15.161:0/2027503979 shutdown_connections 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.628+0000 7f50794d9640 1 -- 172.21.15.161:0/2027503979 wait complete. 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f50794d9640 1 Processor -- start 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f50794d9640 1 -- start start 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f50794d9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5074100860 0x7f507406aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f50794d9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5074101a60 0x7f507419c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f50794d9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f50741096a0 con 0x7f5074101a60 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f50794d9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f5074109520 con 0x7f5074100860 2024-09-18T12:48:37.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f5072ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5074100860 0x7f507406aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f5072ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5074100860 0x7f507406aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:49338/0 (socket says 172.21.15.161:49338) 2024-09-18T12:48:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f5072ffd640 1 -- 172.21.15.161:0/9964532 learned_addr learned my addr 172.21.15.161:0/9964532 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-09-18T12:48:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f50727fc640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5074101a60 0x7f507419c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f5072ffd640 1 -- 172.21.15.161:0/9964532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5074101a60 msgr2=0x7f507419c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f5072ffd640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5074101a60 0x7f507419c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.629+0000 7f5072ffd640 1 -- 172.21.15.161:0/9964532 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507419c800 con 0x7f5074100860 2024-09-18T12:48:37.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.630+0000 7f5072ffd640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5074100860 0x7f507406aca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f506400e970 tx=0x7f506400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.630+0000 7f505bfff640 1 -- 172.21.15.161:0/9964532 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f506400cac0 con 0x7f5074100860 2024-09-18T12:48:37.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.630+0000 7f50794d9640 1 -- 172.21.15.161:0/9964532 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f507419caf0 con 0x7f5074100860 2024-09-18T12:48:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.630+0000 7f505bfff640 1 -- 172.21.15.161:0/9964532 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f506400cc60 con 0x7f5074100860 2024-09-18T12:48:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.630+0000 7f505bfff640 1 -- 172.21.15.161:0/9964532 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5064003e20 con 0x7f5074100860 2024-09-18T12:48:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.630+0000 7f50794d9640 1 -- 172.21.15.161:0/9964532 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f507419d050 con 0x7f5074100860 2024-09-18T12:48:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.631+0000 7f50794d9640 1 -- 172.21.15.161:0/9964532 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5074100c60 con 0x7f5074100860 2024-09-18T12:48:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.632+0000 7f505bfff640 1 -- 172.21.15.161:0/9964532 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5064004000 con 0x7f5074100860 2024-09-18T12:48:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.632+0000 7f505bfff640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f505c06e2b0 0x7f505c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.632+0000 7f505bfff640 1 -- 172.21.15.161:0/9964532 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f506408e460 con 0x7f5074100860 2024-09-18T12:48:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.632+0000 7f50727fc640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f505c06e2b0 0x7f505c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:37.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.633+0000 7f50727fc640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f505c06e2b0 0x7f505c070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5068000c00 tx=0x7f50680058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:37.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.636+0000 7f505bfff640 1 -- 172.21.15.161:0/9964532 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f506405c070 con 0x7f5074100860 2024-09-18T12:48:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.866+0000 7f50794d9640 1 -- 172.21.15.161:0/9964532 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f50741904b0 con 0x7f5074100860 2024-09-18T12:48:37.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.871+0000 7f505bfff640 1 -- 172.21.15.161:0/9964532 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f506408e280 con 0x7f5074100860 2024-09-18T12:48:37.872 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2024-09-18T12:48:37.872 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAlzOpme4K8MxAAuBr4gdQvQxjVHeuqlzYbHA== 2024-09-18T12:48:37.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 -- 172.21.15.161:0/9964532 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f505c06e2b0 msgr2=0x7f505c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:37.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f505c06e2b0 0x7f505c070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5068000c00 tx=0x7f50680058d0 comp rx=0 tx=0).stop 2024-09-18T12:48:37.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 -- 172.21.15.161:0/9964532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5074100860 msgr2=0x7f507406aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:37.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5074100860 0x7f507406aca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f506400e970 tx=0x7f506400ee30 comp rx=0 tx=0).stop 2024-09-18T12:48:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 -- 172.21.15.161:0/9964532 shutdown_connections 2024-09-18T12:48:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f505c06e2b0 0x7f505c070770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5074101a60 0x7f507419c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 --2- 172.21.15.161:0/9964532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5074100860 0x7f507406aca0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 -- 172.21.15.161:0/9964532 >> 172.21.15.161:0/9964532 conn(0x7f50740fc010 msgr2=0x7f5074104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 -- 172.21.15.161:0/9964532 shutdown_connections 2024-09-18T12:48:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:48:37.873+0000 7f50794d9640 1 -- 172.21.15.161:0/9964532 wait complete. 2024-09-18T12:48:38.527 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:38 smithi161 ceph-mon[35784]: from='client.? 172.21.15.161:0/9964532' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:48:38.527 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:38 smithi161 ceph-mon[35784]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:48:38.527 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:38 smithi161 ceph-mon[35784]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:48:38.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:38 smithi045 ceph-mon[28315]: from='client.? 172.21.15.161:0/9964532' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:48:38.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:38 smithi045 ceph-mon[28315]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T12:48:38.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:38 smithi045 ceph-mon[28315]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T12:48:38.555 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:48:38.556 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-18T12:48:38.556 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-18T12:48:38.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph config log 1 --format=json 2024-09-18T12:48:38.862 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:39.245 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:39 smithi045 ceph-mon[28315]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:39.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.327+0000 7f6a87a21640 1 -- 172.21.15.45:0/1045725807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a80074f40 msgr2=0x7f6a8010dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.327+0000 7f6a87a21640 1 --2- 172.21.15.45:0/1045725807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a80074f40 0x7f6a8010dc00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009880 tx=0x7f6a7002a530 comp rx=0 tx=0).stop 2024-09-18T12:48:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.327+0000 7f6a87a21640 1 -- 172.21.15.45:0/1045725807 shutdown_connections 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.327+0000 7f6a87a21640 1 --2- 172.21.15.45:0/1045725807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a80074f40 0x7f6a8010dc00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.327+0000 7f6a87a21640 1 --2- 172.21.15.45:0/1045725807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a80074620 0x7f6a80074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.327+0000 7f6a87a21640 1 -- 172.21.15.45:0/1045725807 >> 172.21.15.45:0/1045725807 conn(0x7f6a800fd600 msgr2=0x7f6a800ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.327+0000 7f6a87a21640 1 -- 172.21.15.45:0/1045725807 shutdown_connections 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.327+0000 7f6a87a21640 1 -- 172.21.15.45:0/1045725807 wait complete. 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.327+0000 7f6a87a21640 1 Processor -- start 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.327+0000 7f6a87a21640 1 -- start start 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a87a21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a80074620 0x7f6a80199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a87a21640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a80074f40 0x7f6a8019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a87a21640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6a80111050 con 0x7f6a80074620 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a87a21640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6a80110ed0 con 0x7f6a80074f40 2024-09-18T12:48:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a857bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a80074620 0x7f6a80199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a857bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a80074620 0x7f6a80199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41356/0 (socket says 172.21.15.45:41356) 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a857bd640 1 -- 172.21.15.45:0/3227725796 learned_addr learned my addr 172.21.15.45:0/3227725796 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a84fbc640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a80074f40 0x7f6a8019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a857bd640 1 -- 172.21.15.45:0/3227725796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a80074f40 msgr2=0x7f6a8019a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a857bd640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a80074f40 0x7f6a8019a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a857bd640 1 -- 172.21.15.45:0/3227725796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8019e620 con 0x7f6a80074620 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a84fbc640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a80074f40 0x7f6a8019a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a857bd640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a80074620 0x7f6a80199d50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00b420 tx=0x7f6a7c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a767fc640 1 -- 172.21.15.45:0/3227725796 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a7c011630 con 0x7f6a80074620 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a87a21640 1 -- 172.21.15.45:0/3227725796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a8019e910 con 0x7f6a80074620 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a767fc640 1 -- 172.21.15.45:0/3227725796 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a7c016070 con 0x7f6a80074620 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a767fc640 1 -- 172.21.15.45:0/3227725796 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a7c010d40 con 0x7f6a80074620 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.328+0000 7f6a87a21640 1 -- 172.21.15.45:0/3227725796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a8019eea0 con 0x7f6a80074620 2024-09-18T12:48:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.329+0000 7f6a87a21640 1 -- 172.21.15.45:0/3227725796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a80075cd0 con 0x7f6a80074620 2024-09-18T12:48:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.330+0000 7f6a767fc640 1 -- 172.21.15.45:0/3227725796 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6a7c01b460 con 0x7f6a80074620 2024-09-18T12:48:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.330+0000 7f6a767fc640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6c06e2b0 0x7f6a6c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.330+0000 7f6a767fc640 1 -- 172.21.15.45:0/3227725796 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f6a7c08d6a0 con 0x7f6a80074620 2024-09-18T12:48:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.331+0000 7f6a84fbc640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6c06e2b0 0x7f6a6c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.331+0000 7f6a84fbc640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6c06e2b0 0x7f6a6c070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a70006010 tx=0x7f6a700095f0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.335+0000 7f6a767fc640 1 -- 172.21.15.45:0/3227725796 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a7c05b340 con 0x7f6a80074620 2024-09-18T12:48:39.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.513+0000 7f6a87a21640 1 -- 172.21.15.45:0/3227725796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f6a8019b0b0 con 0x7f6a80074620 2024-09-18T12:48:39.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.513+0000 7f6a767fc640 1 -- 172.21.15.45:0/3227725796 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v41) ==== 86+0+160 (secure 0 0 0) 0x7f6a7c05eff0 con 0x7f6a80074620 2024-09-18T12:48:39.515 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:48:39.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 -- 172.21.15.45:0/3227725796 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6c06e2b0 msgr2=0x7f6a6c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:39.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6c06e2b0 0x7f6a6c070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a70006010 tx=0x7f6a700095f0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 -- 172.21.15.45:0/3227725796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a80074620 msgr2=0x7f6a80199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:39.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a80074620 0x7f6a80199d50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00b420 tx=0x7f6a7c00b8e0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 -- 172.21.15.45:0/3227725796 shutdown_connections 2024-09-18T12:48:39.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6c06e2b0 0x7f6a6c070770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a80074f40 0x7f6a8019a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 --2- 172.21.15.45:0/3227725796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a80074620 0x7f6a80199d50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:39.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 -- 172.21.15.45:0/3227725796 >> 172.21.15.45:0/3227725796 conn(0x7f6a800fd600 msgr2=0x7f6a8010b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:39.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 -- 172.21.15.45:0/3227725796 shutdown_connections 2024-09-18T12:48:39.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:39.516+0000 7f6a87a21640 1 -- 172.21.15.45:0/3227725796 wait complete. 2024-09-18T12:48:39.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:39 smithi161 ceph-mon[35784]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:40.222 INFO:teuthology.orchestra.run.smithi045.stdout:[{"version":41,"timestamp":"2024-09-18T12:48:30.405001+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"7871.313656"}]}] 2024-09-18T12:48:40.222 INFO:tasks.ceph_manager:config epoch is 41 2024-09-18T12:48:40.222 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T12:48:40.222 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-18T12:48:40.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-18T12:48:40.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:40 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3227725796' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-18T12:48:40.485 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:40.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:40 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3227725796' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.915+0000 7f8fb50c6640 1 -- 172.21.15.45:0/1014128724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb0100800 msgr2=0x7f8fb0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.915+0000 7f8fb50c6640 1 --2- 172.21.15.45:0/1014128724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb0100800 0x7f8fb0100c60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009880 tx=0x7f8fa402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.915+0000 7f8fb50c6640 1 -- 172.21.15.45:0/1014128724 shutdown_connections 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.915+0000 7f8fb50c6640 1 --2- 172.21.15.45:0/1014128724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb0100800 0x7f8fb0100c60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.915+0000 7f8fb50c6640 1 --2- 172.21.15.45:0/1014128724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fb0106800 0x7f8fb0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.915+0000 7f8fb50c6640 1 -- 172.21.15.45:0/1014128724 >> 172.21.15.45:0/1014128724 conn(0x7f8fb00fc520 msgr2=0x7f8fb00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.915+0000 7f8fb50c6640 1 -- 172.21.15.45:0/1014128724 shutdown_connections 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.915+0000 7f8fb50c6640 1 -- 172.21.15.45:0/1014128724 wait complete. 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.916+0000 7f8fb50c6640 1 Processor -- start 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.916+0000 7f8fb50c6640 1 -- start start 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.916+0000 7f8fb50c6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fb0100800 0x7f8fb019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:40.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.916+0000 7f8fb50c6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb0106800 0x7f8fb019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.916+0000 7f8fb50c6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010dd30 con 0x7f8fb0106800 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.916+0000 7f8fb50c6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb010dbb0 con 0x7f8fb0100800 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.916+0000 7f8fae59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb0106800 0x7f8fb019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.916+0000 7f8fae59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb0106800 0x7f8fb019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41372/0 (socket says 172.21.15.45:41372) 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.916+0000 7f8fae59c640 1 -- 172.21.15.45:0/4104223712 learned_addr learned my addr 172.21.15.45:0/4104223712 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.916+0000 7f8faed9d640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fb0100800 0x7f8fb019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.917+0000 7f8fae59c640 1 -- 172.21.15.45:0/4104223712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fb0100800 msgr2=0x7f8fb019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.917+0000 7f8fae59c640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fb0100800 0x7f8fb019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.917+0000 7f8fae59c640 1 -- 172.21.15.45:0/4104223712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb0197870 con 0x7f8fb0106800 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.917+0000 7f8faed9d640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fb0100800 0x7f8fb019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:48:40.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.917+0000 7f8fae59c640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb0106800 0x7f8fb019dbf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4031460 tx=0x7f8fa40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:40.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.917+0000 7f8f97fff640 1 -- 172.21.15.45:0/4104223712 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fa403f070 con 0x7f8fb0106800 2024-09-18T12:48:40.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.917+0000 7f8fb50c6640 1 -- 172.21.15.45:0/4104223712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb0197b00 con 0x7f8fb0106800 2024-09-18T12:48:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.917+0000 7f8f97fff640 1 -- 172.21.15.45:0/4104223712 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fa4004cf0 con 0x7f8fb0106800 2024-09-18T12:48:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.917+0000 7f8fb50c6640 1 -- 172.21.15.45:0/4104223712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb0198030 con 0x7f8fb0106800 2024-09-18T12:48:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.917+0000 7f8f97fff640 1 -- 172.21.15.45:0/4104223712 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fa4035030 con 0x7f8fb0106800 2024-09-18T12:48:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.918+0000 7f8fb50c6640 1 -- 172.21.15.45:0/4104223712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f9c005290 con 0x7f8fb0106800 2024-09-18T12:48:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.919+0000 7f8f97fff640 1 -- 172.21.15.45:0/4104223712 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8fa4042070 con 0x7f8fb0106800 2024-09-18T12:48:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.919+0000 7f8f97fff640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8f9806e310 0x7f8f980707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.919+0000 7f8f97fff640 1 -- 172.21.15.45:0/4104223712 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f8fa40ae6d0 con 0x7f8fb0106800 2024-09-18T12:48:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.919+0000 7f8faed9d640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8f9806e310 0x7f8f980707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:40.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.920+0000 7f8faed9d640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8f9806e310 0x7f8f980707d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fb01989b0 tx=0x7f8fa0008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:40.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:40.923+0000 7f8f97fff640 1 -- 172.21.15.45:0/4104223712 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fa407c3f0 con 0x7f8fb0106800 2024-09-18T12:48:41.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.146+0000 7f8fb50c6640 1 -- 172.21.15.45:0/4104223712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8f9c005580 con 0x7f8fb0106800 2024-09-18T12:48:41.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.149+0000 7f8f97fff640 1 -- 172.21.15.45:0/4104223712 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176563 (secure 0 0 0) 0x7f8fa40800a0 con 0x7f8fb0106800 2024-09-18T12:48:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:48:41.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 -- 172.21.15.45:0/4104223712 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8f9806e310 msgr2=0x7f8f980707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:41.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8f9806e310 0x7f8f980707d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fb01989b0 tx=0x7f8fa0008040 comp rx=0 tx=0).stop 2024-09-18T12:48:41.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 -- 172.21.15.45:0/4104223712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb0106800 msgr2=0x7f8fb019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:41.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb0106800 0x7f8fb019dbf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4031460 tx=0x7f8fa40048f0 comp rx=0 tx=0).stop 2024-09-18T12:48:41.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 -- 172.21.15.45:0/4104223712 shutdown_connections 2024-09-18T12:48:41.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8f9806e310 0x7f8f980707d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:41.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb0106800 0x7f8fb019dbf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:41.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 --2- 172.21.15.45:0/4104223712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fb0100800 0x7f8fb019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:41.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 -- 172.21.15.45:0/4104223712 >> 172.21.15.45:0/4104223712 conn(0x7f8fb00fc520 msgr2=0x7f8fb006a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:41.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 -- 172.21.15.45:0/4104223712 shutdown_connections 2024-09-18T12:48:41.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:41.152+0000 7f8fb50c6640 1 -- 172.21.15.45:0/4104223712 wait complete. 2024-09-18T12:48:41.456 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:41 smithi045 ceph-mon[28315]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:41.456 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:41 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/4104223712' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-18T12:48:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:41 smithi161 ceph-mon[35784]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:41 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/4104223712' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-18T12:48:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"flags":0,"active_gid":14215,"active_name":"smithi045.brvbvl","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3828746740},{"type":"v1","addr":"172.21.15.45:6801","nonce":3828746740}]},"active_addr":"172.21.15.45:6801/3828746740","active_change":"2024-09-18T12:44:31.530526+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14240,"name":"smithi161.yoflkm","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.45:8443/","prometheus":"http://172.21.15.45:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":2407274137}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":470767634}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":133299404}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":411006836}]}]} 2024-09-18T12:48:41.850 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-18T12:48:41.850 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-18T12:48:41.851 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T12:48:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.527+0000 7f9d4cafe640 1 -- 172.21.15.45:0/3170231332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d48107900 msgr2=0x7f9d48107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.527+0000 7f9d4cafe640 1 --2- 172.21.15.45:0/3170231332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d48107900 0x7f9d48107ce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009880 tx=0x7f9d3802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.527+0000 7f9d4cafe640 1 -- 172.21.15.45:0/3170231332 shutdown_connections 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.527+0000 7f9d4cafe640 1 --2- 172.21.15.45:0/3170231332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d48101900 0x7f9d48101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.527+0000 7f9d4cafe640 1 --2- 172.21.15.45:0/3170231332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d48107900 0x7f9d48107ce0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.527+0000 7f9d4cafe640 1 -- 172.21.15.45:0/3170231332 >> 172.21.15.45:0/3170231332 conn(0x7f9d480fd600 msgr2=0x7f9d480ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.527+0000 7f9d4cafe640 1 -- 172.21.15.45:0/3170231332 shutdown_connections 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.527+0000 7f9d4cafe640 1 -- 172.21.15.45:0/3170231332 wait complete. 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d4cafe640 1 Processor -- start 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d4cafe640 1 -- start start 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d4cafe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d48101900 0x7f9d480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d4cafe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d48107900 0x7f9d48074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d4cafe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4810edb0 con 0x7f9d48107900 2024-09-18T12:48:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d4cafe640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4810ec30 con 0x7f9d48101900 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d3ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d48107900 0x7f9d48074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d3ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d48107900 0x7f9d48074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56364/0 (socket says 172.21.15.45:56364) 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d3ffff640 1 -- 172.21.15.45:0/1154140846 learned_addr learned my addr 172.21.15.45:0/1154140846 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d4659c640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d48101900 0x7f9d480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d3ffff640 1 -- 172.21.15.45:0/1154140846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d48101900 msgr2=0x7f9d480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d3ffff640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d48101900 0x7f9d480744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d3ffff640 1 -- 172.21.15.45:0/1154140846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d48074f70 con 0x7f9d48107900 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.528+0000 7f9d3ffff640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d48107900 0x7f9d48074a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000c8a0 tx=0x7f9d3000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.529+0000 7f9d3f7fe640 1 -- 172.21.15.45:0/1154140846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d300079b0 con 0x7f9d48107900 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.529+0000 7f9d4cafe640 1 -- 172.21.15.45:0/1154140846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d48075260 con 0x7f9d48107900 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.529+0000 7f9d3f7fe640 1 -- 172.21.15.45:0/1154140846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d30007b50 con 0x7f9d48107900 2024-09-18T12:48:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.529+0000 7f9d3f7fe640 1 -- 172.21.15.45:0/1154140846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d30018700 con 0x7f9d48107900 2024-09-18T12:48:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.529+0000 7f9d4cafe640 1 -- 172.21.15.45:0/1154140846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d481a3de0 con 0x7f9d48107900 2024-09-18T12:48:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.530+0000 7f9d3f7fe640 1 -- 172.21.15.45:0/1154140846 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9d3000f450 con 0x7f9d48107900 2024-09-18T12:48:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.530+0000 7f9d4cafe640 1 -- 172.21.15.45:0/1154140846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d48103040 con 0x7f9d48107900 2024-09-18T12:48:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.531+0000 7f9d3f7fe640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9d3406e2b0 0x7f9d34070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.531+0000 7f9d3f7fe640 1 -- 172.21.15.45:0/1154140846 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f9d3008f940 con 0x7f9d48107900 2024-09-18T12:48:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.531+0000 7f9d4659c640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9d3406e2b0 0x7f9d34070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.531+0000 7f9d4659c640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9d3406e2b0 0x7f9d34070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d38031460 tx=0x7f9d38009560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:42.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.536+0000 7f9d3f7fe640 1 -- 172.21.15.45:0/1154140846 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d30014030 con 0x7f9d48107900 2024-09-18T12:48:42.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.713+0000 7f9d4cafe640 1 -- 172.21.15.45:0/1154140846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d48104b10 con 0x7f9d48107900 2024-09-18T12:48:42.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.713+0000 7f9d3f7fe640 1 -- 172.21.15.45:0/1154140846 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11356 (secure 0 0 0) 0x7f9d3005b3f0 con 0x7f9d48107900 2024-09-18T12:48:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:48:42.716 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","created":"2024-09-18T12:42:34.157830+0000","modified":"2024-09-18T12:48:32.588236+0000","last_up_change":"2024-09-18T12:48:31.405964+0000","last_in_change":"2024-09-18T12:48:07.544699+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:47:12.057699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abc0345a-6b97-47e0-b114-e26dc66a74cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6803","nonce":2326762873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6805","nonce":2326762873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6809","nonce":2326762873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6807","nonce":2326762873}]},"public_addr":"172.21.15.45:6803/2326762873","cluster_addr":"172.21.15.45:6805/2326762873","heartbeat_back_addr":"172.21.15.45:6809/2326762873","heartbeat_front_addr":"172.21.15.45:6807/2326762873","state":["exists","up"]},{"osd":1,"uuid":"d20b034b-671a-41a6-8b14-29708f221cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6811","nonce":2210413799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6813","nonce":2210413799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6817","nonce":2210413799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6815","nonce":2210413799}]},"public_addr":"172.21.15.45:6811/2210413799","cluster_addr":"172.21.15.45:6813/2210413799","heartbeat_back_addr":"172.21.15.45:6817/2210413799","heartbeat_front_addr":"172.21.15.45:6815/2210413799","state":["exists","up"]},{"osd":2,"uuid":"f2751347-83f5-4e3f-ba05-0af90ad01aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6819","nonce":878363968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6821","nonce":878363968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6825","nonce":878363968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6823","nonce":878363968}]},"public_addr":"172.21.15.45:6819/878363968","cluster_addr":"172.21.15.45:6821/878363968","heartbeat_back_addr":"172.21.15.45:6825/878363968","heartbeat_front_addr":"172.21.15.45:6823/878363968","state":["exists","up"]},{"osd":3,"uuid":"112d636d-4dbc-494b-a7a0-0db054771763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6801","nonce":2568825458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6803","nonce":2568825458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6807","nonce":2568825458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6805","nonce":2568825458}]},"public_addr":"172.21.15.161:6801/2568825458","cluster_addr":"172.21.15.161:6803/2568825458","heartbeat_back_addr":"172.21.15.161:6807/2568825458","heartbeat_front_addr":"172.21.15.161:6805/2568825458","state":["exists","up"]},{"osd":4,"uuid":"7a5fa04a-1e4e-4bf4-ae7f-e6d17118ebaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6809","nonce":3479703638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6811","nonce":3479703638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6815","nonce":3479703638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6813","nonce":3479703638}]},"public_addr":"172.21.15.161:6809/3479703638","cluster_addr":"172.21.15.161:6811/3479703638","heartbeat_back_addr":"172.21.15.161:6815/3479703638","heartbeat_front_addr":"172.21.15.161:6813/3479703638","state":["exists","up"]},{"osd":5,"uuid":"0bc9653a-794e-4716-a830-1bf624a1e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6817","nonce":5467570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6819","nonce":5467570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6823","nonce":5467570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6821","nonce":5467570}]},"public_addr":"172.21.15.161:6817/5467570","cluster_addr":"172.21.15.161:6819/5467570","heartbeat_back_addr":"172.21.15.161:6823/5467570","heartbeat_front_addr":"172.21.15.161:6821/5467570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:04.505507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:02.226350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:10.157095+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:34.032711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:48:02.258575+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:48:28.891662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/4239091440":"2024-09-19T12:44:31.530414+0000","172.21.15.45:6800/4239091440":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/3244778815":"2024-09-19T12:43:02.441203+0000","172.21.15.45:6800/865557257":"2024-09-19T12:43:34.610573+0000","172.21.15.45:6800/4029715284":"2024-09-19T12:43:02.441203+0000","172.21.15.45:6801/4029715284":"2024-09-19T12:43:02.441203+0000","172.21.15.45:0/3028834940":"2024-09-19T12:43:02.441203+0000","172.21.15.45:0/286550513":"2024-09-19T12:43:34.610573+0000","172.21.15.45:0/529444775":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/1773614817":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/3573172920":"2024-09-19T12:43:02.441203+0000","172.21.15.45:6801/865557257":"2024-09-19T12:43:34.610573+0000","172.21.15.45:0/2571293493":"2024-09-19T12:43:34.610573+0000","172.21.15.45:0/714422720":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/2088566729":"2024-09-19T12:43:34.610573+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:48:42.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.715+0000 7f9d4cafe640 1 -- 172.21.15.45:0/1154140846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9d3406e2b0 msgr2=0x7f9d34070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:42.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.715+0000 7f9d4cafe640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9d3406e2b0 0x7f9d34070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d38031460 tx=0x7f9d38009560 comp rx=0 tx=0).stop 2024-09-18T12:48:42.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.715+0000 7f9d4cafe640 1 -- 172.21.15.45:0/1154140846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d48107900 msgr2=0x7f9d48074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:42.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.715+0000 7f9d4cafe640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d48107900 0x7f9d48074a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000c8a0 tx=0x7f9d3000cd60 comp rx=0 tx=0).stop 2024-09-18T12:48:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.715+0000 7f9d4cafe640 1 -- 172.21.15.45:0/1154140846 shutdown_connections 2024-09-18T12:48:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.715+0000 7f9d4cafe640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9d3406e2b0 0x7f9d34070770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.715+0000 7f9d4cafe640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d48107900 0x7f9d48074a30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.715+0000 7f9d4cafe640 1 --2- 172.21.15.45:0/1154140846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d48101900 0x7f9d480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.715+0000 7f9d4cafe640 1 -- 172.21.15.45:0/1154140846 >> 172.21.15.45:0/1154140846 conn(0x7f9d480fd600 msgr2=0x7f9d480ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.716+0000 7f9d4cafe640 1 -- 172.21.15.45:0/1154140846 shutdown_connections 2024-09-18T12:48:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:42.716+0000 7f9d4cafe640 1 -- 172.21.15.45:0/1154140846 wait complete. 2024-09-18T12:48:43.380 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-18T12:48:43.380 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T12:48:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:43.763 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:43 smithi045 ceph-mon[28315]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:43.763 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:43 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1154140846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:48:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:43 smithi161 ceph-mon[35784]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:43 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1154140846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:48:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.077+0000 7fb360410640 1 -- 172.21.15.45:0/4075727009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb358102b50 msgr2=0x7fb358102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.077+0000 7fb360410640 1 --2- 172.21.15.45:0/4075727009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb358102b50 0x7fb358102f30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb348009880 tx=0x7fb34802a530 comp rx=0 tx=0).stop 2024-09-18T12:48:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.078+0000 7fb360410640 1 -- 172.21.15.45:0/4075727009 shutdown_connections 2024-09-18T12:48:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.078+0000 7fb360410640 1 --2- 172.21.15.45:0/4075727009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb358103470 0x7fb35810b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.078+0000 7fb360410640 1 --2- 172.21.15.45:0/4075727009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb358102b50 0x7fb358102f30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.078+0000 7fb360410640 1 -- 172.21.15.45:0/4075727009 >> 172.21.15.45:0/4075727009 conn(0x7fb3580fc550 msgr2=0x7fb3580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.078+0000 7fb360410640 1 -- 172.21.15.45:0/4075727009 shutdown_connections 2024-09-18T12:48:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.078+0000 7fb360410640 1 -- 172.21.15.45:0/4075727009 wait complete. 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.078+0000 7fb360410640 1 Processor -- start 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.078+0000 7fb360410640 1 -- start start 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.078+0000 7fb360410640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb358102b50 0x7fb3581007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.078+0000 7fb360410640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb358103470 0x7fb358100cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb360410640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb35810ee40 con 0x7fb358103470 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb360410640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb35810ecc0 con 0x7fb358102b50 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb35d9ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb358103470 0x7fb358100cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb35d9ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb358103470 0x7fb358100cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56374/0 (socket says 172.21.15.45:56374) 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb35d9ab640 1 -- 172.21.15.45:0/3323506092 learned_addr learned my addr 172.21.15.45:0/3323506092 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb35e1ac640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb358102b50 0x7fb3581007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb35d9ab640 1 -- 172.21.15.45:0/3323506092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb358102b50 msgr2=0x7fb3581007b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb35d9ab640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb358102b50 0x7fb3581007b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb35d9ab640 1 -- 172.21.15.45:0/3323506092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb358101230 con 0x7fb358103470 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb35d9ab640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb358103470 0x7fb358100cf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00ba50 tx=0x7fb34c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb3577fe640 1 -- 172.21.15.45:0/3323506092 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb34c019070 con 0x7fb358103470 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb3577fe640 1 -- 172.21.15.45:0/3323506092 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb34c00ce20 con 0x7fb358103470 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb360410640 1 -- 172.21.15.45:0/3323506092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb358101520 con 0x7fb358103470 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb3577fe640 1 -- 172.21.15.45:0/3323506092 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb34c0075a0 con 0x7fb358103470 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.079+0000 7fb360410640 1 -- 172.21.15.45:0/3323506092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3581a3eb0 con 0x7fb358103470 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.080+0000 7fb360410640 1 -- 172.21.15.45:0/3323506092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb35806a4e0 con 0x7fb358103470 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.081+0000 7fb3577fe640 1 -- 172.21.15.45:0/3323506092 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb34c01c070 con 0x7fb358103470 2024-09-18T12:48:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.081+0000 7fb3577fe640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb34006e310 0x7fb3400707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:44.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.081+0000 7fb3577fe640 1 -- 172.21.15.45:0/3323506092 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fb34c08d760 con 0x7fb358103470 2024-09-18T12:48:44.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.081+0000 7fb35e1ac640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb34006e310 0x7fb3400707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:44.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.082+0000 7fb35e1ac640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb34006e310 0x7fb3400707d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb3480096c0 tx=0x7fb348004f30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:44.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.086+0000 7fb3577fe640 1 -- 172.21.15.45:0/3323506092 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb34c05b480 con 0x7fb358103470 2024-09-18T12:48:44.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.263+0000 7fb360410640 1 -- 172.21.15.45:0/3323506092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb358101ce0 con 0x7fb358103470 2024-09-18T12:48:44.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.264+0000 7fb3577fe640 1 -- 172.21.15.45:0/3323506092 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11356 (secure 0 0 0) 0x7fb34c05f130 con 0x7fb358103470 2024-09-18T12:48:44.267 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:48:44.267 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"fsid":"53bb6910-75bb-11ef-bceb-c7b262605968","created":"2024-09-18T12:42:34.157830+0000","modified":"2024-09-18T12:48:32.588236+0000","last_up_change":"2024-09-18T12:48:31.405964+0000","last_in_change":"2024-09-18T12:48:07.544699+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T12:47:12.057699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"abc0345a-6b97-47e0-b114-e26dc66a74cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6803","nonce":2326762873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6805","nonce":2326762873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6809","nonce":2326762873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2326762873},{"type":"v1","addr":"172.21.15.45:6807","nonce":2326762873}]},"public_addr":"172.21.15.45:6803/2326762873","cluster_addr":"172.21.15.45:6805/2326762873","heartbeat_back_addr":"172.21.15.45:6809/2326762873","heartbeat_front_addr":"172.21.15.45:6807/2326762873","state":["exists","up"]},{"osd":1,"uuid":"d20b034b-671a-41a6-8b14-29708f221cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6811","nonce":2210413799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6813","nonce":2210413799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6817","nonce":2210413799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2210413799},{"type":"v1","addr":"172.21.15.45:6815","nonce":2210413799}]},"public_addr":"172.21.15.45:6811/2210413799","cluster_addr":"172.21.15.45:6813/2210413799","heartbeat_back_addr":"172.21.15.45:6817/2210413799","heartbeat_front_addr":"172.21.15.45:6815/2210413799","state":["exists","up"]},{"osd":2,"uuid":"f2751347-83f5-4e3f-ba05-0af90ad01aae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6819","nonce":878363968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6821","nonce":878363968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6825","nonce":878363968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":878363968},{"type":"v1","addr":"172.21.15.45:6823","nonce":878363968}]},"public_addr":"172.21.15.45:6819/878363968","cluster_addr":"172.21.15.45:6821/878363968","heartbeat_back_addr":"172.21.15.45:6825/878363968","heartbeat_front_addr":"172.21.15.45:6823/878363968","state":["exists","up"]},{"osd":3,"uuid":"112d636d-4dbc-494b-a7a0-0db054771763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6801","nonce":2568825458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6803","nonce":2568825458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6807","nonce":2568825458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2568825458},{"type":"v1","addr":"172.21.15.161:6805","nonce":2568825458}]},"public_addr":"172.21.15.161:6801/2568825458","cluster_addr":"172.21.15.161:6803/2568825458","heartbeat_back_addr":"172.21.15.161:6807/2568825458","heartbeat_front_addr":"172.21.15.161:6805/2568825458","state":["exists","up"]},{"osd":4,"uuid":"7a5fa04a-1e4e-4bf4-ae7f-e6d17118ebaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6809","nonce":3479703638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6811","nonce":3479703638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6815","nonce":3479703638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":3479703638},{"type":"v1","addr":"172.21.15.161:6813","nonce":3479703638}]},"public_addr":"172.21.15.161:6809/3479703638","cluster_addr":"172.21.15.161:6811/3479703638","heartbeat_back_addr":"172.21.15.161:6815/3479703638","heartbeat_front_addr":"172.21.15.161:6813/3479703638","state":["exists","up"]},{"osd":5,"uuid":"0bc9653a-794e-4716-a830-1bf624a1e115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6817","nonce":5467570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6819","nonce":5467570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6823","nonce":5467570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":5467570},{"type":"v1","addr":"172.21.15.161:6821","nonce":5467570}]},"public_addr":"172.21.15.161:6817/5467570","cluster_addr":"172.21.15.161:6819/5467570","heartbeat_back_addr":"172.21.15.161:6823/5467570","heartbeat_front_addr":"172.21.15.161:6821/5467570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:46:04.505507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:02.226350+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:10.157095+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:47:34.032711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:48:02.258575+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:48:28.891662+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/4239091440":"2024-09-19T12:44:31.530414+0000","172.21.15.45:6800/4239091440":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/3244778815":"2024-09-19T12:43:02.441203+0000","172.21.15.45:6800/865557257":"2024-09-19T12:43:34.610573+0000","172.21.15.45:6800/4029715284":"2024-09-19T12:43:02.441203+0000","172.21.15.45:6801/4029715284":"2024-09-19T12:43:02.441203+0000","172.21.15.45:0/3028834940":"2024-09-19T12:43:02.441203+0000","172.21.15.45:0/286550513":"2024-09-19T12:43:34.610573+0000","172.21.15.45:0/529444775":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/1773614817":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/3573172920":"2024-09-19T12:43:02.441203+0000","172.21.15.45:6801/865557257":"2024-09-19T12:43:34.610573+0000","172.21.15.45:0/2571293493":"2024-09-19T12:43:34.610573+0000","172.21.15.45:0/714422720":"2024-09-19T12:44:31.530414+0000","172.21.15.45:0/2088566729":"2024-09-19T12:43:34.610573+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.266+0000 7fb360410640 1 -- 172.21.15.45:0/3323506092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb34006e310 msgr2=0x7fb3400707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.266+0000 7fb360410640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb34006e310 0x7fb3400707d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb3480096c0 tx=0x7fb348004f30 comp rx=0 tx=0).stop 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.266+0000 7fb360410640 1 -- 172.21.15.45:0/3323506092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb358103470 msgr2=0x7fb358100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.266+0000 7fb360410640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb358103470 0x7fb358100cf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00ba50 tx=0x7fb34c00bf10 comp rx=0 tx=0).stop 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.266+0000 7fb360410640 1 -- 172.21.15.45:0/3323506092 shutdown_connections 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.266+0000 7fb360410640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fb34006e310 0x7fb3400707d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.266+0000 7fb360410640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb358103470 0x7fb358100cf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.266+0000 7fb360410640 1 --2- 172.21.15.45:0/3323506092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb358102b50 0x7fb3581007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.266+0000 7fb360410640 1 -- 172.21.15.45:0/3323506092 >> 172.21.15.45:0/3323506092 conn(0x7fb3580fc550 msgr2=0x7fb358108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.266+0000 7fb360410640 1 -- 172.21.15.45:0/3323506092 shutdown_connections 2024-09-18T12:48:44.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:44.267+0000 7fb360410640 1 -- 172.21.15.45:0/3323506092 wait complete. 2024-09-18T12:48:44.766 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:44 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3323506092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:48:44.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:44 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3323506092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T12:48:44.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-18T12:48:44.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-18T12:48:44.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-18T12:48:44.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-18T12:48:44.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-18T12:48:44.884 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-18T12:48:45.177 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:45.179 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:45.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:45 smithi045 ceph-mon[28315]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:45.696 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:45 smithi161 ceph-mon[35784]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.837+0000 7f20b47f6640 1 -- 172.21.15.45:0/3099380402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20ac101900 msgr2=0x7f20ac101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.837+0000 7f20b47f6640 1 --2- 172.21.15.45:0/3099380402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20ac101900 0x7f20ac101d60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f209c009880 tx=0x7f209c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.837+0000 7f20b47f6640 1 -- 172.21.15.45:0/3099380402 shutdown_connections 2024-09-18T12:48:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.837+0000 7f20b47f6640 1 --2- 172.21.15.45:0/3099380402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20ac101900 0x7f20ac101d60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.837+0000 7f20b47f6640 1 --2- 172.21.15.45:0/3099380402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac107900 0x7f20ac107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.837+0000 7f20b47f6640 1 -- 172.21.15.45:0/3099380402 >> 172.21.15.45:0/3099380402 conn(0x7f20ac0fd600 msgr2=0x7f20ac0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.837+0000 7f20b47f6640 1 -- 172.21.15.45:0/3099380402 shutdown_connections 2024-09-18T12:48:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.837+0000 7f20b47f6640 1 -- 172.21.15.45:0/3099380402 wait complete. 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b47f6640 1 Processor -- start 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b47f6640 1 -- start start 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b47f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20ac101900 0x7f20ac19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b47f6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac107900 0x7f20ac19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b47f6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac10ee30 con 0x7f20ac101900 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b47f6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac10ecb0 con 0x7f20ac107900 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b2592640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20ac101900 0x7f20ac19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b2592640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20ac101900 0x7f20ac19f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56386/0 (socket says 172.21.15.45:56386) 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b2592640 1 -- 172.21.15.45:0/4131977108 learned_addr learned my addr 172.21.15.45:0/4131977108 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b1d91640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac107900 0x7f20ac19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b2592640 1 -- 172.21.15.45:0/4131977108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac107900 msgr2=0x7f20ac19fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.838+0000 7f20b2592640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac107900 0x7f20ac19fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.839+0000 7f20b2592640 1 -- 172.21.15.45:0/4131977108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac199a70 con 0x7f20ac101900 2024-09-18T12:48:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.839+0000 7f20b2592640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20ac101900 0x7f20ac19f8b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f20a800b420 tx=0x7f20a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.839+0000 7f20a37fe640 1 -- 172.21.15.45:0/4131977108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20a8011630 con 0x7f20ac101900 2024-09-18T12:48:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.839+0000 7f20a37fe640 1 -- 172.21.15.45:0/4131977108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20a8016070 con 0x7f20ac101900 2024-09-18T12:48:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.839+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac199d60 con 0x7f20ac101900 2024-09-18T12:48:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.839+0000 7f20a37fe640 1 -- 172.21.15.45:0/4131977108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20a8010d40 con 0x7f20ac101900 2024-09-18T12:48:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.839+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac19a2c0 con 0x7f20ac101900 2024-09-18T12:48:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.840+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f20ac103040 con 0x7f20ac101900 2024-09-18T12:48:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.841+0000 7f20a37fe640 1 -- 172.21.15.45:0/4131977108 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f20a801b460 con 0x7f20ac101900 2024-09-18T12:48:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.841+0000 7f20a37fe640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f209806e310 0x7f20980707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.841+0000 7f20b1d91640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f209806e310 0x7f20980707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.841+0000 7f20a37fe640 1 -- 172.21.15.45:0/4131977108 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f20a808d550 con 0x7f20ac101900 2024-09-18T12:48:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.841+0000 7f20a37fe640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638] conn(0x7f2098074100 0x7f2098076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.842+0000 7f20a37fe640 1 -- 172.21.15.45:0/4131977108 --> [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2098076bd0 con 0x7f2098074100 2024-09-18T12:48:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.842+0000 7f20a37fe640 1 -- 172.21.15.45:0/4131977108 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f20a8094050 con 0x7f20ac101900 2024-09-18T12:48:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.842+0000 7f20b1d91640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f209806e310 0x7f20980707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20ac19b260 tx=0x7f209c031400 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.842+0000 7f20b2d93640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638] conn(0x7f2098074100 0x7f2098076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.842+0000 7f20b2d93640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638] conn(0x7f2098074100 0x7f2098076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.843+0000 7f20a37fe640 1 -- 172.21.15.45:0/4131977108 <== osd.4 v2:172.21.15.161:6808/3479703638 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2098076bd0 con 0x7f2098074100 2024-09-18T12:48:45.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.857+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 --> [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f20ac0fe630 con 0x7f2098074100 2024-09-18T12:48:45.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.857+0000 7f20a37fe640 1 -- 172.21.15.45:0/4131977108 <== osd.4 v2:172.21.15.161:6808/3479703638 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f20ac0fe630 con 0x7f2098074100 2024-09-18T12:48:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.857+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 >> [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638] conn(0x7f2098074100 msgr2=0x7f2098076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.857+0000 7f20b47f6640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638] conn(0x7f2098074100 0x7f2098076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.857+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f209806e310 msgr2=0x7f20980707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.857+0000 7f20b47f6640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f209806e310 0x7f20980707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20ac19b260 tx=0x7f209c031400 comp rx=0 tx=0).stop 2024-09-18T12:48:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.857+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20ac101900 msgr2=0x7f20ac19f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.857+0000 7f20b47f6640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20ac101900 0x7f20ac19f8b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f20a800b420 tx=0x7f20a800b8e0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.858+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 shutdown_connections 2024-09-18T12:48:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.858+0000 7f20b47f6640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.161:6808/3479703638,v1:172.21.15.161:6809/3479703638] conn(0x7f2098074100 0x7f2098076520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.858+0000 7f20b47f6640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f209806e310 0x7f20980707d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.858+0000 7f20b47f6640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac107900 0x7f20ac19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.858+0000 7f20b47f6640 1 --2- 172.21.15.45:0/4131977108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20ac101900 0x7f20ac19f8b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.858+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 >> 172.21.15.45:0/4131977108 conn(0x7f20ac0fd600 msgr2=0x7f20ac0fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.858+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 shutdown_connections 2024-09-18T12:48:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.858+0000 7f20b47f6640 1 -- 172.21.15.45:0/4131977108 wait complete. 2024-09-18T12:48:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.998+0000 7f14f09c7640 1 -- 172.21.15.45:0/2471551345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14ec1007f0 msgr2=0x7f14ec100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.998+0000 7f14f09c7640 1 --2- 172.21.15.45:0/2471551345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14ec1007f0 0x7f14ec100c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f14e0009880 tx=0x7f14e002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.999+0000 7f14f09c7640 1 -- 172.21.15.45:0/2471551345 shutdown_connections 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.999+0000 7f14f09c7640 1 --2- 172.21.15.45:0/2471551345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14ec1007f0 0x7f14ec100c50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.999+0000 7f14f09c7640 1 --2- 172.21.15.45:0/2471551345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ec1067f0 0x7f14ec106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.999+0000 7f14f09c7640 1 -- 172.21.15.45:0/2471551345 >> 172.21.15.45:0/2471551345 conn(0x7f14ec0fc550 msgr2=0x7f14ec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.999+0000 7f14f09c7640 1 -- 172.21.15.45:0/2471551345 shutdown_connections 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.999+0000 7f14f09c7640 1 -- 172.21.15.45:0/2471551345 wait complete. 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.999+0000 7f14f09c7640 1 Processor -- start 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:45.999+0000 7f14f09c7640 1 -- start start 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14f09c7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ec1007f0 0x7f14ec19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14f09c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14ec1067f0 0x7f14ec19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14f09c7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec10dca0 con 0x7f14ec1067f0 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14f09c7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec10db20 con 0x7f14ec1007f0 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14e9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14ec1067f0 0x7f14ec19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14e9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14ec1067f0 0x7f14ec19db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56408/0 (socket says 172.21.15.45:56408) 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14e9d9b640 1 -- 172.21.15.45:0/1775240535 learned_addr learned my addr 172.21.15.45:0/1775240535 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14ea59c640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ec1007f0 0x7f14ec19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14e9d9b640 1 -- 172.21.15.45:0/1775240535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ec1007f0 msgr2=0x7f14ec19d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14e9d9b640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ec1007f0 0x7f14ec19d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14e9d9b640 1 -- 172.21.15.45:0/1775240535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ec197780 con 0x7f14ec1067f0 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14e9d9b640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14ec1067f0 0x7f14ec19db40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f14e0031460 tx=0x7f14e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14db7fe640 1 -- 172.21.15.45:0/1775240535 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14e003f070 con 0x7f14ec1067f0 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14db7fe640 1 -- 172.21.15.45:0/1775240535 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f14e0004cf0 con 0x7f14ec1067f0 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.000+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ec197a10 con 0x7f14ec1067f0 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.001+0000 7f14db7fe640 1 -- 172.21.15.45:0/1775240535 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14e0035030 con 0x7f14ec1067f0 2024-09-18T12:48:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.001+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec197f40 con 0x7f14ec1067f0 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.001+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14ec198500 con 0x7f14ec1067f0 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.002+0000 7f14db7fe640 1 -- 172.21.15.45:0/1775240535 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f14e0042070 con 0x7f14ec1067f0 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.003+0000 7f14db7fe640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f14d406e310 0x7f14d40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.003+0000 7f14db7fe640 1 -- 172.21.15.45:0/1775240535 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f14e00ae880 con 0x7f14ec1067f0 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.003+0000 7f14ea59c640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f14d406e310 0x7f14d40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.003+0000 7f14db7fe640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570] conn(0x7f14d4074100 0x7f14d4076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.003+0000 7f14db7fe640 1 -- 172.21.15.45:0/1775240535 --> [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14d4076bd0 con 0x7f14d4074100 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.003+0000 7f14db7fe640 1 -- 172.21.15.45:0/1775240535 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f14e00b32a0 con 0x7f14ec1067f0 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.003+0000 7f14ea59c640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f14d406e310 0x7f14d40707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005e10 tx=0x7f14dc005da0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.003+0000 7f14ead9d640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570] conn(0x7f14d4074100 0x7f14d4076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.003+0000 7f14ead9d640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570] conn(0x7f14d4074100 0x7f14d4076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.004+0000 7f14db7fe640 1 -- 172.21.15.45:0/1775240535 <== osd.5 v2:172.21.15.161:6816/5467570 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14d4076bd0 con 0x7f14d4074100 2024-09-18T12:48:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.018+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 --> [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14ec0628b0 con 0x7f14d4074100 2024-09-18T12:48:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14db7fe640 1 -- 172.21.15.45:0/1775240535 <== osd.5 v2:172.21.15.161:6816/5467570 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f14ec0628b0 con 0x7f14d4074100 2024-09-18T12:48:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 >> [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570] conn(0x7f14d4074100 msgr2=0x7f14d4076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570] conn(0x7f14d4074100 0x7f14d4076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f14d406e310 msgr2=0x7f14d40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f14d406e310 0x7f14d40707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005e10 tx=0x7f14dc005da0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14ec1067f0 msgr2=0x7f14ec19db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14ec1067f0 0x7f14ec19db40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f14e0031460 tx=0x7f14e00048f0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 shutdown_connections 2024-09-18T12:48:46.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.161:6816/5467570,v1:172.21.15.161:6817/5467570] conn(0x7f14d4074100 0x7f14d4076520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f14d406e310 0x7f14d40707d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14ec1067f0 0x7f14ec19db40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 --2- 172.21.15.45:0/1775240535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14ec1007f0 0x7f14ec19d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:46.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 >> 172.21.15.45:0/1775240535 conn(0x7f14ec0fc550 msgr2=0x7f14ec069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:46.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 shutdown_connections 2024-09-18T12:48:46.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:46.019+0000 7f14f09c7640 1 -- 172.21.15.45:0/1775240535 wait complete. 2024-09-18T12:48:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:46.531 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:47.261 INFO:teuthology.orchestra.run.smithi045.stdout:141733920779 2024-09-18T12:48:47.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-18T12:48:47.523 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:47 smithi045 ceph-mon[28315]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:47.523 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:47 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.752+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/4036105268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba4102ac0 msgr2=0x7f7ba4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.752+0000 7f7ba9aa9640 1 --2- 172.21.15.45:0/4036105268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba4102ac0 0x7f7ba4102ea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009880 tx=0x7f7b9402a530 comp rx=0 tx=0).stop 2024-09-18T12:48:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.752+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/4036105268 shutdown_connections 2024-09-18T12:48:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.752+0000 7f7ba9aa9640 1 --2- 172.21.15.45:0/4036105268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba41033e0 0x7f7ba410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.752+0000 7f7ba9aa9640 1 --2- 172.21.15.45:0/4036105268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba4102ac0 0x7f7ba4102ea0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.752+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/4036105268 >> 172.21.15.45:0/4036105268 conn(0x7f7ba40fc520 msgr2=0x7f7ba40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.752+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/4036105268 shutdown_connections 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.752+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/4036105268 wait complete. 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.753+0000 7f7ba9aa9640 1 Processor -- start 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.753+0000 7f7ba9aa9640 1 -- start start 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.753+0000 7f7ba9aa9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba4102ac0 0x7f7ba4100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.753+0000 7f7ba9aa9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba41033e0 0x7f7ba4100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.753+0000 7f7ba9aa9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba410edd0 con 0x7f7ba41033e0 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.753+0000 7f7ba9aa9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba410ec50 con 0x7f7ba4102ac0 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba41033e0 0x7f7ba4100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba41033e0 0x7f7ba4100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56412/0 (socket says 172.21.15.45:56412) 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba2ffd640 1 -- 172.21.15.45:0/372362854 learned_addr learned my addr 172.21.15.45:0/372362854 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba37fe640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba4102ac0 0x7f7ba4100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba2ffd640 1 -- 172.21.15.45:0/372362854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba4102ac0 msgr2=0x7f7ba4100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba2ffd640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba4102ac0 0x7f7ba4100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba2ffd640 1 -- 172.21.15.45:0/372362854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba41011a0 con 0x7f7ba41033e0 2024-09-18T12:48:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba2ffd640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba41033e0 0x7f7ba4100c60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800d6c0 tx=0x7f7b9800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba0ff9640 1 -- 172.21.15.45:0/372362854 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b98017070 con 0x7f7ba41033e0 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba0ff9640 1 -- 172.21.15.45:0/372362854 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b98009ce0 con 0x7f7ba41033e0 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba4101490 con 0x7f7ba41033e0 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba0ff9640 1 -- 172.21.15.45:0/372362854 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b9800f3c0 con 0x7f7ba41033e0 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.754+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba41a3f60 con 0x7f7ba41033e0 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.755+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ba40628c0 con 0x7f7ba41033e0 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.756+0000 7f7ba0ff9640 1 -- 172.21.15.45:0/372362854 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7b98010460 con 0x7f7ba41033e0 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.756+0000 7f7ba0ff9640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7b8c06e310 0x7f7b8c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.757+0000 7f7ba37fe640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7b8c06e310 0x7f7b8c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.757+0000 7f7ba0ff9640 1 -- 172.21.15.45:0/372362854 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f7b9808da30 con 0x7f7ba41033e0 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.757+0000 7f7ba0ff9640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873] conn(0x7f7b8c074100 0x7f7b8c076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.757+0000 7f7ba0ff9640 1 -- 172.21.15.45:0/372362854 --> [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b98004470 con 0x7f7b8c074100 2024-09-18T12:48:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.757+0000 7f7ba0ff9640 1 -- 172.21.15.45:0/372362854 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7b980922a0 con 0x7f7ba41033e0 2024-09-18T12:48:47.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.757+0000 7f7ba3fff640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873] conn(0x7f7b8c074100 0x7f7b8c076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:47.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.757+0000 7f7ba37fe640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7b8c06e310 0x7f7b8c0707d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7b940096c0 tx=0x7f7b94031400 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:47.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.757+0000 7f7ba3fff640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873] conn(0x7f7b8c074100 0x7f7b8c076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:47.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.758+0000 7f7ba0ff9640 1 -- 172.21.15.45:0/372362854 <== osd.0 v2:172.21.15.45:6802/2326762873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b98004470 con 0x7f7b8c074100 2024-09-18T12:48:47.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.772+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 --> [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ba4062d10 con 0x7f7b8c074100 2024-09-18T12:48:47.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.772+0000 7f7ba0ff9640 1 -- 172.21.15.45:0/372362854 <== osd.0 v2:172.21.15.45:6802/2326762873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7ba4062d10 con 0x7f7b8c074100 2024-09-18T12:48:47.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.772+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873] conn(0x7f7b8c074100 msgr2=0x7f7b8c076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:47.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.772+0000 7f7ba9aa9640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873] conn(0x7f7b8c074100 0x7f7b8c076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.772+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7b8c06e310 msgr2=0x7f7b8c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:47.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.772+0000 7f7ba9aa9640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7b8c06e310 0x7f7b8c0707d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7b940096c0 tx=0x7f7b94031400 comp rx=0 tx=0).stop 2024-09-18T12:48:47.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.773+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba41033e0 msgr2=0x7f7ba4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.773+0000 7f7ba9aa9640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba41033e0 0x7f7ba4100c60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800d6c0 tx=0x7f7b9800db80 comp rx=0 tx=0).stop 2024-09-18T12:48:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.773+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 shutdown_connections 2024-09-18T12:48:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.773+0000 7f7ba9aa9640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6802/2326762873,v1:172.21.15.45:6803/2326762873] conn(0x7f7b8c074100 0x7f7b8c076520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.773+0000 7f7ba9aa9640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7b8c06e310 0x7f7b8c0707d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.773+0000 7f7ba9aa9640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ba41033e0 0x7f7ba4100c60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.773+0000 7f7ba9aa9640 1 --2- 172.21.15.45:0/372362854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba4102ac0 0x7f7ba4100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.773+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 >> 172.21.15.45:0/372362854 conn(0x7f7ba40fc520 msgr2=0x7f7ba4108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.773+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 shutdown_connections 2024-09-18T12:48:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:47.773+0000 7f7ba9aa9640 1 -- 172.21.15.45:0/372362854 wait complete. 2024-09-18T12:48:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:47 smithi161 ceph-mon[35784]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:47 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:48:48.600 INFO:teuthology.orchestra.run.smithi045.stdout:38654705700 2024-09-18T12:48:48.600 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-18T12:48:48.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.853+0000 7f5c3ca26640 1 -- 172.21.15.45:0/786826419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c38107900 msgr2=0x7f5c38107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.853+0000 7f5c3ca26640 1 --2- 172.21.15.45:0/786826419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c38107900 0x7f5c38107ce0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009880 tx=0x7f5c2802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.853+0000 7f5c3ca26640 1 -- 172.21.15.45:0/786826419 shutdown_connections 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.853+0000 7f5c3ca26640 1 --2- 172.21.15.45:0/786826419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c38101900 0x7f5c38101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.853+0000 7f5c3ca26640 1 --2- 172.21.15.45:0/786826419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c38107900 0x7f5c38107ce0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.853+0000 7f5c3ca26640 1 -- 172.21.15.45:0/786826419 >> 172.21.15.45:0/786826419 conn(0x7f5c380fd600 msgr2=0x7f5c380ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.853+0000 7f5c3ca26640 1 -- 172.21.15.45:0/786826419 shutdown_connections 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.853+0000 7f5c3ca26640 1 -- 172.21.15.45:0/786826419 wait complete. 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.854+0000 7f5c3ca26640 1 Processor -- start 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.854+0000 7f5c3ca26640 1 -- start start 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3ca26640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c38101900 0x7f5c3819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3ca26640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c38107900 0x7f5c3819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:48.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3ca26640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3810edb0 con 0x7f5c38101900 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3ca26640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3810ec30 con 0x7f5c38107900 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c38101900 0x7f5c3819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c38101900 0x7f5c3819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56430/0 (socket says 172.21.15.45:56430) 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3659c640 1 -- 172.21.15.45:0/36915299 learned_addr learned my addr 172.21.15.45:0/36915299 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c35d9b640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c38107900 0x7f5c3819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3659c640 1 -- 172.21.15.45:0/36915299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c38107900 msgr2=0x7f5c3819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3659c640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c38107900 0x7f5c3819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3659c640 1 -- 172.21.15.45:0/36915299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c381977e0 con 0x7f5c38101900 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.855+0000 7f5c3659c640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c38101900 0x7f5c3819d660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5c28031460 tx=0x7f5c280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.856+0000 7f5c277fe640 1 -- 172.21.15.45:0/36915299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c2803f070 con 0x7f5c38101900 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.856+0000 7f5c277fe640 1 -- 172.21.15.45:0/36915299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c28004cf0 con 0x7f5c38101900 2024-09-18T12:48:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.856+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c38197a70 con 0x7f5c38101900 2024-09-18T12:48:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.856+0000 7f5c277fe640 1 -- 172.21.15.45:0/36915299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c28035030 con 0x7f5c38101900 2024-09-18T12:48:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.856+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c38197fa0 con 0x7f5c38101900 2024-09-18T12:48:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.857+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c38198560 con 0x7f5c38101900 2024-09-18T12:48:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.857+0000 7f5c277fe640 1 -- 172.21.15.45:0/36915299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5c28042070 con 0x7f5c38101900 2024-09-18T12:48:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.858+0000 7f5c277fe640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f5c2006e310 0x7f5c200707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.858+0000 7f5c277fe640 1 -- 172.21.15.45:0/36915299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f5c280ae720 con 0x7f5c38101900 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.858+0000 7f5c35d9b640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f5c2006e310 0x7f5c200707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.858+0000 7f5c277fe640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968] conn(0x7f5c20074100 0x7f5c20076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.858+0000 7f5c277fe640 1 -- 172.21.15.45:0/36915299 --> [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c280054e0 con 0x7f5c20074100 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.858+0000 7f5c277fe640 1 -- 172.21.15.45:0/36915299 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5c280b5050 con 0x7f5c38101900 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.858+0000 7f5c36d9d640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968] conn(0x7f5c20074100 0x7f5c20076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.858+0000 7f5c35d9b640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f5c2006e310 0x7f5c200707d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c38100d10 tx=0x7f5c2c00a2d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.858+0000 7f5c36d9d640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968] conn(0x7f5c20074100 0x7f5c20076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.859+0000 7f5c277fe640 1 -- 172.21.15.45:0/36915299 <== osd.2 v2:172.21.15.45:6818/878363968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c280054e0 con 0x7f5c20074100 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 --> [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5c38062900 con 0x7f5c20074100 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c277fe640 1 -- 172.21.15.45:0/36915299 <== osd.2 v2:172.21.15.45:6818/878363968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5c38062900 con 0x7f5c20074100 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968] conn(0x7f5c20074100 msgr2=0x7f5c20076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968] conn(0x7f5c20074100 0x7f5c20076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f5c2006e310 msgr2=0x7f5c200707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f5c2006e310 0x7f5c200707d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c38100d10 tx=0x7f5c2c00a2d0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c38101900 msgr2=0x7f5c3819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c38101900 0x7f5c3819d660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5c28031460 tx=0x7f5c280048f0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 shutdown_connections 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6818/878363968,v1:172.21.15.45:6819/878363968] conn(0x7f5c20074100 0x7f5c20076520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f5c2006e310 0x7f5c200707d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c38107900 0x7f5c3819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 --2- 172.21.15.45:0/36915299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c38101900 0x7f5c3819d660 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 >> 172.21.15.45:0/36915299 conn(0x7f5c380fd600 msgr2=0x7f5c380fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 shutdown_connections 2024-09-18T12:48:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:48.873+0000 7f5c3ca26640 1 -- 172.21.15.45:0/36915299 wait complete. 2024-09-18T12:48:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.085+0000 7ff247811640 1 -- 172.21.15.45:0/1775333090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff240107900 msgr2=0x7ff240107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.085+0000 7ff247811640 1 --2- 172.21.15.45:0/1775333090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff240107900 0x7ff240107ce0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009880 tx=0x7ff23c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.085+0000 7ff247811640 1 -- 172.21.15.45:0/1775333090 shutdown_connections 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.085+0000 7ff247811640 1 --2- 172.21.15.45:0/1775333090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff240101900 0x7ff240101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.085+0000 7ff247811640 1 --2- 172.21.15.45:0/1775333090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff240107900 0x7ff240107ce0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.085+0000 7ff247811640 1 -- 172.21.15.45:0/1775333090 >> 172.21.15.45:0/1775333090 conn(0x7ff2400fd600 msgr2=0x7ff2400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.085+0000 7ff247811640 1 -- 172.21.15.45:0/1775333090 shutdown_connections 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.085+0000 7ff247811640 1 -- 172.21.15.45:0/1775333090 wait complete. 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff247811640 1 Processor -- start 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff247811640 1 -- start start 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff247811640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff240101900 0x7ff24019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff247811640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff240107900 0x7ff24019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff247811640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff24010edb0 con 0x7ff240101900 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff247811640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff24010ec30 con 0x7ff240107900 2024-09-18T12:48:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff2455ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff240101900 0x7ff24019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff2455ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff240101900 0x7ff24019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56438/0 (socket says 172.21.15.45:56438) 2024-09-18T12:48:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff2455ad640 1 -- 172.21.15.45:0/2065327964 learned_addr learned my addr 172.21.15.45:0/2065327964 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff244dac640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff240107900 0x7ff24019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff2455ad640 1 -- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff240107900 msgr2=0x7ff24019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.086+0000 7ff2455ad640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff240107900 0x7ff24019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.087+0000 7ff2455ad640 1 -- 172.21.15.45:0/2065327964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2401977e0 con 0x7ff240101900 2024-09-18T12:48:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.087+0000 7ff244dac640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff240107900 0x7ff24019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:48:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.087+0000 7ff2455ad640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff240101900 0x7ff24019d660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff23c031460 tx=0x7ff23c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.087+0000 7ff2367fc640 1 -- 172.21.15.45:0/2065327964 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff23c03f070 con 0x7ff240101900 2024-09-18T12:48:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.087+0000 7ff2367fc640 1 -- 172.21.15.45:0/2065327964 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff23c004cf0 con 0x7ff240101900 2024-09-18T12:48:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.087+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff240197a70 con 0x7ff240101900 2024-09-18T12:48:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.087+0000 7ff2367fc640 1 -- 172.21.15.45:0/2065327964 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff23c035030 con 0x7ff240101900 2024-09-18T12:48:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.087+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff240197fa0 con 0x7ff240101900 2024-09-18T12:48:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.088+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff240198560 con 0x7ff240101900 2024-09-18T12:48:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.088+0000 7ff2367fc640 1 -- 172.21.15.45:0/2065327964 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff23c042070 con 0x7ff240101900 2024-09-18T12:48:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.089+0000 7ff2367fc640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff22c06e310 0x7ff22c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:49.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.089+0000 7ff2367fc640 1 -- 172.21.15.45:0/2065327964 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7ff23c0ae880 con 0x7ff240101900 2024-09-18T12:48:49.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.089+0000 7ff244dac640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff22c06e310 0x7ff22c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:49.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.089+0000 7ff2367fc640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458] conn(0x7ff22c074100 0x7ff22c076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:49.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.089+0000 7ff2367fc640 1 -- 172.21.15.45:0/2065327964 --> [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff22c076bd0 con 0x7ff22c074100 2024-09-18T12:48:49.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.089+0000 7ff2367fc640 1 -- 172.21.15.45:0/2065327964 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff23c0b32a0 con 0x7ff240101900 2024-09-18T12:48:49.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.089+0000 7ff244dac640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff22c06e310 0x7ff22c0707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff240100d10 tx=0x7ff230005d90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:49.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.089+0000 7ff245dae640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458] conn(0x7ff22c074100 0x7ff22c076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:49.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.090+0000 7ff245dae640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458] conn(0x7ff22c074100 0x7ff22c076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.091+0000 7ff2367fc640 1 -- 172.21.15.45:0/2065327964 <== osd.3 v2:172.21.15.161:6800/2568825458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff22c076bd0 con 0x7ff22c074100 2024-09-18T12:48:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.104+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 --> [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2400628b0 con 0x7ff22c074100 2024-09-18T12:48:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff2367fc640 1 -- 172.21.15.45:0/2065327964 <== osd.3 v2:172.21.15.161:6800/2568825458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff2400628b0 con 0x7ff22c074100 2024-09-18T12:48:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458] conn(0x7ff22c074100 msgr2=0x7ff22c076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458] conn(0x7ff22c074100 0x7ff22c076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff22c06e310 msgr2=0x7ff22c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff22c06e310 0x7ff22c0707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff240100d10 tx=0x7ff230005d90 comp rx=0 tx=0).stop 2024-09-18T12:48:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff240101900 msgr2=0x7ff24019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff240101900 0x7ff24019d660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff23c031460 tx=0x7ff23c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:48:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 shutdown_connections 2024-09-18T12:48:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:6800/2568825458,v1:172.21.15.161:6801/2568825458] conn(0x7ff22c074100 0x7ff22c076520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff22c06e310 0x7ff22c0707d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff240107900 0x7ff24019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 --2- 172.21.15.45:0/2065327964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff240101900 0x7ff24019d660 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 >> 172.21.15.45:0/2065327964 conn(0x7ff2400fd600 msgr2=0x7ff2400fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.105+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 shutdown_connections 2024-09-18T12:48:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:49.106+0000 7ff247811640 1 -- 172.21.15.45:0/2065327964 wait complete. 2024-09-18T12:48:49.766 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:49 smithi045 ceph-mon[28315]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:49.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:49 smithi161 ceph-mon[35784]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:49.939 INFO:teuthology.orchestra.run.smithi045.stdout:81604378647 2024-09-18T12:48:49.940 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-18T12:48:50.341 INFO:teuthology.orchestra.run.smithi045.stdout:163208757254 2024-09-18T12:48:50.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-18T12:48:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:50.757 INFO:teuthology.orchestra.run.smithi045.stdout:107374182418 2024-09-18T12:48:50.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-18T12:48:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:51.018 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:51.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.191+0000 7f8eb1504640 1 -- 172.21.15.45:0/2070757604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eac1033e0 msgr2=0x7f8eac10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.191+0000 7f8eb1504640 1 --2- 172.21.15.45:0/2070757604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eac1033e0 0x7f8eac10b8d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009880 tx=0x7f8ea002a530 comp rx=0 tx=0).stop 2024-09-18T12:48:51.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.191+0000 7f8eb1504640 1 -- 172.21.15.45:0/2070757604 shutdown_connections 2024-09-18T12:48:51.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.191+0000 7f8eb1504640 1 --2- 172.21.15.45:0/2070757604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eac1033e0 0x7f8eac10b8d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.191+0000 7f8eb1504640 1 --2- 172.21.15.45:0/2070757604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8eac102ac0 0x7f8eac102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.191+0000 7f8eb1504640 1 -- 172.21.15.45:0/2070757604 >> 172.21.15.45:0/2070757604 conn(0x7f8eac0fc520 msgr2=0x7f8eac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:51.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.191+0000 7f8eb1504640 1 -- 172.21.15.45:0/2070757604 shutdown_connections 2024-09-18T12:48:51.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.191+0000 7f8eb1504640 1 -- 172.21.15.45:0/2070757604 wait complete. 2024-09-18T12:48:51.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.192+0000 7f8eb1504640 1 Processor -- start 2024-09-18T12:48:51.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.192+0000 7f8eb1504640 1 -- start start 2024-09-18T12:48:51.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.192+0000 7f8eb1504640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eac102ac0 0x7f8eac19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:51.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.192+0000 7f8eb1504640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8eac1033e0 0x7f8eac19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:51.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.192+0000 7f8eb1504640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac10edf0 con 0x7f8eac102ac0 2024-09-18T12:48:51.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.192+0000 7f8eb1504640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac10ec70 con 0x7f8eac1033e0 2024-09-18T12:48:51.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8eaaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eac102ac0 0x7f8eac19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:51.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8eaaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eac102ac0 0x7f8eac19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56466/0 (socket says 172.21.15.45:56466) 2024-09-18T12:48:51.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8eaaffd640 1 -- 172.21.15.45:0/2677002614 learned_addr learned my addr 172.21.15.45:0/2677002614 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:51.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8eaa7fc640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8eac1033e0 0x7f8eac19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:51.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8eaaffd640 1 -- 172.21.15.45:0/2677002614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8eac1033e0 msgr2=0x7f8eac19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8eaaffd640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8eac1033e0 0x7f8eac19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8eaaffd640 1 -- 172.21.15.45:0/2677002614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac197820 con 0x7f8eac102ac0 2024-09-18T12:48:51.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8eaaffd640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eac102ac0 0x7f8eac19d6a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00d6f0 tx=0x7f8e9c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:51.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8e93fff640 1 -- 172.21.15.45:0/2677002614 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e9c017070 con 0x7f8eac102ac0 2024-09-18T12:48:51.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8eb1504640 1 -- 172.21.15.45:0/2677002614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eac197b10 con 0x7f8eac102ac0 2024-09-18T12:48:51.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8e93fff640 1 -- 172.21.15.45:0/2677002614 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e9c00de00 con 0x7f8eac102ac0 2024-09-18T12:48:51.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8e93fff640 1 -- 172.21.15.45:0/2677002614 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e9c004bb0 con 0x7f8eac102ac0 2024-09-18T12:48:51.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.193+0000 7f8eb1504640 1 -- 172.21.15.45:0/2677002614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eac198070 con 0x7f8eac102ac0 2024-09-18T12:48:51.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.195+0000 7f8eb1504640 1 -- 172.21.15.45:0/2677002614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eac06aa90 con 0x7f8eac102ac0 2024-09-18T12:48:51.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.196+0000 7f8e93fff640 1 -- 172.21.15.45:0/2677002614 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8e9c004e60 con 0x7f8eac102ac0 2024-09-18T12:48:51.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.196+0000 7f8e93fff640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8e9406e2b0 0x7f8e94070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:51.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.196+0000 7f8e93fff640 1 -- 172.21.15.45:0/2677002614 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f8e9c08da20 con 0x7f8eac102ac0 2024-09-18T12:48:51.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.196+0000 7f8eaa7fc640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8e9406e2b0 0x7f8e94070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:51.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.197+0000 7f8eaa7fc640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8e9406e2b0 0x7f8e94070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8eac198b70 tx=0x7f8ea0031400 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:51.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.202+0000 7f8e93fff640 1 -- 172.21.15.45:0/2677002614 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e9c05b6c0 con 0x7f8eac102ac0 2024-09-18T12:48:51.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.381+0000 7f8eb1504640 1 -- 172.21.15.45:0/2677002614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8eac105f60 con 0x7f8eac102ac0 2024-09-18T12:48:51.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.382+0000 7f8e93fff640 1 -- 172.21.15.45:0/2677002614 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8e9c05f370 con 0x7f8eac102ac0 2024-09-18T12:48:51.383 INFO:teuthology.orchestra.run.smithi045.stdout:141733920780 2024-09-18T12:48:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.384+0000 7f8eb1504640 1 -- 172.21.15.45:0/2677002614 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8e9406e2b0 msgr2=0x7f8e94070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.384+0000 7f8eb1504640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8e9406e2b0 0x7f8e94070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8eac198b70 tx=0x7f8ea0031400 comp rx=0 tx=0).stop 2024-09-18T12:48:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.384+0000 7f8eb1504640 1 -- 172.21.15.45:0/2677002614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eac102ac0 msgr2=0x7f8eac19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.384+0000 7f8eb1504640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eac102ac0 0x7f8eac19d6a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00d6f0 tx=0x7f8e9c00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.384+0000 7f8eb1504640 1 -- 172.21.15.45:0/2677002614 shutdown_connections 2024-09-18T12:48:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.384+0000 7f8eb1504640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8e9406e2b0 0x7f8e94070770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.384+0000 7f8eb1504640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8eac1033e0 0x7f8eac19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.384+0000 7f8eb1504640 1 --2- 172.21.15.45:0/2677002614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eac102ac0 0x7f8eac19d6a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.384+0000 7f8eb1504640 1 -- 172.21.15.45:0/2677002614 >> 172.21.15.45:0/2677002614 conn(0x7f8eac0fc520 msgr2=0x7f8eac108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:51.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.385+0000 7f8eb1504640 1 -- 172.21.15.45:0/2677002614 shutdown_connections 2024-09-18T12:48:51.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.385+0000 7f8eb1504640 1 -- 172.21.15.45:0/2677002614 wait complete. 2024-09-18T12:48:51.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:51 smithi045 ceph-mon[28315]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:51.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:51 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2677002614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-18T12:48:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.670+0000 7fa8a421d640 1 -- 172.21.15.45:0/448769191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89c100800 msgr2=0x7fa89c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.670+0000 7fa8a421d640 1 --2- 172.21.15.45:0/448769191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89c100800 0x7fa89c100c60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009880 tx=0x7fa88c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.670+0000 7fa8a421d640 1 -- 172.21.15.45:0/448769191 shutdown_connections 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.670+0000 7fa8a421d640 1 --2- 172.21.15.45:0/448769191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89c100800 0x7fa89c100c60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.670+0000 7fa8a421d640 1 --2- 172.21.15.45:0/448769191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa89c106800 0x7fa89c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.670+0000 7fa8a421d640 1 -- 172.21.15.45:0/448769191 >> 172.21.15.45:0/448769191 conn(0x7fa89c0fc520 msgr2=0x7fa89c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.670+0000 7fa8a421d640 1 -- 172.21.15.45:0/448769191 shutdown_connections 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.670+0000 7fa8a421d640 1 -- 172.21.15.45:0/448769191 wait complete. 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.671+0000 7fa8a421d640 1 Processor -- start 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.671+0000 7fa8a421d640 1 -- start start 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.671+0000 7fa8a421d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89c100800 0x7fa89c1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.671+0000 7fa8a421d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa89c106800 0x7fa89c102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.671+0000 7fa8a421d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c10dcb0 con 0x7fa89c100800 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.671+0000 7fa8a421d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c10db30 con 0x7fa89c106800 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.671+0000 7fa8a1fb9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89c100800 0x7fa89c1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.671+0000 7fa8a1fb9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89c100800 0x7fa89c1023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56480/0 (socket says 172.21.15.45:56480) 2024-09-18T12:48:51.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.671+0000 7fa8a1fb9640 1 -- 172.21.15.45:0/813322485 learned_addr learned my addr 172.21.15.45:0/813322485 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:51.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.671+0000 7fa8a17b8640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa89c106800 0x7fa89c102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:51.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.672+0000 7fa8a1fb9640 1 -- 172.21.15.45:0/813322485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa89c106800 msgr2=0x7fa89c102910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.672+0000 7fa8a1fb9640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa89c106800 0x7fa89c102910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.672+0000 7fa8a1fb9640 1 -- 172.21.15.45:0/813322485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89c102e50 con 0x7fa89c100800 2024-09-18T12:48:51.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.672+0000 7fa8a17b8640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa89c106800 0x7fa89c102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:48:51.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.672+0000 7fa8a1fb9640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89c100800 0x7fa89c1023d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa89800c8a0 tx=0x7fa89800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:51.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.672+0000 7fa892ffd640 1 -- 172.21.15.45:0/813322485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa8980079b0 con 0x7fa89c100800 2024-09-18T12:48:51.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.672+0000 7fa892ffd640 1 -- 172.21.15.45:0/813322485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa898007b50 con 0x7fa89c100800 2024-09-18T12:48:51.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.672+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89c103140 con 0x7fa89c100800 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.672+0000 7fa892ffd640 1 -- 172.21.15.45:0/813322485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa898018700 con 0x7fa89c100800 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.672+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa89c1a3d90 con 0x7fa89c100800 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.673+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa89c06a440 con 0x7fa89c100800 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.674+0000 7fa892ffd640 1 -- 172.21.15.45:0/813322485 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa89800f450 con 0x7fa89c100800 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.674+0000 7fa892ffd640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa88806e2b0 0x7fa888070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.674+0000 7fa892ffd640 1 -- 172.21.15.45:0/813322485 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fa89808e100 con 0x7fa89c100800 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.674+0000 7fa8a17b8640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa88806e2b0 0x7fa888070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.674+0000 7fa892ffd640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799] conn(0x7fa8880740a0 0x7fa8880764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.674+0000 7fa892ffd640 1 -- 172.21.15.45:0/813322485 --> [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa888076b70 con 0x7fa8880740a0 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.674+0000 7fa892ffd640 1 -- 172.21.15.45:0/813322485 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa898095050 con 0x7fa89c100800 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.674+0000 7fa8a27ba640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799] conn(0x7fa8880740a0 0x7fa8880764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.675+0000 7fa8a17b8640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa88806e2b0 0x7fa888070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa89c103e60 tx=0x7fa88c009560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.675+0000 7fa8a27ba640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799] conn(0x7fa8880740a0 0x7fa8880764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:51.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.675+0000 7fa892ffd640 1 -- 172.21.15.45:0/813322485 <== osd.1 v2:172.21.15.45:6810/2210413799 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa888076b70 con 0x7fa8880740a0 2024-09-18T12:48:51.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.689+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 --> [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa89c101f40 con 0x7fa8880740a0 2024-09-18T12:48:51.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.689+0000 7fa892ffd640 1 -- 172.21.15.45:0/813322485 <== osd.1 v2:172.21.15.45:6810/2210413799 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa89c101f40 con 0x7fa8880740a0 2024-09-18T12:48:51.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799] conn(0x7fa8880740a0 msgr2=0x7fa8880764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799] conn(0x7fa8880740a0 0x7fa8880764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa88806e2b0 msgr2=0x7fa888070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa88806e2b0 0x7fa888070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa89c103e60 tx=0x7fa88c009560 comp rx=0 tx=0).stop 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89c100800 msgr2=0x7fa89c1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89c100800 0x7fa89c1023d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa89800c8a0 tx=0x7fa89800cd60 comp rx=0 tx=0).stop 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 shutdown_connections 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6810/2210413799,v1:172.21.15.45:6811/2210413799] conn(0x7fa8880740a0 0x7fa8880764c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa88806e2b0 0x7fa888070770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa89c106800 0x7fa89c102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 --2- 172.21.15.45:0/813322485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89c100800 0x7fa89c1023d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 >> 172.21.15.45:0/813322485 conn(0x7fa89c0fc520 msgr2=0x7fa89c1045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 shutdown_connections 2024-09-18T12:48:51.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:51.690+0000 7fa8a421d640 1 -- 172.21.15.45:0/813322485 wait complete. 2024-09-18T12:48:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:51 smithi161 ceph-mon[35784]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:51 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2677002614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-18T12:48:52.187 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.735+0000 7fbaf721b640 1 -- 172.21.15.45:0/1250200169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaf0102b10 msgr2=0x7fbaf0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.735+0000 7fbaf721b640 1 --2- 172.21.15.45:0/1250200169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaf0102b10 0x7fbaf0102ef0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbae40098b0 tx=0x7fbae402a560 comp rx=0 tx=0).stop 2024-09-18T12:48:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.735+0000 7fbaf721b640 1 -- 172.21.15.45:0/1250200169 shutdown_connections 2024-09-18T12:48:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.735+0000 7fbaf721b640 1 --2- 172.21.15.45:0/1250200169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf0103430 0x7fbaf010b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.735+0000 7fbaf721b640 1 --2- 172.21.15.45:0/1250200169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaf0102b10 0x7fbaf0102ef0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.735+0000 7fbaf721b640 1 -- 172.21.15.45:0/1250200169 >> 172.21.15.45:0/1250200169 conn(0x7fbaf00fc550 msgr2=0x7fbaf00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.735+0000 7fbaf721b640 1 -- 172.21.15.45:0/1250200169 shutdown_connections 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.735+0000 7fbaf721b640 1 -- 172.21.15.45:0/1250200169 wait complete. 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.736+0000 7fbaf721b640 1 Processor -- start 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.736+0000 7fbaf721b640 1 -- start start 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.736+0000 7fbaf721b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf0102b10 0x7fbaf019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.736+0000 7fbaf721b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaf0103430 0x7fbaf019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.736+0000 7fbaf721b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf010edc0 con 0x7fbaf0103430 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.736+0000 7fbaf721b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf010ec40 con 0x7fbaf0102b10 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.736+0000 7fbaeffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaf0103430 0x7fbaf019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.736+0000 7fbaeffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaf0103430 0x7fbaf019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48134/0 (socket says 172.21.15.45:48134) 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.736+0000 7fbaeffff640 1 -- 172.21.15.45:0/416335773 learned_addr learned my addr 172.21.15.45:0/416335773 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaf4fb7640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf0102b10 0x7fbaf019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaeffff640 1 -- 172.21.15.45:0/416335773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf0102b10 msgr2=0x7fbaf019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaeffff640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf0102b10 0x7fbaf019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaeffff640 1 -- 172.21.15.45:0/416335773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf01977d0 con 0x7fbaf0103430 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaf4fb7640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf0102b10 0x7fbaf019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaeffff640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaf0103430 0x7fbaf019db90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00d8d0 tx=0x7fbadc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaedffb640 1 -- 172.21.15.45:0/416335773 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbadc017070 con 0x7fbaf0103430 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaf721b640 1 -- 172.21.15.45:0/416335773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf0197ac0 con 0x7fbaf0103430 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaedffb640 1 -- 172.21.15.45:0/416335773 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbadc010460 con 0x7fbaf0103430 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaedffb640 1 -- 172.21.15.45:0/416335773 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbadc00f5f0 con 0x7fbaf0103430 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.737+0000 7fbaf721b640 1 -- 172.21.15.45:0/416335773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf0198050 con 0x7fbaf0103430 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.738+0000 7fbaf721b640 1 -- 172.21.15.45:0/416335773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf006a520 con 0x7fbaf0103430 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.739+0000 7fbaedffb640 1 -- 172.21.15.45:0/416335773 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fbadc009a30 con 0x7fbaf0103430 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.739+0000 7fbaedffb640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbae006e360 0x7fbae0070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.739+0000 7fbaedffb640 1 -- 172.21.15.45:0/416335773 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fbadc08dcc0 con 0x7fbaf0103430 2024-09-18T12:48:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.739+0000 7fbaf4fb7640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbae006e360 0x7fbae0070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.740+0000 7fbaf4fb7640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbae006e360 0x7fbae0070820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbae4006010 tx=0x7fbae40095f0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.748+0000 7fbaedffb640 1 -- 172.21.15.45:0/416335773 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbadc05b940 con 0x7fbaf0103430 2024-09-18T12:48:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.930+0000 7fbaf721b640 1 -- 172.21.15.45:0/416335773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbaf0104f60 con 0x7fbaf0103430 2024-09-18T12:48:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.931+0000 7fbaedffb640 1 -- 172.21.15.45:0/416335773 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbadc05f5f0 con 0x7fbaf0103430 2024-09-18T12:48:52.932 INFO:teuthology.orchestra.run.smithi045.stdout:163208757256 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 -- 172.21.15.45:0/416335773 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbae006e360 msgr2=0x7fbae0070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbae006e360 0x7fbae0070820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbae4006010 tx=0x7fbae40095f0 comp rx=0 tx=0).stop 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 -- 172.21.15.45:0/416335773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaf0103430 msgr2=0x7fbaf019db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaf0103430 0x7fbaf019db90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00d8d0 tx=0x7fbadc00dd90 comp rx=0 tx=0).stop 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 -- 172.21.15.45:0/416335773 shutdown_connections 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbae006e360 0x7fbae0070820 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbaf0103430 0x7fbaf019db90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 --2- 172.21.15.45:0/416335773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf0102b10 0x7fbaf019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 -- 172.21.15.45:0/416335773 >> 172.21.15.45:0/416335773 conn(0x7fbaf00fc550 msgr2=0x7fbaf0107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 -- 172.21.15.45:0/416335773 shutdown_connections 2024-09-18T12:48:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.933+0000 7fbaf721b640 1 -- 172.21.15.45:0/416335773 wait complete. 2024-09-18T12:48:53.227 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920779 got 141733920780 for osd.4 2024-09-18T12:48:53.227 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:53 smithi045 ceph-mon[28315]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:53 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/602142475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-18T12:48:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:53 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/416335773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-18T12:48:53.674 INFO:teuthology.orchestra.run.smithi045.stdout:64424509465 2024-09-18T12:48:53.675 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-18T12:48:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:53 smithi161 ceph-mon[35784]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:53 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/602142475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-18T12:48:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:53 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/416335773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-18T12:48:54.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.643+0000 7fa2501c0640 1 -- 172.21.15.45:0/881643858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa248106800 msgr2=0x7fa248106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:54.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.643+0000 7fa2501c0640 1 --2- 172.21.15.45:0/881643858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa248106800 0x7fa248106be0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa244009880 tx=0x7fa24402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:54.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.643+0000 7fa2501c0640 1 -- 172.21.15.45:0/881643858 shutdown_connections 2024-09-18T12:48:54.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.643+0000 7fa2501c0640 1 --2- 172.21.15.45:0/881643858 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa248100800 0x7fa248100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.643+0000 7fa2501c0640 1 --2- 172.21.15.45:0/881643858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa248106800 0x7fa248106be0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.643+0000 7fa2501c0640 1 -- 172.21.15.45:0/881643858 >> 172.21.15.45:0/881643858 conn(0x7fa2480fc520 msgr2=0x7fa2480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.643+0000 7fa2501c0640 1 -- 172.21.15.45:0/881643858 shutdown_connections 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.643+0000 7fa2501c0640 1 -- 172.21.15.45:0/881643858 wait complete. 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa2501c0640 1 Processor -- start 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa2501c0640 1 -- start start 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa2501c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa248100800 0x7fa24819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa2501c0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa248106800 0x7fa24819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa2501c0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa24810dd30 con 0x7fa248100800 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa2501c0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa24810dbb0 con 0x7fa248106800 2024-09-18T12:48:54.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa24df5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa248100800 0x7fa24819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:54.105 INFO:teuthology.orchestra.run.smithi045.stdout:38654705700 2024-09-18T12:48:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa24df5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa248100800 0x7fa24819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48122/0 (socket says 172.21.15.45:48122) 2024-09-18T12:48:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa24df5c640 1 -- 172.21.15.45:0/602142475 learned_addr learned my addr 172.21.15.45:0/602142475 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa24d75b640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa248106800 0x7fa24819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa24df5c640 1 -- 172.21.15.45:0/602142475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa248106800 msgr2=0x7fa24819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa24df5c640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa248106800 0x7fa24819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa24df5c640 1 -- 172.21.15.45:0/602142475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2481977f0 con 0x7fa248100800 2024-09-18T12:48:54.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.644+0000 7fa24d75b640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa248106800 0x7fa24819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.645+0000 7fa24df5c640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa248100800 0x7fa24819d670 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa244031460 tx=0x7fa2440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.645+0000 7fa23effd640 1 -- 172.21.15.45:0/602142475 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa24403f070 con 0x7fa248100800 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.645+0000 7fa23effd640 1 -- 172.21.15.45:0/602142475 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa244004cf0 con 0x7fa248100800 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.645+0000 7fa2501c0640 1 -- 172.21.15.45:0/602142475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa248197a80 con 0x7fa248100800 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.645+0000 7fa23effd640 1 -- 172.21.15.45:0/602142475 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa244035030 con 0x7fa248100800 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.645+0000 7fa2501c0640 1 -- 172.21.15.45:0/602142475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa248197fb0 con 0x7fa248100800 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.646+0000 7fa2501c0640 1 -- 172.21.15.45:0/602142475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa248101f40 con 0x7fa248100800 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.646+0000 7fa23effd640 1 -- 172.21.15.45:0/602142475 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa244042070 con 0x7fa248100800 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.647+0000 7fa23effd640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa23406e2b0 0x7fa234070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.647+0000 7fa24d75b640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa23406e2b0 0x7fa234070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.647+0000 7fa23effd640 1 -- 172.21.15.45:0/602142475 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fa2440ae910 con 0x7fa248100800 2024-09-18T12:48:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.647+0000 7fa24d75b640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa23406e2b0 0x7fa234070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa238006fd0 tx=0x7fa238008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:54.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.651+0000 7fa23effd640 1 -- 172.21.15.45:0/602142475 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa24407c5b0 con 0x7fa248100800 2024-09-18T12:48:54.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.844+0000 7fa2501c0640 1 -- 172.21.15.45:0/602142475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa248109d80 con 0x7fa248100800 2024-09-18T12:48:54.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.844+0000 7fa23effd640 1 -- 172.21.15.45:0/602142475 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa244080260 con 0x7fa248100800 2024-09-18T12:48:54.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.846+0000 7fa2501c0640 1 -- 172.21.15.45:0/602142475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa23406e2b0 msgr2=0x7fa234070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:54.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.846+0000 7fa2501c0640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa23406e2b0 0x7fa234070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa238006fd0 tx=0x7fa238008040 comp rx=0 tx=0).stop 2024-09-18T12:48:54.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.846+0000 7fa2501c0640 1 -- 172.21.15.45:0/602142475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa248100800 msgr2=0x7fa24819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:54.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.846+0000 7fa2501c0640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa248100800 0x7fa24819d670 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa244031460 tx=0x7fa2440048f0 comp rx=0 tx=0).stop 2024-09-18T12:48:54.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.846+0000 7fa2501c0640 1 -- 172.21.15.45:0/602142475 shutdown_connections 2024-09-18T12:48:54.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.846+0000 7fa2501c0640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa23406e2b0 0x7fa234070770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:54.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.847+0000 7fa2501c0640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa248106800 0x7fa24819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:54.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.847+0000 7fa2501c0640 1 --2- 172.21.15.45:0/602142475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa248100800 0x7fa24819d670 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:54.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.847+0000 7fa2501c0640 1 -- 172.21.15.45:0/602142475 >> 172.21.15.45:0/602142475 conn(0x7fa2480fc520 msgr2=0x7fa24806a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:54.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.847+0000 7fa2501c0640 1 -- 172.21.15.45:0/602142475 shutdown_connections 2024-09-18T12:48:54.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:52.847+0000 7fa2501c0640 1 -- 172.21.15.45:0/602142475 wait complete. 2024-09-18T12:48:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:54.747 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705700 for osd.0 2024-09-18T12:48:54.747 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:55.118 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757254 got 163208757256 for osd.5 2024-09-18T12:48:55.118 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:55.369 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:55.574 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:55 smithi045 ceph-mon[28315]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:55.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.584+0000 7f3358cb5640 1 -- 172.21.15.45:0/3051399493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354103430 msgr2=0x7f335410b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.584+0000 7f3358cb5640 1 --2- 172.21.15.45:0/3051399493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354103430 0x7f335410b920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f33480098b0 tx=0x7f334802a560 comp rx=0 tx=0).stop 2024-09-18T12:48:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.584+0000 7f3358cb5640 1 -- 172.21.15.45:0/3051399493 shutdown_connections 2024-09-18T12:48:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.584+0000 7f3358cb5640 1 --2- 172.21.15.45:0/3051399493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354103430 0x7f335410b920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.584+0000 7f3358cb5640 1 --2- 172.21.15.45:0/3051399493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3354102b10 0x7f3354102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.584+0000 7f3358cb5640 1 -- 172.21.15.45:0/3051399493 >> 172.21.15.45:0/3051399493 conn(0x7f33540fc550 msgr2=0x7f33540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.584+0000 7f3358cb5640 1 -- 172.21.15.45:0/3051399493 shutdown_connections 2024-09-18T12:48:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.584+0000 7f3358cb5640 1 -- 172.21.15.45:0/3051399493 wait complete. 2024-09-18T12:48:55.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.585+0000 7f3358cb5640 1 Processor -- start 2024-09-18T12:48:55.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f3358cb5640 1 -- start start 2024-09-18T12:48:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f3358cb5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3354102b10 0x7f335419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f3358cb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354103430 0x7f335419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f3358cb5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f335410ede0 con 0x7f3354103430 2024-09-18T12:48:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f3358cb5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f335410ec60 con 0x7f3354102b10 2024-09-18T12:48:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f3351d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354103430 0x7f335419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f3351d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354103430 0x7f335419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48166/0 (socket says 172.21.15.45:48166) 2024-09-18T12:48:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f3351d9b640 1 -- 172.21.15.45:0/4144429482 learned_addr learned my addr 172.21.15.45:0/4144429482 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f335259c640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3354102b10 0x7f335419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f3351d9b640 1 -- 172.21.15.45:0/4144429482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3354102b10 msgr2=0x7f335419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.586+0000 7f3351d9b640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3354102b10 0x7f335419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:55.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.587+0000 7f3351d9b640 1 -- 172.21.15.45:0/4144429482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33541977f0 con 0x7f3354103430 2024-09-18T12:48:55.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.587+0000 7f3351d9b640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354103430 0x7f335419dbb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3348031460 tx=0x7f33480045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:55.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.587+0000 7f33437fe640 1 -- 172.21.15.45:0/4144429482 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f334803f070 con 0x7f3354103430 2024-09-18T12:48:55.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.587+0000 7f33437fe640 1 -- 172.21.15.45:0/4144429482 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33480035f0 con 0x7f3354103430 2024-09-18T12:48:55.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.587+0000 7f3358cb5640 1 -- 172.21.15.45:0/4144429482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3354197a80 con 0x7f3354103430 2024-09-18T12:48:55.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.587+0000 7f33437fe640 1 -- 172.21.15.45:0/4144429482 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3348035030 con 0x7f3354103430 2024-09-18T12:48:55.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.587+0000 7f3358cb5640 1 -- 172.21.15.45:0/4144429482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3354197ef0 con 0x7f3354103430 2024-09-18T12:48:55.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.589+0000 7f33417fa640 1 -- 172.21.15.45:0/4144429482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335406a520 con 0x7f3354103430 2024-09-18T12:48:55.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.590+0000 7f33437fe640 1 -- 172.21.15.45:0/4144429482 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3348042070 con 0x7f3354103430 2024-09-18T12:48:55.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.590+0000 7f33437fe640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f333c06e310 0x7f333c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:55.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.591+0000 7f33437fe640 1 -- 172.21.15.45:0/4144429482 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f33480ae6c0 con 0x7f3354103430 2024-09-18T12:48:55.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.591+0000 7f335259c640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f333c06e310 0x7f333c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:55.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.591+0000 7f335259c640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f333c06e310 0x7f333c0707d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3344005fd0 tx=0x7f334400b390 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:55.595 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:55.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.597+0000 7f33437fe640 1 -- 172.21.15.45:0/4144429482 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f334807fff0 con 0x7f3354103430 2024-09-18T12:48:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:55 smithi161 ceph-mon[35784]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:55.793 INFO:teuthology.orchestra.run.smithi045.stdout:81604378648 2024-09-18T12:48:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.790+0000 7f33417fa640 1 -- 172.21.15.45:0/4144429482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3354198d20 con 0x7f3354103430 2024-09-18T12:48:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.791+0000 7f33437fe640 1 -- 172.21.15.45:0/4144429482 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3348084820 con 0x7f3354103430 2024-09-18T12:48:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.793+0000 7f33417fa640 1 -- 172.21.15.45:0/4144429482 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f333c06e310 msgr2=0x7f333c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.793+0000 7f33417fa640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f333c06e310 0x7f333c0707d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3344005fd0 tx=0x7f334400b390 comp rx=0 tx=0).stop 2024-09-18T12:48:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.793+0000 7f33417fa640 1 -- 172.21.15.45:0/4144429482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354103430 msgr2=0x7f335419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.793+0000 7f33417fa640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354103430 0x7f335419dbb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3348031460 tx=0x7f33480045c0 comp rx=0 tx=0).stop 2024-09-18T12:48:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.794+0000 7f33417fa640 1 -- 172.21.15.45:0/4144429482 shutdown_connections 2024-09-18T12:48:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.794+0000 7f33417fa640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f333c06e310 0x7f333c0707d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.794+0000 7f33417fa640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354103430 0x7f335419dbb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.794+0000 7f33417fa640 1 --2- 172.21.15.45:0/4144429482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3354102b10 0x7f335419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.794+0000 7f33417fa640 1 -- 172.21.15.45:0/4144429482 >> 172.21.15.45:0/4144429482 conn(0x7f33540fc550 msgr2=0x7f3354103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:55.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.794+0000 7f33417fa640 1 -- 172.21.15.45:0/4144429482 shutdown_connections 2024-09-18T12:48:55.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:55.794+0000 7f33417fa640 1 -- 172.21.15.45:0/4144429482 wait complete. 2024-09-18T12:48:56.457 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378648 for osd.2 2024-09-18T12:48:56.457 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:56.637 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:56 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/4144429482' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-18T12:48:56.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:56 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/4144429482' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-18T12:48:56.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.840+0000 7f2af8d52640 1 -- 172.21.15.45:0/3361047796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af41067f0 msgr2=0x7f2af4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:56.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.841+0000 7f2af8d52640 1 --2- 172.21.15.45:0/3361047796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af41067f0 0x7f2af4106bd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009880 tx=0x7f2aec02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:48:56.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.841+0000 7f2af8d52640 1 -- 172.21.15.45:0/3361047796 shutdown_connections 2024-09-18T12:48:56.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.841+0000 7f2af8d52640 1 --2- 172.21.15.45:0/3361047796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af41007f0 0x7f2af4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:56.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.841+0000 7f2af8d52640 1 --2- 172.21.15.45:0/3361047796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af41067f0 0x7f2af4106bd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:56.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.841+0000 7f2af8d52640 1 -- 172.21.15.45:0/3361047796 >> 172.21.15.45:0/3361047796 conn(0x7f2af40fc550 msgr2=0x7f2af40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:56.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.841+0000 7f2af8d52640 1 -- 172.21.15.45:0/3361047796 shutdown_connections 2024-09-18T12:48:56.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.841+0000 7f2af8d52640 1 -- 172.21.15.45:0/3361047796 wait complete. 2024-09-18T12:48:56.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af8d52640 1 Processor -- start 2024-09-18T12:48:56.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af8d52640 1 -- start start 2024-09-18T12:48:56.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af8d52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af41007f0 0x7f2af4107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:56.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af8d52640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af41067f0 0x7f2af4107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:56.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af8d52640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2af410dca0 con 0x7f2af41007f0 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af8d52640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2af410db20 con 0x7f2af41067f0 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af41007f0 0x7f2af4107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af41007f0 0x7f2af4107720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48172/0 (socket says 172.21.15.45:48172) 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af259c640 1 -- 172.21.15.45:0/1020927649 learned_addr learned my addr 172.21.15.45:0/1020927649 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af259c640 1 -- 172.21.15.45:0/1020927649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af41067f0 msgr2=0x7f2af4107c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af259c640 1 --2- 172.21.15.45:0/1020927649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af41067f0 0x7f2af4107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.842+0000 7f2af259c640 1 -- 172.21.15.45:0/1020927649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af41081a0 con 0x7f2af41007f0 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.843+0000 7f2af259c640 1 --2- 172.21.15.45:0/1020927649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af41007f0 0x7f2af4107720 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2aec031460 tx=0x7f2aec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.843+0000 7f2aeb7fe640 1 -- 172.21.15.45:0/1020927649 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2aec03f070 con 0x7f2af41007f0 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.843+0000 7f2af8d52640 1 -- 172.21.15.45:0/1020927649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af4108430 con 0x7f2af41007f0 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.843+0000 7f2aeb7fe640 1 -- 172.21.15.45:0/1020927649 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2aec004cf0 con 0x7f2af41007f0 2024-09-18T12:48:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.843+0000 7f2aeb7fe640 1 -- 172.21.15.45:0/1020927649 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2aec035030 con 0x7f2af41007f0 2024-09-18T12:48:56.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.843+0000 7f2af8d52640 1 -- 172.21.15.45:0/1020927649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af41a3d10 con 0x7f2af41007f0 2024-09-18T12:48:56.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.844+0000 7f2af8d52640 1 -- 172.21.15.45:0/1020927649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af4101f30 con 0x7f2af41007f0 2024-09-18T12:48:56.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.844+0000 7f2aeb7fe640 1 -- 172.21.15.45:0/1020927649 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2aec042070 con 0x7f2af41007f0 2024-09-18T12:48:56.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.845+0000 7f2aeb7fe640 1 --2- 172.21.15.45:0/1020927649 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2ae006e310 0x7f2ae00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:56.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.845+0000 7f2aeb7fe640 1 -- 172.21.15.45:0/1020927649 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f2aec0ae7e0 con 0x7f2af41007f0 2024-09-18T12:48:56.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.845+0000 7f2af1d9b640 1 --2- 172.21.15.45:0/1020927649 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2ae006e310 0x7f2ae00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:56.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.845+0000 7f2af1d9b640 1 --2- 172.21.15.45:0/1020927649 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2ae006e310 0x7f2ae00707d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2af41091b0 tx=0x7f2adc005bf0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:56.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:56.849+0000 7f2aeb7fe640 1 -- 172.21.15.45:0/1020927649 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2aec07c500 con 0x7f2af41007f0 2024-09-18T12:48:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.026+0000 7f2af8d52640 1 -- 172.21.15.45:0/1020927649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2af41a4020 con 0x7f2af41007f0 2024-09-18T12:48:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.026+0000 7f2aeb7fe640 1 -- 172.21.15.45:0/1020927649 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2aec0801b0 con 0x7f2af41007f0 2024-09-18T12:48:57.028 INFO:teuthology.orchestra.run.smithi045.stdout:64424509466 2024-09-18T12:48:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 -- 172.21.15.45:0/1020927649 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2ae006e310 msgr2=0x7f2ae00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 --2- 172.21.15.45:0/1020927649 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2ae006e310 0x7f2ae00707d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2af41091b0 tx=0x7f2adc005bf0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 -- 172.21.15.45:0/1020927649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af41007f0 msgr2=0x7f2af4107720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 --2- 172.21.15.45:0/1020927649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af41007f0 0x7f2af4107720 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2aec031460 tx=0x7f2aec0048f0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 -- 172.21.15.45:0/1020927649 shutdown_connections 2024-09-18T12:48:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 --2- 172.21.15.45:0/1020927649 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2ae006e310 0x7f2ae00707d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 --2- 172.21.15.45:0/1020927649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af41067f0 0x7f2af4107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 --2- 172.21.15.45:0/1020927649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af41007f0 0x7f2af4107720 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 -- 172.21.15.45:0/1020927649 >> 172.21.15.45:0/1020927649 conn(0x7f2af40fc550 msgr2=0x7f2af4069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 -- 172.21.15.45:0/1020927649 shutdown_connections 2024-09-18T12:48:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.028+0000 7f2af8d52640 1 -- 172.21.15.45:0/1020927649 wait complete. 2024-09-18T12:48:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.031+0000 7f6a840ea640 1 -- 172.21.15.45:0/2013798569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c102ab0 msgr2=0x7f6a7c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.031+0000 7f6a840ea640 1 --2- 172.21.15.45:0/2013798569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c102ab0 0x7f6a7c102e90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009880 tx=0x7f6a7802a530 comp rx=0 tx=0).stop 2024-09-18T12:48:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.031+0000 7f6a840ea640 1 -- 172.21.15.45:0/2013798569 shutdown_connections 2024-09-18T12:48:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.031+0000 7f6a840ea640 1 --2- 172.21.15.45:0/2013798569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c1033d0 0x7f6a7c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.031+0000 7f6a840ea640 1 --2- 172.21.15.45:0/2013798569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c102ab0 0x7f6a7c102e90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.031+0000 7f6a840ea640 1 -- 172.21.15.45:0/2013798569 >> 172.21.15.45:0/2013798569 conn(0x7f6a7c0fc550 msgr2=0x7f6a7c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.031+0000 7f6a840ea640 1 -- 172.21.15.45:0/2013798569 shutdown_connections 2024-09-18T12:48:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.031+0000 7f6a840ea640 1 -- 172.21.15.45:0/2013798569 wait complete. 2024-09-18T12:48:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.032+0000 7f6a840ea640 1 Processor -- start 2024-09-18T12:48:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.032+0000 7f6a840ea640 1 -- start start 2024-09-18T12:48:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.032+0000 7f6a840ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c102ab0 0x7f6a7c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.033+0000 7f6a840ea640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c1033d0 0x7f6a7c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.033+0000 7f6a840ea640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c10ede0 con 0x7f6a7c102ab0 2024-09-18T12:48:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.033+0000 7f6a840ea640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c10ec60 con 0x7f6a7c1033d0 2024-09-18T12:48:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.033+0000 7f6a81e86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c102ab0 0x7f6a7c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.033+0000 7f6a81e86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c102ab0 0x7f6a7c100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48194/0 (socket says 172.21.15.45:48194) 2024-09-18T12:48:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.033+0000 7f6a81e86640 1 -- 172.21.15.45:0/496201914 learned_addr learned my addr 172.21.15.45:0/496201914 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.033+0000 7f6a81685640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c1033d0 0x7f6a7c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.033+0000 7f6a81e86640 1 -- 172.21.15.45:0/496201914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c1033d0 msgr2=0x7f6a7c100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.033+0000 7f6a81e86640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c1033d0 0x7f6a7c100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.033+0000 7f6a81e86640 1 -- 172.21.15.45:0/496201914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c102490 con 0x7f6a7c102ab0 2024-09-18T12:48:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.034+0000 7f6a81e86640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c102ab0 0x7f6a7c100710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6a78031460 tx=0x7f6a780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.034+0000 7f6a72ffd640 1 -- 172.21.15.45:0/496201914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a7803f070 con 0x7f6a7c102ab0 2024-09-18T12:48:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.034+0000 7f6a72ffd640 1 -- 172.21.15.45:0/496201914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a780035f0 con 0x7f6a7c102ab0 2024-09-18T12:48:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.034+0000 7f6a840ea640 1 -- 172.21.15.45:0/496201914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7c101190 con 0x7f6a7c102ab0 2024-09-18T12:48:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.034+0000 7f6a72ffd640 1 -- 172.21.15.45:0/496201914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a78035030 con 0x7f6a7c102ab0 2024-09-18T12:48:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.034+0000 7f6a840ea640 1 -- 172.21.15.45:0/496201914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a7c19baf0 con 0x7f6a7c102ab0 2024-09-18T12:48:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.035+0000 7f6a840ea640 1 -- 172.21.15.45:0/496201914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7c06a580 con 0x7f6a7c102ab0 2024-09-18T12:48:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.036+0000 7f6a72ffd640 1 -- 172.21.15.45:0/496201914 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6a78042070 con 0x7f6a7c102ab0 2024-09-18T12:48:57.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.037+0000 7f6a72ffd640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6806e2b0 0x7f6a68070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:57.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.037+0000 7f6a72ffd640 1 -- 172.21.15.45:0/496201914 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f6a780ae7e0 con 0x7f6a7c102ab0 2024-09-18T12:48:57.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.037+0000 7f6a81685640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6806e2b0 0x7f6a68070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:57.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.037+0000 7f6a81685640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6806e2b0 0x7f6a68070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c101ed0 tx=0x7f6a6c00b2e0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:57.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.041+0000 7f6a72ffd640 1 -- 172.21.15.45:0/496201914 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a78080090 con 0x7f6a7c102ab0 2024-09-18T12:48:57.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.219+0000 7f6a840ea640 1 -- 172.21.15.45:0/496201914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6a7c19bcc0 con 0x7f6a7c102ab0 2024-09-18T12:48:57.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.220+0000 7f6a72ffd640 1 -- 172.21.15.45:0/496201914 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6a780848c0 con 0x7f6a7c102ab0 2024-09-18T12:48:57.221 INFO:teuthology.orchestra.run.smithi045.stdout:107374182420 2024-09-18T12:48:57.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 -- 172.21.15.45:0/496201914 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6806e2b0 msgr2=0x7f6a68070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:57.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6806e2b0 0x7f6a68070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c101ed0 tx=0x7f6a6c00b2e0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 -- 172.21.15.45:0/496201914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c102ab0 msgr2=0x7f6a7c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:57.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c102ab0 0x7f6a7c100710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6a78031460 tx=0x7f6a780045e0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 -- 172.21.15.45:0/496201914 shutdown_connections 2024-09-18T12:48:57.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6a6806e2b0 0x7f6a68070770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c1033d0 0x7f6a7c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 --2- 172.21.15.45:0/496201914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a7c102ab0 0x7f6a7c100710 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:57.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 -- 172.21.15.45:0/496201914 >> 172.21.15.45:0/496201914 conn(0x7f6a7c0fc550 msgr2=0x7f6a7c10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:57.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 -- 172.21.15.45:0/496201914 shutdown_connections 2024-09-18T12:48:57.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:57.222+0000 7f6a840ea640 1 -- 172.21.15.45:0/496201914 wait complete. 2024-09-18T12:48:57.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:57 smithi045 ceph-mon[28315]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:57.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:57 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1020927649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-18T12:48:57.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:57 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/496201914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-18T12:48:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:57 smithi161 ceph-mon[35784]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:57 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1020927649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-18T12:48:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:57 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/496201914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-18T12:48:58.009 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182418 got 107374182420 for osd.3 2024-09-18T12:48:58.009 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:58.409 INFO:tasks.cephadm.ceph_manager.ceph:need seq 64424509465 got 64424509466 for osd.1 2024-09-18T12:48:58.409 DEBUG:teuthology.parallel:result is None 2024-09-18T12:48:58.409 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-18T12:48:58.409 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-18T12:48:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:48:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.117+0000 7f607a563640 1 -- 172.21.15.45:0/2643166058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60741033e0 msgr2=0x7f607410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.117+0000 7f607a563640 1 --2- 172.21.15.45:0/2643166058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60741033e0 0x7f607410b8d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6068009880 tx=0x7f606802a530 comp rx=0 tx=0).stop 2024-09-18T12:48:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.117+0000 7f607a563640 1 -- 172.21.15.45:0/2643166058 shutdown_connections 2024-09-18T12:48:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.117+0000 7f607a563640 1 --2- 172.21.15.45:0/2643166058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60741033e0 0x7f607410b8d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:59.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.117+0000 7f607a563640 1 --2- 172.21.15.45:0/2643166058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6074102ac0 0x7f6074102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:59.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.117+0000 7f607a563640 1 -- 172.21.15.45:0/2643166058 >> 172.21.15.45:0/2643166058 conn(0x7f60740fc520 msgr2=0x7f60740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:59.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.117+0000 7f607a563640 1 -- 172.21.15.45:0/2643166058 shutdown_connections 2024-09-18T12:48:59.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.117+0000 7f607a563640 1 -- 172.21.15.45:0/2643166058 wait complete. 2024-09-18T12:48:59.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.117+0000 7f607a563640 1 Processor -- start 2024-09-18T12:48:59.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.117+0000 7f607a563640 1 -- start start 2024-09-18T12:48:59.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f607a563640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6074102ac0 0x7f607419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:59.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f607a563640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60741033e0 0x7f607419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:59.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f607a563640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f607410ee50 con 0x7f60741033e0 2024-09-18T12:48:59.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f607a563640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f607410ecd0 con 0x7f6074102ac0 2024-09-18T12:48:59.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f60737fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60741033e0 0x7f607419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f60737fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60741033e0 0x7f607419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48224/0 (socket says 172.21.15.45:48224) 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f60737fe640 1 -- 172.21.15.45:0/1772153561 learned_addr learned my addr 172.21.15.45:0/1772153561 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f6073fff640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6074102ac0 0x7f607419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f60737fe640 1 -- 172.21.15.45:0/1772153561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6074102ac0 msgr2=0x7f607419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f60737fe640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6074102ac0 0x7f607419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f60737fe640 1 -- 172.21.15.45:0/1772153561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6074197840 con 0x7f60741033e0 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.118+0000 7f6073fff640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6074102ac0 0x7f607419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.119+0000 7f60737fe640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60741033e0 0x7f607419dc00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6068031460 tx=0x7f60680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.119+0000 7f60717fa640 1 -- 172.21.15.45:0/1772153561 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f606803f070 con 0x7f60741033e0 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.119+0000 7f607a563640 1 -- 172.21.15.45:0/1772153561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6074197ad0 con 0x7f60741033e0 2024-09-18T12:48:59.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.119+0000 7f60717fa640 1 -- 172.21.15.45:0/1772153561 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6068004ac0 con 0x7f60741033e0 2024-09-18T12:48:59.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.119+0000 7f607a563640 1 -- 172.21.15.45:0/1772153561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6074198000 con 0x7f60741033e0 2024-09-18T12:48:59.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.119+0000 7f60717fa640 1 -- 172.21.15.45:0/1772153561 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6068035030 con 0x7f60741033e0 2024-09-18T12:48:59.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.120+0000 7f607a563640 1 -- 172.21.15.45:0/1772153561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f607406aa90 con 0x7f60741033e0 2024-09-18T12:48:59.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.120+0000 7f60717fa640 1 -- 172.21.15.45:0/1772153561 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6068042070 con 0x7f60741033e0 2024-09-18T12:48:59.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.121+0000 7f60717fa640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f605c06e2b0 0x7f605c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:48:59.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.121+0000 7f60717fa640 1 -- 172.21.15.45:0/1772153561 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f60680ae840 con 0x7f60741033e0 2024-09-18T12:48:59.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.121+0000 7f6073fff640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f605c06e2b0 0x7f605c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:48:59.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.121+0000 7f6073fff640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f605c06e2b0 0x7f605c070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6064006fd0 tx=0x7f6064008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:48:59.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.126+0000 7f60717fa640 1 -- 172.21.15.45:0/1772153561 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f606807c4e0 con 0x7f60741033e0 2024-09-18T12:48:59.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.299+0000 7f607a563640 1 -- 172.21.15.45:0/1772153561 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6074198370 con 0x7f605c06e2b0 2024-09-18T12:48:59.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.299+0000 7f60717fa640 1 -- 172.21.15.45:0/1772153561 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f6074198370 con 0x7f605c06e2b0 2024-09-18T12:48:59.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:48:59.301 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-18T12:48:59.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 -- 172.21.15.45:0/1772153561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f605c06e2b0 msgr2=0x7f605c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:59.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f605c06e2b0 0x7f605c070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6064006fd0 tx=0x7f6064008040 comp rx=0 tx=0).stop 2024-09-18T12:48:59.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 -- 172.21.15.45:0/1772153561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60741033e0 msgr2=0x7f607419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:48:59.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60741033e0 0x7f607419dc00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6068031460 tx=0x7f60680046c0 comp rx=0 tx=0).stop 2024-09-18T12:48:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 -- 172.21.15.45:0/1772153561 shutdown_connections 2024-09-18T12:48:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f605c06e2b0 0x7f605c070770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60741033e0 0x7f607419dc00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 --2- 172.21.15.45:0/1772153561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6074102ac0 0x7f607419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:48:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 -- 172.21.15.45:0/1772153561 >> 172.21.15.45:0/1772153561 conn(0x7f60740fc520 msgr2=0x7f6074108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:48:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 -- 172.21.15.45:0/1772153561 shutdown_connections 2024-09-18T12:48:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:48:59.302+0000 7f607a563640 1 -- 172.21.15.45:0/1772153561 wait complete. 2024-09-18T12:48:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:48:59 smithi045 ceph-mon[28315]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:48:59 smithi161 ceph-mon[35784]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:48:59.903 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-18T12:48:58.350406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":199288,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":195318,"kb_avail":562271624,"statfs":{"total":575970213888,"available":575766142976,"internally_reserved":0,"allocated":3919872,"data_stored":2591508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":200006304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002348"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-18T12:48:32.594287+0000","last_change":"2024-09-18T12:48:03.656307+0000","last_active":"2024-09-18T12:48:32.594287+0000","last_peered":"2024-09-18T12:48:32.594287+0000","last_clean":"2024-09-18T12:48:32.594287+0000","last_became_active":"2024-09-18T12:48:03.655917+0000","last_became_peered":"2024-09-18T12:48:03.655917+0000","last_unstale":"2024-09-18T12:48:32.594287+0000","last_undegraded":"2024-09-18T12:48:32.594287+0000","last_fullsized":"2024-09-18T12:48:32.594287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:47:12.465668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:47:12.465668+0000","last_clean_scrub_stamp":"2024-09-18T12:47:12.465668+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:14:31.942039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":136734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920781,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":136734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182420,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":950272,"data_stored":727102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":136734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40440,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704712,"statfs":{"total":95995035648,"available":95953625088,"internally_reserved":0,"allocated":950272,"data_stored":727102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":950272,"data_stored":727102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:48:59.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-18T12:49:00.163 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:00.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:00 smithi045 ceph-mon[28315]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:49:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.623+0000 7f2fd2181640 1 -- 172.21.15.45:0/695374920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fcc102b20 msgr2=0x7f2fcc102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.623+0000 7f2fd2181640 1 --2- 172.21.15.45:0/695374920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fcc102b20 0x7f2fcc102f00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc0098b0 tx=0x7f2fbc02a560 comp rx=0 tx=0).stop 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.623+0000 7f2fd2181640 1 -- 172.21.15.45:0/695374920 shutdown_connections 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.623+0000 7f2fd2181640 1 --2- 172.21.15.45:0/695374920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fcc103440 0x7f2fcc10b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.623+0000 7f2fd2181640 1 --2- 172.21.15.45:0/695374920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fcc102b20 0x7f2fcc102f00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.623+0000 7f2fd2181640 1 -- 172.21.15.45:0/695374920 >> 172.21.15.45:0/695374920 conn(0x7f2fcc0fc520 msgr2=0x7f2fcc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.623+0000 7f2fd2181640 1 -- 172.21.15.45:0/695374920 shutdown_connections 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.623+0000 7f2fd2181640 1 -- 172.21.15.45:0/695374920 wait complete. 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.624+0000 7f2fd2181640 1 Processor -- start 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.624+0000 7f2fd2181640 1 -- start start 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.624+0000 7f2fd2181640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fcc102b20 0x7f2fcc100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.624+0000 7f2fd2181640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fcc103440 0x7f2fcc100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.624+0000 7f2fd2181640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc10ee50 con 0x7f2fcc102b20 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.624+0000 7f2fd2181640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc10ecd0 con 0x7f2fcc103440 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.624+0000 7f2fcb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fcc102b20 0x7f2fcc100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.624+0000 7f2fcb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fcc102b20 0x7f2fcc100780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48240/0 (socket says 172.21.15.45:48240) 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.624+0000 7f2fcb7fe640 1 -- 172.21.15.45:0/3352954154 learned_addr learned my addr 172.21.15.45:0/3352954154 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.625+0000 7f2fc2ffd640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fcc103440 0x7f2fcc100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.625+0000 7f2fcb7fe640 1 -- 172.21.15.45:0/3352954154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fcc103440 msgr2=0x7f2fcc100cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.625+0000 7f2fcb7fe640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fcc103440 0x7f2fcc100cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.625+0000 7f2fcb7fe640 1 -- 172.21.15.45:0/3352954154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc101200 con 0x7f2fcc102b20 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.625+0000 7f2fcb7fe640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fcc102b20 0x7f2fcc100780 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009230 tx=0x7f2fbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.625+0000 7f2fc97fa640 1 -- 172.21.15.45:0/3352954154 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fbc03f070 con 0x7f2fcc102b20 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.625+0000 7f2fc97fa640 1 -- 172.21.15.45:0/3352954154 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fbc004ac0 con 0x7f2fcc102b20 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.625+0000 7f2fd2181640 1 -- 172.21.15.45:0/3352954154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fcc101490 con 0x7f2fcc102b20 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.625+0000 7f2fc97fa640 1 -- 172.21.15.45:0/3352954154 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fbc035030 con 0x7f2fcc102b20 2024-09-18T12:49:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.625+0000 7f2fd2181640 1 -- 172.21.15.45:0/3352954154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fcc1a3e60 con 0x7f2fcc102b20 2024-09-18T12:49:00.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.626+0000 7f2fd2181640 1 -- 172.21.15.45:0/3352954154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fcc06aa30 con 0x7f2fcc102b20 2024-09-18T12:49:00.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.627+0000 7f2fc97fa640 1 -- 172.21.15.45:0/3352954154 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2fbc042070 con 0x7f2fcc102b20 2024-09-18T12:49:00.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.627+0000 7f2fc97fa640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2fb806e300 0x7f2fb80707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:00.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.627+0000 7f2fc97fa640 1 -- 172.21.15.45:0/3352954154 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f2fbc0ae970 con 0x7f2fcc102b20 2024-09-18T12:49:00.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.627+0000 7f2fc2ffd640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2fb806e300 0x7f2fb80707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:00.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.628+0000 7f2fc2ffd640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2fb806e300 0x7f2fb80707c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc102210 tx=0x7f2fb4008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:00.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.632+0000 7f2fc97fa640 1 -- 172.21.15.45:0/3352954154 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2fbc0b0e20 con 0x7f2fcc102b20 2024-09-18T12:49:00.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:00 smithi161 ceph-mon[35784]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:49:00.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.803+0000 7f2fd2181640 1 -- 172.21.15.45:0/3352954154 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fcc062630 con 0x7f2fb806e300 2024-09-18T12:49:00.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.804+0000 7f2fc97fa640 1 -- 172.21.15.45:0/3352954154 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f2fcc062630 con 0x7f2fb806e300 2024-09-18T12:49:00.806 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:49:00.806 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-18T12:49:00.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 -- 172.21.15.45:0/3352954154 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2fb806e300 msgr2=0x7f2fb80707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:00.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2fb806e300 0x7f2fb80707c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc102210 tx=0x7f2fb4008040 comp rx=0 tx=0).stop 2024-09-18T12:49:00.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 -- 172.21.15.45:0/3352954154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fcc102b20 msgr2=0x7f2fcc100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fcc102b20 0x7f2fcc100780 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009230 tx=0x7f2fbc0046c0 comp rx=0 tx=0).stop 2024-09-18T12:49:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 -- 172.21.15.45:0/3352954154 shutdown_connections 2024-09-18T12:49:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2fb806e300 0x7f2fb80707c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fcc103440 0x7f2fcc100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 --2- 172.21.15.45:0/3352954154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fcc102b20 0x7f2fcc100780 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 -- 172.21.15.45:0/3352954154 >> 172.21.15.45:0/3352954154 conn(0x7f2fcc0fc520 msgr2=0x7f2fcc108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 -- 172.21.15.45:0/3352954154 shutdown_connections 2024-09-18T12:49:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:00.807+0000 7f2fd2181640 1 -- 172.21.15.45:0/3352954154 wait complete. 2024-09-18T12:49:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:01 smithi045 ceph-mon[28315]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:01.666 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-18T12:49:00.350925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":199288,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":195318,"kb_avail":562271624,"statfs":{"total":575970213888,"available":575766142976,"internally_reserved":0,"allocated":3919872,"data_stored":2591508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":200006304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002346"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-18T12:48:32.594287+0000","last_change":"2024-09-18T12:48:03.656307+0000","last_active":"2024-09-18T12:48:32.594287+0000","last_peered":"2024-09-18T12:48:32.594287+0000","last_clean":"2024-09-18T12:48:32.594287+0000","last_became_active":"2024-09-18T12:48:03.655917+0000","last_became_peered":"2024-09-18T12:48:03.655917+0000","last_unstale":"2024-09-18T12:48:32.594287+0000","last_undegraded":"2024-09-18T12:48:32.594287+0000","last_fullsized":"2024-09-18T12:48:32.594287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:47:12.465668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:47:12.465668+0000","last_clean_scrub_stamp":"2024-09-18T12:47:12.465668+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:14:31.942039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":136734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":136734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182420,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":950272,"data_stored":727102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":136734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40440,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704712,"statfs":{"total":95995035648,"available":95953625088,"internally_reserved":0,"allocated":950272,"data_stored":727102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":950272,"data_stored":727102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:49:01.666 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-18T12:49:01.667 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T12:49:01.667 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-18T12:49:01.667 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-18T12:49:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:01 smithi161 ceph-mon[35784]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:01.928 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.359+0000 7f79c7d77640 1 -- 172.21.15.45:0/3834004909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79c01067f0 msgr2=0x7f79c0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.359+0000 7f79c7d77640 1 --2- 172.21.15.45:0/3834004909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79c01067f0 0x7f79c0106bd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009c20 tx=0x7f79b002a970 comp rx=0 tx=0).stop 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.359+0000 7f79c7d77640 1 -- 172.21.15.45:0/3834004909 shutdown_connections 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.359+0000 7f79c7d77640 1 --2- 172.21.15.45:0/3834004909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c01007f0 0x7f79c0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.359+0000 7f79c7d77640 1 --2- 172.21.15.45:0/3834004909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79c01067f0 0x7f79c0106bd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.359+0000 7f79c7d77640 1 -- 172.21.15.45:0/3834004909 >> 172.21.15.45:0/3834004909 conn(0x7f79c00fc550 msgr2=0x7f79c00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.359+0000 7f79c7d77640 1 -- 172.21.15.45:0/3834004909 shutdown_connections 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.359+0000 7f79c7d77640 1 -- 172.21.15.45:0/3834004909 wait complete. 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c7d77640 1 Processor -- start 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c7d77640 1 -- start start 2024-09-18T12:49:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c7d77640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c01007f0 0x7f79c019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c7d77640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79c01067f0 0x7f79c019dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c7d77640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f79c010ee30 con 0x7f79c01067f0 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c7d77640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f79c010ecb0 con 0x7f79c01007f0 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c5312640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79c01067f0 0x7f79c019dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c5312640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79c01067f0 0x7f79c019dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48264/0 (socket says 172.21.15.45:48264) 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c5312640 1 -- 172.21.15.45:0/3306830110 learned_addr learned my addr 172.21.15.45:0/3306830110 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c5b13640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c01007f0 0x7f79c019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c5312640 1 -- 172.21.15.45:0/3306830110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c01007f0 msgr2=0x7f79c019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c5312640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c01007f0 0x7f79c019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.360+0000 7f79c5312640 1 -- 172.21.15.45:0/3306830110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c01978a0 con 0x7f79c01067f0 2024-09-18T12:49:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.361+0000 7f79c5312640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79c01067f0 0x7f79c019dc20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f79b400b420 tx=0x7f79b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:02.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.361+0000 7f79beffd640 1 -- 172.21.15.45:0/3306830110 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79b4011630 con 0x7f79c01067f0 2024-09-18T12:49:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.361+0000 7f79beffd640 1 -- 172.21.15.45:0/3306830110 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79b4016070 con 0x7f79c01067f0 2024-09-18T12:49:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.361+0000 7f79c7d77640 1 -- 172.21.15.45:0/3306830110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c0197b90 con 0x7f79c01067f0 2024-09-18T12:49:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.361+0000 7f79beffd640 1 -- 172.21.15.45:0/3306830110 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79b4010d40 con 0x7f79c01067f0 2024-09-18T12:49:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.361+0000 7f79c7d77640 1 -- 172.21.15.45:0/3306830110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c0198120 con 0x7f79c01067f0 2024-09-18T12:49:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.362+0000 7f79c7d77640 1 -- 172.21.15.45:0/3306830110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c0101f30 con 0x7f79c01067f0 2024-09-18T12:49:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.362+0000 7f79beffd640 1 -- 172.21.15.45:0/3306830110 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f79b401b460 con 0x7f79c01067f0 2024-09-18T12:49:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.363+0000 7f79beffd640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f79a806e310 0x7f79a80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.363+0000 7f79beffd640 1 -- 172.21.15.45:0/3306830110 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f79b408d5f0 con 0x7f79c01067f0 2024-09-18T12:49:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.363+0000 7f79c5b13640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f79a806e310 0x7f79a80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.363+0000 7f79c5b13640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f79a806e310 0x7f79a80707d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009430 tx=0x7f79b00093c0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:02.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.367+0000 7f79beffd640 1 -- 172.21.15.45:0/3306830110 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79b405b310 con 0x7f79c01067f0 2024-09-18T12:49:02.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.584+0000 7f79c7d77640 1 -- 172.21.15.45:0/3306830110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f79c0198dd0 con 0x7f79c01067f0 2024-09-18T12:49:02.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.584+0000 7f79beffd640 1 -- 172.21.15.45:0/3306830110 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f79b405efc0 con 0x7f79c01067f0 2024-09-18T12:49:02.586 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:49:02.586 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T12:49:02.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.586+0000 7f79c7d77640 1 -- 172.21.15.45:0/3306830110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f79a806e310 msgr2=0x7f79a80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:02.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.587+0000 7f79c7d77640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f79a806e310 0x7f79a80707d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009430 tx=0x7f79b00093c0 comp rx=0 tx=0).stop 2024-09-18T12:49:02.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.587+0000 7f79c7d77640 1 -- 172.21.15.45:0/3306830110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79c01067f0 msgr2=0x7f79c019dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:02.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.587+0000 7f79c7d77640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79c01067f0 0x7f79c019dc20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f79b400b420 tx=0x7f79b400b8e0 comp rx=0 tx=0).stop 2024-09-18T12:49:02.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.587+0000 7f79c7d77640 1 -- 172.21.15.45:0/3306830110 shutdown_connections 2024-09-18T12:49:02.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.587+0000 7f79c7d77640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f79a806e310 0x7f79a80707d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:02.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.587+0000 7f79c7d77640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79c01067f0 0x7f79c019dc20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:02.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.587+0000 7f79c7d77640 1 --2- 172.21.15.45:0/3306830110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c01007f0 0x7f79c019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:02.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.587+0000 7f79c7d77640 1 -- 172.21.15.45:0/3306830110 >> 172.21.15.45:0/3306830110 conn(0x7f79c00fc550 msgr2=0x7f79c00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:02.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.587+0000 7f79c7d77640 1 -- 172.21.15.45:0/3306830110 shutdown_connections 2024-09-18T12:49:02.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:02.587+0000 7f79c7d77640 1 -- 172.21.15.45:0/3306830110 wait complete. 2024-09-18T12:49:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:02 smithi045 ceph-mon[28315]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:49:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:02 smithi161 ceph-mon[35784]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T12:49:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:03.343 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-18T12:49:03.343 INFO:tasks.cephadm:Setup complete, yielding 2024-09-18T12:49:03.344 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:49:03.353 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-18T12:49:03.353 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:49:03.392 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:49:03.392 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-18T12:49:03.656 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:03.772 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:03 smithi045 ceph-mon[28315]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:03.772 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:03 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3306830110' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-18T12:49:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:03 smithi161 ceph-mon[35784]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:03 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3306830110' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-18T12:49:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.093+0000 7f8a97ae4640 1 -- 172.21.15.45:0/1748548231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a90100b20 msgr2=0x7f8a90100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.093+0000 7f8a97ae4640 1 --2- 172.21.15.45:0/1748548231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a90100b20 0x7f8a90100f80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009880 tx=0x7f8a8402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.093+0000 7f8a97ae4640 1 -- 172.21.15.45:0/1748548231 shutdown_connections 2024-09-18T12:49:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.093+0000 7f8a97ae4640 1 --2- 172.21.15.45:0/1748548231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a90100b20 0x7f8a90100f80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.093+0000 7f8a97ae4640 1 --2- 172.21.15.45:0/1748548231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a901001e0 0x7f8a901005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.093+0000 7f8a97ae4640 1 -- 172.21.15.45:0/1748548231 >> 172.21.15.45:0/1748548231 conn(0x7f8a900fc010 msgr2=0x7f8a900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.093+0000 7f8a97ae4640 1 -- 172.21.15.45:0/1748548231 shutdown_connections 2024-09-18T12:49:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.093+0000 7f8a97ae4640 1 -- 172.21.15.45:0/1748548231 wait complete. 2024-09-18T12:49:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.094+0000 7f8a97ae4640 1 Processor -- start 2024-09-18T12:49:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.094+0000 7f8a97ae4640 1 -- start start 2024-09-18T12:49:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.094+0000 7f8a97ae4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a901001e0 0x7f8a901996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.094+0000 7f8a97ae4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a90100b20 0x7f8a90199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.094+0000 7f8a97ae4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9010c990 con 0x7f8a90100b20 2024-09-18T12:49:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.094+0000 7f8a97ae4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9010c810 con 0x7f8a901001e0 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a9507f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a90100b20 0x7f8a90199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a9507f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a90100b20 0x7f8a90199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49786/0 (socket says 172.21.15.45:49786) 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a9507f640 1 -- 172.21.15.45:0/4133215507 learned_addr learned my addr 172.21.15.45:0/4133215507 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a95880640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a901001e0 0x7f8a901996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a9507f640 1 -- 172.21.15.45:0/4133215507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a901001e0 msgr2=0x7f8a901996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a9507f640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a901001e0 0x7f8a901996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a9507f640 1 -- 172.21.15.45:0/4133215507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9019a260 con 0x7f8a90100b20 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a9507f640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a90100b20 0x7f8a90199be0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006010 tx=0x7f8a840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a8effd640 1 -- 172.21.15.45:0/4133215507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a8403f070 con 0x7f8a90100b20 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a97ae4640 1 -- 172.21.15.45:0/4133215507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9019ec40 con 0x7f8a90100b20 2024-09-18T12:49:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a8effd640 1 -- 172.21.15.45:0/4133215507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a84004ac0 con 0x7f8a90100b20 2024-09-18T12:49:04.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a8effd640 1 -- 172.21.15.45:0/4133215507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a84035030 con 0x7f8a90100b20 2024-09-18T12:49:04.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.095+0000 7f8a97ae4640 1 -- 172.21.15.45:0/4133215507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9019f180 con 0x7f8a90100b20 2024-09-18T12:49:04.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.096+0000 7f8a97ae4640 1 -- 172.21.15.45:0/4133215507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a901005e0 con 0x7f8a90100b20 2024-09-18T12:49:04.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.097+0000 7f8a8effd640 1 -- 172.21.15.45:0/4133215507 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8a84042070 con 0x7f8a90100b20 2024-09-18T12:49:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.097+0000 7f8a8effd640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8a7806e2b0 0x7f8a78070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.097+0000 7f8a8effd640 1 -- 172.21.15.45:0/4133215507 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f8a840aea80 con 0x7f8a90100b20 2024-09-18T12:49:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.097+0000 7f8a95880640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8a7806e2b0 0x7f8a78070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.098+0000 7f8a95880640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8a7806e2b0 0x7f8a78070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a80005fd0 tx=0x7f8a8000b390 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.102+0000 7f8a8effd640 1 -- 172.21.15.45:0/4133215507 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a84080330 con 0x7f8a90100b20 2024-09-18T12:49:04.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.276+0000 7f8a97ae4640 1 -- 172.21.15.45:0/4133215507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7f8a90062fb0 con 0x7f8a90100b20 2024-09-18T12:49:04.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.279+0000 7f8a8effd640 1 -- 172.21.15.45:0/4133215507 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v42)=0 v42) ==== 143+0+0 (secure 0 0 0) 0x7f8a84084b60 con 0x7f8a90100b20 2024-09-18T12:49:04.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 -- 172.21.15.45:0/4133215507 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8a7806e2b0 msgr2=0x7f8a78070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:04.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8a7806e2b0 0x7f8a78070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a80005fd0 tx=0x7f8a8000b390 comp rx=0 tx=0).stop 2024-09-18T12:49:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 -- 172.21.15.45:0/4133215507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a90100b20 msgr2=0x7f8a90199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a90100b20 0x7f8a90199be0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006010 tx=0x7f8a840046c0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 -- 172.21.15.45:0/4133215507 shutdown_connections 2024-09-18T12:49:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8a7806e2b0 0x7f8a78070770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a90100b20 0x7f8a90199be0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 --2- 172.21.15.45:0/4133215507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a901001e0 0x7f8a901996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 -- 172.21.15.45:0/4133215507 >> 172.21.15.45:0/4133215507 conn(0x7f8a900fc010 msgr2=0x7f8a90108a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 -- 172.21.15.45:0/4133215507 shutdown_connections 2024-09-18T12:49:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:04.282+0000 7f8a97ae4640 1 -- 172.21.15.45:0/4133215507 wait complete. 2024-09-18T12:49:04.928 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:49:04.937 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-18T12:49:04.937 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:49:04.974 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:49:04.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-18T12:49:05.230 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:05.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:05 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/4133215507' entity='client.admin' 2024-09-18T12:49:05.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:05.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:05.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:05.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:05 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:05.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:05 smithi045 ceph-mon[28315]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:05.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:05 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/4133215507' entity='client.admin' 2024-09-18T12:49:05.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:05.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:05.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:05.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:05 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:05.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:05 smithi161 ceph-mon[35784]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:05.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.708+0000 7f7a57f29640 1 -- 172.21.15.45:0/3063652453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a50101a60 msgr2=0x7f7a50101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:05.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.708+0000 7f7a57f29640 1 --2- 172.21.15.45:0/3063652453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a50101a60 0x7f7a50101ee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009880 tx=0x7f7a4002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.709+0000 7f7a57f29640 1 -- 172.21.15.45:0/3063652453 shutdown_connections 2024-09-18T12:49:05.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.709+0000 7f7a57f29640 1 --2- 172.21.15.45:0/3063652453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a50101a60 0x7f7a50101ee0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.709+0000 7f7a57f29640 1 --2- 172.21.15.45:0/3063652453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a50100860 0x7f7a50100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.709+0000 7f7a57f29640 1 -- 172.21.15.45:0/3063652453 >> 172.21.15.45:0/3063652453 conn(0x7f7a500fc010 msgr2=0x7f7a500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:05.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.709+0000 7f7a57f29640 1 -- 172.21.15.45:0/3063652453 shutdown_connections 2024-09-18T12:49:05.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.709+0000 7f7a57f29640 1 -- 172.21.15.45:0/3063652453 wait complete. 2024-09-18T12:49:05.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.709+0000 7f7a57f29640 1 Processor -- start 2024-09-18T12:49:05.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.709+0000 7f7a57f29640 1 -- start start 2024-09-18T12:49:05.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a57f29640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a50100860 0x7f7a50104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:05.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a57f29640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a50101a60 0x7f7a50102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:05.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a57f29640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501096a0 con 0x7f7a50101a60 2024-09-18T12:49:05.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a57f29640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50109520 con 0x7f7a50100860 2024-09-18T12:49:05.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a554c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a50101a60 0x7f7a50102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:05.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a554c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a50101a60 0x7f7a50102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49800/0 (socket says 172.21.15.45:49800) 2024-09-18T12:49:05.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a554c4640 1 -- 172.21.15.45:0/3384118392 learned_addr learned my addr 172.21.15.45:0/3384118392 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:05.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a55cc5640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a50100860 0x7f7a50104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a554c4640 1 -- 172.21.15.45:0/3384118392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a50100860 msgr2=0x7f7a50104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a554c4640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a50100860 0x7f7a50104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a554c4640 1 -- 172.21.15.45:0/3384118392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a50103380 con 0x7f7a50101a60 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a55cc5640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a50100860 0x7f7a50104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a554c4640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a50101a60 0x7f7a50102e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7a40006010 tx=0x7f7a400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a46ffd640 1 -- 172.21.15.45:0/3384118392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a4003f070 con 0x7f7a50101a60 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a46ffd640 1 -- 172.21.15.45:0/3384118392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a40004ac0 con 0x7f7a50101a60 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a57f29640 1 -- 172.21.15.45:0/3384118392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a50103610 con 0x7f7a50101a60 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.710+0000 7f7a46ffd640 1 -- 172.21.15.45:0/3384118392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a40035030 con 0x7f7a50101a60 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.711+0000 7f7a57f29640 1 -- 172.21.15.45:0/3384118392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a50103b40 con 0x7f7a50101a60 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.712+0000 7f7a57f29640 1 -- 172.21.15.45:0/3384118392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a50100c60 con 0x7f7a50101a60 2024-09-18T12:49:05.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.712+0000 7f7a46ffd640 1 -- 172.21.15.45:0/3384118392 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7a40042070 con 0x7f7a50101a60 2024-09-18T12:49:05.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.712+0000 7f7a46ffd640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7a3c06e2b0 0x7f7a3c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:05.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.713+0000 7f7a46ffd640 1 -- 172.21.15.45:0/3384118392 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f7a400aea90 con 0x7f7a50101a60 2024-09-18T12:49:05.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.713+0000 7f7a55cc5640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7a3c06e2b0 0x7f7a3c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:05.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.713+0000 7f7a55cc5640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7a3c06e2b0 0x7f7a3c070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7a501018c0 tx=0x7f7a4c005e70 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:05.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.717+0000 7f7a46ffd640 1 -- 172.21.15.45:0/3384118392 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a4007c730 con 0x7f7a50101a60 2024-09-18T12:49:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.906+0000 7f7a57f29640 1 -- 172.21.15.45:0/3384118392 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f7a5006a970 con 0x7f7a3c06e2b0 2024-09-18T12:49:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.908+0000 7f7a46ffd640 1 -- 172.21.15.45:0/3384118392 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f7a5006a970 con 0x7f7a3c06e2b0 2024-09-18T12:49:05.909 INFO:teuthology.orchestra.run.smithi045.stdout:Backend: cephadm 2024-09-18T12:49:05.909 INFO:teuthology.orchestra.run.smithi045.stdout:Available: Yes 2024-09-18T12:49:05.909 INFO:teuthology.orchestra.run.smithi045.stdout:Paused: No 2024-09-18T12:49:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 -- 172.21.15.45:0/3384118392 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7a3c06e2b0 msgr2=0x7f7a3c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7a3c06e2b0 0x7f7a3c070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7a501018c0 tx=0x7f7a4c005e70 comp rx=0 tx=0).stop 2024-09-18T12:49:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 -- 172.21.15.45:0/3384118392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a50101a60 msgr2=0x7f7a50102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a50101a60 0x7f7a50102e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7a40006010 tx=0x7f7a400046c0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 -- 172.21.15.45:0/3384118392 shutdown_connections 2024-09-18T12:49:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7a3c06e2b0 0x7f7a3c070770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a50101a60 0x7f7a50102e40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 --2- 172.21.15.45:0/3384118392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a50100860 0x7f7a50104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 -- 172.21.15.45:0/3384118392 >> 172.21.15.45:0/3384118392 conn(0x7f7a500fc010 msgr2=0x7f7a5006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 -- 172.21.15.45:0/3384118392 shutdown_connections 2024-09-18T12:49:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:05.910+0000 7f7a57f29640 1 -- 172.21.15.45:0/3384118392 wait complete. 2024-09-18T12:49:06.533 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-18T12:49:06.788 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.257+0000 7f47d1786640 1 -- 172.21.15.45:0/148144328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47cc101960 msgr2=0x7f47cc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.257+0000 7f47d1786640 1 --2- 172.21.15.45:0/148144328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47cc101960 0x7f47cc101d60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009880 tx=0x7f47c402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.257+0000 7f47d1786640 1 -- 172.21.15.45:0/148144328 shutdown_connections 2024-09-18T12:49:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.257+0000 7f47d1786640 1 --2- 172.21.15.45:0/148144328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47cc102b60 0x7f47cc102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.257+0000 7f47d1786640 1 --2- 172.21.15.45:0/148144328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47cc101960 0x7f47cc101d60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.257+0000 7f47d1786640 1 -- 172.21.15.45:0/148144328 >> 172.21.15.45:0/148144328 conn(0x7f47cc0fd0f0 msgr2=0x7f47cc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.257+0000 7f47d1786640 1 -- 172.21.15.45:0/148144328 shutdown_connections 2024-09-18T12:49:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.258+0000 7f47d1786640 1 -- 172.21.15.45:0/148144328 wait complete. 2024-09-18T12:49:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.258+0000 7f47d1786640 1 Processor -- start 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.258+0000 7f47d1786640 1 -- start start 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.258+0000 7f47d1786640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47cc101960 0x7f47cc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47d1786640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47cc102b60 0x7f47cc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47d1786640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc10a780 con 0x7f47cc102b60 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47d1786640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc10a600 con 0x7f47cc101960 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47ca7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47cc102b60 0x7f47cc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47ca7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47cc102b60 0x7f47cc0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49824/0 (socket says 172.21.15.45:49824) 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47ca7fc640 1 -- 172.21.15.45:0/239084032 learned_addr learned my addr 172.21.15.45:0/239084032 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47caffd640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47cc101960 0x7f47cc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47ca7fc640 1 -- 172.21.15.45:0/239084032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47cc101960 msgr2=0x7f47cc075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47ca7fc640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47cc101960 0x7f47cc075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47ca7fc640 1 -- 172.21.15.45:0/239084032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc074b20 con 0x7f47cc102b60 2024-09-18T12:49:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47ca7fc640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47cc102b60 0x7f47cc0745e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f47b400d8d0 tx=0x7f47b400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47c3fff640 1 -- 172.21.15.45:0/239084032 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47b4017030 con 0x7f47cc102b60 2024-09-18T12:49:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47c3fff640 1 -- 172.21.15.45:0/239084032 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47b4004020 con 0x7f47cc102b60 2024-09-18T12:49:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47d1786640 1 -- 172.21.15.45:0/239084032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47cc074e10 con 0x7f47cc102b60 2024-09-18T12:49:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47c3fff640 1 -- 172.21.15.45:0/239084032 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47b40047a0 con 0x7f47cc102b60 2024-09-18T12:49:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.259+0000 7f47d1786640 1 -- 172.21.15.45:0/239084032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47cc0753a0 con 0x7f47cc102b60 2024-09-18T12:49:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.260+0000 7f47d1786640 1 -- 172.21.15.45:0/239084032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47cc101d60 con 0x7f47cc102b60 2024-09-18T12:49:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.261+0000 7f47c3fff640 1 -- 172.21.15.45:0/239084032 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f47b40041d0 con 0x7f47cc102b60 2024-09-18T12:49:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.261+0000 7f47c3fff640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f47b806e2b0 0x7f47b8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.262+0000 7f47c3fff640 1 -- 172.21.15.45:0/239084032 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f47b4018070 con 0x7f47cc102b60 2024-09-18T12:49:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.262+0000 7f47caffd640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f47b806e2b0 0x7f47b8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.262+0000 7f47caffd640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f47b806e2b0 0x7f47b8070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47c402a9c0 tx=0x7f47c4000bc0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:07.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.266+0000 7f47c3fff640 1 -- 172.21.15.45:0/239084032 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47b405b960 con 0x7f47cc102b60 2024-09-18T12:49:07.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.449+0000 7f47d1786640 1 -- 172.21.15.45:0/239084032 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f47cc062630 con 0x7f47b806e2b0 2024-09-18T12:49:07.450 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:07 smithi045 ceph-mon[28315]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:07.450 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:07 smithi045 ceph-mon[28315]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:07.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.457+0000 7f47c3fff640 1 -- 172.21.15.45:0/239084032 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7f47cc062630 con 0x7f47b806e2b0 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (3m) 117s ago 5m 27.6M - 0.25.0 c8568f914cd2 de7ae4bc8025 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (5m) 117s ago 5m 7541k - 19.1.1-330-gc2ddf972 ebb0615149de 147094edb221 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (4m) 41s ago 4m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de a49472bef49e 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (5m) 117s ago 5m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (4m) 41s ago 4m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (3m) 117s ago 4m 76.5M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:9283,8765,8443 running (6m) 117s ago 6m 490M - 19.1.1-330-gc2ddf972 ebb0615149de 84d721f8241b 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (4m) 41s ago 4m 440M - 19.1.1-330-gc2ddf972 ebb0615149de 0a67817738af 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (6m) 117s ago 6m 45.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (4m) 41s ago 4m 40.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:49:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (5m) 117s ago 5m 16.3M - 1.5.0 0da6a335fe13 39666fd05306 2024-09-18T12:49:07.460 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (4m) 41s ago 4m 16.3M - 1.5.0 0da6a335fe13 ed4fe4d74f39 2024-09-18T12:49:07.460 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (3m) 117s ago 3m 44.9M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:49:07.460 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (2m) 117s ago 2m 45.7M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:49:07.460 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (2m) 117s ago 2m 14.3M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:49:07.460 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (101s) 41s ago 100s 40.5M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:49:07.460 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (72s) 41s ago 72s 45.1M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:49:07.460 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (46s) 41s ago 45s 14.4M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:49:07.460 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (3m) 117s ago 4m 42.9M - 2.43.0 a07b618ecd1d 411e86f6fecd 2024-09-18T12:49:07.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.459+0000 7f47d1786640 1 -- 172.21.15.45:0/239084032 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f47b806e2b0 msgr2=0x7f47b8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:07.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.459+0000 7f47d1786640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f47b806e2b0 0x7f47b8070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47c402a9c0 tx=0x7f47c4000bc0 comp rx=0 tx=0).stop 2024-09-18T12:49:07.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.460+0000 7f47d1786640 1 -- 172.21.15.45:0/239084032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47cc102b60 msgr2=0x7f47cc0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:07.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.460+0000 7f47d1786640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47cc102b60 0x7f47cc0745e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f47b400d8d0 tx=0x7f47b400dd90 comp rx=0 tx=0).stop 2024-09-18T12:49:07.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.460+0000 7f47d1786640 1 -- 172.21.15.45:0/239084032 shutdown_connections 2024-09-18T12:49:07.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.460+0000 7f47d1786640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f47b806e2b0 0x7f47b8070770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:07.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.460+0000 7f47d1786640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47cc102b60 0x7f47cc0745e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:07.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.460+0000 7f47d1786640 1 --2- 172.21.15.45:0/239084032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47cc101960 0x7f47cc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:07.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.460+0000 7f47d1786640 1 -- 172.21.15.45:0/239084032 >> 172.21.15.45:0/239084032 conn(0x7f47cc0fd0f0 msgr2=0x7f47cc105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:07.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.460+0000 7f47d1786640 1 -- 172.21.15.45:0/239084032 shutdown_connections 2024-09-18T12:49:07.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:07.460+0000 7f47d1786640 1 -- 172.21.15.45:0/239084032 wait complete. 2024-09-18T12:49:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:07 smithi161 ceph-mon[35784]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:07 smithi161 ceph-mon[35784]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:08.135 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-18T12:49:08.392 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:08.675 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:08 smithi045 ceph-mon[28315]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:08 smithi161 ceph-mon[35784]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:08.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.839+0000 7efdb1e44640 1 -- 172.21.15.45:0/1635032169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac101a60 msgr2=0x7efdac101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.839+0000 7efdb1e44640 1 --2- 172.21.15.45:0/1635032169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac101a60 0x7efdac101ee0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efda0009880 tx=0x7efda002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.839+0000 7efdb1e44640 1 -- 172.21.15.45:0/1635032169 shutdown_connections 2024-09-18T12:49:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.839+0000 7efdb1e44640 1 --2- 172.21.15.45:0/1635032169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac101a60 0x7efdac101ee0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.839+0000 7efdb1e44640 1 --2- 172.21.15.45:0/1635032169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdac100860 0x7efdac100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.839+0000 7efdb1e44640 1 -- 172.21.15.45:0/1635032169 >> 172.21.15.45:0/1635032169 conn(0x7efdac0fc010 msgr2=0x7efdac0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.839+0000 7efdb1e44640 1 -- 172.21.15.45:0/1635032169 shutdown_connections 2024-09-18T12:49:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.839+0000 7efdb1e44640 1 -- 172.21.15.45:0/1635032169 wait complete. 2024-09-18T12:49:08.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.839+0000 7efdb1e44640 1 Processor -- start 2024-09-18T12:49:08.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdb1e44640 1 -- start start 2024-09-18T12:49:08.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdb1e44640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdac100860 0x7efdac197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:08.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdb1e44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac101a60 0x7efdac197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:08.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdb1e44640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efdac06aa80 con 0x7efdac101a60 2024-09-18T12:49:08.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdb1e44640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7efdac06a900 con 0x7efdac100860 2024-09-18T12:49:08.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdaaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac101a60 0x7efdac197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:08.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdaaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac101a60 0x7efdac197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49834/0 (socket says 172.21.15.45:49834) 2024-09-18T12:49:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdaaffd640 1 -- 172.21.15.45:0/2840813965 learned_addr learned my addr 172.21.15.45:0/2840813965 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdab7fe640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdac100860 0x7efdac197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdaaffd640 1 -- 172.21.15.45:0/2840813965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdac100860 msgr2=0x7efdac197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdaaffd640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdac100860 0x7efdac197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdaaffd640 1 -- 172.21.15.45:0/2840813965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdac198120 con 0x7efdac101a60 2024-09-18T12:49:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdab7fe640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdac100860 0x7efdac197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:49:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.840+0000 7efdaaffd640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac101a60 0x7efdac197aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efda0006010 tx=0x7efda00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.841+0000 7efda8ff9640 1 -- 172.21.15.45:0/2840813965 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efda003f070 con 0x7efdac101a60 2024-09-18T12:49:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.841+0000 7efda8ff9640 1 -- 172.21.15.45:0/2840813965 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efda00044d0 con 0x7efdac101a60 2024-09-18T12:49:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.841+0000 7efdb1e44640 1 -- 172.21.15.45:0/2840813965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdac19cb00 con 0x7efdac101a60 2024-09-18T12:49:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.841+0000 7efda8ff9640 1 -- 172.21.15.45:0/2840813965 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efda0035030 con 0x7efdac101a60 2024-09-18T12:49:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.841+0000 7efdb1e44640 1 -- 172.21.15.45:0/2840813965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdac19d110 con 0x7efdac101a60 2024-09-18T12:49:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.842+0000 7efdb1e44640 1 -- 172.21.15.45:0/2840813965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdac100c40 con 0x7efdac101a60 2024-09-18T12:49:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.842+0000 7efda8ff9640 1 -- 172.21.15.45:0/2840813965 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7efda0042070 con 0x7efdac101a60 2024-09-18T12:49:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.843+0000 7efda8ff9640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7efd9406e310 0x7efd940707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.843+0000 7efda8ff9640 1 -- 172.21.15.45:0/2840813965 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7efda00aeab0 con 0x7efdac101a60 2024-09-18T12:49:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.843+0000 7efdab7fe640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7efd9406e310 0x7efd940707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.843+0000 7efdab7fe640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7efd9406e310 0x7efd940707d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd9c006fd0 tx=0x7efd9c008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:08.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:08.847+0000 7efda8ff9640 1 -- 172.21.15.45:0/2840813965 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efda007c7d0 con 0x7efdac101a60 2024-09-18T12:49:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.030+0000 7efdb1e44640 1 -- 172.21.15.45:0/2840813965 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7efdac062630 con 0x7efd9406e310 2024-09-18T12:49:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.036+0000 7efda8ff9640 1 -- 172.21.15.45:0/2840813965 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1300 (secure 0 0 0) 0x7efdac062630 con 0x7efd9406e310 2024-09-18T12:49:09.037 INFO:teuthology.orchestra.run.smithi045.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-18T12:49:09.037 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager ?:9093,9094 1/1 119s ago 5m count:1 2024-09-18T12:49:09.037 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter 2/2 119s ago 5m * 2024-09-18T12:49:09.037 INFO:teuthology.orchestra.run.smithi045.stdout:crash 2/2 119s ago 5m * 2024-09-18T12:49:09.037 INFO:teuthology.orchestra.run.smithi045.stdout:grafana ?:3000 1/1 119s ago 5m count:1 2024-09-18T12:49:09.037 INFO:teuthology.orchestra.run.smithi045.stdout:mgr 2/2 119s ago 5m count:2 2024-09-18T12:49:09.038 INFO:teuthology.orchestra.run.smithi045.stdout:mon 2/2 119s ago 5m smithi045:172.21.15.45=smithi045;smithi161:172.21.15.161=smithi161;count:2 2024-09-18T12:49:09.038 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter ?:9100 2/2 119s ago 5m * 2024-09-18T12:49:09.038 INFO:teuthology.orchestra.run.smithi045.stdout:osd 6 119s ago - 2024-09-18T12:49:09.038 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus ?:9095 1/1 119s ago 5m count:1 2024-09-18T12:49:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 -- 172.21.15.45:0/2840813965 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7efd9406e310 msgr2=0x7efd940707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7efd9406e310 0x7efd940707d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd9c006fd0 tx=0x7efd9c008040 comp rx=0 tx=0).stop 2024-09-18T12:49:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 -- 172.21.15.45:0/2840813965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac101a60 msgr2=0x7efdac197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac101a60 0x7efdac197aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efda0006010 tx=0x7efda00048f0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 -- 172.21.15.45:0/2840813965 shutdown_connections 2024-09-18T12:49:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7efd9406e310 0x7efd940707d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac101a60 0x7efdac197aa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 --2- 172.21.15.45:0/2840813965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdac100860 0x7efdac197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 -- 172.21.15.45:0/2840813965 >> 172.21.15.45:0/2840813965 conn(0x7efdac0fc010 msgr2=0x7efdac104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 -- 172.21.15.45:0/2840813965 shutdown_connections 2024-09-18T12:49:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:09.038+0000 7efdb1e44640 1 -- 172.21.15.45:0/2840813965 wait complete. 2024-09-18T12:49:09.675 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:09 smithi045 ceph-mon[28315]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:09.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-18T12:49:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:09 smithi161 ceph-mon[35784]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:10.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.348+0000 7f19c16c4640 1 -- 172.21.15.45:0/615101426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19bc100b10 msgr2=0x7f19bc100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:10.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.348+0000 7f19c16c4640 1 --2- 172.21.15.45:0/615101426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19bc100b10 0x7f19bc100f90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009880 tx=0x7f19a402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:10.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.348+0000 7f19c16c4640 1 -- 172.21.15.45:0/615101426 shutdown_connections 2024-09-18T12:49:10.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.348+0000 7f19c16c4640 1 --2- 172.21.15.45:0/615101426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19bc100b10 0x7f19bc100f90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.348+0000 7f19c16c4640 1 --2- 172.21.15.45:0/615101426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19bc101e60 0x7f19bc102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.348+0000 7f19c16c4640 1 -- 172.21.15.45:0/615101426 >> 172.21.15.45:0/615101426 conn(0x7f19bc0fb770 msgr2=0x7f19bc0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.348+0000 7f19c16c4640 1 -- 172.21.15.45:0/615101426 shutdown_connections 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.348+0000 7f19c16c4640 1 -- 172.21.15.45:0/615101426 wait complete. 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19c16c4640 1 Processor -- start 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19c16c4640 1 -- start start 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19c16c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19bc100b10 0x7f19bc1975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19c16c4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19bc101e60 0x7f19bc197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19c16c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc109730 con 0x7f19bc100b10 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19c16c4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc1095b0 con 0x7f19bc101e60 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19baffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19bc100b10 0x7f19bc1975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:10.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19baffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19bc100b10 0x7f19bc1975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49858/0 (socket says 172.21.15.45:49858) 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19baffd640 1 -- 172.21.15.45:0/1951071409 learned_addr learned my addr 172.21.15.45:0/1951071409 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19baffd640 1 -- 172.21.15.45:0/1951071409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19bc101e60 msgr2=0x7f19bc197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19b3fff640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19bc101e60 0x7f19bc197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19baffd640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19bc101e60 0x7f19bc197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.349+0000 7f19baffd640 1 -- 172.21.15.45:0/1951071409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc198160 con 0x7f19bc100b10 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.350+0000 7f19baffd640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19bc100b10 0x7f19bc1975a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00b3d0 tx=0x7f19ac00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.350+0000 7f19b8ff9640 1 -- 172.21.15.45:0/1951071409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19ac015020 con 0x7f19bc100b10 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.350+0000 7f19b8ff9640 1 -- 172.21.15.45:0/1951071409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19ac011af0 con 0x7f19bc100b10 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.350+0000 7f19c16c4640 1 -- 172.21.15.45:0/1951071409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19bc19cba0 con 0x7f19bc100b10 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.350+0000 7f19b8ff9640 1 -- 172.21.15.45:0/1951071409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19ac010da0 con 0x7f19bc100b10 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.350+0000 7f19c16c4640 1 -- 172.21.15.45:0/1951071409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19bc19d130 con 0x7f19bc100b10 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.351+0000 7f19c16c4640 1 -- 172.21.15.45:0/1951071409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19bc100f90 con 0x7f19bc100b10 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.351+0000 7f19b8ff9640 1 -- 172.21.15.45:0/1951071409 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f19ac018020 con 0x7f19bc100b10 2024-09-18T12:49:10.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.352+0000 7f19b8ff9640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f19a806e310 0x7f19a80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:10.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.352+0000 7f19b8ff9640 1 -- 172.21.15.45:0/1951071409 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f19ac08d940 con 0x7f19bc100b10 2024-09-18T12:49:10.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.352+0000 7f19b3fff640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f19a806e310 0x7f19a80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:10.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.352+0000 7f19b3fff640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f19a806e310 0x7f19a80707d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f19a4006010 tx=0x7f19a4000bc0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:10.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.357+0000 7f19b8ff9640 1 -- 172.21.15.45:0/1951071409 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19ac01f020 con 0x7f19bc100b10 2024-09-18T12:49:10.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.545+0000 7f19c16c4640 1 -- 172.21.15.45:0/1951071409 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f19bc100160 con 0x7f19a806e310 2024-09-18T12:49:10.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.546+0000 7f19b8ff9640 1 -- 172.21.15.45:0/1951071409 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7f19bc100160 con 0x7f19a806e310 2024-09-18T12:49:10.547 INFO:teuthology.orchestra.run.smithi045.stdout:HOST ADDR LABELS STATUS 2024-09-18T12:49:10.547 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045 172.21.15.45 2024-09-18T12:49:10.547 INFO:teuthology.orchestra.run.smithi045.stdout:smithi161 172.21.15.161 2024-09-18T12:49:10.548 INFO:teuthology.orchestra.run.smithi045.stdout:2 hosts in cluster 2024-09-18T12:49:10.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 -- 172.21.15.45:0/1951071409 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f19a806e310 msgr2=0x7f19a80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f19a806e310 0x7f19a80707d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f19a4006010 tx=0x7f19a4000bc0 comp rx=0 tx=0).stop 2024-09-18T12:49:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 -- 172.21.15.45:0/1951071409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19bc100b10 msgr2=0x7f19bc1975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19bc100b10 0x7f19bc1975a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00b3d0 tx=0x7f19ac00b890 comp rx=0 tx=0).stop 2024-09-18T12:49:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 -- 172.21.15.45:0/1951071409 shutdown_connections 2024-09-18T12:49:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f19a806e310 0x7f19a80707d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19bc101e60 0x7f19bc197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 --2- 172.21.15.45:0/1951071409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19bc100b10 0x7f19bc1975a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 -- 172.21.15.45:0/1951071409 >> 172.21.15.45:0/1951071409 conn(0x7f19bc0fb770 msgr2=0x7f19bc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 -- 172.21.15.45:0/1951071409 shutdown_connections 2024-09-18T12:49:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:10.548+0000 7f19c16c4640 1 -- 172.21.15.45:0/1951071409 wait complete. 2024-09-18T12:49:10.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:10 smithi045 ceph-mon[28315]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:10 smithi161 ceph-mon[35784]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:11.169 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-18T12:49:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:11.671 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:11 smithi045 ceph-mon[28315]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:11.671 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:11 smithi045 ceph-mon[28315]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:11 smithi161 ceph-mon[35784]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:11 smithi161 ceph-mon[35784]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.857+0000 7f3923dd7640 1 -- 172.21.15.45:0/1817617185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c104dc0 msgr2=0x7f391c1071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.857+0000 7f3923dd7640 1 --2- 172.21.15.45:0/1817617185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c104dc0 0x7f391c1071b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f390c009880 tx=0x7f390c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.857+0000 7f3923dd7640 1 -- 172.21.15.45:0/1817617185 shutdown_connections 2024-09-18T12:49:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.857+0000 7f3923dd7640 1 --2- 172.21.15.45:0/1817617185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c104dc0 0x7f391c1071b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.857+0000 7f3923dd7640 1 --2- 172.21.15.45:0/1817617185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c102490 0x7f391c104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.857+0000 7f3923dd7640 1 -- 172.21.15.45:0/1817617185 >> 172.21.15.45:0/1817617185 conn(0x7f391c0fc010 msgr2=0x7f391c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.857+0000 7f3923dd7640 1 -- 172.21.15.45:0/1817617185 shutdown_connections 2024-09-18T12:49:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.857+0000 7f3923dd7640 1 -- 172.21.15.45:0/1817617185 wait complete. 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3923dd7640 1 Processor -- start 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3923dd7640 1 -- start start 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3923dd7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c102490 0x7f391c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3923dd7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c104dc0 0x7f391c197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3923dd7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f391c10a780 con 0x7f391c102490 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3923dd7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f391c10a600 con 0x7f391c104dc0 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3921b73640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c102490 0x7f391c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3921b73640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c102490 0x7f391c1974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49870/0 (socket says 172.21.15.45:49870) 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3921b73640 1 -- 172.21.15.45:0/2406641561 learned_addr learned my addr 172.21.15.45:0/2406641561 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3921372640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c104dc0 0x7f391c197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3921b73640 1 -- 172.21.15.45:0/2406641561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c104dc0 msgr2=0x7f391c197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:11.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3921b73640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c104dc0 0x7f391c197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:11.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3921b73640 1 -- 172.21.15.45:0/2406641561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391c1980a0 con 0x7f391c102490 2024-09-18T12:49:11.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3921372640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c104dc0 0x7f391c197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:49:11.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.858+0000 7f3921b73640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c102490 0x7f391c1974e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f391800cc60 tx=0x7f391800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:11.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.859+0000 7f3912ffd640 1 -- 172.21.15.45:0/2406641561 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f391800ad30 con 0x7f391c102490 2024-09-18T12:49:11.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.859+0000 7f3912ffd640 1 -- 172.21.15.45:0/2406641561 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3918005020 con 0x7f391c102490 2024-09-18T12:49:11.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.859+0000 7f3923dd7640 1 -- 172.21.15.45:0/2406641561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391c19cae0 con 0x7f391c102490 2024-09-18T12:49:11.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.859+0000 7f3912ffd640 1 -- 172.21.15.45:0/2406641561 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f391800f660 con 0x7f391c102490 2024-09-18T12:49:11.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.859+0000 7f3923dd7640 1 -- 172.21.15.45:0/2406641561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f391c19d040 con 0x7f391c102490 2024-09-18T12:49:11.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.860+0000 7f3923dd7640 1 -- 172.21.15.45:0/2406641561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391c10af60 con 0x7f391c102490 2024-09-18T12:49:11.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.860+0000 7f3912ffd640 1 -- 172.21.15.45:0/2406641561 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f39180051d0 con 0x7f391c102490 2024-09-18T12:49:11.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.861+0000 7f3912ffd640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f390806e2b0 0x7f3908070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:11.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.861+0000 7f3912ffd640 1 -- 172.21.15.45:0/2406641561 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f391808e460 con 0x7f391c102490 2024-09-18T12:49:11.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.861+0000 7f3921372640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f390806e2b0 0x7f3908070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:11.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.861+0000 7f3921372640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f390806e2b0 0x7f3908070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f390c000c00 tx=0x7f390c005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:11.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:11.865+0000 7f3912ffd640 1 -- 172.21.15.45:0/2406641561 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3918014030 con 0x7f391c102490 2024-09-18T12:49:12.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.047+0000 7f3923dd7640 1 -- 172.21.15.45:0/2406641561 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f391c1058a0 con 0x7f390806e2b0 2024-09-18T12:49:12.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.049+0000 7f3912ffd640 1 -- 172.21.15.45:0/2406641561 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f391c1058a0 con 0x7f390806e2b0 2024-09-18T12:49:12.050 INFO:teuthology.orchestra.run.smithi045.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-18T12:49:12.050 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120098480DGN 447G No 118s ago Has a FileSystem, LVM detected 2024-09-18T12:49:12.050 INFO:teuthology.orchestra.run.smithi045.stdout:smithi161 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233001X400BGN 372G No 42s ago Has a FileSystem, LVM detected 2024-09-18T12:49:12.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 -- 172.21.15.45:0/2406641561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f390806e2b0 msgr2=0x7f3908070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:12.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f390806e2b0 0x7f3908070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f390c000c00 tx=0x7f390c005a20 comp rx=0 tx=0).stop 2024-09-18T12:49:12.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 -- 172.21.15.45:0/2406641561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c102490 msgr2=0x7f391c1974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:12.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c102490 0x7f391c1974e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f391800cc60 tx=0x7f391800a620 comp rx=0 tx=0).stop 2024-09-18T12:49:12.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 -- 172.21.15.45:0/2406641561 shutdown_connections 2024-09-18T12:49:12.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f390806e2b0 0x7f3908070770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:12.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f391c104dc0 0x7f391c197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:12.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 --2- 172.21.15.45:0/2406641561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c102490 0x7f391c1974e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:12.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 -- 172.21.15.45:0/2406641561 >> 172.21.15.45:0/2406641561 conn(0x7f391c0fc010 msgr2=0x7f391c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:12.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 -- 172.21.15.45:0/2406641561 shutdown_connections 2024-09-18T12:49:12.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:12.051+0000 7f3923dd7640 1 -- 172.21.15.45:0/2406641561 wait complete. 2024-09-18T12:49:12.774 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:49:12.785 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:49:12.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-18T12:49:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:13.493 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:13 smithi045 ceph-mon[28315]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:13.493 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:13 smithi045 ceph-mon[28315]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.491+0000 7f117e750640 1 -- 172.21.15.45:0/1888201995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1178101960 msgr2=0x7f1178101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.491+0000 7f117e750640 1 --2- 172.21.15.45:0/1888201995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1178101960 0x7f1178101d60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1168009880 tx=0x7f116802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.491+0000 7f117e750640 1 -- 172.21.15.45:0/1888201995 shutdown_connections 2024-09-18T12:49:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.491+0000 7f117e750640 1 --2- 172.21.15.45:0/1888201995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1178102b60 0x7f1178102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.491+0000 7f117e750640 1 --2- 172.21.15.45:0/1888201995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1178101960 0x7f1178101d60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.491+0000 7f117e750640 1 -- 172.21.15.45:0/1888201995 >> 172.21.15.45:0/1888201995 conn(0x7f11780fd0f0 msgr2=0x7f11780ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.491+0000 7f117e750640 1 -- 172.21.15.45:0/1888201995 shutdown_connections 2024-09-18T12:49:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.491+0000 7f117e750640 1 -- 172.21.15.45:0/1888201995 wait complete. 2024-09-18T12:49:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.492+0000 7f117e750640 1 Processor -- start 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.492+0000 7f117e750640 1 -- start start 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.492+0000 7f117e750640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1178101960 0x7f1178199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.492+0000 7f117e750640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1178102b60 0x7f1178199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.492+0000 7f117e750640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f117810a780 con 0x7f1178101960 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.492+0000 7f117e750640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f117810a600 con 0x7f1178102b60 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.492+0000 7f1177fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1178101960 0x7f1178199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.492+0000 7f1177fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1178101960 0x7f1178199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35194/0 (socket says 172.21.15.45:35194) 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.492+0000 7f1177fff640 1 -- 172.21.15.45:0/526619475 learned_addr learned my addr 172.21.15.45:0/526619475 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.492+0000 7f116ffff640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1178102b60 0x7f1178199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.493+0000 7f1177fff640 1 -- 172.21.15.45:0/526619475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1178102b60 msgr2=0x7f1178199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.493+0000 7f1177fff640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1178102b60 0x7f1178199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.493+0000 7f1177fff640 1 -- 172.21.15.45:0/526619475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117819a250 con 0x7f1178101960 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.493+0000 7f1177fff640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1178101960 0x7f1178199690 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1168006010 tx=0x7f11680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.493+0000 7f1175ffb640 1 -- 172.21.15.45:0/526619475 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f116803f070 con 0x7f1178101960 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.493+0000 7f1175ffb640 1 -- 172.21.15.45:0/526619475 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1168004a50 con 0x7f1178101960 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.493+0000 7f117e750640 1 -- 172.21.15.45:0/526619475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f117819ec30 con 0x7f1178101960 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.493+0000 7f1175ffb640 1 -- 172.21.15.45:0/526619475 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1168035030 con 0x7f1178101960 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.493+0000 7f117e750640 1 -- 172.21.15.45:0/526619475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f117819f1c0 con 0x7f1178101960 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.494+0000 7f117e750640 1 -- 172.21.15.45:0/526619475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1178101d60 con 0x7f1178101960 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.494+0000 7f1175ffb640 1 -- 172.21.15.45:0/526619475 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1168042070 con 0x7f1178101960 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.495+0000 7f1175ffb640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f116406e310 0x7f11640707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.495+0000 7f1175ffb640 1 -- 172.21.15.45:0/526619475 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f11680ae870 con 0x7f1178101960 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.495+0000 7f116ffff640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f116406e310 0x7f11640707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.495+0000 7f116ffff640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f116406e310 0x7f11640707d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f117819ab40 tx=0x7f116000b390 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.499+0000 7f1175ffb640 1 -- 172.21.15.45:0/526619475 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1168080240 con 0x7f1178101960 2024-09-18T12:49:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:13.700+0000 7f117e750640 1 -- 172.21.15.45:0/526619475 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7f11780626f0 con 0x7f116406e310 2024-09-18T12:49:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:13 smithi161 ceph-mon[35784]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:13 smithi161 ceph-mon[35784]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:14.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:14 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-18T12:49:14.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:14 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-18T12:49:15.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.459+0000 7f1175ffb640 1 -- 172.21.15.45:0/526619475 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f11780626f0 con 0x7f116406e310 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 -- 172.21.15.45:0/526619475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f116406e310 msgr2=0x7f11640707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f116406e310 0x7f11640707d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f117819ab40 tx=0x7f116000b390 comp rx=0 tx=0).stop 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 -- 172.21.15.45:0/526619475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1178101960 msgr2=0x7f1178199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1178101960 0x7f1178199690 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1168006010 tx=0x7f11680045e0 comp rx=0 tx=0).stop 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 -- 172.21.15.45:0/526619475 shutdown_connections 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f116406e310 0x7f11640707d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1178102b60 0x7f1178199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 --2- 172.21.15.45:0/526619475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1178101960 0x7f1178199690 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 -- 172.21.15.45:0/526619475 >> 172.21.15.45:0/526619475 conn(0x7f11780fd0f0 msgr2=0x7f1178103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 -- 172.21.15.45:0/526619475 shutdown_connections 2024-09-18T12:49:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:15.461+0000 7f117e750640 1 -- 172.21.15.45:0/526619475 wait complete. 2024-09-18T12:49:15.693 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:15 smithi161 ceph-mon[35784]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:15.693 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:15 smithi161 ceph-mon[35784]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:15.693 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:15 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-18T12:49:15.693 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:15 smithi161 ceph-mon[35784]: osdmap e40: 6 total, 6 up, 6 in 2024-09-18T12:49:15.693 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:15 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:49:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:15 smithi045 ceph-mon[28315]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:15 smithi045 ceph-mon[28315]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:15 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-18T12:49:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:15 smithi045 ceph-mon[28315]: osdmap e40: 6 total, 6 up, 6 in 2024-09-18T12:49:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:15 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:49:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045[28311]: 2024-09-18T12:49:15.434+0000 7f68dd523640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:49:16.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T12:49:16.602 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: osdmap e41: 6 total, 6 up, 6 in 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: osdmap e42: 6 total, 6 up, 6 in 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: fsmap cephfs:0 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: Saving service mds.cephfs spec with placement count:4 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:16.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:16.604 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:16.604 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:16.604 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.gzqgyu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:49:16.604 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.gzqgyu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:49:16.604 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:16 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:16.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-18T12:49:16.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: osdmap e41: 6 total, 6 up, 6 in 2024-09-18T12:49:16.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: osdmap e42: 6 total, 6 up, 6 in 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: fsmap cephfs:0 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: Saving service mds.cephfs spec with placement count:4 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.gzqgyu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:49:16.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.gzqgyu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:49:16.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:16 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:17.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:17 smithi045 ceph-mon[28315]: Deploying daemon mds.cephfs.smithi045.gzqgyu on smithi045 2024-09-18T12:49:17.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:17 smithi045 ceph-mon[28315]: pgmap v173: 65 pgs: 10 active+clean, 16 creating+peering, 39 unknown; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:17.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:17 smithi045 ceph-mon[28315]: osdmap e43: 6 total, 6 up, 6 in 2024-09-18T12:49:17.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:17.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:17 smithi161 ceph-mon[35784]: Deploying daemon mds.cephfs.smithi045.gzqgyu on smithi045 2024-09-18T12:49:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:17 smithi161 ceph-mon[35784]: pgmap v173: 65 pgs: 10 active+clean, 16 creating+peering, 39 unknown; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:17 smithi161 ceph-mon[35784]: osdmap e43: 6 total, 6 up, 6 in 2024-09-18T12:49:17.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:17.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:18.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.106+0000 7f9937658640 1 -- 172.21.15.45:0/24660545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9930102b60 msgr2=0x7f9930102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.106+0000 7f9937658640 1 --2- 172.21.15.45:0/24660545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9930102b60 0x7f9930102fe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9924009880 tx=0x7f992402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.106+0000 7f9937658640 1 -- 172.21.15.45:0/24660545 shutdown_connections 2024-09-18T12:49:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.106+0000 7f9937658640 1 --2- 172.21.15.45:0/24660545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9930102b60 0x7f9930102fe0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.106+0000 7f9937658640 1 --2- 172.21.15.45:0/24660545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9930101960 0x7f9930101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.106+0000 7f9937658640 1 -- 172.21.15.45:0/24660545 >> 172.21.15.45:0/24660545 conn(0x7f99300fd0f0 msgr2=0x7f99300ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.106+0000 7f9937658640 1 -- 172.21.15.45:0/24660545 shutdown_connections 2024-09-18T12:49:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.106+0000 7f9937658640 1 -- 172.21.15.45:0/24660545 wait complete. 2024-09-18T12:49:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.107+0000 7f9937658640 1 Processor -- start 2024-09-18T12:49:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.107+0000 7f9937658640 1 -- start start 2024-09-18T12:49:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.107+0000 7f9937658640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9930101960 0x7f9930197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.107+0000 7f9937658640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9930102b60 0x7f9930197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.107+0000 7f9937658640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f993010a820 con 0x7f9930101960 2024-09-18T12:49:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.107+0000 7f9937658640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f993010a6a0 con 0x7f9930102b60 2024-09-18T12:49:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.107+0000 7f99353f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9930101960 0x7f9930197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.107+0000 7f99353f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9930101960 0x7f9930197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35224/0 (socket says 172.21.15.45:35224) 2024-09-18T12:49:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.107+0000 7f99353f4640 1 -- 172.21.15.45:0/3305019155 learned_addr learned my addr 172.21.15.45:0/3305019155 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.107+0000 7f9934bf3640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9930102b60 0x7f9930197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.108+0000 7f99353f4640 1 -- 172.21.15.45:0/3305019155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9930102b60 msgr2=0x7f9930197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.108+0000 7f99353f4640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9930102b60 0x7f9930197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.108+0000 7f99353f4640 1 -- 172.21.15.45:0/3305019155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99301980d0 con 0x7f9930101960 2024-09-18T12:49:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.108+0000 7f9934bf3640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9930102b60 0x7f9930197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:49:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.108+0000 7f99353f4640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9930101960 0x7f9930197510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f992800b9c0 tx=0x7f992800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.108+0000 7f992e7fc640 1 -- 172.21.15.45:0/3305019155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9928019070 con 0x7f9930101960 2024-09-18T12:49:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.108+0000 7f992e7fc640 1 -- 172.21.15.45:0/3305019155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f992800cde0 con 0x7f9930101960 2024-09-18T12:49:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.108+0000 7f9937658640 1 -- 172.21.15.45:0/3305019155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993019cb10 con 0x7f9930101960 2024-09-18T12:49:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.108+0000 7f992e7fc640 1 -- 172.21.15.45:0/3305019155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9928012570 con 0x7f9930101960 2024-09-18T12:49:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.108+0000 7f9937658640 1 -- 172.21.15.45:0/3305019155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f993019d0a0 con 0x7f9930101960 2024-09-18T12:49:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.109+0000 7f9937658640 1 -- 172.21.15.45:0/3305019155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9930101d60 con 0x7f9930101960 2024-09-18T12:49:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.110+0000 7f992e7fc640 1 -- 172.21.15.45:0/3305019155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f992801c070 con 0x7f9930101960 2024-09-18T12:49:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.110+0000 7f992e7fc640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f991806e2b0 0x7f9918070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.110+0000 7f992e7fc640 1 -- 172.21.15.45:0/3305019155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f992808db00 con 0x7f9930101960 2024-09-18T12:49:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.111+0000 7f9934bf3640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f991806e2b0 0x7f9918070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.111+0000 7f9934bf3640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f991806e2b0 0x7f9918070770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99240096c0 tx=0x7f9924009650 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.116+0000 7f992e7fc640 1 -- 172.21.15.45:0/3305019155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f992805b460 con 0x7f9930101960 2024-09-18T12:49:18.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.338+0000 7f9937658640 1 -- 172.21.15.45:0/3305019155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9930062df0 con 0x7f9930101960 2024-09-18T12:49:18.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.338+0000 7f992e7fc640 1 -- 172.21.15.45:0/3305019155 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f992805f110 con 0x7f9930101960 2024-09-18T12:49:18.340 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 2 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:e2 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T12:49:15:435412+0000 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 2 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:49:18.341 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T12:49:15.435246+0000 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:in 2024-09-18T12:49:18.342 INFO:teuthology.orchestra.run.smithi045.stdout:up {} 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data disabled 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 0 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 0 members: 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:49:18.343 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:49:18.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.340+0000 7f9937658640 1 -- 172.21.15.45:0/3305019155 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f991806e2b0 msgr2=0x7f9918070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.340+0000 7f9937658640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f991806e2b0 0x7f9918070770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99240096c0 tx=0x7f9924009650 comp rx=0 tx=0).stop 2024-09-18T12:49:18.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.340+0000 7f9937658640 1 -- 172.21.15.45:0/3305019155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9930101960 msgr2=0x7f9930197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:18.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.341+0000 7f9937658640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9930101960 0x7f9930197510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f992800b9c0 tx=0x7f992800be80 comp rx=0 tx=0).stop 2024-09-18T12:49:18.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.341+0000 7f9937658640 1 -- 172.21.15.45:0/3305019155 shutdown_connections 2024-09-18T12:49:18.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.341+0000 7f9937658640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f991806e2b0 0x7f9918070770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.341+0000 7f9937658640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9930102b60 0x7f9930197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.341+0000 7f9937658640 1 --2- 172.21.15.45:0/3305019155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9930101960 0x7f9930197510 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:18.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.341+0000 7f9937658640 1 -- 172.21.15.45:0/3305019155 >> 172.21.15.45:0/3305019155 conn(0x7f99300fd0f0 msgr2=0x7f9930106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:18.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.341+0000 7f9937658640 1 -- 172.21.15.45:0/3305019155 shutdown_connections 2024-09-18T12:49:18.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:18.341+0000 7f9937658640 1 -- 172.21.15.45:0/3305019155 wait complete. 2024-09-18T12:49:18.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:18 smithi045 ceph-mon[28315]: osdmap e44: 6 total, 6 up, 6 in 2024-09-18T12:49:18.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:18 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3305019155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:49:18.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:18 smithi161 ceph-mon[35784]: osdmap e44: 6 total, 6 up, 6 in 2024-09-18T12:49:18.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:18 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3305019155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:49:19.356 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:49:19.365 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:49:19.366 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-18T12:49:19.626 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:19.748 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: pgmap v176: 65 pgs: 41 active+clean, 16 creating+peering, 8 unknown; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:19.748 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:19.748 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:19.748 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:19.748 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.xoxpyp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:49:19.748 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.xoxpyp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:49:19.748 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:19.749 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: daemon mds.cephfs.smithi045.gzqgyu assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-18T12:49:19.749 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T12:49:19.749 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:49:19.749 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: Cluster is now healthy 2024-09-18T12:49:19.749 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: mds.? [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] up:boot 2024-09-18T12:49:19.749 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:creating} 2024-09-18T12:49:19.749 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.gzqgyu"}]: dispatch 2024-09-18T12:49:19.749 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:19 smithi045 ceph-mon[28315]: daemon mds.cephfs.smithi045.gzqgyu is now active in filesystem cephfs as rank 0 2024-09-18T12:49:19.754 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: pgmap v176: 65 pgs: 41 active+clean, 16 creating+peering, 8 unknown; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:49:19.754 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:19.754 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.xoxpyp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.xoxpyp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: daemon mds.cephfs.smithi045.gzqgyu assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: Cluster is now healthy 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: mds.? [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] up:boot 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:creating} 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.gzqgyu"}]: dispatch 2024-09-18T12:49:19.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:19 smithi161 ceph-mon[35784]: daemon mds.cephfs.smithi045.gzqgyu is now active in filesystem cephfs as rank 0 2024-09-18T12:49:20.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.066+0000 7f3ced16f640 1 -- 172.21.15.45:0/2137070443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ce81023f0 msgr2=0x7f3ce81047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.066+0000 7f3ced16f640 1 --2- 172.21.15.45:0/2137070443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ce81023f0 0x7f3ce81047e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80098b0 tx=0x7f3cd802a4d0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.066+0000 7f3ced16f640 1 -- 172.21.15.45:0/2137070443 shutdown_connections 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.066+0000 7f3ced16f640 1 --2- 172.21.15.45:0/2137070443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce8104d20 0x7f3ce8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.066+0000 7f3ced16f640 1 --2- 172.21.15.45:0/2137070443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ce81023f0 0x7f3ce81047e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.066+0000 7f3ced16f640 1 -- 172.21.15.45:0/2137070443 >> 172.21.15.45:0/2137070443 conn(0x7f3ce80fc010 msgr2=0x7f3ce80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.066+0000 7f3ced16f640 1 -- 172.21.15.45:0/2137070443 shutdown_connections 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.066+0000 7f3ced16f640 1 -- 172.21.15.45:0/2137070443 wait complete. 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.067+0000 7f3ced16f640 1 Processor -- start 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.067+0000 7f3ced16f640 1 -- start start 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.067+0000 7f3ced16f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ce81023f0 0x7f3ce8101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ced16f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce8104d20 0x7f3ce81003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ced16f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce810a7e0 con 0x7f3ce81023f0 2024-09-18T12:49:20.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ced16f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce810a660 con 0x7f3ce8104d20 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ce6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ce81023f0 0x7f3ce8101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ce6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ce81023f0 0x7f3ce8101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35262/0 (socket says 172.21.15.45:35262) 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ce6d9d640 1 -- 172.21.15.45:0/793884825 learned_addr learned my addr 172.21.15.45:0/793884825 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ce659c640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce8104d20 0x7f3ce81003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ce6d9d640 1 -- 172.21.15.45:0/793884825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce8104d20 msgr2=0x7f3ce81003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ce6d9d640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce8104d20 0x7f3ce81003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ce6d9d640 1 -- 172.21.15.45:0/793884825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce81008e0 con 0x7f3ce81023f0 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ce6d9d640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ce81023f0 0x7f3ce8101ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80099d0 tx=0x7f3cd80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ccffff640 1 -- 172.21.15.45:0/793884825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cd803f070 con 0x7f3ce81023f0 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ced16f640 1 -- 172.21.15.45:0/793884825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce8100b70 con 0x7f3ce81023f0 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ccffff640 1 -- 172.21.15.45:0/793884825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3cd80049d0 con 0x7f3ce81023f0 2024-09-18T12:49:20.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ccffff640 1 -- 172.21.15.45:0/793884825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cd8035030 con 0x7f3ce81023f0 2024-09-18T12:49:20.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.068+0000 7f3ced16f640 1 -- 172.21.15.45:0/793884825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce81010a0 con 0x7f3ce81023f0 2024-09-18T12:49:20.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.070+0000 7f3ced16f640 1 -- 172.21.15.45:0/793884825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce81027d0 con 0x7f3ce81023f0 2024-09-18T12:49:20.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.070+0000 7f3ccffff640 1 -- 172.21.15.45:0/793884825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3cd8042070 con 0x7f3ce81023f0 2024-09-18T12:49:20.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.071+0000 7f3ccffff640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f3cd006e2b0 0x7f3cd0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:20.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.071+0000 7f3ccffff640 1 -- 172.21.15.45:0/793884825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f3cd80aec60 con 0x7f3ce81023f0 2024-09-18T12:49:20.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.071+0000 7f3ce659c640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f3cd006e2b0 0x7f3cd0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:20.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.071+0000 7f3ce659c640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f3cd006e2b0 0x7f3cd0070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8101a60 tx=0x7f3cdc005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:20.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.075+0000 7f3ccffff640 1 -- 172.21.15.45:0/793884825 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3cd8080270 con 0x7f3ce81023f0 2024-09-18T12:49:20.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:20.290+0000 7f3ced16f640 1 -- 172.21.15.45:0/793884825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f3ce819f670 con 0x7f3ce81023f0 2024-09-18T12:49:20.756 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:20 smithi161 ceph-mon[35784]: Deploying daemon mds.cephfs.smithi161.xoxpyp on smithi161 2024-09-18T12:49:20.756 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:20 smithi161 ceph-mon[35784]: mds.? [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] up:active 2024-09-18T12:49:20.756 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:20 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 2024-09-18T12:49:20.756 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:20 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/793884825' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-18T12:49:20.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:20 smithi045 ceph-mon[28315]: Deploying daemon mds.cephfs.smithi161.xoxpyp on smithi161 2024-09-18T12:49:20.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:20 smithi045 ceph-mon[28315]: mds.? [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] up:active 2024-09-18T12:49:20.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:20 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 2024-09-18T12:49:20.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:20 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/793884825' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-18T12:49:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.145+0000 7f3ccffff640 1 -- 172.21.15.45:0/793884825 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7f3cd8084aa0 con 0x7f3ce81023f0 2024-09-18T12:49:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 -- 172.21.15.45:0/793884825 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f3cd006e2b0 msgr2=0x7f3cd0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f3cd006e2b0 0x7f3cd0070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8101a60 tx=0x7f3cdc005f90 comp rx=0 tx=0).stop 2024-09-18T12:49:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 -- 172.21.15.45:0/793884825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ce81023f0 msgr2=0x7f3ce8101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ce81023f0 0x7f3ce8101ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80099d0 tx=0x7f3cd80045e0 comp rx=0 tx=0).stop 2024-09-18T12:49:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 -- 172.21.15.45:0/793884825 shutdown_connections 2024-09-18T12:49:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f3cd006e2b0 0x7f3cd0070770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce8104d20 0x7f3ce81003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 --2- 172.21.15.45:0/793884825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ce81023f0 0x7f3ce8101ce0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 -- 172.21.15.45:0/793884825 >> 172.21.15.45:0/793884825 conn(0x7f3ce80fc010 msgr2=0x7f3ce80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 -- 172.21.15.45:0/793884825 shutdown_connections 2024-09-18T12:49:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:21.149+0000 7f3ced16f640 1 -- 172.21.15.45:0/793884825 wait complete. 2024-09-18T12:49:21.731 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:21 smithi045 ceph-mon[28315]: pgmap v177: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 623 B/s wr, 1 op/s 2024-09-18T12:49:21.732 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:21 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/793884825' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-18T12:49:21.732 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:21 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 2024-09-18T12:49:21.733 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:49:21.742 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:49:21.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-18T12:49:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:21 smithi161 ceph-mon[35784]: pgmap v177: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 623 B/s wr, 1 op/s 2024-09-18T12:49:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:21 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/793884825' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-18T12:49:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:21 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 2024-09-18T12:49:23.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:23.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:23.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:23.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.favmzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:49:23.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.favmzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:49:23.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:23.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: Deploying daemon mds.cephfs.smithi045.favmzs on smithi045 2024-09-18T12:49:23.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: pgmap v178: 65 pgs: 65 active+clean; 578 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 889 B/s wr, 3 op/s 2024-09-18T12:49:23.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: mds.? [v2:172.21.15.161:6824/1853440548,v1:172.21.15.161:6825/1853440548] up:boot 2024-09-18T12:49:23.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby 2024-09-18T12:49:23.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.xoxpyp"}]: dispatch 2024-09-18T12:49:23.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:22 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby 2024-09-18T12:49:23.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:23.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:23.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.favmzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:49:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.favmzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:49:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: Deploying daemon mds.cephfs.smithi045.favmzs on smithi045 2024-09-18T12:49:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: pgmap v178: 65 pgs: 65 active+clean; 578 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 889 B/s wr, 3 op/s 2024-09-18T12:49:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: mds.? [v2:172.21.15.161:6824/1853440548,v1:172.21.15.161:6825/1853440548] up:boot 2024-09-18T12:49:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby 2024-09-18T12:49:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.xoxpyp"}]: dispatch 2024-09-18T12:49:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:22 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby 2024-09-18T12:49:23.084 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:23.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.645+0000 7fafd53d5640 1 -- 172.21.15.45:0/2800345672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd01023f0 msgr2=0x7fafd01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:23.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.645+0000 7fafd53d5640 1 --2- 172.21.15.45:0/2800345672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd01023f0 0x7fafd01047e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fafc00098b0 tx=0x7fafc002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:49:23.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.645+0000 7fafd53d5640 1 -- 172.21.15.45:0/2800345672 shutdown_connections 2024-09-18T12:49:23.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.645+0000 7fafd53d5640 1 --2- 172.21.15.45:0/2800345672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd0104d20 0x7fafd0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:23.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.645+0000 7fafd53d5640 1 --2- 172.21.15.45:0/2800345672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd01023f0 0x7fafd01047e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:23.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.645+0000 7fafd53d5640 1 -- 172.21.15.45:0/2800345672 >> 172.21.15.45:0/2800345672 conn(0x7fafd00fc010 msgr2=0x7fafd00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:23.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.645+0000 7fafd53d5640 1 -- 172.21.15.45:0/2800345672 shutdown_connections 2024-09-18T12:49:23.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.645+0000 7fafd53d5640 1 -- 172.21.15.45:0/2800345672 wait complete. 2024-09-18T12:49:23.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.646+0000 7fafd53d5640 1 Processor -- start 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafd53d5640 1 -- start start 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafd53d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd01023f0 0x7fafd0197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafd53d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd0104d20 0x7fafd0197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafd53d5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fafd010a7e0 con 0x7fafd01023f0 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafd53d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fafd010a660 con 0x7fafd0104d20 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafceffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd01023f0 0x7fafd0197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafceffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd01023f0 0x7fafd0197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49240/0 (socket says 172.21.15.45:49240) 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafceffd640 1 -- 172.21.15.45:0/3038575561 learned_addr learned my addr 172.21.15.45:0/3038575561 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafce7fc640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd0104d20 0x7fafd0197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafceffd640 1 -- 172.21.15.45:0/3038575561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd0104d20 msgr2=0x7fafd0197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafceffd640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd0104d20 0x7fafd0197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafceffd640 1 -- 172.21.15.45:0/3038575561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd0198130 con 0x7fafd01023f0 2024-09-18T12:49:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.647+0000 7fafce7fc640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd0104d20 0x7fafd0197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:49:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.648+0000 7fafceffd640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd01023f0 0x7fafd0197570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fafc00099d0 tx=0x7fafc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.648+0000 7fafb7fff640 1 -- 172.21.15.45:0/3038575561 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafc003f070 con 0x7fafd01023f0 2024-09-18T12:49:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.648+0000 7fafd53d5640 1 -- 172.21.15.45:0/3038575561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd019cb10 con 0x7fafd01023f0 2024-09-18T12:49:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.648+0000 7fafb7fff640 1 -- 172.21.15.45:0/3038575561 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafc0004a40 con 0x7fafd01023f0 2024-09-18T12:49:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.648+0000 7fafb7fff640 1 -- 172.21.15.45:0/3038575561 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafc0035030 con 0x7fafd01023f0 2024-09-18T12:49:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.648+0000 7fafd53d5640 1 -- 172.21.15.45:0/3038575561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd019d0a0 con 0x7fafd01023f0 2024-09-18T12:49:23.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.649+0000 7fafd53d5640 1 -- 172.21.15.45:0/3038575561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd01027d0 con 0x7fafd01023f0 2024-09-18T12:49:23.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.650+0000 7fafb7fff640 1 -- 172.21.15.45:0/3038575561 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fafc0042070 con 0x7fafd01023f0 2024-09-18T12:49:23.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.650+0000 7fafb7fff640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fafb806e2b0 0x7fafb8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:23.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.651+0000 7fafb7fff640 1 -- 172.21.15.45:0/3038575561 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fafc00aeda0 con 0x7fafd01023f0 2024-09-18T12:49:23.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.651+0000 7fafce7fc640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fafb806e2b0 0x7fafb8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:23.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.651+0000 7fafce7fc640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fafb806e2b0 0x7fafb8070770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafc40058c0 tx=0x7fafc4005850 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.656+0000 7fafb7fff640 1 -- 172.21.15.45:0/3038575561 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fafc007c700 con 0x7fafd01023f0 2024-09-18T12:49:23.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.884+0000 7fafd53d5640 1 -- 172.21.15.45:0/3038575561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fafd019d390 con 0x7fafd01023f0 2024-09-18T12:49:23.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.936+0000 7fafb7fff640 1 -- 172.21.15.45:0/3038575561 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v8) ==== 121+0+0 (secure 0 0 0) 0x7fafc00803b0 con 0x7fafd01023f0 2024-09-18T12:49:23.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 -- 172.21.15.45:0/3038575561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fafb806e2b0 msgr2=0x7fafb8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:23.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fafb806e2b0 0x7fafb8070770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafc40058c0 tx=0x7fafc4005850 comp rx=0 tx=0).stop 2024-09-18T12:49:23.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 -- 172.21.15.45:0/3038575561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd01023f0 msgr2=0x7fafd0197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:23.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd01023f0 0x7fafd0197570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fafc00099d0 tx=0x7fafc00046c0 comp rx=0 tx=0).stop 2024-09-18T12:49:23.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 -- 172.21.15.45:0/3038575561 shutdown_connections 2024-09-18T12:49:23.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fafb806e2b0 0x7fafb8070770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:23.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd0104d20 0x7fafd0197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:23.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 --2- 172.21.15.45:0/3038575561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd01023f0 0x7fafd0197570 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:23.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 -- 172.21.15.45:0/3038575561 >> 172.21.15.45:0/3038575561 conn(0x7fafd00fc010 msgr2=0x7fafd00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:23.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 -- 172.21.15.45:0/3038575561 shutdown_connections 2024-09-18T12:49:23.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:23.938+0000 7fafd53d5640 1 -- 172.21.15.45:0/3038575561 wait complete. 2024-09-18T12:49:24.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:23 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3038575561' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-18T12:49:24.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:23 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3038575561' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-18T12:49:24.946 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:49:24.956 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:49:24.956 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3038575561' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.maxdew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.maxdew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:25.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:24 smithi161 ceph-mon[35784]: Deploying daemon mds.cephfs.smithi161.maxdew on smithi161 2024-09-18T12:49:25.221 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:25.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3038575561' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-18T12:49:25.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby 2024-09-18T12:49:25.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2024-09-18T12:49:25.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-18T12:49:25.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:25.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:25.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:25.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.maxdew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T12:49:25.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.maxdew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T12:49:25.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:25.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:24 smithi045 ceph-mon[28315]: Deploying daemon mds.cephfs.smithi161.maxdew on smithi161 2024-09-18T12:49:25.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.672+0000 7f2e3b9c2640 1 -- 172.21.15.45:0/3106929831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e34101a60 msgr2=0x7f2e34101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:25.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.672+0000 7f2e3b9c2640 1 --2- 172.21.15.45:0/3106929831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e34101a60 0x7f2e34101ee0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009880 tx=0x7f2e2402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.672+0000 7f2e3b9c2640 1 -- 172.21.15.45:0/3106929831 shutdown_connections 2024-09-18T12:49:25.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.672+0000 7f2e3b9c2640 1 --2- 172.21.15.45:0/3106929831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e34101a60 0x7f2e34101ee0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.672+0000 7f2e3b9c2640 1 --2- 172.21.15.45:0/3106929831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e34100860 0x7f2e34100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.672+0000 7f2e3b9c2640 1 -- 172.21.15.45:0/3106929831 >> 172.21.15.45:0/3106929831 conn(0x7f2e340fc010 msgr2=0x7f2e340fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:25.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.672+0000 7f2e3b9c2640 1 -- 172.21.15.45:0/3106929831 shutdown_connections 2024-09-18T12:49:25.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.672+0000 7f2e3b9c2640 1 -- 172.21.15.45:0/3106929831 wait complete. 2024-09-18T12:49:25.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.672+0000 7f2e3b9c2640 1 Processor -- start 2024-09-18T12:49:25.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.672+0000 7f2e3b9c2640 1 -- start start 2024-09-18T12:49:25.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e3b9c2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e34100860 0x7f2e34104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:25.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e3b9c2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e34101a60 0x7f2e34102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:25.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e3b9c2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34109680 con 0x7f2e34101a60 2024-09-18T12:49:25.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e3b9c2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34109500 con 0x7f2e34100860 2024-09-18T12:49:25.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e38f5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e34101a60 0x7f2e34102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:25.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e38f5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e34101a60 0x7f2e34102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49276/0 (socket says 172.21.15.45:49276) 2024-09-18T12:49:25.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e38f5d640 1 -- 172.21.15.45:0/3031475163 learned_addr learned my addr 172.21.15.45:0/3031475163 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e3975e640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e34100860 0x7f2e34104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e38f5d640 1 -- 172.21.15.45:0/3031475163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e34100860 msgr2=0x7f2e34104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e38f5d640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e34100860 0x7f2e34104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e38f5d640 1 -- 172.21.15.45:0/3031475163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e34103380 con 0x7f2e34101a60 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e38f5d640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e34101a60 0x7f2e34102e40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2e24006010 tx=0x7f2e240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.673+0000 7f2e2a7fc640 1 -- 172.21.15.45:0/3031475163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e2403f070 con 0x7f2e34101a60 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.674+0000 7f2e2a7fc640 1 -- 172.21.15.45:0/3031475163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e24004ac0 con 0x7f2e34101a60 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.674+0000 7f2e3b9c2640 1 -- 172.21.15.45:0/3031475163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e34103610 con 0x7f2e34101a60 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.674+0000 7f2e2a7fc640 1 -- 172.21.15.45:0/3031475163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e24035030 con 0x7f2e34101a60 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.674+0000 7f2e3b9c2640 1 -- 172.21.15.45:0/3031475163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e34103b40 con 0x7f2e34101a60 2024-09-18T12:49:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.675+0000 7f2e1ffff640 1 -- 172.21.15.45:0/3031475163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e34100c60 con 0x7f2e34101a60 2024-09-18T12:49:25.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.675+0000 7f2e2a7fc640 1 -- 172.21.15.45:0/3031475163 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2e24042070 con 0x7f2e34101a60 2024-09-18T12:49:25.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.676+0000 7f2e2a7fc640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2e2006e2b0 0x7f2e20070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:25.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.676+0000 7f2e2a7fc640 1 -- 172.21.15.45:0/3031475163 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f2e240aed30 con 0x7f2e34101a60 2024-09-18T12:49:25.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.676+0000 7f2e3975e640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2e2006e2b0 0x7f2e20070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:25.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.676+0000 7f2e3975e640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2e2006e2b0 0x7f2e20070770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2e30005fd0 tx=0x7f2e3000b410 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:25.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.680+0000 7f2e2a7fc640 1 -- 172.21.15.45:0/3031475163 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e240802a0 con 0x7f2e34101a60 2024-09-18T12:49:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.899+0000 7f2e1ffff640 1 -- 172.21.15.45:0/3031475163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2e34063160 con 0x7f2e34101a60 2024-09-18T12:49:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.948+0000 7f2e2a7fc640 1 -- 172.21.15.45:0/3031475163 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v11) ==== 168+0+0 (secure 0 0 0) 0x7f2e24084ad0 con 0x7f2e34101a60 2024-09-18T12:49:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:inline data enabled 2024-09-18T12:49:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.950+0000 7f2e1ffff640 1 -- 172.21.15.45:0/3031475163 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2e2006e2b0 msgr2=0x7f2e20070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.950+0000 7f2e1ffff640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2e2006e2b0 0x7f2e20070770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2e30005fd0 tx=0x7f2e3000b410 comp rx=0 tx=0).stop 2024-09-18T12:49:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.950+0000 7f2e1ffff640 1 -- 172.21.15.45:0/3031475163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e34101a60 msgr2=0x7f2e34102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.950+0000 7f2e1ffff640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e34101a60 0x7f2e34102e40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2e24006010 tx=0x7f2e240046c0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.951+0000 7f2e1ffff640 1 -- 172.21.15.45:0/3031475163 shutdown_connections 2024-09-18T12:49:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.951+0000 7f2e1ffff640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2e2006e2b0 0x7f2e20070770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.951+0000 7f2e1ffff640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e34101a60 0x7f2e34102e40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.951+0000 7f2e1ffff640 1 --2- 172.21.15.45:0/3031475163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e34100860 0x7f2e34104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.951+0000 7f2e1ffff640 1 -- 172.21.15.45:0/3031475163 >> 172.21.15.45:0/3031475163 conn(0x7f2e340fc010 msgr2=0x7f2e34069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:25.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.951+0000 7f2e1ffff640 1 -- 172.21.15.45:0/3031475163 shutdown_connections 2024-09-18T12:49:25.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:25.951+0000 7f2e1ffff640 1 -- 172.21.15.45:0/3031475163 wait complete. 2024-09-18T12:49:26.081 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:25 smithi161 ceph-mon[35784]: mds.? [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] up:boot 2024-09-18T12:49:26.081 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:25 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 1 up:standby 2024-09-18T12:49:26.081 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:25 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"}]: dispatch 2024-09-18T12:49:26.081 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:25 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3031475163' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-18T12:49:26.252 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:25 smithi045 ceph-mon[28315]: mds.? [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] up:boot 2024-09-18T12:49:26.252 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:25 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 1 up:standby 2024-09-18T12:49:26.252 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:25 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"}]: dispatch 2024-09-18T12:49:26.252 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:25 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3031475163' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-18T12:49:26.514 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T12:49:26.524 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:49:26.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T12:49:26.790 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:27.172 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:26 smithi045 ceph-mon[28315]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-18T12:49:27.172 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:26 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3031475163' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-18T12:49:27.172 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:26 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 1 up:standby 2024-09-18T12:49:27.172 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:26 smithi045 ceph-mon[28315]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 930 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-18T12:49:27.172 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:26 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.255+0000 7fefcf4b3640 1 -- 172.21.15.45:0/2073233744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc81024b0 msgr2=0x7fefc81048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.255+0000 7fefcf4b3640 1 --2- 172.21.15.45:0/2073233744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc81024b0 0x7fefc81048a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009880 tx=0x7fefc402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.256+0000 7fefcf4b3640 1 -- 172.21.15.45:0/2073233744 shutdown_connections 2024-09-18T12:49:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.256+0000 7fefcf4b3640 1 --2- 172.21.15.45:0/2073233744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc8104de0 0x7fefc81071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.256+0000 7fefcf4b3640 1 --2- 172.21.15.45:0/2073233744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc81024b0 0x7fefc81048a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.256+0000 7fefcf4b3640 1 -- 172.21.15.45:0/2073233744 >> 172.21.15.45:0/2073233744 conn(0x7fefc80fc010 msgr2=0x7fefc80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.256+0000 7fefcf4b3640 1 -- 172.21.15.45:0/2073233744 shutdown_connections 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.256+0000 7fefcf4b3640 1 -- 172.21.15.45:0/2073233744 wait complete. 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.256+0000 7fefcf4b3640 1 Processor -- start 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.256+0000 7fefcf4b3640 1 -- start start 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcf4b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc81024b0 0x7fefc8197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcf4b3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc8104de0 0x7fefc8197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcf4b3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fefc810a7d0 con 0x7fefc81024b0 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcf4b3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fefc810a650 con 0x7fefc8104de0 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcd24f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc81024b0 0x7fefc8197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcd24f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc81024b0 0x7fefc8197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49286/0 (socket says 172.21.15.45:49286) 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcd24f640 1 -- 172.21.15.45:0/1833777240 learned_addr learned my addr 172.21.15.45:0/1833777240 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcca4e640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc8104de0 0x7fefc8197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcd24f640 1 -- 172.21.15.45:0/1833777240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc8104de0 msgr2=0x7fefc8197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcd24f640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc8104de0 0x7fefc8197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcd24f640 1 -- 172.21.15.45:0/1833777240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc81980e0 con 0x7fefc81024b0 2024-09-18T12:49:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcd24f640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc81024b0 0x7fefc8197520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009230 tx=0x7fefc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefba7fc640 1 -- 172.21.15.45:0/1833777240 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fefc403f070 con 0x7fefc81024b0 2024-09-18T12:49:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.257+0000 7fefcf4b3640 1 -- 172.21.15.45:0/1833777240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc819cac0 con 0x7fefc81024b0 2024-09-18T12:49:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.258+0000 7fefba7fc640 1 -- 172.21.15.45:0/1833777240 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fefc4004b80 con 0x7fefc81024b0 2024-09-18T12:49:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.258+0000 7fefba7fc640 1 -- 172.21.15.45:0/1833777240 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fefc4035030 con 0x7fefc81024b0 2024-09-18T12:49:27.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.258+0000 7fefcf4b3640 1 -- 172.21.15.45:0/1833777240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc819d050 con 0x7fefc81024b0 2024-09-18T12:49:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.259+0000 7fefcf4b3640 1 -- 172.21.15.45:0/1833777240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc8102890 con 0x7fefc81024b0 2024-09-18T12:49:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.259+0000 7fefba7fc640 1 -- 172.21.15.45:0/1833777240 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fefc4042070 con 0x7fefc81024b0 2024-09-18T12:49:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.260+0000 7fefba7fc640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fefb406e2b0 0x7fefb4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.260+0000 7fefba7fc640 1 -- 172.21.15.45:0/1833777240 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fefc40aed20 con 0x7fefc81024b0 2024-09-18T12:49:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.260+0000 7fefcca4e640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fefb406e2b0 0x7fefb4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.260+0000 7fefcca4e640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fefb406e2b0 0x7fefb4070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fefc81989d0 tx=0x7fefbc00b390 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:27.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.264+0000 7fefba7fc640 1 -- 172.21.15.45:0/1833777240 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fefc4080330 con 0x7fefc81024b0 2024-09-18T12:49:27.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:26 smithi161 ceph-mon[35784]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-18T12:49:27.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:26 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3031475163' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-18T12:49:27.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:26 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 1 up:standby 2024-09-18T12:49:27.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:26 smithi161 ceph-mon[35784]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 930 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-18T12:49:27.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:26 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:27.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.532+0000 7fefcf4b3640 1 -- 172.21.15.45:0/1833777240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fefc819d920 con 0x7fefc81024b0 2024-09-18T12:49:27.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.532+0000 7fefba7fc640 1 -- 172.21.15.45:0/1833777240 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) ==== 76+0+1828 (secure 0 0 0) 0x7fefc4084b60 con 0x7fefc81024b0 2024-09-18T12:49:27.534 INFO:teuthology.orchestra.run.smithi045.stdout:e11 2024-09-18T12:49:27.534 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T12:49:25:944989+0000 2024-09-18T12:49:27.534 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:49:27.534 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:49:27.534 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 11 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T12:49:25.900652+0000 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T12:49:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=14566} 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T12:49:27.536 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T12:49:27.537 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T12:49:27.537 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T12:49:27.537 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 14566 members: 14566 2024-09-18T12:49:27.537 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 2 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:49:27.537 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{0:24309} state up:standby-replay seq 1 addr [v2:172.21.15.161:6824/1853440548,v1:172.21.15.161:6825/1853440548] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:49:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:49:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:49:27.537 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T12:49:27.537 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:49:27.537 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{-1:14580} state up:standby seq 1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:49:27.538 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 11 2024-09-18T12:49:27.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.534+0000 7fefcf4b3640 1 -- 172.21.15.45:0/1833777240 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fefb406e2b0 msgr2=0x7fefb4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:27.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.534+0000 7fefcf4b3640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fefb406e2b0 0x7fefb4070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fefc81989d0 tx=0x7fefbc00b390 comp rx=0 tx=0).stop 2024-09-18T12:49:27.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.535+0000 7fefcf4b3640 1 -- 172.21.15.45:0/1833777240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc81024b0 msgr2=0x7fefc8197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:27.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.535+0000 7fefcf4b3640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc81024b0 0x7fefc8197520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009230 tx=0x7fefc40046c0 comp rx=0 tx=0).stop 2024-09-18T12:49:27.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.535+0000 7fefcf4b3640 1 -- 172.21.15.45:0/1833777240 shutdown_connections 2024-09-18T12:49:27.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.535+0000 7fefcf4b3640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fefb406e2b0 0x7fefb4070770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:27.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.535+0000 7fefcf4b3640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefc8104de0 0x7fefc8197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:27.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.535+0000 7fefcf4b3640 1 --2- 172.21.15.45:0/1833777240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc81024b0 0x7fefc8197520 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:27.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.535+0000 7fefcf4b3640 1 -- 172.21.15.45:0/1833777240 >> 172.21.15.45:0/1833777240 conn(0x7fefc80fc010 msgr2=0x7fefc80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:27.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.535+0000 7fefcf4b3640 1 -- 172.21.15.45:0/1833777240 shutdown_connections 2024-09-18T12:49:27.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:27.535+0000 7fefcf4b3640 1 -- 172.21.15.45:0/1833777240 wait complete. 2024-09-18T12:49:28.042 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:28.043 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:28.043 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:28.043 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:28.043 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:28.043 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:28.043 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1833777240' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:49:28.043 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: mds.? [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] up:boot 2024-09-18T12:49:28.043 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: mds.? [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] up:active 2024-09-18T12:49:28.043 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:49:28.043 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:27 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.maxdew"}]: dispatch 2024-09-18T12:49:28.287 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:28.287 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:28.287 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:28.287 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:28.287 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:28.287 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:28.287 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1833777240' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:49:28.287 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: mds.? [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] up:boot 2024-09-18T12:49:28.287 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: mds.? [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] up:active 2024-09-18T12:49:28.288 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:49:28.288 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:27 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.maxdew"}]: dispatch 2024-09-18T12:49:28.750 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-18T12:49:29.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:28 smithi045 ceph-mon[28315]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.0 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-18T12:49:29.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:28 smithi161 ceph-mon[35784]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.0 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-18T12:49:29.664 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:30.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:29 smithi045 ceph-mon[28315]: mds.? [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] up:standby 2024-09-18T12:49:30.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:29 smithi045 ceph-mon[28315]: Dropping low affinity standby-replay daemon mds.cephfs.smithi161.xoxpyp in favor of higher affinity standby. 2024-09-18T12:49:30.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:29 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:49:30.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:29 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 1 up:standby 2024-09-18T12:49:30.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:30.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:29 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:30.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:29 smithi161 ceph-mon[35784]: mds.? [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] up:standby 2024-09-18T12:49:30.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:29 smithi161 ceph-mon[35784]: Dropping low affinity standby-replay daemon mds.cephfs.smithi161.xoxpyp in favor of higher affinity standby. 2024-09-18T12:49:30.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:29 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:49:30.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:29 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 1 up:standby 2024-09-18T12:49:30.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:30.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:29 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.696+0000 7f2d1a88f640 1 -- 172.21.15.45:0/3654322092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d140ffc40 msgr2=0x7f2d14100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.696+0000 7f2d1a88f640 1 --2- 172.21.15.45:0/3654322092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d140ffc40 0x7f2d14100040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009880 tx=0x7f2d0402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.696+0000 7f2d1a88f640 1 -- 172.21.15.45:0/3654322092 shutdown_connections 2024-09-18T12:49:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.696+0000 7f2d1a88f640 1 --2- 172.21.15.45:0/3654322092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d14102cc0 0x7f2d14103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.696+0000 7f2d1a88f640 1 --2- 172.21.15.45:0/3654322092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d140ffc40 0x7f2d14100040 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.696+0000 7f2d1a88f640 1 -- 172.21.15.45:0/3654322092 >> 172.21.15.45:0/3654322092 conn(0x7f2d140fb770 msgr2=0x7f2d140fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.696+0000 7f2d1a88f640 1 -- 172.21.15.45:0/3654322092 shutdown_connections 2024-09-18T12:49:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.696+0000 7f2d1a88f640 1 -- 172.21.15.45:0/3654322092 wait complete. 2024-09-18T12:49:30.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.697+0000 7f2d1a88f640 1 Processor -- start 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.697+0000 7f2d1a88f640 1 -- start start 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.697+0000 7f2d1a88f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d140ffc40 0x7f2d14197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.697+0000 7f2d1a88f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d14102cc0 0x7f2d14197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.697+0000 7f2d1a88f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1410a800 con 0x7f2d140ffc40 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.697+0000 7f2d1a88f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1410a680 con 0x7f2d14102cc0 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d140ffc40 0x7f2d14197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d140ffc40 0x7f2d14197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49302/0 (socket says 172.21.15.45:49302) 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d13fff640 1 -- 172.21.15.45:0/373736541 learned_addr learned my addr 172.21.15.45:0/373736541 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d137fe640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d14102cc0 0x7f2d14197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d13fff640 1 -- 172.21.15.45:0/373736541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d14102cc0 msgr2=0x7f2d14197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d13fff640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d14102cc0 0x7f2d14197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d13fff640 1 -- 172.21.15.45:0/373736541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d14198100 con 0x7f2d140ffc40 2024-09-18T12:49:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d13fff640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d140ffc40 0x7f2d14197540 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2d04006010 tx=0x7f2d040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d117fa640 1 -- 172.21.15.45:0/373736541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d0403f070 con 0x7f2d140ffc40 2024-09-18T12:49:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d1a88f640 1 -- 172.21.15.45:0/373736541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1419cae0 con 0x7f2d140ffc40 2024-09-18T12:49:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d117fa640 1 -- 172.21.15.45:0/373736541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d040044d0 con 0x7f2d140ffc40 2024-09-18T12:49:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d117fa640 1 -- 172.21.15.45:0/373736541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d04035030 con 0x7f2d140ffc40 2024-09-18T12:49:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.698+0000 7f2d1a88f640 1 -- 172.21.15.45:0/373736541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1419d070 con 0x7f2d140ffc40 2024-09-18T12:49:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.699+0000 7f2d1a88f640 1 -- 172.21.15.45:0/373736541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d14100040 con 0x7f2d140ffc40 2024-09-18T12:49:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.700+0000 7f2d117fa640 1 -- 172.21.15.45:0/373736541 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2d04042070 con 0x7f2d140ffc40 2024-09-18T12:49:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.700+0000 7f2d117fa640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2cfc06e2b0 0x7f2cfc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.701+0000 7f2d137fe640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2cfc06e2b0 0x7f2cfc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.701+0000 7f2d117fa640 1 -- 172.21.15.45:0/373736541 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f2d040aed40 con 0x7f2d140ffc40 2024-09-18T12:49:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.701+0000 7f2d137fe640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2cfc06e2b0 0x7f2cfc070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2d141989f0 tx=0x7f2d08009110 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.705+0000 7f2d117fa640 1 -- 172.21.15.45:0/373736541 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d0407c6a0 con 0x7f2d140ffc40 2024-09-18T12:49:30.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.917+0000 7f2d1a88f640 1 -- 172.21.15.45:0/373736541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d14191610 con 0x7f2d140ffc40 2024-09-18T12:49:30.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.917+0000 7f2d117fa640 1 -- 172.21.15.45:0/373736541 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5329 (secure 0 0 0) 0x7f2d04080350 con 0x7f2d140ffc40 2024-09-18T12:49:30.919 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 15 2024-09-18T12:49:30.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.919+0000 7f2d1a88f640 1 -- 172.21.15.45:0/373736541 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2cfc06e2b0 msgr2=0x7f2cfc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:30.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.919+0000 7f2d1a88f640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2cfc06e2b0 0x7f2cfc070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2d141989f0 tx=0x7f2d08009110 comp rx=0 tx=0).stop 2024-09-18T12:49:30.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.919+0000 7f2d1a88f640 1 -- 172.21.15.45:0/373736541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d140ffc40 msgr2=0x7f2d14197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.919+0000 7f2d1a88f640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d140ffc40 0x7f2d14197540 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2d04006010 tx=0x7f2d040048f0 comp rx=0 tx=0).stop 2024-09-18T12:49:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.919+0000 7f2d1a88f640 1 -- 172.21.15.45:0/373736541 shutdown_connections 2024-09-18T12:49:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.919+0000 7f2d1a88f640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2cfc06e2b0 0x7f2cfc070770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.919+0000 7f2d1a88f640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d14102cc0 0x7f2d14197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.920+0000 7f2d1a88f640 1 --2- 172.21.15.45:0/373736541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d140ffc40 0x7f2d14197540 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.920+0000 7f2d1a88f640 1 -- 172.21.15.45:0/373736541 >> 172.21.15.45:0/373736541 conn(0x7f2d140fb770 msgr2=0x7f2d14106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.920+0000 7f2d1a88f640 1 -- 172.21.15.45:0/373736541 shutdown_connections 2024-09-18T12:49:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:30.920+0000 7f2d1a88f640 1 -- 172.21.15.45:0/373736541 wait complete. 2024-09-18T12:49:30.930 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:49:31.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:30 smithi045 ceph-mon[28315]: mds.? [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] up:boot 2024-09-18T12:49:31.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:30 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:49:31.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:30 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.xoxpyp"}]: dispatch 2024-09-18T12:49:31.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:30 smithi045 ceph-mon[28315]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-18T12:49:31.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:30 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/373736541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:49:31.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:30 smithi161 ceph-mon[35784]: mds.? [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] up:boot 2024-09-18T12:49:31.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:30 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:49:31.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:30 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.xoxpyp"}]: dispatch 2024-09-18T12:49:31.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:30 smithi161 ceph-mon[35784]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-18T12:49:31.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:30 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/373736541' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:49:31.558 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-18T12:49:31.956 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:32.199 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:31 smithi045 ceph-mon[28315]: mds.? [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] up:standby 2024-09-18T12:49:32.199 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:31 smithi045 ceph-mon[28315]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:49:32.199 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:32.199 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:32.199 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:31 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:32.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:31 smithi161 ceph-mon[35784]: mds.? [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] up:standby 2024-09-18T12:49:32.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:31 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:49:32.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:31 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:32.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.944+0000 7f80e1ddc640 1 -- 172.21.15.45:0/3124818504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc100880 msgr2=0x7f80dc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:32.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.944+0000 7f80e1ddc640 1 --2- 172.21.15.45:0/3124818504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc100880 0x7f80dc100c80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009880 tx=0x7f80cc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:32.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.944+0000 7f80e1ddc640 1 -- 172.21.15.45:0/3124818504 shutdown_connections 2024-09-18T12:49:32.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.944+0000 7f80e1ddc640 1 --2- 172.21.15.45:0/3124818504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80dc101a80 0x7f80dc101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.944+0000 7f80e1ddc640 1 --2- 172.21.15.45:0/3124818504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc100880 0x7f80dc100c80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.944+0000 7f80e1ddc640 1 -- 172.21.15.45:0/3124818504 >> 172.21.15.45:0/3124818504 conn(0x7f80dc0fc010 msgr2=0x7f80dc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.944+0000 7f80e1ddc640 1 -- 172.21.15.45:0/3124818504 shutdown_connections 2024-09-18T12:49:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.944+0000 7f80e1ddc640 1 -- 172.21.15.45:0/3124818504 wait complete. 2024-09-18T12:49:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.945+0000 7f80e1ddc640 1 Processor -- start 2024-09-18T12:49:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.945+0000 7f80e1ddc640 1 -- start start 2024-09-18T12:49:32.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.945+0000 7f80e1ddc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc100880 0x7f80dc1047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:32.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.945+0000 7f80e1ddc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80dc101a80 0x7f80dc102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:32.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.945+0000 7f80e1ddc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1096c0 con 0x7f80dc100880 2024-09-18T12:49:32.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.945+0000 7f80e1ddc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc109540 con 0x7f80dc101a80 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.945+0000 7f80db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc100880 0x7f80dc1047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.945+0000 7f80db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc100880 0x7f80dc1047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47372/0 (socket says 172.21.15.45:47372) 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.945+0000 7f80db7fe640 1 -- 172.21.15.45:0/486801201 learned_addr learned my addr 172.21.15.45:0/486801201 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.945+0000 7f80d2ffd640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80dc101a80 0x7f80dc102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.946+0000 7f80db7fe640 1 -- 172.21.15.45:0/486801201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80dc101a80 msgr2=0x7f80dc102e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.946+0000 7f80db7fe640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80dc101a80 0x7f80dc102e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.946+0000 7f80db7fe640 1 -- 172.21.15.45:0/486801201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80dc1033a0 con 0x7f80dc100880 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.946+0000 7f80db7fe640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc100880 0x7f80dc1047a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f80cc006010 tx=0x7f80cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.946+0000 7f80d97fa640 1 -- 172.21.15.45:0/486801201 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80cc03f070 con 0x7f80dc100880 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.946+0000 7f80e1ddc640 1 -- 172.21.15.45:0/486801201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80dc103630 con 0x7f80dc100880 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.946+0000 7f80d97fa640 1 -- 172.21.15.45:0/486801201 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80cc004a50 con 0x7f80dc100880 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.946+0000 7f80d97fa640 1 -- 172.21.15.45:0/486801201 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80cc035030 con 0x7f80dc100880 2024-09-18T12:49:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.946+0000 7f80e1ddc640 1 -- 172.21.15.45:0/486801201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80dc103b60 con 0x7f80dc100880 2024-09-18T12:49:32.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.947+0000 7f80e1ddc640 1 -- 172.21.15.45:0/486801201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80dc100c80 con 0x7f80dc100880 2024-09-18T12:49:32.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.948+0000 7f80d97fa640 1 -- 172.21.15.45:0/486801201 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f80cc042070 con 0x7f80dc100880 2024-09-18T12:49:32.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.948+0000 7f80d97fa640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f80c806e2b0 0x7f80c8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:32.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.948+0000 7f80d97fa640 1 -- 172.21.15.45:0/486801201 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f80cc0aec70 con 0x7f80dc100880 2024-09-18T12:49:32.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.948+0000 7f80d2ffd640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f80c806e2b0 0x7f80c8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:32.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.949+0000 7f80d2ffd640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f80c806e2b0 0x7f80c8070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f80dc104520 tx=0x7f80c400b390 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:32.953+0000 7f80d97fa640 1 -- 172.21.15.45:0/486801201 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80cc004c00 con 0x7f80dc100880 2024-09-18T12:49:33.212 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:32 smithi045 ceph-mon[28315]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-18T12:49:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.211+0000 7f80e1ddc640 1 -- 172.21.15.45:0/486801201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7f80dc19fad0 con 0x7f80dc100880 2024-09-18T12:49:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.211+0000 7f80d97fa640 1 -- 172.21.15.45:0/486801201 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) ==== 78+0+98 (secure 0 0 0) 0x7f80cc080280 con 0x7f80dc100880 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.213+0000 7f80e1ddc640 1 -- 172.21.15.45:0/486801201 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f80c806e2b0 msgr2=0x7f80c8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.213+0000 7f80e1ddc640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f80c806e2b0 0x7f80c8070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f80dc104520 tx=0x7f80c400b390 comp rx=0 tx=0).stop 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.213+0000 7f80e1ddc640 1 -- 172.21.15.45:0/486801201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc100880 msgr2=0x7f80dc1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.213+0000 7f80e1ddc640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc100880 0x7f80dc1047a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f80cc006010 tx=0x7f80cc0045e0 comp rx=0 tx=0).stop 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.214+0000 7f80e1ddc640 1 -- 172.21.15.45:0/486801201 shutdown_connections 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.214+0000 7f80e1ddc640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f80c806e2b0 0x7f80c8070770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.214+0000 7f80e1ddc640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80dc101a80 0x7f80dc102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.214+0000 7f80e1ddc640 1 --2- 172.21.15.45:0/486801201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc100880 0x7f80dc1047a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.214+0000 7f80e1ddc640 1 -- 172.21.15.45:0/486801201 >> 172.21.15.45:0/486801201 conn(0x7f80dc0fc010 msgr2=0x7f80dc06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.214+0000 7f80e1ddc640 1 -- 172.21.15.45:0/486801201 shutdown_connections 2024-09-18T12:49:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:33.214+0000 7f80e1ddc640 1 -- 172.21.15.45:0/486801201 wait complete. 2024-09-18T12:49:33.224 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:49:33.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:32 smithi161 ceph-mon[35784]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-18T12:49:33.854 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-18T12:49:33.866 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-18T12:49:34.162 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:34.414 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:34 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:34.414 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:34 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:34.414 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:34 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/486801201' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-18T12:49:34.414 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:34 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:34.414 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:34 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:34.414 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:34 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:34.414 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:34 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:34 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:34 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:34 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/486801201' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-18T12:49:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:34 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:34 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:34 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:34 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:49:34.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.583+0000 7f9fd8450640 1 -- 172.21.15.45:0/3690125440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd01000e0 msgr2=0x7f9fd01004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:34.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.583+0000 7f9fd8450640 1 --2- 172.21.15.45:0/3690125440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd01000e0 0x7f9fd01004c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009880 tx=0x7f9fcc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.584+0000 7f9fd8450640 1 -- 172.21.15.45:0/3690125440 shutdown_connections 2024-09-18T12:49:34.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.584+0000 7f9fd8450640 1 --2- 172.21.15.45:0/3690125440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fd0100a90 0x7f9fd01065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.584+0000 7f9fd8450640 1 --2- 172.21.15.45:0/3690125440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd01000e0 0x7f9fd01004c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.584+0000 7f9fd8450640 1 -- 172.21.15.45:0/3690125440 >> 172.21.15.45:0/3690125440 conn(0x7f9fd00fbc90 msgr2=0x7f9fd00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:34.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.584+0000 7f9fd8450640 1 -- 172.21.15.45:0/3690125440 shutdown_connections 2024-09-18T12:49:34.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.584+0000 7f9fd8450640 1 -- 172.21.15.45:0/3690125440 wait complete. 2024-09-18T12:49:34.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.584+0000 7f9fd8450640 1 Processor -- start 2024-09-18T12:49:34.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd8450640 1 -- start start 2024-09-18T12:49:34.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd8450640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fd01000e0 0x7f9fd0195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd8450640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd0100a90 0x7f9fd0195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd8450640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd010ee30 con 0x7f9fd0100a90 2024-09-18T12:49:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd8450640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd010ecb0 con 0x7f9fd01000e0 2024-09-18T12:49:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd59eb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd0100a90 0x7f9fd0195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd59eb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd0100a90 0x7f9fd0195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47390/0 (socket says 172.21.15.45:47390) 2024-09-18T12:49:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd59eb640 1 -- 172.21.15.45:0/1641692822 learned_addr learned my addr 172.21.15.45:0/1641692822 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd61ec640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fd01000e0 0x7f9fd0195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd59eb640 1 -- 172.21.15.45:0/1641692822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fd01000e0 msgr2=0x7f9fd0195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd59eb640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fd01000e0 0x7f9fd0195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.585+0000 7f9fd59eb640 1 -- 172.21.15.45:0/1641692822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd01960b0 con 0x7f9fd0100a90 2024-09-18T12:49:34.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.586+0000 7f9fd59eb640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd0100a90 0x7f9fd0195b70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c8a0 tx=0x7f9fc000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:34.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.586+0000 7f9fc77fe640 1 -- 172.21.15.45:0/1641692822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fc00079b0 con 0x7f9fd0100a90 2024-09-18T12:49:34.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.586+0000 7f9fc77fe640 1 -- 172.21.15.45:0/1641692822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fc0007b50 con 0x7f9fd0100a90 2024-09-18T12:49:34.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.586+0000 7f9fd8450640 1 -- 172.21.15.45:0/1641692822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd01963a0 con 0x7f9fd0100a90 2024-09-18T12:49:34.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.586+0000 7f9fc77fe640 1 -- 172.21.15.45:0/1641692822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fc0018700 con 0x7f9fd0100a90 2024-09-18T12:49:34.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.586+0000 7f9fd8450640 1 -- 172.21.15.45:0/1641692822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd01a8210 con 0x7f9fd0100a90 2024-09-18T12:49:34.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.587+0000 7f9fd8450640 1 -- 172.21.15.45:0/1641692822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd01031a0 con 0x7f9fd0100a90 2024-09-18T12:49:34.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.588+0000 7f9fc77fe640 1 -- 172.21.15.45:0/1641692822 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9fc0007d00 con 0x7f9fd0100a90 2024-09-18T12:49:34.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.588+0000 7f9fc77fe640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9fbc06e2b0 0x7f9fbc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:34.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.588+0000 7f9fc77fe640 1 -- 172.21.15.45:0/1641692822 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f9fc008e3e0 con 0x7f9fd0100a90 2024-09-18T12:49:34.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.588+0000 7f9fd61ec640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9fbc06e2b0 0x7f9fbc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:34.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.589+0000 7f9fd61ec640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9fbc06e2b0 0x7f9fbc070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc031460 tx=0x7f9fcc005bd0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:34.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.593+0000 7f9fc77fe640 1 -- 172.21.15.45:0/1641692822 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fc0014030 con 0x7f9fd0100a90 2024-09-18T12:49:34.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.839+0000 7f9fd8450640 1 -- 172.21.15.45:0/1641692822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fd01004c0 con 0x7f9fd0100a90 2024-09-18T12:49:34.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.839+0000 7f9fc77fe640 1 -- 172.21.15.45:0/1641692822 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5328 (secure 0 0 0) 0x7f9fd01004c0 con 0x7f9fd0100a90 2024-09-18T12:49:34.841 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:49:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"btime":"2024-09-18T12:49:30:966010+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T12:49:28.960615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14566":{"gid":14566,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6827/2456430948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2456430948},{"type":"v1","addr":"172.21.15.45:6827","nonce":2456430948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14580":{"gid":14580,"name":"cephfs.smithi045.favmzs","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.45:6829/1739021663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1739021663},{"type":"v1","addr":"172.21.15.45:6829","nonce":1739021663}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14566,"qdb_cluster":[14566]},"id":1}]} 2024-09-18T12:49:34.841 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.841+0000 7f9fd8450640 1 -- 172.21.15.45:0/1641692822 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9fbc06e2b0 msgr2=0x7f9fbc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.841+0000 7f9fd8450640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9fbc06e2b0 0x7f9fbc070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc031460 tx=0x7f9fcc005bd0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.841+0000 7f9fd8450640 1 -- 172.21.15.45:0/1641692822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd0100a90 msgr2=0x7f9fd0195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.841+0000 7f9fd8450640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd0100a90 0x7f9fd0195b70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c8a0 tx=0x7f9fc000cd60 comp rx=0 tx=0).stop 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.841+0000 7f9fd8450640 1 -- 172.21.15.45:0/1641692822 shutdown_connections 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.841+0000 7f9fd8450640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f9fbc06e2b0 0x7f9fbc070770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.842+0000 7f9fd8450640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fd0100a90 0x7f9fd0195b70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.842+0000 7f9fd8450640 1 --2- 172.21.15.45:0/1641692822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fd01000e0 0x7f9fd0195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.842+0000 7f9fd8450640 1 -- 172.21.15.45:0/1641692822 >> 172.21.15.45:0/1641692822 conn(0x7f9fd00fbc90 msgr2=0x7f9fd00fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.842+0000 7f9fd8450640 1 -- 172.21.15.45:0/1641692822 shutdown_connections 2024-09-18T12:49:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:34.842+0000 7f9fd8450640 1 -- 172.21.15.45:0/1641692822 wait complete. 2024-09-18T12:49:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:35 smithi045 ceph-mon[28315]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-18T12:49:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:35 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1641692822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:49:35.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:35 smithi161 ceph-mon[35784]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-18T12:49:35.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:35 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1641692822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T12:49:35.933 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 50} 2024-09-18T12:49:35.934 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-18T12:49:35.961 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-18T12:49:35.961 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-18T12:49:35.962 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-18T12:49:35.962 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-18T12:49:35.962 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:35.962 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-18T12:49:35.962 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-18T12:49:35.962 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:35.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:35.962 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-09-18T12:49:35.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:35.982 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-09-18T12:49:36.053 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2024-09-18T12:49:36.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:49:36.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:36.055 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-09-18T12:49:36.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:36.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2024-09-18T12:49:36.145 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2024-09-18T12:49:36.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:49:36.147 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-18T12:49:36.147 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-18T12:49:36.147 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-18T12:49:36.770 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.186+0000 7ffab2a8f640 1 -- 172.21.15.45:0/209734982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaac101900 msgr2=0x7ffaac101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.186+0000 7ffab2a8f640 1 --2- 172.21.15.45:0/209734982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaac101900 0x7ffaac101d60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009880 tx=0x7ffaa002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.186+0000 7ffab2a8f640 1 -- 172.21.15.45:0/209734982 shutdown_connections 2024-09-18T12:49:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.186+0000 7ffab2a8f640 1 --2- 172.21.15.45:0/209734982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaac101900 0x7ffaac101d60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.186+0000 7ffab2a8f640 1 --2- 172.21.15.45:0/209734982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaac107900 0x7ffaac107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.186+0000 7ffab2a8f640 1 -- 172.21.15.45:0/209734982 >> 172.21.15.45:0/209734982 conn(0x7ffaac0fd600 msgr2=0x7ffaac0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.186+0000 7ffab2a8f640 1 -- 172.21.15.45:0/209734982 shutdown_connections 2024-09-18T12:49:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.186+0000 7ffab2a8f640 1 -- 172.21.15.45:0/209734982 wait complete. 2024-09-18T12:49:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.186+0000 7ffab2a8f640 1 Processor -- start 2024-09-18T12:49:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffab2a8f640 1 -- start start 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffab2a8f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaac101900 0x7ffaac19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffab2a8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaac107900 0x7ffaac19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffab2a8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac10edd0 con 0x7ffaac107900 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffab2a8f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac10ec50 con 0x7ffaac101900 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffaabfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaac107900 0x7ffaac19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffaabfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaac107900 0x7ffaac19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47404/0 (socket says 172.21.15.45:47404) 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffaabfff640 1 -- 172.21.15.45:0/1333928088 learned_addr learned my addr 172.21.15.45:0/1333928088 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffab082b640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaac101900 0x7ffaac19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffaabfff640 1 -- 172.21.15.45:0/1333928088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaac101900 msgr2=0x7ffaac19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffaabfff640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaac101900 0x7ffaac19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffaabfff640 1 -- 172.21.15.45:0/1333928088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaac197800 con 0x7ffaac107900 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffab082b640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaac101900 0x7ffaac19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:49:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.187+0000 7ffaabfff640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaac107900 0x7ffaac19dbc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0031460 tx=0x7ffaa00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.188+0000 7ffaa9ffb640 1 -- 172.21.15.45:0/1333928088 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffaa003f070 con 0x7ffaac107900 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.188+0000 7ffab2a8f640 1 -- 172.21.15.45:0/1333928088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaac197a90 con 0x7ffaac107900 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.188+0000 7ffaa9ffb640 1 -- 172.21.15.45:0/1333928088 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffaa00035f0 con 0x7ffaac107900 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.188+0000 7ffaa9ffb640 1 -- 172.21.15.45:0/1333928088 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffaa0035030 con 0x7ffaac107900 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.188+0000 7ffab2a8f640 1 -- 172.21.15.45:0/1333928088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaac197fc0 con 0x7ffaac107900 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.189+0000 7ffab2a8f640 1 -- 172.21.15.45:0/1333928088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaac103040 con 0x7ffaac107900 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.190+0000 7ffaa9ffb640 1 -- 172.21.15.45:0/1333928088 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ffaa0042070 con 0x7ffaac107900 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.190+0000 7ffaa9ffb640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ffa9406e2b0 0x7ffa94070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.190+0000 7ffaa9ffb640 1 -- 172.21.15.45:0/1333928088 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7ffaa00aebd0 con 0x7ffaac107900 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.190+0000 7ffab082b640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ffa9406e2b0 0x7ffa94070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.191+0000 7ffab082b640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ffa9406e2b0 0x7ffa94070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009b40 tx=0x7ffa9c005e50 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.194+0000 7ffaa9ffb640 1 -- 172.21.15.45:0/1333928088 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffaa007c490 con 0x7ffaac107900 2024-09-18T12:49:37.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.409+0000 7ffab2a8f640 1 -- 172.21.15.45:0/1333928088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffaac109e70 con 0x7ffaac107900 2024-09-18T12:49:37.411 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:37.411 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:37 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:37.411 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:37 smithi045 ceph-mon[28315]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-18T12:49:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.410+0000 7ffaa9ffb640 1 -- 172.21.15.45:0/1333928088 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+83 (secure 0 0 0) 0x7ffaa0080140 con 0x7ffaac107900 2024-09-18T12:49:37.412 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-18T12:49:37.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 -- 172.21.15.45:0/1333928088 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ffa9406e2b0 msgr2=0x7ffa94070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ffa9406e2b0 0x7ffa94070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009b40 tx=0x7ffa9c005e50 comp rx=0 tx=0).stop 2024-09-18T12:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 -- 172.21.15.45:0/1333928088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaac107900 msgr2=0x7ffaac19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaac107900 0x7ffaac19dbc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0031460 tx=0x7ffaa00045e0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 -- 172.21.15.45:0/1333928088 shutdown_connections 2024-09-18T12:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ffa9406e2b0 0x7ffa94070770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaac107900 0x7ffaac19dbc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 --2- 172.21.15.45:0/1333928088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaac101900 0x7ffaac19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 -- 172.21.15.45:0/1333928088 >> 172.21.15.45:0/1333928088 conn(0x7ffaac0fd600 msgr2=0x7ffaac0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 -- 172.21.15.45:0/1333928088 shutdown_connections 2024-09-18T12:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:37.412+0000 7ffab2a8f640 1 -- 172.21.15.45:0/1333928088 wait complete. 2024-09-18T12:49:37.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:37 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:37.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:37 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:37.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:37 smithi161 ceph-mon[35784]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-18T12:49:38.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:38 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1333928088' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:49:38.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:38 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1333928088' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:49:38.825 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-18T12:49:38.825 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-18T12:49:38.825 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2024-09-18T12:49:38.825 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-18T12:49:38.825 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:38.825 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-18T12:49:38.825 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-18T12:49:38.825 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-18T12:49:38.826 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-18T12:49:38.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:38.826 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2024-09-18T12:49:38.843 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-18T12:49:38.843 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-18T12:49:38.843 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2024-09-18T12:49:38.843 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:38.843 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2024-09-18T12:49:38.843 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:38.843 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:38.843 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:38.843 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2024-09-18T12:49:38.843 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42339sec preferred_lft 42339sec 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:38.844 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2024-09-18T12:49:38.845 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-18T12:49:38.845 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:38.845 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-18T12:49:38.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2024-09-18T12:49:38.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2024-09-18T12:49:38.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2024-09-18T12:49:38.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-18T12:49:38.845 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-18T12:49:38.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:39.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:39.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:39.094 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-18T12:49:39.121 INFO:teuthology.orchestra.run.smithi045.stdout:1 2024-09-18T12:49:39.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:39.123 DEBUG:teuthology.orchestra.run.smithi045:> route 2024-09-18T12:49:39.219 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2024-09-18T12:49:39.219 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-18T12:49:39.219 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-18T12:49:39.219 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-18T12:49:39.219 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-18T12:49:39.220 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:39.220 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-18T12:49:39.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-18T12:49:39.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-18T12:49:39.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-18T12:49:39.220 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-18T12:49:39.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:39.374 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:39 smithi045 ceph-mon[28315]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-18T12:49:39.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:39.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:39.590 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-09-18T12:49:39.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:39.607 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2024-09-18T12:49:39.663 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:39.664 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-18T12:49:39.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:49:39.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-18T12:49:39.664 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-18T12:49:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:39.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:39.784 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-18T12:49:39.785 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:39.785 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-18T12:49:39.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-18T12:49:39.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-18T12:49:39.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-18T12:49:39.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-18T12:49:39.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-18T12:49:39.785 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-18T12:49:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:39 smithi161 ceph-mon[35784]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-18T12:49:39.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:39.931 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:39.932 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-18T12:49:39.932 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2024-09-18T12:49:39.932 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2024-09-18T12:49:39.932 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-18T12:49:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:40.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:40.017 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-18T12:49:40.017 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:49:40.017 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:40.034 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-18T12:49:40.034 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:49:40.034 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:40.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2024-09-18T12:49:40.160 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T12:49:40.218 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2024-09-18T12:49:40.219 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/7a420f37f3c0410b68e2e6c66062c46044ab36aeb8de5d6ae6a4625b4f17dcc5/merged 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/d9173415f47b0274850ca1f005e10ee8bafe562bfe6bd0fa5aa37aa667296895/merged 2024-09-18T12:49:40.220 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/0 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/b5778e0889351dbb7d682c30e0198737522942bf86b7fe65204f5bb2376fd360/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/b9aa486e73d6a39ff5871bb006b2cc900e715c748b457913cde6c62c46b21ab1/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/7ea0ea032d905fc45e9507a9f789bdf2477253f9425152fd203b4e7fd73259c0/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/6c8ea5b7a63f7575d02f2497cfb89ec41bff180972b0671c85fd8a09f02df1b1/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/18dbac43580cdb7424a2013094ba5c887de8709e33f91bd10af6527da499dfd9/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/130d0c9954017e626083bf8cac1370ae076e619477998b64bd313481b2dc8138/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/7af04f2e919d45004c3b196dcb59356d5ba054d22e44b009eded295c2223816d/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/4ad5093be7e4568302602611f97aa71f8615424cf3b572429b9e33e909609107/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/c30fb4f8654f46ba2bc98691a946db9fe82394ef29492d804822ee35bccc927c/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/a99f93d76339bb38b82813dabc99aa19e95f7a0d99027ce4c070eca816078f4b/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/14169d35af0c0e6ce48914b15e710ec623935d3fc94c5063f7299118dc289af5/merged 2024-09-18T12:49:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2024-09-18T12:49:40.222 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:49:40.222 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:49:40.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:40.222 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2024-09-18T12:49:40.276 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-18T12:49:40.276 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-18T12:49:40.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2024-09-18T12:49:40.345 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T12:49:40.402 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2024-09-18T12:49:40.402 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2024-09-18T12:49:40.403 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/7a420f37f3c0410b68e2e6c66062c46044ab36aeb8de5d6ae6a4625b4f17dcc5/merged 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/d9173415f47b0274850ca1f005e10ee8bafe562bfe6bd0fa5aa37aa667296895/merged 2024-09-18T12:49:40.404 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/0 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/b5778e0889351dbb7d682c30e0198737522942bf86b7fe65204f5bb2376fd360/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/b9aa486e73d6a39ff5871bb006b2cc900e715c748b457913cde6c62c46b21ab1/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/7ea0ea032d905fc45e9507a9f789bdf2477253f9425152fd203b4e7fd73259c0/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/6c8ea5b7a63f7575d02f2497cfb89ec41bff180972b0671c85fd8a09f02df1b1/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/18dbac43580cdb7424a2013094ba5c887de8709e33f91bd10af6527da499dfd9/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/130d0c9954017e626083bf8cac1370ae076e619477998b64bd313481b2dc8138/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/7af04f2e919d45004c3b196dcb59356d5ba054d22e44b009eded295c2223816d/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/4ad5093be7e4568302602611f97aa71f8615424cf3b572429b9e33e909609107/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/c30fb4f8654f46ba2bc98691a946db9fe82394ef29492d804822ee35bccc927c/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/a99f93d76339bb38b82813dabc99aa19e95f7a0d99027ce4c070eca816078f4b/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/14169d35af0c0e6ce48914b15e710ec623935d3fc94c5063f7299118dc289af5/merged 2024-09-18T12:49:40.405 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2024-09-18T12:49:40.406 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:49:40.406 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T12:49:40.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:40.406 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2024-09-18T12:49:40.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2024-09-18T12:49:40.450+0000 7f744b560480 -1 init, newargv = 0x55f70a894000 newargc=15 2024-09-18T12:49:40.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[77042]: starting ceph client 2024-09-18T12:49:40.457 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[77042]: starting fuse 2024-09-18T12:49:40.460 INFO:teuthology.orchestra.run.smithi045.stdout:132 2024-09-18T12:49:40.460 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [132] 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> import re 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> import os 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2024-09-18T12:49:40.461 DEBUG:teuthology.orchestra.run.smithi045:> 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> return f 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2024-09-18T12:49:40.462 DEBUG:teuthology.orchestra.run.smithi045:> ' 2024-09-18T12:49:40.583 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.77042.asok 2024-09-18T12:49:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:40.593 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.77042.asok 2024-09-18T12:49:40.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:40.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.77042.asok status 2024-09-18T12:49:40.731 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:49:40.731 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2024-09-18T12:49:40.731 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "8e98666cb045318799c9328f1ae906cc2d724fd2", 2024-09-18T12:49:40.732 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 19.2.0 (8e98666cb045318799c9328f1ae906cc2d724fd2) squid (stable)", 2024-09-18T12:49:40.732 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2024-09-18T12:49:40.732 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2024-09-18T12:49:40.732 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-18T12:49:40.732 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "77042", 2024-09-18T12:49:40.733 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2024-09-18T12:49:40.733 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:49:40.733 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2024-09-18T12:49:40.733 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2024-09-18T12:49:40.733 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 14612, 2024-09-18T12:49:40.733 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2024-09-18T12:49:40.734 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2024-09-18T12:49:40.734 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2024-09-18T12:49:40.734 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 14612 2024-09-18T12:49:40.734 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:49:40.734 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2024-09-18T12:49:40.735 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-09-18T12:49:40.735 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2024-09-18T12:49:40.735 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2420928100 2024-09-18T12:49:40.735 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:49:40.735 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:49:40.735 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2024-09-18T12:49:40.735 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-09-18T12:49:40.736 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2024-09-18T12:49:40.736 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2420928100 2024-09-18T12:49:40.736 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:49:40.736 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.14612 192.168.0.1:0/2420928100", 2024-09-18T12:49:40.736 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/2420928100", 2024-09-18T12:49:40.736 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2024-09-18T12:49:40.737 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 14, 2024-09-18T12:49:40.737 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 44, 2024-09-18T12:49:40.737 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2024-09-18T12:49:40.738 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2024-09-18T12:49:40.738 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2024-09-18T12:49:40.738 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:49:40.741 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-18T12:49:40.742 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-18T12:49:40.997 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:41.407 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:41.407 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:41.407 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:41.408 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:41.408 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:41 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:41.408 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:41 smithi045 ceph-mon[28315]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-18T12:49:41.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.489+0000 7fd4070d3640 1 -- 172.21.15.45:0/1308622844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4001033e0 msgr2=0x7fd40010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.489+0000 7fd4070d3640 1 --2- 172.21.15.45:0/1308622844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4001033e0 0x7fd40010b8d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009880 tx=0x7fd3ec02a530 comp rx=0 tx=0).stop 2024-09-18T12:49:41.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.489+0000 7fd4070d3640 1 -- 172.21.15.45:0/1308622844 shutdown_connections 2024-09-18T12:49:41.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.489+0000 7fd4070d3640 1 --2- 172.21.15.45:0/1308622844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4001033e0 0x7fd40010b8d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.489+0000 7fd4070d3640 1 --2- 172.21.15.45:0/1308622844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd400102ac0 0x7fd400102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.489+0000 7fd4070d3640 1 -- 172.21.15.45:0/1308622844 >> 172.21.15.45:0/1308622844 conn(0x7fd4000fc520 msgr2=0x7fd4000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:41.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.490+0000 7fd4070d3640 1 -- 172.21.15.45:0/1308622844 shutdown_connections 2024-09-18T12:49:41.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.490+0000 7fd4070d3640 1 -- 172.21.15.45:0/1308622844 wait complete. 2024-09-18T12:49:41.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.490+0000 7fd4070d3640 1 Processor -- start 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.490+0000 7fd4070d3640 1 -- start start 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.490+0000 7fd4070d3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd400102ac0 0x7fd400103910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.490+0000 7fd4070d3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4001033e0 0x7fd400103e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.490+0000 7fd4070d3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd40010edd0 con 0x7fd400102ac0 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.490+0000 7fd4070d3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd40010ec50 con 0x7fd4001033e0 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.490+0000 7fd404e6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd400102ac0 0x7fd400103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd404e6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd400102ac0 0x7fd400103910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47416/0 (socket says 172.21.15.45:47416) 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd404e6f640 1 -- 172.21.15.45:0/346153027 learned_addr learned my addr 172.21.15.45:0/346153027 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd3fffff640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4001033e0 0x7fd400103e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd404e6f640 1 -- 172.21.15.45:0/346153027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4001033e0 msgr2=0x7fd400103e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd404e6f640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4001033e0 0x7fd400103e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd404e6f640 1 -- 172.21.15.45:0/346153027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd400107a30 con 0x7fd400102ac0 2024-09-18T12:49:41.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd404e6f640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd400102ac0 0x7fd400103910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400c8a0 tx=0x7fd3f400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:41.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd3fdffb640 1 -- 172.21.15.45:0/346153027 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3f40079b0 con 0x7fd400102ac0 2024-09-18T12:49:41.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd3fdffb640 1 -- 172.21.15.45:0/346153027 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3f4007b50 con 0x7fd400102ac0 2024-09-18T12:49:41.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd4070d3640 1 -- 172.21.15.45:0/346153027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4001043f0 con 0x7fd400102ac0 2024-09-18T12:49:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.491+0000 7fd3fdffb640 1 -- 172.21.15.45:0/346153027 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3f4018700 con 0x7fd400102ac0 2024-09-18T12:49:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.492+0000 7fd4070d3640 1 -- 172.21.15.45:0/346153027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4001a8170 con 0x7fd400102ac0 2024-09-18T12:49:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.493+0000 7fd4070d3640 1 -- 172.21.15.45:0/346153027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40006aa90 con 0x7fd400102ac0 2024-09-18T12:49:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.493+0000 7fd3fdffb640 1 -- 172.21.15.45:0/346153027 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd3f4007d00 con 0x7fd400102ac0 2024-09-18T12:49:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.493+0000 7fd3fdffb640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fd3f006e2b0 0x7fd3f0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.494+0000 7fd3fdffb640 1 -- 172.21.15.45:0/346153027 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fd3f408e3c0 con 0x7fd400102ac0 2024-09-18T12:49:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.494+0000 7fd3fffff640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fd3f006e2b0 0x7fd3f0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:41.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.494+0000 7fd3fffff640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fd3f006e2b0 0x7fd3f0070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd400105160 tx=0x7fd3ec031400 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:41.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.498+0000 7fd3fdffb640 1 -- 172.21.15.45:0/346153027 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3f4014030 con 0x7fd400102ac0 2024-09-18T12:49:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:41 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:41 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:41 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:49:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:41 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:49:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:41 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:49:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:41 smithi161 ceph-mon[35784]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-18T12:49:41.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.715+0000 7fd4070d3640 1 -- 172.21.15.45:0/346153027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd40010b370 con 0x7fd400102ac0 2024-09-18T12:49:41.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.716+0000 7fd3fdffb640 1 -- 172.21.15.45:0/346153027 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+83 (secure 0 0 0) 0x7fd3f405bd20 con 0x7fd400102ac0 2024-09-18T12:49:41.717 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-18T12:49:41.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 -- 172.21.15.45:0/346153027 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fd3f006e2b0 msgr2=0x7fd3f0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fd3f006e2b0 0x7fd3f0070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd400105160 tx=0x7fd3ec031400 comp rx=0 tx=0).stop 2024-09-18T12:49:41.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 -- 172.21.15.45:0/346153027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd400102ac0 msgr2=0x7fd400103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:41.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd400102ac0 0x7fd400103910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400c8a0 tx=0x7fd3f400cd60 comp rx=0 tx=0).stop 2024-09-18T12:49:41.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 -- 172.21.15.45:0/346153027 shutdown_connections 2024-09-18T12:49:41.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fd3f006e2b0 0x7fd3f0070770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4001033e0 0x7fd400103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 --2- 172.21.15.45:0/346153027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd400102ac0 0x7fd400103910 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:41.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 -- 172.21.15.45:0/346153027 >> 172.21.15.45:0/346153027 conn(0x7fd4000fc520 msgr2=0x7fd400100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:41.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 -- 172.21.15.45:0/346153027 shutdown_connections 2024-09-18T12:49:41.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:41.718+0000 7fd4070d3640 1 -- 172.21.15.45:0/346153027 wait complete. 2024-09-18T12:49:42.326 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-18T12:49:42.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-18T12:49:42.327 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-09-18T12:49:42.327 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-18T12:49:42.327 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:42.327 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-18T12:49:42.327 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-18T12:49:42.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-18T12:49:42.327 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-18T12:49:42.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:42.327 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-09-18T12:49:42.346 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-09-18T12:49:42.347 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T12:49:42.348 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:42.348 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-18T12:49:42.348 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-09-18T12:49:42.348 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-18T12:49:42.348 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42348sec preferred_lft 42348sec 2024-09-18T12:49:42.348 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link noprefixroute 2024-09-18T12:49:42.348 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-09-18T12:49:42.348 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-18T12:49:42.348 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:42.349 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-09-18T12:49:42.349 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2024-09-18T12:49:42.349 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2024-09-18T12:49:42.349 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2024-09-18T12:49:42.349 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-18T12:49:42.349 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-09-18T12:49:42.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:42.514 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:42 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/346153027' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:49:42.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:42 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/346153027' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T12:49:42.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:42.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:42.568 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-18T12:49:42.593 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-09-18T12:49:42.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:42.595 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-09-18T12:49:42.659 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-09-18T12:49:42.659 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-18T12:49:42.659 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-18T12:49:42.660 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-18T12:49:42.660 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-18T12:49:42.660 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:42.660 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-09-18T12:49:42.660 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-18T12:49:42.660 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-18T12:49:42.660 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-18T12:49:42.660 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-09-18T12:49:42.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:42.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:42.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:42.968 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-09-18T12:49:42.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:42.983 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2024-09-18T12:49:43.039 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:43.040 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-09-18T12:49:43.040 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:49:43.040 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-18T12:49:43.040 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-09-18T12:49:43.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:43.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:43.157 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-18T12:49:43.157 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:43.157 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-09-18T12:49:43.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-18T12:49:43.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-18T12:49:43.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-18T12:49:43.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-18T12:49:43.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-18T12:49:43.158 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-09-18T12:49:43.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:43.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:43.280 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T12:49:43.280 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-09-18T12:49:43.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2024-09-18T12:49:43.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2024-09-18T12:49:43.280 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-09-18T12:49:43.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T12:49:43.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:43.357 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-18T12:49:43.357 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:49:43.358 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:43.373 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-18T12:49:43.373 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T12:49:43.373 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:43.428 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2024-09-18T12:49:43.489 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:43 smithi161 ceph-mon[35784]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-18T12:49:43.494 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T12:49:43.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:43 smithi045 ceph-mon[28315]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-18T12:49:43.551 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2024-09-18T12:49:43.551 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2024-09-18T12:49:43.551 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2024-09-18T12:49:43.551 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2024-09-18T12:49:43.551 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2024-09-18T12:49:43.551 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2024-09-18T12:49:43.551 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2024-09-18T12:49:43.551 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/bpf 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T12:49:43.552 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/0 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/4963fbbacfa3cc29013b82300e552176e708cd444fa8846e9a8ccf688ff9a48a/merged 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/24376b86aacb852f6cc06a0a6ef6d4a531ca6347ac31458998c1fb6f313d97e6/merged 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/6f44b09ffe051aebae1c4033cd7e29a55d9cd385659760dad6034effd7ef4428/merged 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/5d4583a77b6027481e61aa0ca9d6341c6b058b28be90bbcdffabfe1d6efc07d3/merged 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/c264e0eb29a388eb3a76a6e708162f2df1f65bf6321690dcf692584b9405e16f/merged 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/9a31157ebb8bf0e926889dad96bba51e292cf696806edb03bb871e6117186422/merged 2024-09-18T12:49:43.553 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/f1df4719413164e4b228304a751abae08ca48998e42a03f1d71cf2a983b1acdc/merged 2024-09-18T12:49:43.554 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/89bac3107bfc61da6a8db921e8a807023651c5366653f2842d481b661e05805f/merged 2024-09-18T12:49:43.554 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/6bff109e26c5c6246f903e6393d388f8f8515b85744189a3f311da7334982d55/merged 2024-09-18T12:49:43.554 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/672e3dae7374a0a04973a50ccdeba393ae446355fe261a97ac235f323bfd563d/merged 2024-09-18T12:49:43.554 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2024-09-18T12:49:43.554 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:49:43.554 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:49:43.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:43.554 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2024-09-18T12:49:43.607 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-18T12:49:43.607 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-18T12:49:43.650 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2024-09-18T12:49:43.675 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T12:49:43.732 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2024-09-18T12:49:43.732 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2024-09-18T12:49:43.732 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2024-09-18T12:49:43.732 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2024-09-18T12:49:43.732 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2024-09-18T12:49:43.732 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2024-09-18T12:49:43.732 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2024-09-18T12:49:43.732 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2024-09-18T12:49:43.732 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/bpf 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T12:49:43.733 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/0 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/4963fbbacfa3cc29013b82300e552176e708cd444fa8846e9a8ccf688ff9a48a/merged 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/24376b86aacb852f6cc06a0a6ef6d4a531ca6347ac31458998c1fb6f313d97e6/merged 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/6f44b09ffe051aebae1c4033cd7e29a55d9cd385659760dad6034effd7ef4428/merged 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/5d4583a77b6027481e61aa0ca9d6341c6b058b28be90bbcdffabfe1d6efc07d3/merged 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/c264e0eb29a388eb3a76a6e708162f2df1f65bf6321690dcf692584b9405e16f/merged 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/9a31157ebb8bf0e926889dad96bba51e292cf696806edb03bb871e6117186422/merged 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/f1df4719413164e4b228304a751abae08ca48998e42a03f1d71cf2a983b1acdc/merged 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/89bac3107bfc61da6a8db921e8a807023651c5366653f2842d481b661e05805f/merged 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/6bff109e26c5c6246f903e6393d388f8f8515b85744189a3f311da7334982d55/merged 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/containers/storage/overlay/672e3dae7374a0a04973a50ccdeba393ae446355fe261a97ac235f323bfd563d/merged 2024-09-18T12:49:43.734 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2024-09-18T12:49:43.735 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:49:43.735 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T12:49:43.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:43.735 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2024-09-18T12:49:43.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2024-09-18T12:49:43.756+0000 7f40afdef480 -1 init, newargv = 0x5645396d1e90 newargc=15 2024-09-18T12:49:43.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[61546]: starting ceph client 2024-09-18T12:49:43.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[61546]: starting fuse 2024-09-18T12:49:43.773 INFO:teuthology.orchestra.run.smithi161.stdout:129 2024-09-18T12:49:43.773 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-18T12:49:43.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo stdin-killer -- python3 -c ' 2024-09-18T12:49:43.773 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2024-09-18T12:49:43.774 DEBUG:teuthology.orchestra.run.smithi161:> import re 2024-09-18T12:49:43.774 DEBUG:teuthology.orchestra.run.smithi161:> import os 2024-09-18T12:49:43.774 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2024-09-18T12:49:43.774 DEBUG:teuthology.orchestra.run.smithi161:> 2024-09-18T12:49:43.774 DEBUG:teuthology.orchestra.run.smithi161:> def _find_admin_socket(client_name): 2024-09-18T12:49:43.774 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-18T12:49:43.774 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2024-09-18T12:49:43.774 DEBUG:teuthology.orchestra.run.smithi161:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-18T12:49:43.774 DEBUG:teuthology.orchestra.run.smithi161:> 2024-09-18T12:49:43.774 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> contents = proc_f.read() 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> if mountpoint in contents: 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> return f 2024-09-18T12:49:43.775 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-18T12:49:43.776 DEBUG:teuthology.orchestra.run.smithi161:> 2024-09-18T12:49:43.776 DEBUG:teuthology.orchestra.run.smithi161:> print(_find_admin_socket("client.1")) 2024-09-18T12:49:43.776 DEBUG:teuthology.orchestra.run.smithi161:> ' 2024-09-18T12:49:43.890 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.61546.asok 2024-09-18T12:49:43.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-09-18T12:49:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T12:49:43.901 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61546.asok 2024-09-18T12:49:43.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:43.901 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61546.asok status 2024-09-18T12:49:44.035 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "8e98666cb045318799c9328f1ae906cc2d724fd2", 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 19.2.0 (8e98666cb045318799c9328f1ae906cc2d724fd2) squid (stable)", 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "61546", 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2024-09-18T12:49:44.036 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 24347, 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 24347 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 3439559536 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-18T12:49:44.037 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 3439559536 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.24347 192.168.0.1:0/3439559536", 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "192.168.0.1:0/3439559536", 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 14, 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 44, 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "blocklisted": false, 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2024-09-18T12:49:44.038 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-18T12:49:44.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:44.044 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2024-09-18T12:49:44.044 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:44.064 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2024-09-18T12:49:44.064 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:44.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:44.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:44.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:44.138 DEBUG:teuthology.orchestra.run.smithi161:> stat --file-system '--printf=%T 2024-09-18T12:49:44.138 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:44.154 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2024-09-18T12:49:44.154 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:44.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T12:49:44.154 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:44.223 INFO:teuthology.run_tasks:Running task print... 2024-09-18T12:49:44.233 INFO:teuthology.task.print:**** done client 2024-09-18T12:49:44.233 INFO:teuthology.run_tasks:Running task parallel... 2024-09-18T12:49:44.256 INFO:teuthology.task.parallel:starting parallel... 2024-09-18T12:49:44.303 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-18T12:49:44.304 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:49:44.304 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:49:44.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-18T12:49:44.305 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-18T12:49:44.305 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-18T12:49:44.309 INFO:tasks.workunit:Pulling workunits from ref e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:44.309 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-18T12:49:44.309 INFO:tasks.workunit:timeout=3h 2024-09-18T12:49:44.309 INFO:tasks.workunit:cleanup=True 2024-09-18T12:49:44.309 DEBUG:teuthology.orchestra.run.smithi045:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:44.330 INFO:teuthology.orchestra.run.smithi045.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:44.330 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-18T12:49:44.330 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 84h/132d Inode: 1 Links: 2 2024-09-18T12:49:44.330 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:49:44.331 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-18T12:49:44.331 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-18T12:49:44.331 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-18 12:49:19.140660185 +0000 2024-09-18T12:49:44.331 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-18 12:49:44.134856514 +0000 2024-09-18T12:49:44.331 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2024-09-18T12:49:44.331 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-18T12:49:44.331 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-18T12:49:44.401 DEBUG:teuthology.orchestra.run.smithi161:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:44.418 INFO:teuthology.orchestra.run.smithi161.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:44.418 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-18T12:49:44.418 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-18T12:49:44.419 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:49:44.419 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-18T12:49:44.419 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-18T12:49:44.419 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-18 12:49:44.396119945 +0000 2024-09-18T12:49:44.419 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-18 12:49:44.396119945 +0000 2024-09-18T12:49:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-09-18T12:49:44.419 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-18T12:49:44.419 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-18T12:49:44.488 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:44.489 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:49:44.506 INFO:tasks.workunit.client.0.smithi045.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-18T12:49:44.545 INFO:tasks.workunit.client.1.smithi161.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-18T12:49:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:45.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.017+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2952424267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ccc100860 msgr2=0x7f6ccc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:45.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.017+0000 7f6cd46fb640 1 --2- 172.21.15.45:0/2952424267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ccc100860 0x7f6ccc100c60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009880 tx=0x7f6cc402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:45.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.017+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2952424267 shutdown_connections 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.017+0000 7f6cd46fb640 1 --2- 172.21.15.45:0/2952424267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc101a60 0x7f6ccc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.017+0000 7f6cd46fb640 1 --2- 172.21.15.45:0/2952424267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ccc100860 0x7f6ccc100c60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.017+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2952424267 >> 172.21.15.45:0/2952424267 conn(0x7f6ccc0fc010 msgr2=0x7f6ccc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.017+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2952424267 shutdown_connections 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.017+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2952424267 wait complete. 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.017+0000 7f6cd46fb640 1 Processor -- start 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd46fb640 1 -- start start 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd46fb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ccc100860 0x7f6ccc1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd46fb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc101a60 0x7f6ccc197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd46fb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc109680 con 0x7f6ccc100860 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd46fb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc109500 con 0x7f6ccc101a60 2024-09-18T12:49:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd2497640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ccc100860 0x7f6ccc1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd2497640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ccc100860 0x7f6ccc1974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55566/0 (socket says 172.21.15.45:55566) 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd2497640 1 -- 172.21.15.45:0/2697569846 learned_addr learned my addr 172.21.15.45:0/2697569846 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd1c96640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc101a60 0x7f6ccc197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd2497640 1 -- 172.21.15.45:0/2697569846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc101a60 msgr2=0x7f6ccc197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd2497640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc101a60 0x7f6ccc197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.018+0000 7f6cd2497640 1 -- 172.21.15.45:0/2697569846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc1980b0 con 0x7f6ccc100860 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.019+0000 7f6cd2497640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ccc100860 0x7f6ccc1974f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4006010 tx=0x7f6cc40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.019+0000 7f6ccb7fe640 1 -- 172.21.15.45:0/2697569846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6cc403f070 con 0x7f6ccc100860 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.019+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2697569846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ccc19ca90 con 0x7f6ccc100860 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.019+0000 7f6ccb7fe640 1 -- 172.21.15.45:0/2697569846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6cc4004a50 con 0x7f6ccc100860 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.019+0000 7f6ccb7fe640 1 -- 172.21.15.45:0/2697569846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6cc4035030 con 0x7f6ccc100860 2024-09-18T12:49:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.019+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2697569846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ccc19d020 con 0x7f6ccc100860 2024-09-18T12:49:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.020+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2697569846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ccc100c60 con 0x7f6ccc100860 2024-09-18T12:49:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.020+0000 7f6ccb7fe640 1 -- 172.21.15.45:0/2697569846 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6cc4042070 con 0x7f6ccc100860 2024-09-18T12:49:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.021+0000 7f6ccb7fe640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6cb406e2b0 0x7f6cb4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.021+0000 7f6ccb7fe640 1 -- 172.21.15.45:0/2697569846 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f6cc40aed20 con 0x7f6ccc100860 2024-09-18T12:49:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.021+0000 7f6cd1c96640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6cb406e2b0 0x7f6cb4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.021+0000 7f6cd1c96640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6cb406e2b0 0x7f6cb4070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0005fd0 tx=0x7f6cc0005850 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:45.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.025+0000 7f6ccb7fe640 1 -- 172.21.15.45:0/2697569846 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6cc4004c00 con 0x7f6ccc100860 2024-09-18T12:49:45.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.202+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2697569846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f6ccc19d850 con 0x7f6ccc100860 2024-09-18T12:49:45.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.202+0000 7f6ccb7fe640 1 -- 172.21.15.45:0/2697569846 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v43)=0 v43) ==== 155+0+0 (secure 0 0 0) 0x7f6cc407c680 con 0x7f6ccc100860 2024-09-18T12:49:45.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.204+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2697569846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6cb406e2b0 msgr2=0x7f6cb4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:45.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.204+0000 7f6cd46fb640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6cb406e2b0 0x7f6cb4070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0005fd0 tx=0x7f6cc0005850 comp rx=0 tx=0).stop 2024-09-18T12:49:45.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.204+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2697569846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ccc100860 msgr2=0x7f6ccc1974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:45.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.204+0000 7f6cd46fb640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ccc100860 0x7f6ccc1974f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4006010 tx=0x7f6cc40045e0 comp rx=0 tx=0).stop 2024-09-18T12:49:45.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.205+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2697569846 shutdown_connections 2024-09-18T12:49:45.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.205+0000 7f6cd46fb640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f6cb406e2b0 0x7f6cb4070770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:45.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.205+0000 7f6cd46fb640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc101a60 0x7f6ccc197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:45.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.205+0000 7f6cd46fb640 1 --2- 172.21.15.45:0/2697569846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ccc100860 0x7f6ccc1974f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:45.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.205+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2697569846 >> 172.21.15.45:0/2697569846 conn(0x7f6ccc0fc010 msgr2=0x7f6ccc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:45.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.205+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2697569846 shutdown_connections 2024-09-18T12:49:45.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:45.205+0000 7f6cd46fb640 1 -- 172.21.15.45:0/2697569846 wait complete. 2024-09-18T12:49:45.694 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:45 smithi161 ceph-mon[35784]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-18T12:49:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:45 smithi045 ceph-mon[28315]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-18T12:49:45.823 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-18T12:49:46.123 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:46.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.664+0000 7f0a24744640 1 -- 172.21.15.45:0/2486344629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c101960 msgr2=0x7f0a1c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:46.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.664+0000 7f0a24744640 1 --2- 172.21.15.45:0/2486344629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c101960 0x7f0a1c101d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009c20 tx=0x7f0a0c02a970 comp rx=0 tx=0).stop 2024-09-18T12:49:46.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.664+0000 7f0a24744640 1 -- 172.21.15.45:0/2486344629 shutdown_connections 2024-09-18T12:49:46.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.664+0000 7f0a24744640 1 --2- 172.21.15.45:0/2486344629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a1c102b60 0x7f0a1c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:46.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.664+0000 7f0a24744640 1 --2- 172.21.15.45:0/2486344629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c101960 0x7f0a1c101d60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:46.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.664+0000 7f0a24744640 1 -- 172.21.15.45:0/2486344629 >> 172.21.15.45:0/2486344629 conn(0x7f0a1c0fd0f0 msgr2=0x7f0a1c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:46.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.664+0000 7f0a24744640 1 -- 172.21.15.45:0/2486344629 shutdown_connections 2024-09-18T12:49:46.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.664+0000 7f0a24744640 1 -- 172.21.15.45:0/2486344629 wait complete. 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a24744640 1 Processor -- start 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a24744640 1 -- start start 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a24744640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c101960 0x7f0a1c199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a24744640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a1c102b60 0x7f0a1c199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a24744640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c10a7a0 con 0x7f0a1c101960 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a24744640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c10a620 con 0x7f0a1c102b60 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a224e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c101960 0x7f0a1c199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a224e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c101960 0x7f0a1c199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55588/0 (socket says 172.21.15.45:55588) 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a224e0640 1 -- 172.21.15.45:0/2536994934 learned_addr learned my addr 172.21.15.45:0/2536994934 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a21cdf640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a1c102b60 0x7f0a1c199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a224e0640 1 -- 172.21.15.45:0/2536994934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a1c102b60 msgr2=0x7f0a1c199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a224e0640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a1c102b60 0x7f0a1c199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:46.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.665+0000 7f0a224e0640 1 -- 172.21.15.45:0/2536994934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c19a2d0 con 0x7f0a1c101960 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.666+0000 7f0a224e0640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c101960 0x7f0a1c199710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c006010 tx=0x7f0a0c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.666+0000 7f0a1b7fe640 1 -- 172.21.15.45:0/2536994934 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a0c047070 con 0x7f0a1c101960 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.666+0000 7f0a1b7fe640 1 -- 172.21.15.45:0/2536994934 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a0c003e30 con 0x7f0a1c101960 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.666+0000 7f0a24744640 1 -- 172.21.15.45:0/2536994934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1c19ecb0 con 0x7f0a1c101960 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.666+0000 7f0a1b7fe640 1 -- 172.21.15.45:0/2536994934 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a0c034070 con 0x7f0a1c101960 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.666+0000 7f0a24744640 1 -- 172.21.15.45:0/2536994934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1c19f210 con 0x7f0a1c101960 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.667+0000 7f0a24744640 1 -- 172.21.15.45:0/2536994934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1c101d60 con 0x7f0a1c101960 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.667+0000 7f0a1b7fe640 1 -- 172.21.15.45:0/2536994934 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0a0c04a070 con 0x7f0a1c101960 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.668+0000 7f0a1b7fe640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0a0406e310 0x7f0a040707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.668+0000 7f0a1b7fe640 1 -- 172.21.15.45:0/2536994934 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f0a0c0aed00 con 0x7f0a1c101960 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.668+0000 7f0a21cdf640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0a0406e310 0x7f0a040707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.668+0000 7f0a21cdf640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0a0406e310 0x7f0a040707d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c19abc0 tx=0x7f0a10005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:46.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.672+0000 7f0a1b7fe640 1 -- 172.21.15.45:0/2536994934 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a0c0b2030 con 0x7f0a1c101960 2024-09-18T12:49:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.848+0000 7f0a24744640 1 -- 172.21.15.45:0/2536994934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f0a1c19f710 con 0x7f0a1c101960 2024-09-18T12:49:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.849+0000 7f0a1b7fe640 1 -- 172.21.15.45:0/2536994934 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v43)=0 v43) ==== 163+0+0 (secure 0 0 0) 0x7f0a0c03f070 con 0x7f0a1c101960 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 -- 172.21.15.45:0/2536994934 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0a0406e310 msgr2=0x7f0a040707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0a0406e310 0x7f0a040707d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c19abc0 tx=0x7f0a10005f90 comp rx=0 tx=0).stop 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 -- 172.21.15.45:0/2536994934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c101960 msgr2=0x7f0a1c199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c101960 0x7f0a1c199710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c006010 tx=0x7f0a0c02f5d0 comp rx=0 tx=0).stop 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 -- 172.21.15.45:0/2536994934 shutdown_connections 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f0a0406e310 0x7f0a040707d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a1c102b60 0x7f0a1c199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 --2- 172.21.15.45:0/2536994934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c101960 0x7f0a1c199710 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 -- 172.21.15.45:0/2536994934 >> 172.21.15.45:0/2536994934 conn(0x7f0a1c0fd0f0 msgr2=0x7f0a1c074660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 -- 172.21.15.45:0/2536994934 shutdown_connections 2024-09-18T12:49:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:46.851+0000 7f0a24744640 1 -- 172.21.15.45:0/2536994934 wait complete. 2024-09-18T12:49:47.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:47 smithi045 ceph-mon[28315]: pgmap v190: 65 pgs: 65 active+clean; 585 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-18T12:49:47.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:47 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:47.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-18T12:49:47.740 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:47 smithi161 ceph-mon[35784]: pgmap v190: 65 pgs: 65 active+clean; 585 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-18T12:49:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:47 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:49:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.170+0000 7fa2de420640 1 -- 172.21.15.45:0/2378330539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d80ffc20 msgr2=0x7fa2d8100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.170+0000 7fa2de420640 1 --2- 172.21.15.45:0/2378330539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d80ffc20 0x7fa2d8100020 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009880 tx=0x7fa2c802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.170+0000 7fa2de420640 1 -- 172.21.15.45:0/2378330539 shutdown_connections 2024-09-18T12:49:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.170+0000 7fa2de420640 1 --2- 172.21.15.45:0/2378330539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d8102c00 0x7fa2d8103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.170+0000 7fa2de420640 1 --2- 172.21.15.45:0/2378330539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d80ffc20 0x7fa2d8100020 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.170+0000 7fa2de420640 1 -- 172.21.15.45:0/2378330539 >> 172.21.15.45:0/2378330539 conn(0x7fa2d80fb770 msgr2=0x7fa2d80fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.171+0000 7fa2de420640 1 -- 172.21.15.45:0/2378330539 shutdown_connections 2024-09-18T12:49:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.171+0000 7fa2de420640 1 -- 172.21.15.45:0/2378330539 wait complete. 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.171+0000 7fa2de420640 1 Processor -- start 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.171+0000 7fa2de420640 1 -- start start 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2de420640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d80ffc20 0x7fa2d8199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2de420640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d8102c00 0x7fa2d8199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2de420640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d810a800 con 0x7fa2d80ffc20 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2de420640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d810a680 con 0x7fa2d8102c00 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d80ffc20 0x7fa2d8199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d80ffc20 0x7fa2d8199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55594/0 (socket says 172.21.15.45:55594) 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2d7fff640 1 -- 172.21.15.45:0/1398717984 learned_addr learned my addr 172.21.15.45:0/1398717984 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2d77fe640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d8102c00 0x7fa2d8199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2d7fff640 1 -- 172.21.15.45:0/1398717984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d8102c00 msgr2=0x7fa2d8199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2d7fff640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d8102c00 0x7fa2d8199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2d7fff640 1 -- 172.21.15.45:0/1398717984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d819a300 con 0x7fa2d80ffc20 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.172+0000 7fa2d7fff640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d80ffc20 0x7fa2d8199740 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8006010 tx=0x7fa2c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.173+0000 7fa2d57fa640 1 -- 172.21.15.45:0/1398717984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2c803f070 con 0x7fa2d80ffc20 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.173+0000 7fa2d57fa640 1 -- 172.21.15.45:0/1398717984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2c80044d0 con 0x7fa2d80ffc20 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.173+0000 7fa2de420640 1 -- 172.21.15.45:0/1398717984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d819ece0 con 0x7fa2d80ffc20 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.173+0000 7fa2d57fa640 1 -- 172.21.15.45:0/1398717984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2c8035030 con 0x7fa2d80ffc20 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.173+0000 7fa2de420640 1 -- 172.21.15.45:0/1398717984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d819f240 con 0x7fa2d80ffc20 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.174+0000 7fa2de420640 1 -- 172.21.15.45:0/1398717984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d8100020 con 0x7fa2d80ffc20 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.174+0000 7fa2d57fa640 1 -- 172.21.15.45:0/1398717984 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa2c8042070 con 0x7fa2d80ffc20 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.175+0000 7fa2d57fa640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa2c006e2b0 0x7fa2c0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.175+0000 7fa2d57fa640 1 -- 172.21.15.45:0/1398717984 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fa2c80aed30 con 0x7fa2d80ffc20 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.175+0000 7fa2d77fe640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa2c006e2b0 0x7fa2c0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.175+0000 7fa2d77fe640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa2c006e2b0 0x7fa2c0070770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2d819abf0 tx=0x7fa2cc009110 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.179+0000 7fa2d57fa640 1 -- 172.21.15.45:0/1398717984 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2c807c690 con 0x7fa2d80ffc20 2024-09-18T12:49:48.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.354+0000 7fa2de420640 1 -- 172.21.15.45:0/1398717984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7fa2d819f560 con 0x7fa2d80ffc20 2024-09-18T12:49:48.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.354+0000 7fa2d57fa640 1 -- 172.21.15.45:0/1398717984 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v43)=0 v43) ==== 135+0+0 (secure 0 0 0) 0x7fa2c8080340 con 0x7fa2d80ffc20 2024-09-18T12:49:48.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 -- 172.21.15.45:0/1398717984 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa2c006e2b0 msgr2=0x7fa2c0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:48.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa2c006e2b0 0x7fa2c0070770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2d819abf0 tx=0x7fa2cc009110 comp rx=0 tx=0).stop 2024-09-18T12:49:48.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 -- 172.21.15.45:0/1398717984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d80ffc20 msgr2=0x7fa2d8199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d80ffc20 0x7fa2d8199740 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8006010 tx=0x7fa2c80048f0 comp rx=0 tx=0).stop 2024-09-18T12:49:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 -- 172.21.15.45:0/1398717984 shutdown_connections 2024-09-18T12:49:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fa2c006e2b0 0x7fa2c0070770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d8102c00 0x7fa2d8199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 --2- 172.21.15.45:0/1398717984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2d80ffc20 0x7fa2d8199740 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 -- 172.21.15.45:0/1398717984 >> 172.21.15.45:0/1398717984 conn(0x7fa2d80fb770 msgr2=0x7fa2d8100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 -- 172.21.15.45:0/1398717984 shutdown_connections 2024-09-18T12:49:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:48.356+0000 7fa2de420640 1 -- 172.21.15.45:0/1398717984 wait complete. 2024-09-18T12:49:48.967 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-18T12:49:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:49:49.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.646+0000 7f41842d5640 1 -- 172.21.15.45:0/3975732326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f417c101a60 msgr2=0x7f417c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:49.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.646+0000 7f41842d5640 1 --2- 172.21.15.45:0/3975732326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f417c101a60 0x7f417c101ee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f416c009880 tx=0x7f416c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.646+0000 7f41842d5640 1 -- 172.21.15.45:0/3975732326 shutdown_connections 2024-09-18T12:49:49.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.646+0000 7f41842d5640 1 --2- 172.21.15.45:0/3975732326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f417c101a60 0x7f417c101ee0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.646+0000 7f41842d5640 1 --2- 172.21.15.45:0/3975732326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f417c100860 0x7f417c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.646+0000 7f41842d5640 1 -- 172.21.15.45:0/3975732326 >> 172.21.15.45:0/3975732326 conn(0x7f417c0fc010 msgr2=0x7f417c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.646+0000 7f41842d5640 1 -- 172.21.15.45:0/3975732326 shutdown_connections 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.646+0000 7f41842d5640 1 -- 172.21.15.45:0/3975732326 wait complete. 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f41842d5640 1 Processor -- start 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f41842d5640 1 -- start start 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f41842d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f417c100860 0x7f417c196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f41842d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f417c101a60 0x7f417c196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f41842d5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f417c109720 con 0x7f417c101a60 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f41842d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1095a0 con 0x7f417c100860 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f4181870640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f417c101a60 0x7f417c196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f4181870640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f417c101a60 0x7f417c196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55618/0 (socket says 172.21.15.45:55618) 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f4181870640 1 -- 172.21.15.45:0/126172668 learned_addr learned my addr 172.21.15.45:0/126172668 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:49:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f4182071640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f417c100860 0x7f417c196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f4181870640 1 -- 172.21.15.45:0/126172668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f417c100860 msgr2=0x7f417c196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f4181870640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f417c100860 0x7f417c196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.647+0000 7f4181870640 1 -- 172.21.15.45:0/126172668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c196fd0 con 0x7f417c101a60 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.648+0000 7f4181870640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f417c101a60 0x7f417c196950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f416c006010 tx=0x7f416c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.648+0000 7f41737fe640 1 -- 172.21.15.45:0/126172668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f416c03f070 con 0x7f417c101a60 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.648+0000 7f41842d5640 1 -- 172.21.15.45:0/126172668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c19b9b0 con 0x7f417c101a60 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.648+0000 7f41737fe640 1 -- 172.21.15.45:0/126172668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f416c0044d0 con 0x7f417c101a60 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.648+0000 7f41737fe640 1 -- 172.21.15.45:0/126172668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f416c035030 con 0x7f417c101a60 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.648+0000 7f41842d5640 1 -- 172.21.15.45:0/126172668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c19bfc0 con 0x7f417c101a60 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.649+0000 7f41842d5640 1 -- 172.21.15.45:0/126172668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417c100c40 con 0x7f417c101a60 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.650+0000 7f41737fe640 1 -- 172.21.15.45:0/126172668 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f416c042070 con 0x7f417c101a60 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.650+0000 7f41737fe640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f416806e2b0 0x7f4168070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:49:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.650+0000 7f41737fe640 1 -- 172.21.15.45:0/126172668 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f416c0aee00 con 0x7f417c101a60 2024-09-18T12:49:49.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.650+0000 7f4182071640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f416806e2b0 0x7f4168070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:49:49.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.651+0000 7f4182071640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f416806e2b0 0x7f4168070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f417c1018c0 tx=0x7f4178009110 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:49:49.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.655+0000 7f41737fe640 1 -- 172.21.15.45:0/126172668 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f416c07c760 con 0x7f417c101a60 2024-09-18T12:49:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:49 smithi045 ceph-mon[28315]: pgmap v191: 65 pgs: 65 active+clean; 585 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-18T12:49:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:49 smithi161 ceph-mon[35784]: pgmap v191: 65 pgs: 65 active+clean; 585 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-18T12:49:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:49:49.847+0000 7f41842d5640 1 -- 172.21.15.45:0/126172668 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7f417c0627a0 con 0x7f416806e2b0 2024-09-18T12:49:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:51 smithi045 ceph-mon[28315]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:51 smithi045 ceph-mon[28315]: pgmap v192: 65 pgs: 65 active+clean; 585 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-18T12:49:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:51 smithi161 ceph-mon[35784]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:49:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:51 smithi161 ceph-mon[35784]: pgmap v192: 65 pgs: 65 active+clean; 585 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-18T12:49:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:53 smithi045 ceph-mon[28315]: pgmap v193: 65 pgs: 65 active+clean; 585 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-18T12:49:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:53 smithi161 ceph-mon[35784]: pgmap v193: 65 pgs: 65 active+clean; 585 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-18T12:49:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:55 smithi045 ceph-mon[28315]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-18T12:49:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:55 smithi161 ceph-mon[35784]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-18T12:49:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:57 smithi045 ceph-mon[28315]: pgmap v195: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-18T12:49:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:57 smithi161 ceph-mon[35784]: pgmap v195: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-18T12:49:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:49:59 smithi045 ceph-mon[28315]: pgmap v196: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-18T12:49:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:49:59 smithi161 ceph-mon[35784]: pgmap v196: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-18T12:50:00.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:00 smithi045 ceph-mon[28315]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:50:00.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:00 smithi045 ceph-mon[28315]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:50:00.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:00 smithi045 ceph-mon[28315]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:50:00.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:00 smithi161 ceph-mon[35784]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:50:00.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:00 smithi161 ceph-mon[35784]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:50:00.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:00 smithi161 ceph-mon[35784]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:50:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:01 smithi045 ceph-mon[28315]: pgmap v197: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-18T12:50:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:01 smithi161 ceph-mon[35784]: pgmap v197: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-18T12:50:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:03 smithi045 ceph-mon[28315]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-18T12:50:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:03 smithi161 ceph-mon[35784]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-18T12:50:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:05 smithi045 ceph-mon[28315]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-18T12:50:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:05 smithi161 ceph-mon[35784]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-18T12:50:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:07 smithi045 ceph-mon[28315]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-18T12:50:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:07 smithi161 ceph-mon[35784]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-18T12:50:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:09 smithi045 ceph-mon[28315]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:09 smithi161 ceph-mon[35784]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:11.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:11 smithi045 ceph-mon[28315]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:11 smithi161 ceph-mon[35784]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:13 smithi045 ceph-mon[28315]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:13 smithi161 ceph-mon[35784]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:15 smithi045 ceph-mon[28315]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:15 smithi161 ceph-mon[35784]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:17 smithi045 ceph-mon[28315]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:17 smithi161 ceph-mon[35784]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:19.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:19 smithi045 ceph-mon[28315]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:19 smithi161 ceph-mon[35784]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.003+0000 7f41737fe640 1 -- 172.21.15.45:0/126172668 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f417c0627a0 con 0x7f416806e2b0 2024-09-18T12:50:21.005 INFO:teuthology.orchestra.run.smithi045.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:50:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 -- 172.21.15.45:0/126172668 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f416806e2b0 msgr2=0x7f4168070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f416806e2b0 0x7f4168070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f417c1018c0 tx=0x7f4178009110 comp rx=0 tx=0).stop 2024-09-18T12:50:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 -- 172.21.15.45:0/126172668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f417c101a60 msgr2=0x7f417c196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f417c101a60 0x7f417c196950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f416c006010 tx=0x7f416c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 -- 172.21.15.45:0/126172668 shutdown_connections 2024-09-18T12:50:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f416806e2b0 0x7f4168070770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f417c101a60 0x7f417c196950 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 --2- 172.21.15.45:0/126172668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f417c100860 0x7f417c196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 -- 172.21.15.45:0/126172668 >> 172.21.15.45:0/126172668 conn(0x7f417c0fc010 msgr2=0x7f417c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 -- 172.21.15.45:0/126172668 shutdown_connections 2024-09-18T12:50:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:21.006+0000 7f41842d5640 1 -- 172.21.15.45:0/126172668 wait complete. 2024-09-18T12:50:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:21 smithi045 ceph-mon[28315]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:50:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:50:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:50:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:50:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:21 smithi161 ceph-mon[35784]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:50:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:50:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:50:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:50:21.855 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-18T12:50:22.206 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:50:22.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:22 smithi045 ceph-mon[28315]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:50:22.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:22 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:50:22.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:22 smithi045 ceph-mon[28315]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:50:22.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:22 smithi161 ceph-mon[35784]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:50:22.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:22 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:50:22.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:22 smithi161 ceph-mon[35784]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:50:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.579+0000 7f7df33b1640 1 -- 172.21.15.45:0/1916978612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec101960 msgr2=0x7f7dec101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.579+0000 7f7df33b1640 1 --2- 172.21.15.45:0/1916978612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec101960 0x7f7dec101d60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009880 tx=0x7f7de802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.580+0000 7f7df33b1640 1 -- 172.21.15.45:0/1916978612 shutdown_connections 2024-09-18T12:50:23.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.580+0000 7f7df33b1640 1 --2- 172.21.15.45:0/1916978612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dec102b60 0x7f7dec102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.580+0000 7f7df33b1640 1 --2- 172.21.15.45:0/1916978612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec101960 0x7f7dec101d60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.580+0000 7f7df33b1640 1 -- 172.21.15.45:0/1916978612 >> 172.21.15.45:0/1916978612 conn(0x7f7dec0fd110 msgr2=0x7f7dec0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:23.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.580+0000 7f7df33b1640 1 -- 172.21.15.45:0/1916978612 shutdown_connections 2024-09-18T12:50:23.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.580+0000 7f7df33b1640 1 -- 172.21.15.45:0/1916978612 wait complete. 2024-09-18T12:50:23.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.581+0000 7f7df33b1640 1 Processor -- start 2024-09-18T12:50:23.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.581+0000 7f7df33b1640 1 -- start start 2024-09-18T12:50:23.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.581+0000 7f7df33b1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dec101960 0x7f7dec1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.581+0000 7f7df33b1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec102b60 0x7f7dec197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.582+0000 7f7df33b1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec10a7a0 con 0x7f7dec102b60 2024-09-18T12:50:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.582+0000 7f7df114d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dec101960 0x7f7dec1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.582+0000 7f7df094c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec102b60 0x7f7dec197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.582+0000 7f7df114d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dec101960 0x7f7dec1974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:35096/0 (socket says 172.21.15.45:35096) 2024-09-18T12:50:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.582+0000 7f7df094c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec102b60 0x7f7dec197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59054/0 (socket says 172.21.15.45:59054) 2024-09-18T12:50:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.582+0000 7f7df114d640 1 -- 172.21.15.45:0/1352095299 learned_addr learned my addr 172.21.15.45:0/1352095299 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:50:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.582+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec10a620 con 0x7f7dec101960 2024-09-18T12:50:23.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.582+0000 7f7df094c640 1 -- 172.21.15.45:0/1352095299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dec101960 msgr2=0x7f7dec1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.582+0000 7f7df094c640 1 --2- 172.21.15.45:0/1352095299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dec101960 0x7f7dec1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.582+0000 7f7df094c640 1 -- 172.21.15.45:0/1352095299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dec198090 con 0x7f7dec102b60 2024-09-18T12:50:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.583+0000 7f7df094c640 1 --2- 172.21.15.45:0/1352095299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec102b60 0x7f7dec197a10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00e970 tx=0x7f7ddc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.583+0000 7f7de27fc640 1 -- 172.21.15.45:0/1352095299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ddc00cac0 con 0x7f7dec102b60 2024-09-18T12:50:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.583+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dec19cad0 con 0x7f7dec102b60 2024-09-18T12:50:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.583+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dec19d060 con 0x7f7dec102b60 2024-09-18T12:50:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.583+0000 7f7de27fc640 1 -- 172.21.15.45:0/1352095299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ddc00cc60 con 0x7f7dec102b60 2024-09-18T12:50:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.584+0000 7f7de27fc640 1 -- 172.21.15.45:0/1352095299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ddc0047a0 con 0x7f7dec102b60 2024-09-18T12:50:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.584+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd00052c0 con 0x7f7dec102b60 2024-09-18T12:50:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.585+0000 7f7de27fc640 1 -- 172.21.15.45:0/1352095299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7ddc004a60 con 0x7f7dec102b60 2024-09-18T12:50:23.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.586+0000 7f7de27fc640 1 --2- 172.21.15.45:0/1352095299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7dd806e0b0 0x7f7dd8070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:23.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.586+0000 7f7de27fc640 1 -- 172.21.15.45:0/1352095299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f7ddc08e5a0 con 0x7f7dec102b60 2024-09-18T12:50:23.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.586+0000 7f7df114d640 1 --2- 172.21.15.45:0/1352095299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7dd806e0b0 0x7f7dd8070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:23.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.587+0000 7f7df114d640 1 --2- 172.21.15.45:0/1352095299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7dd806e0b0 0x7f7dd8070570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7de8000c00 tx=0x7f7de80058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:23.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.594+0000 7f7de27fc640 1 -- 172.21.15.45:0/1352095299 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ddc05bf80 con 0x7f7dec102b60 2024-09-18T12:50:23.675 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:23 smithi045 ceph-mon[28315]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:23 smithi161 ceph-mon[35784]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:23.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.829+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7dd0000bf0 con 0x7f7dd806e0b0 2024-09-18T12:50:23.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.831+0000 7f7de27fc640 1 -- 172.21.15.45:0/1352095299 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f7dd0000bf0 con 0x7f7dd806e0b0 2024-09-18T12:50:23.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.833+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7dd806e0b0 msgr2=0x7f7dd8070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.833+0000 7f7df33b1640 1 --2- 172.21.15.45:0/1352095299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7dd806e0b0 0x7f7dd8070570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7de8000c00 tx=0x7f7de80058d0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.833+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec102b60 msgr2=0x7f7dec197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.833+0000 7f7df33b1640 1 --2- 172.21.15.45:0/1352095299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec102b60 0x7f7dec197a10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00e970 tx=0x7f7ddc00ee30 comp rx=0 tx=0).stop 2024-09-18T12:50:23.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.834+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 shutdown_connections 2024-09-18T12:50:23.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.834+0000 7f7df33b1640 1 --2- 172.21.15.45:0/1352095299 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f7dd806e0b0 0x7f7dd8070570 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.834+0000 7f7df33b1640 1 --2- 172.21.15.45:0/1352095299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec102b60 0x7f7dec197a10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.834+0000 7f7df33b1640 1 --2- 172.21.15.45:0/1352095299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7dec101960 0x7f7dec1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.834+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 >> 172.21.15.45:0/1352095299 conn(0x7f7dec0fd110 msgr2=0x7f7dec0ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:23.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.834+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 shutdown_connections 2024-09-18T12:50:23.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.834+0000 7f7df33b1640 1 -- 172.21.15.45:0/1352095299 wait complete. 2024-09-18T12:50:23.846 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:50:23.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.925+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/2848661331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18102470 msgr2=0x7fbb18104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.925+0000 7fbb1fa6b640 1 --2- 172.21.15.45:0/2848661331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18102470 0x7fbb18104860 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009880 tx=0x7fbb1402e8b0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.925+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/2848661331 shutdown_connections 2024-09-18T12:50:23.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.925+0000 7fbb1fa6b640 1 --2- 172.21.15.45:0/2848661331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb18104da0 0x7fbb18107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.925+0000 7fbb1fa6b640 1 --2- 172.21.15.45:0/2848661331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18102470 0x7fbb18104860 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.925+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/2848661331 >> 172.21.15.45:0/2848661331 conn(0x7fbb180fc010 msgr2=0x7fbb180fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:23.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.925+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/2848661331 shutdown_connections 2024-09-18T12:50:23.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.925+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/2848661331 wait complete. 2024-09-18T12:50:23.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1fa6b640 1 Processor -- start 2024-09-18T12:50:23.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1fa6b640 1 -- start start 2024-09-18T12:50:23.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1fa6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18102470 0x7fbb1806bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1fa6b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb18104da0 0x7fbb1806c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1fa6b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbb18108550 con 0x7fbb18102470 2024-09-18T12:50:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1fa6b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbb181083d0 con 0x7fbb18104da0 2024-09-18T12:50:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1d807640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18102470 0x7fbb1806bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1d807640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18102470 0x7fbb1806bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59072/0 (socket says 172.21.15.45:59072) 2024-09-18T12:50:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1d807640 1 -- 172.21.15.45:0/951634927 learned_addr learned my addr 172.21.15.45:0/951634927 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:50:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1d006640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb18104da0 0x7fbb1806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1d807640 1 -- 172.21.15.45:0/951634927 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb18104da0 msgr2=0x7fbb1806c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1d807640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb18104da0 0x7fbb1806c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.927+0000 7fbb1d807640 1 -- 172.21.15.45:0/951634927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1806cba0 con 0x7fbb18102470 2024-09-18T12:50:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.928+0000 7fbb1d807640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18102470 0x7fbb1806bfe0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009230 tx=0x7fbb14035910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.928+0000 7fbb0effd640 1 -- 172.21.15.45:0/951634927 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb14043ad0 con 0x7fbb18102470 2024-09-18T12:50:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.928+0000 7fbb0effd640 1 -- 172.21.15.45:0/951634927 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb14043c70 con 0x7fbb18102470 2024-09-18T12:50:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.928+0000 7fbb0effd640 1 -- 172.21.15.45:0/951634927 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb14005230 con 0x7fbb18102470 2024-09-18T12:50:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.928+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/951634927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb180715e0 con 0x7fbb18102470 2024-09-18T12:50:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.928+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/951634927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb18071b70 con 0x7fbb18102470 2024-09-18T12:50:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.930+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/951634927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb18102850 con 0x7fbb18102470 2024-09-18T12:50:23.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.931+0000 7fbb0effd640 1 -- 172.21.15.45:0/951634927 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fbb140053d0 con 0x7fbb18102470 2024-09-18T12:50:23.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.932+0000 7fbb0effd640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbb0406e420 0x7fbb040708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:23.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.932+0000 7fbb0effd640 1 -- 172.21.15.45:0/951634927 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fbb1403a020 con 0x7fbb18102470 2024-09-18T12:50:23.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.933+0000 7fbb1d006640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbb0406e420 0x7fbb040708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:23.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.933+0000 7fbb1d006640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbb0406e420 0x7fbb040708e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb1806d490 tx=0x7fbb08005f90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:23.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:23.936+0000 7fbb0effd640 1 -- 172.21.15.45:0/951634927 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb140853c0 con 0x7fbb18102470 2024-09-18T12:50:24.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.262+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/951634927 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbb181057c0 con 0x7fbb0406e420 2024-09-18T12:50:24.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.264+0000 7fbb0effd640 1 -- 172.21.15.45:0/951634927 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fbb181057c0 con 0x7fbb0406e420 2024-09-18T12:50:24.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.266+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/951634927 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbb0406e420 msgr2=0x7fbb040708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:24.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.266+0000 7fbb1fa6b640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbb0406e420 0x7fbb040708e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb1806d490 tx=0x7fbb08005f90 comp rx=0 tx=0).stop 2024-09-18T12:50:24.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.267+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/951634927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18102470 msgr2=0x7fbb1806bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:24.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.267+0000 7fbb1fa6b640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18102470 0x7fbb1806bfe0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009230 tx=0x7fbb14035910 comp rx=0 tx=0).stop 2024-09-18T12:50:24.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.267+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/951634927 shutdown_connections 2024-09-18T12:50:24.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.267+0000 7fbb1fa6b640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbb0406e420 0x7fbb040708e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.267+0000 7fbb1fa6b640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb18104da0 0x7fbb1806c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.267+0000 7fbb1fa6b640 1 --2- 172.21.15.45:0/951634927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18102470 0x7fbb1806bfe0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.267+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/951634927 >> 172.21.15.45:0/951634927 conn(0x7fbb180fc010 msgr2=0x7fbb180fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:24.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.267+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/951634927 shutdown_connections 2024-09-18T12:50:24.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.267+0000 7fbb1fa6b640 1 -- 172.21.15.45:0/951634927 wait complete. 2024-09-18T12:50:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.405+0000 7f0889503640 1 -- 172.21.15.45:0/1465944159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884104dc0 msgr2=0x7f08841071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.405+0000 7f0889503640 1 --2- 172.21.15.45:0/1465944159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884104dc0 0x7f08841071b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0878009880 tx=0x7f087802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.405+0000 7f0889503640 1 -- 172.21.15.45:0/1465944159 shutdown_connections 2024-09-18T12:50:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.405+0000 7f0889503640 1 --2- 172.21.15.45:0/1465944159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884104dc0 0x7f08841071b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.405+0000 7f0889503640 1 --2- 172.21.15.45:0/1465944159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0884102490 0x7f0884104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.405+0000 7f0889503640 1 -- 172.21.15.45:0/1465944159 >> 172.21.15.45:0/1465944159 conn(0x7f08840fbff0 msgr2=0x7f08840fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.405+0000 7f0889503640 1 -- 172.21.15.45:0/1465944159 shutdown_connections 2024-09-18T12:50:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.405+0000 7f0889503640 1 -- 172.21.15.45:0/1465944159 wait complete. 2024-09-18T12:50:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.407+0000 7f0889503640 1 Processor -- start 2024-09-18T12:50:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.407+0000 7f0889503640 1 -- start start 2024-09-18T12:50:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.407+0000 7f0889503640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0884102490 0x7f0884197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.408+0000 7f0889503640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884104dc0 0x7f0884197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.408+0000 7f0882ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0884102490 0x7f0884197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.408+0000 7f0882ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0884102490 0x7f0884197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:35126/0 (socket says 172.21.15.45:35126) 2024-09-18T12:50:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.408+0000 7f0882ffd640 1 -- 172.21.15.45:0/150133546 learned_addr learned my addr 172.21.15.45:0/150133546 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:50:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.408+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f088410a7a0 con 0x7f0884104dc0 2024-09-18T12:50:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.408+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f088410a620 con 0x7f0884102490 2024-09-18T12:50:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.408+0000 7f08827fc640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884104dc0 0x7f0884197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.408+0000 7f0882ffd640 1 -- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884104dc0 msgr2=0x7f0884197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.409+0000 7f0882ffd640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884104dc0 0x7f0884197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.409+0000 7f0882ffd640 1 -- 172.21.15.45:0/150133546 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08841980c0 con 0x7f0884102490 2024-09-18T12:50:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.409+0000 7f08827fc640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884104dc0 0x7f0884197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:50:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.409+0000 7f0882ffd640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0884102490 0x7f0884197500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f087400e970 tx=0x7f087400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.409+0000 7f086bfff640 1 -- 172.21.15.45:0/150133546 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f087400cac0 con 0x7f0884102490 2024-09-18T12:50:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.409+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088419cb00 con 0x7f0884102490 2024-09-18T12:50:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.409+0000 7f086bfff640 1 -- 172.21.15.45:0/150133546 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08740054e0 con 0x7f0884102490 2024-09-18T12:50:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.409+0000 7f086bfff640 1 -- 172.21.15.45:0/150133546 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0874010430 con 0x7f0884102490 2024-09-18T12:50:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.409+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088419d060 con 0x7f0884102490 2024-09-18T12:50:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.412+0000 7f086bfff640 1 -- 172.21.15.45:0/150133546 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f08740106e0 con 0x7f0884102490 2024-09-18T12:50:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.412+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088410af80 con 0x7f0884102490 2024-09-18T12:50:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.412+0000 7f086bfff640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f086c06e360 0x7f086c070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.413+0000 7f086bfff640 1 -- 172.21.15.45:0/150133546 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f087408f830 con 0x7f0884102490 2024-09-18T12:50:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.413+0000 7f08827fc640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f086c06e360 0x7f086c070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:24.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.414+0000 7f08827fc640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f086c06e360 0x7f086c070820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0878000c00 tx=0x7f0878005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:24.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.422+0000 7f086bfff640 1 -- 172.21.15.45:0/150133546 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f087405d170 con 0x7f0884102490 2024-09-18T12:50:24.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.792+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0884105820 con 0x7f086c06e360 2024-09-18T12:50:24.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.810+0000 7f086bfff640 1 -- 172.21.15.45:0/150133546 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f0884105820 con 0x7f086c06e360 2024-09-18T12:50:24.812 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:50:24.812 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (4m) 44s ago 6m 26.8M - 0.25.0 c8568f914cd2 de7ae4bc8025 2024-09-18T12:50:24.812 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (6m) 44s ago 6m 8224k - 19.1.1-330-gc2ddf972 ebb0615149de 147094edb221 2024-09-18T12:50:24.812 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (5m) 48s ago 5m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de a49472bef49e 2024-09-18T12:50:24.812 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (6m) 44s ago 6m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:50:24.812 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (5m) 48s ago 5m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:50:24.812 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (4m) 44s ago 6m 79.5M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:50:24.812 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (60s) 44s ago 60s 15.4M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:50:24.812 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (66s) 44s ago 65s 17.3M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:50:24.812 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (58s) 48s ago 57s 12.8M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (63s) 48s ago 63s 11.3M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:9283,8765,8443 running (7m) 44s ago 7m 500M - 19.1.1-330-gc2ddf972 ebb0615149de 84d721f8241b 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (5m) 48s ago 5m 441M - 19.1.1-330-gc2ddf972 ebb0615149de 0a67817738af 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (7m) 44s ago 7m 47.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (5m) 48s ago 5m 35.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (6m) 44s ago 6m 16.1M - 1.5.0 0da6a335fe13 39666fd05306 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (5m) 48s ago 5m 16.4M - 1.5.0 0da6a335fe13 ed4fe4d74f39 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (4m) 44s ago 4m 53.3M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (3m) 44s ago 3m 55.6M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (3m) 44s ago 3m 48.5M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:50:24.813 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (2m) 48s ago 2m 46.2M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:50:24.814 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (2m) 48s ago 2m 49.9M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:50:24.814 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (2m) 48s ago 2m 52.6M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:50:24.814 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (4m) 44s ago 5m 55.4M - 2.43.0 a07b618ecd1d 411e86f6fecd 2024-09-18T12:50:24.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.812+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f086c06e360 msgr2=0x7f086c070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:24.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.812+0000 7f0889503640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f086c06e360 0x7f086c070820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0878000c00 tx=0x7f0878005a20 comp rx=0 tx=0).stop 2024-09-18T12:50:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.812+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0884102490 msgr2=0x7f0884197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.812+0000 7f0889503640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0884102490 0x7f0884197500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f087400e970 tx=0x7f087400ed70 comp rx=0 tx=0).stop 2024-09-18T12:50:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.812+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 shutdown_connections 2024-09-18T12:50:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.812+0000 7f0889503640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f086c06e360 0x7f086c070820 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.812+0000 7f0889503640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884104dc0 0x7f0884197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.812+0000 7f0889503640 1 --2- 172.21.15.45:0/150133546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0884102490 0x7f0884197500 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.813+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 >> 172.21.15.45:0/150133546 conn(0x7f08840fbff0 msgr2=0x7f08840fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.813+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 shutdown_connections 2024-09-18T12:50:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.813+0000 7f0889503640 1 -- 172.21.15.45:0/150133546 wait complete. 2024-09-18T12:50:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.939+0000 7f6117033640 1 -- 172.21.15.45:0/2413225587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6110101a80 msgr2=0x7f6110101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.939+0000 7f6117033640 1 --2- 172.21.15.45:0/2413225587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6110101a80 0x7f6110101f00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009880 tx=0x7f60fc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.940+0000 7f6117033640 1 -- 172.21.15.45:0/2413225587 shutdown_connections 2024-09-18T12:50:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.940+0000 7f6117033640 1 --2- 172.21.15.45:0/2413225587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6110101a80 0x7f6110101f00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.940+0000 7f6117033640 1 --2- 172.21.15.45:0/2413225587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6110100880 0x7f6110100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.940+0000 7f6117033640 1 -- 172.21.15.45:0/2413225587 >> 172.21.15.45:0/2413225587 conn(0x7f61100fc030 msgr2=0x7f61100fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.940+0000 7f6117033640 1 -- 172.21.15.45:0/2413225587 shutdown_connections 2024-09-18T12:50:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.940+0000 7f6117033640 1 -- 172.21.15.45:0/2413225587 wait complete. 2024-09-18T12:50:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.941+0000 7f6117033640 1 Processor -- start 2024-09-18T12:50:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.941+0000 7f6117033640 1 -- start start 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.941+0000 7f6117033640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6110100880 0x7f611006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.941+0000 7f6117033640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6110101a80 0x7f611019a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.941+0000 7f6117033640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f61101096c0 con 0x7f6110100880 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.941+0000 7f6117033640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6110109540 con 0x7f6110101a80 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.941+0000 7f6114dcf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6110100880 0x7f611006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.941+0000 7f6114dcf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6110100880 0x7f611006aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59124/0 (socket says 172.21.15.45:59124) 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.941+0000 7f6114dcf640 1 -- 172.21.15.45:0/2518603092 learned_addr learned my addr 172.21.15.45:0/2518603092 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.942+0000 7f610ffff640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6110101a80 0x7f611019a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.942+0000 7f6114dcf640 1 -- 172.21.15.45:0/2518603092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6110101a80 msgr2=0x7f611019a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.942+0000 7f6114dcf640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6110101a80 0x7f611019a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.942+0000 7f6114dcf640 1 -- 172.21.15.45:0/2518603092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611019a610 con 0x7f6110100880 2024-09-18T12:50:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.942+0000 7f6114dcf640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6110100880 0x7f611006aff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f610400e940 tx=0x7f610400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.942+0000 7f610dffb640 1 -- 172.21.15.45:0/2518603092 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f610400cac0 con 0x7f6110100880 2024-09-18T12:50:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.942+0000 7f610dffb640 1 -- 172.21.15.45:0/2518603092 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f610400cc60 con 0x7f6110100880 2024-09-18T12:50:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.942+0000 7f6117033640 1 -- 172.21.15.45:0/2518603092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611019a900 con 0x7f6110100880 2024-09-18T12:50:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.943+0000 7f610dffb640 1 -- 172.21.15.45:0/2518603092 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6104003e30 con 0x7f6110100880 2024-09-18T12:50:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.945+0000 7f6117033640 1 -- 172.21.15.45:0/2518603092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611019ae90 con 0x7f6110100880 2024-09-18T12:50:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.945+0000 7f610dffb640 1 -- 172.21.15.45:0/2518603092 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6104004030 con 0x7f6110100880 2024-09-18T12:50:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.946+0000 7f610dffb640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f610006e300 0x7f61000707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.946+0000 7f6117033640 1 -- 172.21.15.45:0/2518603092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6110109ea0 con 0x7f6110100880 2024-09-18T12:50:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.946+0000 7f610ffff640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f610006e300 0x7f61000707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.947+0000 7f610dffb640 1 -- 172.21.15.45:0/2518603092 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f610408e0a0 con 0x7f6110100880 2024-09-18T12:50:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.947+0000 7f610ffff640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f610006e300 0x7f61000707c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f611006ad70 tx=0x7f60fc009620 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:24.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:24.956+0000 7f610dffb640 1 -- 172.21.15.45:0/2518603092 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61040152d0 con 0x7f6110100880 2024-09-18T12:50:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.373+0000 7f6117033640 1 -- 172.21.15.45:0/2518603092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f611019b220 con 0x7f6110100880 2024-09-18T12:50:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.374+0000 7f610dffb640 1 -- 172.21.15.45:0/2518603092 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f610405b960 con 0x7f6110100880 2024-09-18T12:50:25.375 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:50:25.375 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:50:25.375 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:50:25.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:50:25.376 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:50:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 -- 172.21.15.45:0/2518603092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f610006e300 msgr2=0x7f61000707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f610006e300 0x7f61000707c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f611006ad70 tx=0x7f60fc009620 comp rx=0 tx=0).stop 2024-09-18T12:50:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 -- 172.21.15.45:0/2518603092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6110100880 msgr2=0x7f611006aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6110100880 0x7f611006aff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f610400e940 tx=0x7f610400ee00 comp rx=0 tx=0).stop 2024-09-18T12:50:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 -- 172.21.15.45:0/2518603092 shutdown_connections 2024-09-18T12:50:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f610006e300 0x7f61000707c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6110101a80 0x7f611019a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 --2- 172.21.15.45:0/2518603092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6110100880 0x7f611006aff0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 -- 172.21.15.45:0/2518603092 >> 172.21.15.45:0/2518603092 conn(0x7f61100fc030 msgr2=0x7f61100fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 -- 172.21.15.45:0/2518603092 shutdown_connections 2024-09-18T12:50:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.377+0000 7f6117033640 1 -- 172.21.15.45:0/2518603092 wait complete. 2024-09-18T12:50:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.466+0000 7ff1ed63b640 1 -- 172.21.15.45:0/691892968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e8101970 msgr2=0x7ff1e8101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.466+0000 7ff1ed63b640 1 --2- 172.21.15.45:0/691892968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e8101970 0x7ff1e8101d70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009880 tx=0x7ff1d802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.466+0000 7ff1ed63b640 1 -- 172.21.15.45:0/691892968 shutdown_connections 2024-09-18T12:50:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.466+0000 7ff1ed63b640 1 --2- 172.21.15.45:0/691892968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e8102b70 0x7ff1e8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.466+0000 7ff1ed63b640 1 --2- 172.21.15.45:0/691892968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e8101970 0x7ff1e8101d70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.466+0000 7ff1ed63b640 1 -- 172.21.15.45:0/691892968 >> 172.21.15.45:0/691892968 conn(0x7ff1e80fd140 msgr2=0x7ff1e80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.466+0000 7ff1ed63b640 1 -- 172.21.15.45:0/691892968 shutdown_connections 2024-09-18T12:50:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.466+0000 7ff1ed63b640 1 -- 172.21.15.45:0/691892968 wait complete. 2024-09-18T12:50:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.467+0000 7ff1ed63b640 1 Processor -- start 2024-09-18T12:50:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.467+0000 7ff1ed63b640 1 -- start start 2024-09-18T12:50:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1ed63b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e8101970 0x7ff1e8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1ed63b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e8102b70 0x7ff1e80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1ed63b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e810a7b0 con 0x7ff1e8101970 2024-09-18T12:50:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1ed63b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e810a630 con 0x7ff1e8102b70 2024-09-18T12:50:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1e6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e8101970 0x7ff1e8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1e67fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e8102b70 0x7ff1e80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1e67fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e8102b70 0x7ff1e80745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:35150/0 (socket says 172.21.15.45:35150) 2024-09-18T12:50:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1e67fc640 1 -- 172.21.15.45:0/450262728 learned_addr learned my addr 172.21.15.45:0/450262728 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:50:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1e67fc640 1 -- 172.21.15.45:0/450262728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e8101970 msgr2=0x7ff1e8075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1e67fc640 1 --2- 172.21.15.45:0/450262728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e8101970 0x7ff1e8075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.468+0000 7ff1e67fc640 1 -- 172.21.15.45:0/450262728 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e8074b20 con 0x7ff1e8102b70 2024-09-18T12:50:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.469+0000 7ff1e67fc640 1 --2- 172.21.15.45:0/450262728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e8102b70 0x7ff1e80745e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00e970 tx=0x7ff1dc00ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.469+0000 7ff1cffff640 1 -- 172.21.15.45:0/450262728 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1dc00cac0 con 0x7ff1e8102b70 2024-09-18T12:50:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.469+0000 7ff1cffff640 1 -- 172.21.15.45:0/450262728 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1dc0054e0 con 0x7ff1e8102b70 2024-09-18T12:50:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.469+0000 7ff1cffff640 1 -- 172.21.15.45:0/450262728 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1dc010430 con 0x7ff1e8102b70 2024-09-18T12:50:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.469+0000 7ff1ed63b640 1 -- 172.21.15.45:0/450262728 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e8074e10 con 0x7ff1e8102b70 2024-09-18T12:50:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.469+0000 7ff1ed63b640 1 -- 172.21.15.45:0/450262728 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e8075340 con 0x7ff1e8102b70 2024-09-18T12:50:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.471+0000 7ff1ed63b640 1 -- 172.21.15.45:0/450262728 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e8101d70 con 0x7ff1e8102b70 2024-09-18T12:50:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.472+0000 7ff1cffff640 1 -- 172.21.15.45:0/450262728 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff1dc004f00 con 0x7ff1e8102b70 2024-09-18T12:50:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.473+0000 7ff1cffff640 1 --2- 172.21.15.45:0/450262728 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff1d006e310 0x7ff1d00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.473+0000 7ff1e6ffd640 1 --2- 172.21.15.45:0/450262728 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff1d006e310 0x7ff1d00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.474+0000 7ff1cffff640 1 -- 172.21.15.45:0/450262728 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7ff1dc08e770 con 0x7ff1e8102b70 2024-09-18T12:50:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.474+0000 7ff1e6ffd640 1 --2- 172.21.15.45:0/450262728 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff1d006e310 0x7ff1d00707d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8000c00 tx=0x7ff1d8005a20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:25.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.483+0000 7ff1cffff640 1 -- 172.21.15.45:0/450262728 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1dc05c150 con 0x7ff1e8102b70 2024-09-18T12:50:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.679+0000 7ff1ed63b640 1 -- 172.21.15.45:0/450262728 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff1e8107140 con 0x7ff1d006e310 2024-09-18T12:50:25.681 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:25 smithi045 ceph-mon[28315]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:25.681 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:25 smithi045 ceph-mon[28315]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:25.681 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:25 smithi045 ceph-mon[28315]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:25.681 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:25 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:50:25.682 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:25 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:50:25.682 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:25 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2518603092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:25.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.681+0000 7ff1cffff640 1 -- 172.21.15.45:0/450262728 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7ff1e8107140 con 0x7ff1d006e310 2024-09-18T12:50:25.682 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:50:25.682 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:50:25.682 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:50:25.683 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:50:25.683 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [], 2024-09-18T12:50:25.683 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "0/2 daemons upgraded", 2024-09-18T12:50:25.683 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 image on host smithi161", 2024-09-18T12:50:25.683 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:50:25.683 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.684+0000 7ff1ed63b640 1 -- 172.21.15.45:0/450262728 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff1d006e310 msgr2=0x7ff1d00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.684+0000 7ff1ed63b640 1 --2- 172.21.15.45:0/450262728 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff1d006e310 0x7ff1d00707d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8000c00 tx=0x7ff1d8005a20 comp rx=0 tx=0).stop 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.684+0000 7ff1ed63b640 1 -- 172.21.15.45:0/450262728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e8102b70 msgr2=0x7ff1e80745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.684+0000 7ff1ed63b640 1 --2- 172.21.15.45:0/450262728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e8102b70 0x7ff1e80745e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00e970 tx=0x7ff1dc00ed70 comp rx=0 tx=0).stop 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.684+0000 7ff1ed63b640 1 -- 172.21.15.45:0/450262728 shutdown_connections 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.684+0000 7ff1ed63b640 1 --2- 172.21.15.45:0/450262728 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7ff1d006e310 0x7ff1d00707d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.684+0000 7ff1ed63b640 1 --2- 172.21.15.45:0/450262728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e8102b70 0x7ff1e80745e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.684+0000 7ff1ed63b640 1 --2- 172.21.15.45:0/450262728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e8101970 0x7ff1e8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.684+0000 7ff1ed63b640 1 -- 172.21.15.45:0/450262728 >> 172.21.15.45:0/450262728 conn(0x7ff1e80fd140 msgr2=0x7ff1e80ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.685+0000 7ff1ed63b640 1 -- 172.21.15.45:0/450262728 shutdown_connections 2024-09-18T12:50:25.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:25.685+0000 7ff1ed63b640 1 -- 172.21.15.45:0/450262728 wait complete. 2024-09-18T12:50:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:25 smithi161 ceph-mon[35784]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:25 smithi161 ceph-mon[35784]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:25 smithi161 ceph-mon[35784]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:25 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:50:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:25 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:50:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:25 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2518603092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:26.720 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:26 smithi045 ceph-mon[28315]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:26.720 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:26 smithi045 ceph-mon[28315]: Upgrade: Target is version 19.3.0-4983-ge7fb7b56 (squid) 2024-09-18T12:50:26.720 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:26 smithi045 ceph-mon[28315]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9'] 2024-09-18T12:50:26.720 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:26 smithi045 ceph-mon[28315]: Upgrade: Need to upgrade myself (mgr.smithi045.brvbvl) 2024-09-18T12:50:26.721 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:26 smithi045 ceph-mon[28315]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 on smithi161 2024-09-18T12:50:26.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:26 smithi161 ceph-mon[35784]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:26.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:26 smithi161 ceph-mon[35784]: Upgrade: Target is version 19.3.0-4983-ge7fb7b56 (squid) 2024-09-18T12:50:26.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:26 smithi161 ceph-mon[35784]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9'] 2024-09-18T12:50:26.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:26 smithi161 ceph-mon[35784]: Upgrade: Need to upgrade myself (mgr.smithi045.brvbvl) 2024-09-18T12:50:26.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:26 smithi161 ceph-mon[35784]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 on smithi161 2024-09-18T12:50:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:27 smithi045 ceph-mon[28315]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:27 smithi045 ceph-mon[28315]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:27 smithi161 ceph-mon[35784]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:27 smithi161 ceph-mon[35784]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:29 smithi045 ceph-mon[28315]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:29 smithi161 ceph-mon[35784]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:31 smithi045 ceph-mon[28315]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:31 smithi161 ceph-mon[35784]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:32.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:32 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:32 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:33 smithi045 ceph-mon[28315]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:33 smithi161 ceph-mon[35784]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:35 smithi045 ceph-mon[28315]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:35 smithi161 ceph-mon[35784]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:37.766 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:37 smithi045 ceph-mon[28315]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:37 smithi161 ceph-mon[35784]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:39 smithi045 ceph-mon[28315]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:39 smithi161 ceph-mon[35784]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:41 smithi045 ceph-mon[28315]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:41 smithi161 ceph-mon[35784]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:43 smithi045 ceph-mon[28315]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:43 smithi161 ceph-mon[35784]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:45 smithi045 ceph-mon[28315]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:45 smithi161 ceph-mon[35784]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:47.503 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:47 smithi161 ceph-mon[35784]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:47.503 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:47 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:47 smithi045 ceph-mon[28315]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:47 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:50:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:49 smithi045 ceph-mon[28315]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:49 smithi161 ceph-mon[35784]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:50.888 INFO:tasks.workunit.client.0.smithi045.stderr:Updating files: 91% (11563/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-18T12:50:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:51 smithi045 ceph-mon[28315]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:51 smithi161 ceph-mon[35784]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:51.834 INFO:tasks.workunit.client.0.smithi045.stderr:Note: switching to 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'. 2024-09-18T12:50:51.834 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-18T12:50:51.834 INFO:tasks.workunit.client.0.smithi045.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T12:50:51.834 INFO:tasks.workunit.client.0.smithi045.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T12:50:51.834 INFO:tasks.workunit.client.0.smithi045.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T12:50:51.834 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-18T12:50:51.834 INFO:tasks.workunit.client.0.smithi045.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T12:50:51.834 INFO:tasks.workunit.client.0.smithi045.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T12:50:51.835 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-18T12:50:51.835 INFO:tasks.workunit.client.0.smithi045.stderr: git switch -c 2024-09-18T12:50:51.835 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-18T12:50:51.835 INFO:tasks.workunit.client.0.smithi045.stderr:Or undo this operation with: 2024-09-18T12:50:51.835 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-18T12:50:51.835 INFO:tasks.workunit.client.0.smithi045.stderr: git switch - 2024-09-18T12:50:51.835 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-18T12:50:51.835 INFO:tasks.workunit.client.0.smithi045.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T12:50:51.835 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-18T12:50:51.835 INFO:tasks.workunit.client.0.smithi045.stderr:HEAD is now at e7fb7b56dba Merge branch 'drive-group-spec-bool-args-followup' of https://github.com/guits/ceph into wip-guits-main-2024-09-17-1213 2024-09-18T12:50:51.841 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-18T12:50:51.904 INFO:tasks.workunit.client.0.smithi045.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T12:50:51.906 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:50:51.906 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T12:50:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:53 smithi045 ceph-mon[28315]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:53 smithi161 ceph-mon[35784]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:55.009 INFO:tasks.workunit.client.1.smithi161.stderr:Updating files: 93% (11935/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-18T12:50:55.336 INFO:tasks.workunit.client.1.smithi161.stderr:Note: switching to 'e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e'. 2024-09-18T12:50:55.336 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-09-18T12:50:55.336 INFO:tasks.workunit.client.1.smithi161.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T12:50:55.336 INFO:tasks.workunit.client.1.smithi161.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T12:50:55.336 INFO:tasks.workunit.client.1.smithi161.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T12:50:55.336 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr: git switch -c 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr:Or undo this operation with: 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr: git switch - 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-09-18T12:50:55.337 INFO:tasks.workunit.client.1.smithi161.stderr:HEAD is now at e7fb7b56dba Merge branch 'drive-group-spec-bool-args-followup' of https://github.com/guits/ceph into wip-guits-main-2024-09-17-1213 2024-09-18T12:50:55.339 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-18T12:50:55.431 INFO:tasks.workunit.client.1.smithi161.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T12:50:55.433 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-18T12:50:55.433 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T12:50:55.779 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:55 smithi045 ceph-mon[28315]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 -- 172.21.15.45:0/399857999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db8102b60 msgr2=0x7f2db8102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 --2- 172.21.15.45:0/399857999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db8102b60 0x7f2db8102fe0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009880 tx=0x7f2dac02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 -- 172.21.15.45:0/399857999 shutdown_connections 2024-09-18T12:50:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 --2- 172.21.15.45:0/399857999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db8102b60 0x7f2db8102fe0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 --2- 172.21.15.45:0/399857999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8101960 0x7f2db8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 -- 172.21.15.45:0/399857999 >> 172.21.15.45:0/399857999 conn(0x7f2db80fd0f0 msgr2=0x7f2db80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 -- 172.21.15.45:0/399857999 shutdown_connections 2024-09-18T12:50:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 -- 172.21.15.45:0/399857999 wait complete. 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 Processor -- start 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 -- start start 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8101960 0x7f2db8197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.778+0000 7f2dbf074640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db8102b60 0x7f2db81979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.779+0000 7f2dbf074640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2db810a780 con 0x7f2db8102b60 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.779+0000 7f2dbf074640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2db810a600 con 0x7f2db8101960 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.779+0000 7f2db7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db8102b60 0x7f2db81979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.779+0000 7f2db7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db8102b60 0x7f2db81979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54336/0 (socket says 172.21.15.45:54336) 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.779+0000 7f2db7fff640 1 -- 172.21.15.45:0/1480653010 learned_addr learned my addr 172.21.15.45:0/1480653010 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.779+0000 7f2dbce10640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8101960 0x7f2db8197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.779+0000 7f2db7fff640 1 -- 172.21.15.45:0/1480653010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8101960 msgr2=0x7f2db8197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.779+0000 7f2db7fff640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8101960 0x7f2db8197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.779+0000 7f2db7fff640 1 -- 172.21.15.45:0/1480653010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db8198030 con 0x7f2db8102b60 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.779+0000 7f2db7fff640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db8102b60 0x7f2db81979b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2dac006010 tx=0x7f2dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.780+0000 7f2db5ffb640 1 -- 172.21.15.45:0/1480653010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2dac03f070 con 0x7f2db8102b60 2024-09-18T12:50:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.780+0000 7f2dbf074640 1 -- 172.21.15.45:0/1480653010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db819ca10 con 0x7f2db8102b60 2024-09-18T12:50:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.780+0000 7f2db5ffb640 1 -- 172.21.15.45:0/1480653010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2dac004ac0 con 0x7f2db8102b60 2024-09-18T12:50:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.780+0000 7f2db5ffb640 1 -- 172.21.15.45:0/1480653010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2dac035030 con 0x7f2db8102b60 2024-09-18T12:50:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.780+0000 7f2dbf074640 1 -- 172.21.15.45:0/1480653010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db819cfa0 con 0x7f2db8102b60 2024-09-18T12:50:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.781+0000 7f2dbf074640 1 -- 172.21.15.45:0/1480653010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db8101d60 con 0x7f2db8102b60 2024-09-18T12:50:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.782+0000 7f2db5ffb640 1 -- 172.21.15.45:0/1480653010 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2dac042070 con 0x7f2db8102b60 2024-09-18T12:50:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.782+0000 7f2db5ffb640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2da006e2b0 0x7f2da0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.782+0000 7f2db5ffb640 1 -- 172.21.15.45:0/1480653010 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f2dac0aecd0 con 0x7f2db8102b60 2024-09-18T12:50:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.782+0000 7f2dbce10640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2da006e2b0 0x7f2da0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.783+0000 7f2dbce10640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2da006e2b0 0x7f2da0070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2da8005fd0 tx=0x7f2da800b410 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:55.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.787+0000 7f2db5ffb640 1 -- 172.21.15.45:0/1480653010 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2dac0802e0 con 0x7f2db8102b60 2024-09-18T12:50:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:55 smithi161 ceph-mon[35784]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:55.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.985+0000 7f2dbf074640 1 -- 172.21.15.45:0/1480653010 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2db8062630 con 0x7f2da006e2b0 2024-09-18T12:50:55.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.986+0000 7f2db5ffb640 1 -- 172.21.15.45:0/1480653010 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f2db8062630 con 0x7f2da006e2b0 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 -- 172.21.15.45:0/1480653010 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2da006e2b0 msgr2=0x7f2da0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2da006e2b0 0x7f2da0070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2da8005fd0 tx=0x7f2da800b410 comp rx=0 tx=0).stop 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 -- 172.21.15.45:0/1480653010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db8102b60 msgr2=0x7f2db81979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db8102b60 0x7f2db81979b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2dac006010 tx=0x7f2dac0046c0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 -- 172.21.15.45:0/1480653010 shutdown_connections 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f2da006e2b0 0x7f2da0070770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db8102b60 0x7f2db81979b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 --2- 172.21.15.45:0/1480653010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2db8101960 0x7f2db8197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 -- 172.21.15.45:0/1480653010 >> 172.21.15.45:0/1480653010 conn(0x7f2db80fd0f0 msgr2=0x7f2db8105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 -- 172.21.15.45:0/1480653010 shutdown_connections 2024-09-18T12:50:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:55.988+0000 7f2dbf074640 1 -- 172.21.15.45:0/1480653010 wait complete. 2024-09-18T12:50:55.998 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:50:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.077+0000 7f8c6b59e640 1 -- 172.21.15.45:0/1284280694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c6c101940 msgr2=0x7f8c6c101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.077+0000 7f8c6b59e640 1 --2- 172.21.15.45:0/1284280694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c6c101940 0x7f8c6c101dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009880 tx=0x7f8c5402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.077+0000 7f8c6b59e640 1 -- 172.21.15.45:0/1284280694 shutdown_connections 2024-09-18T12:50:56.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.077+0000 7f8c6b59e640 1 --2- 172.21.15.45:0/1284280694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c6c101940 0x7f8c6c101dc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.077+0000 7f8c6b59e640 1 --2- 172.21.15.45:0/1284280694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c100740 0x7f8c6c100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.077+0000 7f8c6b59e640 1 -- 172.21.15.45:0/1284280694 >> 172.21.15.45:0/1284280694 conn(0x7f8c6c0fbed0 msgr2=0x7f8c6c0fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:56.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.077+0000 7f8c6b59e640 1 -- 172.21.15.45:0/1284280694 shutdown_connections 2024-09-18T12:50:56.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.077+0000 7f8c6b59e640 1 -- 172.21.15.45:0/1284280694 wait complete. 2024-09-18T12:50:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c6b59e640 1 Processor -- start 2024-09-18T12:50:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c6b59e640 1 -- start start 2024-09-18T12:50:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c6b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c100740 0x7f8c6c1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c6b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c6c101940 0x7f8c6c197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c6b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c10a700 con 0x7f8c6c101940 2024-09-18T12:50:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c6b59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c10a580 con 0x7f8c6c100740 2024-09-18T12:50:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c69d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c6c101940 0x7f8c6c197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c69d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c6c101940 0x7f8c6c197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54342/0 (socket says 172.21.15.45:54342) 2024-09-18T12:50:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c69d9b640 1 -- 172.21.15.45:0/96849257 learned_addr learned my addr 172.21.15.45:0/96849257 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:50:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c6a59c640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c100740 0x7f8c6c1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c69d9b640 1 -- 172.21.15.45:0/96849257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c100740 msgr2=0x7f8c6c1973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c69d9b640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c100740 0x7f8c6c1973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.078+0000 7f8c69d9b640 1 -- 172.21.15.45:0/96849257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6c197f80 con 0x7f8c6c101940 2024-09-18T12:50:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.079+0000 7f8c69d9b640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c6c101940 0x7f8c6c197900 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8c54006010 tx=0x7f8c540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.079+0000 7f8c637fe640 1 -- 172.21.15.45:0/96849257 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c5403f070 con 0x7f8c6c101940 2024-09-18T12:50:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.079+0000 7f8c6b59e640 1 -- 172.21.15.45:0/96849257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6c19c960 con 0x7f8c6c101940 2024-09-18T12:50:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.079+0000 7f8c637fe640 1 -- 172.21.15.45:0/96849257 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c540044d0 con 0x7f8c6c101940 2024-09-18T12:50:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.079+0000 7f8c637fe640 1 -- 172.21.15.45:0/96849257 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c54035030 con 0x7f8c6c101940 2024-09-18T12:50:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.079+0000 7f8c6b59e640 1 -- 172.21.15.45:0/96849257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6c19cef0 con 0x7f8c6c101940 2024-09-18T12:50:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.080+0000 7f8c6b59e640 1 -- 172.21.15.45:0/96849257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6c100b20 con 0x7f8c6c101940 2024-09-18T12:50:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.080+0000 7f8c637fe640 1 -- 172.21.15.45:0/96849257 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8c54042070 con 0x7f8c6c101940 2024-09-18T12:50:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.081+0000 7f8c637fe640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8c5806e2b0 0x7f8c58070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.081+0000 7f8c637fe640 1 -- 172.21.15.45:0/96849257 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f8c540aee00 con 0x7f8c6c101940 2024-09-18T12:50:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.081+0000 7f8c6a59c640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8c5806e2b0 0x7f8c58070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.082+0000 7f8c6a59c640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8c5806e2b0 0x7f8c58070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c1017a0 tx=0x7f8c5c009110 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.086+0000 7f8c637fe640 1 -- 172.21.15.45:0/96849257 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c5407c760 con 0x7f8c6c101940 2024-09-18T12:50:56.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.277+0000 7f8c6b59e640 1 -- 172.21.15.45:0/96849257 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8c6c105e90 con 0x7f8c5806e2b0 2024-09-18T12:50:56.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.278+0000 7f8c637fe640 1 -- 172.21.15.45:0/96849257 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f8c6c105e90 con 0x7f8c5806e2b0 2024-09-18T12:50:56.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.280+0000 7f8c6b59e640 1 -- 172.21.15.45:0/96849257 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8c5806e2b0 msgr2=0x7f8c58070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.280+0000 7f8c6b59e640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8c5806e2b0 0x7f8c58070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c1017a0 tx=0x7f8c5c009110 comp rx=0 tx=0).stop 2024-09-18T12:50:56.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.280+0000 7f8c6b59e640 1 -- 172.21.15.45:0/96849257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c6c101940 msgr2=0x7f8c6c197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.280+0000 7f8c6b59e640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c6c101940 0x7f8c6c197900 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8c54006010 tx=0x7f8c540048f0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.280+0000 7f8c6b59e640 1 -- 172.21.15.45:0/96849257 shutdown_connections 2024-09-18T12:50:56.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.280+0000 7f8c6b59e640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f8c5806e2b0 0x7f8c58070770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.280+0000 7f8c6b59e640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c6c101940 0x7f8c6c197900 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.280+0000 7f8c6b59e640 1 --2- 172.21.15.45:0/96849257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c100740 0x7f8c6c1973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.280+0000 7f8c6b59e640 1 -- 172.21.15.45:0/96849257 >> 172.21.15.45:0/96849257 conn(0x7f8c6c0fbed0 msgr2=0x7f8c6c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:56.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.281+0000 7f8c6b59e640 1 -- 172.21.15.45:0/96849257 shutdown_connections 2024-09-18T12:50:56.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.281+0000 7f8c6b59e640 1 -- 172.21.15.45:0/96849257 wait complete. 2024-09-18T12:50:56.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.364+0000 7fdc252e1640 1 -- 172.21.15.45:0/870845806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc20100860 msgr2=0x7fdc20100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.364+0000 7fdc252e1640 1 --2- 172.21.15.45:0/870845806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc20100860 0x7fdc20100c60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009880 tx=0x7fdc1002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.364+0000 7fdc252e1640 1 -- 172.21.15.45:0/870845806 shutdown_connections 2024-09-18T12:50:56.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.364+0000 7fdc252e1640 1 --2- 172.21.15.45:0/870845806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc20101a60 0x7fdc20101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.364+0000 7fdc252e1640 1 --2- 172.21.15.45:0/870845806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc20100860 0x7fdc20100c60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.364+0000 7fdc252e1640 1 -- 172.21.15.45:0/870845806 >> 172.21.15.45:0/870845806 conn(0x7fdc200fc010 msgr2=0x7fdc200fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:56.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.365+0000 7fdc252e1640 1 -- 172.21.15.45:0/870845806 shutdown_connections 2024-09-18T12:50:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.365+0000 7fdc252e1640 1 -- 172.21.15.45:0/870845806 wait complete. 2024-09-18T12:50:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.365+0000 7fdc252e1640 1 Processor -- start 2024-09-18T12:50:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.365+0000 7fdc252e1640 1 -- start start 2024-09-18T12:50:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc252e1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc20100860 0x7fdc20104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc252e1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc20101a60 0x7fdc20102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc252e1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdc201096a0 con 0x7fdc20101a60 2024-09-18T12:50:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc252e1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdc20109520 con 0x7fdc20100860 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc1e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc20101a60 0x7fdc20102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc1e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc20101a60 0x7fdc20102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54352/0 (socket says 172.21.15.45:54352) 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc1e7fc640 1 -- 172.21.15.45:0/2772812575 learned_addr learned my addr 172.21.15.45:0/2772812575 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc1effd640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc20100860 0x7fdc20104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc1e7fc640 1 -- 172.21.15.45:0/2772812575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc20100860 msgr2=0x7fdc20104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc1e7fc640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc20100860 0x7fdc20104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc1e7fc640 1 -- 172.21.15.45:0/2772812575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc20103380 con 0x7fdc20101a60 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc1e7fc640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc20101a60 0x7fdc20102e40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400ea00 tx=0x7fdc1400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.366+0000 7fdc07fff640 1 -- 172.21.15.45:0/2772812575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc1400cb80 con 0x7fdc20101a60 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.367+0000 7fdc252e1640 1 -- 172.21.15.45:0/2772812575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc20103670 con 0x7fdc20101a60 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.367+0000 7fdc07fff640 1 -- 172.21.15.45:0/2772812575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdc1400cd20 con 0x7fdc20101a60 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.367+0000 7fdc07fff640 1 -- 172.21.15.45:0/2772812575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc14011470 con 0x7fdc20101a60 2024-09-18T12:50:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.367+0000 7fdc252e1640 1 -- 172.21.15.45:0/2772812575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc20103c00 con 0x7fdc20101a60 2024-09-18T12:50:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.368+0000 7fdc252e1640 1 -- 172.21.15.45:0/2772812575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc20100c60 con 0x7fdc20101a60 2024-09-18T12:50:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.368+0000 7fdc07fff640 1 -- 172.21.15.45:0/2772812575 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdc14011750 con 0x7fdc20101a60 2024-09-18T12:50:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.369+0000 7fdc07fff640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdc0806e2b0 0x7fdc08070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.369+0000 7fdc07fff640 1 -- 172.21.15.45:0/2772812575 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fdc1408e550 con 0x7fdc20101a60 2024-09-18T12:50:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.369+0000 7fdc1effd640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdc0806e2b0 0x7fdc08070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.369+0000 7fdc1effd640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdc0806e2b0 0x7fdc08070770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009230 tx=0x7fdc100058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:56.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.373+0000 7fdc07fff640 1 -- 172.21.15.45:0/2772812575 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc14016030 con 0x7fdc20101a60 2024-09-18T12:50:56.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.559+0000 7fdc252e1640 1 -- 172.21.15.45:0/2772812575 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdc2019f5e0 con 0x7fdc0806e2b0 2024-09-18T12:50:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.569+0000 7fdc07fff640 1 -- 172.21.15.45:0/2772812575 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7fdc2019f5e0 con 0x7fdc0806e2b0 2024-09-18T12:50:56.570 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:50:56.570 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (5m) 76s ago 6m 26.8M - 0.25.0 c8568f914cd2 de7ae4bc8025 2024-09-18T12:50:56.570 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (7m) 76s ago 7m 8224k - 19.1.1-330-gc2ddf972 ebb0615149de 147094edb221 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (6m) 80s ago 6m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de a49472bef49e 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (7m) 76s ago 7m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (6m) 80s ago 6m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (5m) 76s ago 6m 79.5M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (92s) 76s ago 92s 15.4M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (98s) 76s ago 97s 17.3M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (90s) 80s ago 89s 12.8M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (95s) 80s ago 94s 11.3M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:9283,8765,8443 running (8m) 76s ago 8m 500M - 19.1.1-330-gc2ddf972 ebb0615149de 84d721f8241b 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (6m) 80s ago 6m 441M - 19.1.1-330-gc2ddf972 ebb0615149de 0a67817738af 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (8m) 76s ago 8m 47.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (6m) 80s ago 6m 35.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (7m) 76s ago 7m 16.1M - 1.5.0 0da6a335fe13 39666fd05306 2024-09-18T12:50:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (6m) 80s ago 6m 16.4M - 1.5.0 0da6a335fe13 ed4fe4d74f39 2024-09-18T12:50:56.572 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (4m) 76s ago 4m 53.3M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:50:56.572 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (4m) 76s ago 4m 55.6M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:50:56.572 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (3m) 76s ago 3m 48.5M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:50:56.572 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (3m) 80s ago 3m 46.2M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:50:56.572 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (3m) 80s ago 3m 49.9M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:50:56.572 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (2m) 80s ago 2m 52.6M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:50:56.572 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (5m) 76s ago 6m 55.4M - 2.43.0 a07b618ecd1d 411e86f6fecd 2024-09-18T12:50:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 -- 172.21.15.45:0/2772812575 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdc0806e2b0 msgr2=0x7fdc08070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdc0806e2b0 0x7fdc08070770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009230 tx=0x7fdc100058d0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 -- 172.21.15.45:0/2772812575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc20101a60 msgr2=0x7fdc20102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc20101a60 0x7fdc20102e40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400ea00 tx=0x7fdc1400eec0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 -- 172.21.15.45:0/2772812575 shutdown_connections 2024-09-18T12:50:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fdc0806e2b0 0x7fdc08070770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc20101a60 0x7fdc20102e40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 --2- 172.21.15.45:0/2772812575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc20100860 0x7fdc20104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 -- 172.21.15.45:0/2772812575 >> 172.21.15.45:0/2772812575 conn(0x7fdc200fc010 msgr2=0x7fdc20069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:56.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 -- 172.21.15.45:0/2772812575 shutdown_connections 2024-09-18T12:50:56.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.571+0000 7fdc252e1640 1 -- 172.21.15.45:0/2772812575 wait complete. 2024-09-18T12:50:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.655+0000 7f076d8c7640 1 -- 172.21.15.45:0/1613669607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07681023f0 msgr2=0x7f07681047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.655+0000 7f076d8c7640 1 --2- 172.21.15.45:0/1613669607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07681023f0 0x7f07681047e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07580098b0 tx=0x7f075802a4d0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.655+0000 7f076d8c7640 1 -- 172.21.15.45:0/1613669607 shutdown_connections 2024-09-18T12:50:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.655+0000 7f076d8c7640 1 --2- 172.21.15.45:0/1613669607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768104d20 0x7f0768107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.655+0000 7f076d8c7640 1 --2- 172.21.15.45:0/1613669607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07681023f0 0x7f07681047e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.655+0000 7f076d8c7640 1 -- 172.21.15.45:0/1613669607 >> 172.21.15.45:0/1613669607 conn(0x7f07680fc010 msgr2=0x7f07680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:56.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.656+0000 7f076d8c7640 1 -- 172.21.15.45:0/1613669607 shutdown_connections 2024-09-18T12:50:56.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.656+0000 7f076d8c7640 1 -- 172.21.15.45:0/1613669607 wait complete. 2024-09-18T12:50:56.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.656+0000 7f076d8c7640 1 Processor -- start 2024-09-18T12:50:56.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.656+0000 7f076d8c7640 1 -- start start 2024-09-18T12:50:56.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.656+0000 7f076d8c7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07681023f0 0x7f0768101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:56.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f076d8c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768104d20 0x7f07681003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f076d8c7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f076810a7e0 con 0x7f0768104d20 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f076d8c7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f076810a660 con 0x7f07681023f0 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f07667fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768104d20 0x7f07681003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f07667fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768104d20 0x7f07681003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54380/0 (socket says 172.21.15.45:54380) 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f07667fc640 1 -- 172.21.15.45:0/3256098102 learned_addr learned my addr 172.21.15.45:0/3256098102 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f0766ffd640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07681023f0 0x7f0768101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f07667fc640 1 -- 172.21.15.45:0/3256098102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07681023f0 msgr2=0x7f0768101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f07667fc640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07681023f0 0x7f0768101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f07667fc640 1 -- 172.21.15.45:0/3256098102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07681008e0 con 0x7f0768104d20 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f07667fc640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768104d20 0x7f07681003a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f075c00d6c0 tx=0x7f075c00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f076c8c5640 1 -- 172.21.15.45:0/3256098102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f075c017070 con 0x7f0768104d20 2024-09-18T12:50:56.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f076c8c5640 1 -- 172.21.15.45:0/3256098102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f075c0054e0 con 0x7f0768104d20 2024-09-18T12:50:56.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f076d8c7640 1 -- 172.21.15.45:0/3256098102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0768100bd0 con 0x7f0768104d20 2024-09-18T12:50:56.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f076c8c5640 1 -- 172.21.15.45:0/3256098102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f075c004b70 con 0x7f0768104d20 2024-09-18T12:50:56.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.657+0000 7f076d8c7640 1 -- 172.21.15.45:0/3256098102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0768101160 con 0x7f0768104d20 2024-09-18T12:50:56.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.658+0000 7f076d8c7640 1 -- 172.21.15.45:0/3256098102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07681027d0 con 0x7f0768104d20 2024-09-18T12:50:56.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.659+0000 7f076c8c5640 1 -- 172.21.15.45:0/3256098102 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f075c009820 con 0x7f0768104d20 2024-09-18T12:50:56.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.660+0000 7f076c8c5640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f075006e2b0 0x7f0750070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:56.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.660+0000 7f076c8c5640 1 -- 172.21.15.45:0/3256098102 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f075c08dd00 con 0x7f0768104d20 2024-09-18T12:50:56.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.660+0000 7f0766ffd640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f075006e2b0 0x7f0750070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:56.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.660+0000 7f0766ffd640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f075006e2b0 0x7f0750070770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0758006010 tx=0x7f07580058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:56.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.664+0000 7f076c8c5640 1 -- 172.21.15.45:0/3256098102 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f075c091030 con 0x7f0768104d20 2024-09-18T12:50:56.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.912+0000 7f076d8c7640 1 -- 172.21.15.45:0/3256098102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f076819fc90 con 0x7f0768104d20 2024-09-18T12:50:56.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.913+0000 7f076c8c5640 1 -- 172.21.15.45:0/3256098102 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f075c05f310 con 0x7f0768104d20 2024-09-18T12:50:56.914 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:50:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:50:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:50:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:50:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:50:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:50:56.915 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:50:56.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 -- 172.21.15.45:0/3256098102 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f075006e2b0 msgr2=0x7f0750070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f075006e2b0 0x7f0750070770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0758006010 tx=0x7f07580058d0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 -- 172.21.15.45:0/3256098102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768104d20 msgr2=0x7f07681003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:56.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768104d20 0x7f07681003a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f075c00d6c0 tx=0x7f075c00db80 comp rx=0 tx=0).stop 2024-09-18T12:50:56.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 -- 172.21.15.45:0/3256098102 shutdown_connections 2024-09-18T12:50:56.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7f075006e2b0 0x7f0750070770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768104d20 0x7f07681003a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 --2- 172.21.15.45:0/3256098102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07681023f0 0x7f0768101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:56.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 -- 172.21.15.45:0/3256098102 >> 172.21.15.45:0/3256098102 conn(0x7f07680fc010 msgr2=0x7f07680fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:56.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 -- 172.21.15.45:0/3256098102 shutdown_connections 2024-09-18T12:50:56.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:56.915+0000 7f076d8c7640 1 -- 172.21.15.45:0/3256098102 wait complete. 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.000+0000 7fbc19618640 1 -- 172.21.15.45:0/3580843209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc14102b60 msgr2=0x7fbc14102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.000+0000 7fbc19618640 1 --2- 172.21.15.45:0/3580843209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc14102b60 0x7fbc14102fe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009880 tx=0x7fbbfc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.000+0000 7fbc19618640 1 -- 172.21.15.45:0/3580843209 shutdown_connections 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.000+0000 7fbc19618640 1 --2- 172.21.15.45:0/3580843209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc14102b60 0x7fbc14102fe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.000+0000 7fbc19618640 1 --2- 172.21.15.45:0/3580843209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc14101960 0x7fbc14101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.000+0000 7fbc19618640 1 -- 172.21.15.45:0/3580843209 >> 172.21.15.45:0/3580843209 conn(0x7fbc140fd0f0 msgr2=0x7fbc140ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.000+0000 7fbc19618640 1 -- 172.21.15.45:0/3580843209 shutdown_connections 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.000+0000 7fbc19618640 1 -- 172.21.15.45:0/3580843209 wait complete. 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.000+0000 7fbc19618640 1 Processor -- start 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc19618640 1 -- start start 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc19618640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc14101960 0x7fbc14075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc19618640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc14102b60 0x7fbc140745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:57.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc19618640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1410a780 con 0x7fbc14101960 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc19618640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1410a600 con 0x7fbc14102b60 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc12ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc14101960 0x7fbc14075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc12ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc14101960 0x7fbc14075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54386/0 (socket says 172.21.15.45:54386) 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc12ffd640 1 -- 172.21.15.45:0/4138455548 learned_addr learned my addr 172.21.15.45:0/4138455548 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc0bfff640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc14102b60 0x7fbc140745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc12ffd640 1 -- 172.21.15.45:0/4138455548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc14102b60 msgr2=0x7fbc140745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc12ffd640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc14102b60 0x7fbc140745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc12ffd640 1 -- 172.21.15.45:0/4138455548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc14074b20 con 0x7fbc14101960 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc12ffd640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc14101960 0x7fbc14075f20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400d6f0 tx=0x7fbc0400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc10ff9640 1 -- 172.21.15.45:0/4138455548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc04017070 con 0x7fbc14101960 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc10ff9640 1 -- 172.21.15.45:0/4138455548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc0400de00 con 0x7fbc14101960 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.001+0000 7fbc19618640 1 -- 172.21.15.45:0/4138455548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc14074e10 con 0x7fbc14101960 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.002+0000 7fbc10ff9640 1 -- 172.21.15.45:0/4138455548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc04003bc0 con 0x7fbc14101960 2024-09-18T12:50:57.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.002+0000 7fbc19618640 1 -- 172.21.15.45:0/4138455548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc14075370 con 0x7fbc14101960 2024-09-18T12:50:57.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.003+0000 7fbc19618640 1 -- 172.21.15.45:0/4138455548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc14101d60 con 0x7fbc14101960 2024-09-18T12:50:57.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.003+0000 7fbc10ff9640 1 -- 172.21.15.45:0/4138455548 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fbc04003e70 con 0x7fbc14101960 2024-09-18T12:50:57.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.004+0000 7fbc10ff9640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbc0006e2b0 0x7fbc00070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:50:57.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.004+0000 7fbc10ff9640 1 -- 172.21.15.45:0/4138455548 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fbc0408dc70 con 0x7fbc14101960 2024-09-18T12:50:57.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.004+0000 7fbc0bfff640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbc0006e2b0 0x7fbc00070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:50:57.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.004+0000 7fbc0bfff640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbc0006e2b0 0x7fbc00070770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc000c00 tx=0x7fbbfc0058d0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:50:57.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.008+0000 7fbc10ff9640 1 -- 172.21.15.45:0/4138455548 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc0405f280 con 0x7fbc14101960 2024-09-18T12:50:57.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.200+0000 7fbc19618640 1 -- 172.21.15.45:0/4138455548 --> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbc1402c640 con 0x7fbc0006e2b0 2024-09-18T12:50:57.202 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:57.202 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: Upgrade: Updating mgr.smithi161.yoflkm 2024-09-18T12:50:57.202 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:50:57.202 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.yoflkm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:50:57.202 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:50:57.202 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:50:57.202 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: Deploying daemon mgr.smithi161.yoflkm on smithi161 2024-09-18T12:50:57.202 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:57.203 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:57.203 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:57.203 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:57 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3256098102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:57.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.201+0000 7fbc10ff9640 1 -- 172.21.15.45:0/4138455548 <== mgr.14215 v2:172.21.15.45:6800/3828746740 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fbc1402c640 con 0x7fbc0006e2b0 2024-09-18T12:50:57.203 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:50:57.203 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:50:57.203 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:50:57.204 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:50:57.204 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [], 2024-09-18T12:50:57.204 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "0/2 daemons upgraded", 2024-09-18T12:50:57.204 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T12:50:57.204 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:50:57.204 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:50:57.204 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T12:50:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.204+0000 7fbc19618640 1 -- 172.21.15.45:0/4138455548 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbc0006e2b0 msgr2=0x7fbc00070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.204+0000 7fbc19618640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbc0006e2b0 0x7fbc00070770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc000c00 tx=0x7fbbfc0058d0 comp rx=0 tx=0).stop 2024-09-18T12:50:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.204+0000 7fbc19618640 1 -- 172.21.15.45:0/4138455548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc14101960 msgr2=0x7fbc14075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:50:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.204+0000 7fbc19618640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc14101960 0x7fbc14075f20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400d6f0 tx=0x7fbc0400dbb0 comp rx=0 tx=0).stop 2024-09-18T12:50:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.204+0000 7fbc19618640 1 -- 172.21.15.45:0/4138455548 shutdown_connections 2024-09-18T12:50:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.204+0000 7fbc19618640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.45:6800/3828746740,v1:172.21.15.45:6801/3828746740] conn(0x7fbc0006e2b0 0x7fbc00070770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.204+0000 7fbc19618640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc14102b60 0x7fbc140745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:57.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.204+0000 7fbc19618640 1 --2- 172.21.15.45:0/4138455548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc14101960 0x7fbc14075f20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:50:57.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.204+0000 7fbc19618640 1 -- 172.21.15.45:0/4138455548 >> 172.21.15.45:0/4138455548 conn(0x7fbc140fd0f0 msgr2=0x7fbc14105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:50:57.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.205+0000 7fbc19618640 1 -- 172.21.15.45:0/4138455548 shutdown_connections 2024-09-18T12:50:57.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:50:57.205+0000 7fbc19618640 1 -- 172.21.15.45:0/4138455548 wait complete. 2024-09-18T12:50:57.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:57.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: Upgrade: Updating mgr.smithi161.yoflkm 2024-09-18T12:50:57.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:50:57.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.yoflkm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:50:57.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:50:57.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:50:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: Deploying daemon mgr.smithi161.yoflkm on smithi161 2024-09-18T12:50:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:50:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:57 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3256098102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:50:57.301 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T12:50:57.341 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:50:57.343 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:50:57.343 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T12:50:57.380 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T12:50:57.383 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:50:57.386 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T12:50:57.386 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-18T12:50:57.404 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-18T12:50:57.405 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-18T12:50:57.406 DEBUG:teuthology.orchestra.run.smithi045:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-18T12:50:57.470 INFO:tasks.workunit.client.0.smithi045.stderr:+ mkdir -p fsstress 2024-09-18T12:50:57.472 INFO:tasks.workunit.client.0.smithi045.stderr:+ pushd fsstress 2024-09-18T12:50:57.473 INFO:tasks.workunit.client.0.smithi045.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:50:57.474 INFO:tasks.workunit.client.0.smithi045.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-18T12:50:57.501 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T12:50:57.543 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-18T12:50:57.544 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-18T12:50:57.545 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T12:50:57.586 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-18T12:50:57.589 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-18T12:50:57.590 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-18T12:50:57.606 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-18T12:50:57.607 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-18T12:50:57.607 DEBUG:teuthology.orchestra.run.smithi161:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-18T12:50:57.671 INFO:tasks.workunit.client.1.smithi161.stderr:+ mkdir -p fsstress 2024-09-18T12:50:57.673 INFO:tasks.workunit.client.1.smithi161.stderr:+ pushd fsstress 2024-09-18T12:50:57.674 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:50:57.674 INFO:tasks.workunit.client.1.smithi161.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-18T12:50:58.028 INFO:tasks.workunit.client.0.smithi045.stderr:+ tar xzf ltp-full.tgz 2024-09-18T12:50:58.213 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:58 smithi161 ceph-mon[35784]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:58.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:58 smithi045 ceph-mon[28315]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:50:58.794 INFO:tasks.workunit.client.1.smithi161.stderr:+ tar xzf ltp-full.tgz 2024-09-18T12:50:59.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:50:59 smithi045 ceph-mon[28315]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:50:59.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:50:59 smithi161 ceph-mon[35784]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:51:01.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:01 smithi161 ceph-mon[35784]: pgmap v227: 65 pgs: 65 active+clean; 7.6 MiB data, 210 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 606 KiB/s wr, 8 op/s 2024-09-18T12:51:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:01 smithi045 ceph-mon[28315]: pgmap v227: 65 pgs: 65 active+clean; 7.6 MiB data, 210 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 606 KiB/s wr, 8 op/s 2024-09-18T12:51:02.575 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:02 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:02 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:03.692 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:03 smithi161 ceph-mon[35784]: pgmap v228: 65 pgs: 65 active+clean; 22 MiB data, 243 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s rd, 1.8 MiB/s wr, 37 op/s 2024-09-18T12:51:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:03 smithi045 ceph-mon[28315]: pgmap v228: 65 pgs: 65 active+clean; 22 MiB data, 243 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s rd, 1.8 MiB/s wr, 37 op/s 2024-09-18T12:51:05.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:05.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:05.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:04 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:05.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:04 smithi045 ceph-mon[28315]: pgmap v229: 65 pgs: 65 active+clean; 28 MiB data, 265 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s rd, 2.3 MiB/s wr, 61 op/s 2024-09-18T12:51:05.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:05.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:05.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:04 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:05.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:04 smithi161 ceph-mon[35784]: pgmap v229: 65 pgs: 65 active+clean; 28 MiB data, 265 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s rd, 2.3 MiB/s wr, 61 op/s 2024-09-18T12:51:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:07 smithi045 ceph-mon[28315]: pgmap v230: 65 pgs: 65 active+clean; 38 MiB data, 298 MiB used, 536 GiB / 536 GiB avail; 728 KiB/s rd, 3.2 MiB/s wr, 96 op/s 2024-09-18T12:51:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:07 smithi161 ceph-mon[35784]: pgmap v230: 65 pgs: 65 active+clean; 38 MiB data, 298 MiB used, 536 GiB / 536 GiB avail; 728 KiB/s rd, 3.2 MiB/s wr, 96 op/s 2024-09-18T12:51:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:09 smithi045 ceph-mon[28315]: pgmap v231: 65 pgs: 65 active+clean; 40 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 728 KiB/s rd, 3.4 MiB/s wr, 134 op/s 2024-09-18T12:51:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:09 smithi045 ceph-mon[28315]: Standby manager daemon smithi161.yoflkm restarted 2024-09-18T12:51:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:09 smithi045 ceph-mon[28315]: Standby manager daemon smithi161.yoflkm started 2024-09-18T12:51:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:09 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/crt"}]: dispatch 2024-09-18T12:51:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:09 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:51:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:09 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/key"}]: dispatch 2024-09-18T12:51:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:09 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:51:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:09 smithi161 ceph-mon[35784]: pgmap v231: 65 pgs: 65 active+clean; 40 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 728 KiB/s rd, 3.4 MiB/s wr, 134 op/s 2024-09-18T12:51:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:09 smithi161 ceph-mon[35784]: Standby manager daemon smithi161.yoflkm restarted 2024-09-18T12:51:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:09 smithi161 ceph-mon[35784]: Standby manager daemon smithi161.yoflkm started 2024-09-18T12:51:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:09 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/crt"}]: dispatch 2024-09-18T12:51:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:09 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:51:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:09 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/key"}]: dispatch 2024-09-18T12:51:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:09 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:51:10.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:10 smithi045 ceph-mon[28315]: mgrmap e20: smithi045.brvbvl(active, since 6m), standbys: smithi161.yoflkm 2024-09-18T12:51:10.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:10 smithi161 ceph-mon[35784]: mgrmap e20: smithi045.brvbvl(active, since 6m), standbys: smithi161.yoflkm 2024-09-18T12:51:11.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:11 smithi045 ceph-mon[28315]: pgmap v232: 65 pgs: 65 active+clean; 42 MiB data, 335 MiB used, 536 GiB / 536 GiB avail; 790 KiB/s rd, 3.5 MiB/s wr, 149 op/s 2024-09-18T12:51:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:11 smithi161 ceph-mon[35784]: pgmap v232: 65 pgs: 65 active+clean; 42 MiB data, 335 MiB used, 536 GiB / 536 GiB avail; 790 KiB/s rd, 3.5 MiB/s wr, 149 op/s 2024-09-18T12:51:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:13 smithi045 ceph-mon[28315]: pgmap v233: 65 pgs: 65 active+clean; 51 MiB data, 367 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 163 op/s 2024-09-18T12:51:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:13 smithi161 ceph-mon[35784]: pgmap v233: 65 pgs: 65 active+clean; 51 MiB data, 367 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 163 op/s 2024-09-18T12:51:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:15 smithi045 ceph-mon[28315]: pgmap v234: 65 pgs: 65 active+clean; 63 MiB data, 400 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 151 op/s 2024-09-18T12:51:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:15 smithi161 ceph-mon[35784]: pgmap v234: 65 pgs: 65 active+clean; 63 MiB data, 400 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 151 op/s 2024-09-18T12:51:17.381 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:17.381 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:17.381 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:17 smithi161 ceph-mon[35784]: pgmap v235: 65 pgs: 65 active+clean; 78 MiB data, 427 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.3 MiB/s wr, 176 op/s 2024-09-18T12:51:17.381 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:17.382 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:17.382 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:17 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:17 smithi045 ceph-mon[28315]: pgmap v235: 65 pgs: 65 active+clean; 78 MiB data, 427 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.3 MiB/s wr, 176 op/s 2024-09-18T12:51:17.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:17.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:17.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:17 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:19.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:19 smithi045 ceph-mon[28315]: pgmap v236: 65 pgs: 65 active+clean; 93 MiB data, 456 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 202 op/s 2024-09-18T12:51:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:19 smithi161 ceph-mon[35784]: pgmap v236: 65 pgs: 65 active+clean; 93 MiB data, 456 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 202 op/s 2024-09-18T12:51:21.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:21.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:21.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:21.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:21.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:21.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:21.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr fail", "who": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:51:21.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: Activating manager daemon smithi161.yoflkm 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "mgr fail", "who": "smithi045.brvbvl"}]': finished 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: osdmap e45: 6 total, 6 up, 6 in 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: mgrmap e21: smithi161.yoflkm(active, starting, since 0.00894012s) 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.gzqgyu"}]: dispatch 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"}]: dispatch 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.maxdew"}]: dispatch 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.xoxpyp"}]: dispatch 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mgr metadata", "who": "smithi161.yoflkm", "id": "smithi161.yoflkm"}]: dispatch 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:51:21.445 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: Manager daemon smithi161.yoflkm is now available 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:21.446 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr fail", "who": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: Activating manager daemon smithi161.yoflkm 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.14215 172.21.15.45:0/2356178081' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "mgr fail", "who": "smithi045.brvbvl"}]': finished 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: osdmap e45: 6 total, 6 up, 6 in 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: mgrmap e21: smithi161.yoflkm(active, starting, since 0.00894012s) 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.gzqgyu"}]: dispatch 2024-09-18T12:51:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.maxdew"}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.xoxpyp"}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mgr metadata", "who": "smithi161.yoflkm", "id": "smithi161.yoflkm"}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: Manager daemon smithi161.yoflkm is now available 2024-09-18T12:51:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:21.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:21.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:21.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:51:22.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:22 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:22.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:22 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:51:22.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:22 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.yoflkm/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:51:22.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:22 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.yoflkm/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:51:22.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:22 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.yoflkm/trash_purge_schedule"}]: dispatch 2024-09-18T12:51:22.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:22 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.yoflkm/trash_purge_schedule"}]: dispatch 2024-09-18T12:51:22.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:22 smithi045 ceph-mon[28315]: mgrmap e22: smithi161.yoflkm(active, since 1.01144s) 2024-09-18T12:51:22.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:22 smithi045 ceph-mon[28315]: Deploying cephadm binary to smithi161 2024-09-18T12:51:22.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:22 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:22.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:22 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:51:22.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:22 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.yoflkm/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:51:22.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:22 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.yoflkm/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:51:22.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:22 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.yoflkm/trash_purge_schedule"}]: dispatch 2024-09-18T12:51:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:22 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.yoflkm/trash_purge_schedule"}]: dispatch 2024-09-18T12:51:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:22 smithi161 ceph-mon[35784]: mgrmap e22: smithi161.yoflkm(active, since 1.01144s) 2024-09-18T12:51:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:22 smithi161 ceph-mon[35784]: Deploying cephadm binary to smithi161 2024-09-18T12:51:23.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:23 smithi161 ceph-mon[35784]: [18/Sep/2024:12:51:22] ENGINE Bus STARTING 2024-09-18T12:51:23.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:23 smithi161 ceph-mon[35784]: pgmap v4: 65 pgs: 65 active+clean; 104 MiB data, 523 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:51:23.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:23 smithi161 ceph-mon[35784]: [18/Sep/2024:12:51:22] ENGINE Serving on https://172.21.15.161:7150 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:23 smithi161 ceph-mon[35784]: [18/Sep/2024:12:51:22] ENGINE Error in HTTPServer.serve 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Traceback (most recent call last): 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self._run(expiration_interval) 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: s = self.context.wrap_socket( 2024-09-18T12:51:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:51:23.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: return self.sslsocket_class._create( 2024-09-18T12:51:23.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:51:23.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self.do_handshake() 2024-09-18T12:51:23.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:51:23.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self._sslobj.do_handshake() 2024-09-18T12:51:23.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:51:23.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:23 smithi161 ceph-mon[35784]: [18/Sep/2024:12:51:22] ENGINE Serving on http://172.21.15.161:8765 2024-09-18T12:51:23.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:23 smithi161 ceph-mon[35784]: [18/Sep/2024:12:51:22] ENGINE Bus STARTED 2024-09-18T12:51:23.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:23 smithi161 ceph-mon[35784]: Deploying cephadm binary to smithi045 2024-09-18T12:51:23.720 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:23 smithi045 ceph-mon[28315]: [18/Sep/2024:12:51:22] ENGINE Bus STARTING 2024-09-18T12:51:23.720 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:23 smithi045 ceph-mon[28315]: pgmap v4: 65 pgs: 65 active+clean; 104 MiB data, 523 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:51:23.721 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:23 smithi045 ceph-mon[28315]: [18/Sep/2024:12:51:22] ENGINE Serving on https://172.21.15.161:7150 2024-09-18T12:51:23.721 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:23 smithi045 ceph-mon[28315]: [18/Sep/2024:12:51:22] ENGINE Error in HTTPServer.serve 2024-09-18T12:51:23.721 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Traceback (most recent call last): 2024-09-18T12:51:23.721 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:51:23.721 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:51:23.721 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:51:23.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._run(expiration_interval) 2024-09-18T12:51:23.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:51:23.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:51:23.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:51:23.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:51:23.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:51:23.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: s = self.context.wrap_socket( 2024-09-18T12:51:23.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:51:23.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: return self.sslsocket_class._create( 2024-09-18T12:51:23.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:51:23.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self.do_handshake() 2024-09-18T12:51:23.724 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:51:23.724 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._sslobj.do_handshake() 2024-09-18T12:51:23.724 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:51:23.724 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:23 smithi045 ceph-mon[28315]: [18/Sep/2024:12:51:22] ENGINE Serving on http://172.21.15.161:8765 2024-09-18T12:51:23.724 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:23 smithi045 ceph-mon[28315]: [18/Sep/2024:12:51:22] ENGINE Bus STARTED 2024-09-18T12:51:23.724 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:23 smithi045 ceph-mon[28315]: Deploying cephadm binary to smithi045 2024-09-18T12:51:24.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:24 smithi045 ceph-mon[28315]: mgrmap e23: smithi161.yoflkm(active, since 3s) 2024-09-18T12:51:24.767 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:24 smithi161 ceph-mon[35784]: mgrmap e23: smithi161.yoflkm(active, since 3s) 2024-09-18T12:51:25.575 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:25 smithi045 ceph-mon[28315]: pgmap v5: 65 pgs: 65 active+clean; 104 MiB data, 523 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:51:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:25 smithi161 ceph-mon[35784]: pgmap v5: 65 pgs: 65 active+clean; 104 MiB data, 523 MiB used, 536 GiB / 536 GiB avail 2024-09-18T12:51:26.711 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:26 smithi161 ceph-mon[35784]: mgrmap e24: smithi161.yoflkm(active, since 5s) 2024-09-18T12:51:26.711 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:26 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:26.711 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:26 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:26.711 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:26 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:26.711 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:26 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:26.728 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:26 smithi045 ceph-mon[28315]: mgrmap e24: smithi161.yoflkm(active, since 5s) 2024-09-18T12:51:26.728 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:26 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:26.728 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:26 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:26.728 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:26 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:26.728 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:26 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.327+0000 7faaac12a640 1 -- 172.21.15.45:0/3429320361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa4101960 msgr2=0x7faaa4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.327+0000 7faaac12a640 1 --2- 172.21.15.45:0/3429320361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa4101960 0x7faaa4101d60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009880 tx=0x7faa9c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.327+0000 7faaac12a640 1 -- 172.21.15.45:0/3429320361 shutdown_connections 2024-09-18T12:51:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.327+0000 7faaac12a640 1 --2- 172.21.15.45:0/3429320361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa4102b60 0x7faaa4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.327+0000 7faaac12a640 1 --2- 172.21.15.45:0/3429320361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa4101960 0x7faaa4101d60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.327+0000 7faaac12a640 1 -- 172.21.15.45:0/3429320361 >> 172.21.15.45:0/3429320361 conn(0x7faaa40fd0f0 msgr2=0x7faaa40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.328+0000 7faaac12a640 1 -- 172.21.15.45:0/3429320361 shutdown_connections 2024-09-18T12:51:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.328+0000 7faaac12a640 1 -- 172.21.15.45:0/3429320361 wait complete. 2024-09-18T12:51:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.329+0000 7faaac12a640 1 Processor -- start 2024-09-18T12:51:27.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.330+0000 7faaac12a640 1 -- start start 2024-09-18T12:51:27.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.330+0000 7faaac12a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa4101960 0x7faaa41974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:27.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.330+0000 7faaac12a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa4102b60 0x7faaa41979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.330+0000 7faaac12a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faaa410a780 con 0x7faaa4102b60 2024-09-18T12:51:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.330+0000 7faaa9ec6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa4101960 0x7faaa41974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.330+0000 7faaa9ec6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa4101960 0x7faaa41974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:47674/0 (socket says 172.21.15.45:47674) 2024-09-18T12:51:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.330+0000 7faaa9ec6640 1 -- 172.21.15.45:0/35598181 learned_addr learned my addr 172.21.15.45:0/35598181 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:51:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.331+0000 7faaa96c5640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa4102b60 0x7faaa41979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.331+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7faaa410a600 con 0x7faaa4101960 2024-09-18T12:51:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.331+0000 7faaa96c5640 1 -- 172.21.15.45:0/35598181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa4101960 msgr2=0x7faaa41974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.331+0000 7faaa96c5640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa4101960 0x7faaa41974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.331+0000 7faaa96c5640 1 -- 172.21.15.45:0/35598181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa4198070 con 0x7faaa4102b60 2024-09-18T12:51:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.332+0000 7faaa96c5640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa4102b60 0x7faaa41979f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa9800e970 tx=0x7faa9800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.332+0000 7faaa2ffd640 1 -- 172.21.15.45:0/35598181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa9800cac0 con 0x7faaa4102b60 2024-09-18T12:51:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.332+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa419cab0 con 0x7faaa4102b60 2024-09-18T12:51:27.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.332+0000 7faaa2ffd640 1 -- 172.21.15.45:0/35598181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa9800cc60 con 0x7faaa4102b60 2024-09-18T12:51:27.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.332+0000 7faaa2ffd640 1 -- 172.21.15.45:0/35598181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa980184f0 con 0x7faaa4102b60 2024-09-18T12:51:27.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.333+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa419d040 con 0x7faaa4102b60 2024-09-18T12:51:27.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.333+0000 7faaa2ffd640 1 -- 172.21.15.45:0/35598181 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 52130+0+0 (secure 0 0 0) 0x7faa98018690 con 0x7faaa4102b60 2024-09-18T12:51:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.334+0000 7faaa2ffd640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7faa8c03fde0 0x7faa8c0422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.334+0000 7faaa2ffd640 1 -- 172.21.15.45:0/35598181 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7faa98055950 con 0x7faaa4102b60 2024-09-18T12:51:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.334+0000 7faaa9ec6640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7faa8c03fde0 0x7faa8c0422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.334+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa4101d60 con 0x7faaa4102b60 2024-09-18T12:51:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.335+0000 7faaa9ec6640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7faa8c03fde0 0x7faa8c0422a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0096c0 tx=0x7faa9c02a9a0 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:27.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.343+0000 7faaa2ffd640 1 -- 172.21.15.45:0/35598181 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7faa98018980 con 0x7faaa4102b60 2024-09-18T12:51:27.643 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:27 smithi045 ceph-mon[28315]: pgmap v6: 65 pgs: 65 active+clean; 107 MiB data, 544 MiB used, 536 GiB / 536 GiB avail; 822 KiB/s rd, 676 KiB/s wr, 36 op/s 2024-09-18T12:51:27.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.747+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faaa4062740 con 0x7faa8c03fde0 2024-09-18T12:51:27.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.749+0000 7faaa2ffd640 1 -- 172.21.15.45:0/35598181 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7faaa4062740 con 0x7faa8c03fde0 2024-09-18T12:51:27.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.753+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7faa8c03fde0 msgr2=0x7faa8c0422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.753+0000 7faaac12a640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7faa8c03fde0 0x7faa8c0422a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0096c0 tx=0x7faa9c02a9a0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.753+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa4102b60 msgr2=0x7faaa41979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.753+0000 7faaac12a640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa4102b60 0x7faaa41979f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa9800e970 tx=0x7faa9800ee30 comp rx=0 tx=0).stop 2024-09-18T12:51:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.754+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 shutdown_connections 2024-09-18T12:51:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.754+0000 7faaac12a640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7faa8c03fde0 0x7faa8c0422a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.754+0000 7faaac12a640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa4102b60 0x7faaa41979f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.754+0000 7faaac12a640 1 --2- 172.21.15.45:0/35598181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa4101960 0x7faaa41974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.754+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 >> 172.21.15.45:0/35598181 conn(0x7faaa40fd0f0 msgr2=0x7faaa4106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:27.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.754+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 shutdown_connections 2024-09-18T12:51:27.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.754+0000 7faaac12a640 1 -- 172.21.15.45:0/35598181 wait complete. 2024-09-18T12:51:27.770 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:51:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:27 smithi161 ceph-mon[35784]: pgmap v6: 65 pgs: 65 active+clean; 107 MiB data, 544 MiB used, 536 GiB / 536 GiB avail; 822 KiB/s rd, 676 KiB/s wr, 36 op/s 2024-09-18T12:51:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.885+0000 7f2433cd6640 1 -- 172.21.15.45:0/3654700636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f242c101a60 msgr2=0x7f242c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.885+0000 7f2433cd6640 1 --2- 172.21.15.45:0/3654700636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f242c101a60 0x7f242c101ee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f241c00b9f0 tx=0x7f241c02c1e0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.885+0000 7f2433cd6640 1 -- 172.21.15.45:0/3654700636 shutdown_connections 2024-09-18T12:51:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.885+0000 7f2433cd6640 1 --2- 172.21.15.45:0/3654700636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f242c101a60 0x7f242c101ee0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.885+0000 7f2433cd6640 1 --2- 172.21.15.45:0/3654700636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f242c100860 0x7f242c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.885+0000 7f2433cd6640 1 -- 172.21.15.45:0/3654700636 >> 172.21.15.45:0/3654700636 conn(0x7f242c0fc010 msgr2=0x7f242c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.885+0000 7f2433cd6640 1 -- 172.21.15.45:0/3654700636 shutdown_connections 2024-09-18T12:51:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.886+0000 7f2433cd6640 1 -- 172.21.15.45:0/3654700636 wait complete. 2024-09-18T12:51:27.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2433cd6640 1 Processor -- start 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2433cd6640 1 -- start start 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2433cd6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f242c100860 0x7f242c1996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2433cd6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f242c101a60 0x7f242c199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2433cd6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f242c108570 con 0x7f242c100860 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2433cd6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f242c1083f0 con 0x7f242c101a60 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2431a72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f242c100860 0x7f242c1996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2431a72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f242c100860 0x7f242c1996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36326/0 (socket says 172.21.15.45:36326) 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2431a72640 1 -- 172.21.15.45:0/3368868333 learned_addr learned my addr 172.21.15.45:0/3368868333 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2431271640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f242c101a60 0x7f242c199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2431a72640 1 -- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f242c101a60 msgr2=0x7f242c199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2431a72640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f242c101a60 0x7f242c199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:27.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.887+0000 7f2431a72640 1 -- 172.21.15.45:0/3368868333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242c19a270 con 0x7f242c100860 2024-09-18T12:51:27.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.888+0000 7f2431271640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f242c101a60 0x7f242c199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:51:27.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.888+0000 7f2431a72640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f242c100860 0x7f242c1996b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f242800e970 tx=0x7f242800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:27.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.888+0000 7f2422ffd640 1 -- 172.21.15.45:0/3368868333 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f242800cac0 con 0x7f242c100860 2024-09-18T12:51:27.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.888+0000 7f2422ffd640 1 -- 172.21.15.45:0/3368868333 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f242800cc60 con 0x7f242c100860 2024-09-18T12:51:27.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.888+0000 7f2422ffd640 1 -- 172.21.15.45:0/3368868333 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2428003d10 con 0x7f242c100860 2024-09-18T12:51:27.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.888+0000 7f2433cd6640 1 -- 172.21.15.45:0/3368868333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242c19ecb0 con 0x7f242c100860 2024-09-18T12:51:27.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.888+0000 7f2433cd6640 1 -- 172.21.15.45:0/3368868333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f242c19f1c0 con 0x7f242c100860 2024-09-18T12:51:27.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.889+0000 7f2433cd6640 1 -- 172.21.15.45:0/3368868333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f242c100c60 con 0x7f242c100860 2024-09-18T12:51:27.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.889+0000 7f2422ffd640 1 -- 172.21.15.45:0/3368868333 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 52130+0+0 (secure 0 0 0) 0x7f2428003f80 con 0x7f242c100860 2024-09-18T12:51:27.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.890+0000 7f2422ffd640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f241803fb90 0x7f2418042050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:27.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.890+0000 7f2422ffd640 1 -- 172.21.15.45:0/3368868333 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f2428055db0 con 0x7f242c100860 2024-09-18T12:51:27.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.890+0000 7f2431271640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f241803fb90 0x7f2418042050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:27.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.891+0000 7f2431271640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f241803fb90 0x7f2418042050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f241c000c00 tx=0x7f241c02e040 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:27.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:27.897+0000 7f2422ffd640 1 -- 172.21.15.45:0/3368868333 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f24280173d0 con 0x7f242c100860 2024-09-18T12:51:28.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.156+0000 7f2433cd6640 1 -- 172.21.15.45:0/3368868333 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f242c062630 con 0x7f241803fb90 2024-09-18T12:51:28.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.157+0000 7f2422ffd640 1 -- 172.21.15.45:0/3368868333 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f242c062630 con 0x7f241803fb90 2024-09-18T12:51:28.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 -- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f241803fb90 msgr2=0x7f2418042050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:28.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f241803fb90 0x7f2418042050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f241c000c00 tx=0x7f241c02e040 comp rx=0 tx=0).stop 2024-09-18T12:51:28.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 -- 172.21.15.45:0/3368868333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f242c100860 msgr2=0x7f242c1996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:28.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f242c100860 0x7f242c1996b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f242800e970 tx=0x7f242800ee30 comp rx=0 tx=0).stop 2024-09-18T12:51:28.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 -- 172.21.15.45:0/3368868333 shutdown_connections 2024-09-18T12:51:28.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f241803fb90 0x7f2418042050 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f242c101a60 0x7f242c199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 --2- 172.21.15.45:0/3368868333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f242c100860 0x7f242c1996b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 -- 172.21.15.45:0/3368868333 >> 172.21.15.45:0/3368868333 conn(0x7f242c0fc010 msgr2=0x7f242c104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:28.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 -- 172.21.15.45:0/3368868333 shutdown_connections 2024-09-18T12:51:28.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.160+0000 7f2433cd6640 1 -- 172.21.15.45:0/3368868333 wait complete. 2024-09-18T12:51:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.271+0000 7f6044b16640 1 -- 172.21.15.45:0/3676792903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6040100240 msgr2=0x7f6040100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.271+0000 7f6044b16640 1 --2- 172.21.15.45:0/3676792903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6040100240 0x7f6040100640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60300097e0 tx=0x7f603002a3f0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.272+0000 7f6044b16640 1 -- 172.21.15.45:0/3676792903 shutdown_connections 2024-09-18T12:51:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.272+0000 7f6044b16640 1 --2- 172.21.15.45:0/3676792903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6040100b80 0x7f6040100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.272+0000 7f6044b16640 1 --2- 172.21.15.45:0/3676792903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6040100240 0x7f6040100640 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.272+0000 7f6044b16640 1 -- 172.21.15.45:0/3676792903 >> 172.21.15.45:0/3676792903 conn(0x7f60400fc010 msgr2=0x7f60400fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.272+0000 7f6044b16640 1 -- 172.21.15.45:0/3676792903 shutdown_connections 2024-09-18T12:51:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.272+0000 7f6044b16640 1 -- 172.21.15.45:0/3676792903 wait complete. 2024-09-18T12:51:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f6044b16640 1 Processor -- start 2024-09-18T12:51:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f6044b16640 1 -- start start 2024-09-18T12:51:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f6044b16640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6040100240 0x7f604019daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f6044b16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6040100b80 0x7f604019dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f6044b16640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f60401036f0 con 0x7f6040100b80 2024-09-18T12:51:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f6044b16640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6040103570 con 0x7f6040100240 2024-09-18T12:51:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f603e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6040100240 0x7f604019daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f603dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6040100b80 0x7f604019dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f603e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6040100240 0x7f604019daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:47708/0 (socket says 172.21.15.45:47708) 2024-09-18T12:51:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f603e59c640 1 -- 172.21.15.45:0/3826057201 learned_addr learned my addr 172.21.15.45:0/3826057201 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:51:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.273+0000 7f603dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6040100b80 0x7f604019dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36340/0 (socket says 172.21.15.45:36340) 2024-09-18T12:51:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.274+0000 7f603e59c640 1 -- 172.21.15.45:0/3826057201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6040100b80 msgr2=0x7f604019dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.274+0000 7f603e59c640 1 --2- 172.21.15.45:0/3826057201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6040100b80 0x7f604019dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.274+0000 7f603e59c640 1 -- 172.21.15.45:0/3826057201 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604019e660 con 0x7f6040100240 2024-09-18T12:51:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.274+0000 7f603e59c640 1 --2- 172.21.15.45:0/3826057201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6040100240 0x7f604019daa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6030009900 tx=0x7f60300043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.274+0000 7f602f7fe640 1 -- 172.21.15.45:0/3826057201 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6030040070 con 0x7f6040100240 2024-09-18T12:51:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.275+0000 7f6044b16640 1 -- 172.21.15.45:0/3826057201 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60401a3040 con 0x7f6040100240 2024-09-18T12:51:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.275+0000 7f6044b16640 1 -- 172.21.15.45:0/3826057201 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60401a35d0 con 0x7f6040100240 2024-09-18T12:51:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.275+0000 7f602f7fe640 1 -- 172.21.15.45:0/3826057201 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6030030c00 con 0x7f6040100240 2024-09-18T12:51:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.275+0000 7f602f7fe640 1 -- 172.21.15.45:0/3826057201 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6030003d10 con 0x7f6040100240 2024-09-18T12:51:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.276+0000 7f6044b16640 1 -- 172.21.15.45:0/3826057201 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60200052c0 con 0x7f6040100240 2024-09-18T12:51:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.276+0000 7f602f7fe640 1 -- 172.21.15.45:0/3826057201 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 24) ==== 52130+0+0 (secure 0 0 0) 0x7f6030039040 con 0x7f6040100240 2024-09-18T12:51:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.276+0000 7f602f7fe640 1 --2- 172.21.15.45:0/3826057201 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f602803fc30 0x7f60280420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.277+0000 7f602f7fe640 1 -- 172.21.15.45:0/3826057201 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f6030076b50 con 0x7f6040100240 2024-09-18T12:51:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.277+0000 7f603dd9b640 1 --2- 172.21.15.45:0/3826057201 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f602803fc30 0x7f60280420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:28.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.277+0000 7f603dd9b640 1 --2- 172.21.15.45:0/3826057201 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f602803fc30 0x7f60280420f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f604019ef50 tx=0x7f6034009260 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:28.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.282+0000 7f602f7fe640 1 -- 172.21.15.45:0/3826057201 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f60300035f0 con 0x7f6040100240 2024-09-18T12:51:28.408 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:28 smithi045 ceph-mon[28315]: Standby manager daemon smithi045.brvbvl started 2024-09-18T12:51:28.408 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:28 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.45:0/3016376817' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi045.brvbvl/crt"}]: dispatch 2024-09-18T12:51:28.408 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:28 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.45:0/3016376817' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:51:28.408 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:28 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.45:0/3016376817' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi045.brvbvl/key"}]: dispatch 2024-09-18T12:51:28.408 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:28 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.45:0/3016376817' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:51:28.409 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:28 smithi045 ceph-mon[28315]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.417+0000 7f602f7fe640 1 -- 172.21.15.45:0/3826057201 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f6030043d30 con 0x7f6040100240 2024-09-18T12:51:28.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.614+0000 7f6044b16640 1 -- 172.21.15.45:0/3826057201 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6020000bf0 con 0x7f602803fc30 2024-09-18T12:51:28.626 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:51:28.626 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (5m) 108s ago 7m 26.8M - 0.25.0 c8568f914cd2 de7ae4bc8025 2024-09-18T12:51:28.626 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (7m) 108s ago 7m 8224k - 19.1.1-330-gc2ddf972 ebb0615149de 147094edb221 2024-09-18T12:51:28.626 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (6m) 3s ago 6m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de a49472bef49e 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (7m) 108s ago 7m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (6m) 3s ago 6m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (5m) 108s ago 7m 79.5M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (2m) 108s ago 2m 15.4M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (2m) 108s ago 2m 17.3M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (2m) 3s ago 2m 13.8M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (2m) 3s ago 2m 12.2M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:9283,8765,8443 running (8m) 108s ago 8m 500M - 19.1.1-330-gc2ddf972 ebb0615149de 84d721f8241b 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (28s) 3s ago 6m 491M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 0fb3c7114540 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (8m) 108s ago 8m 47.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (6m) 3s ago 6m 41.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (7m) 108s ago 7m 16.1M - 1.5.0 0da6a335fe13 39666fd05306 2024-09-18T12:51:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (6m) 3s ago 6m 16.6M - 1.5.0 0da6a335fe13 ed4fe4d74f39 2024-09-18T12:51:28.628 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (5m) 108s ago 5m 53.3M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:51:28.628 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (4m) 108s ago 5m 55.6M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:51:28.628 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (4m) 108s ago 4m 48.5M 3948M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:51:28.628 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (4m) 3s ago 4m 77.4M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:51:28.628 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (3m) 3s ago 3m 80.0M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:51:28.628 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (3m) 3s ago 3m 75.4M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:51:28.628 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (5m) 108s ago 7m 55.4M - 2.43.0 a07b618ecd1d 411e86f6fecd 2024-09-18T12:51:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.624+0000 7f602f7fe640 1 -- 172.21.15.45:0/3826057201 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6020000bf0 con 0x7f602803fc30 2024-09-18T12:51:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.627+0000 7f6044b16640 1 -- 172.21.15.45:0/3826057201 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f602803fc30 msgr2=0x7f60280420f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.627+0000 7f6044b16640 1 --2- 172.21.15.45:0/3826057201 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f602803fc30 0x7f60280420f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f604019ef50 tx=0x7f6034009260 comp rx=0 tx=0).stop 2024-09-18T12:51:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.627+0000 7f6044b16640 1 -- 172.21.15.45:0/3826057201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6040100240 msgr2=0x7f604019daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.627+0000 7f6044b16640 1 --2- 172.21.15.45:0/3826057201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6040100240 0x7f604019daa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6030009900 tx=0x7f60300043b0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.627+0000 7f6044b16640 1 -- 172.21.15.45:0/3826057201 shutdown_connections 2024-09-18T12:51:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.627+0000 7f6044b16640 1 --2- 172.21.15.45:0/3826057201 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f602803fc30 0x7f60280420f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.627+0000 7f6044b16640 1 --2- 172.21.15.45:0/3826057201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6040100b80 0x7f604019dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.627+0000 7f6044b16640 1 --2- 172.21.15.45:0/3826057201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6040100240 0x7f604019daa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.627+0000 7f6044b16640 1 -- 172.21.15.45:0/3826057201 >> 172.21.15.45:0/3826057201 conn(0x7f60400fc010 msgr2=0x7f60401063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.628+0000 7f6044b16640 1 -- 172.21.15.45:0/3826057201 shutdown_connections 2024-09-18T12:51:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.628+0000 7f6044b16640 1 -- 172.21.15.45:0/3826057201 wait complete. 2024-09-18T12:51:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.754+0000 7ff2de993640 1 -- 172.21.15.45:0/2742908331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d8100880 msgr2=0x7ff2d8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.754+0000 7ff2de993640 1 --2- 172.21.15.45:0/2742908331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d8100880 0x7ff2d8100c80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009c20 tx=0x7ff2d002a980 comp rx=0 tx=0).stop 2024-09-18T12:51:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.754+0000 7ff2de993640 1 -- 172.21.15.45:0/2742908331 shutdown_connections 2024-09-18T12:51:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.754+0000 7ff2de993640 1 --2- 172.21.15.45:0/2742908331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8101a80 0x7ff2d8101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.754+0000 7ff2de993640 1 --2- 172.21.15.45:0/2742908331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d8100880 0x7ff2d8100c80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.754+0000 7ff2de993640 1 -- 172.21.15.45:0/2742908331 >> 172.21.15.45:0/2742908331 conn(0x7ff2d80fc010 msgr2=0x7ff2d80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.754+0000 7ff2de993640 1 -- 172.21.15.45:0/2742908331 shutdown_connections 2024-09-18T12:51:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.754+0000 7ff2de993640 1 -- 172.21.15.45:0/2742908331 wait complete. 2024-09-18T12:51:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.755+0000 7ff2de993640 1 Processor -- start 2024-09-18T12:51:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.755+0000 7ff2de993640 1 -- start start 2024-09-18T12:51:28.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2de993640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8100880 0x7ff2d81996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:28.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2de993640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d8101a80 0x7ff2d8199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:28.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2de993640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d81096a0 con 0x7ff2d8100880 2024-09-18T12:51:28.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2de993640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d8109520 con 0x7ff2d8101a80 2024-09-18T12:51:28.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2d7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8100880 0x7ff2d81996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:28.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2d7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8100880 0x7ff2d81996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36360/0 (socket says 172.21.15.45:36360) 2024-09-18T12:51:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2d7fff640 1 -- 172.21.15.45:0/4048086794 learned_addr learned my addr 172.21.15.45:0/4048086794 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:51:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2d77fe640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d8101a80 0x7ff2d8199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2d7fff640 1 -- 172.21.15.45:0/4048086794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d8101a80 msgr2=0x7ff2d8199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2d7fff640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d8101a80 0x7ff2d8199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.756+0000 7ff2d7fff640 1 -- 172.21.15.45:0/4048086794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d819a2b0 con 0x7ff2d8100880 2024-09-18T12:51:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.757+0000 7ff2d7fff640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8100880 0x7ff2d81996f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0004af0 tx=0x7ff2d002f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.757+0000 7ff2d57fa640 1 -- 172.21.15.45:0/4048086794 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2d0034040 con 0x7ff2d8100880 2024-09-18T12:51:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.757+0000 7ff2d57fa640 1 -- 172.21.15.45:0/4048086794 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2d0003e30 con 0x7ff2d8100880 2024-09-18T12:51:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.757+0000 7ff2d57fa640 1 -- 172.21.15.45:0/4048086794 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2d0039430 con 0x7ff2d8100880 2024-09-18T12:51:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.757+0000 7ff2de993640 1 -- 172.21.15.45:0/4048086794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d819ec90 con 0x7ff2d8100880 2024-09-18T12:51:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.758+0000 7ff2de993640 1 -- 172.21.15.45:0/4048086794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d819f1f0 con 0x7ff2d8100880 2024-09-18T12:51:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.759+0000 7ff2de993640 1 -- 172.21.15.45:0/4048086794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d8100c80 con 0x7ff2d8100880 2024-09-18T12:51:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.761+0000 7ff2d57fa640 1 -- 172.21.15.45:0/4048086794 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ff2d0037020 con 0x7ff2d8100880 2024-09-18T12:51:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.762+0000 7ff2d57fa640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff2c0074ab0 0x7ff2c0076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.762+0000 7ff2d57fa640 1 -- 172.21.15.45:0/4048086794 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7ff2d00b7690 con 0x7ff2d8100880 2024-09-18T12:51:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.762+0000 7ff2d77fe640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff2c0074ab0 0x7ff2c0076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.763+0000 7ff2d77fe640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff2c0074ab0 0x7ff2c0076f70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff2d819aba0 tx=0x7ff2cc00b390 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:28.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:28.768+0000 7ff2d57fa640 1 -- 172.21.15.45:0/4048086794 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7ff2d0082d90 con 0x7ff2d8100880 2024-09-18T12:51:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:28 smithi161 ceph-mon[35784]: Standby manager daemon smithi045.brvbvl started 2024-09-18T12:51:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:28 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.45:0/3016376817' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi045.brvbvl/crt"}]: dispatch 2024-09-18T12:51:28.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:28 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.45:0/3016376817' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:51:28.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:28 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.45:0/3016376817' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi045.brvbvl/key"}]: dispatch 2024-09-18T12:51:28.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:28 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.45:0/3016376817' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:51:28.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:28 smithi161 ceph-mon[35784]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:29.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.154+0000 7ff2de993640 1 -- 172.21.15.45:0/4048086794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff2d819f690 con 0x7ff2d8100880 2024-09-18T12:51:29.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.155+0000 7ff2d57fa640 1 -- 172.21.15.45:0/4048086794 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7ff2d0087c40 con 0x7ff2d8100880 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:51:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:51:29.158 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:51:29.158 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:51:29.158 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:51:29.158 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13, 2024-09-18T12:51:29.158 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:51:29.158 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:51:29.158 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:51:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 -- 172.21.15.45:0/4048086794 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff2c0074ab0 msgr2=0x7ff2c0076f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff2c0074ab0 0x7ff2c0076f70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff2d819aba0 tx=0x7ff2cc00b390 comp rx=0 tx=0).stop 2024-09-18T12:51:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 -- 172.21.15.45:0/4048086794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8100880 msgr2=0x7ff2d81996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8100880 0x7ff2d81996f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0004af0 tx=0x7ff2d002f5e0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 -- 172.21.15.45:0/4048086794 shutdown_connections 2024-09-18T12:51:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff2c0074ab0 0x7ff2c0076f70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d8101a80 0x7ff2d8199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 --2- 172.21.15.45:0/4048086794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d8100880 0x7ff2d81996f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 -- 172.21.15.45:0/4048086794 >> 172.21.15.45:0/4048086794 conn(0x7ff2d80fc010 msgr2=0x7ff2d80fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 -- 172.21.15.45:0/4048086794 shutdown_connections 2024-09-18T12:51:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.159+0000 7ff2de993640 1 -- 172.21.15.45:0/4048086794 wait complete. 2024-09-18T12:51:29.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.282+0000 7ff316c38640 1 -- 172.21.15.45:0/1805212560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff310102b60 msgr2=0x7ff310102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:29.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.282+0000 7ff316c38640 1 --2- 172.21.15.45:0/1805212560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff310102b60 0x7ff310102fe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0097e0 tx=0x7ff2fc02a3f0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.282+0000 7ff316c38640 1 -- 172.21.15.45:0/1805212560 shutdown_connections 2024-09-18T12:51:29.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.282+0000 7ff316c38640 1 --2- 172.21.15.45:0/1805212560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff310102b60 0x7ff310102fe0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.282+0000 7ff316c38640 1 --2- 172.21.15.45:0/1805212560 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff310101960 0x7ff310101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.282+0000 7ff316c38640 1 -- 172.21.15.45:0/1805212560 >> 172.21.15.45:0/1805212560 conn(0x7ff3100fd0d0 msgr2=0x7ff3100ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:29.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.282+0000 7ff316c38640 1 -- 172.21.15.45:0/1805212560 shutdown_connections 2024-09-18T12:51:29.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.282+0000 7ff316c38640 1 -- 172.21.15.45:0/1805212560 wait complete. 2024-09-18T12:51:29.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.283+0000 7ff316c38640 1 Processor -- start 2024-09-18T12:51:29.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.283+0000 7ff316c38640 1 -- start start 2024-09-18T12:51:29.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.283+0000 7ff316c38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff310101960 0x7ff310075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:29.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.283+0000 7ff316c38640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff310102b60 0x7ff3100745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:29.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.283+0000 7ff316c38640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff31010a780 con 0x7ff310101960 2024-09-18T12:51:29.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.283+0000 7ff316c38640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff31010a600 con 0x7ff310102b60 2024-09-18T12:51:29.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.283+0000 7ff3149d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff310101960 0x7ff310075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:29.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.284+0000 7ff30ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff310102b60 0x7ff3100745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:29.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.283+0000 7ff3149d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff310101960 0x7ff310075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36374/0 (socket says 172.21.15.45:36374) 2024-09-18T12:51:29.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.284+0000 7ff3149d4640 1 -- 172.21.15.45:0/1493018518 learned_addr learned my addr 172.21.15.45:0/1493018518 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:51:29.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.284+0000 7ff30ffff640 1 -- 172.21.15.45:0/1493018518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff310101960 msgr2=0x7ff310075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:29.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.284+0000 7ff30ffff640 1 --2- 172.21.15.45:0/1493018518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff310101960 0x7ff310075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.284+0000 7ff30ffff640 1 -- 172.21.15.45:0/1493018518 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff310074b20 con 0x7ff310102b60 2024-09-18T12:51:29.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.284+0000 7ff30ffff640 1 --2- 172.21.15.45:0/1493018518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff310102b60 0x7ff3100745e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc02a910 tx=0x7ff2fc0043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:29.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.285+0000 7ff30dffb640 1 -- 172.21.15.45:0/1493018518 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2fc040070 con 0x7ff310102b60 2024-09-18T12:51:29.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.285+0000 7ff30dffb640 1 -- 172.21.15.45:0/1493018518 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2fc030c00 con 0x7ff310102b60 2024-09-18T12:51:29.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.285+0000 7ff30dffb640 1 -- 172.21.15.45:0/1493018518 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2fc003c80 con 0x7ff310102b60 2024-09-18T12:51:29.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.285+0000 7ff316c38640 1 -- 172.21.15.45:0/1493018518 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff310074db0 con 0x7ff310102b60 2024-09-18T12:51:29.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.285+0000 7ff316c38640 1 -- 172.21.15.45:0/1493018518 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3100752e0 con 0x7ff310102b60 2024-09-18T12:51:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.287+0000 7ff30dffb640 1 -- 172.21.15.45:0/1493018518 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ff2fc039040 con 0x7ff310102b60 2024-09-18T12:51:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.287+0000 7ff316c38640 1 -- 172.21.15.45:0/1493018518 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff310101d60 con 0x7ff310102b60 2024-09-18T12:51:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.287+0000 7ff30dffb640 1 --2- 172.21.15.45:0/1493018518 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff300074a30 0x7ff300076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:29.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.288+0000 7ff30dffb640 1 -- 172.21.15.45:0/1493018518 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7ff2fc0b75e0 con 0x7ff310102b60 2024-09-18T12:51:29.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.288+0000 7ff3149d4640 1 --2- 172.21.15.45:0/1493018518 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff300074a30 0x7ff300076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:29.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.288+0000 7ff3149d4640 1 --2- 172.21.15.45:0/1493018518 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff300074a30 0x7ff300076ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff3040096c0 tx=0x7ff304009260 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:29.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.293+0000 7ff30dffb640 1 -- 172.21.15.45:0/1493018518 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7ff2fc082b10 con 0x7ff310102b60 2024-09-18T12:51:29.460 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:29 smithi161 ceph-mon[35784]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:29.460 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:29 smithi161 ceph-mon[35784]: pgmap v7: 65 pgs: 65 active+clean; 116 MiB data, 573 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 107 op/s 2024-09-18T12:51:29.460 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:29 smithi161 ceph-mon[35784]: mgrmap e25: smithi161.yoflkm(active, since 8s), standbys: smithi045.brvbvl 2024-09-18T12:51:29.460 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:29 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mgr metadata", "who": "smithi045.brvbvl", "id": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:51:29.460 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:29 smithi161 ceph-mon[35784]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:29.460 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:29 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:29.460 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:29 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:29.460 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:29 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/4048086794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:29.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.616+0000 7ff316c38640 1 -- 172.21.15.45:0/1493018518 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff310062630 con 0x7ff300074a30 2024-09-18T12:51:29.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.618+0000 7ff30dffb640 1 -- 172.21.15.45:0/1493018518 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7ff310062630 con 0x7ff300074a30 2024-09-18T12:51:29.619 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:51:29.619 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:51:29.619 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:51:29.619 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:51:29.620 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [], 2024-09-18T12:51:29.620 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "1/2 daemons upgraded", 2024-09-18T12:51:29.620 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "", 2024-09-18T12:51:29.620 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:51:29.620 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:51:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.620+0000 7ff316c38640 1 -- 172.21.15.45:0/1493018518 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff300074a30 msgr2=0x7ff300076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.620+0000 7ff316c38640 1 --2- 172.21.15.45:0/1493018518 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff300074a30 0x7ff300076ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff3040096c0 tx=0x7ff304009260 comp rx=0 tx=0).stop 2024-09-18T12:51:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.620+0000 7ff316c38640 1 -- 172.21.15.45:0/1493018518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff310102b60 msgr2=0x7ff3100745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.620+0000 7ff316c38640 1 --2- 172.21.15.45:0/1493018518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff310102b60 0x7ff3100745e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc02a910 tx=0x7ff2fc0043b0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.620+0000 7ff316c38640 1 -- 172.21.15.45:0/1493018518 shutdown_connections 2024-09-18T12:51:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.620+0000 7ff316c38640 1 --2- 172.21.15.45:0/1493018518 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7ff300074a30 0x7ff300076ef0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.620+0000 7ff316c38640 1 --2- 172.21.15.45:0/1493018518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff310102b60 0x7ff3100745e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.620+0000 7ff316c38640 1 --2- 172.21.15.45:0/1493018518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff310101960 0x7ff310075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:29.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.620+0000 7ff316c38640 1 -- 172.21.15.45:0/1493018518 >> 172.21.15.45:0/1493018518 conn(0x7ff3100fd0d0 msgr2=0x7ff310105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:29.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.621+0000 7ff316c38640 1 -- 172.21.15.45:0/1493018518 shutdown_connections 2024-09-18T12:51:29.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:29.621+0000 7ff316c38640 1 -- 172.21.15.45:0/1493018518 wait complete. 2024-09-18T12:51:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:29 smithi045 ceph-mon[28315]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:29 smithi045 ceph-mon[28315]: pgmap v7: 65 pgs: 65 active+clean; 116 MiB data, 573 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 107 op/s 2024-09-18T12:51:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:29 smithi045 ceph-mon[28315]: mgrmap e25: smithi161.yoflkm(active, since 8s), standbys: smithi045.brvbvl 2024-09-18T12:51:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:29 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mgr metadata", "who": "smithi045.brvbvl", "id": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:51:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:29 smithi045 ceph-mon[28315]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:29 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:29 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:29.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:29 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/4048086794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:51:31.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:31.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:31.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:31.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: Adjusting osd_memory_target on smithi045 to 1217M 2024-09-18T12:51:31.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:30 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:51:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: Adjusting osd_memory_target on smithi045 to 1217M 2024-09-18T12:51:31.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:30 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: pgmap v8: 65 pgs: 65 active+clean; 116 MiB data, 573 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-09-18T12:51:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: Adjusting osd_memory_target on smithi161 to 2240M 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi045", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:32.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi045", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:32.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:31 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:32.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: pgmap v8: 65 pgs: 65 active+clean; 116 MiB data, 573 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-09-18T12:51:32.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: Adjusting osd_memory_target on smithi161 to 2240M 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:32.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi045", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi045", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:51:32.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:31 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:51:33.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:32 smithi045 ceph-mon[28315]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:51:33.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:32 smithi045 ceph-mon[28315]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:51:33.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:32 smithi045 ceph-mon[28315]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:51:33.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:32 smithi045 ceph-mon[28315]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:51:33.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:32 smithi045 ceph-mon[28315]: Reconfiguring ceph-exporter.smithi045 (dependencies changed)... 2024-09-18T12:51:33.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:32 smithi045 ceph-mon[28315]: Deploying daemon ceph-exporter.smithi045 on smithi045 2024-09-18T12:51:33.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:32 smithi161 ceph-mon[35784]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:51:33.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:32 smithi161 ceph-mon[35784]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:51:33.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:32 smithi161 ceph-mon[35784]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:51:33.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:32 smithi161 ceph-mon[35784]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:51:33.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:32 smithi161 ceph-mon[35784]: Reconfiguring ceph-exporter.smithi045 (dependencies changed)... 2024-09-18T12:51:33.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:32 smithi161 ceph-mon[35784]: Deploying daemon ceph-exporter.smithi045 on smithi045 2024-09-18T12:51:34.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:33 smithi045 ceph-mon[28315]: pgmap v9: 65 pgs: 65 active+clean; 129 MiB data, 608 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 143 op/s 2024-09-18T12:51:34.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:33 smithi161 ceph-mon[35784]: pgmap v9: 65 pgs: 65 active+clean; 129 MiB data, 608 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 143 op/s 2024-09-18T12:51:36.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:35 smithi045 ceph-mon[28315]: pgmap v10: 65 pgs: 65 active+clean; 129 MiB data, 608 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 131 op/s 2024-09-18T12:51:36.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:35 smithi161 ceph-mon[35784]: pgmap v10: 65 pgs: 65 active+clean; 129 MiB data, 608 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 131 op/s 2024-09-18T12:51:37.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:36 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:37.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:36 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:38.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:37 smithi045 ceph-mon[28315]: pgmap v11: 65 pgs: 65 active+clean; 136 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 169 op/s 2024-09-18T12:51:38.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:37 smithi161 ceph-mon[35784]: pgmap v11: 65 pgs: 65 active+clean; 136 MiB data, 632 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 169 op/s 2024-09-18T12:51:40.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:39 smithi045 ceph-mon[28315]: pgmap v12: 65 pgs: 65 active+clean; 153 MiB data, 683 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 243 op/s 2024-09-18T12:51:40.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:39 smithi161 ceph-mon[35784]: pgmap v12: 65 pgs: 65 active+clean; 153 MiB data, 683 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 243 op/s 2024-09-18T12:51:42.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:41 smithi045 ceph-mon[28315]: pgmap v13: 65 pgs: 65 active+clean; 153 MiB data, 683 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 195 op/s 2024-09-18T12:51:42.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:41 smithi161 ceph-mon[35784]: pgmap v13: 65 pgs: 65 active+clean; 153 MiB data, 683 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 195 op/s 2024-09-18T12:51:44.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:43 smithi045 ceph-mon[28315]: pgmap v14: 65 pgs: 65 active+clean; 165 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 281 op/s 2024-09-18T12:51:44.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:43 smithi161 ceph-mon[35784]: pgmap v14: 65 pgs: 65 active+clean; 165 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 281 op/s 2024-09-18T12:51:46.069 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:45 smithi045 ceph-mon[28315]: pgmap v15: 65 pgs: 65 active+clean; 165 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 212 op/s 2024-09-18T12:51:46.094 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:45 smithi161 ceph-mon[35784]: pgmap v15: 65 pgs: 65 active+clean; 165 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 212 op/s 2024-09-18T12:51:47.973 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:47 smithi045 ceph-mon[28315]: pgmap v16: 65 pgs: 65 active+clean; 174 MiB data, 773 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 369 op/s 2024-09-18T12:51:48.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:47 smithi161 ceph-mon[35784]: pgmap v16: 65 pgs: 65 active+clean; 174 MiB data, 773 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 369 op/s 2024-09-18T12:51:49.977 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:49 smithi045 ceph-mon[28315]: pgmap v17: 65 pgs: 65 active+clean; 182 MiB data, 780 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 373 op/s 2024-09-18T12:51:49.977 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:49 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:49.977 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:49 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:49.977 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:49 smithi045 ceph-mon[28315]: Reconfiguring prometheus.smithi045 (dependencies changed)... 2024-09-18T12:51:49.977 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:49 smithi045 ceph-mon[28315]: Reconfiguring daemon prometheus.smithi045 on smithi045 2024-09-18T12:51:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:49 smithi161 ceph-mon[35784]: pgmap v17: 65 pgs: 65 active+clean; 182 MiB data, 780 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 373 op/s 2024-09-18T12:51:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:49 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:49 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:51:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:49 smithi161 ceph-mon[35784]: Reconfiguring prometheus.smithi045 (dependencies changed)... 2024-09-18T12:51:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:49 smithi161 ceph-mon[35784]: Reconfiguring daemon prometheus.smithi045 on smithi045 2024-09-18T12:51:52.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:51 smithi045 ceph-mon[28315]: pgmap v18: 65 pgs: 65 active+clean; 182 MiB data, 780 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 284 op/s 2024-09-18T12:51:52.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:51 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:52.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:51 smithi161 ceph-mon[35784]: pgmap v18: 65 pgs: 65 active+clean; 182 MiB data, 780 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 284 op/s 2024-09-18T12:51:52.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:51 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:51:53.703 INFO:tasks.workunit.client.1.smithi161.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-18T12:51:53.706 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:51:53.707 INFO:tasks.workunit.client.1.smithi161.stderr:+ make 2024-09-18T12:51:53.899 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:53 smithi045 ceph-mon[28315]: pgmap v19: 65 pgs: 65 active+clean; 204 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 421 op/s 2024-09-18T12:51:53.988 INFO:tasks.workunit.client.0.smithi045.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-18T12:51:53.994 INFO:tasks.workunit.client.0.smithi045.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:51:53.995 INFO:tasks.workunit.client.0.smithi045.stderr:+ make 2024-09-18T12:51:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:53 smithi161 ceph-mon[35784]: pgmap v19: 65 pgs: 65 active+clean; 204 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 421 op/s 2024-09-18T12:51:54.211 INFO:tasks.workunit.client.1.smithi161.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-18T12:51:54.253 INFO:tasks.workunit.client.0.smithi045.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-18T12:51:54.567 INFO:tasks.workunit.client.1.smithi161.stderr:++ readlink -f fsstress 2024-09-18T12:51:54.569 INFO:tasks.workunit.client.1.smithi161.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-18T12:51:54.569 INFO:tasks.workunit.client.1.smithi161.stderr:+ popd 2024-09-18T12:51:54.570 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:51:54.570 INFO:tasks.workunit.client.1.smithi161.stderr:+ popd 2024-09-18T12:51:54.571 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-18T12:51:54.571 INFO:tasks.workunit.client.1.smithi161.stderr:++ mktemp -d -p . 2024-09-18T12:51:54.573 INFO:tasks.workunit.client.1.smithi161.stderr:+ T=./tmp.23ogfvswIo 2024-09-18T12:51:54.573 INFO:tasks.workunit.client.1.smithi161.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.23ogfvswIo -l 1 -n 1000 -p 10 -v 2024-09-18T12:51:54.576 INFO:tasks.workunit.client.1.smithi161.stdout:seed = 1726087319 2024-09-18T12:51:54.579 INFO:tasks.workunit.client.1.smithi161.stdout:0/0: rename - no filename 2024-09-18T12:51:54.581 INFO:tasks.workunit.client.1.smithi161.stdout:0/1: symlink l0 0 2024-09-18T12:51:54.582 INFO:tasks.workunit.client.1.smithi161.stdout:2/0: dwrite - no filename 2024-09-18T12:51:54.582 INFO:tasks.workunit.client.1.smithi161.stdout:2/1: chown . 156542455 1 2024-09-18T12:51:54.582 INFO:tasks.workunit.client.1.smithi161.stdout:2/2: chown . 0 1 2024-09-18T12:51:54.582 INFO:tasks.workunit.client.1.smithi161.stdout:0/2: rename l0 to l1 0 2024-09-18T12:51:54.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/0: unlink - no file 2024-09-18T12:51:54.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/1: fsync - no filename 2024-09-18T12:51:54.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/2: dread - no filename 2024-09-18T12:51:54.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/3: dread - no filename 2024-09-18T12:51:54.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/4: dread - no filename 2024-09-18T12:51:54.584 INFO:tasks.workunit.client.1.smithi161.stdout:2/3: mkdir d0 0 2024-09-18T12:51:54.586 INFO:tasks.workunit.client.1.smithi161.stdout:4/0: dread - no filename 2024-09-18T12:51:54.586 INFO:tasks.workunit.client.1.smithi161.stdout:4/1: write - no filename 2024-09-18T12:51:54.586 INFO:tasks.workunit.client.1.smithi161.stdout:4/2: fsync - no filename 2024-09-18T12:51:54.586 INFO:tasks.workunit.client.1.smithi161.stdout:4/3: truncate - no filename 2024-09-18T12:51:54.586 INFO:tasks.workunit.client.1.smithi161.stdout:3/5: symlink l0 0 2024-09-18T12:51:54.586 INFO:tasks.workunit.client.1.smithi161.stdout:3/6: dread - no filename 2024-09-18T12:51:54.586 INFO:tasks.workunit.client.1.smithi161.stdout:2/4: mkdir d0/d1 0 2024-09-18T12:51:54.587 INFO:tasks.workunit.client.1.smithi161.stdout:2/5: fdatasync - no filename 2024-09-18T12:51:54.587 INFO:tasks.workunit.client.1.smithi161.stdout:2/6: read - no filename 2024-09-18T12:51:54.587 INFO:tasks.workunit.client.1.smithi161.stdout:2/7: write - no filename 2024-09-18T12:51:54.587 INFO:tasks.workunit.client.1.smithi161.stdout:2/8: write - no filename 2024-09-18T12:51:54.587 INFO:tasks.workunit.client.1.smithi161.stdout:3/7: mkdir d1 0 2024-09-18T12:51:54.588 INFO:tasks.workunit.client.1.smithi161.stdout:5/0: chown . 0 1 2024-09-18T12:51:54.588 INFO:tasks.workunit.client.1.smithi161.stdout:5/1: unlink - no file 2024-09-18T12:51:54.588 INFO:tasks.workunit.client.1.smithi161.stdout:5/2: unlink - no file 2024-09-18T12:51:54.588 INFO:tasks.workunit.client.1.smithi161.stdout:5/3: write - no filename 2024-09-18T12:51:54.588 INFO:tasks.workunit.client.1.smithi161.stdout:2/9: symlink d0/l2 0 2024-09-18T12:51:54.588 INFO:tasks.workunit.client.1.smithi161.stdout:2/10: dread - no filename 2024-09-18T12:51:54.589 INFO:tasks.workunit.client.1.smithi161.stdout:2/11: dwrite - no filename 2024-09-18T12:51:54.589 INFO:tasks.workunit.client.1.smithi161.stdout:4/4: symlink l0 0 2024-09-18T12:51:54.589 INFO:tasks.workunit.client.1.smithi161.stdout:4/5: read - no filename 2024-09-18T12:51:54.590 INFO:tasks.workunit.client.1.smithi161.stdout:6/0: dwrite - no filename 2024-09-18T12:51:54.590 INFO:tasks.workunit.client.1.smithi161.stdout:6/1: dread - no filename 2024-09-18T12:51:54.590 INFO:tasks.workunit.client.1.smithi161.stdout:6/2: unlink - no file 2024-09-18T12:51:54.590 INFO:tasks.workunit.client.1.smithi161.stdout:6/3: read - no filename 2024-09-18T12:51:54.590 INFO:tasks.workunit.client.1.smithi161.stdout:6/4: fsync - no filename 2024-09-18T12:51:54.593 INFO:tasks.workunit.client.1.smithi161.stdout:3/8: symlink d1/l2 0 2024-09-18T12:51:54.593 INFO:tasks.workunit.client.1.smithi161.stdout:3/9: dread - no filename 2024-09-18T12:51:54.593 INFO:tasks.workunit.client.1.smithi161.stdout:3/10: write - no filename 2024-09-18T12:51:54.595 INFO:tasks.workunit.client.1.smithi161.stdout:2/12: creat d0/d1/f3 x:0 0 0 2024-09-18T12:51:54.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/0: unlink - no file 2024-09-18T12:51:54.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/1: link - no file 2024-09-18T12:51:54.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/2: dwrite - no filename 2024-09-18T12:51:54.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/3: chown . 5152 1 2024-09-18T12:51:54.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/4: rename - no filename 2024-09-18T12:51:54.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/5: dread - no filename 2024-09-18T12:51:54.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/6: dwrite - no filename 2024-09-18T12:51:54.598 INFO:tasks.workunit.client.1.smithi161.stdout:3/11: mkdir d1/d3 0 2024-09-18T12:51:54.598 INFO:tasks.workunit.client.1.smithi161.stdout:3/12: stat d1/l2 0 2024-09-18T12:51:54.599 INFO:tasks.workunit.client.1.smithi161.stdout:6/5: symlink l0 0 2024-09-18T12:51:54.599 INFO:tasks.workunit.client.1.smithi161.stdout:6/6: write - no filename 2024-09-18T12:51:54.600 INFO:tasks.workunit.client.1.smithi161.stdout:2/13: mkdir d0/d4 0 2024-09-18T12:51:54.600 INFO:tasks.workunit.client.1.smithi161.stdout:4/6: link l0 l1 0 2024-09-18T12:51:54.600 INFO:tasks.workunit.client.1.smithi161.stdout:4/7: fsync - no filename 2024-09-18T12:51:54.602 INFO:tasks.workunit.client.1.smithi161.stdout:9/0: dread - no filename 2024-09-18T12:51:54.602 INFO:tasks.workunit.client.1.smithi161.stdout:9/1: fdatasync - no filename 2024-09-18T12:51:54.603 INFO:tasks.workunit.client.1.smithi161.stdout:7/0: getdents . 0 2024-09-18T12:51:54.603 INFO:tasks.workunit.client.1.smithi161.stdout:7/1: write - no filename 2024-09-18T12:51:54.603 INFO:tasks.workunit.client.1.smithi161.stdout:7/2: write - no filename 2024-09-18T12:51:54.603 INFO:tasks.workunit.client.1.smithi161.stdout:7/3: write - no filename 2024-09-18T12:51:54.604 INFO:tasks.workunit.client.1.smithi161.stdout:3/13: unlink d1/l2 0 2024-09-18T12:51:54.605 INFO:tasks.workunit.client.1.smithi161.stdout:6/7: rename l0 to l1 0 2024-09-18T12:51:54.606 INFO:tasks.workunit.client.1.smithi161.stdout:2/14: mkdir d0/d5 0 2024-09-18T12:51:54.607 INFO:tasks.workunit.client.1.smithi161.stdout:2/15: dread - d0/d1/f3 zero size 2024-09-18T12:51:54.607 INFO:tasks.workunit.client.1.smithi161.stdout:2/16: fdatasync d0/d1/f3 0 2024-09-18T12:51:54.608 INFO:tasks.workunit.client.1.smithi161.stdout:8/7: mkdir d0 0 2024-09-18T12:51:54.608 INFO:tasks.workunit.client.1.smithi161.stdout:8/8: dwrite - no filename 2024-09-18T12:51:54.608 INFO:tasks.workunit.client.1.smithi161.stdout:8/9: write - no filename 2024-09-18T12:51:54.609 INFO:tasks.workunit.client.1.smithi161.stdout:8/10: stat d0 0 2024-09-18T12:51:54.611 INFO:tasks.workunit.client.1.smithi161.stdout:4/8: unlink l1 0 2024-09-18T12:51:54.612 INFO:tasks.workunit.client.1.smithi161.stdout:9/2: mkdir d0 0 2024-09-18T12:51:54.613 INFO:tasks.workunit.client.1.smithi161.stdout:7/4: creat f0 x:0 0 0 2024-09-18T12:51:54.614 INFO:tasks.workunit.client.1.smithi161.stdout:7/5: fdatasync f0 0 2024-09-18T12:51:54.616 INFO:tasks.workunit.client.1.smithi161.stdout:4/9: readlink l0 0 2024-09-18T12:51:54.616 INFO:tasks.workunit.client.1.smithi161.stdout:2/17: dwrite d0/d1/f3 [0,4194304] 0 2024-09-18T12:51:54.616 INFO:tasks.workunit.client.1.smithi161.stdout:7/6: write f0 [279797,81127] 0 2024-09-18T12:51:54.617 INFO:tasks.workunit.client.1.smithi161.stdout:8/11: symlink d0/l1 0 2024-09-18T12:51:54.617 INFO:tasks.workunit.client.1.smithi161.stdout:8/12: write - no filename 2024-09-18T12:51:54.617 INFO:tasks.workunit.client.1.smithi161.stdout:8/13: write - no filename 2024-09-18T12:51:54.620 INFO:tasks.workunit.client.1.smithi161.stdout:3/14: rmdir d1/d3 0 2024-09-18T12:51:54.620 INFO:tasks.workunit.client.1.smithi161.stdout:9/3: symlink d0/l1 0 2024-09-18T12:51:54.620 INFO:tasks.workunit.client.1.smithi161.stdout:9/4: write - no filename 2024-09-18T12:51:54.620 INFO:tasks.workunit.client.1.smithi161.stdout:4/10: symlink l2 0 2024-09-18T12:51:54.620 INFO:tasks.workunit.client.1.smithi161.stdout:2/18: creat d0/d1/f6 x:0 0 0 2024-09-18T12:51:54.621 INFO:tasks.workunit.client.1.smithi161.stdout:8/14: creat d0/f2 x:0 0 0 2024-09-18T12:51:54.622 INFO:tasks.workunit.client.1.smithi161.stdout:3/15: mkdir d1/d4 0 2024-09-18T12:51:54.623 INFO:tasks.workunit.client.1.smithi161.stdout:9/5: rename d0/l1 to d0/l2 0 2024-09-18T12:51:54.626 INFO:tasks.workunit.client.1.smithi161.stdout:7/7: dwrite f0 [0,4194304] 0 2024-09-18T12:51:54.627 INFO:tasks.workunit.client.1.smithi161.stdout:8/15: mkdir d0/d3 0 2024-09-18T12:51:54.629 INFO:tasks.workunit.client.1.smithi161.stdout:9/6: creat d0/f3 x:0 0 0 2024-09-18T12:51:54.629 INFO:tasks.workunit.client.1.smithi161.stdout:4/11: chown l0 21 1 2024-09-18T12:51:54.631 INFO:tasks.workunit.client.1.smithi161.stdout:9/7: dread - d0/f3 zero size 2024-09-18T12:51:54.631 INFO:tasks.workunit.client.1.smithi161.stdout:8/16: mkdir d0/d4 0 2024-09-18T12:51:54.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/12: chown l2 5 1 2024-09-18T12:51:54.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/13: dread - no filename 2024-09-18T12:51:54.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/14: dwrite - no filename 2024-09-18T12:51:54.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/15: fdatasync - no filename 2024-09-18T12:51:54.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/16: rmdir - no directory 2024-09-18T12:51:54.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/17: truncate - no filename 2024-09-18T12:51:54.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/18: dread - no filename 2024-09-18T12:51:54.632 INFO:tasks.workunit.client.1.smithi161.stdout:3/16: symlink d1/d4/l5 0 2024-09-18T12:51:54.633 INFO:tasks.workunit.client.1.smithi161.stdout:3/17: rename d1 to d1/d6 22 2024-09-18T12:51:54.634 INFO:tasks.workunit.client.1.smithi161.stdout:8/17: fdatasync d0/f2 0 2024-09-18T12:51:54.635 INFO:tasks.workunit.client.1.smithi161.stdout:4/19: mknod c3 0 2024-09-18T12:51:54.635 INFO:tasks.workunit.client.1.smithi161.stdout:4/20: dread - no filename 2024-09-18T12:51:54.635 INFO:tasks.workunit.client.1.smithi161.stdout:4/21: dwrite - no filename 2024-09-18T12:51:54.635 INFO:tasks.workunit.client.1.smithi161.stdout:4/22: read - no filename 2024-09-18T12:51:54.637 INFO:tasks.workunit.client.1.smithi161.stdout:3/18: unlink l0 0 2024-09-18T12:51:54.638 INFO:tasks.workunit.client.1.smithi161.stdout:4/23: mknod c4 0 2024-09-18T12:51:54.638 INFO:tasks.workunit.client.1.smithi161.stdout:4/24: write - no filename 2024-09-18T12:51:54.638 INFO:tasks.workunit.client.1.smithi161.stdout:7/8: dwrite f0 [0,4194304] 0 2024-09-18T12:51:54.640 INFO:tasks.workunit.client.1.smithi161.stdout:8/18: mknod d0/d3/c5 0 2024-09-18T12:51:54.640 INFO:tasks.workunit.client.1.smithi161.stdout:3/19: creat d1/d4/f7 x:0 0 0 2024-09-18T12:51:54.641 INFO:tasks.workunit.client.1.smithi161.stdout:4/25: mkdir d5 0 2024-09-18T12:51:54.641 INFO:tasks.workunit.client.1.smithi161.stdout:4/26: write - no filename 2024-09-18T12:51:54.641 INFO:tasks.workunit.client.1.smithi161.stdout:4/27: fsync - no filename 2024-09-18T12:51:54.641 INFO:tasks.workunit.client.1.smithi161.stdout:4/28: dread - no filename 2024-09-18T12:51:54.641 INFO:tasks.workunit.client.1.smithi161.stdout:4/29: dwrite - no filename 2024-09-18T12:51:54.641 INFO:tasks.workunit.client.1.smithi161.stdout:4/30: dwrite - no filename 2024-09-18T12:51:54.641 INFO:tasks.workunit.client.1.smithi161.stdout:8/19: dread - d0/f2 zero size 2024-09-18T12:51:54.642 INFO:tasks.workunit.client.1.smithi161.stdout:3/20: dread - d1/d4/f7 zero size 2024-09-18T12:51:54.642 INFO:tasks.workunit.client.1.smithi161.stdout:7/9: rename f0 to f1 0 2024-09-18T12:51:54.644 INFO:tasks.workunit.client.1.smithi161.stdout:7/10: chown f1 140342 1 2024-09-18T12:51:54.644 INFO:tasks.workunit.client.1.smithi161.stdout:3/21: rmdir d1 39 2024-09-18T12:51:54.646 INFO:tasks.workunit.client.1.smithi161.stdout:4/31: rename l2 to d5/l6 0 2024-09-18T12:51:54.646 INFO:tasks.workunit.client.1.smithi161.stdout:4/32: dread - no filename 2024-09-18T12:51:54.646 INFO:tasks.workunit.client.1.smithi161.stdout:4/33: rename d5 to d5/d7 22 2024-09-18T12:51:54.651 INFO:tasks.workunit.client.1.smithi161.stdout:4/34: creat d5/f8 x:0 0 0 2024-09-18T12:51:54.652 INFO:tasks.workunit.client.1.smithi161.stdout:8/20: rmdir d0/d4 0 2024-09-18T12:51:54.653 INFO:tasks.workunit.client.1.smithi161.stdout:4/35: mknod d5/c9 0 2024-09-18T12:51:54.654 INFO:tasks.workunit.client.1.smithi161.stdout:4/36: chown d5 3 1 2024-09-18T12:51:54.654 INFO:tasks.workunit.client.1.smithi161.stdout:8/21: write d0/f2 [65772,96636] 0 2024-09-18T12:51:54.654 INFO:tasks.workunit.client.1.smithi161.stdout:7/11: dwrite f1 [0,4194304] 0 2024-09-18T12:51:54.655 INFO:tasks.workunit.client.1.smithi161.stdout:7/12: chown f1 4 1 2024-09-18T12:51:54.657 INFO:tasks.workunit.client.1.smithi161.stdout:8/22: mknod d0/d3/c6 0 2024-09-18T12:51:54.660 INFO:tasks.workunit.client.1.smithi161.stdout:8/23: rmdir d0/d3 39 2024-09-18T12:51:54.664 INFO:tasks.workunit.client.1.smithi161.stdout:4/37: dwrite d5/f8 [0,4194304] 0 2024-09-18T12:51:54.672 INFO:tasks.workunit.client.1.smithi161.stdout:4/38: dwrite d5/f8 [0,4194304] 0 2024-09-18T12:51:54.677 INFO:tasks.workunit.client.1.smithi161.stdout:4/39: rename l0 to d5/la 0 2024-09-18T12:51:54.709 INFO:tasks.workunit.client.1.smithi161.stdout:0/3: unlink l1 0 2024-09-18T12:51:54.709 INFO:tasks.workunit.client.1.smithi161.stdout:0/4: write - no filename 2024-09-18T12:51:54.709 INFO:tasks.workunit.client.1.smithi161.stdout:0/5: stat - no entries 2024-09-18T12:51:54.709 INFO:tasks.workunit.client.1.smithi161.stdout:0/6: unlink - no file 2024-09-18T12:51:54.710 INFO:tasks.workunit.client.1.smithi161.stdout:0/7: symlink l2 0 2024-09-18T12:51:54.710 INFO:tasks.workunit.client.1.smithi161.stdout:0/8: dread - no filename 2024-09-18T12:51:54.711 INFO:tasks.workunit.client.1.smithi161.stdout:0/9: dread - no filename 2024-09-18T12:51:54.714 INFO:tasks.workunit.client.1.smithi161.stdout:3/22: unlink d1/d4/l5 0 2024-09-18T12:51:54.716 INFO:tasks.workunit.client.1.smithi161.stdout:3/23: creat d1/d4/f8 x:0 0 0 2024-09-18T12:51:54.717 INFO:tasks.workunit.client.1.smithi161.stdout:3/24: mknod d1/d4/c9 0 2024-09-18T12:51:54.718 INFO:tasks.workunit.client.1.smithi161.stdout:3/25: stat d1/d4/c9 0 2024-09-18T12:51:54.720 INFO:tasks.workunit.client.1.smithi161.stdout:3/26: mknod d1/ca 0 2024-09-18T12:51:54.721 INFO:tasks.workunit.client.1.smithi161.stdout:3/27: mknod d1/cb 0 2024-09-18T12:51:54.723 INFO:tasks.workunit.client.1.smithi161.stdout:6/8: rename l1 to l2 0 2024-09-18T12:51:54.723 INFO:tasks.workunit.client.1.smithi161.stdout:6/9: read - no filename 2024-09-18T12:51:54.724 INFO:tasks.workunit.client.1.smithi161.stdout:6/10: mknod c3 0 2024-09-18T12:51:54.724 INFO:tasks.workunit.client.1.smithi161.stdout:6/11: dread - no filename 2024-09-18T12:51:54.724 INFO:tasks.workunit.client.1.smithi161.stdout:6/12: dread - no filename 2024-09-18T12:51:54.724 INFO:tasks.workunit.client.1.smithi161.stdout:6/13: dread - no filename 2024-09-18T12:51:54.725 INFO:tasks.workunit.client.1.smithi161.stdout:6/14: dread - no filename 2024-09-18T12:51:54.725 INFO:tasks.workunit.client.1.smithi161.stdout:6/15: dread - no filename 2024-09-18T12:51:54.725 INFO:tasks.workunit.client.1.smithi161.stdout:6/16: truncate - no filename 2024-09-18T12:51:54.725 INFO:tasks.workunit.client.1.smithi161.stdout:6/17: truncate - no filename 2024-09-18T12:51:54.725 INFO:tasks.workunit.client.1.smithi161.stdout:6/18: write - no filename 2024-09-18T12:51:54.726 INFO:tasks.workunit.client.1.smithi161.stdout:3/28: link d1/cb d1/cc 0 2024-09-18T12:51:54.726 INFO:tasks.workunit.client.1.smithi161.stdout:2/19: write d0/d1/f3 [4364441,45396] 0 2024-09-18T12:51:54.726 INFO:tasks.workunit.client.1.smithi161.stdout:3/29: write d1/d4/f8 [208429,124072] 0 2024-09-18T12:51:54.727 INFO:tasks.workunit.client.1.smithi161.stdout:2/20: read d0/d1/f3 [1807487,34856] 0 2024-09-18T12:51:54.727 INFO:tasks.workunit.client.1.smithi161.stdout:3/30: chown d1/d4 39 1 2024-09-18T12:51:54.728 INFO:tasks.workunit.client.1.smithi161.stdout:3/31: chown d1/d4/f8 8281181 1 2024-09-18T12:51:54.728 INFO:tasks.workunit.client.1.smithi161.stdout:2/21: write d0/d1/f6 [586434,6800] 0 2024-09-18T12:51:54.730 INFO:tasks.workunit.client.1.smithi161.stdout:9/8: readlink d0/l2 0 2024-09-18T12:51:54.731 INFO:tasks.workunit.client.1.smithi161.stdout:9/9: truncate d0/f3 1039276 0 2024-09-18T12:51:54.731 INFO:tasks.workunit.client.1.smithi161.stdout:3/32: symlink d1/ld 0 2024-09-18T12:51:54.731 INFO:tasks.workunit.client.1.smithi161.stdout:3/33: readlink d1/ld 0 2024-09-18T12:51:54.732 INFO:tasks.workunit.client.1.smithi161.stdout:9/10: truncate d0/f3 1154585 0 2024-09-18T12:51:54.732 INFO:tasks.workunit.client.1.smithi161.stdout:2/22: dread d0/d1/f6 [0,4194304] 0 2024-09-18T12:51:54.733 INFO:tasks.workunit.client.1.smithi161.stdout:2/23: stat d0/d1/f3 0 2024-09-18T12:51:54.736 INFO:tasks.workunit.client.1.smithi161.stdout:2/24: creat d0/d1/f7 x:0 0 0 2024-09-18T12:51:54.738 INFO:tasks.workunit.client.1.smithi161.stdout:7/13: dwrite f1 [4194304,4194304] 0 2024-09-18T12:51:54.738 INFO:tasks.workunit.client.1.smithi161.stdout:9/11: link d0/l2 d0/l4 0 2024-09-18T12:51:54.739 INFO:tasks.workunit.client.1.smithi161.stdout:7/14: write f1 [5041518,48446] 0 2024-09-18T12:51:54.740 INFO:tasks.workunit.client.1.smithi161.stdout:7/15: stat f1 0 2024-09-18T12:51:54.743 INFO:tasks.workunit.client.1.smithi161.stdout:2/25: dread d0/d1/f3 [0,4194304] 0 2024-09-18T12:51:54.743 INFO:tasks.workunit.client.1.smithi161.stdout:8/24: getdents d0/d3 0 2024-09-18T12:51:54.745 INFO:tasks.workunit.client.1.smithi161.stdout:4/40: chown d5/la 154 1 2024-09-18T12:51:54.746 INFO:tasks.workunit.client.1.smithi161.stdout:8/25: dread d0/f2 [0,4194304] 0 2024-09-18T12:51:54.750 INFO:tasks.workunit.client.1.smithi161.stdout:4/41: creat d5/fb x:0 0 0 2024-09-18T12:51:54.750 INFO:tasks.workunit.client.1.smithi161.stdout:8/26: mkdir d0/d3/d7 0 2024-09-18T12:51:54.752 INFO:tasks.workunit.client.1.smithi161.stdout:2/26: dwrite d0/d1/f3 [0,4194304] 0 2024-09-18T12:51:54.753 INFO:tasks.workunit.client.1.smithi161.stdout:8/27: write d0/f2 [421606,7418] 0 2024-09-18T12:51:54.754 INFO:tasks.workunit.client.1.smithi161.stdout:7/16: fdatasync f1 0 2024-09-18T12:51:54.754 INFO:tasks.workunit.client.1.smithi161.stdout:8/28: rename d0 to d0/d3/d8 22 2024-09-18T12:51:54.754 INFO:tasks.workunit.client.1.smithi161.stdout:6/19: chown l2 62 1 2024-09-18T12:51:54.755 INFO:tasks.workunit.client.1.smithi161.stdout:6/20: dwrite - no filename 2024-09-18T12:51:54.756 INFO:tasks.workunit.client.1.smithi161.stdout:8/29: fdatasync d0/f2 0 2024-09-18T12:51:54.756 INFO:tasks.workunit.client.1.smithi161.stdout:3/34: getdents d1 0 2024-09-18T12:51:54.756 INFO:tasks.workunit.client.1.smithi161.stdout:6/21: chown c3 284780892 1 2024-09-18T12:51:54.756 INFO:tasks.workunit.client.1.smithi161.stdout:6/22: write - no filename 2024-09-18T12:51:54.757 INFO:tasks.workunit.client.1.smithi161.stdout:2/27: creat d0/d4/f8 x:0 0 0 2024-09-18T12:51:54.757 INFO:tasks.workunit.client.1.smithi161.stdout:2/28: dread - d0/d4/f8 zero size 2024-09-18T12:51:54.759 INFO:tasks.workunit.client.1.smithi161.stdout:7/17: rename f1 to f2 0 2024-09-18T12:51:54.760 INFO:tasks.workunit.client.1.smithi161.stdout:9/12: getdents d0 0 2024-09-18T12:51:54.761 INFO:tasks.workunit.client.1.smithi161.stdout:6/23: mkdir d4 0 2024-09-18T12:51:54.761 INFO:tasks.workunit.client.1.smithi161.stdout:6/24: fsync - no filename 2024-09-18T12:51:54.761 INFO:tasks.workunit.client.1.smithi161.stdout:6/25: dwrite - no filename 2024-09-18T12:51:54.762 INFO:tasks.workunit.client.1.smithi161.stdout:6/26: dwrite - no filename 2024-09-18T12:51:54.762 INFO:tasks.workunit.client.1.smithi161.stdout:6/27: readlink l2 0 2024-09-18T12:51:54.762 INFO:tasks.workunit.client.1.smithi161.stdout:9/13: truncate d0/f3 1754955 0 2024-09-18T12:51:54.763 INFO:tasks.workunit.client.1.smithi161.stdout:3/35: symlink d1/le 0 2024-09-18T12:51:54.763 INFO:tasks.workunit.client.1.smithi161.stdout:7/18: dread f2 [0,4194304] 0 2024-09-18T12:51:54.764 INFO:tasks.workunit.client.1.smithi161.stdout:3/36: read - d1/d4/f7 zero size 2024-09-18T12:51:54.766 INFO:tasks.workunit.client.1.smithi161.stdout:2/29: symlink d0/d5/l9 0 2024-09-18T12:51:54.767 INFO:tasks.workunit.client.1.smithi161.stdout:3/37: rmdir d1/d4 39 2024-09-18T12:51:54.767 INFO:tasks.workunit.client.1.smithi161.stdout:2/30: stat d0/d1/f3 0 2024-09-18T12:51:54.768 INFO:tasks.workunit.client.1.smithi161.stdout:8/30: rename d0/f2 to d0/f9 0 2024-09-18T12:51:54.770 INFO:tasks.workunit.client.1.smithi161.stdout:9/14: dwrite d0/f3 [0,4194304] 0 2024-09-18T12:51:54.770 INFO:tasks.workunit.client.1.smithi161.stdout:7/19: unlink f2 0 2024-09-18T12:51:54.771 INFO:tasks.workunit.client.1.smithi161.stdout:7/20: chown . 3 1 2024-09-18T12:51:54.771 INFO:tasks.workunit.client.1.smithi161.stdout:8/31: read d0/f9 [139082,130862] 0 2024-09-18T12:51:54.771 INFO:tasks.workunit.client.1.smithi161.stdout:3/38: truncate d1/d4/f7 328562 0 2024-09-18T12:51:54.771 INFO:tasks.workunit.client.1.smithi161.stdout:2/31: unlink d0/d1/f6 0 2024-09-18T12:51:54.773 INFO:tasks.workunit.client.1.smithi161.stdout:2/32: read d0/d1/f3 [2822503,29016] 0 2024-09-18T12:51:54.774 INFO:tasks.workunit.client.1.smithi161.stdout:9/15: readlink d0/l2 0 2024-09-18T12:51:54.774 INFO:tasks.workunit.client.1.smithi161.stdout:8/32: dread d0/f9 [0,4194304] 0 2024-09-18T12:51:54.775 INFO:tasks.workunit.client.1.smithi161.stdout:7/21: mkdir d3 0 2024-09-18T12:51:54.775 INFO:tasks.workunit.client.1.smithi161.stdout:7/22: unlink - no file 2024-09-18T12:51:54.775 INFO:tasks.workunit.client.1.smithi161.stdout:7/23: truncate - no filename 2024-09-18T12:51:54.775 INFO:tasks.workunit.client.1.smithi161.stdout:7/24: dwrite - no filename 2024-09-18T12:51:54.775 INFO:tasks.workunit.client.1.smithi161.stdout:7/25: dread - no filename 2024-09-18T12:51:54.775 INFO:tasks.workunit.client.1.smithi161.stdout:9/16: chown d0/f3 30848140 1 2024-09-18T12:51:54.779 INFO:tasks.workunit.client.1.smithi161.stdout:2/33: unlink d0/d5/l9 0 2024-09-18T12:51:54.782 INFO:tasks.workunit.client.1.smithi161.stdout:9/17: dwrite d0/f3 [0,4194304] 0 2024-09-18T12:51:54.782 INFO:tasks.workunit.client.1.smithi161.stdout:2/34: truncate d0/d1/f7 858989 0 2024-09-18T12:51:54.783 INFO:tasks.workunit.client.1.smithi161.stdout:3/39: mknod d1/cf 0 2024-09-18T12:51:54.783 INFO:tasks.workunit.client.1.smithi161.stdout:2/35: write d0/d4/f8 [487212,86954] 0 2024-09-18T12:51:54.787 INFO:tasks.workunit.client.1.smithi161.stdout:7/26: creat d3/f4 x:0 0 0 2024-09-18T12:51:54.788 INFO:tasks.workunit.client.1.smithi161.stdout:3/40: mknod d1/d4/c10 0 2024-09-18T12:51:54.788 INFO:tasks.workunit.client.1.smithi161.stdout:3/41: chown d1/ld 12386506 1 2024-09-18T12:51:54.789 INFO:tasks.workunit.client.1.smithi161.stdout:8/33: rmdir d0/d3/d7 0 2024-09-18T12:51:54.791 INFO:tasks.workunit.client.1.smithi161.stdout:9/18: link d0/f3 d0/f5 0 2024-09-18T12:51:54.791 INFO:tasks.workunit.client.1.smithi161.stdout:7/27: symlink d3/l5 0 2024-09-18T12:51:54.792 INFO:tasks.workunit.client.1.smithi161.stdout:8/34: dread d0/f9 [0,4194304] 0 2024-09-18T12:51:54.793 INFO:tasks.workunit.client.1.smithi161.stdout:9/19: read d0/f3 [2242600,10775] 0 2024-09-18T12:51:54.794 INFO:tasks.workunit.client.1.smithi161.stdout:2/36: getdents d0/d1 0 2024-09-18T12:51:54.794 INFO:tasks.workunit.client.1.smithi161.stdout:7/28: creat d3/f6 x:0 0 0 2024-09-18T12:51:54.796 INFO:tasks.workunit.client.1.smithi161.stdout:7/29: chown d3/f6 0 1 2024-09-18T12:51:54.797 INFO:tasks.workunit.client.1.smithi161.stdout:8/35: dread d0/f9 [0,4194304] 0 2024-09-18T12:51:54.798 INFO:tasks.workunit.client.1.smithi161.stdout:2/37: dread d0/d1/f7 [0,4194304] 0 2024-09-18T12:51:54.799 INFO:tasks.workunit.client.1.smithi161.stdout:3/42: dwrite d1/d4/f7 [0,4194304] 0 2024-09-18T12:51:54.801 INFO:tasks.workunit.client.1.smithi161.stdout:7/30: write d3/f6 [134091,16073] 0 2024-09-18T12:51:54.803 INFO:tasks.workunit.client.1.smithi161.stdout:2/38: mkdir d0/d5/da 0 2024-09-18T12:51:54.805 INFO:tasks.workunit.client.1.smithi161.stdout:8/36: write d0/f9 [367431,46384] 0 2024-09-18T12:51:54.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/43: unlink d1/ld 0 2024-09-18T12:51:54.805 INFO:tasks.workunit.client.1.smithi161.stdout:7/31: write d3/f6 [353137,86568] 0 2024-09-18T12:51:54.807 INFO:tasks.workunit.client.1.smithi161.stdout:9/20: dwrite d0/f5 [0,4194304] 0 2024-09-18T12:51:54.809 INFO:tasks.workunit.client.1.smithi161.stdout:8/37: symlink d0/d3/la 0 2024-09-18T12:51:54.810 INFO:tasks.workunit.client.1.smithi161.stdout:3/44: mkdir d1/d11 0 2024-09-18T12:51:54.813 INFO:tasks.workunit.client.1.smithi161.stdout:8/38: creat d0/d3/fb x:0 0 0 2024-09-18T12:51:54.815 INFO:tasks.workunit.client.1.smithi161.stdout:7/32: getdents d3 0 2024-09-18T12:51:54.819 INFO:tasks.workunit.client.1.smithi161.stdout:8/39: dread d0/f9 [0,4194304] 0 2024-09-18T12:51:54.820 INFO:tasks.workunit.client.1.smithi161.stdout:7/33: creat d3/f7 x:0 0 0 2024-09-18T12:51:54.820 INFO:tasks.workunit.client.1.smithi161.stdout:2/39: dwrite d0/d1/f7 [0,4194304] 0 2024-09-18T12:51:54.820 INFO:tasks.workunit.client.1.smithi161.stdout:9/21: dwrite d0/f3 [0,4194304] 0 2024-09-18T12:51:54.824 INFO:tasks.workunit.client.1.smithi161.stdout:8/40: write d0/d3/fb [236863,114940] 0 2024-09-18T12:51:54.824 INFO:tasks.workunit.client.1.smithi161.stdout:2/40: stat d0/d5/da 0 2024-09-18T12:51:54.825 INFO:tasks.workunit.client.1.smithi161.stdout:9/22: stat d0/f5 0 2024-09-18T12:51:54.825 INFO:tasks.workunit.client.1.smithi161.stdout:7/34: write d3/f6 [1154400,18693] 0 2024-09-18T12:51:54.825 INFO:tasks.workunit.client.1.smithi161.stdout:9/23: stat d0/f5 0 2024-09-18T12:51:54.825 INFO:tasks.workunit.client.1.smithi161.stdout:7/35: readlink d3/l5 0 2024-09-18T12:51:54.825 INFO:tasks.workunit.client.1.smithi161.stdout:2/41: chown d0/d1 1470 1 2024-09-18T12:51:54.825 INFO:tasks.workunit.client.1.smithi161.stdout:8/41: write d0/d3/fb [1398669,74613] 0 2024-09-18T12:51:54.829 INFO:tasks.workunit.client.1.smithi161.stdout:2/42: symlink d0/d4/lb 0 2024-09-18T12:51:54.830 INFO:tasks.workunit.client.1.smithi161.stdout:9/24: dread d0/f3 [0,4194304] 0 2024-09-18T12:51:54.830 INFO:tasks.workunit.client.1.smithi161.stdout:8/42: write d0/f9 [276158,108971] 0 2024-09-18T12:51:54.835 INFO:tasks.workunit.client.1.smithi161.stdout:9/25: mknod d0/c6 0 2024-09-18T12:51:54.836 INFO:tasks.workunit.client.1.smithi161.stdout:3/45: truncate d1/d4/f7 2500536 0 2024-09-18T12:51:54.836 INFO:tasks.workunit.client.1.smithi161.stdout:2/43: getdents d0/d1 0 2024-09-18T12:51:54.838 INFO:tasks.workunit.client.1.smithi161.stdout:2/44: fdatasync d0/d4/f8 0 2024-09-18T12:51:54.838 INFO:tasks.workunit.client.1.smithi161.stdout:7/36: read d3/f6 [827333,61125] 0 2024-09-18T12:51:54.840 INFO:tasks.workunit.client.1.smithi161.stdout:8/43: getdents d0 0 2024-09-18T12:51:54.840 INFO:tasks.workunit.client.1.smithi161.stdout:7/37: dread - d3/f4 zero size 2024-09-18T12:51:54.841 INFO:tasks.workunit.client.1.smithi161.stdout:7/38: dread - d3/f4 zero size 2024-09-18T12:51:54.842 INFO:tasks.workunit.client.1.smithi161.stdout:9/26: dread d0/f5 [0,4194304] 0 2024-09-18T12:51:54.842 INFO:tasks.workunit.client.1.smithi161.stdout:3/46: creat d1/f12 x:0 0 0 2024-09-18T12:51:54.843 INFO:tasks.workunit.client.1.smithi161.stdout:8/44: symlink d0/d3/lc 0 2024-09-18T12:51:54.845 INFO:tasks.workunit.client.1.smithi161.stdout:8/45: write d0/f9 [835185,20534] 0 2024-09-18T12:51:54.845 INFO:tasks.workunit.client.1.smithi161.stdout:2/45: dread d0/d1/f3 [0,4194304] 0 2024-09-18T12:51:54.846 INFO:tasks.workunit.client.1.smithi161.stdout:3/47: rename d1/ca to d1/d11/c13 0 2024-09-18T12:51:54.850 INFO:tasks.workunit.client.1.smithi161.stdout:3/48: mkdir d1/d11/d14 0 2024-09-18T12:51:54.854 INFO:tasks.workunit.client.1.smithi161.stdout:8/46: rename d0/l1 to d0/d3/ld 0 2024-09-18T12:51:54.854 INFO:tasks.workunit.client.1.smithi161.stdout:7/39: dwrite d3/f4 [0,4194304] 0 2024-09-18T12:51:54.855 INFO:tasks.workunit.client.1.smithi161.stdout:9/27: dwrite d0/f5 [0,4194304] 0 2024-09-18T12:51:54.856 INFO:tasks.workunit.client.1.smithi161.stdout:3/49: unlink d1/d4/c9 0 2024-09-18T12:51:54.858 INFO:tasks.workunit.client.1.smithi161.stdout:7/40: read d3/f6 [678485,80548] 0 2024-09-18T12:51:54.860 INFO:tasks.workunit.client.1.smithi161.stdout:7/41: readlink d3/l5 0 2024-09-18T12:51:54.862 INFO:tasks.workunit.client.1.smithi161.stdout:2/46: dwrite d0/d1/f7 [0,4194304] 0 2024-09-18T12:51:54.863 INFO:tasks.workunit.client.1.smithi161.stdout:9/28: link d0/l4 d0/l7 0 2024-09-18T12:51:54.870 INFO:tasks.workunit.client.1.smithi161.stdout:2/47: rename d0/l2 to d0/d1/lc 0 2024-09-18T12:51:54.874 INFO:tasks.workunit.client.1.smithi161.stdout:2/48: rename d0 to d0/dd 22 2024-09-18T12:51:54.878 INFO:tasks.workunit.client.1.smithi161.stdout:3/50: dwrite d1/f12 [0,4194304] 0 2024-09-18T12:51:54.881 INFO:tasks.workunit.client.1.smithi161.stdout:7/42: dwrite d3/f4 [0,4194304] 0 2024-09-18T12:51:54.882 INFO:tasks.workunit.client.1.smithi161.stdout:9/29: dwrite d0/f3 [0,4194304] 0 2024-09-18T12:51:54.889 INFO:tasks.workunit.client.1.smithi161.stdout:2/49: getdents d0/d1 0 2024-09-18T12:51:54.892 INFO:tasks.workunit.client.1.smithi161.stdout:2/50: mknod d0/ce 0 2024-09-18T12:51:54.893 INFO:tasks.workunit.client.1.smithi161.stdout:8/47: dwrite d0/d3/fb [0,4194304] 0 2024-09-18T12:51:54.896 INFO:tasks.workunit.client.1.smithi161.stdout:9/30: dwrite d0/f3 [0,4194304] 0 2024-09-18T12:51:54.896 INFO:tasks.workunit.client.1.smithi161.stdout:2/51: write d0/d1/f7 [1903159,85993] 0 2024-09-18T12:51:54.903 INFO:tasks.workunit.client.1.smithi161.stdout:3/51: dwrite d1/d4/f7 [0,4194304] 0 2024-09-18T12:51:54.904 INFO:tasks.workunit.client.1.smithi161.stdout:3/52: write d1/f12 [3037181,93002] 0 2024-09-18T12:51:54.904 INFO:tasks.workunit.client.1.smithi161.stdout:8/48: dread d0/d3/fb [0,4194304] 0 2024-09-18T12:51:54.909 INFO:tasks.workunit.client.1.smithi161.stdout:2/52: write d0/d1/f3 [1874360,53711] 0 2024-09-18T12:51:54.909 INFO:tasks.workunit.client.1.smithi161.stdout:8/49: mknod d0/ce 0 2024-09-18T12:51:54.911 INFO:tasks.workunit.client.1.smithi161.stdout:9/31: truncate d0/f3 722126 0 2024-09-18T12:51:54.913 INFO:tasks.workunit.client.1.smithi161.stdout:2/53: dread d0/d1/f3 [4194304,4194304] 0 2024-09-18T12:51:54.913 INFO:tasks.workunit.client.1.smithi161.stdout:8/50: chown d0/f9 1392827 1 2024-09-18T12:51:54.915 INFO:tasks.workunit.client.1.smithi161.stdout:2/54: readlink d0/d4/lb 0 2024-09-18T12:51:54.916 INFO:tasks.workunit.client.1.smithi161.stdout:2/55: chown d0/d5/da 1386530900 1 2024-09-18T12:51:54.916 INFO:tasks.workunit.client.1.smithi161.stdout:3/53: dwrite d1/f12 [0,4194304] 0 2024-09-18T12:51:54.917 INFO:tasks.workunit.client.1.smithi161.stdout:3/54: fsync d1/d4/f8 0 2024-09-18T12:51:54.918 INFO:tasks.workunit.client.1.smithi161.stdout:9/32: rename d0/l2 to d0/l8 0 2024-09-18T12:51:54.919 INFO:tasks.workunit.client.1.smithi161.stdout:8/51: mkdir d0/d3/df 0 2024-09-18T12:51:54.920 INFO:tasks.workunit.client.1.smithi161.stdout:8/52: write d0/f9 [1822598,69072] 0 2024-09-18T12:51:54.925 INFO:tasks.workunit.client.1.smithi161.stdout:3/55: creat d1/d11/d14/f15 x:0 0 0 2024-09-18T12:51:54.926 INFO:tasks.workunit.client.1.smithi161.stdout:8/53: fsync d0/d3/fb 0 2024-09-18T12:51:54.928 INFO:tasks.workunit.client.1.smithi161.stdout:8/54: write d0/f9 [14167,32892] 0 2024-09-18T12:51:54.929 INFO:tasks.workunit.client.1.smithi161.stdout:9/33: dread d0/f3 [0,4194304] 0 2024-09-18T12:51:54.929 INFO:tasks.workunit.client.1.smithi161.stdout:2/56: truncate d0/d1/f3 563928 0 2024-09-18T12:51:54.932 INFO:tasks.workunit.client.1.smithi161.stdout:3/56: dwrite d1/f12 [0,4194304] 0 2024-09-18T12:51:54.934 INFO:tasks.workunit.client.0.smithi045.stderr:++ readlink -f fsstress 2024-09-18T12:51:54.934 INFO:tasks.workunit.client.1.smithi161.stdout:8/55: readlink d0/d3/ld 0 2024-09-18T12:51:54.935 INFO:tasks.workunit.client.1.smithi161.stdout:9/34: write d0/f3 [1700196,89127] 0 2024-09-18T12:51:54.936 INFO:tasks.workunit.client.1.smithi161.stdout:3/57: unlink d1/d11/d14/f15 0 2024-09-18T12:51:54.937 INFO:tasks.workunit.client.1.smithi161.stdout:2/57: dread d0/d1/f7 [0,4194304] 0 2024-09-18T12:51:54.937 INFO:tasks.workunit.client.1.smithi161.stdout:8/56: mkdir d0/d3/d10 0 2024-09-18T12:51:54.938 INFO:tasks.workunit.client.0.smithi045.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-18T12:51:54.938 INFO:tasks.workunit.client.0.smithi045.stderr:+ popd 2024-09-18T12:51:54.938 INFO:tasks.workunit.client.1.smithi161.stdout:8/57: fdatasync d0/d3/fb 0 2024-09-18T12:51:54.939 INFO:tasks.workunit.client.0.smithi045.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:51:54.939 INFO:tasks.workunit.client.0.smithi045.stderr:+ popd 2024-09-18T12:51:54.940 INFO:tasks.workunit.client.1.smithi161.stdout:3/58: mknod d1/d4/c16 0 2024-09-18T12:51:54.940 INFO:tasks.workunit.client.0.smithi045.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-18T12:51:54.941 INFO:tasks.workunit.client.1.smithi161.stdout:2/58: mkdir d0/d1/df 0 2024-09-18T12:51:54.941 INFO:tasks.workunit.client.0.smithi045.stderr:++ mktemp -d -p . 2024-09-18T12:51:54.941 INFO:tasks.workunit.client.1.smithi161.stdout:9/35: unlink d0/l4 0 2024-09-18T12:51:54.943 INFO:tasks.workunit.client.1.smithi161.stdout:3/59: dread d1/f12 [0,4194304] 0 2024-09-18T12:51:54.943 INFO:tasks.workunit.client.1.smithi161.stdout:8/58: symlink d0/d3/d10/l11 0 2024-09-18T12:51:54.946 INFO:tasks.workunit.client.0.smithi045.stderr:+ T=./tmp.Byz9CSsVFD 2024-09-18T12:51:54.946 INFO:tasks.workunit.client.0.smithi045.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Byz9CSsVFD -l 1 -n 1000 -p 10 -v 2024-09-18T12:51:54.950 INFO:tasks.workunit.client.1.smithi161.stdout:3/60: stat d1/cb 0 2024-09-18T12:51:54.952 INFO:tasks.workunit.client.1.smithi161.stdout:2/59: symlink d0/d1/df/l10 0 2024-09-18T12:51:54.954 INFO:tasks.workunit.client.1.smithi161.stdout:3/61: dread d1/d4/f7 [0,4194304] 0 2024-09-18T12:51:54.954 INFO:tasks.workunit.client.0.smithi045.stdout:seed = 1726241955 2024-09-18T12:51:54.956 INFO:tasks.workunit.client.1.smithi161.stdout:2/60: rename d0/d1/df/l10 to d0/d5/da/l11 0 2024-09-18T12:51:54.956 INFO:tasks.workunit.client.1.smithi161.stdout:8/59: getdents d0/d3/df 0 2024-09-18T12:51:54.958 INFO:tasks.workunit.client.1.smithi161.stdout:3/62: write d1/f12 [880431,26289] 0 2024-09-18T12:51:54.961 INFO:tasks.workunit.client.0.smithi045.stdout:0/0: stat - no entries 2024-09-18T12:51:54.961 INFO:tasks.workunit.client.0.smithi045.stdout:0/1: fdatasync - no filename 2024-09-18T12:51:54.961 INFO:tasks.workunit.client.0.smithi045.stdout:0/2: rename - no filename 2024-09-18T12:51:54.961 INFO:tasks.workunit.client.0.smithi045.stdout:0/3: read - no filename 2024-09-18T12:51:54.961 INFO:tasks.workunit.client.1.smithi161.stdout:8/60: dwrite d0/d3/fb [0,4194304] 0 2024-09-18T12:51:54.962 INFO:tasks.workunit.client.1.smithi161.stdout:8/61: chown d0/d3/fb 198930 1 2024-09-18T12:51:54.962 INFO:tasks.workunit.client.1.smithi161.stdout:2/61: symlink d0/l12 0 2024-09-18T12:51:54.963 INFO:tasks.workunit.client.1.smithi161.stdout:3/63: creat d1/d11/f17 x:0 0 0 2024-09-18T12:51:54.965 INFO:tasks.workunit.client.1.smithi161.stdout:9/36: truncate d0/f5 608098 0 2024-09-18T12:51:54.966 INFO:tasks.workunit.client.1.smithi161.stdout:2/62: write d0/d1/f3 [333026,90864] 0 2024-09-18T12:51:54.966 INFO:tasks.workunit.client.1.smithi161.stdout:3/64: mknod d1/d11/c18 0 2024-09-18T12:51:54.967 INFO:tasks.workunit.client.1.smithi161.stdout:2/63: chown d0/l12 1170596 1 2024-09-18T12:51:54.967 INFO:tasks.workunit.client.1.smithi161.stdout:2/64: readlink d0/d4/lb 0 2024-09-18T12:51:54.968 INFO:tasks.workunit.client.0.smithi045.stdout:2/0: unlink - no file 2024-09-18T12:51:54.968 INFO:tasks.workunit.client.0.smithi045.stdout:2/1: rename - no filename 2024-09-18T12:51:54.968 INFO:tasks.workunit.client.0.smithi045.stdout:0/4: symlink l0 0 2024-09-18T12:51:54.971 INFO:tasks.workunit.client.0.smithi045.stdout:3/0: stat - no entries 2024-09-18T12:51:54.972 INFO:tasks.workunit.client.1.smithi161.stdout:2/65: creat d0/f13 x:0 0 0 2024-09-18T12:51:54.974 INFO:tasks.workunit.client.0.smithi045.stdout:0/5: rename l0 to l1 0 2024-09-18T12:51:54.974 INFO:tasks.workunit.client.1.smithi161.stdout:3/65: dread d1/d4/f7 [0,4194304] 0 2024-09-18T12:51:54.975 INFO:tasks.workunit.client.1.smithi161.stdout:8/62: creat d0/f12 x:0 0 0 2024-09-18T12:51:54.977 INFO:tasks.workunit.client.0.smithi045.stdout:4/0: rmdir - no directory 2024-09-18T12:51:54.978 INFO:tasks.workunit.client.0.smithi045.stdout:2/2: mknod c0 0 2024-09-18T12:51:54.978 INFO:tasks.workunit.client.0.smithi045.stdout:2/3: dread - no filename 2024-09-18T12:51:54.979 INFO:tasks.workunit.client.1.smithi161.stdout:2/66: symlink d0/d1/l14 0 2024-09-18T12:51:54.984 INFO:tasks.workunit.client.1.smithi161.stdout:8/63: mkdir d0/d3/d13 0 2024-09-18T12:51:54.987 INFO:tasks.workunit.client.0.smithi045.stdout:2/4: rename c0 to c1 0 2024-09-18T12:51:54.988 INFO:tasks.workunit.client.1.smithi161.stdout:8/64: dwrite d0/d3/fb [0,4194304] 0 2024-09-18T12:51:54.990 INFO:tasks.workunit.client.0.smithi045.stdout:3/1: mkdir d0 0 2024-09-18T12:51:54.990 INFO:tasks.workunit.client.0.smithi045.stdout:3/2: truncate - no filename 2024-09-18T12:51:54.990 INFO:tasks.workunit.client.0.smithi045.stdout:3/3: rename d0 to d0/d1 22 2024-09-18T12:51:54.990 INFO:tasks.workunit.client.0.smithi045.stdout:3/4: write - no filename 2024-09-18T12:51:54.992 INFO:tasks.workunit.client.1.smithi161.stdout:3/66: creat d1/f19 x:0 0 0 2024-09-18T12:51:54.992 INFO:tasks.workunit.client.1.smithi161.stdout:3/67: stat d1/cb 0 2024-09-18T12:51:54.995 INFO:tasks.workunit.client.1.smithi161.stdout:9/37: dread d0/f3 [0,4194304] 0 2024-09-18T12:51:54.998 INFO:tasks.workunit.client.0.smithi045.stdout:6/0: fdatasync - no filename 2024-09-18T12:51:54.998 INFO:tasks.workunit.client.0.smithi045.stdout:6/1: dwrite - no filename 2024-09-18T12:51:54.998 INFO:tasks.workunit.client.0.smithi045.stdout:6/2: dwrite - no filename 2024-09-18T12:51:54.998 INFO:tasks.workunit.client.1.smithi161.stdout:3/68: unlink d1/cc 0 2024-09-18T12:51:54.999 INFO:tasks.workunit.client.1.smithi161.stdout:3/69: chown d1/d11/f17 7011293 1 2024-09-18T12:51:54.999 INFO:tasks.workunit.client.0.smithi045.stdout:4/1: mknod c0 0 2024-09-18T12:51:55.002 INFO:tasks.workunit.client.0.smithi045.stdout:2/5: mknod c2 0 2024-09-18T12:51:55.005 INFO:tasks.workunit.client.1.smithi161.stdout:8/65: symlink d0/d3/df/l14 0 2024-09-18T12:51:55.009 INFO:tasks.workunit.client.0.smithi045.stdout:7/0: chown . 25430 1 2024-09-18T12:51:55.009 INFO:tasks.workunit.client.0.smithi045.stdout:7/1: stat - no entries 2024-09-18T12:51:55.010 INFO:tasks.workunit.client.0.smithi045.stdout:7/2: fsync - no filename 2024-09-18T12:51:55.010 INFO:tasks.workunit.client.0.smithi045.stdout:7/3: dwrite - no filename 2024-09-18T12:51:55.010 INFO:tasks.workunit.client.1.smithi161.stdout:3/70: mkdir d1/d4/d1a 0 2024-09-18T12:51:55.011 INFO:tasks.workunit.client.0.smithi045.stdout:5/0: getdents . 0 2024-09-18T12:51:55.011 INFO:tasks.workunit.client.0.smithi045.stdout:5/1: dread - no filename 2024-09-18T12:51:55.011 INFO:tasks.workunit.client.0.smithi045.stdout:5/2: rename - no filename 2024-09-18T12:51:55.013 INFO:tasks.workunit.client.1.smithi161.stdout:8/66: creat d0/d3/d10/f15 x:0 0 0 2024-09-18T12:51:55.013 INFO:tasks.workunit.client.1.smithi161.stdout:8/67: chown d0/d3/c6 115775 1 2024-09-18T12:51:55.015 INFO:tasks.workunit.client.0.smithi045.stdout:4/2: symlink l1 0 2024-09-18T12:51:55.016 INFO:tasks.workunit.client.0.smithi045.stdout:4/3: chown c0 21 1 2024-09-18T12:51:55.016 INFO:tasks.workunit.client.0.smithi045.stdout:4/4: dwrite - no filename 2024-09-18T12:51:55.016 INFO:tasks.workunit.client.0.smithi045.stdout:4/5: fdatasync - no filename 2024-09-18T12:51:55.016 INFO:tasks.workunit.client.1.smithi161.stdout:3/71: fsync d1/f19 0 2024-09-18T12:51:55.022 INFO:tasks.workunit.client.0.smithi045.stdout:3/5: creat d0/f2 x:0 0 0 2024-09-18T12:51:55.024 INFO:tasks.workunit.client.0.smithi045.stdout:8/0: write - no filename 2024-09-18T12:51:55.024 INFO:tasks.workunit.client.0.smithi045.stdout:8/1: write - no filename 2024-09-18T12:51:55.025 INFO:tasks.workunit.client.0.smithi045.stdout:8/2: dread - no filename 2024-09-18T12:51:55.025 INFO:tasks.workunit.client.0.smithi045.stdout:8/3: dread - no filename 2024-09-18T12:51:55.026 INFO:tasks.workunit.client.1.smithi161.stdout:9/38: dwrite d0/f5 [0,4194304] 0 2024-09-18T12:51:55.029 INFO:tasks.workunit.client.0.smithi045.stdout:6/3: mknod c0 0 2024-09-18T12:51:55.029 INFO:tasks.workunit.client.0.smithi045.stdout:6/4: truncate - no filename 2024-09-18T12:51:55.029 INFO:tasks.workunit.client.0.smithi045.stdout:6/5: write - no filename 2024-09-18T12:51:55.030 INFO:tasks.workunit.client.0.smithi045.stdout:6/6: read - no filename 2024-09-18T12:51:55.030 INFO:tasks.workunit.client.0.smithi045.stdout:6/7: stat c0 0 2024-09-18T12:51:55.030 INFO:tasks.workunit.client.0.smithi045.stdout:6/8: dread - no filename 2024-09-18T12:51:55.030 INFO:tasks.workunit.client.0.smithi045.stdout:6/9: write - no filename 2024-09-18T12:51:55.030 INFO:tasks.workunit.client.0.smithi045.stdout:6/10: dread - no filename 2024-09-18T12:51:55.031 INFO:tasks.workunit.client.1.smithi161.stdout:8/68: creat d0/f16 x:0 0 0 2024-09-18T12:51:55.032 INFO:tasks.workunit.client.0.smithi045.stdout:4/6: symlink l2 0 2024-09-18T12:51:55.032 INFO:tasks.workunit.client.1.smithi161.stdout:8/69: write d0/f12 [433746,72593] 0 2024-09-18T12:51:55.034 INFO:tasks.workunit.client.0.smithi045.stdout:2/6: rename c1 to c3 0 2024-09-18T12:51:55.035 INFO:tasks.workunit.client.1.smithi161.stdout:3/72: dwrite d1/d4/f7 [0,4194304] 0 2024-09-18T12:51:55.036 INFO:tasks.workunit.client.0.smithi045.stdout:3/6: mknod d0/c3 0 2024-09-18T12:51:55.037 INFO:tasks.workunit.client.0.smithi045.stdout:3/7: dread - d0/f2 zero size 2024-09-18T12:51:55.038 INFO:tasks.workunit.client.0.smithi045.stdout:3/8: truncate d0/f2 840970 0 2024-09-18T12:51:55.038 INFO:tasks.workunit.client.0.smithi045.stdout:9/0: write - no filename 2024-09-18T12:51:55.039 INFO:tasks.workunit.client.0.smithi045.stdout:9/1: dwrite - no filename 2024-09-18T12:51:55.039 INFO:tasks.workunit.client.0.smithi045.stdout:9/2: dwrite - no filename 2024-09-18T12:51:55.039 INFO:tasks.workunit.client.0.smithi045.stdout:9/3: truncate - no filename 2024-09-18T12:51:55.040 INFO:tasks.workunit.client.0.smithi045.stdout:7/4: getdents . 0 2024-09-18T12:51:55.040 INFO:tasks.workunit.client.0.smithi045.stdout:7/5: rmdir - no directory 2024-09-18T12:51:55.040 INFO:tasks.workunit.client.0.smithi045.stdout:7/6: chown . 58462126 1 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/7: chown . 383690329 1 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/8: dread - no filename 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/9: truncate - no filename 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/10: dread - no filename 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/11: write - no filename 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/12: write - no filename 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/13: rmdir - no directory 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/14: stat - no entries 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/15: write - no filename 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/16: dread - no filename 2024-09-18T12:51:55.041 INFO:tasks.workunit.client.0.smithi045.stdout:7/17: rename - no filename 2024-09-18T12:51:55.042 INFO:tasks.workunit.client.0.smithi045.stdout:5/3: mknod c0 0 2024-09-18T12:51:55.042 INFO:tasks.workunit.client.1.smithi161.stdout:3/73: dwrite d1/d4/f7 [0,4194304] 0 2024-09-18T12:51:55.043 INFO:tasks.workunit.client.0.smithi045.stdout:6/11: rename c0 to c1 0 2024-09-18T12:51:55.043 INFO:tasks.workunit.client.0.smithi045.stdout:6/12: dread - no filename 2024-09-18T12:51:55.044 INFO:tasks.workunit.client.0.smithi045.stdout:4/7: symlink l3 0 2024-09-18T12:51:55.045 INFO:tasks.workunit.client.0.smithi045.stdout:4/8: read - no filename 2024-09-18T12:51:55.045 INFO:tasks.workunit.client.0.smithi045.stdout:0/6: link l1 l2 0 2024-09-18T12:51:55.045 INFO:tasks.workunit.client.0.smithi045.stdout:0/7: write - no filename 2024-09-18T12:51:55.045 INFO:tasks.workunit.client.0.smithi045.stdout:0/8: truncate - no filename 2024-09-18T12:51:55.046 INFO:tasks.workunit.client.0.smithi045.stdout:8/4: creat f0 x:0 0 0 2024-09-18T12:51:55.048 INFO:tasks.workunit.client.1.smithi161.stdout:3/74: unlink d1/d4/c16 0 2024-09-18T12:51:55.049 INFO:tasks.workunit.client.1.smithi161.stdout:3/75: write d1/d11/f17 [378244,82668] 0 2024-09-18T12:51:55.049 INFO:tasks.workunit.client.0.smithi045.stdout:3/9: creat d0/f4 x:0 0 0 2024-09-18T12:51:55.050 INFO:tasks.workunit.client.1.smithi161.stdout:3/76: dread - d1/f19 zero size 2024-09-18T12:51:55.051 INFO:tasks.workunit.client.1.smithi161.stdout:3/77: write d1/d11/f17 [19351,56718] 0 2024-09-18T12:51:55.052 INFO:tasks.workunit.client.0.smithi045.stdout:4/9: symlink l4 0 2024-09-18T12:51:55.055 INFO:tasks.workunit.client.0.smithi045.stdout:8/5: symlink l1 0 2024-09-18T12:51:55.056 INFO:tasks.workunit.client.0.smithi045.stdout:8/6: stat f0 0 2024-09-18T12:51:55.056 INFO:tasks.workunit.client.0.smithi045.stdout:9/4: mkdir d0 0 2024-09-18T12:51:55.057 INFO:tasks.workunit.client.0.smithi045.stdout:7/18: mkdir d0 0 2024-09-18T12:51:55.057 INFO:tasks.workunit.client.1.smithi161.stdout:3/78: dwrite d1/d4/f7 [0,4194304] 0 2024-09-18T12:51:55.059 INFO:tasks.workunit.client.0.smithi045.stdout:4/10: mknod c5 0 2024-09-18T12:51:55.059 INFO:tasks.workunit.client.0.smithi045.stdout:0/9: rename l2 to l3 0 2024-09-18T12:51:55.060 INFO:tasks.workunit.client.0.smithi045.stdout:0/10: read - no filename 2024-09-18T12:51:55.060 INFO:tasks.workunit.client.0.smithi045.stdout:3/10: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:51:55.061 INFO:tasks.workunit.client.0.smithi045.stdout:8/7: mknod c2 0 2024-09-18T12:51:55.063 INFO:tasks.workunit.client.1.smithi161.stdout:3/79: dread d1/d11/f17 [0,4194304] 0 2024-09-18T12:51:55.063 INFO:tasks.workunit.client.0.smithi045.stdout:5/4: link c0 c1 0 2024-09-18T12:51:55.069 INFO:tasks.workunit.client.1.smithi161.stdout:3/80: unlink d1/d4/c10 0 2024-09-18T12:51:55.069 INFO:tasks.workunit.client.1.smithi161.stdout:3/81: dread - d1/f19 zero size 2024-09-18T12:51:55.070 INFO:tasks.workunit.client.1.smithi161.stdout:3/82: rename d1/d4 to d1/d4/d1a/d1b 22 2024-09-18T12:51:55.072 INFO:tasks.workunit.client.0.smithi045.stdout:4/11: rename l4 to l6 0 2024-09-18T12:51:55.073 INFO:tasks.workunit.client.0.smithi045.stdout:3/11: creat d0/f5 x:0 0 0 2024-09-18T12:51:55.074 INFO:tasks.workunit.client.0.smithi045.stdout:9/5: symlink d0/l1 0 2024-09-18T12:51:55.075 INFO:tasks.workunit.client.0.smithi045.stdout:8/8: mknod c3 0 2024-09-18T12:51:55.076 INFO:tasks.workunit.client.1.smithi161.stdout:8/70: truncate d0/f9 487693 0 2024-09-18T12:51:55.076 INFO:tasks.workunit.client.1.smithi161.stdout:3/83: mknod d1/c1c 0 2024-09-18T12:51:55.080 INFO:tasks.workunit.client.0.smithi045.stdout:6/13: getdents . 0 2024-09-18T12:51:55.080 INFO:tasks.workunit.client.0.smithi045.stdout:6/14: write - no filename 2024-09-18T12:51:55.080 INFO:tasks.workunit.client.0.smithi045.stdout:2/7: stat c3 0 2024-09-18T12:51:55.081 INFO:tasks.workunit.client.0.smithi045.stdout:4/12: creat f7 x:0 0 0 2024-09-18T12:51:55.083 INFO:tasks.workunit.client.1.smithi161.stdout:8/71: dwrite d0/f12 [0,4194304] 0 2024-09-18T12:51:55.083 INFO:tasks.workunit.client.1.smithi161.stdout:3/84: dwrite d1/f19 [0,4194304] 0 2024-09-18T12:51:55.084 INFO:tasks.workunit.client.0.smithi045.stdout:9/6: creat d0/f2 x:0 0 0 2024-09-18T12:51:55.084 INFO:tasks.workunit.client.1.smithi161.stdout:8/72: dread - d0/d3/d10/f15 zero size 2024-09-18T12:51:55.085 INFO:tasks.workunit.client.0.smithi045.stdout:8/9: creat f4 x:0 0 0 2024-09-18T12:51:55.086 INFO:tasks.workunit.client.0.smithi045.stdout:7/19: rmdir d0 0 2024-09-18T12:51:55.086 INFO:tasks.workunit.client.0.smithi045.stdout:7/20: fsync - no filename 2024-09-18T12:51:55.086 INFO:tasks.workunit.client.0.smithi045.stdout:7/21: truncate - no filename 2024-09-18T12:51:55.087 INFO:tasks.workunit.client.0.smithi045.stdout:5/5: unlink c1 0 2024-09-18T12:51:55.088 INFO:tasks.workunit.client.0.smithi045.stdout:5/6: fdatasync - no filename 2024-09-18T12:51:55.088 INFO:tasks.workunit.client.0.smithi045.stdout:5/7: dread - no filename 2024-09-18T12:51:55.091 INFO:tasks.workunit.client.0.smithi045.stdout:0/11: chown l3 164401812 1 2024-09-18T12:51:55.091 INFO:tasks.workunit.client.1.smithi161.stdout:3/85: dwrite d1/f12 [0,4194304] 0 2024-09-18T12:51:55.091 INFO:tasks.workunit.client.1.smithi161.stdout:8/73: dread d0/d3/fb [0,4194304] 0 2024-09-18T12:51:55.093 INFO:tasks.workunit.client.0.smithi045.stdout:2/8: rename c3 to c4 0 2024-09-18T12:51:55.093 INFO:tasks.workunit.client.0.smithi045.stdout:2/9: write - no filename 2024-09-18T12:51:55.094 INFO:tasks.workunit.client.1.smithi161.stdout:8/74: write d0/f12 [783397,52142] 0 2024-09-18T12:51:55.099 INFO:tasks.workunit.client.0.smithi045.stdout:3/12: link d0/f5 d0/f6 0 2024-09-18T12:51:55.100 INFO:tasks.workunit.client.0.smithi045.stdout:9/7: unlink d0/l1 0 2024-09-18T12:51:55.103 INFO:tasks.workunit.client.0.smithi045.stdout:8/10: creat f5 x:0 0 0 2024-09-18T12:51:55.104 INFO:tasks.workunit.client.0.smithi045.stdout:8/11: chown f0 33182047 1 2024-09-18T12:51:55.106 INFO:tasks.workunit.client.0.smithi045.stdout:7/22: symlink l1 0 2024-09-18T12:51:55.107 INFO:tasks.workunit.client.0.smithi045.stdout:7/23: stat l1 0 2024-09-18T12:51:55.107 INFO:tasks.workunit.client.0.smithi045.stdout:7/24: dwrite - no filename 2024-09-18T12:51:55.109 INFO:tasks.workunit.client.0.smithi045.stdout:5/8: creat f2 x:0 0 0 2024-09-18T12:51:55.110 INFO:tasks.workunit.client.0.smithi045.stdout:5/9: rmdir - no directory 2024-09-18T12:51:55.110 INFO:tasks.workunit.client.0.smithi045.stdout:5/10: truncate f2 1015180 0 2024-09-18T12:51:55.111 INFO:tasks.workunit.client.1.smithi161.stdout:8/75: symlink d0/l17 0 2024-09-18T12:51:55.111 INFO:tasks.workunit.client.1.smithi161.stdout:8/76: read d0/f12 [4146908,111208] 0 2024-09-18T12:51:55.112 INFO:tasks.workunit.client.0.smithi045.stdout:5/11: write f2 [1778877,126181] 0 2024-09-18T12:51:55.112 INFO:tasks.workunit.client.0.smithi045.stdout:6/15: getdents . 0 2024-09-18T12:51:55.112 INFO:tasks.workunit.client.0.smithi045.stdout:4/13: fsync f7 0 2024-09-18T12:51:55.113 INFO:tasks.workunit.client.0.smithi045.stdout:4/14: dread - f7 zero size 2024-09-18T12:51:55.114 INFO:tasks.workunit.client.0.smithi045.stdout:2/10: mkdir d5 0 2024-09-18T12:51:55.115 INFO:tasks.workunit.client.0.smithi045.stdout:2/11: write - no filename 2024-09-18T12:51:55.117 INFO:tasks.workunit.client.0.smithi045.stdout:3/13: write d0/f5 [519134,125828] 0 2024-09-18T12:51:55.117 INFO:tasks.workunit.client.1.smithi161.stdout:8/77: dread d0/f12 [0,4194304] 0 2024-09-18T12:51:55.117 INFO:tasks.workunit.client.1.smithi161.stdout:8/78: stat d0/f16 0 2024-09-18T12:51:55.118 INFO:tasks.workunit.client.0.smithi045.stdout:9/8: mkdir d0/d3 0 2024-09-18T12:51:55.118 INFO:tasks.workunit.client.1.smithi161.stdout:8/79: dread - d0/f16 zero size 2024-09-18T12:51:55.119 INFO:tasks.workunit.client.1.smithi161.stdout:3/86: dwrite d1/f19 [4194304,4194304] 0 2024-09-18T12:51:55.122 INFO:tasks.workunit.client.0.smithi045.stdout:7/25: unlink l1 0 2024-09-18T12:51:55.123 INFO:tasks.workunit.client.0.smithi045.stdout:5/12: dwrite f2 [0,4194304] 0 2024-09-18T12:51:55.124 INFO:tasks.workunit.client.1.smithi161.stdout:8/80: creat d0/d3/d10/f18 x:0 0 0 2024-09-18T12:51:55.125 INFO:tasks.workunit.client.1.smithi161.stdout:8/81: dread - d0/d3/d10/f15 zero size 2024-09-18T12:51:55.129 INFO:tasks.workunit.client.1.smithi161.stdout:3/87: mkdir d1/d4/d1a/d1d 0 2024-09-18T12:51:55.130 INFO:tasks.workunit.client.1.smithi161.stdout:3/88: readlink d1/le 0 2024-09-18T12:51:55.131 INFO:tasks.workunit.client.0.smithi045.stdout:4/15: mknod c8 0 2024-09-18T12:51:55.131 INFO:tasks.workunit.client.0.smithi045.stdout:4/16: fsync f7 0 2024-09-18T12:51:55.132 INFO:tasks.workunit.client.1.smithi161.stdout:8/82: symlink d0/l19 0 2024-09-18T12:51:55.132 INFO:tasks.workunit.client.0.smithi045.stdout:4/17: truncate f7 61483 0 2024-09-18T12:51:55.133 INFO:tasks.workunit.client.0.smithi045.stdout:4/18: chown l2 49003 1 2024-09-18T12:51:55.134 INFO:tasks.workunit.client.0.smithi045.stdout:3/14: mkdir d0/d7 0 2024-09-18T12:51:55.137 INFO:tasks.workunit.client.0.smithi045.stdout:8/12: rename f4 to f6 0 2024-09-18T12:51:55.139 INFO:tasks.workunit.client.0.smithi045.stdout:7/26: creat f2 x:0 0 0 2024-09-18T12:51:55.140 INFO:tasks.workunit.client.0.smithi045.stdout:5/13: symlink l3 0 2024-09-18T12:51:55.140 INFO:tasks.workunit.client.0.smithi045.stdout:5/14: readlink l3 0 2024-09-18T12:51:55.140 INFO:tasks.workunit.client.0.smithi045.stdout:5/15: rmdir - no directory 2024-09-18T12:51:55.141 INFO:tasks.workunit.client.1.smithi161.stdout:8/83: rmdir d0/d3/d13 0 2024-09-18T12:51:55.142 INFO:tasks.workunit.client.1.smithi161.stdout:8/84: write d0/d3/d10/f18 [927455,26862] 0 2024-09-18T12:51:55.143 INFO:tasks.workunit.client.0.smithi045.stdout:4/19: creat f9 x:0 0 0 2024-09-18T12:51:55.144 INFO:tasks.workunit.client.0.smithi045.stdout:8/13: creat f7 x:0 0 0 2024-09-18T12:51:55.145 INFO:tasks.workunit.client.0.smithi045.stdout:9/9: symlink d0/d3/l4 0 2024-09-18T12:51:55.145 INFO:tasks.workunit.client.0.smithi045.stdout:6/16: link c1 c2 0 2024-09-18T12:51:55.145 INFO:tasks.workunit.client.0.smithi045.stdout:6/17: dwrite - no filename 2024-09-18T12:51:55.145 INFO:tasks.workunit.client.0.smithi045.stdout:8/14: fsync f0 0 2024-09-18T12:51:55.147 INFO:tasks.workunit.client.0.smithi045.stdout:9/10: readlink d0/d3/l4 0 2024-09-18T12:51:55.148 INFO:tasks.workunit.client.0.smithi045.stdout:8/15: chown f7 1088 1 2024-09-18T12:51:55.342 INFO:tasks.workunit.client.1.smithi161.stdout:8/85: creat d0/f1a x:0 0 0 2024-09-18T12:51:55.342 INFO:tasks.workunit.client.0.smithi045.stdout:7/27: dwrite f2 [0,4194304] 0 2024-09-18T12:51:55.345 INFO:tasks.workunit.client.1.smithi161.stdout:8/86: fdatasync d0/d3/fb 0 2024-09-18T12:51:55.345 INFO:tasks.workunit.client.0.smithi045.stdout:3/15: creat d0/d7/f8 x:0 0 0 2024-09-18T12:51:55.347 INFO:tasks.workunit.client.0.smithi045.stdout:2/12: link c4 d5/c6 0 2024-09-18T12:51:55.347 INFO:tasks.workunit.client.0.smithi045.stdout:3/16: chown d0/f6 262 1 2024-09-18T12:51:55.349 INFO:tasks.workunit.client.0.smithi045.stdout:4/20: dwrite f9 [0,4194304] 0 2024-09-18T12:51:55.349 INFO:tasks.workunit.client.0.smithi045.stdout:3/17: fdatasync d0/f5 0 2024-09-18T12:51:55.349 INFO:tasks.workunit.client.0.smithi045.stdout:2/13: chown c2 1741216636 1 2024-09-18T12:51:55.350 INFO:tasks.workunit.client.0.smithi045.stdout:2/14: dread - no filename 2024-09-18T12:51:55.350 INFO:tasks.workunit.client.0.smithi045.stdout:2/15: dwrite - no filename 2024-09-18T12:51:55.350 INFO:tasks.workunit.client.0.smithi045.stdout:3/18: chown d0/d7/f8 566 1 2024-09-18T12:51:55.351 INFO:tasks.workunit.client.0.smithi045.stdout:3/19: truncate d0/f6 848933 0 2024-09-18T12:51:55.358 INFO:tasks.workunit.client.0.smithi045.stdout:6/18: chown c1 142856 1 2024-09-18T12:51:55.358 INFO:tasks.workunit.client.0.smithi045.stdout:6/19: truncate - no filename 2024-09-18T12:51:55.358 INFO:tasks.workunit.client.0.smithi045.stdout:6/20: write - no filename 2024-09-18T12:51:55.358 INFO:tasks.workunit.client.0.smithi045.stdout:6/21: fdatasync - no filename 2024-09-18T12:51:55.363 INFO:tasks.workunit.client.0.smithi045.stdout:4/21: creat fa x:0 0 0 2024-09-18T12:51:55.364 INFO:tasks.workunit.client.0.smithi045.stdout:4/22: write f7 [621686,33759] 0 2024-09-18T12:51:55.365 INFO:tasks.workunit.client.1.smithi161.stdout:8/87: dwrite d0/d3/d10/f18 [0,4194304] 0 2024-09-18T12:51:55.365 INFO:tasks.workunit.client.0.smithi045.stdout:4/23: truncate fa 300957 0 2024-09-18T12:51:55.366 INFO:tasks.workunit.client.1.smithi161.stdout:8/88: chown d0/d3/c5 6962 1 2024-09-18T12:51:55.367 INFO:tasks.workunit.client.0.smithi045.stdout:7/28: fdatasync f2 0 2024-09-18T12:51:55.367 INFO:tasks.workunit.client.0.smithi045.stdout:3/20: rename d0/f6 to d0/d7/f9 0 2024-09-18T12:51:55.368 INFO:tasks.workunit.client.0.smithi045.stdout:3/21: truncate d0/f4 527684 0 2024-09-18T12:51:55.370 INFO:tasks.workunit.client.0.smithi045.stdout:6/22: stat c2 0 2024-09-18T12:51:55.370 INFO:tasks.workunit.client.0.smithi045.stdout:6/23: dwrite - no filename 2024-09-18T12:51:55.372 INFO:tasks.workunit.client.0.smithi045.stdout:5/16: link c0 c4 0 2024-09-18T12:51:55.372 INFO:tasks.workunit.client.0.smithi045.stdout:5/17: fdatasync f2 0 2024-09-18T12:51:55.380 INFO:tasks.workunit.client.0.smithi045.stdout:6/24: creat f3 x:0 0 0 2024-09-18T12:51:55.381 INFO:tasks.workunit.client.0.smithi045.stdout:6/25: write f3 [481370,65074] 0 2024-09-18T12:51:55.384 INFO:tasks.workunit.client.0.smithi045.stdout:5/18: rename f2 to f5 0 2024-09-18T12:51:55.396 INFO:tasks.workunit.client.0.smithi045.stdout:6/26: rename c1 to c4 0 2024-09-18T12:51:55.397 INFO:tasks.workunit.client.0.smithi045.stdout:6/27: truncate f3 943560 0 2024-09-18T12:51:55.403 INFO:tasks.workunit.client.0.smithi045.stdout:5/19: dwrite f5 [0,4194304] 0 2024-09-18T12:51:55.406 INFO:tasks.workunit.client.0.smithi045.stdout:5/20: dread f5 [0,4194304] 0 2024-09-18T12:51:55.407 INFO:tasks.workunit.client.0.smithi045.stdout:5/21: write f5 [891901,55985] 0 2024-09-18T12:51:55.408 INFO:tasks.workunit.client.0.smithi045.stdout:5/22: write f5 [4160643,13239] 0 2024-09-18T12:51:55.570 INFO:tasks.workunit.client.0.smithi045.stdout:4/24: getdents . 0 2024-09-18T12:51:55.570 INFO:tasks.workunit.client.0.smithi045.stdout:4/25: write fa [570930,50585] 0 2024-09-18T12:51:55.573 INFO:tasks.workunit.client.0.smithi045.stdout:5/23: mkdir d6 0 2024-09-18T12:51:55.574 INFO:tasks.workunit.client.0.smithi045.stdout:3/22: getdents d0/d7 0 2024-09-18T12:51:55.576 INFO:tasks.workunit.client.0.smithi045.stdout:6/28: chown c2 23664 1 2024-09-18T12:51:55.577 INFO:tasks.workunit.client.0.smithi045.stdout:4/26: mkdir db 0 2024-09-18T12:51:55.577 INFO:tasks.workunit.client.0.smithi045.stdout:4/27: chown l3 258456 1 2024-09-18T12:51:55.578 INFO:tasks.workunit.client.0.smithi045.stdout:4/28: chown l2 952180788 1 2024-09-18T12:51:55.580 INFO:tasks.workunit.client.0.smithi045.stdout:3/23: mkdir d0/da 0 2024-09-18T12:51:55.582 INFO:tasks.workunit.client.0.smithi045.stdout:4/29: rename c0 to db/cc 0 2024-09-18T12:51:55.583 INFO:tasks.workunit.client.0.smithi045.stdout:5/24: getdents d6 0 2024-09-18T12:51:55.584 INFO:tasks.workunit.client.0.smithi045.stdout:3/24: unlink d0/d7/f8 0 2024-09-18T12:51:55.585 INFO:tasks.workunit.client.0.smithi045.stdout:6/29: chown c2 141964417 1 2024-09-18T12:51:55.586 INFO:tasks.workunit.client.0.smithi045.stdout:4/30: symlink db/ld 0 2024-09-18T12:51:55.588 INFO:tasks.workunit.client.0.smithi045.stdout:3/25: creat d0/fb x:0 0 0 2024-09-18T12:51:55.589 INFO:tasks.workunit.client.0.smithi045.stdout:3/26: chown d0/d7/f9 59 1 2024-09-18T12:51:55.589 INFO:tasks.workunit.client.0.smithi045.stdout:4/31: mkdir db/de 0 2024-09-18T12:51:55.590 INFO:tasks.workunit.client.0.smithi045.stdout:4/32: write f9 [4958534,41562] 0 2024-09-18T12:51:55.591 INFO:tasks.workunit.client.1.smithi161.stdout:8/89: getdents d0/d3 0 2024-09-18T12:51:55.591 INFO:tasks.workunit.client.0.smithi045.stdout:6/30: unlink c2 0 2024-09-18T12:51:55.593 INFO:tasks.workunit.client.0.smithi045.stdout:3/27: rename d0/f5 to d0/d7/fc 0 2024-09-18T12:51:55.594 INFO:tasks.workunit.client.0.smithi045.stdout:4/33: symlink db/lf 0 2024-09-18T12:51:55.594 INFO:tasks.workunit.client.0.smithi045.stdout:4/34: stat c8 0 2024-09-18T12:51:55.595 INFO:tasks.workunit.client.0.smithi045.stdout:6/31: creat f5 x:0 0 0 2024-09-18T12:51:55.596 INFO:tasks.workunit.client.0.smithi045.stdout:4/35: fsync f7 0 2024-09-18T12:51:55.597 INFO:tasks.workunit.client.0.smithi045.stdout:4/36: readlink l1 0 2024-09-18T12:51:55.597 INFO:tasks.workunit.client.0.smithi045.stdout:5/25: unlink f5 0 2024-09-18T12:51:55.598 INFO:tasks.workunit.client.0.smithi045.stdout:4/37: chown fa 23 1 2024-09-18T12:51:55.599 INFO:tasks.workunit.client.1.smithi161.stdout:8/90: dwrite d0/f12 [0,4194304] 0 2024-09-18T12:51:55.603 INFO:tasks.workunit.client.1.smithi161.stdout:8/91: symlink d0/d3/df/l1b 0 2024-09-18T12:51:55.605 INFO:tasks.workunit.client.0.smithi045.stdout:5/26: creat d6/f7 x:0 0 0 2024-09-18T12:51:55.605 INFO:tasks.workunit.client.1.smithi161.stdout:8/92: symlink d0/d3/df/l1c 0 2024-09-18T12:51:55.606 INFO:tasks.workunit.client.0.smithi045.stdout:3/28: dwrite d0/fb [0,4194304] 0 2024-09-18T12:51:55.609 INFO:tasks.workunit.client.1.smithi161.stdout:8/93: fdatasync d0/f9 0 2024-09-18T12:51:55.611 INFO:tasks.workunit.client.0.smithi045.stdout:5/27: symlink d6/l8 0 2024-09-18T12:51:55.613 INFO:tasks.workunit.client.0.smithi045.stdout:6/32: dwrite f3 [0,4194304] 0 2024-09-18T12:51:55.614 INFO:tasks.workunit.client.1.smithi161.stdout:8/94: mknod d0/d3/c1d 0 2024-09-18T12:51:55.615 INFO:tasks.workunit.client.0.smithi045.stdout:5/28: truncate d6/f7 202119 0 2024-09-18T12:51:55.615 INFO:tasks.workunit.client.0.smithi045.stdout:6/33: write f3 [700701,125460] 0 2024-09-18T12:51:55.617 INFO:tasks.workunit.client.0.smithi045.stdout:4/38: dwrite f9 [0,4194304] 0 2024-09-18T12:51:55.618 INFO:tasks.workunit.client.1.smithi161.stdout:8/95: mkdir d0/d3/d1e 0 2024-09-18T12:51:55.622 INFO:tasks.workunit.client.1.smithi161.stdout:8/96: dread d0/f9 [0,4194304] 0 2024-09-18T12:51:55.622 INFO:tasks.workunit.client.0.smithi045.stdout:6/34: dread f3 [0,4194304] 0 2024-09-18T12:51:55.625 INFO:tasks.workunit.client.0.smithi045.stdout:4/39: dread f7 [0,4194304] 0 2024-09-18T12:51:55.628 INFO:tasks.workunit.client.0.smithi045.stdout:6/35: symlink l6 0 2024-09-18T12:51:55.628 INFO:tasks.workunit.client.0.smithi045.stdout:6/36: stat f3 0 2024-09-18T12:51:55.629 INFO:tasks.workunit.client.1.smithi161.stdout:8/97: symlink d0/d3/df/l1f 0 2024-09-18T12:51:55.630 INFO:tasks.workunit.client.0.smithi045.stdout:4/40: mkdir db/d10 0 2024-09-18T12:51:55.632 INFO:tasks.workunit.client.0.smithi045.stdout:4/41: rename l6 to db/d10/l11 0 2024-09-18T12:51:55.634 INFO:tasks.workunit.client.0.smithi045.stdout:6/37: link f5 f7 0 2024-09-18T12:51:55.635 INFO:tasks.workunit.client.0.smithi045.stdout:6/38: dread - f5 zero size 2024-09-18T12:51:55.636 INFO:tasks.workunit.client.0.smithi045.stdout:4/42: rename db/lf to db/de/l12 0 2024-09-18T12:51:55.640 INFO:tasks.workunit.client.0.smithi045.stdout:6/39: dread f3 [0,4194304] 0 2024-09-18T12:51:55.641 INFO:tasks.workunit.client.0.smithi045.stdout:6/40: write f5 [946539,117065] 0 2024-09-18T12:51:55.643 INFO:tasks.workunit.client.0.smithi045.stdout:4/43: fdatasync f9 0 2024-09-18T12:51:55.643 INFO:tasks.workunit.client.0.smithi045.stdout:6/41: rename l6 to l8 0 2024-09-18T12:51:55.645 INFO:tasks.workunit.client.0.smithi045.stdout:4/44: mkdir db/d10/d13 0 2024-09-18T12:51:55.645 INFO:tasks.workunit.client.0.smithi045.stdout:4/45: write f9 [3912199,52849] 0 2024-09-18T12:51:55.646 INFO:tasks.workunit.client.0.smithi045.stdout:6/42: write f3 [1252035,119665] 0 2024-09-18T12:51:55.646 INFO:tasks.workunit.client.0.smithi045.stdout:6/43: stat f7 0 2024-09-18T12:51:55.647 INFO:tasks.workunit.client.0.smithi045.stdout:6/44: read f3 [3289523,35703] 0 2024-09-18T12:51:55.650 INFO:tasks.workunit.client.0.smithi045.stdout:6/45: mkdir d9 0 2024-09-18T12:51:55.651 INFO:tasks.workunit.client.0.smithi045.stdout:4/46: creat db/d10/d13/f14 x:0 0 0 2024-09-18T12:51:55.652 INFO:tasks.workunit.client.0.smithi045.stdout:6/46: symlink d9/la 0 2024-09-18T12:51:55.653 INFO:tasks.workunit.client.0.smithi045.stdout:6/47: truncate f7 1348767 0 2024-09-18T12:51:55.655 INFO:tasks.workunit.client.0.smithi045.stdout:6/48: rename f7 to d9/fb 0 2024-09-18T12:51:55.657 INFO:tasks.workunit.client.0.smithi045.stdout:6/49: creat d9/fc x:0 0 0 2024-09-18T12:51:55.877 INFO:tasks.workunit.client.0.smithi045.stdout:3/29: truncate d0/d7/f9 104165 0 2024-09-18T12:51:55.883 INFO:tasks.workunit.client.0.smithi045.stdout:4/47: unlink db/de/l12 0 2024-09-18T12:51:55.885 INFO:tasks.workunit.client.0.smithi045.stdout:4/48: dread f7 [0,4194304] 0 2024-09-18T12:51:55.888 INFO:tasks.workunit.client.0.smithi045.stdout:4/49: rename l2 to db/l15 0 2024-09-18T12:51:55.888 INFO:tasks.workunit.client.0.smithi045.stdout:4/50: read f7 [576554,68063] 0 2024-09-18T12:51:55.891 INFO:tasks.workunit.client.0.smithi045.stdout:4/51: mknod db/de/c16 0 2024-09-18T12:51:55.891 INFO:tasks.workunit.client.0.smithi045.stdout:6/50: truncate f3 2688775 0 2024-09-18T12:51:55.894 INFO:tasks.workunit.client.0.smithi045.stdout:4/52: rename c8 to db/de/c17 0 2024-09-18T12:51:55.898 INFO:tasks.workunit.client.0.smithi045.stdout:4/53: symlink db/d10/d13/l18 0 2024-09-18T12:51:55.900 INFO:tasks.workunit.client.0.smithi045.stdout:6/51: dwrite d9/fc [0,4194304] 0 2024-09-18T12:51:55.903 INFO:tasks.workunit.client.0.smithi045.stdout:4/54: mknod db/d10/d13/c19 0 2024-09-18T12:51:55.907 INFO:tasks.workunit.client.0.smithi045.stdout:4/55: rmdir db/d10 39 2024-09-18T12:51:55.909 INFO:tasks.workunit.client.0.smithi045.stdout:3/30: dwrite d0/d7/f9 [0,4194304] 0 2024-09-18T12:51:55.910 INFO:tasks.workunit.client.0.smithi045.stdout:4/56: mkdir db/de/d1a 0 2024-09-18T12:51:55.911 INFO:tasks.workunit.client.0.smithi045.stdout:6/52: dread d9/fb [0,4194304] 0 2024-09-18T12:51:55.913 INFO:tasks.workunit.client.0.smithi045.stdout:6/53: rmdir d9 39 2024-09-18T12:51:55.915 INFO:tasks.workunit.client.0.smithi045.stdout:4/57: mkdir db/d1b 0 2024-09-18T12:51:55.916 INFO:tasks.workunit.client.0.smithi045.stdout:4/58: write fa [187583,17259] 0 2024-09-18T12:51:55.917 INFO:tasks.workunit.client.0.smithi045.stdout:3/31: dread d0/fb [0,4194304] 0 2024-09-18T12:51:55.917 INFO:tasks.workunit.client.0.smithi045.stdout:3/32: readlink - no filename 2024-09-18T12:51:55.918 INFO:tasks.workunit.client.0.smithi045.stdout:6/54: creat d9/fd x:0 0 0 2024-09-18T12:51:55.919 INFO:tasks.workunit.client.0.smithi045.stdout:4/59: fdatasync fa 0 2024-09-18T12:51:55.924 INFO:tasks.workunit.client.0.smithi045.stdout:3/33: rmdir d0/da 0 2024-09-18T12:51:55.926 INFO:tasks.workunit.client.0.smithi045.stdout:4/60: dread f9 [0,4194304] 0 2024-09-18T12:51:55.932 INFO:tasks.workunit.client.0.smithi045.stdout:6/55: dwrite d9/fb [0,4194304] 0 2024-09-18T12:51:55.934 INFO:tasks.workunit.client.0.smithi045.stdout:6/56: write d9/fd [902804,45456] 0 2024-09-18T12:51:55.934 INFO:tasks.workunit.client.0.smithi045.stdout:4/61: unlink db/d10/l11 0 2024-09-18T12:51:55.935 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:55 smithi045 ceph-mon[28315]: pgmap v20: 65 pgs: 65 active+clean; 204 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 335 op/s 2024-09-18T12:51:55.937 INFO:tasks.workunit.client.0.smithi045.stdout:3/34: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:51:55.937 INFO:tasks.workunit.client.0.smithi045.stdout:6/57: creat d9/fe x:0 0 0 2024-09-18T12:51:55.939 INFO:tasks.workunit.client.0.smithi045.stdout:3/35: chown d0/fb 0 1 2024-09-18T12:51:55.940 INFO:tasks.workunit.client.0.smithi045.stdout:6/58: creat d9/ff x:0 0 0 2024-09-18T12:51:55.944 INFO:tasks.workunit.client.0.smithi045.stdout:6/59: symlink d9/l10 0 2024-09-18T12:51:55.947 INFO:tasks.workunit.client.0.smithi045.stdout:4/62: dwrite db/d10/d13/f14 [0,4194304] 0 2024-09-18T12:51:55.948 INFO:tasks.workunit.client.0.smithi045.stdout:6/60: symlink d9/l11 0 2024-09-18T12:51:55.950 INFO:tasks.workunit.client.0.smithi045.stdout:4/63: rename l3 to db/d10/d13/l1c 0 2024-09-18T12:51:55.957 INFO:tasks.workunit.client.0.smithi045.stdout:3/36: truncate d0/f2 1071966 0 2024-09-18T12:51:55.958 INFO:tasks.workunit.client.0.smithi045.stdout:6/61: dwrite d9/fe [0,4194304] 0 2024-09-18T12:51:55.960 INFO:tasks.workunit.client.0.smithi045.stdout:3/37: symlink d0/ld 0 2024-09-18T12:51:55.961 INFO:tasks.workunit.client.0.smithi045.stdout:4/64: fdatasync db/d10/d13/f14 0 2024-09-18T12:51:55.961 INFO:tasks.workunit.client.0.smithi045.stdout:6/62: creat d9/f12 x:0 0 0 2024-09-18T12:51:55.962 INFO:tasks.workunit.client.0.smithi045.stdout:4/65: write db/d10/d13/f14 [4257630,24321] 0 2024-09-18T12:51:55.965 INFO:tasks.workunit.client.0.smithi045.stdout:4/66: mknod db/d1b/c1d 0 2024-09-18T12:51:55.966 INFO:tasks.workunit.client.0.smithi045.stdout:4/67: fsync db/d10/d13/f14 0 2024-09-18T12:51:55.968 INFO:tasks.workunit.client.0.smithi045.stdout:3/38: unlink d0/f2 0 2024-09-18T12:51:55.970 INFO:tasks.workunit.client.0.smithi045.stdout:3/39: write d0/f4 [4891,1642] 0 2024-09-18T12:51:55.970 INFO:tasks.workunit.client.0.smithi045.stdout:4/68: mkdir db/de/d1e 0 2024-09-18T12:51:55.971 INFO:tasks.workunit.client.0.smithi045.stdout:3/40: truncate d0/fb 4460930 0 2024-09-18T12:51:55.972 INFO:tasks.workunit.client.0.smithi045.stdout:3/41: chown d0/f4 26171769 1 2024-09-18T12:51:55.974 INFO:tasks.workunit.client.0.smithi045.stdout:6/63: fdatasync d9/fe 0 2024-09-18T12:51:55.975 INFO:tasks.workunit.client.0.smithi045.stdout:3/42: rename d0/d7/fc to d0/fe 0 2024-09-18T12:51:55.979 INFO:tasks.workunit.client.0.smithi045.stdout:4/69: dwrite f7 [0,4194304] 0 2024-09-18T12:51:55.979 INFO:tasks.workunit.client.0.smithi045.stdout:6/64: fsync f3 0 2024-09-18T12:51:55.981 INFO:tasks.workunit.client.0.smithi045.stdout:6/65: chown d9/f12 19 1 2024-09-18T12:51:55.984 INFO:tasks.workunit.client.0.smithi045.stdout:6/66: write f5 [527733,43783] 0 2024-09-18T12:51:55.989 INFO:tasks.workunit.client.0.smithi045.stdout:6/67: creat d9/f13 x:0 0 0 2024-09-18T12:51:55.991 INFO:tasks.workunit.client.0.smithi045.stdout:3/43: dwrite d0/f4 [0,4194304] 0 2024-09-18T12:51:55.993 INFO:tasks.workunit.client.0.smithi045.stdout:3/44: stat d0/ld 0 2024-09-18T12:51:55.994 INFO:tasks.workunit.client.0.smithi045.stdout:4/70: dwrite fa [0,4194304] 0 2024-09-18T12:51:55.995 INFO:tasks.workunit.client.0.smithi045.stdout:4/71: fsync f7 0 2024-09-18T12:51:55.997 INFO:tasks.workunit.client.0.smithi045.stdout:3/45: rmdir d0 39 2024-09-18T12:51:55.997 INFO:tasks.workunit.client.0.smithi045.stdout:4/72: rename db/de/d1e to db/de/d1e/d1f 22 2024-09-18T12:51:55.999 INFO:tasks.workunit.client.0.smithi045.stdout:6/68: link d9/la d9/l14 0 2024-09-18T12:51:56.001 INFO:tasks.workunit.client.0.smithi045.stdout:6/69: write d9/fe [3543895,65172] 0 2024-09-18T12:51:56.002 INFO:tasks.workunit.client.0.smithi045.stdout:3/46: mknod d0/d7/cf 0 2024-09-18T12:51:56.004 INFO:tasks.workunit.client.0.smithi045.stdout:6/70: write d9/fe [1656756,125450] 0 2024-09-18T12:51:56.004 INFO:tasks.workunit.client.0.smithi045.stdout:3/47: read d0/fe [2066518,44663] 0 2024-09-18T12:51:56.005 INFO:tasks.workunit.client.0.smithi045.stdout:4/73: dwrite f7 [0,4194304] 0 2024-09-18T12:51:56.005 INFO:tasks.workunit.client.0.smithi045.stdout:6/71: fsync d9/fc 0 2024-09-18T12:51:56.008 INFO:tasks.workunit.client.0.smithi045.stdout:3/48: write d0/fb [735148,112695] 0 2024-09-18T12:51:56.011 INFO:tasks.workunit.client.0.smithi045.stdout:6/72: unlink d9/fb 0 2024-09-18T12:51:56.013 INFO:tasks.workunit.client.0.smithi045.stdout:4/74: mkdir db/d20 0 2024-09-18T12:51:56.015 INFO:tasks.workunit.client.0.smithi045.stdout:3/49: creat d0/d7/f10 x:0 0 0 2024-09-18T12:51:56.016 INFO:tasks.workunit.client.0.smithi045.stdout:6/73: fsync f3 0 2024-09-18T12:51:56.018 INFO:tasks.workunit.client.0.smithi045.stdout:6/74: mknod d9/c15 0 2024-09-18T12:51:56.021 INFO:tasks.workunit.client.0.smithi045.stdout:6/75: symlink d9/l16 0 2024-09-18T12:51:56.022 INFO:tasks.workunit.client.0.smithi045.stdout:4/75: dwrite db/d10/d13/f14 [4194304,4194304] 0 2024-09-18T12:51:56.022 INFO:tasks.workunit.client.0.smithi045.stdout:6/76: rmdir d9 39 2024-09-18T12:51:56.025 INFO:tasks.workunit.client.0.smithi045.stdout:4/76: creat db/f21 x:0 0 0 2024-09-18T12:51:56.027 INFO:tasks.workunit.client.0.smithi045.stdout:6/77: mknod d9/c17 0 2024-09-18T12:51:56.029 INFO:tasks.workunit.client.0.smithi045.stdout:4/77: mknod db/de/c22 0 2024-09-18T12:51:56.029 INFO:tasks.workunit.client.0.smithi045.stdout:4/78: readlink l1 0 2024-09-18T12:51:56.029 INFO:tasks.workunit.client.0.smithi045.stdout:4/79: chown fa 1 1 2024-09-18T12:51:56.030 INFO:tasks.workunit.client.0.smithi045.stdout:6/78: rename d9/fd to d9/f18 0 2024-09-18T12:51:56.032 INFO:tasks.workunit.client.0.smithi045.stdout:4/80: fsync f9 0 2024-09-18T12:51:56.033 INFO:tasks.workunit.client.0.smithi045.stdout:4/81: read fa [2548115,92522] 0 2024-09-18T12:51:56.041 INFO:tasks.workunit.client.0.smithi045.stdout:6/79: truncate d9/fe 3017925 0 2024-09-18T12:51:56.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:55 smithi161 ceph-mon[35784]: pgmap v20: 65 pgs: 65 active+clean; 204 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 335 op/s 2024-09-18T12:51:56.050 INFO:tasks.workunit.client.0.smithi045.stdout:6/80: dwrite f3 [0,4194304] 0 2024-09-18T12:51:56.055 INFO:tasks.workunit.client.0.smithi045.stdout:6/81: link f5 d9/f19 0 2024-09-18T12:51:56.055 INFO:tasks.workunit.client.0.smithi045.stdout:6/82: chown d9/l16 20 1 2024-09-18T12:51:56.057 INFO:tasks.workunit.client.0.smithi045.stdout:6/83: write d9/f12 [319474,41626] 0 2024-09-18T12:51:56.058 INFO:tasks.workunit.client.0.smithi045.stdout:6/84: rmdir d9 39 2024-09-18T12:51:56.059 INFO:tasks.workunit.client.0.smithi045.stdout:6/85: fsync d9/fc 0 2024-09-18T12:51:56.061 INFO:tasks.workunit.client.0.smithi045.stdout:6/86: mkdir d9/d1a 0 2024-09-18T12:51:56.063 INFO:tasks.workunit.client.0.smithi045.stdout:6/87: symlink d9/d1a/l1b 0 2024-09-18T12:51:56.064 INFO:tasks.workunit.client.0.smithi045.stdout:6/88: mknod d9/d1a/c1c 0 2024-09-18T12:51:56.489 INFO:tasks.workunit.client.1.smithi161.stdout:4/42: sync 2024-09-18T12:51:56.489 INFO:tasks.workunit.client.1.smithi161.stdout:6/28: sync 2024-09-18T12:51:56.489 INFO:tasks.workunit.client.1.smithi161.stdout:7/43: sync 2024-09-18T12:51:56.489 INFO:tasks.workunit.client.1.smithi161.stdout:1/0: sync 2024-09-18T12:51:56.489 INFO:tasks.workunit.client.1.smithi161.stdout:5/4: sync 2024-09-18T12:51:56.489 INFO:tasks.workunit.client.1.smithi161.stdout:9/39: sync 2024-09-18T12:51:56.489 INFO:tasks.workunit.client.1.smithi161.stdout:5/5: dwrite - no filename 2024-09-18T12:51:56.490 INFO:tasks.workunit.client.1.smithi161.stdout:8/98: sync 2024-09-18T12:51:56.490 INFO:tasks.workunit.client.1.smithi161.stdout:5/6: dwrite - no filename 2024-09-18T12:51:56.490 INFO:tasks.workunit.client.1.smithi161.stdout:3/89: sync 2024-09-18T12:51:56.490 INFO:tasks.workunit.client.1.smithi161.stdout:2/67: sync 2024-09-18T12:51:56.490 INFO:tasks.workunit.client.1.smithi161.stdout:0/10: sync 2024-09-18T12:51:56.490 INFO:tasks.workunit.client.1.smithi161.stdout:4/43: chown c4 7 1 2024-09-18T12:51:56.499 INFO:tasks.workunit.client.1.smithi161.stdout:3/90: dwrite d1/d4/f7 [0,4194304] 0 2024-09-18T12:51:56.499 INFO:tasks.workunit.client.1.smithi161.stdout:4/44: dwrite d5/fb [0,4194304] 0 2024-09-18T12:51:56.626 INFO:tasks.workunit.client.1.smithi161.stdout:9/40: rmdir d0 39 2024-09-18T12:51:56.627 INFO:tasks.workunit.client.1.smithi161.stdout:0/11: sync 2024-09-18T12:51:56.627 INFO:tasks.workunit.client.1.smithi161.stdout:0/12: readlink l2 0 2024-09-18T12:51:56.627 INFO:tasks.workunit.client.1.smithi161.stdout:0/13: truncate - no filename 2024-09-18T12:51:56.628 INFO:tasks.workunit.client.1.smithi161.stdout:2/68: rmdir d0/d5/da 39 2024-09-18T12:51:56.630 INFO:tasks.workunit.client.1.smithi161.stdout:2/69: dread d0/d4/f8 [0,4194304] 0 2024-09-18T12:51:56.631 INFO:tasks.workunit.client.1.smithi161.stdout:2/70: read d0/d4/f8 [434782,125466] 0 2024-09-18T12:51:56.632 INFO:tasks.workunit.client.1.smithi161.stdout:3/91: rename d1/d4/d1a to d1/d11/d14/d1e 0 2024-09-18T12:51:56.632 INFO:tasks.workunit.client.1.smithi161.stdout:7/44: mkdir d3/d8 0 2024-09-18T12:51:56.632 INFO:tasks.workunit.client.1.smithi161.stdout:5/7: creat f0 x:0 0 0 2024-09-18T12:51:56.633 INFO:tasks.workunit.client.1.smithi161.stdout:1/1: creat f0 x:0 0 0 2024-09-18T12:51:56.634 INFO:tasks.workunit.client.1.smithi161.stdout:1/2: stat f0 0 2024-09-18T12:51:56.635 INFO:tasks.workunit.client.1.smithi161.stdout:5/8: dread - f0 zero size 2024-09-18T12:51:56.635 INFO:tasks.workunit.client.1.smithi161.stdout:7/45: rename d3 to d3/d8/d9 22 2024-09-18T12:51:56.635 INFO:tasks.workunit.client.1.smithi161.stdout:8/99: symlink d0/l20 0 2024-09-18T12:51:56.635 INFO:tasks.workunit.client.1.smithi161.stdout:9/41: rename d0 to d0/d9 22 2024-09-18T12:51:56.636 INFO:tasks.workunit.client.1.smithi161.stdout:3/92: write d1/f12 [4300405,62035] 0 2024-09-18T12:51:56.636 INFO:tasks.workunit.client.1.smithi161.stdout:7/46: dread - d3/f7 zero size 2024-09-18T12:51:56.636 INFO:tasks.workunit.client.1.smithi161.stdout:0/14: creat f3 x:0 0 0 2024-09-18T12:51:56.637 INFO:tasks.workunit.client.1.smithi161.stdout:6/29: link c3 d4/c5 0 2024-09-18T12:51:56.637 INFO:tasks.workunit.client.1.smithi161.stdout:5/9: write f0 [599813,60523] 0 2024-09-18T12:51:56.638 INFO:tasks.workunit.client.1.smithi161.stdout:8/100: fdatasync d0/d3/d10/f15 0 2024-09-18T12:51:56.638 INFO:tasks.workunit.client.1.smithi161.stdout:9/42: creat d0/fa x:0 0 0 2024-09-18T12:51:56.640 INFO:tasks.workunit.client.1.smithi161.stdout:5/10: chown f0 110417 1 2024-09-18T12:51:56.642 INFO:tasks.workunit.client.1.smithi161.stdout:8/101: stat d0/d3/lc 0 2024-09-18T12:51:56.643 INFO:tasks.workunit.client.1.smithi161.stdout:3/93: creat d1/d11/d14/d1e/f1f x:0 0 0 2024-09-18T12:51:56.644 INFO:tasks.workunit.client.1.smithi161.stdout:5/11: write f0 [1658806,122453] 0 2024-09-18T12:51:56.644 INFO:tasks.workunit.client.1.smithi161.stdout:2/71: rename d0/d5/da to d0/d5/d15 0 2024-09-18T12:51:56.645 INFO:tasks.workunit.client.1.smithi161.stdout:3/94: stat d1/d11 0 2024-09-18T12:51:56.647 INFO:tasks.workunit.client.1.smithi161.stdout:6/30: chown d4/c5 259098 1 2024-09-18T12:51:56.648 INFO:tasks.workunit.client.1.smithi161.stdout:9/43: unlink d0/l7 0 2024-09-18T12:51:56.649 INFO:tasks.workunit.client.1.smithi161.stdout:5/12: mknod c1 0 2024-09-18T12:51:56.650 INFO:tasks.workunit.client.1.smithi161.stdout:6/31: rename d4 to d4/d6 22 2024-09-18T12:51:56.650 INFO:tasks.workunit.client.1.smithi161.stdout:6/32: dwrite - no filename 2024-09-18T12:51:56.650 INFO:tasks.workunit.client.1.smithi161.stdout:8/102: mkdir d0/d3/d10/d21 0 2024-09-18T12:51:56.652 INFO:tasks.workunit.client.1.smithi161.stdout:3/95: creat d1/d11/f20 x:0 0 0 2024-09-18T12:51:56.652 INFO:tasks.workunit.client.1.smithi161.stdout:9/44: write d0/fa [752022,91957] 0 2024-09-18T12:51:56.654 INFO:tasks.workunit.client.1.smithi161.stdout:2/72: creat d0/d1/df/f16 x:0 0 0 2024-09-18T12:51:56.654 INFO:tasks.workunit.client.1.smithi161.stdout:8/103: readlink d0/l19 0 2024-09-18T12:51:56.654 INFO:tasks.workunit.client.1.smithi161.stdout:1/3: dwrite f0 [0,4194304] 0 2024-09-18T12:51:56.654 INFO:tasks.workunit.client.1.smithi161.stdout:5/13: write f0 [2403954,83106] 0 2024-09-18T12:51:56.655 INFO:tasks.workunit.client.1.smithi161.stdout:0/15: dwrite f3 [0,4194304] 0 2024-09-18T12:51:56.655 INFO:tasks.workunit.client.1.smithi161.stdout:7/47: dread d3/f4 [0,4194304] 0 2024-09-18T12:51:56.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/33: symlink d4/l7 0 2024-09-18T12:51:56.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/34: dwrite - no filename 2024-09-18T12:51:56.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/35: dwrite - no filename 2024-09-18T12:51:56.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/36: write - no filename 2024-09-18T12:51:56.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/37: truncate - no filename 2024-09-18T12:51:56.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/38: truncate - no filename 2024-09-18T12:51:56.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/39: read - no filename 2024-09-18T12:51:56.658 INFO:tasks.workunit.client.1.smithi161.stdout:7/48: stat d3/l5 0 2024-09-18T12:51:56.661 INFO:tasks.workunit.client.1.smithi161.stdout:9/45: mkdir d0/db 0 2024-09-18T12:51:56.661 INFO:tasks.workunit.client.1.smithi161.stdout:3/96: write d1/d11/f17 [461505,72893] 0 2024-09-18T12:51:56.661 INFO:tasks.workunit.client.1.smithi161.stdout:0/16: mkdir d4 0 2024-09-18T12:51:56.663 INFO:tasks.workunit.client.1.smithi161.stdout:8/104: creat d0/d3/d10/f22 x:0 0 0 2024-09-18T12:51:56.665 INFO:tasks.workunit.client.1.smithi161.stdout:0/17: write f3 [208862,19888] 0 2024-09-18T12:51:56.667 INFO:tasks.workunit.client.1.smithi161.stdout:6/40: mknod d4/c8 0 2024-09-18T12:51:56.667 INFO:tasks.workunit.client.1.smithi161.stdout:6/41: truncate - no filename 2024-09-18T12:51:56.667 INFO:tasks.workunit.client.1.smithi161.stdout:6/42: dwrite - no filename 2024-09-18T12:51:56.669 INFO:tasks.workunit.client.1.smithi161.stdout:9/46: write d0/fa [3300,64556] 0 2024-09-18T12:51:56.671 INFO:tasks.workunit.client.1.smithi161.stdout:0/18: truncate f3 4357099 0 2024-09-18T12:51:56.678 INFO:tasks.workunit.client.1.smithi161.stdout:5/14: dread f0 [0,4194304] 0 2024-09-18T12:51:56.680 INFO:tasks.workunit.client.1.smithi161.stdout:7/49: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:51:56.686 INFO:tasks.workunit.client.1.smithi161.stdout:7/50: chown d3/f6 4 1 2024-09-18T12:51:56.686 INFO:tasks.workunit.client.1.smithi161.stdout:3/97: dwrite d1/d4/f8 [0,4194304] 0 2024-09-18T12:51:56.691 INFO:tasks.workunit.client.1.smithi161.stdout:3/98: stat d1/d11/c13 0 2024-09-18T12:51:56.692 INFO:tasks.workunit.client.1.smithi161.stdout:9/47: dwrite d0/f3 [0,4194304] 0 2024-09-18T12:51:56.693 INFO:tasks.workunit.client.1.smithi161.stdout:0/19: dwrite f3 [0,4194304] 0 2024-09-18T12:51:56.694 INFO:tasks.workunit.client.1.smithi161.stdout:5/15: dread f0 [0,4194304] 0 2024-09-18T12:51:56.697 INFO:tasks.workunit.client.1.smithi161.stdout:9/48: mkdir d0/dc 0 2024-09-18T12:51:56.698 INFO:tasks.workunit.client.1.smithi161.stdout:3/99: symlink d1/d11/d14/d1e/l21 0 2024-09-18T12:51:56.700 INFO:tasks.workunit.client.1.smithi161.stdout:9/49: read d0/fa [417132,130291] 0 2024-09-18T12:51:56.702 INFO:tasks.workunit.client.1.smithi161.stdout:3/100: creat d1/d4/f22 x:0 0 0 2024-09-18T12:51:56.703 INFO:tasks.workunit.client.1.smithi161.stdout:0/20: rmdir d4 0 2024-09-18T12:51:56.704 INFO:tasks.workunit.client.1.smithi161.stdout:3/101: readlink d1/d11/d14/d1e/l21 0 2024-09-18T12:51:56.704 INFO:tasks.workunit.client.1.smithi161.stdout:3/102: stat d1/f19 0 2024-09-18T12:51:56.705 INFO:tasks.workunit.client.1.smithi161.stdout:9/50: creat d0/fd x:0 0 0 2024-09-18T12:51:56.706 INFO:tasks.workunit.client.1.smithi161.stdout:3/103: chown d1/d11/c18 2156 1 2024-09-18T12:51:56.707 INFO:tasks.workunit.client.1.smithi161.stdout:5/16: dwrite f0 [0,4194304] 0 2024-09-18T12:51:56.707 INFO:tasks.workunit.client.1.smithi161.stdout:5/17: rmdir - no directory 2024-09-18T12:51:56.707 INFO:tasks.workunit.client.1.smithi161.stdout:9/51: truncate d0/fd 583999 0 2024-09-18T12:51:56.709 INFO:tasks.workunit.client.1.smithi161.stdout:0/21: link f3 f5 0 2024-09-18T12:51:56.709 INFO:tasks.workunit.client.1.smithi161.stdout:9/52: write d0/f5 [3642629,92916] 0 2024-09-18T12:51:56.710 INFO:tasks.workunit.client.1.smithi161.stdout:5/18: creat f2 x:0 0 0 2024-09-18T12:51:56.710 INFO:tasks.workunit.client.1.smithi161.stdout:5/19: dread - f2 zero size 2024-09-18T12:51:56.713 INFO:tasks.workunit.client.1.smithi161.stdout:9/53: symlink d0/le 0 2024-09-18T12:51:56.714 INFO:tasks.workunit.client.1.smithi161.stdout:5/20: mkdir d3 0 2024-09-18T12:51:56.714 INFO:tasks.workunit.client.1.smithi161.stdout:5/21: readlink - no filename 2024-09-18T12:51:56.714 INFO:tasks.workunit.client.1.smithi161.stdout:0/22: dread f3 [0,4194304] 0 2024-09-18T12:51:56.715 INFO:tasks.workunit.client.1.smithi161.stdout:5/22: truncate f0 4672443 0 2024-09-18T12:51:56.721 INFO:tasks.workunit.client.1.smithi161.stdout:5/23: symlink d3/l4 0 2024-09-18T12:51:56.725 INFO:tasks.workunit.client.1.smithi161.stdout:5/24: dread f0 [0,4194304] 0 2024-09-18T12:51:56.725 INFO:tasks.workunit.client.1.smithi161.stdout:5/25: chown f0 13523883 1 2024-09-18T12:51:56.789 INFO:tasks.workunit.client.1.smithi161.stdout:4/45: write d5/fb [5218233,129965] 0 2024-09-18T12:51:56.790 INFO:tasks.workunit.client.1.smithi161.stdout:3/104: getdents d1/d11/d14 0 2024-09-18T12:51:56.792 INFO:tasks.workunit.client.1.smithi161.stdout:6/43: sync 2024-09-18T12:51:56.792 INFO:tasks.workunit.client.1.smithi161.stdout:3/105: symlink d1/d4/l23 0 2024-09-18T12:51:56.793 INFO:tasks.workunit.client.1.smithi161.stdout:4/46: link d5/fb d5/fc 0 2024-09-18T12:51:56.793 INFO:tasks.workunit.client.1.smithi161.stdout:4/47: chown d5/fb 685320 1 2024-09-18T12:51:56.794 INFO:tasks.workunit.client.1.smithi161.stdout:6/44: unlink d4/c8 0 2024-09-18T12:51:56.794 INFO:tasks.workunit.client.1.smithi161.stdout:6/45: write - no filename 2024-09-18T12:51:56.796 INFO:tasks.workunit.client.1.smithi161.stdout:4/48: mknod d5/cd 0 2024-09-18T12:51:56.797 INFO:tasks.workunit.client.1.smithi161.stdout:6/46: symlink d4/l9 0 2024-09-18T12:51:56.797 INFO:tasks.workunit.client.1.smithi161.stdout:6/47: dwrite - no filename 2024-09-18T12:51:56.797 INFO:tasks.workunit.client.1.smithi161.stdout:6/48: write - no filename 2024-09-18T12:51:56.798 INFO:tasks.workunit.client.1.smithi161.stdout:4/49: fdatasync d5/fc 0 2024-09-18T12:51:56.801 INFO:tasks.workunit.client.1.smithi161.stdout:2/73: rename d0/d5/d15 to d0/d4/d17 0 2024-09-18T12:51:56.802 INFO:tasks.workunit.client.1.smithi161.stdout:2/74: write d0/d1/f3 [1171834,88629] 0 2024-09-18T12:51:56.802 INFO:tasks.workunit.client.1.smithi161.stdout:4/50: creat d5/fe x:0 0 0 2024-09-18T12:51:56.805 INFO:tasks.workunit.client.1.smithi161.stdout:5/26: rename f2 to d3/f5 0 2024-09-18T12:51:56.807 INFO:tasks.workunit.client.1.smithi161.stdout:4/51: creat d5/ff x:0 0 0 2024-09-18T12:51:56.809 INFO:tasks.workunit.client.1.smithi161.stdout:2/75: unlink d0/ce 0 2024-09-18T12:51:56.810 INFO:tasks.workunit.client.1.smithi161.stdout:2/76: dread - d0/d1/df/f16 zero size 2024-09-18T12:51:56.812 INFO:tasks.workunit.client.1.smithi161.stdout:5/27: creat d3/f6 x:0 0 0 2024-09-18T12:51:56.813 INFO:tasks.workunit.client.1.smithi161.stdout:4/52: rename d5/c9 to d5/c10 0 2024-09-18T12:51:56.814 INFO:tasks.workunit.client.1.smithi161.stdout:2/77: rmdir d0/d1 39 2024-09-18T12:51:56.816 INFO:tasks.workunit.client.1.smithi161.stdout:4/53: symlink d5/l11 0 2024-09-18T12:51:56.817 INFO:tasks.workunit.client.1.smithi161.stdout:2/78: creat d0/d4/d17/f18 x:0 0 0 2024-09-18T12:51:56.818 INFO:tasks.workunit.client.1.smithi161.stdout:4/54: creat d5/f12 x:0 0 0 2024-09-18T12:51:56.818 INFO:tasks.workunit.client.1.smithi161.stdout:0/23: sync 2024-09-18T12:51:56.818 INFO:tasks.workunit.client.1.smithi161.stdout:0/24: rmdir - no directory 2024-09-18T12:51:56.818 INFO:tasks.workunit.client.1.smithi161.stdout:1/4: truncate f0 483150 0 2024-09-18T12:51:56.820 INFO:tasks.workunit.client.1.smithi161.stdout:2/79: truncate d0/d4/f8 928985 0 2024-09-18T12:51:56.820 INFO:tasks.workunit.client.1.smithi161.stdout:4/55: chown d5/fc 8995 1 2024-09-18T12:51:56.820 INFO:tasks.workunit.client.1.smithi161.stdout:8/105: truncate d0/d3/d10/f18 2215054 0 2024-09-18T12:51:56.820 INFO:tasks.workunit.client.1.smithi161.stdout:4/56: readlink d5/la 0 2024-09-18T12:51:56.820 INFO:tasks.workunit.client.1.smithi161.stdout:5/28: dwrite f0 [0,4194304] 0 2024-09-18T12:51:56.821 INFO:tasks.workunit.client.1.smithi161.stdout:0/25: rename l2 to l6 0 2024-09-18T12:51:56.821 INFO:tasks.workunit.client.1.smithi161.stdout:4/57: chown d5/f8 3100 1 2024-09-18T12:51:56.822 INFO:tasks.workunit.client.1.smithi161.stdout:7/51: truncate d3/f6 1047499 0 2024-09-18T12:51:56.822 INFO:tasks.workunit.client.1.smithi161.stdout:5/29: read - d3/f5 zero size 2024-09-18T12:51:56.823 INFO:tasks.workunit.client.1.smithi161.stdout:2/80: fdatasync d0/d1/df/f16 0 2024-09-18T12:51:56.825 INFO:tasks.workunit.client.1.smithi161.stdout:8/106: rename d0/d3/d10/f15 to d0/d3/d10/f23 0 2024-09-18T12:51:56.827 INFO:tasks.workunit.client.1.smithi161.stdout:4/58: symlink d5/l13 0 2024-09-18T12:51:56.833 INFO:tasks.workunit.client.1.smithi161.stdout:2/81: dwrite d0/d1/df/f16 [0,4194304] 0 2024-09-18T12:51:56.836 INFO:tasks.workunit.client.1.smithi161.stdout:9/54: getdents d0 0 2024-09-18T12:51:56.839 INFO:tasks.workunit.client.1.smithi161.stdout:3/106: getdents d1/d4 0 2024-09-18T12:51:56.841 INFO:tasks.workunit.client.1.smithi161.stdout:9/55: read d0/f5 [3876489,50628] 0 2024-09-18T12:51:56.841 INFO:tasks.workunit.client.1.smithi161.stdout:2/82: fdatasync d0/d4/d17/f18 0 2024-09-18T12:51:56.843 INFO:tasks.workunit.client.1.smithi161.stdout:8/107: dwrite d0/f12 [0,4194304] 0 2024-09-18T12:51:56.843 INFO:tasks.workunit.client.1.smithi161.stdout:2/83: chown d0 14003 1 2024-09-18T12:51:56.843 INFO:tasks.workunit.client.1.smithi161.stdout:6/49: getdents d4 0 2024-09-18T12:51:56.843 INFO:tasks.workunit.client.1.smithi161.stdout:6/50: dwrite - no filename 2024-09-18T12:51:56.844 INFO:tasks.workunit.client.1.smithi161.stdout:6/51: dread - no filename 2024-09-18T12:51:56.847 INFO:tasks.workunit.client.1.smithi161.stdout:6/52: stat d4/l9 0 2024-09-18T12:51:56.847 INFO:tasks.workunit.client.1.smithi161.stdout:6/53: dwrite - no filename 2024-09-18T12:51:56.848 INFO:tasks.workunit.client.1.smithi161.stdout:4/59: dwrite d5/f8 [0,4194304] 0 2024-09-18T12:51:56.849 INFO:tasks.workunit.client.1.smithi161.stdout:7/52: dwrite d3/f4 [0,4194304] 0 2024-09-18T12:51:56.851 INFO:tasks.workunit.client.1.smithi161.stdout:2/84: write d0/d1/f7 [3261148,58757] 0 2024-09-18T12:51:56.851 INFO:tasks.workunit.client.1.smithi161.stdout:4/60: chown d5/f12 1 1 2024-09-18T12:51:56.856 INFO:tasks.workunit.client.1.smithi161.stdout:6/54: creat d4/fa x:0 0 0 2024-09-18T12:51:56.858 INFO:tasks.workunit.client.1.smithi161.stdout:3/107: dread d1/d4/f8 [0,4194304] 0 2024-09-18T12:51:56.864 INFO:tasks.workunit.client.1.smithi161.stdout:2/85: dread d0/d1/df/f16 [0,4194304] 0 2024-09-18T12:51:56.864 INFO:tasks.workunit.client.1.smithi161.stdout:4/61: mkdir d5/d14 0 2024-09-18T12:51:56.864 INFO:tasks.workunit.client.1.smithi161.stdout:7/53: dread d3/f4 [0,4194304] 0 2024-09-18T12:51:56.864 INFO:tasks.workunit.client.1.smithi161.stdout:6/55: mkdir d4/db 0 2024-09-18T12:51:56.865 INFO:tasks.workunit.client.1.smithi161.stdout:0/26: rename l6 to l7 0 2024-09-18T12:51:56.865 INFO:tasks.workunit.client.1.smithi161.stdout:5/30: truncate f0 1368155 0 2024-09-18T12:51:56.865 INFO:tasks.workunit.client.1.smithi161.stdout:6/56: dread - d4/fa zero size 2024-09-18T12:51:56.867 INFO:tasks.workunit.client.1.smithi161.stdout:8/108: link d0/f16 d0/f24 0 2024-09-18T12:51:56.868 INFO:tasks.workunit.client.1.smithi161.stdout:3/108: rename d1/d11/d14/d1e to d1/d11/d24 0 2024-09-18T12:51:56.868 INFO:tasks.workunit.client.1.smithi161.stdout:2/86: mknod d0/d1/c19 0 2024-09-18T12:51:56.869 INFO:tasks.workunit.client.1.smithi161.stdout:0/27: creat f8 x:0 0 0 2024-09-18T12:51:56.870 INFO:tasks.workunit.client.1.smithi161.stdout:5/31: creat d3/f7 x:0 0 0 2024-09-18T12:51:56.871 INFO:tasks.workunit.client.1.smithi161.stdout:7/54: getdents d3/d8 0 2024-09-18T12:51:56.875 INFO:tasks.workunit.client.1.smithi161.stdout:0/28: read f3 [3518765,72872] 0 2024-09-18T12:51:56.875 INFO:tasks.workunit.client.1.smithi161.stdout:8/109: creat d0/d3/df/f25 x:0 0 0 2024-09-18T12:51:56.877 INFO:tasks.workunit.client.1.smithi161.stdout:7/55: write d3/f7 [3777055,112755] 0 2024-09-18T12:51:56.878 INFO:tasks.workunit.client.1.smithi161.stdout:4/62: dwrite d5/ff [0,4194304] 0 2024-09-18T12:51:56.878 INFO:tasks.workunit.client.1.smithi161.stdout:3/109: creat d1/d11/d24/d1d/f25 x:0 0 0 2024-09-18T12:51:56.880 INFO:tasks.workunit.client.1.smithi161.stdout:0/29: mknod c9 0 2024-09-18T12:51:56.886 INFO:tasks.workunit.client.1.smithi161.stdout:0/30: write f8 [776805,107864] 0 2024-09-18T12:51:56.886 INFO:tasks.workunit.client.1.smithi161.stdout:6/57: dwrite d4/fa [0,4194304] 0 2024-09-18T12:51:56.887 INFO:tasks.workunit.client.1.smithi161.stdout:7/56: truncate d3/f7 5041659 0 2024-09-18T12:51:56.888 INFO:tasks.workunit.client.1.smithi161.stdout:9/56: truncate d0/fa 567123 0 2024-09-18T12:51:56.890 INFO:tasks.workunit.client.1.smithi161.stdout:4/63: creat d5/f15 x:0 0 0 2024-09-18T12:51:56.890 INFO:tasks.workunit.client.1.smithi161.stdout:2/87: dwrite d0/d1/f7 [0,4194304] 0 2024-09-18T12:51:56.891 INFO:tasks.workunit.client.1.smithi161.stdout:9/57: readlink d0/le 0 2024-09-18T12:51:56.896 INFO:tasks.workunit.client.1.smithi161.stdout:5/32: getdents d3 0 2024-09-18T12:51:56.900 INFO:tasks.workunit.client.1.smithi161.stdout:5/33: write d3/f6 [284417,127238] 0 2024-09-18T12:51:56.902 INFO:tasks.workunit.client.1.smithi161.stdout:6/58: dread d4/fa [0,4194304] 0 2024-09-18T12:51:56.902 INFO:tasks.workunit.client.1.smithi161.stdout:7/57: dread d3/f7 [0,4194304] 0 2024-09-18T12:51:56.902 INFO:tasks.workunit.client.1.smithi161.stdout:4/64: dread d5/fb [4194304,4194304] 0 2024-09-18T12:51:56.904 INFO:tasks.workunit.client.1.smithi161.stdout:3/110: link d1/cb d1/d4/c26 0 2024-09-18T12:51:56.905 INFO:tasks.workunit.client.1.smithi161.stdout:4/65: dread - d5/f12 zero size 2024-09-18T12:51:56.906 INFO:tasks.workunit.client.1.smithi161.stdout:5/34: unlink d3/f6 0 2024-09-18T12:51:56.907 INFO:tasks.workunit.client.1.smithi161.stdout:0/31: write f3 [2537370,83084] 0 2024-09-18T12:51:56.907 INFO:tasks.workunit.client.1.smithi161.stdout:4/66: write d5/fb [1689998,45135] 0 2024-09-18T12:51:56.909 INFO:tasks.workunit.client.1.smithi161.stdout:7/58: creat d3/fa x:0 0 0 2024-09-18T12:51:56.909 INFO:tasks.workunit.client.1.smithi161.stdout:0/32: write f5 [1773319,108084] 0 2024-09-18T12:51:56.909 INFO:tasks.workunit.client.1.smithi161.stdout:0/33: rmdir - no directory 2024-09-18T12:51:56.911 INFO:tasks.workunit.client.1.smithi161.stdout:8/110: dwrite d0/f9 [0,4194304] 0 2024-09-18T12:51:56.912 INFO:tasks.workunit.client.1.smithi161.stdout:7/59: write d3/fa [536669,9306] 0 2024-09-18T12:51:56.913 INFO:tasks.workunit.client.1.smithi161.stdout:6/59: creat d4/db/fc x:0 0 0 2024-09-18T12:51:56.916 INFO:tasks.workunit.client.1.smithi161.stdout:8/111: chown d0/d3/d10/f23 185158260 1 2024-09-18T12:51:56.917 INFO:tasks.workunit.client.1.smithi161.stdout:0/34: creat fa x:0 0 0 2024-09-18T12:51:56.919 INFO:tasks.workunit.client.1.smithi161.stdout:8/112: dread - d0/f1a zero size 2024-09-18T12:51:56.920 INFO:tasks.workunit.client.1.smithi161.stdout:0/35: symlink lb 0 2024-09-18T12:51:56.941 INFO:tasks.workunit.client.1.smithi161.stdout:1/5: sync 2024-09-18T12:51:56.947 INFO:tasks.workunit.client.1.smithi161.stdout:7/60: fdatasync d3/f6 0 2024-09-18T12:51:56.947 INFO:tasks.workunit.client.1.smithi161.stdout:3/111: getdents d1/d11 0 2024-09-18T12:51:56.947 INFO:tasks.workunit.client.1.smithi161.stdout:9/58: dwrite d0/f5 [0,4194304] 0 2024-09-18T12:51:56.948 INFO:tasks.workunit.client.1.smithi161.stdout:4/67: dwrite d5/ff [0,4194304] 0 2024-09-18T12:51:56.948 INFO:tasks.workunit.client.1.smithi161.stdout:8/113: chown d0/d3/df/l1c 287745 1 2024-09-18T12:51:56.948 INFO:tasks.workunit.client.1.smithi161.stdout:0/36: truncate fa 248631 0 2024-09-18T12:51:56.949 INFO:tasks.workunit.client.1.smithi161.stdout:5/35: write f0 [1249015,60376] 0 2024-09-18T12:51:56.950 INFO:tasks.workunit.client.1.smithi161.stdout:3/112: readlink d1/d11/d24/l21 0 2024-09-18T12:51:56.950 INFO:tasks.workunit.client.1.smithi161.stdout:1/6: dread f0 [0,4194304] 0 2024-09-18T12:51:56.951 INFO:tasks.workunit.client.1.smithi161.stdout:9/59: creat d0/ff x:0 0 0 2024-09-18T12:51:56.952 INFO:tasks.workunit.client.1.smithi161.stdout:8/114: dread - d0/d3/d10/f23 zero size 2024-09-18T12:51:56.954 INFO:tasks.workunit.client.1.smithi161.stdout:0/37: unlink fa 0 2024-09-18T12:51:56.955 INFO:tasks.workunit.client.1.smithi161.stdout:9/60: dread d0/fd [0,4194304] 0 2024-09-18T12:51:56.956 INFO:tasks.workunit.client.1.smithi161.stdout:4/68: creat d5/f16 x:0 0 0 2024-09-18T12:51:56.958 INFO:tasks.workunit.client.1.smithi161.stdout:5/36: mkdir d3/d8 0 2024-09-18T12:51:56.959 INFO:tasks.workunit.client.1.smithi161.stdout:4/69: fdatasync d5/f16 0 2024-09-18T12:51:56.959 INFO:tasks.workunit.client.1.smithi161.stdout:1/7: mkdir d1 0 2024-09-18T12:51:56.962 INFO:tasks.workunit.client.1.smithi161.stdout:1/8: truncate f0 1072336 0 2024-09-18T12:51:56.962 INFO:tasks.workunit.client.1.smithi161.stdout:7/61: dwrite d3/f6 [0,4194304] 0 2024-09-18T12:51:56.964 INFO:tasks.workunit.client.1.smithi161.stdout:0/38: creat fc x:0 0 0 2024-09-18T12:51:56.968 INFO:tasks.workunit.client.1.smithi161.stdout:5/37: mkdir d3/d9 0 2024-09-18T12:51:56.970 INFO:tasks.workunit.client.1.smithi161.stdout:9/61: dwrite d0/fd [0,4194304] 0 2024-09-18T12:51:56.972 INFO:tasks.workunit.client.1.smithi161.stdout:7/62: mknod d3/cb 0 2024-09-18T12:51:56.976 INFO:tasks.workunit.client.1.smithi161.stdout:5/38: unlink d3/f7 0 2024-09-18T12:51:56.979 INFO:tasks.workunit.client.1.smithi161.stdout:3/113: getdents d1/d11/d24 0 2024-09-18T12:51:56.981 INFO:tasks.workunit.client.1.smithi161.stdout:9/62: mknod d0/dc/c10 0 2024-09-18T12:51:56.982 INFO:tasks.workunit.client.1.smithi161.stdout:5/39: creat d3/fa x:0 0 0 2024-09-18T12:51:56.983 INFO:tasks.workunit.client.1.smithi161.stdout:3/114: chown d1/d11 209008 1 2024-09-18T12:51:56.983 INFO:tasks.workunit.client.1.smithi161.stdout:7/63: symlink d3/d8/lc 0 2024-09-18T12:51:56.983 INFO:tasks.workunit.client.1.smithi161.stdout:0/39: dwrite f5 [0,4194304] 0 2024-09-18T12:51:56.984 INFO:tasks.workunit.client.1.smithi161.stdout:8/115: dwrite d0/d3/d10/f23 [0,4194304] 0 2024-09-18T12:51:56.985 INFO:tasks.workunit.client.1.smithi161.stdout:9/63: write d0/f5 [2763225,6517] 0 2024-09-18T12:51:56.985 INFO:tasks.workunit.client.1.smithi161.stdout:0/40: fdatasync f8 0 2024-09-18T12:51:56.986 INFO:tasks.workunit.client.1.smithi161.stdout:7/64: chown d3/l5 614 1 2024-09-18T12:51:56.986 INFO:tasks.workunit.client.1.smithi161.stdout:5/40: fsync d3/f5 0 2024-09-18T12:51:56.988 INFO:tasks.workunit.client.1.smithi161.stdout:3/115: mkdir d1/d11/d24/d27 0 2024-09-18T12:51:56.989 INFO:tasks.workunit.client.1.smithi161.stdout:8/116: truncate d0/f16 72700 0 2024-09-18T12:51:56.989 INFO:tasks.workunit.client.1.smithi161.stdout:1/9: dwrite f0 [0,4194304] 0 2024-09-18T12:51:56.990 INFO:tasks.workunit.client.1.smithi161.stdout:7/65: chown d3/l5 12084135 1 2024-09-18T12:51:56.990 INFO:tasks.workunit.client.1.smithi161.stdout:0/41: creat fd x:0 0 0 2024-09-18T12:51:56.990 INFO:tasks.workunit.client.1.smithi161.stdout:5/41: write d3/f5 [816803,47237] 0 2024-09-18T12:51:56.992 INFO:tasks.workunit.client.1.smithi161.stdout:9/64: creat d0/f11 x:0 0 0 2024-09-18T12:51:56.995 INFO:tasks.workunit.client.1.smithi161.stdout:3/116: chown d1/d11/d24/d27 2 1 2024-09-18T12:51:56.995 INFO:tasks.workunit.client.1.smithi161.stdout:0/42: readlink l7 0 2024-09-18T12:51:56.998 INFO:tasks.workunit.client.1.smithi161.stdout:8/117: rename d0/d3/df/l14 to d0/d3/d10/d21/l26 0 2024-09-18T12:51:56.999 INFO:tasks.workunit.client.1.smithi161.stdout:1/10: mknod d1/c2 0 2024-09-18T12:51:57.000 INFO:tasks.workunit.client.1.smithi161.stdout:9/65: mkdir d0/dc/d12 0 2024-09-18T12:51:57.001 INFO:tasks.workunit.client.1.smithi161.stdout:7/66: link d3/f6 d3/d8/fd 0 2024-09-18T12:51:57.002 INFO:tasks.workunit.client.1.smithi161.stdout:9/66: chown d0/dc 66012 1 2024-09-18T12:51:57.003 INFO:tasks.workunit.client.1.smithi161.stdout:1/11: chown f0 9194772 1 2024-09-18T12:51:57.004 INFO:tasks.workunit.client.1.smithi161.stdout:3/117: link d1/d11/d24/f1f d1/d11/f28 0 2024-09-18T12:51:57.006 INFO:tasks.workunit.client.1.smithi161.stdout:1/12: rmdir d1 39 2024-09-18T12:51:57.007 INFO:tasks.workunit.client.1.smithi161.stdout:7/67: chown d3/d8/lc 41335 1 2024-09-18T12:51:57.009 INFO:tasks.workunit.client.1.smithi161.stdout:9/67: write d0/f5 [3322740,72427] 0 2024-09-18T12:51:57.010 INFO:tasks.workunit.client.1.smithi161.stdout:3/118: unlink d1/d11/c13 0 2024-09-18T12:51:57.011 INFO:tasks.workunit.client.1.smithi161.stdout:7/68: fdatasync d3/fa 0 2024-09-18T12:51:57.011 INFO:tasks.workunit.client.1.smithi161.stdout:2/88: sync 2024-09-18T12:51:57.012 INFO:tasks.workunit.client.1.smithi161.stdout:5/42: dwrite d3/fa [0,4194304] 0 2024-09-18T12:51:57.013 INFO:tasks.workunit.client.1.smithi161.stdout:0/43: dwrite fd [0,4194304] 0 2024-09-18T12:51:57.015 INFO:tasks.workunit.client.1.smithi161.stdout:9/68: creat d0/db/f13 x:0 0 0 2024-09-18T12:51:57.015 INFO:tasks.workunit.client.1.smithi161.stdout:0/44: dread - fc zero size 2024-09-18T12:51:57.015 INFO:tasks.workunit.client.1.smithi161.stdout:5/43: read d3/fa [3931574,106327] 0 2024-09-18T12:51:57.015 INFO:tasks.workunit.client.1.smithi161.stdout:3/119: mknod d1/d4/c29 0 2024-09-18T12:51:57.017 INFO:tasks.workunit.client.1.smithi161.stdout:7/69: write d3/f6 [2644482,28436] 0 2024-09-18T12:51:57.017 INFO:tasks.workunit.client.1.smithi161.stdout:9/69: dread - d0/f11 zero size 2024-09-18T12:51:57.021 INFO:tasks.workunit.client.1.smithi161.stdout:1/13: dread f0 [0,4194304] 0 2024-09-18T12:51:57.022 INFO:tasks.workunit.client.1.smithi161.stdout:0/45: unlink f8 0 2024-09-18T12:51:57.022 INFO:tasks.workunit.client.1.smithi161.stdout:0/46: rmdir - no directory 2024-09-18T12:51:57.025 INFO:tasks.workunit.client.1.smithi161.stdout:7/70: mknod d3/ce 0 2024-09-18T12:51:57.026 INFO:tasks.workunit.client.1.smithi161.stdout:3/120: dwrite d1/d4/f22 [0,4194304] 0 2024-09-18T12:51:57.030 INFO:tasks.workunit.client.1.smithi161.stdout:1/14: rename d1 to d1/d3 22 2024-09-18T12:51:57.032 INFO:tasks.workunit.client.1.smithi161.stdout:0/47: mknod ce 0 2024-09-18T12:51:57.033 INFO:tasks.workunit.client.1.smithi161.stdout:5/44: getdents d3/d8 0 2024-09-18T12:51:57.034 INFO:tasks.workunit.client.1.smithi161.stdout:5/45: rename d3 to d3/d8/db 22 2024-09-18T12:51:57.034 INFO:tasks.workunit.client.1.smithi161.stdout:5/46: chown c1 218 1 2024-09-18T12:51:57.034 INFO:tasks.workunit.client.1.smithi161.stdout:7/71: unlink d3/ce 0 2024-09-18T12:51:57.037 INFO:tasks.workunit.client.1.smithi161.stdout:5/47: write d3/f5 [1290615,24281] 0 2024-09-18T12:51:57.037 INFO:tasks.workunit.client.1.smithi161.stdout:8/118: truncate d0/f9 2372645 0 2024-09-18T12:51:57.038 INFO:tasks.workunit.client.1.smithi161.stdout:9/70: creat d0/dc/d12/f14 x:0 0 0 2024-09-18T12:51:57.038 INFO:tasks.workunit.client.1.smithi161.stdout:1/15: rmdir d1 39 2024-09-18T12:51:57.038 INFO:tasks.workunit.client.1.smithi161.stdout:1/16: readlink - no filename 2024-09-18T12:51:57.039 INFO:tasks.workunit.client.1.smithi161.stdout:5/48: read f0 [653540,5167] 0 2024-09-18T12:51:57.040 INFO:tasks.workunit.client.1.smithi161.stdout:5/49: chown d3/l4 23277 1 2024-09-18T12:51:57.040 INFO:tasks.workunit.client.1.smithi161.stdout:7/72: mknod d3/cf 0 2024-09-18T12:51:57.041 INFO:tasks.workunit.client.1.smithi161.stdout:2/89: getdents d0/d4/d17 0 2024-09-18T12:51:57.041 INFO:tasks.workunit.client.1.smithi161.stdout:5/50: chown d3/l4 1 1 2024-09-18T12:51:57.042 INFO:tasks.workunit.client.1.smithi161.stdout:0/48: dwrite fd [0,4194304] 0 2024-09-18T12:51:57.047 INFO:tasks.workunit.client.1.smithi161.stdout:5/51: mknod d3/cc 0 2024-09-18T12:51:57.049 INFO:tasks.workunit.client.1.smithi161.stdout:5/52: write d3/f5 [331128,57907] 0 2024-09-18T12:51:57.050 INFO:tasks.workunit.client.1.smithi161.stdout:0/49: mkdir df 0 2024-09-18T12:51:57.051 INFO:tasks.workunit.client.1.smithi161.stdout:1/17: dwrite f0 [0,4194304] 0 2024-09-18T12:51:57.053 INFO:tasks.workunit.client.1.smithi161.stdout:2/90: symlink d0/l1a 0 2024-09-18T12:51:57.053 INFO:tasks.workunit.client.1.smithi161.stdout:3/121: write d1/d11/d24/f1f [341002,12296] 0 2024-09-18T12:51:57.059 INFO:tasks.workunit.client.1.smithi161.stdout:5/53: unlink d3/fa 0 2024-09-18T12:51:57.060 INFO:tasks.workunit.client.1.smithi161.stdout:5/54: readlink d3/l4 0 2024-09-18T12:51:57.062 INFO:tasks.workunit.client.1.smithi161.stdout:2/91: fsync d0/d1/df/f16 0 2024-09-18T12:51:57.063 INFO:tasks.workunit.client.1.smithi161.stdout:2/92: stat d0/l12 0 2024-09-18T12:51:57.068 INFO:tasks.workunit.client.1.smithi161.stdout:3/122: dwrite d1/d11/f28 [0,4194304] 0 2024-09-18T12:51:57.068 INFO:tasks.workunit.client.1.smithi161.stdout:5/55: link d3/f5 d3/fd 0 2024-09-18T12:51:57.068 INFO:tasks.workunit.client.1.smithi161.stdout:2/93: chown d0/d1/df/f16 74 1 2024-09-18T12:51:57.068 INFO:tasks.workunit.client.1.smithi161.stdout:3/123: write d1/f19 [1961713,73148] 0 2024-09-18T12:51:57.070 INFO:tasks.workunit.client.1.smithi161.stdout:7/73: dwrite d3/f7 [4194304,4194304] 0 2024-09-18T12:51:57.071 INFO:tasks.workunit.client.1.smithi161.stdout:1/18: fsync f0 0 2024-09-18T12:51:57.072 INFO:tasks.workunit.client.1.smithi161.stdout:3/124: rmdir d1/d4 39 2024-09-18T12:51:57.074 INFO:tasks.workunit.client.1.smithi161.stdout:2/94: creat d0/d1/df/f1b x:0 0 0 2024-09-18T12:51:57.077 INFO:tasks.workunit.client.1.smithi161.stdout:0/50: truncate fd 4172595 0 2024-09-18T12:51:57.078 INFO:tasks.workunit.client.1.smithi161.stdout:8/119: truncate d0/f9 3339112 0 2024-09-18T12:51:57.080 INFO:tasks.workunit.client.1.smithi161.stdout:8/120: stat d0/d3/la 0 2024-09-18T12:51:57.080 INFO:tasks.workunit.client.1.smithi161.stdout:1/19: mknod d1/c4 0 2024-09-18T12:51:57.082 INFO:tasks.workunit.client.1.smithi161.stdout:2/95: mknod d0/d5/c1c 0 2024-09-18T12:51:57.083 INFO:tasks.workunit.client.1.smithi161.stdout:1/20: rmdir d1 39 2024-09-18T12:51:57.084 INFO:tasks.workunit.client.1.smithi161.stdout:1/21: fsync f0 0 2024-09-18T12:51:57.086 INFO:tasks.workunit.client.1.smithi161.stdout:2/96: chown d0/d4/d17 313624143 1 2024-09-18T12:51:57.086 INFO:tasks.workunit.client.1.smithi161.stdout:8/121: creat d0/f27 x:0 0 0 2024-09-18T12:51:57.087 INFO:tasks.workunit.client.1.smithi161.stdout:5/56: dwrite d3/f5 [0,4194304] 0 2024-09-18T12:51:57.089 INFO:tasks.workunit.client.1.smithi161.stdout:8/122: unlink d0/f1a 0 2024-09-18T12:51:57.090 INFO:tasks.workunit.client.1.smithi161.stdout:3/125: dwrite d1/d11/d24/d1d/f25 [0,4194304] 0 2024-09-18T12:51:57.090 INFO:tasks.workunit.client.1.smithi161.stdout:2/97: mkdir d0/d1d 0 2024-09-18T12:51:57.093 INFO:tasks.workunit.client.1.smithi161.stdout:2/98: stat d0/d1/df 0 2024-09-18T12:51:57.093 INFO:tasks.workunit.client.1.smithi161.stdout:3/126: write d1/d11/f28 [64806,15720] 0 2024-09-18T12:51:57.094 INFO:tasks.workunit.client.1.smithi161.stdout:7/74: truncate d3/f6 2170227 0 2024-09-18T12:51:57.095 INFO:tasks.workunit.client.1.smithi161.stdout:0/51: write fd [2408970,75686] 0 2024-09-18T12:51:57.098 INFO:tasks.workunit.client.1.smithi161.stdout:2/99: read d0/d1/f7 [407148,24417] 0 2024-09-18T12:51:57.103 INFO:tasks.workunit.client.1.smithi161.stdout:5/57: write f0 [2109802,84054] 0 2024-09-18T12:51:57.104 INFO:tasks.workunit.client.1.smithi161.stdout:7/75: rename d3/cf to d3/d8/c10 0 2024-09-18T12:51:57.107 INFO:tasks.workunit.client.1.smithi161.stdout:8/123: fsync d0/d3/d10/f18 0 2024-09-18T12:51:57.107 INFO:tasks.workunit.client.1.smithi161.stdout:2/100: symlink d0/d4/l1e 0 2024-09-18T12:51:57.108 INFO:tasks.workunit.client.1.smithi161.stdout:3/127: dwrite d1/d11/f28 [0,4194304] 0 2024-09-18T12:51:57.110 INFO:tasks.workunit.client.1.smithi161.stdout:5/58: mknod d3/d9/ce 0 2024-09-18T12:51:57.112 INFO:tasks.workunit.client.1.smithi161.stdout:2/101: dread - d0/d4/d17/f18 zero size 2024-09-18T12:51:57.113 INFO:tasks.workunit.client.1.smithi161.stdout:0/52: dwrite fc [0,4194304] 0 2024-09-18T12:51:57.115 INFO:tasks.workunit.client.1.smithi161.stdout:0/53: chown lb 6675 1 2024-09-18T12:51:57.116 INFO:tasks.workunit.client.1.smithi161.stdout:7/76: dread d3/f7 [0,4194304] 0 2024-09-18T12:51:57.116 INFO:tasks.workunit.client.1.smithi161.stdout:8/124: symlink d0/d3/d10/d21/l28 0 2024-09-18T12:51:57.120 INFO:tasks.workunit.client.1.smithi161.stdout:5/59: mknod d3/d8/cf 0 2024-09-18T12:51:57.120 INFO:tasks.workunit.client.1.smithi161.stdout:3/128: dread d1/d11/f28 [0,4194304] 0 2024-09-18T12:51:57.121 INFO:tasks.workunit.client.1.smithi161.stdout:2/102: unlink d0/d4/f8 0 2024-09-18T12:51:57.122 INFO:tasks.workunit.client.1.smithi161.stdout:2/103: fsync d0/d1/f3 0 2024-09-18T12:51:57.122 INFO:tasks.workunit.client.1.smithi161.stdout:4/70: sync 2024-09-18T12:51:57.123 INFO:tasks.workunit.client.1.smithi161.stdout:6/60: sync 2024-09-18T12:51:57.123 INFO:tasks.workunit.client.1.smithi161.stdout:7/77: rmdir d3 39 2024-09-18T12:51:57.124 INFO:tasks.workunit.client.1.smithi161.stdout:4/71: write d5/fc [1332509,61281] 0 2024-09-18T12:51:57.124 INFO:tasks.workunit.client.1.smithi161.stdout:2/104: truncate d0/d4/d17/f18 551143 0 2024-09-18T12:51:57.125 INFO:tasks.workunit.client.1.smithi161.stdout:4/72: dread - d5/f16 zero size 2024-09-18T12:51:57.125 INFO:tasks.workunit.client.1.smithi161.stdout:8/125: symlink d0/d3/df/l29 0 2024-09-18T12:51:57.127 INFO:tasks.workunit.client.1.smithi161.stdout:3/129: creat d1/d11/d24/d1d/f2a x:0 0 0 2024-09-18T12:51:57.128 INFO:tasks.workunit.client.1.smithi161.stdout:5/60: rename d3/d9/ce to d3/d8/c10 0 2024-09-18T12:51:57.129 INFO:tasks.workunit.client.1.smithi161.stdout:0/54: mknod df/c10 0 2024-09-18T12:51:57.129 INFO:tasks.workunit.client.1.smithi161.stdout:5/61: write d3/fd [2779699,4421] 0 2024-09-18T12:51:57.130 INFO:tasks.workunit.client.1.smithi161.stdout:6/61: symlink d4/db/ld 0 2024-09-18T12:51:57.133 INFO:tasks.workunit.client.1.smithi161.stdout:3/130: creat d1/d11/d24/d1d/f2b x:0 0 0 2024-09-18T12:51:57.136 INFO:tasks.workunit.client.1.smithi161.stdout:2/105: symlink d0/d1d/l1f 0 2024-09-18T12:51:57.137 INFO:tasks.workunit.client.1.smithi161.stdout:0/55: dwrite f3 [4194304,4194304] 0 2024-09-18T12:51:57.137 INFO:tasks.workunit.client.1.smithi161.stdout:7/78: rmdir d3 39 2024-09-18T12:51:57.138 INFO:tasks.workunit.client.1.smithi161.stdout:0/56: write f3 [2826654,88322] 0 2024-09-18T12:51:57.138 INFO:tasks.workunit.client.1.smithi161.stdout:0/57: readlink lb 0 2024-09-18T12:51:57.139 INFO:tasks.workunit.client.1.smithi161.stdout:0/58: read fd [1128217,36937] 0 2024-09-18T12:51:57.140 INFO:tasks.workunit.client.1.smithi161.stdout:4/73: link d5/f16 d5/f17 0 2024-09-18T12:51:57.142 INFO:tasks.workunit.client.1.smithi161.stdout:4/74: chown d5/cd 35 1 2024-09-18T12:51:57.143 INFO:tasks.workunit.client.1.smithi161.stdout:4/75: write d5/ff [3722449,75009] 0 2024-09-18T12:51:57.144 INFO:tasks.workunit.client.1.smithi161.stdout:3/131: mkdir d1/d11/d14/d2c 0 2024-09-18T12:51:57.146 INFO:tasks.workunit.client.1.smithi161.stdout:2/106: dwrite d0/d1/f3 [0,4194304] 0 2024-09-18T12:51:57.147 INFO:tasks.workunit.client.1.smithi161.stdout:7/79: write d3/fa [874878,103483] 0 2024-09-18T12:51:57.150 INFO:tasks.workunit.client.1.smithi161.stdout:0/59: symlink df/l11 0 2024-09-18T12:51:57.151 INFO:tasks.workunit.client.1.smithi161.stdout:8/126: rename d0/f24 to d0/f2a 0 2024-09-18T12:51:57.156 INFO:tasks.workunit.client.1.smithi161.stdout:2/107: symlink d0/d1/l20 0 2024-09-18T12:51:57.157 INFO:tasks.workunit.client.1.smithi161.stdout:7/80: creat d3/f11 x:0 0 0 2024-09-18T12:51:57.158 INFO:tasks.workunit.client.1.smithi161.stdout:0/60: creat df/f12 x:0 0 0 2024-09-18T12:51:57.159 INFO:tasks.workunit.client.1.smithi161.stdout:0/61: stat l7 0 2024-09-18T12:51:57.160 INFO:tasks.workunit.client.1.smithi161.stdout:5/62: getdents d3/d8 0 2024-09-18T12:51:57.160 INFO:tasks.workunit.client.1.smithi161.stdout:4/76: mknod d5/d14/c18 0 2024-09-18T12:51:57.161 INFO:tasks.workunit.client.1.smithi161.stdout:4/77: chown d5/fb 123830 1 2024-09-18T12:51:57.161 INFO:tasks.workunit.client.1.smithi161.stdout:8/127: truncate d0/f9 984136 0 2024-09-18T12:51:57.163 INFO:tasks.workunit.client.1.smithi161.stdout:0/62: rename df/l11 to df/l13 0 2024-09-18T12:51:57.163 INFO:tasks.workunit.client.1.smithi161.stdout:3/132: creat d1/f2d x:0 0 0 2024-09-18T12:51:57.163 INFO:tasks.workunit.client.1.smithi161.stdout:8/128: stat d0/d3/fb 0 2024-09-18T12:51:57.166 INFO:tasks.workunit.client.1.smithi161.stdout:4/78: dread d5/fc [4194304,4194304] 0 2024-09-18T12:51:57.171 INFO:tasks.workunit.client.1.smithi161.stdout:4/79: mknod d5/d14/c19 0 2024-09-18T12:51:57.171 INFO:tasks.workunit.client.1.smithi161.stdout:5/63: dwrite d3/fd [4194304,4194304] 0 2024-09-18T12:51:57.171 INFO:tasks.workunit.client.1.smithi161.stdout:2/108: dread d0/d1/f7 [0,4194304] 0 2024-09-18T12:51:57.173 INFO:tasks.workunit.client.1.smithi161.stdout:4/80: creat d5/f1a x:0 0 0 2024-09-18T12:51:57.177 INFO:tasks.workunit.client.1.smithi161.stdout:2/109: symlink d0/d1/l21 0 2024-09-18T12:51:57.177 INFO:tasks.workunit.client.1.smithi161.stdout:3/133: dwrite d1/f19 [4194304,4194304] 0 2024-09-18T12:51:57.179 INFO:tasks.workunit.client.1.smithi161.stdout:2/110: fdatasync d0/d1/df/f16 0 2024-09-18T12:51:57.180 INFO:tasks.workunit.client.1.smithi161.stdout:0/63: truncate fc 1514665 0 2024-09-18T12:51:57.182 INFO:tasks.workunit.client.1.smithi161.stdout:4/81: unlink d5/d14/c19 0 2024-09-18T12:51:57.184 INFO:tasks.workunit.client.1.smithi161.stdout:3/134: chown d1/d4/l23 17 1 2024-09-18T12:51:57.184 INFO:tasks.workunit.client.1.smithi161.stdout:0/64: symlink df/l14 0 2024-09-18T12:51:57.186 INFO:tasks.workunit.client.1.smithi161.stdout:5/64: fdatasync d3/fd 0 2024-09-18T12:51:57.187 INFO:tasks.workunit.client.1.smithi161.stdout:4/82: mknod d5/c1b 0 2024-09-18T12:51:57.187 INFO:tasks.workunit.client.1.smithi161.stdout:3/135: readlink d1/d11/d24/l21 0 2024-09-18T12:51:57.187 INFO:tasks.workunit.client.1.smithi161.stdout:8/129: dwrite d0/f2a [0,4194304] 0 2024-09-18T12:51:57.188 INFO:tasks.workunit.client.1.smithi161.stdout:0/65: creat df/f15 x:0 0 0 2024-09-18T12:51:57.189 INFO:tasks.workunit.client.1.smithi161.stdout:4/83: dread - d5/f16 zero size 2024-09-18T12:51:57.190 INFO:tasks.workunit.client.1.smithi161.stdout:3/136: chown d1/d11/d24/d1d/f2b 40005 1 2024-09-18T12:51:57.191 INFO:tasks.workunit.client.1.smithi161.stdout:5/65: creat d3/d9/f11 x:0 0 0 2024-09-18T12:51:57.192 INFO:tasks.workunit.client.1.smithi161.stdout:0/66: creat df/f16 x:0 0 0 2024-09-18T12:51:57.192 INFO:tasks.workunit.client.1.smithi161.stdout:4/84: write d5/fe [5681,116453] 0 2024-09-18T12:51:57.193 INFO:tasks.workunit.client.1.smithi161.stdout:0/67: rename df to df/d17 22 2024-09-18T12:51:57.196 INFO:tasks.workunit.client.1.smithi161.stdout:3/137: write d1/d4/f22 [1146037,70693] 0 2024-09-18T12:51:57.198 INFO:tasks.workunit.client.1.smithi161.stdout:0/68: write df/f15 [192701,39222] 0 2024-09-18T12:51:57.200 INFO:tasks.workunit.client.1.smithi161.stdout:3/138: readlink d1/d4/l23 0 2024-09-18T12:51:57.200 INFO:tasks.workunit.client.1.smithi161.stdout:4/85: unlink d5/f12 0 2024-09-18T12:51:57.200 INFO:tasks.workunit.client.1.smithi161.stdout:0/69: fdatasync df/f16 0 2024-09-18T12:51:57.201 INFO:tasks.workunit.client.1.smithi161.stdout:3/139: readlink d1/le 0 2024-09-18T12:51:57.202 INFO:tasks.workunit.client.1.smithi161.stdout:8/130: dwrite d0/f27 [0,4194304] 0 2024-09-18T12:51:57.204 INFO:tasks.workunit.client.1.smithi161.stdout:4/86: truncate d5/f1a 972389 0 2024-09-18T12:51:57.204 INFO:tasks.workunit.client.1.smithi161.stdout:5/66: dread d3/f5 [4194304,4194304] 0 2024-09-18T12:51:57.205 INFO:tasks.workunit.client.1.smithi161.stdout:3/140: write d1/d11/f17 [563712,11723] 0 2024-09-18T12:51:57.207 INFO:tasks.workunit.client.1.smithi161.stdout:8/131: fdatasync d0/d3/d10/f18 0 2024-09-18T12:51:57.211 INFO:tasks.workunit.client.1.smithi161.stdout:2/111: dwrite d0/d1/f7 [0,4194304] 0 2024-09-18T12:51:57.211 INFO:tasks.workunit.client.1.smithi161.stdout:2/112: fdatasync d0/d1/df/f1b 0 2024-09-18T12:51:57.215 INFO:tasks.workunit.client.1.smithi161.stdout:2/113: creat d0/d4/f22 x:0 0 0 2024-09-18T12:51:57.217 INFO:tasks.workunit.client.1.smithi161.stdout:3/141: rename d1/d11 to d1/d2e 0 2024-09-18T12:51:57.217 INFO:tasks.workunit.client.1.smithi161.stdout:2/114: mkdir d0/d4/d17/d23 0 2024-09-18T12:51:57.218 INFO:tasks.workunit.client.1.smithi161.stdout:2/115: read d0/d1/f3 [1725839,109954] 0 2024-09-18T12:51:57.220 INFO:tasks.workunit.client.1.smithi161.stdout:2/116: write d0/d1/f3 [152556,77248] 0 2024-09-18T12:51:57.220 INFO:tasks.workunit.client.1.smithi161.stdout:4/87: truncate d5/f8 1759915 0 2024-09-18T12:51:57.220 INFO:tasks.workunit.client.1.smithi161.stdout:2/117: dread - d0/f13 zero size 2024-09-18T12:51:57.222 INFO:tasks.workunit.client.1.smithi161.stdout:8/132: truncate d0/f16 2421400 0 2024-09-18T12:51:57.223 INFO:tasks.workunit.client.1.smithi161.stdout:8/133: chown d0/d3/df/l29 791396128 1 2024-09-18T12:51:57.223 INFO:tasks.workunit.client.1.smithi161.stdout:3/142: getdents d1/d2e/d14 0 2024-09-18T12:51:57.225 INFO:tasks.workunit.client.1.smithi161.stdout:2/118: creat d0/f24 x:0 0 0 2024-09-18T12:51:57.226 INFO:tasks.workunit.client.1.smithi161.stdout:3/143: rename d1/le to d1/d4/l2f 0 2024-09-18T12:51:57.227 INFO:tasks.workunit.client.1.smithi161.stdout:2/119: mknod d0/d4/c25 0 2024-09-18T12:51:57.228 INFO:tasks.workunit.client.1.smithi161.stdout:3/144: dread - d1/d2e/f20 zero size 2024-09-18T12:51:57.232 INFO:tasks.workunit.client.1.smithi161.stdout:4/88: dwrite d5/fb [0,4194304] 0 2024-09-18T12:51:57.234 INFO:tasks.workunit.client.1.smithi161.stdout:8/134: dwrite d0/d3/df/f25 [0,4194304] 0 2024-09-18T12:51:57.235 INFO:tasks.workunit.client.1.smithi161.stdout:3/145: rename d1/d2e/f20 to d1/d2e/d14/f30 0 2024-09-18T12:51:57.237 INFO:tasks.workunit.client.1.smithi161.stdout:2/120: dread d0/d1/f7 [0,4194304] 0 2024-09-18T12:51:57.238 INFO:tasks.workunit.client.1.smithi161.stdout:8/135: chown d0/d3/d10/d21/l26 3 1 2024-09-18T12:51:57.240 INFO:tasks.workunit.client.1.smithi161.stdout:2/121: truncate d0/d4/d17/f18 641980 0 2024-09-18T12:51:57.240 INFO:tasks.workunit.client.1.smithi161.stdout:3/146: rmdir d1/d2e/d14 39 2024-09-18T12:51:57.241 INFO:tasks.workunit.client.1.smithi161.stdout:3/147: dread - d1/d2e/d24/d1d/f2a zero size 2024-09-18T12:51:57.244 INFO:tasks.workunit.client.1.smithi161.stdout:8/136: mknod d0/d3/c2b 0 2024-09-18T12:51:57.244 INFO:tasks.workunit.client.1.smithi161.stdout:2/122: dread d0/d1/df/f16 [0,4194304] 0 2024-09-18T12:51:57.245 INFO:tasks.workunit.client.1.smithi161.stdout:2/123: write d0/d1/df/f1b [612212,124569] 0 2024-09-18T12:51:57.247 INFO:tasks.workunit.client.1.smithi161.stdout:3/148: write d1/d2e/d24/f1f [3764462,117780] 0 2024-09-18T12:51:57.251 INFO:tasks.workunit.client.1.smithi161.stdout:8/137: mknod d0/d3/d1e/c2c 0 2024-09-18T12:51:57.252 INFO:tasks.workunit.client.1.smithi161.stdout:8/138: write d0/d3/d10/f22 [710068,49296] 0 2024-09-18T12:51:57.253 INFO:tasks.workunit.client.1.smithi161.stdout:2/124: getdents d0/d4/d17/d23 0 2024-09-18T12:51:57.255 INFO:tasks.workunit.client.1.smithi161.stdout:2/125: symlink d0/d1d/l26 0 2024-09-18T12:51:57.256 INFO:tasks.workunit.client.1.smithi161.stdout:8/139: symlink d0/d3/d10/l2d 0 2024-09-18T12:51:57.258 INFO:tasks.workunit.client.1.smithi161.stdout:2/126: mknod d0/d5/c27 0 2024-09-18T12:51:57.259 INFO:tasks.workunit.client.1.smithi161.stdout:8/140: creat d0/f2e x:0 0 0 2024-09-18T12:51:57.262 INFO:tasks.workunit.client.1.smithi161.stdout:3/149: dwrite d1/d2e/d14/f30 [0,4194304] 0 2024-09-18T12:51:57.262 INFO:tasks.workunit.client.1.smithi161.stdout:2/127: rename d0/d4/lb to d0/d5/l28 0 2024-09-18T12:51:57.262 INFO:tasks.workunit.client.1.smithi161.stdout:2/128: dread - d0/d4/f22 zero size 2024-09-18T12:51:57.263 INFO:tasks.workunit.client.1.smithi161.stdout:2/129: chown d0/d1/c19 51671 1 2024-09-18T12:51:57.264 INFO:tasks.workunit.client.1.smithi161.stdout:3/150: creat d1/d2e/d14/d2c/f31 x:0 0 0 2024-09-18T12:51:57.265 INFO:tasks.workunit.client.1.smithi161.stdout:3/151: fsync d1/d2e/f17 0 2024-09-18T12:51:57.267 INFO:tasks.workunit.client.1.smithi161.stdout:3/152: symlink d1/d2e/d14/d2c/l32 0 2024-09-18T12:51:57.269 INFO:tasks.workunit.client.1.smithi161.stdout:3/153: write d1/d2e/d24/f1f [1639958,77336] 0 2024-09-18T12:51:57.269 INFO:tasks.workunit.client.1.smithi161.stdout:2/130: dwrite d0/d1/df/f16 [0,4194304] 0 2024-09-18T12:51:57.281 INFO:tasks.workunit.client.1.smithi161.stdout:2/131: dwrite d0/d1/f3 [0,4194304] 0 2024-09-18T12:51:57.283 INFO:tasks.workunit.client.1.smithi161.stdout:3/154: dwrite d1/f2d [0,4194304] 0 2024-09-18T12:51:57.284 INFO:tasks.workunit.client.1.smithi161.stdout:2/132: chown d0/d4/l1e 95060 1 2024-09-18T12:51:57.286 INFO:tasks.workunit.client.1.smithi161.stdout:2/133: write d0/d4/f22 [577454,19869] 0 2024-09-18T12:51:57.287 INFO:tasks.workunit.client.1.smithi161.stdout:3/155: creat d1/d2e/d14/d2c/f33 x:0 0 0 2024-09-18T12:51:57.287 INFO:tasks.workunit.client.1.smithi161.stdout:2/134: chown d0/d4/f22 3901784 1 2024-09-18T12:51:57.288 INFO:tasks.workunit.client.1.smithi161.stdout:3/156: readlink d1/d4/l23 0 2024-09-18T12:51:57.291 INFO:tasks.workunit.client.1.smithi161.stdout:4/89: dread d5/f8 [0,4194304] 0 2024-09-18T12:51:57.291 INFO:tasks.workunit.client.1.smithi161.stdout:2/135: symlink d0/d5/l29 0 2024-09-18T12:51:57.292 INFO:tasks.workunit.client.1.smithi161.stdout:4/90: dread - d5/f17 zero size 2024-09-18T12:51:57.292 INFO:tasks.workunit.client.1.smithi161.stdout:3/157: symlink d1/d2e/d24/d1d/l34 0 2024-09-18T12:51:57.293 INFO:tasks.workunit.client.1.smithi161.stdout:2/136: creat d0/d4/f2a x:0 0 0 2024-09-18T12:51:57.295 INFO:tasks.workunit.client.1.smithi161.stdout:2/137: write d0/f24 [140317,104066] 0 2024-09-18T12:51:57.296 INFO:tasks.workunit.client.1.smithi161.stdout:3/158: mknod d1/d2e/c35 0 2024-09-18T12:51:57.296 INFO:tasks.workunit.client.1.smithi161.stdout:8/141: write d0/f9 [1138904,9217] 0 2024-09-18T12:51:57.304 INFO:tasks.workunit.client.1.smithi161.stdout:2/138: dwrite d0/f13 [0,4194304] 0 2024-09-18T12:51:57.305 INFO:tasks.workunit.client.1.smithi161.stdout:3/159: dread d1/d2e/d14/f30 [0,4194304] 0 2024-09-18T12:51:57.305 INFO:tasks.workunit.client.1.smithi161.stdout:2/139: dread - d0/d4/f2a zero size 2024-09-18T12:51:57.306 INFO:tasks.workunit.client.1.smithi161.stdout:3/160: write d1/f12 [2470754,45211] 0 2024-09-18T12:51:57.308 INFO:tasks.workunit.client.1.smithi161.stdout:2/140: unlink d0/d4/f22 0 2024-09-18T12:51:57.310 INFO:tasks.workunit.client.1.smithi161.stdout:3/161: mknod d1/d2e/d14/d2c/c36 0 2024-09-18T12:51:57.312 INFO:tasks.workunit.client.1.smithi161.stdout:2/141: symlink d0/d1/l2b 0 2024-09-18T12:51:57.314 INFO:tasks.workunit.client.1.smithi161.stdout:2/142: stat d0/d5/l28 0 2024-09-18T12:51:57.315 INFO:tasks.workunit.client.1.smithi161.stdout:3/162: dread d1/f2d [0,4194304] 0 2024-09-18T12:51:57.316 INFO:tasks.workunit.client.1.smithi161.stdout:8/142: truncate d0/d3/df/f25 622526 0 2024-09-18T12:51:57.316 INFO:tasks.workunit.client.1.smithi161.stdout:9/71: sync 2024-09-18T12:51:57.317 INFO:tasks.workunit.client.1.smithi161.stdout:2/143: write d0/d1/f7 [525764,12175] 0 2024-09-18T12:51:57.318 INFO:tasks.workunit.client.1.smithi161.stdout:2/144: read d0/f13 [1708847,9749] 0 2024-09-18T12:51:57.320 INFO:tasks.workunit.client.1.smithi161.stdout:8/143: dread d0/d3/d10/f18 [0,4194304] 0 2024-09-18T12:51:57.320 INFO:tasks.workunit.client.1.smithi161.stdout:2/145: truncate d0/d1/df/f1b 862350 0 2024-09-18T12:51:57.321 INFO:tasks.workunit.client.1.smithi161.stdout:2/146: dread - d0/d4/f2a zero size 2024-09-18T12:51:57.322 INFO:tasks.workunit.client.1.smithi161.stdout:3/163: link d1/d2e/d24/f1f d1/d2e/f37 0 2024-09-18T12:51:57.323 INFO:tasks.workunit.client.1.smithi161.stdout:3/164: chown d1/d2e/f17 2728203 1 2024-09-18T12:51:57.324 INFO:tasks.workunit.client.1.smithi161.stdout:2/147: rmdir d0 39 2024-09-18T12:51:57.325 INFO:tasks.workunit.client.1.smithi161.stdout:9/72: getdents d0/dc 0 2024-09-18T12:51:57.327 INFO:tasks.workunit.client.1.smithi161.stdout:2/148: chown d0/d1d/l1f 791 1 2024-09-18T12:51:57.329 INFO:tasks.workunit.client.1.smithi161.stdout:3/165: link d1/d2e/f37 d1/d4/f38 0 2024-09-18T12:51:57.330 INFO:tasks.workunit.client.1.smithi161.stdout:8/144: dwrite d0/d3/d10/f22 [0,4194304] 0 2024-09-18T12:51:57.331 INFO:tasks.workunit.client.1.smithi161.stdout:2/149: symlink d0/d5/l2c 0 2024-09-18T12:51:57.335 INFO:tasks.workunit.client.1.smithi161.stdout:2/150: symlink d0/d4/d17/d23/l2d 0 2024-09-18T12:51:57.336 INFO:tasks.workunit.client.1.smithi161.stdout:9/73: dwrite d0/fd [0,4194304] 0 2024-09-18T12:51:57.336 INFO:tasks.workunit.client.1.smithi161.stdout:8/145: write d0/d3/fb [3196585,99643] 0 2024-09-18T12:51:57.338 INFO:tasks.workunit.client.1.smithi161.stdout:3/166: write d1/d2e/d24/f1f [773212,63203] 0 2024-09-18T12:51:57.339 INFO:tasks.workunit.client.1.smithi161.stdout:2/151: fdatasync d0/f13 0 2024-09-18T12:51:57.341 INFO:tasks.workunit.client.1.smithi161.stdout:9/74: creat d0/dc/d12/f15 x:0 0 0 2024-09-18T12:51:57.341 INFO:tasks.workunit.client.1.smithi161.stdout:3/167: truncate d1/d2e/f17 1213373 0 2024-09-18T12:51:57.342 INFO:tasks.workunit.client.1.smithi161.stdout:8/146: rename d0/d3/c2b to d0/d3/df/c2f 0 2024-09-18T12:51:57.342 INFO:tasks.workunit.client.1.smithi161.stdout:8/147: stat d0/d3/fb 0 2024-09-18T12:51:57.343 INFO:tasks.workunit.client.1.smithi161.stdout:2/152: creat d0/d1/f2e x:0 0 0 2024-09-18T12:51:57.347 INFO:tasks.workunit.client.1.smithi161.stdout:3/168: creat d1/d4/f39 x:0 0 0 2024-09-18T12:51:57.347 INFO:tasks.workunit.client.1.smithi161.stdout:8/148: creat d0/d3/d10/d21/f30 x:0 0 0 2024-09-18T12:51:57.348 INFO:tasks.workunit.client.1.smithi161.stdout:3/169: fdatasync d1/d4/f39 0 2024-09-18T12:51:57.412 INFO:tasks.workunit.client.1.smithi161.stdout:2/153: getdents d0/d5 0 2024-09-18T12:51:57.412 INFO:tasks.workunit.client.1.smithi161.stdout:8/149: fdatasync d0/d3/df/f25 0 2024-09-18T12:51:57.412 INFO:tasks.workunit.client.1.smithi161.stdout:9/75: rename d0/dc to d0/d16 0 2024-09-18T12:51:57.413 INFO:tasks.workunit.client.1.smithi161.stdout:8/150: readlink d0/d3/ld 0 2024-09-18T12:51:57.413 INFO:tasks.workunit.client.1.smithi161.stdout:8/151: chown d0/d3/d10/f18 0 1 2024-09-18T12:51:57.417 INFO:tasks.workunit.client.1.smithi161.stdout:2/154: dwrite d0/d1/f7 [0,4194304] 0 2024-09-18T12:51:57.418 INFO:tasks.workunit.client.1.smithi161.stdout:2/155: read d0/d1/f3 [763760,60775] 0 2024-09-18T12:51:57.477 INFO:tasks.workunit.client.1.smithi161.stdout:6/62: sync 2024-09-18T12:51:57.477 INFO:tasks.workunit.client.1.smithi161.stdout:1/22: sync 2024-09-18T12:51:57.504 INFO:tasks.workunit.client.1.smithi161.stdout:0/70: sync 2024-09-18T12:51:57.504 INFO:tasks.workunit.client.1.smithi161.stdout:5/67: sync 2024-09-18T12:51:57.504 INFO:tasks.workunit.client.1.smithi161.stdout:7/81: sync 2024-09-18T12:51:57.504 INFO:tasks.workunit.client.1.smithi161.stdout:4/91: sync 2024-09-18T12:51:57.505 INFO:tasks.workunit.client.1.smithi161.stdout:7/82: write d3/fa [1927335,72552] 0 2024-09-18T12:51:57.506 INFO:tasks.workunit.client.1.smithi161.stdout:0/71: dread df/f15 [0,4194304] 0 2024-09-18T12:51:57.595 INFO:tasks.workunit.client.1.smithi161.stdout:5/68: sync 2024-09-18T12:51:57.598 INFO:tasks.workunit.client.1.smithi161.stdout:5/69: dread d3/fd [4194304,4194304] 0 2024-09-18T12:51:57.669 INFO:tasks.workunit.client.1.smithi161.stdout:9/76: creat d0/db/f17 x:0 0 0 2024-09-18T12:51:57.670 INFO:tasks.workunit.client.1.smithi161.stdout:8/152: mknod d0/d3/df/c31 0 2024-09-18T12:51:57.670 INFO:tasks.workunit.client.1.smithi161.stdout:9/77: write d0/f3 [3017361,63120] 0 2024-09-18T12:51:57.671 INFO:tasks.workunit.client.1.smithi161.stdout:2/156: rename d0/d1/lc to d0/d4/d17/l2f 0 2024-09-18T12:51:57.674 INFO:tasks.workunit.client.1.smithi161.stdout:6/63: creat d4/db/fe x:0 0 0 2024-09-18T12:51:57.674 INFO:tasks.workunit.client.1.smithi161.stdout:2/157: chown d0/d1/l21 718965 1 2024-09-18T12:51:57.675 INFO:tasks.workunit.client.1.smithi161.stdout:2/158: chown d0/f24 982 1 2024-09-18T12:51:57.676 INFO:tasks.workunit.client.1.smithi161.stdout:7/83: mknod d3/d8/c12 0 2024-09-18T12:51:57.676 INFO:tasks.workunit.client.1.smithi161.stdout:6/64: truncate d4/db/fc 133447 0 2024-09-18T12:51:57.677 INFO:tasks.workunit.client.1.smithi161.stdout:9/78: dread d0/f3 [0,4194304] 0 2024-09-18T12:51:57.677 INFO:tasks.workunit.client.1.smithi161.stdout:5/70: creat d3/d9/f12 x:0 0 0 2024-09-18T12:51:57.678 INFO:tasks.workunit.client.1.smithi161.stdout:8/153: dwrite d0/f27 [4194304,4194304] 0 2024-09-18T12:51:57.678 INFO:tasks.workunit.client.1.smithi161.stdout:3/170: rmdir d1/d2e/d24/d27 0 2024-09-18T12:51:57.679 INFO:tasks.workunit.client.1.smithi161.stdout:5/71: chown d3/d9/f11 324984572 1 2024-09-18T12:51:57.680 INFO:tasks.workunit.client.1.smithi161.stdout:5/72: write d3/fd [5093019,61961] 0 2024-09-18T12:51:57.686 INFO:tasks.workunit.client.1.smithi161.stdout:4/92: rename c3 to d5/d14/c1c 0 2024-09-18T12:51:57.686 INFO:tasks.workunit.client.1.smithi161.stdout:1/23: creat d1/f5 x:0 0 0 2024-09-18T12:51:57.688 INFO:tasks.workunit.client.1.smithi161.stdout:1/24: dread - d1/f5 zero size 2024-09-18T12:51:57.689 INFO:tasks.workunit.client.1.smithi161.stdout:7/84: mknod d3/c13 0 2024-09-18T12:51:57.690 INFO:tasks.workunit.client.1.smithi161.stdout:9/79: mkdir d0/db/d18 0 2024-09-18T12:51:57.691 INFO:tasks.workunit.client.1.smithi161.stdout:3/171: dwrite d1/d4/f39 [0,4194304] 0 2024-09-18T12:51:57.692 INFO:tasks.workunit.client.1.smithi161.stdout:8/154: creat d0/d3/d10/d21/f32 x:0 0 0 2024-09-18T12:51:57.693 INFO:tasks.workunit.client.1.smithi161.stdout:3/172: write d1/d4/f22 [4069375,45176] 0 2024-09-18T12:51:57.696 INFO:tasks.workunit.client.1.smithi161.stdout:4/93: dwrite d5/fe [0,4194304] 0 2024-09-18T12:51:57.697 INFO:tasks.workunit.client.1.smithi161.stdout:0/72: rename c9 to df/c18 0 2024-09-18T12:51:57.699 INFO:tasks.workunit.client.1.smithi161.stdout:1/25: mkdir d1/d6 0 2024-09-18T12:51:57.703 INFO:tasks.workunit.client.1.smithi161.stdout:6/65: link d4/db/fe d4/ff 0 2024-09-18T12:51:57.705 INFO:tasks.workunit.client.1.smithi161.stdout:8/155: rename d0/d3/c1d to d0/d3/c33 0 2024-09-18T12:51:57.705 INFO:tasks.workunit.client.1.smithi161.stdout:3/173: dwrite d1/d2e/d24/d1d/f2a [0,4194304] 0 2024-09-18T12:51:57.707 INFO:tasks.workunit.client.1.smithi161.stdout:3/174: write d1/f12 [1568,16327] 0 2024-09-18T12:51:57.707 INFO:tasks.workunit.client.1.smithi161.stdout:8/156: write d0/d3/d10/f23 [2020848,109973] 0 2024-09-18T12:51:57.708 INFO:tasks.workunit.client.1.smithi161.stdout:8/157: fsync d0/f12 0 2024-09-18T12:51:57.708 INFO:tasks.workunit.client.1.smithi161.stdout:5/73: rename d3/d9/f11 to d3/f13 0 2024-09-18T12:51:57.710 INFO:tasks.workunit.client.1.smithi161.stdout:5/74: write d3/d9/f12 [542739,56808] 0 2024-09-18T12:51:57.717 INFO:tasks.workunit.client.1.smithi161.stdout:6/66: creat d4/f10 x:0 0 0 2024-09-18T12:51:57.718 INFO:tasks.workunit.client.1.smithi161.stdout:4/94: rename d5/c10 to d5/c1d 0 2024-09-18T12:51:57.721 INFO:tasks.workunit.client.1.smithi161.stdout:2/159: getdents d0/d1d 0 2024-09-18T12:51:57.723 INFO:tasks.workunit.client.1.smithi161.stdout:2/160: write d0/d1/f7 [1812732,1694] 0 2024-09-18T12:51:57.724 INFO:tasks.workunit.client.1.smithi161.stdout:2/161: write d0/f13 [403081,183] 0 2024-09-18T12:51:57.726 INFO:tasks.workunit.client.1.smithi161.stdout:2/162: write d0/d1/df/f16 [3051039,62480] 0 2024-09-18T12:51:57.727 INFO:tasks.workunit.client.1.smithi161.stdout:3/175: rename d1/d4/f8 to d1/d2e/d24/f3a 0 2024-09-18T12:51:57.729 INFO:tasks.workunit.client.1.smithi161.stdout:0/73: link df/f12 df/f19 0 2024-09-18T12:51:57.731 INFO:tasks.workunit.client.1.smithi161.stdout:5/75: unlink d3/d8/c10 0 2024-09-18T12:51:57.731 INFO:tasks.workunit.client.1.smithi161.stdout:3/176: dread d1/f12 [0,4194304] 0 2024-09-18T12:51:57.731 INFO:tasks.workunit.client.1.smithi161.stdout:5/76: write d3/fd [8718733,35986] 0 2024-09-18T12:51:57.732 INFO:tasks.workunit.client.1.smithi161.stdout:3/177: write d1/f12 [3253134,10376] 0 2024-09-18T12:51:57.733 INFO:tasks.workunit.client.1.smithi161.stdout:1/26: creat d1/d6/f7 x:0 0 0 2024-09-18T12:51:57.733 INFO:tasks.workunit.client.1.smithi161.stdout:5/77: fsync d3/fd 0 2024-09-18T12:51:57.736 INFO:tasks.workunit.client.1.smithi161.stdout:6/67: write d4/ff [484885,74235] 0 2024-09-18T12:51:57.738 INFO:tasks.workunit.client.1.smithi161.stdout:4/95: fsync d5/f8 0 2024-09-18T12:51:57.748 INFO:tasks.workunit.client.1.smithi161.stdout:5/78: mkdir d3/d14 0 2024-09-18T12:51:57.748 INFO:tasks.workunit.client.1.smithi161.stdout:5/79: chown d3/d8/cf 70 1 2024-09-18T12:51:57.750 INFO:tasks.workunit.client.1.smithi161.stdout:6/68: creat d4/db/f11 x:0 0 0 2024-09-18T12:51:57.751 INFO:tasks.workunit.client.1.smithi161.stdout:6/69: truncate d4/f10 297506 0 2024-09-18T12:51:57.752 INFO:tasks.workunit.client.1.smithi161.stdout:6/70: read d4/ff [381484,113648] 0 2024-09-18T12:51:57.753 INFO:tasks.workunit.client.1.smithi161.stdout:6/71: dread - d4/db/f11 zero size 2024-09-18T12:51:57.753 INFO:tasks.workunit.client.1.smithi161.stdout:4/96: creat d5/d14/f1e x:0 0 0 2024-09-18T12:51:57.754 INFO:tasks.workunit.client.1.smithi161.stdout:6/72: write d4/f10 [507475,1146] 0 2024-09-18T12:51:57.754 INFO:tasks.workunit.client.1.smithi161.stdout:6/73: readlink d4/db/ld 0 2024-09-18T12:51:57.757 INFO:tasks.workunit.client.1.smithi161.stdout:3/178: symlink d1/l3b 0 2024-09-18T12:51:57.759 INFO:tasks.workunit.client.1.smithi161.stdout:3/179: fdatasync d1/d2e/d24/d1d/f2b 0 2024-09-18T12:51:57.759 INFO:tasks.workunit.client.1.smithi161.stdout:1/27: link d1/f5 d1/d6/f8 0 2024-09-18T12:51:57.762 INFO:tasks.workunit.client.1.smithi161.stdout:6/74: dwrite d4/db/fe [0,4194304] 0 2024-09-18T12:51:57.762 INFO:tasks.workunit.client.1.smithi161.stdout:4/97: unlink d5/l11 0 2024-09-18T12:51:57.764 INFO:tasks.workunit.client.1.smithi161.stdout:6/75: read d4/ff [1865303,45040] 0 2024-09-18T12:51:57.764 INFO:tasks.workunit.client.1.smithi161.stdout:9/80: sync 2024-09-18T12:51:57.765 INFO:tasks.workunit.client.1.smithi161.stdout:9/81: stat d0/db/f17 0 2024-09-18T12:51:57.766 INFO:tasks.workunit.client.1.smithi161.stdout:2/163: creat d0/f30 x:0 0 0 2024-09-18T12:51:57.766 INFO:tasks.workunit.client.1.smithi161.stdout:9/82: truncate d0/f11 844526 0 2024-09-18T12:51:57.767 INFO:tasks.workunit.client.1.smithi161.stdout:3/180: dwrite d1/d4/f39 [0,4194304] 0 2024-09-18T12:51:57.772 INFO:tasks.workunit.client.1.smithi161.stdout:1/28: creat d1/d6/f9 x:0 0 0 2024-09-18T12:51:57.779 INFO:tasks.workunit.client.1.smithi161.stdout:4/98: chown d5/l6 11279 1 2024-09-18T12:51:57.779 INFO:tasks.workunit.client.1.smithi161.stdout:4/99: chown d5/f16 333 1 2024-09-18T12:51:57.780 INFO:tasks.workunit.client.1.smithi161.stdout:6/76: fdatasync d4/fa 0 2024-09-18T12:51:57.781 INFO:tasks.workunit.client.1.smithi161.stdout:6/77: fdatasync d4/fa 0 2024-09-18T12:51:57.782 INFO:tasks.workunit.client.1.smithi161.stdout:2/164: write d0/d1/f3 [2844307,88647] 0 2024-09-18T12:51:57.783 INFO:tasks.workunit.client.1.smithi161.stdout:6/78: write d4/f10 [188669,27897] 0 2024-09-18T12:51:57.784 INFO:tasks.workunit.client.1.smithi161.stdout:9/83: creat d0/d16/d12/f19 x:0 0 0 2024-09-18T12:51:57.786 INFO:tasks.workunit.client.1.smithi161.stdout:4/100: dread d5/fe [0,4194304] 0 2024-09-18T12:51:57.786 INFO:tasks.workunit.client.1.smithi161.stdout:1/29: mkdir d1/da 0 2024-09-18T12:51:57.790 INFO:tasks.workunit.client.1.smithi161.stdout:2/165: dwrite d0/d1/df/f16 [0,4194304] 0 2024-09-18T12:51:57.792 INFO:tasks.workunit.client.1.smithi161.stdout:1/30: dread f0 [0,4194304] 0 2024-09-18T12:51:57.792 INFO:tasks.workunit.client.1.smithi161.stdout:1/31: chown d1/d6 89611641 1 2024-09-18T12:51:57.800 INFO:tasks.workunit.client.1.smithi161.stdout:9/84: dread d0/fa [0,4194304] 0 2024-09-18T12:51:57.802 INFO:tasks.workunit.client.1.smithi161.stdout:2/166: mknod d0/d5/c31 0 2024-09-18T12:51:57.803 INFO:tasks.workunit.client.1.smithi161.stdout:2/167: chown d0/d4/d17 1115 1 2024-09-18T12:51:57.804 INFO:tasks.workunit.client.1.smithi161.stdout:1/32: creat d1/d6/fb x:0 0 0 2024-09-18T12:51:57.804 INFO:tasks.workunit.client.1.smithi161.stdout:1/33: fdatasync f0 0 2024-09-18T12:51:57.804 INFO:tasks.workunit.client.1.smithi161.stdout:1/34: dread - d1/d6/fb zero size 2024-09-18T12:51:57.807 INFO:tasks.workunit.client.1.smithi161.stdout:3/181: link d1/d2e/d24/d1d/l34 d1/d2e/d14/l3c 0 2024-09-18T12:51:57.807 INFO:tasks.workunit.client.1.smithi161.stdout:3/182: fsync d1/d2e/d24/d1d/f25 0 2024-09-18T12:51:57.808 INFO:tasks.workunit.client.1.smithi161.stdout:9/85: symlink d0/d16/d12/l1a 0 2024-09-18T12:51:57.811 INFO:tasks.workunit.client.1.smithi161.stdout:9/86: dread - d0/d16/d12/f15 zero size 2024-09-18T12:51:57.812 INFO:tasks.workunit.client.1.smithi161.stdout:9/87: write d0/f11 [621689,79402] 0 2024-09-18T12:51:57.815 INFO:tasks.workunit.client.1.smithi161.stdout:3/183: dwrite d1/d2e/f37 [0,4194304] 0 2024-09-18T12:51:57.866 INFO:tasks.workunit.client.1.smithi161.stdout:9/88: readlink d0/l8 0 2024-09-18T12:51:57.866 INFO:tasks.workunit.client.1.smithi161.stdout:9/89: read - d0/ff zero size 2024-09-18T12:51:57.868 INFO:tasks.workunit.client.1.smithi161.stdout:9/90: creat d0/d16/d12/f1b x:0 0 0 2024-09-18T12:51:57.871 INFO:tasks.workunit.client.1.smithi161.stdout:9/91: link d0/l8 d0/l1c 0 2024-09-18T12:51:57.878 INFO:tasks.workunit.client.1.smithi161.stdout:1/35: sync 2024-09-18T12:51:57.878 INFO:tasks.workunit.client.1.smithi161.stdout:1/36: dread - d1/d6/fb zero size 2024-09-18T12:51:57.883 INFO:tasks.workunit.client.1.smithi161.stdout:1/37: dwrite f0 [0,4194304] 0 2024-09-18T12:51:57.887 INFO:tasks.workunit.client.1.smithi161.stdout:1/38: link d1/d6/f7 d1/fc 0 2024-09-18T12:51:57.889 INFO:tasks.workunit.client.1.smithi161.stdout:1/39: mknod d1/da/cd 0 2024-09-18T12:51:57.930 INFO:tasks.workunit.client.1.smithi161.stdout:9/92: sync 2024-09-18T12:51:57.931 INFO:tasks.workunit.client.1.smithi161.stdout:9/93: rmdir d0/d16/d12 39 2024-09-18T12:51:57.933 INFO:tasks.workunit.client.1.smithi161.stdout:9/94: dread - d0/d16/d12/f19 zero size 2024-09-18T12:51:57.934 INFO:tasks.workunit.client.1.smithi161.stdout:9/95: unlink d0/le 0 2024-09-18T12:51:57.936 INFO:tasks.workunit.client.1.smithi161.stdout:9/96: mknod d0/db/c1d 0 2024-09-18T12:51:57.938 INFO:tasks.workunit.client.1.smithi161.stdout:9/97: mknod d0/d16/c1e 0 2024-09-18T12:51:57.939 INFO:tasks.workunit.client.1.smithi161.stdout:9/98: creat d0/f1f x:0 0 0 2024-09-18T12:51:57.940 INFO:tasks.workunit.client.1.smithi161.stdout:9/99: read d0/f3 [2881379,59560] 0 2024-09-18T12:51:57.942 INFO:tasks.workunit.client.1.smithi161.stdout:9/100: mkdir d0/d20 0 2024-09-18T12:51:57.942 INFO:tasks.workunit.client.1.smithi161.stdout:9/101: truncate d0/f11 1215222 0 2024-09-18T12:51:57.943 INFO:tasks.workunit.client.1.smithi161.stdout:8/158: rename d0/d3/df to d0/d3/d1e/d34 0 2024-09-18T12:51:57.944 INFO:tasks.workunit.client.1.smithi161.stdout:8/159: dread - d0/d3/d10/d21/f30 zero size 2024-09-18T12:51:57.945 INFO:tasks.workunit.client.1.smithi161.stdout:0/74: rename f5 to df/f1a 0 2024-09-18T12:51:57.947 INFO:tasks.workunit.client.1.smithi161.stdout:8/160: creat d0/d3/d1e/d34/f35 x:0 0 0 2024-09-18T12:51:57.949 INFO:tasks.workunit.client.1.smithi161.stdout:4/101: rename d5/c1b to d5/d14/c1f 0 2024-09-18T12:51:57.950 INFO:tasks.workunit.client.1.smithi161.stdout:8/161: symlink d0/d3/d1e/l36 0 2024-09-18T12:51:57.951 INFO:tasks.workunit.client.1.smithi161.stdout:0/75: truncate fc 2371548 0 2024-09-18T12:51:57.952 INFO:tasks.workunit.client.1.smithi161.stdout:0/76: rmdir df 39 2024-09-18T12:51:57.957 INFO:tasks.workunit.client.1.smithi161.stdout:4/102: dwrite d5/f15 [0,4194304] 0 2024-09-18T12:51:57.957 INFO:tasks.workunit.client.1.smithi161.stdout:2/168: rename d0/d4/d17 to d0/d32 0 2024-09-18T12:51:57.959 INFO:tasks.workunit.client.1.smithi161.stdout:0/77: unlink df/f16 0 2024-09-18T12:51:57.960 INFO:tasks.workunit.client.1.smithi161.stdout:0/78: chown df/c10 2 1 2024-09-18T12:51:57.961 INFO:tasks.workunit.client.1.smithi161.stdout:4/103: rename d5/fb to d5/f20 0 2024-09-18T12:51:57.963 INFO:tasks.workunit.client.1.smithi161.stdout:4/104: write d5/ff [2085160,104252] 0 2024-09-18T12:51:57.965 INFO:tasks.workunit.client.1.smithi161.stdout:2/169: dwrite d0/d1/df/f1b [0,4194304] 0 2024-09-18T12:51:57.975 INFO:tasks.workunit.client.1.smithi161.stdout:0/79: dwrite df/f12 [0,4194304] 0 2024-09-18T12:51:57.978 INFO:tasks.workunit.client.1.smithi161.stdout:0/80: creat df/f1b x:0 0 0 2024-09-18T12:51:57.980 INFO:tasks.workunit.client.1.smithi161.stdout:0/81: fdatasync df/f15 0 2024-09-18T12:51:57.980 INFO:tasks.workunit.client.1.smithi161.stdout:0/82: truncate f3 8647060 0 2024-09-18T12:51:57.982 INFO:tasks.workunit.client.1.smithi161.stdout:0/83: write df/f12 [1992509,46591] 0 2024-09-18T12:51:57.985 INFO:tasks.workunit.client.1.smithi161.stdout:0/84: creat df/f1c x:0 0 0 2024-09-18T12:51:57.986 INFO:tasks.workunit.client.1.smithi161.stdout:0/85: symlink df/l1d 0 2024-09-18T12:51:57.987 INFO:tasks.workunit.client.1.smithi161.stdout:7/85: write d3/f6 [339053,12883] 0 2024-09-18T12:51:57.990 INFO:tasks.workunit.client.1.smithi161.stdout:6/79: getdents d4 0 2024-09-18T12:51:57.991 INFO:tasks.workunit.client.1.smithi161.stdout:7/86: write d3/d8/fd [2575797,70664] 0 2024-09-18T12:51:57.992 INFO:tasks.workunit.client.1.smithi161.stdout:6/80: chown d4/ff 215 1 2024-09-18T12:51:57.996 INFO:tasks.workunit.client.1.smithi161.stdout:6/81: symlink d4/db/l12 0 2024-09-18T12:51:57.997 INFO:tasks.workunit.client.1.smithi161.stdout:3/184: dwrite d1/d2e/d24/d1d/f2a [4194304,4194304] 0 2024-09-18T12:51:57.998 INFO:tasks.workunit.client.1.smithi161.stdout:0/86: dread f3 [0,4194304] 0 2024-09-18T12:51:58.006 INFO:tasks.workunit.client.1.smithi161.stdout:7/87: dwrite d3/f6 [0,4194304] 0 2024-09-18T12:51:58.006 INFO:tasks.workunit.client.1.smithi161.stdout:3/185: rename d1/d4 to d1/d2e/d3d 0 2024-09-18T12:51:58.011 INFO:tasks.workunit.client.1.smithi161.stdout:5/80: truncate d3/d9/f12 567268 0 2024-09-18T12:51:58.012 INFO:tasks.workunit.client.1.smithi161.stdout:0/87: dread df/f1a [0,4194304] 0 2024-09-18T12:51:58.013 INFO:tasks.workunit.client.1.smithi161.stdout:5/81: dread - d3/f13 zero size 2024-09-18T12:51:58.014 INFO:tasks.workunit.client.1.smithi161.stdout:6/82: dwrite d4/ff [0,4194304] 0 2024-09-18T12:51:58.015 INFO:tasks.workunit.client.1.smithi161.stdout:9/102: sync 2024-09-18T12:51:58.019 INFO:tasks.workunit.client.1.smithi161.stdout:6/83: rename d4/db/fe to d4/db/f13 0 2024-09-18T12:51:58.024 INFO:tasks.workunit.client.1.smithi161.stdout:9/103: dwrite d0/d16/d12/f1b [0,4194304] 0 2024-09-18T12:51:58.026 INFO:tasks.workunit.client.1.smithi161.stdout:9/104: dread - d0/d16/d12/f19 zero size 2024-09-18T12:51:58.027 INFO:tasks.workunit.client.1.smithi161.stdout:6/84: dread d4/db/f13 [0,4194304] 0 2024-09-18T12:51:58.028 INFO:tasks.workunit.client.1.smithi161.stdout:6/85: chown d4/db/ld 0 1 2024-09-18T12:51:58.029 INFO:tasks.workunit.client.1.smithi161.stdout:2/170: chown d0/d5/l2c 86929 1 2024-09-18T12:51:58.030 INFO:tasks.workunit.client.1.smithi161.stdout:6/86: unlink l2 0 2024-09-18T12:51:58.032 INFO:tasks.workunit.client.1.smithi161.stdout:6/87: truncate d4/fa 5096264 0 2024-09-18T12:51:58.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:57 smithi045 ceph-mon[28315]: pgmap v21: 65 pgs: 65 active+clean; 304 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 20 MiB/s wr, 411 op/s 2024-09-18T12:51:58.035 INFO:tasks.workunit.client.1.smithi161.stdout:1/40: getdents d1 0 2024-09-18T12:51:58.037 INFO:tasks.workunit.client.1.smithi161.stdout:1/41: chown f0 6925 1 2024-09-18T12:51:58.037 INFO:tasks.workunit.client.1.smithi161.stdout:6/88: creat d4/db/f14 x:0 0 0 2024-09-18T12:51:58.038 INFO:tasks.workunit.client.1.smithi161.stdout:9/105: dwrite d0/f11 [0,4194304] 0 2024-09-18T12:51:58.040 INFO:tasks.workunit.client.1.smithi161.stdout:1/42: dread - d1/d6/f8 zero size 2024-09-18T12:51:58.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:57 smithi161 ceph-mon[35784]: pgmap v21: 65 pgs: 65 active+clean; 304 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 20 MiB/s wr, 411 op/s 2024-09-18T12:51:58.045 INFO:tasks.workunit.client.1.smithi161.stdout:2/171: dwrite d0/d1/f2e [0,4194304] 0 2024-09-18T12:51:58.045 INFO:tasks.workunit.client.1.smithi161.stdout:8/162: write d0/f2a [1354048,65406] 0 2024-09-18T12:51:58.050 INFO:tasks.workunit.client.1.smithi161.stdout:1/43: creat d1/d6/fe x:0 0 0 2024-09-18T12:51:58.052 INFO:tasks.workunit.client.1.smithi161.stdout:8/163: creat d0/d3/d10/d21/f37 x:0 0 0 2024-09-18T12:51:58.053 INFO:tasks.workunit.client.1.smithi161.stdout:6/89: getdents d4 0 2024-09-18T12:51:58.053 INFO:tasks.workunit.client.1.smithi161.stdout:9/106: creat d0/db/d18/f21 x:0 0 0 2024-09-18T12:51:58.055 INFO:tasks.workunit.client.1.smithi161.stdout:4/105: dwrite d5/f8 [0,4194304] 0 2024-09-18T12:51:58.057 INFO:tasks.workunit.client.1.smithi161.stdout:4/106: readlink d5/la 0 2024-09-18T12:51:58.059 INFO:tasks.workunit.client.1.smithi161.stdout:8/164: mkdir d0/d38 0 2024-09-18T12:51:58.061 INFO:tasks.workunit.client.1.smithi161.stdout:7/88: truncate d3/d8/fd 1069673 0 2024-09-18T12:51:58.062 INFO:tasks.workunit.client.1.smithi161.stdout:2/172: getdents d0/d1 0 2024-09-18T12:51:58.063 INFO:tasks.workunit.client.1.smithi161.stdout:0/88: truncate df/f19 1463908 0 2024-09-18T12:51:58.063 INFO:tasks.workunit.client.1.smithi161.stdout:4/107: creat d5/f21 x:0 0 0 2024-09-18T12:51:58.065 INFO:tasks.workunit.client.1.smithi161.stdout:8/165: rename d0/f2e to d0/d3/d1e/d34/f39 0 2024-09-18T12:51:58.066 INFO:tasks.workunit.client.1.smithi161.stdout:6/90: link d4/l9 d4/db/l15 0 2024-09-18T12:51:58.067 INFO:tasks.workunit.client.1.smithi161.stdout:3/186: dwrite d1/f12 [0,4194304] 0 2024-09-18T12:51:58.070 INFO:tasks.workunit.client.1.smithi161.stdout:1/44: write d1/d6/f8 [394875,127571] 0 2024-09-18T12:51:58.070 INFO:tasks.workunit.client.1.smithi161.stdout:4/108: creat d5/f22 x:0 0 0 2024-09-18T12:51:58.073 INFO:tasks.workunit.client.1.smithi161.stdout:8/166: creat d0/d3/d10/d21/f3a x:0 0 0 2024-09-18T12:51:58.075 INFO:tasks.workunit.client.1.smithi161.stdout:6/91: unlink d4/db/l15 0 2024-09-18T12:51:58.077 INFO:tasks.workunit.client.1.smithi161.stdout:1/45: fsync d1/fc 0 2024-09-18T12:51:58.079 INFO:tasks.workunit.client.1.smithi161.stdout:4/109: creat d5/d14/f23 x:0 0 0 2024-09-18T12:51:58.079 INFO:tasks.workunit.client.1.smithi161.stdout:8/167: read - d0/d3/d1e/d34/f35 zero size 2024-09-18T12:51:58.079 INFO:tasks.workunit.client.1.smithi161.stdout:6/92: dread - d4/db/f14 zero size 2024-09-18T12:51:58.079 INFO:tasks.workunit.client.1.smithi161.stdout:2/173: dwrite d0/d1/f3 [0,4194304] 0 2024-09-18T12:51:58.081 INFO:tasks.workunit.client.1.smithi161.stdout:0/89: getdents df 0 2024-09-18T12:51:58.081 INFO:tasks.workunit.client.1.smithi161.stdout:7/89: dwrite d3/f4 [0,4194304] 0 2024-09-18T12:51:58.082 INFO:tasks.workunit.client.1.smithi161.stdout:1/46: dread - d1/d6/f9 zero size 2024-09-18T12:51:58.082 INFO:tasks.workunit.client.1.smithi161.stdout:6/93: fsync d4/fa 0 2024-09-18T12:51:58.085 INFO:tasks.workunit.client.1.smithi161.stdout:8/168: readlink d0/d3/d10/l11 0 2024-09-18T12:51:58.085 INFO:tasks.workunit.client.1.smithi161.stdout:7/90: read d3/fa [207839,71401] 0 2024-09-18T12:51:58.088 INFO:tasks.workunit.client.1.smithi161.stdout:7/91: dread - d3/f11 zero size 2024-09-18T12:51:58.088 INFO:tasks.workunit.client.1.smithi161.stdout:8/169: write d0/f16 [2329118,93911] 0 2024-09-18T12:51:58.092 INFO:tasks.workunit.client.1.smithi161.stdout:3/187: dwrite d1/f2d [0,4194304] 0 2024-09-18T12:51:58.092 INFO:tasks.workunit.client.1.smithi161.stdout:4/110: symlink d5/l24 0 2024-09-18T12:51:58.092 INFO:tasks.workunit.client.1.smithi161.stdout:0/90: symlink df/l1e 0 2024-09-18T12:51:58.093 INFO:tasks.workunit.client.1.smithi161.stdout:1/47: creat d1/ff x:0 0 0 2024-09-18T12:51:58.094 INFO:tasks.workunit.client.1.smithi161.stdout:7/92: dread d3/f6 [0,4194304] 0 2024-09-18T12:51:58.094 INFO:tasks.workunit.client.1.smithi161.stdout:7/93: dread - d3/f11 zero size 2024-09-18T12:51:58.095 INFO:tasks.workunit.client.1.smithi161.stdout:6/94: mkdir d4/db/d16 0 2024-09-18T12:51:58.095 INFO:tasks.workunit.client.1.smithi161.stdout:1/48: truncate d1/ff 599046 0 2024-09-18T12:51:58.096 INFO:tasks.workunit.client.1.smithi161.stdout:7/94: chown d3/d8 50539550 1 2024-09-18T12:51:58.098 INFO:tasks.workunit.client.1.smithi161.stdout:8/170: symlink d0/d3/d10/d21/l3b 0 2024-09-18T12:51:58.099 INFO:tasks.workunit.client.1.smithi161.stdout:4/111: unlink d5/f15 0 2024-09-18T12:51:58.100 INFO:tasks.workunit.client.1.smithi161.stdout:3/188: dread d1/d2e/d3d/f39 [0,4194304] 0 2024-09-18T12:51:58.102 INFO:tasks.workunit.client.1.smithi161.stdout:6/95: creat d4/f17 x:0 0 0 2024-09-18T12:51:58.103 INFO:tasks.workunit.client.1.smithi161.stdout:1/49: creat d1/d6/f10 x:0 0 0 2024-09-18T12:51:58.103 INFO:tasks.workunit.client.1.smithi161.stdout:2/174: getdents d0/d1d 0 2024-09-18T12:51:58.104 INFO:tasks.workunit.client.1.smithi161.stdout:1/50: stat d1/d6/f9 0 2024-09-18T12:51:58.104 INFO:tasks.workunit.client.1.smithi161.stdout:1/51: chown f0 58187 1 2024-09-18T12:51:58.105 INFO:tasks.workunit.client.1.smithi161.stdout:1/52: chown d1/da/cd 29 1 2024-09-18T12:51:58.105 INFO:tasks.workunit.client.1.smithi161.stdout:8/171: unlink d0/f27 0 2024-09-18T12:51:58.106 INFO:tasks.workunit.client.1.smithi161.stdout:4/112: symlink d5/l25 0 2024-09-18T12:51:58.106 INFO:tasks.workunit.client.1.smithi161.stdout:8/172: fdatasync d0/f9 0 2024-09-18T12:51:58.107 INFO:tasks.workunit.client.1.smithi161.stdout:0/91: rename df/f12 to df/f1f 0 2024-09-18T12:51:58.107 INFO:tasks.workunit.client.1.smithi161.stdout:4/113: write d5/f21 [583152,71327] 0 2024-09-18T12:51:58.108 INFO:tasks.workunit.client.1.smithi161.stdout:3/189: symlink d1/d2e/d24/d1d/l3e 0 2024-09-18T12:51:58.108 INFO:tasks.workunit.client.1.smithi161.stdout:2/175: mknod d0/d32/d23/c33 0 2024-09-18T12:51:58.109 INFO:tasks.workunit.client.1.smithi161.stdout:1/53: truncate d1/d6/f7 61089 0 2024-09-18T12:51:58.110 INFO:tasks.workunit.client.1.smithi161.stdout:2/176: write d0/d1/f3 [496055,85749] 0 2024-09-18T12:51:58.110 INFO:tasks.workunit.client.1.smithi161.stdout:8/173: dread d0/d3/d10/f18 [0,4194304] 0 2024-09-18T12:51:58.110 INFO:tasks.workunit.client.1.smithi161.stdout:0/92: fdatasync fd 0 2024-09-18T12:51:58.111 INFO:tasks.workunit.client.1.smithi161.stdout:6/96: mkdir d4/db/d16/d18 0 2024-09-18T12:51:58.112 INFO:tasks.workunit.client.1.smithi161.stdout:4/114: mknod d5/c26 0 2024-09-18T12:51:58.112 INFO:tasks.workunit.client.1.smithi161.stdout:1/54: truncate d1/d6/fb 85114 0 2024-09-18T12:51:58.115 INFO:tasks.workunit.client.1.smithi161.stdout:2/177: creat d0/d1/df/f34 x:0 0 0 2024-09-18T12:51:58.116 INFO:tasks.workunit.client.1.smithi161.stdout:2/178: stat d0/d1/df/f34 0 2024-09-18T12:51:58.116 INFO:tasks.workunit.client.1.smithi161.stdout:3/190: symlink d1/d2e/l3f 0 2024-09-18T12:51:58.118 INFO:tasks.workunit.client.1.smithi161.stdout:8/174: dread d0/d3/fb [0,4194304] 0 2024-09-18T12:51:58.118 INFO:tasks.workunit.client.1.smithi161.stdout:6/97: creat d4/f19 x:0 0 0 2024-09-18T12:51:58.119 INFO:tasks.workunit.client.1.smithi161.stdout:1/55: dwrite f0 [0,4194304] 0 2024-09-18T12:51:58.119 INFO:tasks.workunit.client.1.smithi161.stdout:6/98: read - d4/f17 zero size 2024-09-18T12:51:58.120 INFO:tasks.workunit.client.1.smithi161.stdout:8/175: write d0/f16 [2745075,105932] 0 2024-09-18T12:51:58.123 INFO:tasks.workunit.client.1.smithi161.stdout:0/93: fdatasync fc 0 2024-09-18T12:51:58.125 INFO:tasks.workunit.client.1.smithi161.stdout:1/56: mknod d1/d6/c11 0 2024-09-18T12:51:58.129 INFO:tasks.workunit.client.1.smithi161.stdout:1/57: dread - d1/d6/fe zero size 2024-09-18T12:51:58.129 INFO:tasks.workunit.client.1.smithi161.stdout:3/191: symlink d1/l40 0 2024-09-18T12:51:58.134 INFO:tasks.workunit.client.1.smithi161.stdout:6/99: dwrite d4/f19 [0,4194304] 0 2024-09-18T12:51:58.134 INFO:tasks.workunit.client.1.smithi161.stdout:0/94: dread fd [0,4194304] 0 2024-09-18T12:51:58.138 INFO:tasks.workunit.client.1.smithi161.stdout:8/176: write d0/d3/d1e/d34/f25 [851897,76945] 0 2024-09-18T12:51:58.140 INFO:tasks.workunit.client.1.smithi161.stdout:0/95: rename df/f1a to df/f20 0 2024-09-18T12:51:58.146 INFO:tasks.workunit.client.1.smithi161.stdout:0/96: mknod df/c21 0 2024-09-18T12:51:58.147 INFO:tasks.workunit.client.1.smithi161.stdout:1/58: dwrite d1/d6/fe [0,4194304] 0 2024-09-18T12:51:58.147 INFO:tasks.workunit.client.1.smithi161.stdout:3/192: dwrite d1/d2e/d3d/f22 [0,4194304] 0 2024-09-18T12:51:58.148 INFO:tasks.workunit.client.1.smithi161.stdout:8/177: write d0/d3/d10/d21/f32 [458499,79790] 0 2024-09-18T12:51:58.149 INFO:tasks.workunit.client.1.smithi161.stdout:5/82: sync 2024-09-18T12:51:58.150 INFO:tasks.workunit.client.1.smithi161.stdout:8/178: fsync d0/d3/d1e/d34/f35 0 2024-09-18T12:51:58.151 INFO:tasks.workunit.client.1.smithi161.stdout:4/115: dwrite d5/f16 [0,4194304] 0 2024-09-18T12:51:58.155 INFO:tasks.workunit.client.1.smithi161.stdout:0/97: creat df/f22 x:0 0 0 2024-09-18T12:51:58.155 INFO:tasks.workunit.client.1.smithi161.stdout:3/193: dread - d1/d2e/d14/d2c/f31 zero size 2024-09-18T12:51:58.156 INFO:tasks.workunit.client.1.smithi161.stdout:1/59: unlink d1/c2 0 2024-09-18T12:51:58.156 INFO:tasks.workunit.client.1.smithi161.stdout:5/83: creat d3/d9/f15 x:0 0 0 2024-09-18T12:51:58.158 INFO:tasks.workunit.client.1.smithi161.stdout:5/84: readlink d3/l4 0 2024-09-18T12:51:58.158 INFO:tasks.workunit.client.1.smithi161.stdout:4/116: write d5/fc [1472045,21666] 0 2024-09-18T12:51:58.159 INFO:tasks.workunit.client.1.smithi161.stdout:5/85: stat d3/l4 0 2024-09-18T12:51:58.160 INFO:tasks.workunit.client.1.smithi161.stdout:1/60: rmdir d1/da 39 2024-09-18T12:51:58.162 INFO:tasks.workunit.client.1.smithi161.stdout:3/194: mknod d1/d2e/d14/d2c/c41 0 2024-09-18T12:51:58.164 INFO:tasks.workunit.client.1.smithi161.stdout:1/61: read d1/f5 [442479,24646] 0 2024-09-18T12:51:58.166 INFO:tasks.workunit.client.1.smithi161.stdout:3/195: mknod d1/d2e/d24/c42 0 2024-09-18T12:51:58.167 INFO:tasks.workunit.client.1.smithi161.stdout:8/179: rename d0/d3/d1e/d34/c2f to d0/c3c 0 2024-09-18T12:51:58.167 INFO:tasks.workunit.client.1.smithi161.stdout:5/86: dwrite f0 [0,4194304] 0 2024-09-18T12:51:58.169 INFO:tasks.workunit.client.1.smithi161.stdout:3/196: creat d1/d2e/d24/d1d/f43 x:0 0 0 2024-09-18T12:51:58.170 INFO:tasks.workunit.client.1.smithi161.stdout:8/180: creat d0/d3/f3d x:0 0 0 2024-09-18T12:51:58.208 INFO:tasks.workunit.client.1.smithi161.stdout:1/62: dread d1/d6/fe [0,4194304] 0 2024-09-18T12:51:58.209 INFO:tasks.workunit.client.1.smithi161.stdout:3/197: readlink d1/d2e/d24/d1d/l3e 0 2024-09-18T12:51:58.209 INFO:tasks.workunit.client.1.smithi161.stdout:0/98: write df/f1f [46075,51259] 0 2024-09-18T12:51:58.209 INFO:tasks.workunit.client.1.smithi161.stdout:4/117: write d5/fe [4967790,13771] 0 2024-09-18T12:51:58.210 INFO:tasks.workunit.client.1.smithi161.stdout:5/87: truncate d3/d9/f12 1486378 0 2024-09-18T12:51:58.212 INFO:tasks.workunit.client.1.smithi161.stdout:3/198: creat d1/d2e/d14/f44 x:0 0 0 2024-09-18T12:51:58.215 INFO:tasks.workunit.client.1.smithi161.stdout:5/88: symlink d3/d8/l16 0 2024-09-18T12:51:58.215 INFO:tasks.workunit.client.1.smithi161.stdout:8/181: rename d0/d3/lc to d0/l3e 0 2024-09-18T12:51:58.216 INFO:tasks.workunit.client.1.smithi161.stdout:4/118: dread d5/f16 [0,4194304] 0 2024-09-18T12:51:58.217 INFO:tasks.workunit.client.1.smithi161.stdout:5/89: symlink d3/d9/l17 0 2024-09-18T12:51:58.218 INFO:tasks.workunit.client.1.smithi161.stdout:5/90: chown d3/fd 705979 1 2024-09-18T12:51:58.218 INFO:tasks.workunit.client.1.smithi161.stdout:3/199: dread d1/d2e/d3d/f38 [0,4194304] 0 2024-09-18T12:51:58.218 INFO:tasks.workunit.client.1.smithi161.stdout:8/182: creat d0/d3/d10/f3f x:0 0 0 2024-09-18T12:51:58.222 INFO:tasks.workunit.client.1.smithi161.stdout:3/200: write d1/d2e/f37 [3304942,6378] 0 2024-09-18T12:51:58.223 INFO:tasks.workunit.client.1.smithi161.stdout:0/99: write fc [2170859,89181] 0 2024-09-18T12:51:58.223 INFO:tasks.workunit.client.1.smithi161.stdout:1/63: write d1/d6/f7 [607357,14000] 0 2024-09-18T12:51:58.227 INFO:tasks.workunit.client.1.smithi161.stdout:1/64: fsync d1/d6/f9 0 2024-09-18T12:51:58.227 INFO:tasks.workunit.client.1.smithi161.stdout:5/91: dread f0 [0,4194304] 0 2024-09-18T12:51:58.227 INFO:tasks.workunit.client.1.smithi161.stdout:4/119: truncate d5/f16 2943761 0 2024-09-18T12:51:58.228 INFO:tasks.workunit.client.1.smithi161.stdout:3/201: creat d1/d2e/d24/f45 x:0 0 0 2024-09-18T12:51:58.229 INFO:tasks.workunit.client.1.smithi161.stdout:0/100: write fd [1835132,43888] 0 2024-09-18T12:51:58.230 INFO:tasks.workunit.client.1.smithi161.stdout:1/65: fdatasync d1/d6/fe 0 2024-09-18T12:51:58.232 INFO:tasks.workunit.client.1.smithi161.stdout:4/120: truncate d5/d14/f1e 385595 0 2024-09-18T12:51:58.233 INFO:tasks.workunit.client.1.smithi161.stdout:0/101: chown df/l14 180506867 1 2024-09-18T12:51:58.233 INFO:tasks.workunit.client.1.smithi161.stdout:8/183: dwrite d0/d3/d10/d21/f3a [0,4194304] 0 2024-09-18T12:51:58.233 INFO:tasks.workunit.client.1.smithi161.stdout:8/184: dread - d0/d3/f3d zero size 2024-09-18T12:51:58.234 INFO:tasks.workunit.client.1.smithi161.stdout:5/92: rename d3/f5 to d3/d9/f18 0 2024-09-18T12:51:58.235 INFO:tasks.workunit.client.1.smithi161.stdout:5/93: dread - d3/d9/f15 zero size 2024-09-18T12:51:58.237 INFO:tasks.workunit.client.1.smithi161.stdout:3/202: mknod d1/d2e/d14/d2c/c46 0 2024-09-18T12:51:58.240 INFO:tasks.workunit.client.1.smithi161.stdout:0/102: creat df/f23 x:0 0 0 2024-09-18T12:51:58.241 INFO:tasks.workunit.client.1.smithi161.stdout:8/185: dwrite d0/f9 [0,4194304] 0 2024-09-18T12:51:58.241 INFO:tasks.workunit.client.1.smithi161.stdout:4/121: mkdir d5/d27 0 2024-09-18T12:51:58.242 INFO:tasks.workunit.client.1.smithi161.stdout:0/103: write df/f1c [353058,17197] 0 2024-09-18T12:51:58.243 INFO:tasks.workunit.client.1.smithi161.stdout:4/122: write d5/f1a [1808104,54671] 0 2024-09-18T12:51:58.245 INFO:tasks.workunit.client.1.smithi161.stdout:5/94: creat d3/d14/f19 x:0 0 0 2024-09-18T12:51:58.249 INFO:tasks.workunit.client.1.smithi161.stdout:8/186: dwrite d0/f2a [0,4194304] 0 2024-09-18T12:51:58.249 INFO:tasks.workunit.client.1.smithi161.stdout:0/104: unlink df/l13 0 2024-09-18T12:51:58.254 INFO:tasks.workunit.client.1.smithi161.stdout:3/203: link d1/d2e/d24/f3a d1/d2e/d24/f47 0 2024-09-18T12:51:58.255 INFO:tasks.workunit.client.1.smithi161.stdout:9/107: sync 2024-09-18T12:51:58.255 INFO:tasks.workunit.client.1.smithi161.stdout:9/108: stat d0/d16/d12 0 2024-09-18T12:51:58.259 INFO:tasks.workunit.client.1.smithi161.stdout:0/105: rmdir df 39 2024-09-18T12:51:58.260 INFO:tasks.workunit.client.1.smithi161.stdout:4/123: symlink d5/d27/l28 0 2024-09-18T12:51:58.260 INFO:tasks.workunit.client.1.smithi161.stdout:0/106: readlink l7 0 2024-09-18T12:51:58.262 INFO:tasks.workunit.client.1.smithi161.stdout:4/124: readlink d5/l13 0 2024-09-18T12:51:58.263 INFO:tasks.workunit.client.1.smithi161.stdout:1/66: link d1/da/cd d1/c12 0 2024-09-18T12:51:58.263 INFO:tasks.workunit.client.1.smithi161.stdout:3/204: write d1/d2e/d3d/f39 [1611522,380] 0 2024-09-18T12:51:58.264 INFO:tasks.workunit.client.1.smithi161.stdout:5/95: dwrite d3/f13 [0,4194304] 0 2024-09-18T12:51:58.266 INFO:tasks.workunit.client.1.smithi161.stdout:5/96: chown d3 850628 1 2024-09-18T12:51:58.267 INFO:tasks.workunit.client.1.smithi161.stdout:8/187: truncate d0/f12 4172941 0 2024-09-18T12:51:58.270 INFO:tasks.workunit.client.1.smithi161.stdout:9/109: dwrite d0/fd [0,4194304] 0 2024-09-18T12:51:58.273 INFO:tasks.workunit.client.1.smithi161.stdout:3/205: mknod d1/d2e/c48 0 2024-09-18T12:51:58.276 INFO:tasks.workunit.client.1.smithi161.stdout:8/188: truncate d0/d3/f3d 924952 0 2024-09-18T12:51:58.277 INFO:tasks.workunit.client.1.smithi161.stdout:5/97: mknod d3/d8/c1a 0 2024-09-18T12:51:58.280 INFO:tasks.workunit.client.1.smithi161.stdout:3/206: mkdir d1/d2e/d3d/d49 0 2024-09-18T12:51:58.282 INFO:tasks.workunit.client.1.smithi161.stdout:1/67: link d1/d6/f8 d1/d6/f13 0 2024-09-18T12:51:58.284 INFO:tasks.workunit.client.1.smithi161.stdout:5/98: creat d3/d14/f1b x:0 0 0 2024-09-18T12:51:58.284 INFO:tasks.workunit.client.1.smithi161.stdout:4/125: dwrite d5/d14/f1e [0,4194304] 0 2024-09-18T12:51:58.287 INFO:tasks.workunit.client.1.smithi161.stdout:3/207: creat d1/d2e/d14/f4a x:0 0 0 2024-09-18T12:51:58.288 INFO:tasks.workunit.client.1.smithi161.stdout:0/107: dwrite df/f23 [0,4194304] 0 2024-09-18T12:51:58.290 INFO:tasks.workunit.client.1.smithi161.stdout:4/126: read - d5/d14/f23 zero size 2024-09-18T12:51:58.290 INFO:tasks.workunit.client.1.smithi161.stdout:1/68: dread d1/ff [0,4194304] 0 2024-09-18T12:51:58.290 INFO:tasks.workunit.client.1.smithi161.stdout:9/110: dwrite d0/db/f13 [0,4194304] 0 2024-09-18T12:51:58.290 INFO:tasks.workunit.client.1.smithi161.stdout:8/189: link d0/d3/d10/l11 d0/d3/d1e/l40 0 2024-09-18T12:51:58.311 INFO:tasks.workunit.client.1.smithi161.stdout:0/108: read - df/f1b zero size 2024-09-18T12:51:58.312 INFO:tasks.workunit.client.1.smithi161.stdout:1/69: write d1/d6/fb [219252,35846] 0 2024-09-18T12:51:58.312 INFO:tasks.workunit.client.1.smithi161.stdout:9/111: fdatasync d0/f5 0 2024-09-18T12:51:58.313 INFO:tasks.workunit.client.1.smithi161.stdout:0/109: chown l7 0 1 2024-09-18T12:51:58.317 INFO:tasks.workunit.client.1.smithi161.stdout:9/112: write d0/d16/d12/f14 [361814,61157] 0 2024-09-18T12:51:58.317 INFO:tasks.workunit.client.1.smithi161.stdout:0/110: unlink df/f1f 0 2024-09-18T12:51:58.322 INFO:tasks.workunit.client.1.smithi161.stdout:0/111: fsync df/f20 0 2024-09-18T12:51:58.328 INFO:tasks.workunit.client.1.smithi161.stdout:8/190: dwrite d0/d3/d10/f3f [0,4194304] 0 2024-09-18T12:51:58.332 INFO:tasks.workunit.client.1.smithi161.stdout:4/127: dwrite d5/fc [0,4194304] 0 2024-09-18T12:51:58.332 INFO:tasks.workunit.client.1.smithi161.stdout:1/70: dwrite d1/fc [0,4194304] 0 2024-09-18T12:51:58.335 INFO:tasks.workunit.client.1.smithi161.stdout:4/128: write d5/f20 [6163012,71523] 0 2024-09-18T12:51:58.335 INFO:tasks.workunit.client.1.smithi161.stdout:3/208: dwrite d1/d2e/d24/f3a [0,4194304] 0 2024-09-18T12:51:58.339 INFO:tasks.workunit.client.1.smithi161.stdout:0/112: fsync df/f1c 0 2024-09-18T12:51:58.340 INFO:tasks.workunit.client.1.smithi161.stdout:4/129: chown d5/f1a 3954950 1 2024-09-18T12:51:58.340 INFO:tasks.workunit.client.1.smithi161.stdout:1/71: creat d1/d6/f14 x:0 0 0 2024-09-18T12:51:58.343 INFO:tasks.workunit.client.1.smithi161.stdout:1/72: dread - d1/d6/f14 zero size 2024-09-18T12:51:58.344 INFO:tasks.workunit.client.1.smithi161.stdout:0/113: creat df/f24 x:0 0 0 2024-09-18T12:51:58.349 INFO:tasks.workunit.client.1.smithi161.stdout:4/130: getdents d5/d27 0 2024-09-18T12:51:58.351 INFO:tasks.workunit.client.1.smithi161.stdout:0/114: creat df/f25 x:0 0 0 2024-09-18T12:51:58.354 INFO:tasks.workunit.client.1.smithi161.stdout:8/191: dwrite d0/f9 [0,4194304] 0 2024-09-18T12:51:58.354 INFO:tasks.workunit.client.1.smithi161.stdout:9/113: truncate d0/fd 3059916 0 2024-09-18T12:51:58.355 INFO:tasks.workunit.client.1.smithi161.stdout:4/131: creat d5/d14/f29 x:0 0 0 2024-09-18T12:51:58.357 INFO:tasks.workunit.client.1.smithi161.stdout:3/209: dwrite d1/d2e/d14/f44 [0,4194304] 0 2024-09-18T12:51:58.358 INFO:tasks.workunit.client.1.smithi161.stdout:9/114: unlink d0/ff 0 2024-09-18T12:51:58.359 INFO:tasks.workunit.client.1.smithi161.stdout:1/73: dread f0 [0,4194304] 0 2024-09-18T12:51:58.360 INFO:tasks.workunit.client.1.smithi161.stdout:3/210: fsync d1/d2e/d3d/f39 0 2024-09-18T12:51:58.360 INFO:tasks.workunit.client.1.smithi161.stdout:9/115: write d0/f11 [61031,33716] 0 2024-09-18T12:51:58.361 INFO:tasks.workunit.client.1.smithi161.stdout:9/116: read - d0/f1f zero size 2024-09-18T12:51:58.364 INFO:tasks.workunit.client.1.smithi161.stdout:8/192: dread d0/d3/fb [0,4194304] 0 2024-09-18T12:51:58.368 INFO:tasks.workunit.client.1.smithi161.stdout:4/132: fsync d5/f16 0 2024-09-18T12:51:58.370 INFO:tasks.workunit.client.1.smithi161.stdout:9/117: readlink d0/l1c 0 2024-09-18T12:51:58.370 INFO:tasks.workunit.client.1.smithi161.stdout:3/211: dwrite d1/d2e/d24/f45 [0,4194304] 0 2024-09-18T12:51:58.371 INFO:tasks.workunit.client.1.smithi161.stdout:4/133: chown d5/f16 8 1 2024-09-18T12:51:58.371 INFO:tasks.workunit.client.1.smithi161.stdout:8/193: rename d0/d3/d1e/d34/l29 to d0/d3/d10/l41 0 2024-09-18T12:51:58.373 INFO:tasks.workunit.client.1.smithi161.stdout:7/95: sync 2024-09-18T12:51:58.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/179: sync 2024-09-18T12:51:58.374 INFO:tasks.workunit.client.1.smithi161.stdout:4/134: symlink d5/d14/l2a 0 2024-09-18T12:51:58.374 INFO:tasks.workunit.client.1.smithi161.stdout:8/194: chown d0/d3/d1e/d34/l1b 801 1 2024-09-18T12:51:58.375 INFO:tasks.workunit.client.1.smithi161.stdout:0/115: link df/f15 df/f26 0 2024-09-18T12:51:58.375 INFO:tasks.workunit.client.1.smithi161.stdout:3/212: chown d1/d2e/d24/f1f 602304390 1 2024-09-18T12:51:58.376 INFO:tasks.workunit.client.1.smithi161.stdout:7/96: creat d3/f14 x:0 0 0 2024-09-18T12:51:58.378 INFO:tasks.workunit.client.1.smithi161.stdout:9/118: link d0/f11 d0/f22 0 2024-09-18T12:51:58.379 INFO:tasks.workunit.client.1.smithi161.stdout:4/135: dread d5/f21 [0,4194304] 0 2024-09-18T12:51:58.380 INFO:tasks.workunit.client.1.smithi161.stdout:2/180: dread d0/d1/df/f1b [0,4194304] 0 2024-09-18T12:51:58.383 INFO:tasks.workunit.client.1.smithi161.stdout:7/97: mkdir d3/d8/d15 0 2024-09-18T12:51:58.383 INFO:tasks.workunit.client.1.smithi161.stdout:1/74: write d1/d6/f8 [931930,38018] 0 2024-09-18T12:51:58.384 INFO:tasks.workunit.client.1.smithi161.stdout:7/98: chown d3/c13 9 1 2024-09-18T12:51:58.385 INFO:tasks.workunit.client.1.smithi161.stdout:8/195: rename d0/d3/d10/f23 to d0/d3/d10/f42 0 2024-09-18T12:51:58.386 INFO:tasks.workunit.client.1.smithi161.stdout:4/136: symlink d5/l2b 0 2024-09-18T12:51:58.387 INFO:tasks.workunit.client.1.smithi161.stdout:9/119: dwrite d0/db/d18/f21 [0,4194304] 0 2024-09-18T12:51:58.387 INFO:tasks.workunit.client.1.smithi161.stdout:4/137: fdatasync d5/f1a 0 2024-09-18T12:51:58.388 INFO:tasks.workunit.client.1.smithi161.stdout:4/138: stat d5/f22 0 2024-09-18T12:51:58.388 INFO:tasks.workunit.client.1.smithi161.stdout:9/120: fdatasync d0/d16/d12/f14 0 2024-09-18T12:51:58.389 INFO:tasks.workunit.client.1.smithi161.stdout:9/121: stat d0/db 0 2024-09-18T12:51:58.389 INFO:tasks.workunit.client.1.smithi161.stdout:2/181: mkdir d0/d32/d35 0 2024-09-18T12:51:58.389 INFO:tasks.workunit.client.1.smithi161.stdout:6/100: sync 2024-09-18T12:51:58.390 INFO:tasks.workunit.client.1.smithi161.stdout:4/139: write d5/f22 [248411,81771] 0 2024-09-18T12:51:58.391 INFO:tasks.workunit.client.1.smithi161.stdout:6/101: dread - d4/db/f11 zero size 2024-09-18T12:51:58.393 INFO:tasks.workunit.client.1.smithi161.stdout:7/99: rename d3/fa to d3/f16 0 2024-09-18T12:51:58.393 INFO:tasks.workunit.client.1.smithi161.stdout:7/100: chown d3 331 1 2024-09-18T12:51:58.393 INFO:tasks.workunit.client.1.smithi161.stdout:7/101: readlink d3/d8/lc 0 2024-09-18T12:51:58.394 INFO:tasks.workunit.client.1.smithi161.stdout:8/196: mknod d0/d3/d1e/d34/c43 0 2024-09-18T12:51:58.394 INFO:tasks.workunit.client.1.smithi161.stdout:7/102: write d3/f14 [465062,2943] 0 2024-09-18T12:51:58.395 INFO:tasks.workunit.client.1.smithi161.stdout:8/197: write d0/f2a [3419080,27360] 0 2024-09-18T12:51:58.398 INFO:tasks.workunit.client.1.smithi161.stdout:7/103: dread d3/f4 [0,4194304] 0 2024-09-18T12:51:58.399 INFO:tasks.workunit.client.1.smithi161.stdout:3/213: link d1/d2e/f28 d1/d2e/f4b 0 2024-09-18T12:51:58.400 INFO:tasks.workunit.client.1.smithi161.stdout:9/122: symlink d0/db/d18/l23 0 2024-09-18T12:51:58.401 INFO:tasks.workunit.client.1.smithi161.stdout:4/140: creat d5/f2c x:0 0 0 2024-09-18T12:51:58.403 INFO:tasks.workunit.client.1.smithi161.stdout:6/102: rename d4/db to d4/d1a 0 2024-09-18T12:51:58.406 INFO:tasks.workunit.client.1.smithi161.stdout:3/214: mknod d1/d2e/d3d/c4c 0 2024-09-18T12:51:58.406 INFO:tasks.workunit.client.1.smithi161.stdout:0/116: getdents df 0 2024-09-18T12:51:58.406 INFO:tasks.workunit.client.1.smithi161.stdout:9/123: rmdir d0/db/d18 39 2024-09-18T12:51:58.406 INFO:tasks.workunit.client.1.smithi161.stdout:4/141: rmdir d5 39 2024-09-18T12:51:58.407 INFO:tasks.workunit.client.1.smithi161.stdout:1/75: creat d1/f15 x:0 0 0 2024-09-18T12:51:58.407 INFO:tasks.workunit.client.1.smithi161.stdout:3/215: write d1/d2e/d3d/f7 [2741700,19828] 0 2024-09-18T12:51:58.410 INFO:tasks.workunit.client.1.smithi161.stdout:6/103: creat d4/d1a/f1b x:0 0 0 2024-09-18T12:51:58.411 INFO:tasks.workunit.client.1.smithi161.stdout:8/198: symlink d0/l44 0 2024-09-18T12:51:58.425 INFO:tasks.workunit.client.1.smithi161.stdout:9/124: rename d0/d16/d12/f1b to d0/f24 0 2024-09-18T12:51:58.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/216: rmdir d1/d2e 39 2024-09-18T12:51:58.425 INFO:tasks.workunit.client.1.smithi161.stdout:6/104: mkdir d4/d1a/d1c 0 2024-09-18T12:51:58.426 INFO:tasks.workunit.client.1.smithi161.stdout:2/182: truncate d0/d1/df/f1b 740556 0 2024-09-18T12:51:58.427 INFO:tasks.workunit.client.1.smithi161.stdout:7/104: dread d3/f16 [0,4194304] 0 2024-09-18T12:51:58.433 INFO:tasks.workunit.client.1.smithi161.stdout:1/76: dwrite d1/ff [0,4194304] 0 2024-09-18T12:51:58.433 INFO:tasks.workunit.client.1.smithi161.stdout:6/105: dread d4/d1a/f13 [0,4194304] 0 2024-09-18T12:51:58.433 INFO:tasks.workunit.client.1.smithi161.stdout:1/77: readlink - no filename 2024-09-18T12:51:58.433 INFO:tasks.workunit.client.1.smithi161.stdout:2/183: dwrite d0/f13 [4194304,4194304] 0 2024-09-18T12:51:58.434 INFO:tasks.workunit.client.1.smithi161.stdout:6/106: truncate d4/ff 5037307 0 2024-09-18T12:51:58.453 INFO:tasks.workunit.client.1.smithi161.stdout:5/99: sync 2024-09-18T12:51:58.492 INFO:tasks.workunit.client.1.smithi161.stdout:8/199: write d0/d3/fb [2399118,127907] 0 2024-09-18T12:51:58.495 INFO:tasks.workunit.client.1.smithi161.stdout:7/105: fsync d3/f6 0 2024-09-18T12:51:58.496 INFO:tasks.workunit.client.1.smithi161.stdout:1/78: creat d1/da/f16 x:0 0 0 2024-09-18T12:51:58.496 INFO:tasks.workunit.client.1.smithi161.stdout:6/107: symlink d4/d1a/d16/l1d 0 2024-09-18T12:51:58.497 INFO:tasks.workunit.client.1.smithi161.stdout:1/79: chown d1/d6/f8 394771 1 2024-09-18T12:51:58.498 INFO:tasks.workunit.client.1.smithi161.stdout:9/125: mkdir d0/d16/d25 0 2024-09-18T12:51:58.499 INFO:tasks.workunit.client.1.smithi161.stdout:7/106: creat d3/f17 x:0 0 0 2024-09-18T12:51:58.505 INFO:tasks.workunit.client.1.smithi161.stdout:1/80: mkdir d1/d6/d17 0 2024-09-18T12:51:58.505 INFO:tasks.workunit.client.1.smithi161.stdout:5/100: dwrite d3/fd [0,4194304] 0 2024-09-18T12:51:58.506 INFO:tasks.workunit.client.1.smithi161.stdout:5/101: chown c1 5 1 2024-09-18T12:51:58.507 INFO:tasks.workunit.client.1.smithi161.stdout:1/81: dread - d1/d6/f14 zero size 2024-09-18T12:51:58.509 INFO:tasks.workunit.client.1.smithi161.stdout:9/126: creat d0/db/f26 x:0 0 0 2024-09-18T12:51:58.509 INFO:tasks.workunit.client.1.smithi161.stdout:1/82: creat d1/da/f18 x:0 0 0 2024-09-18T12:51:58.510 INFO:tasks.workunit.client.1.smithi161.stdout:6/108: dwrite d4/d1a/f1b [0,4194304] 0 2024-09-18T12:51:58.512 INFO:tasks.workunit.client.1.smithi161.stdout:1/83: fdatasync f0 0 2024-09-18T12:51:58.513 INFO:tasks.workunit.client.1.smithi161.stdout:1/84: chown d1/d6/d17 2 1 2024-09-18T12:51:58.513 INFO:tasks.workunit.client.1.smithi161.stdout:1/85: readlink - no filename 2024-09-18T12:51:58.514 INFO:tasks.workunit.client.1.smithi161.stdout:9/127: chown d0/db/d18/l23 1051 1 2024-09-18T12:51:58.514 INFO:tasks.workunit.client.1.smithi161.stdout:9/128: chown d0/fa 25196293 1 2024-09-18T12:51:58.521 INFO:tasks.workunit.client.1.smithi161.stdout:6/109: link d4/f10 d4/d1a/d16/f1e 0 2024-09-18T12:51:58.523 INFO:tasks.workunit.client.1.smithi161.stdout:1/86: link d1/da/f18 d1/da/f19 0 2024-09-18T12:51:58.523 INFO:tasks.workunit.client.1.smithi161.stdout:9/129: creat d0/d16/d25/f27 x:0 0 0 2024-09-18T12:51:58.525 INFO:tasks.workunit.client.1.smithi161.stdout:1/87: mknod d1/d6/c1a 0 2024-09-18T12:51:58.526 INFO:tasks.workunit.client.1.smithi161.stdout:9/130: mkdir d0/d16/d25/d28 0 2024-09-18T12:51:58.529 INFO:tasks.workunit.client.1.smithi161.stdout:9/131: creat d0/f29 x:0 0 0 2024-09-18T12:51:58.532 INFO:tasks.workunit.client.1.smithi161.stdout:9/132: mknod d0/d16/c2a 0 2024-09-18T12:51:58.532 INFO:tasks.workunit.client.1.smithi161.stdout:6/110: dwrite d4/d1a/d16/f1e [0,4194304] 0 2024-09-18T12:51:58.534 INFO:tasks.workunit.client.1.smithi161.stdout:1/88: dread d1/fc [0,4194304] 0 2024-09-18T12:51:58.535 INFO:tasks.workunit.client.1.smithi161.stdout:9/133: truncate d0/d16/d12/f19 28465 0 2024-09-18T12:51:58.539 INFO:tasks.workunit.client.1.smithi161.stdout:6/111: dread d4/d1a/f1b [0,4194304] 0 2024-09-18T12:51:58.543 INFO:tasks.workunit.client.1.smithi161.stdout:9/134: symlink d0/d16/l2b 0 2024-09-18T12:51:58.543 INFO:tasks.workunit.client.1.smithi161.stdout:9/135: stat d0/db/d18/l23 0 2024-09-18T12:51:58.545 INFO:tasks.workunit.client.1.smithi161.stdout:6/112: rename d4/d1a/fc to d4/d1a/d16/d18/f1f 0 2024-09-18T12:51:58.547 INFO:tasks.workunit.client.1.smithi161.stdout:9/136: unlink d0/f11 0 2024-09-18T12:51:58.547 INFO:tasks.workunit.client.1.smithi161.stdout:9/137: chown d0/fa 5 1 2024-09-18T12:51:58.549 INFO:tasks.workunit.client.1.smithi161.stdout:6/113: dread d4/f19 [0,4194304] 0 2024-09-18T12:51:58.551 INFO:tasks.workunit.client.1.smithi161.stdout:9/138: mknod d0/d16/d12/c2c 0 2024-09-18T12:51:58.552 INFO:tasks.workunit.client.1.smithi161.stdout:9/139: stat d0/d16/d12/f19 0 2024-09-18T12:51:58.552 INFO:tasks.workunit.client.1.smithi161.stdout:9/140: stat d0 0 2024-09-18T12:51:58.552 INFO:tasks.workunit.client.1.smithi161.stdout:6/114: mkdir d4/d1a/d16/d20 0 2024-09-18T12:51:58.555 INFO:tasks.workunit.client.1.smithi161.stdout:6/115: mknod d4/d1a/c21 0 2024-09-18T12:51:58.557 INFO:tasks.workunit.client.1.smithi161.stdout:6/116: dread d4/d1a/d16/d18/f1f [0,4194304] 0 2024-09-18T12:51:58.558 INFO:tasks.workunit.client.1.smithi161.stdout:9/141: dwrite d0/f29 [0,4194304] 0 2024-09-18T12:51:58.558 INFO:tasks.workunit.client.1.smithi161.stdout:6/117: stat d4/d1a/d16/d20 0 2024-09-18T12:51:58.559 INFO:tasks.workunit.client.1.smithi161.stdout:9/142: chown d0/f24 62826100 1 2024-09-18T12:51:58.564 INFO:tasks.workunit.client.1.smithi161.stdout:6/118: mkdir d4/d1a/d1c/d22 0 2024-09-18T12:51:58.564 INFO:tasks.workunit.client.1.smithi161.stdout:6/119: dread - d4/f17 zero size 2024-09-18T12:51:58.571 INFO:tasks.workunit.client.1.smithi161.stdout:6/120: dwrite d4/d1a/f11 [0,4194304] 0 2024-09-18T12:51:58.573 INFO:tasks.workunit.client.1.smithi161.stdout:6/121: read d4/d1a/f1b [2256998,17556] 0 2024-09-18T12:51:58.573 INFO:tasks.workunit.client.1.smithi161.stdout:6/122: chown d4/fa 389727736 1 2024-09-18T12:51:58.574 INFO:tasks.workunit.client.1.smithi161.stdout:6/123: write d4/f10 [283544,52202] 0 2024-09-18T12:51:58.585 INFO:tasks.workunit.client.1.smithi161.stdout:6/124: dwrite d4/d1a/d16/d18/f1f [0,4194304] 0 2024-09-18T12:51:58.588 INFO:tasks.workunit.client.1.smithi161.stdout:6/125: rename d4/d1a/c21 to d4/d1a/d16/c23 0 2024-09-18T12:51:58.591 INFO:tasks.workunit.client.1.smithi161.stdout:6/126: creat d4/d1a/d1c/f24 x:0 0 0 2024-09-18T12:51:58.592 INFO:tasks.workunit.client.1.smithi161.stdout:6/127: readlink d4/d1a/l12 0 2024-09-18T12:51:58.616 INFO:tasks.workunit.client.1.smithi161.stdout:0/117: write df/f15 [366179,10833] 0 2024-09-18T12:51:58.617 INFO:tasks.workunit.client.1.smithi161.stdout:0/118: write df/f1b [315299,92866] 0 2024-09-18T12:51:58.618 INFO:tasks.workunit.client.1.smithi161.stdout:4/142: write d5/f17 [2924299,14360] 0 2024-09-18T12:51:58.619 INFO:tasks.workunit.client.1.smithi161.stdout:0/119: write df/f1b [378144,27509] 0 2024-09-18T12:51:58.620 INFO:tasks.workunit.client.1.smithi161.stdout:4/143: dread - d5/d14/f29 zero size 2024-09-18T12:51:58.621 INFO:tasks.workunit.client.1.smithi161.stdout:4/144: chown d5/d27 41863 1 2024-09-18T12:51:58.623 INFO:tasks.workunit.client.1.smithi161.stdout:0/120: creat df/f27 x:0 0 0 2024-09-18T12:51:58.623 INFO:tasks.workunit.client.1.smithi161.stdout:7/107: sync 2024-09-18T12:51:58.623 INFO:tasks.workunit.client.1.smithi161.stdout:2/184: truncate d0/d1/f2e 3163484 0 2024-09-18T12:51:58.624 INFO:tasks.workunit.client.1.smithi161.stdout:4/145: mknod d5/d27/c2d 0 2024-09-18T12:51:58.624 INFO:tasks.workunit.client.1.smithi161.stdout:8/200: write d0/f12 [2015599,84221] 0 2024-09-18T12:51:58.625 INFO:tasks.workunit.client.1.smithi161.stdout:3/217: truncate d1/d2e/d14/f44 186884 0 2024-09-18T12:51:58.627 INFO:tasks.workunit.client.1.smithi161.stdout:3/218: write d1/d2e/d14/f4a [752250,77887] 0 2024-09-18T12:51:58.627 INFO:tasks.workunit.client.1.smithi161.stdout:0/121: stat df/f19 0 2024-09-18T12:51:58.628 INFO:tasks.workunit.client.1.smithi161.stdout:0/122: fsync df/f1c 0 2024-09-18T12:51:58.629 INFO:tasks.workunit.client.1.smithi161.stdout:5/102: truncate d3/fd 1107125 0 2024-09-18T12:51:58.630 INFO:tasks.workunit.client.1.smithi161.stdout:5/103: fdatasync d3/f13 0 2024-09-18T12:51:58.631 INFO:tasks.workunit.client.1.smithi161.stdout:2/185: rename d0/l12 to d0/d4/l36 0 2024-09-18T12:51:58.631 INFO:tasks.workunit.client.1.smithi161.stdout:5/104: fdatasync d3/d14/f1b 0 2024-09-18T12:51:58.632 INFO:tasks.workunit.client.1.smithi161.stdout:2/186: stat d0/d32/d23 0 2024-09-18T12:51:58.633 INFO:tasks.workunit.client.1.smithi161.stdout:0/123: dread df/f20 [0,4194304] 0 2024-09-18T12:51:58.634 INFO:tasks.workunit.client.1.smithi161.stdout:4/146: symlink d5/d14/l2e 0 2024-09-18T12:51:58.635 INFO:tasks.workunit.client.1.smithi161.stdout:0/124: read - df/f24 zero size 2024-09-18T12:51:58.635 INFO:tasks.workunit.client.1.smithi161.stdout:3/219: mknod d1/d2e/d3d/c4d 0 2024-09-18T12:51:58.635 INFO:tasks.workunit.client.1.smithi161.stdout:7/108: dwrite d3/f7 [4194304,4194304] 0 2024-09-18T12:51:58.636 INFO:tasks.workunit.client.1.smithi161.stdout:0/125: dread - df/f27 zero size 2024-09-18T12:51:58.642 INFO:tasks.workunit.client.1.smithi161.stdout:7/109: chown d3/f7 3 1 2024-09-18T12:51:58.642 INFO:tasks.workunit.client.1.smithi161.stdout:2/187: dread d0/f13 [4194304,4194304] 0 2024-09-18T12:51:58.642 INFO:tasks.workunit.client.1.smithi161.stdout:5/105: rename f0 to d3/d9/f1c 0 2024-09-18T12:51:58.643 INFO:tasks.workunit.client.1.smithi161.stdout:3/220: symlink d1/d2e/d14/d2c/l4e 0 2024-09-18T12:51:58.644 INFO:tasks.workunit.client.1.smithi161.stdout:7/110: read d3/f6 [1067670,116873] 0 2024-09-18T12:51:58.645 INFO:tasks.workunit.client.1.smithi161.stdout:4/147: dwrite d5/fc [0,4194304] 0 2024-09-18T12:51:58.645 INFO:tasks.workunit.client.1.smithi161.stdout:2/188: readlink d0/d32/l11 0 2024-09-18T12:51:58.645 INFO:tasks.workunit.client.1.smithi161.stdout:7/111: chown d3 448875259 1 2024-09-18T12:51:58.647 INFO:tasks.workunit.client.1.smithi161.stdout:8/201: creat d0/f45 x:0 0 0 2024-09-18T12:51:58.649 INFO:tasks.workunit.client.1.smithi161.stdout:8/202: readlink d0/d3/d10/d21/l26 0 2024-09-18T12:51:58.649 INFO:tasks.workunit.client.1.smithi161.stdout:8/203: chown d0/l19 5780381 1 2024-09-18T12:51:58.649 INFO:tasks.workunit.client.1.smithi161.stdout:8/204: chown d0/l17 3771 1 2024-09-18T12:51:58.650 INFO:tasks.workunit.client.1.smithi161.stdout:7/112: dread d3/f7 [4194304,4194304] 0 2024-09-18T12:51:58.651 INFO:tasks.workunit.client.1.smithi161.stdout:8/205: write d0/f9 [231160,93631] 0 2024-09-18T12:51:58.652 INFO:tasks.workunit.client.1.smithi161.stdout:7/113: fdatasync d3/f6 0 2024-09-18T12:51:58.653 INFO:tasks.workunit.client.1.smithi161.stdout:7/114: read d3/d8/fd [554512,123797] 0 2024-09-18T12:51:58.656 INFO:tasks.workunit.client.1.smithi161.stdout:3/221: readlink d1/d2e/d24/d1d/l34 0 2024-09-18T12:51:58.657 INFO:tasks.workunit.client.1.smithi161.stdout:3/222: truncate d1/d2e/f17 2241489 0 2024-09-18T12:51:58.664 INFO:tasks.workunit.client.1.smithi161.stdout:3/223: dwrite d1/d2e/d24/d1d/f2b [0,4194304] 0 2024-09-18T12:51:58.670 INFO:tasks.workunit.client.1.smithi161.stdout:4/148: dread d5/ff [0,4194304] 0 2024-09-18T12:51:58.671 INFO:tasks.workunit.client.1.smithi161.stdout:4/149: rename d5 to d5/d27/d2f 22 2024-09-18T12:51:58.673 INFO:tasks.workunit.client.1.smithi161.stdout:9/143: dwrite d0/fa [0,4194304] 0 2024-09-18T12:51:58.673 INFO:tasks.workunit.client.1.smithi161.stdout:1/89: sync 2024-09-18T12:51:58.674 INFO:tasks.workunit.client.1.smithi161.stdout:1/90: dread - d1/da/f16 zero size 2024-09-18T12:51:58.683 INFO:tasks.workunit.client.1.smithi161.stdout:8/206: unlink d0/d3/d1e/l40 0 2024-09-18T12:51:58.685 INFO:tasks.workunit.client.1.smithi161.stdout:5/106: link d3/d8/l16 d3/d14/l1d 0 2024-09-18T12:51:58.686 INFO:tasks.workunit.client.1.smithi161.stdout:7/115: getdents d3/d8/d15 0 2024-09-18T12:51:58.689 INFO:tasks.workunit.client.1.smithi161.stdout:8/207: dwrite d0/d3/d1e/d34/f35 [0,4194304] 0 2024-09-18T12:51:58.701 INFO:tasks.workunit.client.1.smithi161.stdout:6/128: getdents d4/d1a/d16 0 2024-09-18T12:51:58.797 INFO:tasks.workunit.client.1.smithi161.stdout:1/91: rename d1/d6/f14 to d1/f1b 0 2024-09-18T12:51:58.797 INFO:tasks.workunit.client.1.smithi161.stdout:1/92: write d1/d6/f13 [82723,122422] 0 2024-09-18T12:51:58.798 INFO:tasks.workunit.client.1.smithi161.stdout:7/116: link d3/cb d3/d8/c18 0 2024-09-18T12:51:58.798 INFO:tasks.workunit.client.1.smithi161.stdout:7/117: fdatasync d3/f17 0 2024-09-18T12:51:58.799 INFO:tasks.workunit.client.1.smithi161.stdout:7/118: write d3/f14 [529724,82189] 0 2024-09-18T12:51:58.799 INFO:tasks.workunit.client.1.smithi161.stdout:6/129: getdents d4/d1a/d1c/d22 0 2024-09-18T12:51:58.801 INFO:tasks.workunit.client.1.smithi161.stdout:6/130: write d4/d1a/d16/d18/f1f [4193082,96269] 0 2024-09-18T12:51:58.802 INFO:tasks.workunit.client.1.smithi161.stdout:7/119: dread d3/d8/fd [0,4194304] 0 2024-09-18T12:51:58.802 INFO:tasks.workunit.client.1.smithi161.stdout:6/131: truncate d4/d1a/f14 238770 0 2024-09-18T12:51:58.807 INFO:tasks.workunit.client.1.smithi161.stdout:7/120: creat d3/f19 x:0 0 0 2024-09-18T12:51:58.809 INFO:tasks.workunit.client.1.smithi161.stdout:6/132: creat d4/d1a/d1c/f25 x:0 0 0 2024-09-18T12:51:58.811 INFO:tasks.workunit.client.1.smithi161.stdout:7/121: dread d3/f14 [0,4194304] 0 2024-09-18T12:51:58.811 INFO:tasks.workunit.client.1.smithi161.stdout:1/93: rename d1/da/cd to d1/d6/d17/c1c 0 2024-09-18T12:51:58.811 INFO:tasks.workunit.client.1.smithi161.stdout:1/94: fsync d1/f15 0 2024-09-18T12:51:58.814 INFO:tasks.workunit.client.1.smithi161.stdout:6/133: chown d4/l9 19672392 1 2024-09-18T12:51:58.817 INFO:tasks.workunit.client.1.smithi161.stdout:7/122: dwrite d3/f6 [0,4194304] 0 2024-09-18T12:51:58.819 INFO:tasks.workunit.client.1.smithi161.stdout:6/134: rename d4/d1a/d16 to d4/d1a/d1c/d22/d26 0 2024-09-18T12:51:58.823 INFO:tasks.workunit.client.1.smithi161.stdout:6/135: read d4/f19 [3291137,122655] 0 2024-09-18T12:51:58.824 INFO:tasks.workunit.client.1.smithi161.stdout:1/95: dwrite d1/fc [0,4194304] 0 2024-09-18T12:51:58.825 INFO:tasks.workunit.client.1.smithi161.stdout:1/96: chown d1/ff 319 1 2024-09-18T12:51:58.827 INFO:tasks.workunit.client.1.smithi161.stdout:0/126: getdents df 0 2024-09-18T12:51:58.828 INFO:tasks.workunit.client.1.smithi161.stdout:0/127: read df/f26 [26427,81301] 0 2024-09-18T12:51:58.829 INFO:tasks.workunit.client.1.smithi161.stdout:0/128: readlink df/l14 0 2024-09-18T12:51:58.830 INFO:tasks.workunit.client.1.smithi161.stdout:0/129: write df/f27 [932335,84978] 0 2024-09-18T12:51:58.836 INFO:tasks.workunit.client.1.smithi161.stdout:6/136: mknod d4/d1a/d1c/d22/d26/d20/c27 0 2024-09-18T12:51:58.838 INFO:tasks.workunit.client.1.smithi161.stdout:5/107: dread d3/d9/f18 [0,4194304] 0 2024-09-18T12:51:58.838 INFO:tasks.workunit.client.1.smithi161.stdout:5/108: stat d3/f13 0 2024-09-18T12:51:58.840 INFO:tasks.workunit.client.1.smithi161.stdout:2/189: truncate d0/d1/df/f1b 581030 0 2024-09-18T12:51:58.842 INFO:tasks.workunit.client.1.smithi161.stdout:6/137: unlink d4/d1a/d1c/d22/d26/f1e 0 2024-09-18T12:51:58.842 INFO:tasks.workunit.client.1.smithi161.stdout:6/138: dread - d4/d1a/d1c/f24 zero size 2024-09-18T12:51:58.844 INFO:tasks.workunit.client.1.smithi161.stdout:5/109: creat d3/d14/f1e x:0 0 0 2024-09-18T12:51:58.846 INFO:tasks.workunit.client.1.smithi161.stdout:6/139: mkdir d4/d1a/d1c/d22/d26/d20/d28 0 2024-09-18T12:51:58.847 INFO:tasks.workunit.client.1.smithi161.stdout:2/190: chown d0/d1/df/f1b 1020077 1 2024-09-18T12:51:58.849 INFO:tasks.workunit.client.1.smithi161.stdout:6/140: creat d4/d1a/d1c/d22/d26/d18/f29 x:0 0 0 2024-09-18T12:51:58.850 INFO:tasks.workunit.client.1.smithi161.stdout:6/141: write d4/d1a/f14 [921319,93985] 0 2024-09-18T12:51:58.850 INFO:tasks.workunit.client.1.smithi161.stdout:2/191: creat d0/d32/f37 x:0 0 0 2024-09-18T12:51:58.852 INFO:tasks.workunit.client.1.smithi161.stdout:5/110: getdents d3/d9 0 2024-09-18T12:51:58.853 INFO:tasks.workunit.client.1.smithi161.stdout:6/142: creat d4/d1a/d1c/d22/d26/d20/f2a x:0 0 0 2024-09-18T12:51:58.854 INFO:tasks.workunit.client.1.smithi161.stdout:5/111: fdatasync d3/fd 0 2024-09-18T12:51:58.855 INFO:tasks.workunit.client.1.smithi161.stdout:6/143: rmdir d4/d1a/d1c/d22 39 2024-09-18T12:51:58.856 INFO:tasks.workunit.client.1.smithi161.stdout:2/192: dwrite d0/d1/df/f16 [0,4194304] 0 2024-09-18T12:51:58.857 INFO:tasks.workunit.client.1.smithi161.stdout:5/112: write d3/d9/f1c [2616008,64748] 0 2024-09-18T12:51:58.859 INFO:tasks.workunit.client.1.smithi161.stdout:5/113: dread d3/d9/f18 [0,4194304] 0 2024-09-18T12:51:58.859 INFO:tasks.workunit.client.1.smithi161.stdout:6/144: creat d4/d1a/d1c/d22/d26/f2b x:0 0 0 2024-09-18T12:51:58.860 INFO:tasks.workunit.client.1.smithi161.stdout:5/114: truncate d3/d14/f1e 790063 0 2024-09-18T12:51:58.861 INFO:tasks.workunit.client.1.smithi161.stdout:9/144: truncate d0/d16/d12/f19 687944 0 2024-09-18T12:51:58.862 INFO:tasks.workunit.client.1.smithi161.stdout:5/115: symlink d3/l1f 0 2024-09-18T12:51:58.863 INFO:tasks.workunit.client.1.smithi161.stdout:5/116: write d3/d14/f1b [696846,78508] 0 2024-09-18T12:51:58.864 INFO:tasks.workunit.client.1.smithi161.stdout:5/117: truncate d3/d14/f1e 1158461 0 2024-09-18T12:51:58.865 INFO:tasks.workunit.client.1.smithi161.stdout:6/145: creat d4/d1a/d1c/f2c x:0 0 0 2024-09-18T12:51:58.866 INFO:tasks.workunit.client.1.smithi161.stdout:6/146: stat d4/d1a/d1c/f2c 0 2024-09-18T12:51:58.867 INFO:tasks.workunit.client.1.smithi161.stdout:6/147: stat d4/d1a/d1c/d22/d26/f2b 0 2024-09-18T12:51:58.867 INFO:tasks.workunit.client.1.smithi161.stdout:5/118: mkdir d3/d14/d20 0 2024-09-18T12:51:58.868 INFO:tasks.workunit.client.1.smithi161.stdout:9/145: mkdir d0/db/d18/d2d 0 2024-09-18T12:51:58.871 INFO:tasks.workunit.client.1.smithi161.stdout:5/119: mkdir d3/d14/d20/d21 0 2024-09-18T12:51:58.872 INFO:tasks.workunit.client.1.smithi161.stdout:6/148: dread d4/d1a/d1c/d22/d26/d18/f1f [0,4194304] 0 2024-09-18T12:51:58.874 INFO:tasks.workunit.client.1.smithi161.stdout:5/120: symlink d3/d14/d20/l22 0 2024-09-18T12:51:58.875 INFO:tasks.workunit.client.1.smithi161.stdout:6/149: creat d4/d1a/f2d x:0 0 0 2024-09-18T12:51:58.876 INFO:tasks.workunit.client.1.smithi161.stdout:5/121: mknod d3/c23 0 2024-09-18T12:51:58.878 INFO:tasks.workunit.client.1.smithi161.stdout:3/224: dwrite d1/d2e/d24/f1f [0,4194304] 0 2024-09-18T12:51:58.881 INFO:tasks.workunit.client.1.smithi161.stdout:5/122: unlink d3/d14/f1e 0 2024-09-18T12:51:58.882 INFO:tasks.workunit.client.1.smithi161.stdout:9/146: dwrite d0/fa [0,4194304] 0 2024-09-18T12:51:58.885 INFO:tasks.workunit.client.1.smithi161.stdout:3/225: read d1/d2e/f4b [3572755,82852] 0 2024-09-18T12:51:58.890 INFO:tasks.workunit.client.1.smithi161.stdout:4/150: dwrite d5/f8 [4194304,4194304] 0 2024-09-18T12:51:58.892 INFO:tasks.workunit.client.1.smithi161.stdout:6/150: dread d4/d1a/f1b [0,4194304] 0 2024-09-18T12:51:58.894 INFO:tasks.workunit.client.1.smithi161.stdout:4/151: chown d5/l24 186418 1 2024-09-18T12:51:58.894 INFO:tasks.workunit.client.1.smithi161.stdout:8/208: dwrite d0/d3/d10/f18 [0,4194304] 0 2024-09-18T12:51:58.898 INFO:tasks.workunit.client.1.smithi161.stdout:8/209: chown d0/d3/d10/f22 35280 1 2024-09-18T12:51:58.898 INFO:tasks.workunit.client.1.smithi161.stdout:8/210: readlink d0/d3/ld 0 2024-09-18T12:51:58.900 INFO:tasks.workunit.client.1.smithi161.stdout:8/211: truncate d0/d3/d10/d21/f32 968768 0 2024-09-18T12:51:58.901 INFO:tasks.workunit.client.1.smithi161.stdout:8/212: chown d0/d3/d1e/d34/f25 638384 1 2024-09-18T12:51:58.902 INFO:tasks.workunit.client.1.smithi161.stdout:8/213: fsync d0/f16 0 2024-09-18T12:51:58.908 INFO:tasks.workunit.client.1.smithi161.stdout:1/97: getdents d1/d6 0 2024-09-18T12:51:58.908 INFO:tasks.workunit.client.1.smithi161.stdout:5/123: readlink d3/d14/l1d 0 2024-09-18T12:51:58.908 INFO:tasks.workunit.client.1.smithi161.stdout:3/226: rename d1/f2d to d1/d2e/d24/d1d/f4f 0 2024-09-18T12:51:58.910 INFO:tasks.workunit.client.1.smithi161.stdout:6/151: symlink d4/d1a/d1c/d22/l2e 0 2024-09-18T12:51:58.911 INFO:tasks.workunit.client.1.smithi161.stdout:4/152: symlink d5/l30 0 2024-09-18T12:51:58.911 INFO:tasks.workunit.client.1.smithi161.stdout:4/153: stat d5/d14 0 2024-09-18T12:51:58.912 INFO:tasks.workunit.client.1.smithi161.stdout:8/214: creat d0/d3/d1e/f46 x:0 0 0 2024-09-18T12:51:58.918 INFO:tasks.workunit.client.1.smithi161.stdout:4/154: symlink d5/d27/l31 0 2024-09-18T12:51:58.919 INFO:tasks.workunit.client.1.smithi161.stdout:9/147: creat d0/d20/f2e x:0 0 0 2024-09-18T12:51:58.921 INFO:tasks.workunit.client.1.smithi161.stdout:1/98: dread d1/d6/f13 [0,4194304] 0 2024-09-18T12:51:58.922 INFO:tasks.workunit.client.1.smithi161.stdout:8/215: symlink d0/d3/d1e/d34/l47 0 2024-09-18T12:51:58.922 INFO:tasks.workunit.client.1.smithi161.stdout:8/216: chown d0/l17 36 1 2024-09-18T12:51:58.924 INFO:tasks.workunit.client.1.smithi161.stdout:5/124: mkdir d3/d14/d20/d21/d24 0 2024-09-18T12:51:58.925 INFO:tasks.workunit.client.1.smithi161.stdout:6/152: mknod d4/d1a/d1c/d22/d26/d20/d28/c2f 0 2024-09-18T12:51:58.926 INFO:tasks.workunit.client.1.smithi161.stdout:4/155: mkdir d5/d32 0 2024-09-18T12:51:58.928 INFO:tasks.workunit.client.1.smithi161.stdout:6/153: rename d4/d1a/d1c/d22/d26/d18 to d4/d1a/d1c/d22/d26/d18/d30 22 2024-09-18T12:51:58.928 INFO:tasks.workunit.client.1.smithi161.stdout:3/227: link d1/d2e/f37 d1/f50 0 2024-09-18T12:51:58.929 INFO:tasks.workunit.client.1.smithi161.stdout:6/154: stat d4/d1a/f13 0 2024-09-18T12:51:58.934 INFO:tasks.workunit.client.1.smithi161.stdout:3/228: mknod d1/d2e/d3d/c51 0 2024-09-18T12:51:58.935 INFO:tasks.workunit.client.1.smithi161.stdout:5/125: link d3/d14/d20/l22 d3/d14/d20/l25 0 2024-09-18T12:51:58.941 INFO:tasks.workunit.client.1.smithi161.stdout:5/126: mknod d3/d8/c26 0 2024-09-18T12:51:58.944 INFO:tasks.workunit.client.1.smithi161.stdout:9/148: dwrite d0/f1f [0,4194304] 0 2024-09-18T12:51:58.946 INFO:tasks.workunit.client.1.smithi161.stdout:4/156: dwrite d5/f22 [0,4194304] 0 2024-09-18T12:51:58.948 INFO:tasks.workunit.client.1.smithi161.stdout:5/127: symlink d3/l27 0 2024-09-18T12:51:58.950 INFO:tasks.workunit.client.1.smithi161.stdout:7/123: dwrite d3/f16 [0,4194304] 0 2024-09-18T12:51:58.956 INFO:tasks.workunit.client.1.smithi161.stdout:6/155: truncate d4/f10 1432509 0 2024-09-18T12:51:58.956 INFO:tasks.workunit.client.1.smithi161.stdout:3/229: dread d1/f12 [0,4194304] 0 2024-09-18T12:51:58.956 INFO:tasks.workunit.client.1.smithi161.stdout:4/157: mkdir d5/d14/d33 0 2024-09-18T12:51:58.956 INFO:tasks.workunit.client.1.smithi161.stdout:0/130: dwrite df/f19 [0,4194304] 0 2024-09-18T12:51:58.957 INFO:tasks.workunit.client.1.smithi161.stdout:0/131: fdatasync f3 0 2024-09-18T12:51:58.959 INFO:tasks.workunit.client.1.smithi161.stdout:4/158: dread - d5/d14/f29 zero size 2024-09-18T12:51:58.960 INFO:tasks.workunit.client.1.smithi161.stdout:3/230: write d1/d2e/d3d/f39 [4491770,107836] 0 2024-09-18T12:51:58.961 INFO:tasks.workunit.client.1.smithi161.stdout:5/128: symlink d3/d14/d20/l28 0 2024-09-18T12:51:58.962 INFO:tasks.workunit.client.1.smithi161.stdout:4/159: truncate d5/d14/f29 24197 0 2024-09-18T12:51:58.966 INFO:tasks.workunit.client.1.smithi161.stdout:4/160: truncate d5/fe 4999504 0 2024-09-18T12:51:58.966 INFO:tasks.workunit.client.1.smithi161.stdout:7/124: mkdir d3/d8/d15/d1a 0 2024-09-18T12:51:58.966 INFO:tasks.workunit.client.1.smithi161.stdout:6/156: mkdir d4/d1a/d1c/d22/d26/d31 0 2024-09-18T12:51:58.969 INFO:tasks.workunit.client.1.smithi161.stdout:0/132: rename df/f19 to df/f28 0 2024-09-18T12:51:58.971 INFO:tasks.workunit.client.1.smithi161.stdout:5/129: dwrite d3/d9/f1c [0,4194304] 0 2024-09-18T12:51:58.972 INFO:tasks.workunit.client.1.smithi161.stdout:5/130: write d3/d14/f19 [64786,70613] 0 2024-09-18T12:51:58.974 INFO:tasks.workunit.client.1.smithi161.stdout:9/149: creat d0/f2f x:0 0 0 2024-09-18T12:51:58.974 INFO:tasks.workunit.client.1.smithi161.stdout:7/125: fsync d3/f4 0 2024-09-18T12:51:58.978 INFO:tasks.workunit.client.1.smithi161.stdout:3/231: dread d1/d2e/f17 [0,4194304] 0 2024-09-18T12:51:58.978 INFO:tasks.workunit.client.1.smithi161.stdout:0/133: mkdir df/d29 0 2024-09-18T12:51:58.982 INFO:tasks.workunit.client.1.smithi161.stdout:9/150: write d0/db/f17 [670292,95218] 0 2024-09-18T12:51:58.983 INFO:tasks.workunit.client.1.smithi161.stdout:3/232: dread d1/d2e/f4b [0,4194304] 0 2024-09-18T12:51:58.985 INFO:tasks.workunit.client.1.smithi161.stdout:0/134: rename df/l14 to df/l2a 0 2024-09-18T12:51:58.985 INFO:tasks.workunit.client.1.smithi161.stdout:0/135: readlink df/l1e 0 2024-09-18T12:51:58.986 INFO:tasks.workunit.client.1.smithi161.stdout:5/131: chown d3/d14/d20/l22 37 1 2024-09-18T12:51:58.987 INFO:tasks.workunit.client.1.smithi161.stdout:7/126: rename d3/cb to d3/c1b 0 2024-09-18T12:51:58.988 INFO:tasks.workunit.client.1.smithi161.stdout:4/161: link d5/l30 d5/d27/l34 0 2024-09-18T12:51:58.989 INFO:tasks.workunit.client.1.smithi161.stdout:3/233: mknod d1/d2e/d24/c52 0 2024-09-18T12:51:58.990 INFO:tasks.workunit.client.1.smithi161.stdout:0/136: rename fc to df/f2b 0 2024-09-18T12:51:58.991 INFO:tasks.workunit.client.1.smithi161.stdout:9/151: symlink d0/d16/d25/l30 0 2024-09-18T12:51:58.991 INFO:tasks.workunit.client.1.smithi161.stdout:4/162: dread d5/ff [0,4194304] 0 2024-09-18T12:51:58.992 INFO:tasks.workunit.client.1.smithi161.stdout:4/163: readlink d5/l25 0 2024-09-18T12:51:58.992 INFO:tasks.workunit.client.1.smithi161.stdout:5/132: creat d3/d14/d20/d21/f29 x:0 0 0 2024-09-18T12:51:58.993 INFO:tasks.workunit.client.1.smithi161.stdout:7/127: unlink d3/d8/fd 0 2024-09-18T12:51:58.994 INFO:tasks.workunit.client.1.smithi161.stdout:7/128: truncate d3/f19 998861 0 2024-09-18T12:51:58.999 INFO:tasks.workunit.client.1.smithi161.stdout:5/133: creat d3/f2a x:0 0 0 2024-09-18T12:51:58.999 INFO:tasks.workunit.client.1.smithi161.stdout:0/137: link df/f28 df/d29/f2c 0 2024-09-18T12:51:58.999 INFO:tasks.workunit.client.1.smithi161.stdout:4/164: dwrite d5/f22 [0,4194304] 0 2024-09-18T12:51:59.002 INFO:tasks.workunit.client.1.smithi161.stdout:9/152: creat d0/d16/d25/d28/f31 x:0 0 0 2024-09-18T12:51:59.002 INFO:tasks.workunit.client.1.smithi161.stdout:7/129: dread d3/f4 [0,4194304] 0 2024-09-18T12:51:59.003 INFO:tasks.workunit.client.1.smithi161.stdout:5/134: creat d3/d9/f2b x:0 0 0 2024-09-18T12:51:59.005 INFO:tasks.workunit.client.1.smithi161.stdout:9/153: write d0/d16/d12/f19 [1516385,37560] 0 2024-09-18T12:51:59.005 INFO:tasks.workunit.client.1.smithi161.stdout:0/138: unlink df/f20 0 2024-09-18T12:51:59.006 INFO:tasks.workunit.client.1.smithi161.stdout:4/165: chown d5/d14/c1f 1 1 2024-09-18T12:51:59.007 INFO:tasks.workunit.client.1.smithi161.stdout:7/130: mkdir d3/d1c 0 2024-09-18T12:51:59.009 INFO:tasks.workunit.client.1.smithi161.stdout:0/139: unlink df/f27 0 2024-09-18T12:51:59.011 INFO:tasks.workunit.client.1.smithi161.stdout:4/166: creat d5/d27/f35 x:0 0 0 2024-09-18T12:51:59.012 INFO:tasks.workunit.client.1.smithi161.stdout:5/135: rename d3/d9/f2b to d3/d14/d20/f2c 0 2024-09-18T12:51:59.014 INFO:tasks.workunit.client.1.smithi161.stdout:9/154: symlink d0/db/d18/d2d/l32 0 2024-09-18T12:51:59.015 INFO:tasks.workunit.client.1.smithi161.stdout:5/136: dread d3/fd [0,4194304] 0 2024-09-18T12:51:59.015 INFO:tasks.workunit.client.1.smithi161.stdout:5/137: readlink d3/l1f 0 2024-09-18T12:51:59.020 INFO:tasks.workunit.client.1.smithi161.stdout:5/138: rename d3/d14/d20/d21/f29 to d3/d9/f2d 0 2024-09-18T12:51:59.021 INFO:tasks.workunit.client.1.smithi161.stdout:9/155: dwrite d0/f2f [0,4194304] 0 2024-09-18T12:51:59.023 INFO:tasks.workunit.client.1.smithi161.stdout:5/139: creat d3/d14/d20/f2e x:0 0 0 2024-09-18T12:51:59.028 INFO:tasks.workunit.client.1.smithi161.stdout:9/156: rename d0/d20/f2e to d0/d16/d25/d28/f33 0 2024-09-18T12:51:59.028 INFO:tasks.workunit.client.1.smithi161.stdout:5/140: dread d3/d9/f1c [0,4194304] 0 2024-09-18T12:51:59.029 INFO:tasks.workunit.client.1.smithi161.stdout:8/217: truncate d0/d3/d1e/d34/f35 2715198 0 2024-09-18T12:51:59.030 INFO:tasks.workunit.client.1.smithi161.stdout:8/218: write d0/d3/d10/d21/f30 [576423,100478] 0 2024-09-18T12:51:59.030 INFO:tasks.workunit.client.1.smithi161.stdout:9/157: symlink d0/db/d18/l34 0 2024-09-18T12:51:59.031 INFO:tasks.workunit.client.1.smithi161.stdout:2/193: sync 2024-09-18T12:51:59.031 INFO:tasks.workunit.client.1.smithi161.stdout:8/219: chown d0/d3/d10/d21/l28 0 1 2024-09-18T12:51:59.032 INFO:tasks.workunit.client.1.smithi161.stdout:2/194: write d0/d1/df/f34 [403477,19503] 0 2024-09-18T12:51:59.037 INFO:tasks.workunit.client.1.smithi161.stdout:8/220: dwrite d0/f12 [0,4194304] 0 2024-09-18T12:51:59.039 INFO:tasks.workunit.client.1.smithi161.stdout:8/221: dread - d0/d3/d10/d21/f37 zero size 2024-09-18T12:51:59.040 INFO:tasks.workunit.client.1.smithi161.stdout:2/195: creat d0/f38 x:0 0 0 2024-09-18T12:51:59.043 INFO:tasks.workunit.client.1.smithi161.stdout:8/222: creat d0/d3/d10/d21/f48 x:0 0 0 2024-09-18T12:51:59.043 INFO:tasks.workunit.client.1.smithi161.stdout:2/196: rmdir d0/d1/df 39 2024-09-18T12:51:59.047 INFO:tasks.workunit.client.1.smithi161.stdout:2/197: rename d0/f30 to d0/d4/f39 0 2024-09-18T12:51:59.047 INFO:tasks.workunit.client.1.smithi161.stdout:8/223: dread d0/f9 [0,4194304] 0 2024-09-18T12:51:59.047 INFO:tasks.workunit.client.1.smithi161.stdout:2/198: dread - d0/d4/f39 zero size 2024-09-18T12:51:59.054 INFO:tasks.workunit.client.1.smithi161.stdout:8/224: dwrite d0/d3/d10/d21/f32 [0,4194304] 0 2024-09-18T12:51:59.055 INFO:tasks.workunit.client.1.smithi161.stdout:8/225: truncate d0/d3/d10/d21/f30 1481615 0 2024-09-18T12:51:59.060 INFO:tasks.workunit.client.1.smithi161.stdout:7/131: getdents d3/d8 0 2024-09-18T12:51:59.060 INFO:tasks.workunit.client.1.smithi161.stdout:7/132: stat d3/c13 0 2024-09-18T12:51:59.060 INFO:tasks.workunit.client.1.smithi161.stdout:6/157: dwrite d4/f19 [0,4194304] 0 2024-09-18T12:51:59.064 INFO:tasks.workunit.client.1.smithi161.stdout:1/99: sync 2024-09-18T12:51:59.064 INFO:tasks.workunit.client.1.smithi161.stdout:1/100: fdatasync d1/ff 0 2024-09-18T12:51:59.065 INFO:tasks.workunit.client.1.smithi161.stdout:7/133: getdents d3/d1c 0 2024-09-18T12:51:59.066 INFO:tasks.workunit.client.1.smithi161.stdout:7/134: chown d3/d8/d15/d1a 65 1 2024-09-18T12:51:59.066 INFO:tasks.workunit.client.1.smithi161.stdout:1/101: dread d1/d6/f8 [0,4194304] 0 2024-09-18T12:51:59.066 INFO:tasks.workunit.client.1.smithi161.stdout:7/135: chown d3/d8/lc 18504 1 2024-09-18T12:51:59.067 INFO:tasks.workunit.client.1.smithi161.stdout:1/102: dread - d1/da/f19 zero size 2024-09-18T12:51:59.069 INFO:tasks.workunit.client.1.smithi161.stdout:7/136: dread d3/f19 [0,4194304] 0 2024-09-18T12:51:59.073 INFO:tasks.workunit.client.1.smithi161.stdout:7/137: dread d3/f4 [0,4194304] 0 2024-09-18T12:51:59.073 INFO:tasks.workunit.client.1.smithi161.stdout:6/158: getdents d4/d1a/d1c/d22/d26/d18 0 2024-09-18T12:51:59.075 INFO:tasks.workunit.client.1.smithi161.stdout:6/159: chown d4/d1a/d1c/d22/d26/f2b 3217975 1 2024-09-18T12:51:59.076 INFO:tasks.workunit.client.1.smithi161.stdout:4/167: getdents d5/d27 0 2024-09-18T12:51:59.077 INFO:tasks.workunit.client.1.smithi161.stdout:6/160: chown d4/d1a/l12 1533247 1 2024-09-18T12:51:59.078 INFO:tasks.workunit.client.1.smithi161.stdout:7/138: rmdir d3/d1c 0 2024-09-18T12:51:59.079 INFO:tasks.workunit.client.1.smithi161.stdout:1/103: dwrite d1/f1b [0,4194304] 0 2024-09-18T12:51:59.079 INFO:tasks.workunit.client.1.smithi161.stdout:4/168: readlink d5/l30 0 2024-09-18T12:51:59.080 INFO:tasks.workunit.client.1.smithi161.stdout:0/140: write df/f26 [412953,62536] 0 2024-09-18T12:51:59.080 INFO:tasks.workunit.client.1.smithi161.stdout:7/139: symlink d3/l1d 0 2024-09-18T12:51:59.083 INFO:tasks.workunit.client.1.smithi161.stdout:6/161: symlink d4/d1a/d1c/l32 0 2024-09-18T12:51:59.084 INFO:tasks.workunit.client.1.smithi161.stdout:4/169: dread d5/f17 [0,4194304] 0 2024-09-18T12:51:59.086 INFO:tasks.workunit.client.1.smithi161.stdout:1/104: mkdir d1/d1d 0 2024-09-18T12:51:59.088 INFO:tasks.workunit.client.1.smithi161.stdout:1/105: write d1/da/f16 [502180,46637] 0 2024-09-18T12:51:59.088 INFO:tasks.workunit.client.1.smithi161.stdout:0/141: mkdir df/d29/d2d 0 2024-09-18T12:51:59.090 INFO:tasks.workunit.client.1.smithi161.stdout:4/170: dread d5/f20 [0,4194304] 0 2024-09-18T12:51:59.091 INFO:tasks.workunit.client.1.smithi161.stdout:9/158: truncate d0/fa 3388891 0 2024-09-18T12:51:59.093 INFO:tasks.workunit.client.1.smithi161.stdout:1/106: fdatasync d1/da/f18 0 2024-09-18T12:51:59.095 INFO:tasks.workunit.client.1.smithi161.stdout:0/142: creat df/d29/f2e x:0 0 0 2024-09-18T12:51:59.096 INFO:tasks.workunit.client.1.smithi161.stdout:2/199: getdents d0/d4 0 2024-09-18T12:51:59.098 INFO:tasks.workunit.client.1.smithi161.stdout:0/143: stat df/c21 0 2024-09-18T12:51:59.101 INFO:tasks.workunit.client.0.smithi045.stdout:0/12: sync 2024-09-18T12:51:59.101 INFO:tasks.workunit.client.0.smithi045.stdout:1/0: sync 2024-09-18T12:51:59.101 INFO:tasks.workunit.client.1.smithi161.stdout:5/141: dwrite d3/d9/f12 [0,4194304] 0 2024-09-18T12:51:59.101 INFO:tasks.workunit.client.1.smithi161.stdout:1/107: rmdir d1 39 2024-09-18T12:51:59.102 INFO:tasks.workunit.client.1.smithi161.stdout:0/144: fsync df/f22 0 2024-09-18T12:51:59.103 INFO:tasks.workunit.client.1.smithi161.stdout:3/234: dwrite d1/d2e/d14/f44 [0,4194304] 0 2024-09-18T12:51:59.104 INFO:tasks.workunit.client.1.smithi161.stdout:9/159: dread d0/db/f17 [0,4194304] 0 2024-09-18T12:51:59.104 INFO:tasks.workunit.client.0.smithi045.stdout:0/13: creat f4 x:0 0 0 2024-09-18T12:51:59.105 INFO:tasks.workunit.client.0.smithi045.stdout:0/14: chown l1 2804 1 2024-09-18T12:51:59.106 INFO:tasks.workunit.client.0.smithi045.stdout:0/15: readlink l3 0 2024-09-18T12:51:59.106 INFO:tasks.workunit.client.1.smithi161.stdout:6/162: dwrite d4/d1a/f13 [4194304,4194304] 0 2024-09-18T12:51:59.107 INFO:tasks.workunit.client.1.smithi161.stdout:9/160: dread - d0/d16/d12/f15 zero size 2024-09-18T12:51:59.107 INFO:tasks.workunit.client.1.smithi161.stdout:3/235: write d1/d2e/d24/f47 [85942,85350] 0 2024-09-18T12:51:59.109 INFO:tasks.workunit.client.1.smithi161.stdout:6/163: chown d4/d1a/d1c/d22/d26/d20/d28/c2f 900 1 2024-09-18T12:51:59.112 INFO:tasks.workunit.client.0.smithi045.stdout:1/1: mkdir d0 0 2024-09-18T12:51:59.113 INFO:tasks.workunit.client.1.smithi161.stdout:7/140: write d3/f4 [4357868,99969] 0 2024-09-18T12:51:59.115 INFO:tasks.workunit.client.1.smithi161.stdout:7/141: dread - d3/f11 zero size 2024-09-18T12:51:59.115 INFO:tasks.workunit.client.0.smithi045.stdout:0/16: link f4 f5 0 2024-09-18T12:51:59.116 INFO:tasks.workunit.client.1.smithi161.stdout:0/145: symlink df/l2f 0 2024-09-18T12:51:59.117 INFO:tasks.workunit.client.1.smithi161.stdout:5/142: mknod d3/d14/d20/c2f 0 2024-09-18T12:51:59.117 INFO:tasks.workunit.client.1.smithi161.stdout:0/146: fsync df/f1b 0 2024-09-18T12:51:59.118 INFO:tasks.workunit.client.1.smithi161.stdout:9/161: dwrite d0/d16/d12/f14 [0,4194304] 0 2024-09-18T12:51:59.119 INFO:tasks.workunit.client.0.smithi045.stdout:0/17: unlink f5 0 2024-09-18T12:51:59.120 INFO:tasks.workunit.client.1.smithi161.stdout:9/162: read d0/db/f13 [2446516,127700] 0 2024-09-18T12:51:59.121 INFO:tasks.workunit.client.1.smithi161.stdout:1/108: symlink d1/d6/l1e 0 2024-09-18T12:51:59.122 INFO:tasks.workunit.client.1.smithi161.stdout:4/171: getdents d5/d14 0 2024-09-18T12:51:59.123 INFO:tasks.workunit.client.0.smithi045.stdout:0/18: truncate f4 1014778 0 2024-09-18T12:51:59.126 INFO:tasks.workunit.client.1.smithi161.stdout:6/164: symlink d4/d1a/l33 0 2024-09-18T12:51:59.129 INFO:tasks.workunit.client.1.smithi161.stdout:0/147: mkdir df/d30 0 2024-09-18T12:51:59.130 INFO:tasks.workunit.client.1.smithi161.stdout:5/143: dwrite d3/fd [0,4194304] 0 2024-09-18T12:51:59.131 INFO:tasks.workunit.client.0.smithi045.stdout:0/19: dwrite f4 [0,4194304] 0 2024-09-18T12:51:59.132 INFO:tasks.workunit.client.1.smithi161.stdout:7/142: dwrite d3/f17 [0,4194304] 0 2024-09-18T12:51:59.132 INFO:tasks.workunit.client.1.smithi161.stdout:6/165: truncate d4/d1a/d1c/f25 77922 0 2024-09-18T12:51:59.133 INFO:tasks.workunit.client.1.smithi161.stdout:1/109: mkdir d1/da/d1f 0 2024-09-18T12:51:59.134 INFO:tasks.workunit.client.0.smithi045.stdout:0/20: mkdir d6 0 2024-09-18T12:51:59.134 INFO:tasks.workunit.client.1.smithi161.stdout:4/172: creat d5/f36 x:0 0 0 2024-09-18T12:51:59.136 INFO:tasks.workunit.client.1.smithi161.stdout:2/200: getdents d0/d1 0 2024-09-18T12:51:59.137 INFO:tasks.workunit.client.0.smithi045.stdout:0/21: mkdir d6/d7 0 2024-09-18T12:51:59.137 INFO:tasks.workunit.client.0.smithi045.stdout:0/22: read f4 [2317540,43059] 0 2024-09-18T12:51:59.138 INFO:tasks.workunit.client.1.smithi161.stdout:7/143: chown d3/d8/c12 105 1 2024-09-18T12:51:59.139 INFO:tasks.workunit.client.0.smithi045.stdout:0/23: write f4 [4081275,53941] 0 2024-09-18T12:51:59.145 INFO:tasks.workunit.client.1.smithi161.stdout:5/144: write d3/d14/d20/f2e [694355,19114] 0 2024-09-18T12:51:59.145 INFO:tasks.workunit.client.1.smithi161.stdout:7/144: chown d3/d8/lc 2936863 1 2024-09-18T12:51:59.145 INFO:tasks.workunit.client.1.smithi161.stdout:6/166: symlink d4/d1a/d1c/d22/l34 0 2024-09-18T12:51:59.145 INFO:tasks.workunit.client.1.smithi161.stdout:9/163: creat d0/d16/f35 x:0 0 0 2024-09-18T12:51:59.148 INFO:tasks.workunit.client.1.smithi161.stdout:0/148: dwrite df/f23 [4194304,4194304] 0 2024-09-18T12:51:59.150 INFO:tasks.workunit.client.1.smithi161.stdout:2/201: unlink d0/d32/l11 0 2024-09-18T12:51:59.150 INFO:tasks.workunit.client.1.smithi161.stdout:6/167: chown d4/d1a/d1c/d22/d26/c23 13546478 1 2024-09-18T12:51:59.153 INFO:tasks.workunit.client.1.smithi161.stdout:7/145: unlink d3/l1d 0 2024-09-18T12:51:59.154 INFO:tasks.workunit.client.1.smithi161.stdout:6/168: dread - d4/d1a/d1c/f2c zero size 2024-09-18T12:51:59.154 INFO:tasks.workunit.client.1.smithi161.stdout:5/145: truncate d3/d14/d20/f2e 1213851 0 2024-09-18T12:51:59.154 INFO:tasks.workunit.client.1.smithi161.stdout:1/110: getdents d1/d1d 0 2024-09-18T12:51:59.155 INFO:tasks.workunit.client.1.smithi161.stdout:0/149: mknod df/d29/c31 0 2024-09-18T12:51:59.156 INFO:tasks.workunit.client.1.smithi161.stdout:4/173: dwrite d5/f2c [0,4194304] 0 2024-09-18T12:51:59.157 INFO:tasks.workunit.client.1.smithi161.stdout:2/202: mknod d0/d32/d23/c3a 0 2024-09-18T12:51:59.157 INFO:tasks.workunit.client.1.smithi161.stdout:5/146: dread - d3/d9/f15 zero size 2024-09-18T12:51:59.160 INFO:tasks.workunit.client.1.smithi161.stdout:1/111: truncate d1/d6/f9 484006 0 2024-09-18T12:51:59.161 INFO:tasks.workunit.client.1.smithi161.stdout:4/174: creat d5/d27/f37 x:0 0 0 2024-09-18T12:51:59.162 INFO:tasks.workunit.client.1.smithi161.stdout:1/112: dread d1/d6/f13 [0,4194304] 0 2024-09-18T12:51:59.163 INFO:tasks.workunit.client.1.smithi161.stdout:7/146: dread d3/f4 [0,4194304] 0 2024-09-18T12:51:59.163 INFO:tasks.workunit.client.1.smithi161.stdout:1/113: fdatasync d1/d6/f10 0 2024-09-18T12:51:59.163 INFO:tasks.workunit.client.1.smithi161.stdout:2/203: mkdir d0/d1/d3b 0 2024-09-18T12:51:59.165 INFO:tasks.workunit.client.1.smithi161.stdout:0/150: dread df/f26 [0,4194304] 0 2024-09-18T12:51:59.166 INFO:tasks.workunit.client.1.smithi161.stdout:5/147: creat d3/d14/f30 x:0 0 0 2024-09-18T12:51:59.166 INFO:tasks.workunit.client.1.smithi161.stdout:3/236: truncate d1/d2e/d14/f44 726773 0 2024-09-18T12:51:59.170 INFO:tasks.workunit.client.1.smithi161.stdout:6/169: creat d4/d1a/d1c/d22/d26/d20/d28/f35 x:0 0 0 2024-09-18T12:51:59.171 INFO:tasks.workunit.client.1.smithi161.stdout:1/114: creat d1/d6/f20 x:0 0 0 2024-09-18T12:51:59.171 INFO:tasks.workunit.client.1.smithi161.stdout:3/237: chown d1/d2e/d24/d1d/f25 49672074 1 2024-09-18T12:51:59.171 INFO:tasks.workunit.client.1.smithi161.stdout:2/204: mknod d0/d1d/c3c 0 2024-09-18T12:51:59.174 INFO:tasks.workunit.client.1.smithi161.stdout:4/175: dwrite d5/fe [0,4194304] 0 2024-09-18T12:51:59.176 INFO:tasks.workunit.client.1.smithi161.stdout:5/148: chown d3/d14/d20/l22 1467482 1 2024-09-18T12:51:59.177 INFO:tasks.workunit.client.1.smithi161.stdout:3/238: chown d1/d2e/d24/d1d/f2b 445019253 1 2024-09-18T12:51:59.177 INFO:tasks.workunit.client.1.smithi161.stdout:7/147: dwrite d3/f17 [0,4194304] 0 2024-09-18T12:51:59.195 INFO:tasks.workunit.client.1.smithi161.stdout:1/115: dwrite d1/f1b [0,4194304] 0 2024-09-18T12:51:59.197 INFO:tasks.workunit.client.1.smithi161.stdout:2/205: dwrite d0/f38 [0,4194304] 0 2024-09-18T12:51:59.200 INFO:tasks.workunit.client.1.smithi161.stdout:0/151: link f3 df/f32 0 2024-09-18T12:51:59.200 INFO:tasks.workunit.client.1.smithi161.stdout:6/170: dwrite d4/d1a/d1c/d22/d26/d20/d28/f35 [0,4194304] 0 2024-09-18T12:51:59.203 INFO:tasks.workunit.client.1.smithi161.stdout:7/148: creat d3/d8/d15/f1e x:0 0 0 2024-09-18T12:51:59.203 INFO:tasks.workunit.client.1.smithi161.stdout:5/149: dread d3/d14/d20/f2e [0,4194304] 0 2024-09-18T12:51:59.206 INFO:tasks.workunit.client.1.smithi161.stdout:4/176: dwrite d5/f36 [0,4194304] 0 2024-09-18T12:51:59.208 INFO:tasks.workunit.client.1.smithi161.stdout:5/150: read - d3/d14/f30 zero size 2024-09-18T12:51:59.208 INFO:tasks.workunit.client.1.smithi161.stdout:1/116: creat d1/d1d/f21 x:0 0 0 2024-09-18T12:51:59.208 INFO:tasks.workunit.client.1.smithi161.stdout:7/149: fdatasync d3/f4 0 2024-09-18T12:51:59.211 INFO:tasks.workunit.client.1.smithi161.stdout:4/177: chown d5/d14 7 1 2024-09-18T12:51:59.211 INFO:tasks.workunit.client.1.smithi161.stdout:3/239: dwrite d1/d2e/d24/f3a [0,4194304] 0 2024-09-18T12:51:59.216 INFO:tasks.workunit.client.1.smithi161.stdout:3/240: write d1/d2e/d24/f3a [4286383,41632] 0 2024-09-18T12:51:59.218 INFO:tasks.workunit.client.1.smithi161.stdout:5/151: mknod d3/d14/d20/d21/c31 0 2024-09-18T12:51:59.218 INFO:tasks.workunit.client.1.smithi161.stdout:6/171: dwrite d4/f17 [0,4194304] 0 2024-09-18T12:51:59.219 INFO:tasks.workunit.client.1.smithi161.stdout:7/150: symlink d3/d8/l1f 0 2024-09-18T12:51:59.221 INFO:tasks.workunit.client.1.smithi161.stdout:2/206: fsync d0/d1/df/f1b 0 2024-09-18T12:51:59.222 INFO:tasks.workunit.client.1.smithi161.stdout:2/207: chown d0/d5/c31 119 1 2024-09-18T12:51:59.223 INFO:tasks.workunit.client.1.smithi161.stdout:1/117: truncate d1/ff 3613997 0 2024-09-18T12:51:59.224 INFO:tasks.workunit.client.1.smithi161.stdout:3/241: unlink d1/d2e/c48 0 2024-09-18T12:51:59.226 INFO:tasks.workunit.client.1.smithi161.stdout:7/151: mkdir d3/d8/d20 0 2024-09-18T12:51:59.227 INFO:tasks.workunit.client.1.smithi161.stdout:1/118: truncate d1/d1d/f21 523391 0 2024-09-18T12:51:59.229 INFO:tasks.workunit.client.1.smithi161.stdout:6/172: rename d4/d1a/d1c/d22/l2e to d4/d1a/d1c/d22/d26/d18/l36 0 2024-09-18T12:51:59.231 INFO:tasks.workunit.client.1.smithi161.stdout:4/178: getdents d5/d14 0 2024-09-18T12:51:59.233 INFO:tasks.workunit.client.1.smithi161.stdout:2/208: mkdir d0/d1/d3b/d3d 0 2024-09-18T12:51:59.235 INFO:tasks.workunit.client.1.smithi161.stdout:5/152: dwrite d3/d9/f15 [0,4194304] 0 2024-09-18T12:51:59.239 INFO:tasks.workunit.client.1.smithi161.stdout:0/152: dread fd [0,4194304] 0 2024-09-18T12:51:59.239 INFO:tasks.workunit.client.1.smithi161.stdout:3/242: dread d1/d2e/d24/f1f [0,4194304] 0 2024-09-18T12:51:59.239 INFO:tasks.workunit.client.1.smithi161.stdout:6/173: creat d4/d1a/d1c/d22/d26/d20/d28/f37 x:0 0 0 2024-09-18T12:51:59.240 INFO:tasks.workunit.client.1.smithi161.stdout:4/179: creat d5/d32/f38 x:0 0 0 2024-09-18T12:51:59.241 INFO:tasks.workunit.client.1.smithi161.stdout:2/209: creat d0/d32/d35/f3e x:0 0 0 2024-09-18T12:51:59.243 INFO:tasks.workunit.client.1.smithi161.stdout:6/174: symlink d4/d1a/l38 0 2024-09-18T12:51:59.245 INFO:tasks.workunit.client.1.smithi161.stdout:7/152: getdents d3/d8 0 2024-09-18T12:51:59.246 INFO:tasks.workunit.client.1.smithi161.stdout:1/119: getdents d1/d6 0 2024-09-18T12:51:59.247 INFO:tasks.workunit.client.1.smithi161.stdout:1/120: write d1/d6/f20 [680195,128117] 0 2024-09-18T12:51:59.249 INFO:tasks.workunit.client.1.smithi161.stdout:5/153: truncate d3/d9/f12 3774258 0 2024-09-18T12:51:59.250 INFO:tasks.workunit.client.1.smithi161.stdout:7/153: unlink d3/d8/c10 0 2024-09-18T12:51:59.251 INFO:tasks.workunit.client.1.smithi161.stdout:0/153: link df/c21 df/d30/c33 0 2024-09-18T12:51:59.253 INFO:tasks.workunit.client.1.smithi161.stdout:4/180: rmdir d5/d14/d33 0 2024-09-18T12:51:59.254 INFO:tasks.workunit.client.1.smithi161.stdout:2/210: rename d0/d4/f39 to d0/d1/f3f 0 2024-09-18T12:51:59.255 INFO:tasks.workunit.client.1.smithi161.stdout:1/121: symlink d1/da/d1f/l22 0 2024-09-18T12:51:59.258 INFO:tasks.workunit.client.1.smithi161.stdout:4/181: rmdir d5 39 2024-09-18T12:51:59.259 INFO:tasks.workunit.client.1.smithi161.stdout:6/175: rename d4/d1a/d1c/d22 to d4/d39 0 2024-09-18T12:51:59.259 INFO:tasks.workunit.client.1.smithi161.stdout:0/154: mknod df/d30/c34 0 2024-09-18T12:51:59.259 INFO:tasks.workunit.client.1.smithi161.stdout:1/122: write d1/d6/f7 [2648611,29809] 0 2024-09-18T12:51:59.262 INFO:tasks.workunit.client.1.smithi161.stdout:4/182: stat d5/d27/f35 0 2024-09-18T12:51:59.263 INFO:tasks.workunit.client.1.smithi161.stdout:1/123: mknod d1/da/c23 0 2024-09-18T12:51:59.263 INFO:tasks.workunit.client.1.smithi161.stdout:0/155: symlink df/d29/l35 0 2024-09-18T12:51:59.264 INFO:tasks.workunit.client.1.smithi161.stdout:3/243: dread d1/d2e/d3d/f7 [0,4194304] 0 2024-09-18T12:51:59.266 INFO:tasks.workunit.client.1.smithi161.stdout:4/183: mkdir d5/d32/d39 0 2024-09-18T12:51:59.266 INFO:tasks.workunit.client.1.smithi161.stdout:2/211: dwrite d0/d32/f18 [0,4194304] 0 2024-09-18T12:51:59.266 INFO:tasks.workunit.client.1.smithi161.stdout:1/124: rmdir d1/da/d1f 39 2024-09-18T12:51:59.267 INFO:tasks.workunit.client.1.smithi161.stdout:0/156: mkdir df/d29/d36 0 2024-09-18T12:51:59.269 INFO:tasks.workunit.client.1.smithi161.stdout:3/244: mkdir d1/d2e/d3d/d53 0 2024-09-18T12:51:59.269 INFO:tasks.workunit.client.1.smithi161.stdout:4/184: mkdir d5/d27/d3a 0 2024-09-18T12:51:59.272 INFO:tasks.workunit.client.1.smithi161.stdout:1/125: creat d1/d6/f24 x:0 0 0 2024-09-18T12:51:59.272 INFO:tasks.workunit.client.1.smithi161.stdout:2/212: truncate d0/d4/f2a 707583 0 2024-09-18T12:51:59.273 INFO:tasks.workunit.client.1.smithi161.stdout:4/185: mknod d5/d27/c3b 0 2024-09-18T12:51:59.273 INFO:tasks.workunit.client.1.smithi161.stdout:0/157: write df/f15 [1122286,19512] 0 2024-09-18T12:51:59.274 INFO:tasks.workunit.client.1.smithi161.stdout:8/226: sync 2024-09-18T12:51:59.276 INFO:tasks.workunit.client.1.smithi161.stdout:7/154: dwrite d3/f6 [4194304,4194304] 0 2024-09-18T12:51:59.278 INFO:tasks.workunit.client.1.smithi161.stdout:1/126: fsync d1/d6/f8 0 2024-09-18T12:51:59.278 INFO:tasks.workunit.client.1.smithi161.stdout:4/186: dread - d5/d14/f23 zero size 2024-09-18T12:51:59.280 INFO:tasks.workunit.client.1.smithi161.stdout:0/158: mkdir df/d29/d2d/d37 0 2024-09-18T12:51:59.281 INFO:tasks.workunit.client.1.smithi161.stdout:4/187: stat d5/la 0 2024-09-18T12:51:59.283 INFO:tasks.workunit.client.1.smithi161.stdout:2/213: rename d0/d1/df/f16 to d0/d1/df/f40 0 2024-09-18T12:51:59.284 INFO:tasks.workunit.client.1.smithi161.stdout:1/127: symlink d1/d1d/l25 0 2024-09-18T12:51:59.286 INFO:tasks.workunit.client.1.smithi161.stdout:4/188: fsync d5/f17 0 2024-09-18T12:51:59.286 INFO:tasks.workunit.client.1.smithi161.stdout:5/154: dwrite d3/d9/f12 [0,4194304] 0 2024-09-18T12:51:59.288 INFO:tasks.workunit.client.1.smithi161.stdout:8/227: link d0/d3/fb d0/d3/d10/d21/f49 0 2024-09-18T12:51:59.289 INFO:tasks.workunit.client.1.smithi161.stdout:1/128: write d1/d6/f13 [186498,26465] 0 2024-09-18T12:51:59.291 INFO:tasks.workunit.client.1.smithi161.stdout:5/155: creat d3/d14/d20/f32 x:0 0 0 2024-09-18T12:51:59.293 INFO:tasks.workunit.client.1.smithi161.stdout:2/214: getdents d0/d32 0 2024-09-18T12:51:59.294 INFO:tasks.workunit.client.1.smithi161.stdout:3/245: dwrite d1/d2e/f17 [0,4194304] 0 2024-09-18T12:51:59.295 INFO:tasks.workunit.client.1.smithi161.stdout:8/228: mkdir d0/d3/d10/d21/d4a 0 2024-09-18T12:51:59.295 INFO:tasks.workunit.client.1.smithi161.stdout:2/215: readlink d0/d1d/l1f 0 2024-09-18T12:51:59.298 INFO:tasks.workunit.client.1.smithi161.stdout:5/156: creat d3/f33 x:0 0 0 2024-09-18T12:51:59.300 INFO:tasks.workunit.client.1.smithi161.stdout:0/159: dwrite fd [0,4194304] 0 2024-09-18T12:51:59.301 INFO:tasks.workunit.client.1.smithi161.stdout:3/246: write d1/d2e/d24/f3a [4283298,116871] 0 2024-09-18T12:51:59.302 INFO:tasks.workunit.client.1.smithi161.stdout:8/229: fdatasync d0/d3/d10/d21/f48 0 2024-09-18T12:51:59.303 INFO:tasks.workunit.client.1.smithi161.stdout:2/216: truncate d0/d1/f3f 1017355 0 2024-09-18T12:51:59.303 INFO:tasks.workunit.client.1.smithi161.stdout:8/230: chown d0/ce 1365781 1 2024-09-18T12:51:59.304 INFO:tasks.workunit.client.1.smithi161.stdout:5/157: creat d3/d9/f34 x:0 0 0 2024-09-18T12:51:59.306 INFO:tasks.workunit.client.1.smithi161.stdout:7/155: write d3/f14 [925055,15695] 0 2024-09-18T12:51:59.306 INFO:tasks.workunit.client.1.smithi161.stdout:1/129: rename d1/d6 to d1/d26 0 2024-09-18T12:51:59.306 INFO:tasks.workunit.client.1.smithi161.stdout:2/217: dread d0/d1/f3f [0,4194304] 0 2024-09-18T12:51:59.308 INFO:tasks.workunit.client.1.smithi161.stdout:0/160: unlink f3 0 2024-09-18T12:51:59.310 INFO:tasks.workunit.client.1.smithi161.stdout:5/158: creat d3/f35 x:0 0 0 2024-09-18T12:51:59.311 INFO:tasks.workunit.client.1.smithi161.stdout:5/159: fsync d3/d14/f19 0 2024-09-18T12:51:59.312 INFO:tasks.workunit.client.1.smithi161.stdout:5/160: write d3/fd [4240707,64766] 0 2024-09-18T12:51:59.312 INFO:tasks.workunit.client.1.smithi161.stdout:5/161: fdatasync d3/f33 0 2024-09-18T12:51:59.316 INFO:tasks.workunit.client.1.smithi161.stdout:8/231: rename d0/ce to d0/d3/d10/d21/c4b 0 2024-09-18T12:51:59.317 INFO:tasks.workunit.client.1.smithi161.stdout:1/130: readlink d1/da/d1f/l22 0 2024-09-18T12:51:59.317 INFO:tasks.workunit.client.1.smithi161.stdout:4/189: truncate d5/f2c 3158516 0 2024-09-18T12:51:59.317 INFO:tasks.workunit.client.1.smithi161.stdout:1/131: readlink d1/d26/l1e 0 2024-09-18T12:51:59.317 INFO:tasks.workunit.client.1.smithi161.stdout:0/161: creat df/d30/f38 x:0 0 0 2024-09-18T12:51:59.317 INFO:tasks.workunit.client.1.smithi161.stdout:3/247: creat d1/f54 x:0 0 0 2024-09-18T12:51:59.318 INFO:tasks.workunit.client.1.smithi161.stdout:8/232: creat d0/d3/d1e/f4c x:0 0 0 2024-09-18T12:51:59.318 INFO:tasks.workunit.client.1.smithi161.stdout:0/162: write df/f23 [9339992,43389] 0 2024-09-18T12:51:59.319 INFO:tasks.workunit.client.1.smithi161.stdout:5/162: rename d3/d9/f18 to d3/d14/d20/d21/d24/f36 0 2024-09-18T12:51:59.321 INFO:tasks.workunit.client.1.smithi161.stdout:5/163: stat d3/d14 0 2024-09-18T12:51:59.323 INFO:tasks.workunit.client.1.smithi161.stdout:2/218: link d0/d32/d35/f3e d0/f41 0 2024-09-18T12:51:59.323 INFO:tasks.workunit.client.1.smithi161.stdout:8/233: mknod d0/d3/d10/c4d 0 2024-09-18T12:51:59.324 INFO:tasks.workunit.client.1.smithi161.stdout:4/190: dread d5/f20 [0,4194304] 0 2024-09-18T12:51:59.324 INFO:tasks.workunit.client.1.smithi161.stdout:3/248: write d1/d2e/d3d/f38 [4733231,45346] 0 2024-09-18T12:51:59.324 INFO:tasks.workunit.client.1.smithi161.stdout:0/163: mknod df/d29/d2d/c39 0 2024-09-18T12:51:59.325 INFO:tasks.workunit.client.1.smithi161.stdout:5/164: chown d3/d9/f34 1 1 2024-09-18T12:51:59.325 INFO:tasks.workunit.client.1.smithi161.stdout:1/132: dwrite d1/fc [0,4194304] 0 2024-09-18T12:51:59.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/133: write d1/fc [402010,76394] 0 2024-09-18T12:51:59.330 INFO:tasks.workunit.client.1.smithi161.stdout:2/219: creat d0/d1/d3b/f42 x:0 0 0 2024-09-18T12:51:59.331 INFO:tasks.workunit.client.1.smithi161.stdout:1/134: stat d1/d26/f13 0 2024-09-18T12:51:59.336 INFO:tasks.workunit.client.1.smithi161.stdout:4/191: creat d5/d27/d3a/f3c x:0 0 0 2024-09-18T12:51:59.337 INFO:tasks.workunit.client.1.smithi161.stdout:1/135: symlink d1/d26/d17/l27 0 2024-09-18T12:51:59.341 INFO:tasks.workunit.client.1.smithi161.stdout:1/136: readlink d1/d26/l1e 0 2024-09-18T12:51:59.342 INFO:tasks.workunit.client.1.smithi161.stdout:2/220: rename d0/d32 to d0/d5/d43 0 2024-09-18T12:51:59.342 INFO:tasks.workunit.client.1.smithi161.stdout:3/249: dwrite d1/f50 [0,4194304] 0 2024-09-18T12:51:59.343 INFO:tasks.workunit.client.1.smithi161.stdout:8/234: dwrite d0/d3/d10/d21/f48 [0,4194304] 0 2024-09-18T12:51:59.351 INFO:tasks.workunit.client.1.smithi161.stdout:4/192: getdents d5/d14 0 2024-09-18T12:51:59.354 INFO:tasks.workunit.client.1.smithi161.stdout:1/137: truncate d1/ff 3174024 0 2024-09-18T12:51:59.361 INFO:tasks.workunit.client.0.smithi045.stdout:4/82: sync 2024-09-18T12:51:59.361 INFO:tasks.workunit.client.0.smithi045.stdout:8/16: sync 2024-09-18T12:51:59.361 INFO:tasks.workunit.client.0.smithi045.stdout:7/29: sync 2024-09-18T12:51:59.361 INFO:tasks.workunit.client.0.smithi045.stdout:8/17: rmdir - no directory 2024-09-18T12:51:59.361 INFO:tasks.workunit.client.0.smithi045.stdout:3/50: sync 2024-09-18T12:51:59.361 INFO:tasks.workunit.client.0.smithi045.stdout:2/16: sync 2024-09-18T12:51:59.362 INFO:tasks.workunit.client.0.smithi045.stdout:9/11: sync 2024-09-18T12:51:59.362 INFO:tasks.workunit.client.0.smithi045.stdout:6/89: sync 2024-09-18T12:51:59.362 INFO:tasks.workunit.client.0.smithi045.stdout:5/29: sync 2024-09-18T12:51:59.363 INFO:tasks.workunit.client.0.smithi045.stdout:4/83: chown fa 1857 1 2024-09-18T12:51:59.364 INFO:tasks.workunit.client.1.smithi161.stdout:2/221: dwrite d0/d1/f3 [0,4194304] 0 2024-09-18T12:51:59.364 INFO:tasks.workunit.client.0.smithi045.stdout:8/18: dread - f7 zero size 2024-09-18T12:51:59.365 INFO:tasks.workunit.client.0.smithi045.stdout:5/30: write d6/f7 [1229700,81659] 0 2024-09-18T12:51:59.367 INFO:tasks.workunit.client.0.smithi045.stdout:9/12: mknod d0/d3/c5 0 2024-09-18T12:51:59.367 INFO:tasks.workunit.client.0.smithi045.stdout:8/19: chown f0 12990 1 2024-09-18T12:51:59.367 INFO:tasks.workunit.client.1.smithi161.stdout:0/164: dwrite df/d29/f2c [0,4194304] 0 2024-09-18T12:51:59.368 INFO:tasks.workunit.client.0.smithi045.stdout:6/90: mkdir d9/d1a/d1d 0 2024-09-18T12:51:59.369 INFO:tasks.workunit.client.0.smithi045.stdout:8/20: read - f0 zero size 2024-09-18T12:51:59.369 INFO:tasks.workunit.client.0.smithi045.stdout:5/31: write d6/f7 [1578139,109418] 0 2024-09-18T12:51:59.370 INFO:tasks.workunit.client.1.smithi161.stdout:5/165: dread d3/f13 [0,4194304] 0 2024-09-18T12:51:59.373 INFO:tasks.workunit.client.1.smithi161.stdout:8/235: dwrite d0/f16 [0,4194304] 0 2024-09-18T12:51:59.374 INFO:tasks.workunit.client.1.smithi161.stdout:3/250: dwrite d1/d2e/f37 [4194304,4194304] 0 2024-09-18T12:51:59.378 INFO:tasks.workunit.client.1.smithi161.stdout:4/193: dwrite d5/d32/f38 [0,4194304] 0 2024-09-18T12:51:59.380 INFO:tasks.workunit.client.1.smithi161.stdout:2/222: creat d0/d5/d43/d35/f44 x:0 0 0 2024-09-18T12:51:59.382 INFO:tasks.workunit.client.1.smithi161.stdout:8/236: symlink d0/d3/d1e/l4e 0 2024-09-18T12:51:59.382 INFO:tasks.workunit.client.1.smithi161.stdout:1/138: dwrite d1/fc [0,4194304] 0 2024-09-18T12:51:59.384 INFO:tasks.workunit.client.1.smithi161.stdout:8/237: write d0/d3/d10/f3f [4247317,81513] 0 2024-09-18T12:51:59.385 INFO:tasks.workunit.client.1.smithi161.stdout:5/166: dread d3/d9/f12 [0,4194304] 0 2024-09-18T12:51:59.393 INFO:tasks.workunit.client.1.smithi161.stdout:4/194: creat d5/d27/d3a/f3d x:0 0 0 2024-09-18T12:51:59.397 INFO:tasks.workunit.client.0.smithi045.stdout:2/17: creat d5/f7 x:0 0 0 2024-09-18T12:51:59.400 INFO:tasks.workunit.client.1.smithi161.stdout:2/223: creat d0/d5/d43/f45 x:0 0 0 2024-09-18T12:51:59.404 INFO:tasks.workunit.client.0.smithi045.stdout:7/30: dwrite f2 [0,4194304] 0 2024-09-18T12:51:59.405 INFO:tasks.workunit.client.0.smithi045.stdout:3/51: dwrite d0/fe [4194304,4194304] 0 2024-09-18T12:51:59.407 INFO:tasks.workunit.client.0.smithi045.stdout:8/21: link f5 f8 0 2024-09-18T12:51:59.411 INFO:tasks.workunit.client.0.smithi045.stdout:3/52: chown d0/fe 3661 1 2024-09-18T12:51:59.411 INFO:tasks.workunit.client.0.smithi045.stdout:5/32: dwrite d6/f7 [0,4194304] 0 2024-09-18T12:51:59.412 INFO:tasks.workunit.client.0.smithi045.stdout:2/18: dread - d5/f7 zero size 2024-09-18T12:51:59.413 INFO:tasks.workunit.client.0.smithi045.stdout:9/13: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:51:59.414 INFO:tasks.workunit.client.1.smithi161.stdout:0/165: creat df/d30/f3a x:0 0 0 2024-09-18T12:51:59.414 INFO:tasks.workunit.client.1.smithi161.stdout:4/195: symlink d5/d27/d3a/l3e 0 2024-09-18T12:51:59.415 INFO:tasks.workunit.client.0.smithi045.stdout:8/22: truncate f0 211643 0 2024-09-18T12:51:59.417 INFO:tasks.workunit.client.0.smithi045.stdout:6/91: dwrite d9/fc [0,4194304] 0 2024-09-18T12:51:59.417 INFO:tasks.workunit.client.0.smithi045.stdout:4/84: dread fa [0,4194304] 0 2024-09-18T12:51:59.418 INFO:tasks.workunit.client.0.smithi045.stdout:3/53: rename d0 to d0/d11 22 2024-09-18T12:51:59.419 INFO:tasks.workunit.client.1.smithi161.stdout:8/238: creat d0/d3/d10/d21/d4a/f4f x:0 0 0 2024-09-18T12:51:59.421 INFO:tasks.workunit.client.1.smithi161.stdout:0/166: write df/f1c [82757,86236] 0 2024-09-18T12:51:59.421 INFO:tasks.workunit.client.0.smithi045.stdout:8/23: chown l1 76 1 2024-09-18T12:51:59.425 INFO:tasks.workunit.client.0.smithi045.stdout:4/85: fsync db/f21 0 2024-09-18T12:51:59.425 INFO:tasks.workunit.client.0.smithi045.stdout:5/33: symlink d6/l9 0 2024-09-18T12:51:59.430 INFO:tasks.workunit.client.1.smithi161.stdout:1/139: creat d1/f28 x:0 0 0 2024-09-18T12:51:59.430 INFO:tasks.workunit.client.0.smithi045.stdout:2/19: chown d5/f7 227256 1 2024-09-18T12:51:59.432 INFO:tasks.workunit.client.1.smithi161.stdout:1/140: fdatasync d1/d26/fb 0 2024-09-18T12:51:59.432 INFO:tasks.workunit.client.1.smithi161.stdout:4/196: dwrite d5/f20 [0,4194304] 0 2024-09-18T12:51:59.433 INFO:tasks.workunit.client.1.smithi161.stdout:1/141: stat d1/d26/f10 0 2024-09-18T12:51:59.433 INFO:tasks.workunit.client.1.smithi161.stdout:4/197: dread - d5/d14/f23 zero size 2024-09-18T12:51:59.433 INFO:tasks.workunit.client.0.smithi045.stdout:9/14: mkdir d0/d3/d6 0 2024-09-18T12:51:59.433 INFO:tasks.workunit.client.0.smithi045.stdout:8/24: unlink f8 0 2024-09-18T12:51:59.434 INFO:tasks.workunit.client.0.smithi045.stdout:2/20: truncate d5/f7 836797 0 2024-09-18T12:51:59.436 INFO:tasks.workunit.client.0.smithi045.stdout:6/92: truncate d9/f19 3639233 0 2024-09-18T12:51:59.440 INFO:tasks.workunit.client.1.smithi161.stdout:8/239: dwrite d0/f9 [0,4194304] 0 2024-09-18T12:51:59.440 INFO:tasks.workunit.client.1.smithi161.stdout:9/164: sync 2024-09-18T12:51:59.441 INFO:tasks.workunit.client.1.smithi161.stdout:3/251: dread d1/d2e/d3d/f39 [0,4194304] 0 2024-09-18T12:51:59.442 INFO:tasks.workunit.client.0.smithi045.stdout:2/21: dread d5/f7 [0,4194304] 0 2024-09-18T12:51:59.442 INFO:tasks.workunit.client.1.smithi161.stdout:0/167: readlink df/l2a 0 2024-09-18T12:51:59.443 INFO:tasks.workunit.client.0.smithi045.stdout:2/22: truncate d5/f7 928859 0 2024-09-18T12:51:59.444 INFO:tasks.workunit.client.0.smithi045.stdout:5/34: rename d6/l8 to d6/la 0 2024-09-18T12:51:59.445 INFO:tasks.workunit.client.1.smithi161.stdout:8/240: dread d0/f16 [0,4194304] 0 2024-09-18T12:51:59.447 INFO:tasks.workunit.client.0.smithi045.stdout:7/31: dwrite f2 [0,4194304] 0 2024-09-18T12:51:59.449 INFO:tasks.workunit.client.0.smithi045.stdout:8/25: chown f5 13819 1 2024-09-18T12:51:59.450 INFO:tasks.workunit.client.0.smithi045.stdout:4/86: dwrite db/d10/d13/f14 [0,4194304] 0 2024-09-18T12:51:59.451 INFO:tasks.workunit.client.0.smithi045.stdout:2/23: creat d5/f8 x:0 0 0 2024-09-18T12:51:59.455 INFO:tasks.workunit.client.0.smithi045.stdout:9/15: dread d0/f2 [0,4194304] 0 2024-09-18T12:51:59.459 INFO:tasks.workunit.client.1.smithi161.stdout:8/241: dread d0/f12 [0,4194304] 0 2024-09-18T12:51:59.460 INFO:tasks.workunit.client.0.smithi045.stdout:5/35: mkdir d6/db 0 2024-09-18T12:51:59.463 INFO:tasks.workunit.client.0.smithi045.stdout:5/36: dread d6/f7 [0,4194304] 0 2024-09-18T12:51:59.511 INFO:tasks.workunit.client.0.smithi045.stdout:7/32: creat f3 x:0 0 0 2024-09-18T12:51:59.512 INFO:tasks.workunit.client.1.smithi161.stdout:5/167: getdents d3/d14/d20/d21 0 2024-09-18T12:51:59.514 INFO:tasks.workunit.client.0.smithi045.stdout:3/54: truncate d0/fb 1963548 0 2024-09-18T12:51:59.515 INFO:tasks.workunit.client.0.smithi045.stdout:3/55: read d0/fe [3643069,37272] 0 2024-09-18T12:51:59.516 INFO:tasks.workunit.client.1.smithi161.stdout:5/168: dread d3/d9/f15 [0,4194304] 0 2024-09-18T12:51:59.517 INFO:tasks.workunit.client.0.smithi045.stdout:4/87: stat db/de/c17 0 2024-09-18T12:51:59.518 INFO:tasks.workunit.client.1.smithi161.stdout:5/169: dread d3/d14/d20/f2e [0,4194304] 0 2024-09-18T12:51:59.519 INFO:tasks.workunit.client.1.smithi161.stdout:4/198: creat d5/d14/f3f x:0 0 0 2024-09-18T12:51:59.524 INFO:tasks.workunit.client.1.smithi161.stdout:5/170: dwrite d3/d14/f30 [0,4194304] 0 2024-09-18T12:51:59.524 INFO:tasks.workunit.client.1.smithi161.stdout:3/252: symlink d1/d2e/d14/l55 0 2024-09-18T12:51:59.525 INFO:tasks.workunit.client.0.smithi045.stdout:5/37: rmdir d6 39 2024-09-18T12:51:59.526 INFO:tasks.workunit.client.1.smithi161.stdout:0/168: fdatasync df/f28 0 2024-09-18T12:51:59.530 INFO:tasks.workunit.client.0.smithi045.stdout:7/33: symlink l4 0 2024-09-18T12:51:59.531 INFO:tasks.workunit.client.0.smithi045.stdout:7/34: fsync f3 0 2024-09-18T12:51:59.531 INFO:tasks.workunit.client.0.smithi045.stdout:7/35: chown f2 787 1 2024-09-18T12:51:59.532 INFO:tasks.workunit.client.1.smithi161.stdout:8/242: creat d0/d3/d1e/f50 x:0 0 0 2024-09-18T12:51:59.533 INFO:tasks.workunit.client.1.smithi161.stdout:6/176: sync 2024-09-18T12:51:59.534 INFO:tasks.workunit.client.1.smithi161.stdout:6/177: write d4/d39/d26/d20/d28/f35 [2922887,102500] 0 2024-09-18T12:51:59.534 INFO:tasks.workunit.client.0.smithi045.stdout:6/93: symlink d9/d1a/d1d/l1e 0 2024-09-18T12:51:59.537 INFO:tasks.workunit.client.1.smithi161.stdout:2/224: link d0/d1/l14 d0/d1/df/l46 0 2024-09-18T12:51:59.542 INFO:tasks.workunit.client.0.smithi045.stdout:4/88: rmdir db/d1b 39 2024-09-18T12:51:59.547 INFO:tasks.workunit.client.1.smithi161.stdout:3/253: rename d1/d2e/d24/d1d/f25 to d1/d2e/d14/f56 0 2024-09-18T12:51:59.550 INFO:tasks.workunit.client.0.smithi045.stdout:2/24: rename d5/f7 to d5/f9 0 2024-09-18T12:51:59.550 INFO:tasks.workunit.client.0.smithi045.stdout:7/36: mknod c5 0 2024-09-18T12:51:59.550 INFO:tasks.workunit.client.1.smithi161.stdout:8/243: rmdir d0/d3/d1e/d34 39 2024-09-18T12:51:59.551 INFO:tasks.workunit.client.0.smithi045.stdout:7/37: read - f3 zero size 2024-09-18T12:51:59.551 INFO:tasks.workunit.client.0.smithi045.stdout:6/94: chown d9/f19 11488829 1 2024-09-18T12:51:59.552 INFO:tasks.workunit.client.0.smithi045.stdout:3/56: fdatasync d0/fb 0 2024-09-18T12:51:59.553 INFO:tasks.workunit.client.0.smithi045.stdout:4/89: unlink db/de/c16 0 2024-09-18T12:51:59.554 INFO:tasks.workunit.client.0.smithi045.stdout:3/57: write d0/d7/f10 [869480,125099] 0 2024-09-18T12:51:59.556 INFO:tasks.workunit.client.0.smithi045.stdout:3/58: write d0/d7/f10 [293827,12628] 0 2024-09-18T12:51:59.556 INFO:tasks.workunit.client.1.smithi161.stdout:4/199: creat d5/d32/d39/f40 x:0 0 0 2024-09-18T12:51:59.557 INFO:tasks.workunit.client.1.smithi161.stdout:4/200: dread - d5/d32/d39/f40 zero size 2024-09-18T12:51:59.558 INFO:tasks.workunit.client.0.smithi045.stdout:7/38: dwrite f3 [0,4194304] 0 2024-09-18T12:51:59.560 INFO:tasks.workunit.client.1.smithi161.stdout:4/201: dread d5/f8 [4194304,4194304] 0 2024-09-18T12:51:59.562 INFO:tasks.workunit.client.1.smithi161.stdout:6/178: rename d4/d39/d26/d18 to d4/d39/d3a 0 2024-09-18T12:51:59.563 INFO:tasks.workunit.client.1.smithi161.stdout:6/179: write d4/d1a/f14 [1242351,60963] 0 2024-09-18T12:51:59.564 INFO:tasks.workunit.client.1.smithi161.stdout:3/254: mknod d1/d2e/d14/c57 0 2024-09-18T12:51:59.567 INFO:tasks.workunit.client.1.smithi161.stdout:0/169: creat df/d29/f3b x:0 0 0 2024-09-18T12:51:59.568 INFO:tasks.workunit.client.1.smithi161.stdout:8/244: mknod d0/d3/d10/d21/d4a/c51 0 2024-09-18T12:51:59.570 INFO:tasks.workunit.client.1.smithi161.stdout:5/171: link d3/d8/l16 d3/d14/d20/l37 0 2024-09-18T12:51:59.571 INFO:tasks.workunit.client.1.smithi161.stdout:6/180: dwrite d4/d1a/f14 [0,4194304] 0 2024-09-18T12:51:59.571 INFO:tasks.workunit.client.1.smithi161.stdout:5/172: readlink d3/d9/l17 0 2024-09-18T12:51:59.572 INFO:tasks.workunit.client.1.smithi161.stdout:6/181: fsync d4/f17 0 2024-09-18T12:51:59.572 INFO:tasks.workunit.client.1.smithi161.stdout:4/202: symlink d5/d27/l41 0 2024-09-18T12:51:59.574 INFO:tasks.workunit.client.1.smithi161.stdout:3/255: fdatasync d1/d2e/d3d/f39 0 2024-09-18T12:51:59.575 INFO:tasks.workunit.client.1.smithi161.stdout:3/256: chown d1/d2e/f17 174124 1 2024-09-18T12:51:59.577 INFO:tasks.workunit.client.1.smithi161.stdout:2/225: creat d0/d5/f47 x:0 0 0 2024-09-18T12:51:59.578 INFO:tasks.workunit.client.1.smithi161.stdout:8/245: mkdir d0/d3/d10/d21/d4a/d52 0 2024-09-18T12:51:59.580 INFO:tasks.workunit.client.1.smithi161.stdout:8/246: write d0/d3/d1e/f50 [495127,2278] 0 2024-09-18T12:51:59.582 INFO:tasks.workunit.client.1.smithi161.stdout:5/173: creat d3/d9/f38 x:0 0 0 2024-09-18T12:51:59.583 INFO:tasks.workunit.client.1.smithi161.stdout:0/170: dwrite df/f25 [0,4194304] 0 2024-09-18T12:51:59.584 INFO:tasks.workunit.client.1.smithi161.stdout:7/156: sync 2024-09-18T12:51:59.584 INFO:tasks.workunit.client.1.smithi161.stdout:1/142: sync 2024-09-18T12:51:59.584 INFO:tasks.workunit.client.1.smithi161.stdout:4/203: creat d5/d32/f42 x:0 0 0 2024-09-18T12:51:59.584 INFO:tasks.workunit.client.1.smithi161.stdout:5/174: readlink d3/d14/d20/l22 0 2024-09-18T12:51:59.585 INFO:tasks.workunit.client.1.smithi161.stdout:6/182: creat d4/d39/d26/d20/d28/f3b x:0 0 0 2024-09-18T12:51:59.586 INFO:tasks.workunit.client.1.smithi161.stdout:4/204: read - d5/d27/d3a/f3d zero size 2024-09-18T12:51:59.591 INFO:tasks.workunit.client.1.smithi161.stdout:1/143: dwrite d1/d26/f13 [0,4194304] 0 2024-09-18T12:51:59.600 INFO:tasks.workunit.client.1.smithi161.stdout:0/171: rmdir df/d29 39 2024-09-18T12:51:59.605 INFO:tasks.workunit.client.1.smithi161.stdout:5/175: rmdir d3/d14/d20/d21/d24 39 2024-09-18T12:51:59.607 INFO:tasks.workunit.client.1.smithi161.stdout:4/205: creat d5/d27/d3a/f43 x:0 0 0 2024-09-18T12:51:59.609 INFO:tasks.workunit.client.1.smithi161.stdout:6/183: rename d4/f17 to d4/d39/d3a/f3c 0 2024-09-18T12:51:59.609 INFO:tasks.workunit.client.1.smithi161.stdout:5/176: dread d3/d14/f30 [0,4194304] 0 2024-09-18T12:51:59.610 INFO:tasks.workunit.client.1.smithi161.stdout:6/184: truncate d4/d1a/d1c/f25 598634 0 2024-09-18T12:51:59.611 INFO:tasks.workunit.client.1.smithi161.stdout:2/226: mknod d0/c48 0 2024-09-18T12:51:59.614 INFO:tasks.workunit.client.1.smithi161.stdout:8/247: symlink d0/d38/l53 0 2024-09-18T12:51:59.617 INFO:tasks.workunit.client.1.smithi161.stdout:7/157: creat d3/d8/d20/f21 x:0 0 0 2024-09-18T12:51:59.620 INFO:tasks.workunit.client.1.smithi161.stdout:0/172: dwrite df/f23 [4194304,4194304] 0 2024-09-18T12:51:59.624 INFO:tasks.workunit.client.1.smithi161.stdout:6/185: creat d4/d39/d26/d20/d28/f3d x:0 0 0 2024-09-18T12:51:59.626 INFO:tasks.workunit.client.1.smithi161.stdout:2/227: symlink d0/d1d/l49 0 2024-09-18T12:51:59.626 INFO:tasks.workunit.client.1.smithi161.stdout:2/228: read d0/d5/d43/f18 [3594087,79894] 0 2024-09-18T12:51:59.629 INFO:tasks.workunit.client.1.smithi161.stdout:8/248: symlink d0/d3/d10/d21/d4a/l54 0 2024-09-18T12:51:59.633 INFO:tasks.workunit.client.1.smithi161.stdout:2/229: dwrite d0/f24 [0,4194304] 0 2024-09-18T12:51:59.634 INFO:tasks.workunit.client.1.smithi161.stdout:2/230: read d0/f13 [350081,23733] 0 2024-09-18T12:51:59.637 INFO:tasks.workunit.client.1.smithi161.stdout:0/173: write df/d29/f3b [131710,12874] 0 2024-09-18T12:51:59.638 INFO:tasks.workunit.client.1.smithi161.stdout:3/257: getdents d1/d2e/d3d 0 2024-09-18T12:51:59.640 INFO:tasks.workunit.client.1.smithi161.stdout:0/174: dread df/d29/f2c [0,4194304] 0 2024-09-18T12:51:59.649 INFO:tasks.workunit.client.1.smithi161.stdout:7/158: creat d3/d8/d15/d1a/f22 x:0 0 0 2024-09-18T12:51:59.650 INFO:tasks.workunit.client.1.smithi161.stdout:1/144: dwrite d1/ff [0,4194304] 0 2024-09-18T12:51:59.651 INFO:tasks.workunit.client.1.smithi161.stdout:2/231: symlink d0/d4/l4a 0 2024-09-18T12:51:59.655 INFO:tasks.workunit.client.1.smithi161.stdout:6/186: getdents d4/d39/d26/d31 0 2024-09-18T12:51:59.655 INFO:tasks.workunit.client.1.smithi161.stdout:1/145: dread d1/f5 [0,4194304] 0 2024-09-18T12:51:59.656 INFO:tasks.workunit.client.1.smithi161.stdout:6/187: readlink d4/d1a/d1c/l32 0 2024-09-18T12:51:59.657 INFO:tasks.workunit.client.1.smithi161.stdout:9/165: sync 2024-09-18T12:51:59.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/188: dread - d4/d39/d26/d20/f2a zero size 2024-09-18T12:51:59.658 INFO:tasks.workunit.client.1.smithi161.stdout:0/175: read df/f2b [165639,86516] 0 2024-09-18T12:51:59.659 INFO:tasks.workunit.client.1.smithi161.stdout:6/189: truncate d4/d1a/d1c/f2c 413622 0 2024-09-18T12:51:59.659 INFO:tasks.workunit.client.1.smithi161.stdout:7/159: creat d3/f23 x:0 0 0 2024-09-18T12:51:59.659 INFO:tasks.workunit.client.1.smithi161.stdout:0/176: truncate df/f23 9542291 0 2024-09-18T12:51:59.660 INFO:tasks.workunit.client.1.smithi161.stdout:0/177: write df/d29/f2c [3332127,37322] 0 2024-09-18T12:51:59.662 INFO:tasks.workunit.client.1.smithi161.stdout:4/206: getdents d5 0 2024-09-18T12:51:59.665 INFO:tasks.workunit.client.1.smithi161.stdout:2/232: creat d0/d1d/f4b x:0 0 0 2024-09-18T12:51:59.666 INFO:tasks.workunit.client.1.smithi161.stdout:4/207: write d5/d27/d3a/f3d [908334,90880] 0 2024-09-18T12:51:59.666 INFO:tasks.workunit.client.1.smithi161.stdout:1/146: unlink d1/d26/f20 0 2024-09-18T12:51:59.669 INFO:tasks.workunit.client.1.smithi161.stdout:9/166: chown d0/c6 0 1 2024-09-18T12:51:59.670 INFO:tasks.workunit.client.1.smithi161.stdout:7/160: dread d3/f4 [0,4194304] 0 2024-09-18T12:51:59.670 INFO:tasks.workunit.client.1.smithi161.stdout:6/190: dwrite d4/d39/d3a/f29 [0,4194304] 0 2024-09-18T12:51:59.671 INFO:tasks.workunit.client.1.smithi161.stdout:7/161: dread - d3/f23 zero size 2024-09-18T12:51:59.675 INFO:tasks.workunit.client.1.smithi161.stdout:8/249: dread d0/d3/d1e/d34/f35 [0,4194304] 0 2024-09-18T12:51:59.676 INFO:tasks.workunit.client.1.smithi161.stdout:4/208: mkdir d5/d27/d44 0 2024-09-18T12:51:59.682 INFO:tasks.workunit.client.1.smithi161.stdout:6/191: fsync d4/d39/d3a/f1f 0 2024-09-18T12:51:59.684 INFO:tasks.workunit.client.1.smithi161.stdout:7/162: read d3/f19 [542621,1430] 0 2024-09-18T12:51:59.685 INFO:tasks.workunit.client.1.smithi161.stdout:3/258: truncate d1/f12 1445521 0 2024-09-18T12:51:59.685 INFO:tasks.workunit.client.1.smithi161.stdout:7/163: chown d3/d8/d15/d1a/f22 7860038 1 2024-09-18T12:51:59.686 INFO:tasks.workunit.client.1.smithi161.stdout:3/259: read - d1/d2e/d14/d2c/f33 zero size 2024-09-18T12:51:59.687 INFO:tasks.workunit.client.1.smithi161.stdout:7/164: write d3/f6 [5716892,47088] 0 2024-09-18T12:51:59.687 INFO:tasks.workunit.client.1.smithi161.stdout:2/233: mkdir d0/d1/d4c 0 2024-09-18T12:51:59.689 INFO:tasks.workunit.client.1.smithi161.stdout:7/165: chown d3/d8/lc 28505576 1 2024-09-18T12:51:59.690 INFO:tasks.workunit.client.1.smithi161.stdout:4/209: creat d5/d32/f45 x:0 0 0 2024-09-18T12:51:59.691 INFO:tasks.workunit.client.1.smithi161.stdout:1/147: symlink d1/da/l29 0 2024-09-18T12:51:59.692 INFO:tasks.workunit.client.0.smithi045.stdout:5/38: symlink d6/db/lc 0 2024-09-18T12:51:59.692 INFO:tasks.workunit.client.1.smithi161.stdout:4/210: chown d5/d14/l2a 58 1 2024-09-18T12:51:59.693 INFO:tasks.workunit.client.1.smithi161.stdout:3/260: dread d1/d2e/d24/f3a [0,4194304] 0 2024-09-18T12:51:59.694 INFO:tasks.workunit.client.1.smithi161.stdout:0/178: link df/f26 df/d29/f3c 0 2024-09-18T12:51:59.694 INFO:tasks.workunit.client.1.smithi161.stdout:3/261: write d1/d2e/d24/f45 [338589,65298] 0 2024-09-18T12:51:59.695 INFO:tasks.workunit.client.1.smithi161.stdout:7/166: dwrite d3/f17 [0,4194304] 0 2024-09-18T12:51:59.696 INFO:tasks.workunit.client.0.smithi045.stdout:5/39: dread d6/f7 [0,4194304] 0 2024-09-18T12:51:59.696 INFO:tasks.workunit.client.1.smithi161.stdout:6/192: stat d4/d39/d3a/l36 0 2024-09-18T12:51:59.700 INFO:tasks.workunit.client.0.smithi045.stdout:5/40: unlink l3 0 2024-09-18T12:51:59.703 INFO:tasks.workunit.client.1.smithi161.stdout:5/177: sync 2024-09-18T12:51:59.706 INFO:tasks.workunit.client.1.smithi161.stdout:2/234: rmdir d0/d5/d43/d35 39 2024-09-18T12:51:59.706 INFO:tasks.workunit.client.0.smithi045.stdout:7/39: link l4 l6 0 2024-09-18T12:51:59.707 INFO:tasks.workunit.client.1.smithi161.stdout:3/262: dwrite d1/d2e/d3d/f22 [0,4194304] 0 2024-09-18T12:51:59.708 INFO:tasks.workunit.client.0.smithi045.stdout:3/59: write d0/fe [7248135,100299] 0 2024-09-18T12:51:59.709 INFO:tasks.workunit.client.0.smithi045.stdout:2/25: dwrite d5/f9 [0,4194304] 0 2024-09-18T12:51:59.710 INFO:tasks.workunit.client.0.smithi045.stdout:3/60: stat d0/f4 0 2024-09-18T12:51:59.711 INFO:tasks.workunit.client.0.smithi045.stdout:6/95: dwrite f5 [0,4194304] 0 2024-09-18T12:51:59.713 INFO:tasks.workunit.client.0.smithi045.stdout:2/26: write d5/f9 [111005,43091] 0 2024-09-18T12:51:59.715 INFO:tasks.workunit.client.0.smithi045.stdout:7/40: creat f7 x:0 0 0 2024-09-18T12:51:59.717 INFO:tasks.workunit.client.0.smithi045.stdout:7/41: write f2 [2420424,31611] 0 2024-09-18T12:51:59.720 INFO:tasks.workunit.client.0.smithi045.stdout:7/42: write f2 [4255766,91775] 0 2024-09-18T12:51:59.723 INFO:tasks.workunit.client.1.smithi161.stdout:0/179: rename df/f25 to df/d29/f3d 0 2024-09-18T12:51:59.725 INFO:tasks.workunit.client.0.smithi045.stdout:6/96: mknod d9/c1f 0 2024-09-18T12:51:59.727 INFO:tasks.workunit.client.0.smithi045.stdout:6/97: write d9/f13 [4962,124953] 0 2024-09-18T12:51:59.727 INFO:tasks.workunit.client.0.smithi045.stdout:2/27: mknod d5/ca 0 2024-09-18T12:51:59.728 INFO:tasks.workunit.client.0.smithi045.stdout:6/98: truncate d9/f12 620466 0 2024-09-18T12:51:59.733 INFO:tasks.workunit.client.0.smithi045.stdout:5/41: truncate d6/f7 1638938 0 2024-09-18T12:51:59.734 INFO:tasks.workunit.client.0.smithi045.stdout:7/43: readlink l4 0 2024-09-18T12:51:59.735 INFO:tasks.workunit.client.0.smithi045.stdout:2/28: dread d5/f9 [0,4194304] 0 2024-09-18T12:51:59.735 INFO:tasks.workunit.client.0.smithi045.stdout:7/44: dread - f7 zero size 2024-09-18T12:51:59.736 INFO:tasks.workunit.client.0.smithi045.stdout:3/61: link d0/fb d0/d7/f12 0 2024-09-18T12:51:59.736 INFO:tasks.workunit.client.1.smithi161.stdout:3/263: write d1/d2e/d14/f44 [271596,1035] 0 2024-09-18T12:51:59.737 INFO:tasks.workunit.client.0.smithi045.stdout:6/99: dwrite f3 [0,4194304] 0 2024-09-18T12:51:59.738 INFO:tasks.workunit.client.1.smithi161.stdout:8/250: creat d0/f55 x:0 0 0 2024-09-18T12:51:59.740 INFO:tasks.workunit.client.1.smithi161.stdout:8/251: write d0/d3/d1e/f46 [715776,20761] 0 2024-09-18T12:51:59.740 INFO:tasks.workunit.client.1.smithi161.stdout:1/148: mknod d1/c2a 0 2024-09-18T12:51:59.740 INFO:tasks.workunit.client.1.smithi161.stdout:8/252: readlink d0/d3/ld 0 2024-09-18T12:51:59.742 INFO:tasks.workunit.client.0.smithi045.stdout:5/42: symlink d6/db/ld 0 2024-09-18T12:51:59.742 INFO:tasks.workunit.client.1.smithi161.stdout:8/253: chown d0/d3/d10/d21/d4a/l54 1613824944 1 2024-09-18T12:51:59.745 INFO:tasks.workunit.client.1.smithi161.stdout:9/167: getdents d0 0 2024-09-18T12:51:59.745 INFO:tasks.workunit.client.0.smithi045.stdout:2/29: dread d5/f9 [0,4194304] 0 2024-09-18T12:51:59.746 INFO:tasks.workunit.client.0.smithi045.stdout:3/62: dwrite d0/f4 [4194304,4194304] 0 2024-09-18T12:51:59.748 INFO:tasks.workunit.client.1.smithi161.stdout:1/149: dwrite d1/f1b [4194304,4194304] 0 2024-09-18T12:51:59.748 INFO:tasks.workunit.client.0.smithi045.stdout:3/63: write d0/d7/f9 [7185698,118417] 0 2024-09-18T12:51:59.749 INFO:tasks.workunit.client.1.smithi161.stdout:0/180: fsync df/f22 0 2024-09-18T12:51:59.750 INFO:tasks.workunit.client.1.smithi161.stdout:1/150: fdatasync d1/d26/f7 0 2024-09-18T12:51:59.751 INFO:tasks.workunit.client.1.smithi161.stdout:1/151: write d1/da/f16 [768862,1928] 0 2024-09-18T12:51:59.752 INFO:tasks.workunit.client.1.smithi161.stdout:1/152: truncate d1/f15 902863 0 2024-09-18T12:51:59.753 INFO:tasks.workunit.client.1.smithi161.stdout:6/193: mkdir d4/d1a/d1c/d3e 0 2024-09-18T12:51:59.755 INFO:tasks.workunit.client.0.smithi045.stdout:5/43: creat d6/db/fe x:0 0 0 2024-09-18T12:51:59.756 INFO:tasks.workunit.client.0.smithi045.stdout:3/64: fdatasync d0/d7/f9 0 2024-09-18T12:51:59.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.758+0000 7f6531e9d640 1 -- 172.21.15.45:0/1796557041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652c104d60 msgr2=0x7f652c1051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:59.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.758+0000 7f6531e9d640 1 --2- 172.21.15.45:0/1796557041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652c104d60 0x7f652c1051e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6520009880 tx=0x7f652002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:51:59.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.758+0000 7f6531e9d640 1 -- 172.21.15.45:0/1796557041 shutdown_connections 2024-09-18T12:51:59.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.758+0000 7f6531e9d640 1 --2- 172.21.15.45:0/1796557041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652c104d60 0x7f652c1051e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:59.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.758+0000 7f6531e9d640 1 --2- 172.21.15.45:0/1796557041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c103b60 0x7f652c103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:59.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.758+0000 7f6531e9d640 1 -- 172.21.15.45:0/1796557041 >> 172.21.15.45:0/1796557041 conn(0x7f652c0ff2f0 msgr2=0x7f652c101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:51:59.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.758+0000 7f6531e9d640 1 -- 172.21.15.45:0/1796557041 shutdown_connections 2024-09-18T12:51:59.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.758+0000 7f6531e9d640 1 -- 172.21.15.45:0/1796557041 wait complete. 2024-09-18T12:51:59.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.759+0000 7f6531e9d640 1 Processor -- start 2024-09-18T12:51:59.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.759+0000 7f6531e9d640 1 -- start start 2024-09-18T12:51:59.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.760+0000 7f6531e9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652c103b60 0x7f652c199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:59.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.760+0000 7f6531e9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c104d60 0x7f652c199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:59.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.760+0000 7f6531e9d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f652c10ca20 con 0x7f652c103b60 2024-09-18T12:51:59.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.760+0000 7f6531e9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f652c10c8a0 con 0x7f652c104d60 2024-09-18T12:51:59.762 INFO:tasks.workunit.client.1.smithi161.stdout:5/178: symlink d3/d14/d20/d21/l39 0 2024-09-18T12:51:59.762 INFO:tasks.workunit.client.1.smithi161.stdout:5/179: write d3/d14/f1b [1242651,98000] 0 2024-09-18T12:51:59.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.760+0000 7f652b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652c103b60 0x7f652c199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:59.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.760+0000 7f652b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652c103b60 0x7f652c199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36002/0 (socket says 172.21.15.45:36002) 2024-09-18T12:51:59.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.761+0000 7f652b7fe640 1 -- 172.21.15.45:0/61276107 learned_addr learned my addr 172.21.15.45:0/61276107 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:51:59.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.761+0000 7f652affd640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c104d60 0x7f652c199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:59.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.761+0000 7f652b7fe640 1 -- 172.21.15.45:0/61276107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c104d60 msgr2=0x7f652c199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:51:59.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.761+0000 7f652b7fe640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c104d60 0x7f652c199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:51:59.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.761+0000 7f652b7fe640 1 -- 172.21.15.45:0/61276107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c19a310 con 0x7f652c103b60 2024-09-18T12:51:59.764 INFO:tasks.workunit.client.1.smithi161.stdout:5/180: chown d3/f35 14468 1 2024-09-18T12:51:59.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.763+0000 7f652b7fe640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652c103b60 0x7f652c199750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f651c00b3f0 tx=0x7f651c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:59.765 INFO:tasks.workunit.client.0.smithi045.stdout:1/2: sync 2024-09-18T12:51:59.765 INFO:tasks.workunit.client.1.smithi161.stdout:3/264: creat d1/d2e/d14/f58 x:0 0 0 2024-09-18T12:51:59.765 INFO:tasks.workunit.client.1.smithi161.stdout:3/265: chown d1/d2e/d24 114680598 1 2024-09-18T12:51:59.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.764+0000 7f6528ff9640 1 -- 172.21.15.45:0/61276107 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f651c015020 con 0x7f652c103b60 2024-09-18T12:51:59.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.764+0000 7f6528ff9640 1 -- 172.21.15.45:0/61276107 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f651c011af0 con 0x7f652c103b60 2024-09-18T12:51:59.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.764+0000 7f6531e9d640 1 -- 172.21.15.45:0/61276107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c19ed50 con 0x7f652c103b60 2024-09-18T12:51:59.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.765+0000 7f6531e9d640 1 -- 172.21.15.45:0/61276107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652c19f270 con 0x7f652c103b60 2024-09-18T12:51:59.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.765+0000 7f6528ff9640 1 -- 172.21.15.45:0/61276107 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f651c010cb0 con 0x7f652c103b60 2024-09-18T12:51:59.767 INFO:tasks.workunit.client.1.smithi161.stdout:8/254: write d0/f12 [986273,114637] 0 2024-09-18T12:51:59.768 INFO:tasks.workunit.client.1.smithi161.stdout:8/255: stat d0/d3/d10/d21/f48 0 2024-09-18T12:51:59.768 INFO:tasks.workunit.client.1.smithi161.stdout:9/168: creat d0/db/d18/f36 x:0 0 0 2024-09-18T12:51:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.767+0000 7f6531e9d640 1 -- 172.21.15.45:0/61276107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652c103f60 con 0x7f652c103b60 2024-09-18T12:51:59.769 INFO:tasks.workunit.client.0.smithi045.stdout:2/30: dwrite d5/f9 [0,4194304] 0 2024-09-18T12:51:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.768+0000 7f6528ff9640 1 -- 172.21.15.45:0/61276107 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f651c018020 con 0x7f652c103b60 2024-09-18T12:51:59.771 INFO:tasks.workunit.client.0.smithi045.stdout:3/65: mknod d0/c13 0 2024-09-18T12:51:59.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.769+0000 7f6528ff9640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f6514074ad0 0x7f6514076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:51:59.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.769+0000 7f6528ff9640 1 -- 172.21.15.45:0/61276107 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f651c096410 con 0x7f652c103b60 2024-09-18T12:51:59.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.770+0000 7f652affd640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f6514074ad0 0x7f6514076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:51:59.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.771+0000 7f652affd640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f6514074ad0 0x7f6514076f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f652c19ac00 tx=0x7f6520005a20 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:51:59.772 INFO:tasks.workunit.client.1.smithi161.stdout:7/167: truncate d3/f14 509134 0 2024-09-18T12:51:59.774 INFO:tasks.workunit.client.1.smithi161.stdout:0/181: fdatasync df/d29/f3d 0 2024-09-18T12:51:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:51:59.776+0000 7f6528ff9640 1 -- 172.21.15.45:0/61276107 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f651c01f020 con 0x7f652c103b60 2024-09-18T12:51:59.779 INFO:tasks.workunit.client.0.smithi045.stdout:7/45: truncate f3 2492279 0 2024-09-18T12:51:59.779 INFO:tasks.workunit.client.0.smithi045.stdout:7/46: chown l4 128 1 2024-09-18T12:51:59.783 INFO:tasks.workunit.client.1.smithi161.stdout:6/194: creat d4/d39/d3a/f3f x:0 0 0 2024-09-18T12:51:59.784 INFO:tasks.workunit.client.0.smithi045.stdout:6/100: write d9/fe [3920419,93869] 0 2024-09-18T12:51:59.784 INFO:tasks.workunit.client.0.smithi045.stdout:2/31: fdatasync d5/f9 0 2024-09-18T12:51:59.785 INFO:tasks.workunit.client.0.smithi045.stdout:6/101: truncate d9/fc 4850118 0 2024-09-18T12:51:59.785 INFO:tasks.workunit.client.0.smithi045.stdout:3/66: rename d0/ld to d0/d7/l14 0 2024-09-18T12:51:59.785 INFO:tasks.workunit.client.1.smithi161.stdout:4/211: sync 2024-09-18T12:51:59.786 INFO:tasks.workunit.client.1.smithi161.stdout:4/212: dread - d5/d27/f35 zero size 2024-09-18T12:51:59.786 INFO:tasks.workunit.client.0.smithi045.stdout:1/3: symlink d0/l1 0 2024-09-18T12:51:59.787 INFO:tasks.workunit.client.1.smithi161.stdout:6/195: dread d4/d1a/f14 [0,4194304] 0 2024-09-18T12:51:59.787 INFO:tasks.workunit.client.1.smithi161.stdout:4/213: write d5/f36 [2963331,41197] 0 2024-09-18T12:51:59.788 INFO:tasks.workunit.client.1.smithi161.stdout:4/214: write d5/fe [4507745,78170] 0 2024-09-18T12:51:59.789 INFO:tasks.workunit.client.1.smithi161.stdout:4/215: chown d5/l25 80126354 1 2024-09-18T12:51:59.790 INFO:tasks.workunit.client.1.smithi161.stdout:3/266: rmdir d1/d2e/d24 39 2024-09-18T12:51:59.791 INFO:tasks.workunit.client.0.smithi045.stdout:7/47: mknod c8 0 2024-09-18T12:51:59.792 INFO:tasks.workunit.client.1.smithi161.stdout:8/256: fdatasync d0/d3/d10/f42 0 2024-09-18T12:51:59.792 INFO:tasks.workunit.client.1.smithi161.stdout:8/257: readlink d0/d3/la 0 2024-09-18T12:51:59.792 INFO:tasks.workunit.client.0.smithi045.stdout:6/102: dwrite d9/f12 [0,4194304] 0 2024-09-18T12:51:59.794 INFO:tasks.workunit.client.0.smithi045.stdout:2/32: creat d5/fb x:0 0 0 2024-09-18T12:51:59.794 INFO:tasks.workunit.client.0.smithi045.stdout:6/103: write f3 [3383245,104125] 0 2024-09-18T12:51:59.799 INFO:tasks.workunit.client.1.smithi161.stdout:9/169: creat d0/db/d18/d2d/f37 x:0 0 0 2024-09-18T12:51:59.801 INFO:tasks.workunit.client.1.smithi161.stdout:7/168: rmdir d3 39 2024-09-18T12:51:59.804 INFO:tasks.workunit.client.0.smithi045.stdout:6/104: dwrite d9/f12 [0,4194304] 0 2024-09-18T12:51:59.804 INFO:tasks.workunit.client.0.smithi045.stdout:3/67: mknod d0/c15 0 2024-09-18T12:51:59.804 INFO:tasks.workunit.client.0.smithi045.stdout:6/105: fsync d9/fc 0 2024-09-18T12:51:59.805 INFO:tasks.workunit.client.0.smithi045.stdout:3/68: fdatasync d0/d7/f10 0 2024-09-18T12:51:59.805 INFO:tasks.workunit.client.0.smithi045.stdout:3/69: stat d0/fb 0 2024-09-18T12:51:59.807 INFO:tasks.workunit.client.1.smithi161.stdout:0/182: rename df/d29/f2e to df/d29/d2d/d37/f3e 0 2024-09-18T12:51:59.809 INFO:tasks.workunit.client.0.smithi045.stdout:3/70: dread d0/fb [0,4194304] 0 2024-09-18T12:51:59.810 INFO:tasks.workunit.client.0.smithi045.stdout:1/4: creat d0/f2 x:0 0 0 2024-09-18T12:51:59.810 INFO:tasks.workunit.client.1.smithi161.stdout:8/258: dread d0/d3/d10/f3f [0,4194304] 0 2024-09-18T12:51:59.811 INFO:tasks.workunit.client.0.smithi045.stdout:6/106: dread d9/f12 [0,4194304] 0 2024-09-18T12:51:59.816 INFO:tasks.workunit.client.0.smithi045.stdout:2/33: mknod d5/cc 0 2024-09-18T12:51:59.817 INFO:tasks.workunit.client.1.smithi161.stdout:2/235: getdents d0/d1/df 0 2024-09-18T12:51:59.817 INFO:tasks.workunit.client.0.smithi045.stdout:2/34: fsync d5/f8 0 2024-09-18T12:51:59.819 INFO:tasks.workunit.client.0.smithi045.stdout:1/5: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:51:59.819 INFO:tasks.workunit.client.1.smithi161.stdout:5/181: symlink d3/d14/d20/d21/d24/l3a 0 2024-09-18T12:51:59.820 INFO:tasks.workunit.client.0.smithi045.stdout:1/6: chown d0/l1 169443 1 2024-09-18T12:51:59.822 INFO:tasks.workunit.client.1.smithi161.stdout:3/267: symlink d1/d2e/d3d/l59 0 2024-09-18T12:51:59.828 INFO:tasks.workunit.client.0.smithi045.stdout:3/71: creat d0/f16 x:0 0 0 2024-09-18T12:51:59.828 INFO:tasks.workunit.client.0.smithi045.stdout:3/72: chown d0/d7/f10 1160951793 1 2024-09-18T12:51:59.830 INFO:tasks.workunit.client.0.smithi045.stdout:6/107: symlink d9/l20 0 2024-09-18T12:51:59.834 INFO:tasks.workunit.client.1.smithi161.stdout:4/216: rename d5/d27/d3a/f43 to d5/d27/f46 0 2024-09-18T12:51:59.834 INFO:tasks.workunit.client.0.smithi045.stdout:5/44: truncate d6/f7 187766 0 2024-09-18T12:51:59.835 INFO:tasks.workunit.client.1.smithi161.stdout:4/217: write d5/d14/f1e [3878616,57316] 0 2024-09-18T12:51:59.835 INFO:tasks.workunit.client.1.smithi161.stdout:0/183: creat df/d30/f3f x:0 0 0 2024-09-18T12:51:59.837 INFO:tasks.workunit.client.1.smithi161.stdout:1/153: link d1/c4 d1/d26/c2b 0 2024-09-18T12:51:59.838 INFO:tasks.workunit.client.0.smithi045.stdout:2/35: creat d5/fd x:0 0 0 2024-09-18T12:51:59.838 INFO:tasks.workunit.client.0.smithi045.stdout:2/36: dread - d5/f8 zero size 2024-09-18T12:51:59.839 INFO:tasks.workunit.client.1.smithi161.stdout:8/259: write d0/d3/d1e/d34/f39 [711663,61438] 0 2024-09-18T12:51:59.844 INFO:tasks.workunit.client.1.smithi161.stdout:5/182: mkdir d3/d3b 0 2024-09-18T12:51:59.845 INFO:tasks.workunit.client.0.smithi045.stdout:3/73: mknod d0/d7/c17 0 2024-09-18T12:51:59.846 INFO:tasks.workunit.client.0.smithi045.stdout:1/7: write d0/f2 [4564399,45103] 0 2024-09-18T12:51:59.847 INFO:tasks.workunit.client.1.smithi161.stdout:6/196: link d4/d1a/d1c/f24 d4/d39/d26/f40 0 2024-09-18T12:51:59.848 INFO:tasks.workunit.client.1.smithi161.stdout:6/197: write d4/d39/d26/d20/d28/f35 [5217628,58910] 0 2024-09-18T12:51:59.850 INFO:tasks.workunit.client.1.smithi161.stdout:5/183: dread d3/d14/f1b [0,4194304] 0 2024-09-18T12:51:59.850 INFO:tasks.workunit.client.1.smithi161.stdout:3/268: rmdir d1/d2e/d14 39 2024-09-18T12:51:59.850 INFO:tasks.workunit.client.1.smithi161.stdout:6/198: chown d4/d1a/d1c/f2c 8458678 1 2024-09-18T12:51:59.850 INFO:tasks.workunit.client.0.smithi045.stdout:3/74: dread d0/fe [0,4194304] 0 2024-09-18T12:51:59.850 INFO:tasks.workunit.client.0.smithi045.stdout:7/48: link c8 c9 0 2024-09-18T12:51:59.851 INFO:tasks.workunit.client.0.smithi045.stdout:3/75: chown d0/f4 107519085 1 2024-09-18T12:51:59.851 INFO:tasks.workunit.client.1.smithi161.stdout:6/199: truncate d4/d39/d26/f40 954712 0 2024-09-18T12:51:59.852 INFO:tasks.workunit.client.0.smithi045.stdout:7/49: truncate f7 808557 0 2024-09-18T12:51:59.852 INFO:tasks.workunit.client.0.smithi045.stdout:3/76: chown d0/c15 15009219 1 2024-09-18T12:51:59.852 INFO:tasks.workunit.client.0.smithi045.stdout:6/108: dread d9/f12 [0,4194304] 0 2024-09-18T12:51:59.852 INFO:tasks.workunit.client.1.smithi161.stdout:6/200: stat d4/d39/d26/d20/f2a 0 2024-09-18T12:51:59.853 INFO:tasks.workunit.client.0.smithi045.stdout:3/77: fdatasync d0/f4 0 2024-09-18T12:51:59.853 INFO:tasks.workunit.client.1.smithi161.stdout:6/201: read d4/d39/d26/f40 [914611,104564] 0 2024-09-18T12:51:59.853 INFO:tasks.workunit.client.1.smithi161.stdout:5/184: dread d3/f13 [0,4194304] 0 2024-09-18T12:51:59.854 INFO:tasks.workunit.client.1.smithi161.stdout:5/185: dread - d3/f2a zero size 2024-09-18T12:51:59.854 INFO:tasks.workunit.client.1.smithi161.stdout:6/202: chown d4/d39/d26/l1d 2383912 1 2024-09-18T12:51:59.855 INFO:tasks.workunit.client.1.smithi161.stdout:9/170: rename d0/fa to d0/d16/d25/d28/f38 0 2024-09-18T12:51:59.876 INFO:tasks.workunit.client.0.smithi045.stdout:0/24: sync 2024-09-18T12:51:59.876 INFO:tasks.workunit.client.0.smithi045.stdout:1/8: mkdir d0/d3 0 2024-09-18T12:51:59.876 INFO:tasks.workunit.client.0.smithi045.stdout:6/109: write d9/f13 [310284,121436] 0 2024-09-18T12:51:59.878 INFO:tasks.workunit.client.1.smithi161.stdout:0/184: chown df/l2f 746739 1 2024-09-18T12:51:59.879 INFO:tasks.workunit.client.0.smithi045.stdout:6/110: readlink d9/l20 0 2024-09-18T12:51:59.879 INFO:tasks.workunit.client.0.smithi045.stdout:1/9: write d0/f2 [1711312,5671] 0 2024-09-18T12:51:59.880 INFO:tasks.workunit.client.1.smithi161.stdout:8/260: mknod d0/d3/d1e/d34/c56 0 2024-09-18T12:51:59.881 INFO:tasks.workunit.client.1.smithi161.stdout:2/236: symlink d0/d5/l4d 0 2024-09-18T12:51:59.883 INFO:tasks.workunit.client.0.smithi045.stdout:1/10: write d0/f2 [5370413,50099] 0 2024-09-18T12:51:59.885 INFO:tasks.workunit.client.1.smithi161.stdout:2/237: dread d0/f24 [0,4194304] 0 2024-09-18T12:51:59.885 INFO:tasks.workunit.client.0.smithi045.stdout:7/50: dwrite f7 [0,4194304] 0 2024-09-18T12:51:59.888 INFO:tasks.workunit.client.0.smithi045.stdout:0/25: dread f4 [0,4194304] 0 2024-09-18T12:51:59.890 INFO:tasks.workunit.client.0.smithi045.stdout:7/51: dread f7 [0,4194304] 0 2024-09-18T12:51:59.892 INFO:tasks.workunit.client.0.smithi045.stdout:6/111: symlink d9/l21 0 2024-09-18T12:51:59.893 INFO:tasks.workunit.client.0.smithi045.stdout:6/112: write f5 [1671022,5023] 0 2024-09-18T12:51:59.893 INFO:tasks.workunit.client.1.smithi161.stdout:7/169: truncate d3/f4 1240201 0 2024-09-18T12:51:59.894 INFO:tasks.workunit.client.1.smithi161.stdout:7/170: dread - d3/d8/d15/d1a/f22 zero size 2024-09-18T12:51:59.897 INFO:tasks.workunit.client.1.smithi161.stdout:5/186: creat d3/d14/d20/f3c x:0 0 0 2024-09-18T12:51:59.898 INFO:tasks.workunit.client.1.smithi161.stdout:6/203: rename d4/d1a/ld to d4/d1a/l41 0 2024-09-18T12:51:59.899 INFO:tasks.workunit.client.1.smithi161.stdout:6/204: chown d4/d1a/l38 2601568 1 2024-09-18T12:51:59.899 INFO:tasks.workunit.client.0.smithi045.stdout:1/11: creat d0/f4 x:0 0 0 2024-09-18T12:51:59.901 INFO:tasks.workunit.client.1.smithi161.stdout:3/269: rename d1/d2e/c18 to d1/d2e/d3d/c5a 0 2024-09-18T12:51:59.903 INFO:tasks.workunit.client.0.smithi045.stdout:5/45: getdents d6/db 0 2024-09-18T12:51:59.903 INFO:tasks.workunit.client.1.smithi161.stdout:0/185: write df/f2b [2853053,72278] 0 2024-09-18T12:51:59.904 INFO:tasks.workunit.client.1.smithi161.stdout:8/261: unlink d0/l44 0 2024-09-18T12:51:59.905 INFO:tasks.workunit.client.0.smithi045.stdout:7/52: mknod ca 0 2024-09-18T12:51:59.908 INFO:tasks.workunit.client.0.smithi045.stdout:7/53: read f2 [2494262,1396] 0 2024-09-18T12:51:59.908 INFO:tasks.workunit.client.0.smithi045.stdout:5/46: write d6/db/fe [781516,87617] 0 2024-09-18T12:51:59.909 INFO:tasks.workunit.client.0.smithi045.stdout:3/78: dwrite d0/d7/f12 [0,4194304] 0 2024-09-18T12:51:59.909 INFO:tasks.workunit.client.0.smithi045.stdout:6/113: mknod d9/d1a/c22 0 2024-09-18T12:51:59.912 INFO:tasks.workunit.client.0.smithi045.stdout:3/79: chown d0 209969715 1 2024-09-18T12:51:59.913 INFO:tasks.workunit.client.0.smithi045.stdout:2/37: getdents d5 0 2024-09-18T12:51:59.913 INFO:tasks.workunit.client.1.smithi161.stdout:7/171: mkdir d3/d8/d15/d1a/d24 0 2024-09-18T12:51:59.913 INFO:tasks.workunit.client.0.smithi045.stdout:3/80: chown d0/fb 633803 1 2024-09-18T12:51:59.914 INFO:tasks.workunit.client.1.smithi161.stdout:7/172: fsync d3/f17 0 2024-09-18T12:51:59.914 INFO:tasks.workunit.client.1.smithi161.stdout:7/173: fsync d3/f23 0 2024-09-18T12:51:59.914 INFO:tasks.workunit.client.1.smithi161.stdout:5/187: rmdir d3 39 2024-09-18T12:51:59.914 INFO:tasks.workunit.client.1.smithi161.stdout:7/174: read d3/f17 [3812252,23592] 0 2024-09-18T12:51:59.915 INFO:tasks.workunit.client.0.smithi045.stdout:1/12: dwrite d0/f4 [0,4194304] 0 2024-09-18T12:51:59.915 INFO:tasks.workunit.client.0.smithi045.stdout:0/26: symlink d6/d7/l8 0 2024-09-18T12:51:59.918 INFO:tasks.workunit.client.1.smithi161.stdout:4/218: sync 2024-09-18T12:51:59.920 INFO:tasks.workunit.client.1.smithi161.stdout:9/171: readlink d0/db/d18/d2d/l32 0 2024-09-18T12:51:59.924 INFO:tasks.workunit.client.0.smithi045.stdout:2/38: dwrite d5/fb [0,4194304] 0 2024-09-18T12:51:59.925 INFO:tasks.workunit.client.0.smithi045.stdout:0/27: dread f4 [0,4194304] 0 2024-09-18T12:51:59.926 INFO:tasks.workunit.client.0.smithi045.stdout:6/114: creat d9/f23 x:0 0 0 2024-09-18T12:51:59.927 INFO:tasks.workunit.client.1.smithi161.stdout:0/186: symlink df/d29/l40 0 2024-09-18T12:51:59.929 INFO:tasks.workunit.client.1.smithi161.stdout:8/262: creat d0/d3/d10/f57 x:0 0 0 2024-09-18T12:51:59.929 INFO:tasks.workunit.client.0.smithi045.stdout:0/28: dread f4 [0,4194304] 0 2024-09-18T12:51:59.930 INFO:tasks.workunit.client.0.smithi045.stdout:5/47: mkdir d6/df 0 2024-09-18T12:51:59.930 INFO:tasks.workunit.client.1.smithi161.stdout:8/263: write d0/d3/d1e/d34/f25 [1483609,9261] 0 2024-09-18T12:51:59.932 INFO:tasks.workunit.client.1.smithi161.stdout:8/264: chown d0/d3/d10/d21/f37 3485901 1 2024-09-18T12:51:59.932 INFO:tasks.workunit.client.0.smithi045.stdout:3/81: creat d0/f18 x:0 0 0 2024-09-18T12:51:59.932 INFO:tasks.workunit.client.1.smithi161.stdout:8/265: dread - d0/d3/d10/f57 zero size 2024-09-18T12:51:59.933 INFO:tasks.workunit.client.1.smithi161.stdout:8/266: chown d0/d38 958366213 1 2024-09-18T12:51:59.933 INFO:tasks.workunit.client.1.smithi161.stdout:2/238: unlink d0/d5/c27 0 2024-09-18T12:51:59.936 INFO:tasks.workunit.client.1.smithi161.stdout:2/239: dread - d0/d5/d43/f37 zero size 2024-09-18T12:51:59.937 INFO:tasks.workunit.client.0.smithi045.stdout:2/39: mkdir d5/de 0 2024-09-18T12:51:59.939 INFO:tasks.workunit.client.1.smithi161.stdout:7/175: unlink d3/f16 0 2024-09-18T12:51:59.939 INFO:tasks.workunit.client.1.smithi161.stdout:7/176: dread - d3/d8/d15/d1a/f22 zero size 2024-09-18T12:51:59.939 INFO:tasks.workunit.client.0.smithi045.stdout:6/115: symlink d9/d1a/d1d/l24 0 2024-09-18T12:51:59.940 INFO:tasks.workunit.client.1.smithi161.stdout:7/177: write d3/d8/d20/f21 [645641,8585] 0 2024-09-18T12:51:59.941 INFO:tasks.workunit.client.1.smithi161.stdout:6/205: creat d4/d1a/d1c/d3e/f42 x:0 0 0 2024-09-18T12:51:59.944 INFO:tasks.workunit.client.1.smithi161.stdout:4/219: mkdir d5/d27/d3a/d47 0 2024-09-18T12:51:59.944 INFO:tasks.workunit.client.1.smithi161.stdout:4/220: fsync d5/d32/d39/f40 0 2024-09-18T12:51:59.945 INFO:tasks.workunit.client.0.smithi045.stdout:0/29: mknod d6/d7/c9 0 2024-09-18T12:51:59.945 INFO:tasks.workunit.client.0.smithi045.stdout:0/30: readlink l3 0 2024-09-18T12:51:59.946 INFO:tasks.workunit.client.0.smithi045.stdout:5/48: read d6/f7 [68117,114598] 0 2024-09-18T12:51:59.947 INFO:tasks.workunit.client.1.smithi161.stdout:1/154: getdents d1/da 0 2024-09-18T12:51:59.948 INFO:tasks.workunit.client.0.smithi045.stdout:3/82: creat d0/d7/f19 x:0 0 0 2024-09-18T12:51:59.954 INFO:tasks.workunit.client.0.smithi045.stdout:6/116: creat d9/d1a/d1d/f25 x:0 0 0 2024-09-18T12:51:59.956 INFO:tasks.workunit.client.0.smithi045.stdout:7/54: link c9 cb 0 2024-09-18T12:51:59.959 INFO:tasks.workunit.client.0.smithi045.stdout:0/31: unlink l1 0 2024-09-18T12:51:59.960 INFO:tasks.workunit.client.0.smithi045.stdout:0/32: chown d6/d7/l8 108473 1 2024-09-18T12:51:59.961 INFO:tasks.workunit.client.0.smithi045.stdout:8/26: sync 2024-09-18T12:51:59.961 INFO:tasks.workunit.client.1.smithi161.stdout:5/188: write d3/fd [5321320,128128] 0 2024-09-18T12:51:59.961 INFO:tasks.workunit.client.0.smithi045.stdout:5/49: readlink d6/la 0 2024-09-18T12:51:59.963 INFO:tasks.workunit.client.0.smithi045.stdout:3/83: unlink d0/d7/f19 0 2024-09-18T12:51:59.964 INFO:tasks.workunit.client.0.smithi045.stdout:0/33: dread f4 [0,4194304] 0 2024-09-18T12:51:59.965 INFO:tasks.workunit.client.1.smithi161.stdout:7/178: mknod d3/d8/d20/c25 0 2024-09-18T12:51:59.965 INFO:tasks.workunit.client.1.smithi161.stdout:7/179: read d3/f17 [1875947,27214] 0 2024-09-18T12:51:59.965 INFO:tasks.workunit.client.0.smithi045.stdout:5/50: dread d6/db/fe [0,4194304] 0 2024-09-18T12:51:59.966 INFO:tasks.workunit.client.1.smithi161.stdout:6/206: write d4/d1a/d1c/f24 [1235297,96845] 0 2024-09-18T12:51:59.967 INFO:tasks.workunit.client.0.smithi045.stdout:2/40: creat d5/de/ff x:0 0 0 2024-09-18T12:51:59.967 INFO:tasks.workunit.client.1.smithi161.stdout:4/221: symlink d5/d14/l48 0 2024-09-18T12:51:59.968 INFO:tasks.workunit.client.1.smithi161.stdout:4/222: fdatasync d5/f36 0 2024-09-18T12:51:59.969 INFO:tasks.workunit.client.1.smithi161.stdout:4/223: write d5/d27/f37 [748581,102847] 0 2024-09-18T12:51:59.969 INFO:tasks.workunit.client.0.smithi045.stdout:6/117: creat d9/d1a/d1d/f26 x:0 0 0 2024-09-18T12:51:59.970 INFO:tasks.workunit.client.1.smithi161.stdout:9/172: creat d0/d20/f39 x:0 0 0 2024-09-18T12:51:59.974 INFO:tasks.workunit.client.1.smithi161.stdout:8/267: creat d0/d3/d10/d21/d4a/d52/f58 x:0 0 0 2024-09-18T12:51:59.974 INFO:tasks.workunit.client.0.smithi045.stdout:0/34: dwrite f4 [0,4194304] 0 2024-09-18T12:51:59.976 INFO:tasks.workunit.client.0.smithi045.stdout:6/118: truncate d9/d1a/d1d/f26 778170 0 2024-09-18T12:51:59.976 INFO:tasks.workunit.client.0.smithi045.stdout:0/35: read f4 [4147379,85886] 0 2024-09-18T12:51:59.977 INFO:tasks.workunit.client.0.smithi045.stdout:3/84: creat d0/f1a x:0 0 0 2024-09-18T12:51:59.978 INFO:tasks.workunit.client.0.smithi045.stdout:0/36: chown d6/d7 60899 1 2024-09-18T12:51:59.979 INFO:tasks.workunit.client.0.smithi045.stdout:1/13: getdents d0 0 2024-09-18T12:51:59.981 INFO:tasks.workunit.client.0.smithi045.stdout:5/51: symlink d6/l10 0 2024-09-18T12:51:59.981 INFO:tasks.workunit.client.0.smithi045.stdout:3/85: write d0/f16 [428075,75420] 0 2024-09-18T12:51:59.981 INFO:tasks.workunit.client.0.smithi045.stdout:2/41: dwrite d5/de/ff [0,4194304] 0 2024-09-18T12:51:59.982 INFO:tasks.workunit.client.1.smithi161.stdout:6/207: symlink d4/d39/d26/d20/l43 0 2024-09-18T12:51:59.984 INFO:tasks.workunit.client.0.smithi045.stdout:7/55: fdatasync f3 0 2024-09-18T12:51:59.984 INFO:tasks.workunit.client.1.smithi161.stdout:6/208: truncate d4/d39/d26/d20/d28/f3d 408226 0 2024-09-18T12:51:59.984 INFO:tasks.workunit.client.1.smithi161.stdout:6/209: dread - d4/d39/d26/f2b zero size 2024-09-18T12:51:59.987 INFO:tasks.workunit.client.1.smithi161.stdout:9/173: stat d0/d16/d12/f15 0 2024-09-18T12:51:59.987 INFO:tasks.workunit.client.1.smithi161.stdout:9/174: dread - d0/d16/f35 zero size 2024-09-18T12:51:59.990 INFO:tasks.workunit.client.0.smithi045.stdout:6/119: symlink d9/l27 0 2024-09-18T12:51:59.992 INFO:tasks.workunit.client.1.smithi161.stdout:3/270: rename d1/d2e/d24/d1d/f2b to d1/d2e/f5b 0 2024-09-18T12:51:59.992 INFO:tasks.workunit.client.1.smithi161.stdout:0/187: rename df/d29 to df/d29/d41 22 2024-09-18T12:51:59.993 INFO:tasks.workunit.client.1.smithi161.stdout:3/271: chown d1/d2e/d3d/c4d 1710751322 1 2024-09-18T12:51:59.994 INFO:tasks.workunit.client.1.smithi161.stdout:8/268: chown d0/c3c 206057642 1 2024-09-18T12:51:59.996 INFO:tasks.workunit.client.0.smithi045.stdout:0/37: creat d6/d7/fa x:0 0 0 2024-09-18T12:51:59.996 INFO:tasks.workunit.client.0.smithi045.stdout:0/38: readlink d6/d7/l8 0 2024-09-18T12:51:59.997 INFO:tasks.workunit.client.1.smithi161.stdout:2/240: link d0/d4/l4a d0/d4/l4e 0 2024-09-18T12:51:59.998 INFO:tasks.workunit.client.0.smithi045.stdout:3/86: mknod d0/d7/c1b 0 2024-09-18T12:51:59.998 INFO:tasks.workunit.client.1.smithi161.stdout:3/272: dwrite d1/d2e/d24/f1f [4194304,4194304] 0 2024-09-18T12:51:59.999 INFO:tasks.workunit.client.0.smithi045.stdout:3/87: write d0/d7/f10 [947453,21717] 0 2024-09-18T12:51:59.999 INFO:tasks.workunit.client.1.smithi161.stdout:5/189: creat d3/d3b/f3d x:0 0 0 2024-09-18T12:52:00.000 INFO:tasks.workunit.client.1.smithi161.stdout:5/190: write d3/f13 [5181687,77757] 0 2024-09-18T12:52:00.000 INFO:tasks.workunit.client.0.smithi045.stdout:2/42: symlink d5/l10 0 2024-09-18T12:52:00.001 INFO:tasks.workunit.client.1.smithi161.stdout:5/191: write d3/d14/d20/f32 [216553,100525] 0 2024-09-18T12:52:00.004 INFO:tasks.workunit.client.0.smithi045.stdout:5/52: write d6/db/fe [1709627,12312] 0 2024-09-18T12:52:00.006 INFO:tasks.workunit.client.1.smithi161.stdout:6/210: unlink d4/d1a/f2d 0 2024-09-18T12:52:00.011 INFO:tasks.workunit.client.0.smithi045.stdout:7/56: creat fc x:0 0 0 2024-09-18T12:52:00.014 INFO:tasks.workunit.client.1.smithi161.stdout:3/273: fdatasync d1/d2e/d3d/f38 0 2024-09-18T12:52:00.014 INFO:tasks.workunit.client.1.smithi161.stdout:0/188: creat df/d29/d2d/d37/f42 x:0 0 0 2024-09-18T12:52:00.014 INFO:tasks.workunit.client.0.smithi045.stdout:9/16: sync 2024-09-18T12:52:00.014 INFO:tasks.workunit.client.0.smithi045.stdout:4/90: sync 2024-09-18T12:52:00.015 INFO:tasks.workunit.client.0.smithi045.stdout:6/120: rename d9/fe to d9/f28 0 2024-09-18T12:52:00.016 INFO:tasks.workunit.client.0.smithi045.stdout:6/121: chown d9 278055107 1 2024-09-18T12:52:00.017 INFO:tasks.workunit.client.1.smithi161.stdout:8/269: stat d0/d3/d10/l11 0 2024-09-18T12:52:00.019 INFO:tasks.workunit.client.1.smithi161.stdout:2/241: chown d0/d1/l20 685920 1 2024-09-18T12:52:00.019 INFO:tasks.workunit.client.0.smithi045.stdout:0/39: symlink d6/lb 0 2024-09-18T12:52:00.019 INFO:tasks.workunit.client.1.smithi161.stdout:0/189: dwrite fd [0,4194304] 0 2024-09-18T12:52:00.020 INFO:tasks.workunit.client.1.smithi161.stdout:0/190: write df/d30/f3a [1008986,112007] 0 2024-09-18T12:52:00.021 INFO:tasks.workunit.client.0.smithi045.stdout:3/88: unlink d0/c3 0 2024-09-18T12:52:00.022 INFO:tasks.workunit.client.1.smithi161.stdout:4/224: write d5/f21 [615362,65525] 0 2024-09-18T12:52:00.022 INFO:tasks.workunit.client.1.smithi161.stdout:0/191: write df/f2b [12763,102626] 0 2024-09-18T12:52:00.023 INFO:tasks.workunit.client.0.smithi045.stdout:2/43: creat d5/f11 x:0 0 0 2024-09-18T12:52:00.023 INFO:tasks.workunit.client.1.smithi161.stdout:4/225: write d5/f17 [1565821,37625] 0 2024-09-18T12:52:00.024 INFO:tasks.workunit.client.1.smithi161.stdout:4/226: read d5/fc [4513614,13880] 0 2024-09-18T12:52:00.025 INFO:tasks.workunit.client.1.smithi161.stdout:4/227: read d5/d32/f38 [2211383,36060] 0 2024-09-18T12:52:00.026 INFO:tasks.workunit.client.0.smithi045.stdout:5/53: fdatasync d6/f7 0 2024-09-18T12:52:00.027 INFO:tasks.workunit.client.1.smithi161.stdout:1/155: truncate d1/d1d/f21 375920 0 2024-09-18T12:52:00.029 INFO:tasks.workunit.client.0.smithi045.stdout:8/27: getdents . 0 2024-09-18T12:52:00.030 INFO:tasks.workunit.client.0.smithi045.stdout:8/28: dread f0 [0,4194304] 0 2024-09-18T12:52:00.031 INFO:tasks.workunit.client.0.smithi045.stdout:8/29: truncate f0 285057 0 2024-09-18T12:52:00.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:51:59 smithi045 ceph-mon[28315]: pgmap v22: 65 pgs: 65 active+clean; 337 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 23 MiB/s wr, 279 op/s 2024-09-18T12:52:00.034 INFO:tasks.workunit.client.1.smithi161.stdout:3/274: chown d1/d2e/d14/l55 113440420 1 2024-09-18T12:52:00.035 INFO:tasks.workunit.client.0.smithi045.stdout:7/57: creat fd x:0 0 0 2024-09-18T12:52:00.038 INFO:tasks.workunit.client.1.smithi161.stdout:8/270: readlink d0/d3/d10/l41 0 2024-09-18T12:52:00.039 INFO:tasks.workunit.client.1.smithi161.stdout:2/242: fdatasync d0/d5/d43/f18 0 2024-09-18T12:52:00.039 INFO:tasks.workunit.client.0.smithi045.stdout:8/30: dwrite f7 [0,4194304] 0 2024-09-18T12:52:00.041 INFO:tasks.workunit.client.1.smithi161.stdout:7/180: dwrite d3/f14 [0,4194304] 0 2024-09-18T12:52:00.042 INFO:tasks.workunit.client.0.smithi045.stdout:6/122: creat d9/f29 x:0 0 0 2024-09-18T12:52:00.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:51:59 smithi161 ceph-mon[35784]: pgmap v22: 65 pgs: 65 active+clean; 337 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 23 MiB/s wr, 279 op/s 2024-09-18T12:52:00.045 INFO:tasks.workunit.client.0.smithi045.stdout:1/14: rmdir d0/d3 0 2024-09-18T12:52:00.045 INFO:tasks.workunit.client.1.smithi161.stdout:9/175: dwrite d0/db/f13 [0,4194304] 0 2024-09-18T12:52:00.046 INFO:tasks.workunit.client.0.smithi045.stdout:6/123: dread d9/f19 [0,4194304] 0 2024-09-18T12:52:00.057 INFO:tasks.workunit.client.0.smithi045.stdout:2/44: creat d5/f12 x:0 0 0 2024-09-18T12:52:00.058 INFO:tasks.workunit.client.1.smithi161.stdout:1/156: creat d1/da/d1f/f2c x:0 0 0 2024-09-18T12:52:00.061 INFO:tasks.workunit.client.0.smithi045.stdout:2/45: dread d5/de/ff [0,4194304] 0 2024-09-18T12:52:00.061 INFO:tasks.workunit.client.0.smithi045.stdout:2/46: fdatasync d5/de/ff 0 2024-09-18T12:52:00.062 INFO:tasks.workunit.client.1.smithi161.stdout:6/211: rename d4/d1a/l41 to d4/d39/l44 0 2024-09-18T12:52:00.063 INFO:tasks.workunit.client.1.smithi161.stdout:6/212: write d4/d1a/d1c/f2c [772869,112187] 0 2024-09-18T12:52:00.066 INFO:tasks.workunit.client.1.smithi161.stdout:8/271: symlink d0/d3/d10/d21/l59 0 2024-09-18T12:52:00.070 INFO:tasks.workunit.client.0.smithi045.stdout:4/91: creat db/d1b/f23 x:0 0 0 2024-09-18T12:52:00.072 INFO:tasks.workunit.client.0.smithi045.stdout:8/31: unlink c2 0 2024-09-18T12:52:00.073 INFO:tasks.workunit.client.1.smithi161.stdout:6/213: dwrite d4/d39/d26/d20/f2a [0,4194304] 0 2024-09-18T12:52:00.073 INFO:tasks.workunit.client.1.smithi161.stdout:0/192: dwrite df/f26 [0,4194304] 0 2024-09-18T12:52:00.074 INFO:tasks.workunit.client.0.smithi045.stdout:1/15: symlink d0/l5 0 2024-09-18T12:52:00.076 INFO:tasks.workunit.client.1.smithi161.stdout:4/228: mkdir d5/d27/d3a/d47/d49 0 2024-09-18T12:52:00.076 INFO:tasks.workunit.client.1.smithi161.stdout:0/193: read df/f23 [392020,108292] 0 2024-09-18T12:52:00.076 INFO:tasks.workunit.client.0.smithi045.stdout:6/124: rename d9/l21 to d9/d1a/l2a 0 2024-09-18T12:52:00.078 INFO:tasks.workunit.client.1.smithi161.stdout:1/157: rename d1/c4 to d1/d1d/c2d 0 2024-09-18T12:52:00.079 INFO:tasks.workunit.client.0.smithi045.stdout:0/40: mknod d6/d7/cc 0 2024-09-18T12:52:00.080 INFO:tasks.workunit.client.1.smithi161.stdout:1/158: write d1/d26/f9 [344572,28955] 0 2024-09-18T12:52:00.083 INFO:tasks.workunit.client.0.smithi045.stdout:7/58: write f2 [2357387,23304] 0 2024-09-18T12:52:00.087 INFO:tasks.workunit.client.0.smithi045.stdout:9/17: truncate d0/f2 2520010 0 2024-09-18T12:52:00.088 INFO:tasks.workunit.client.0.smithi045.stdout:7/59: dread f7 [0,4194304] 0 2024-09-18T12:52:00.088 INFO:tasks.workunit.client.0.smithi045.stdout:5/54: creat d6/df/f11 x:0 0 0 2024-09-18T12:52:00.091 INFO:tasks.workunit.client.0.smithi045.stdout:2/47: creat d5/de/f13 x:0 0 0 2024-09-18T12:52:00.091 INFO:tasks.workunit.client.0.smithi045.stdout:7/60: dread f3 [0,4194304] 0 2024-09-18T12:52:00.093 INFO:tasks.workunit.client.0.smithi045.stdout:4/92: mkdir db/d1b/d24 0 2024-09-18T12:52:00.094 INFO:tasks.workunit.client.0.smithi045.stdout:8/32: dread f0 [0,4194304] 0 2024-09-18T12:52:00.097 INFO:tasks.workunit.client.0.smithi045.stdout:4/93: dread db/d10/d13/f14 [0,4194304] 0 2024-09-18T12:52:00.098 INFO:tasks.workunit.client.0.smithi045.stdout:1/16: rename d0/f4 to d0/f6 0 2024-09-18T12:52:00.101 INFO:tasks.workunit.client.0.smithi045.stdout:6/125: creat d9/f2b x:0 0 0 2024-09-18T12:52:00.102 INFO:tasks.workunit.client.0.smithi045.stdout:1/17: dread d0/f6 [0,4194304] 0 2024-09-18T12:52:00.107 INFO:tasks.workunit.client.1.smithi161.stdout:3/275: link d1/d2e/f5b d1/f5c 0 2024-09-18T12:52:00.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.105+0000 7f6531e9d640 1 -- 172.21.15.45:0/61276107 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f652c109330 con 0x7f6514074ad0 2024-09-18T12:52:00.107 INFO:tasks.workunit.client.0.smithi045.stdout:3/89: link d0/c13 d0/d7/c1c 0 2024-09-18T12:52:00.108 INFO:tasks.workunit.client.1.smithi161.stdout:5/192: sync 2024-09-18T12:52:00.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.107+0000 7f6528ff9640 1 -- 172.21.15.45:0/61276107 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f652c109330 con 0x7f6514074ad0 2024-09-18T12:52:00.109 INFO:tasks.workunit.client.1.smithi161.stdout:7/181: link d3/f7 d3/d8/d15/f26 0 2024-09-18T12:52:00.109 INFO:tasks.workunit.client.0.smithi045.stdout:6/126: dwrite d9/f2b [0,4194304] 0 2024-09-18T12:52:00.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.110+0000 7f6531e9d640 1 -- 172.21.15.45:0/61276107 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f6514074ad0 msgr2=0x7f6514076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:00.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.110+0000 7f6531e9d640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f6514074ad0 0x7f6514076f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f652c19ac00 tx=0x7f6520005a20 comp rx=0 tx=0).stop 2024-09-18T12:52:00.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.110+0000 7f6531e9d640 1 -- 172.21.15.45:0/61276107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652c103b60 msgr2=0x7f652c199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.110+0000 7f6531e9d640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652c103b60 0x7f652c199750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f651c00b3f0 tx=0x7f651c00b8b0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.111+0000 7f6531e9d640 1 -- 172.21.15.45:0/61276107 shutdown_connections 2024-09-18T12:52:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.111+0000 7f6531e9d640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f6514074ad0 0x7f6514076f90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.111+0000 7f6531e9d640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c104d60 0x7f652c199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.111+0000 7f6531e9d640 1 --2- 172.21.15.45:0/61276107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652c103b60 0x7f652c199750 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.111+0000 7f6531e9d640 1 -- 172.21.15.45:0/61276107 >> 172.21.15.45:0/61276107 conn(0x7f652c0ff2f0 msgr2=0x7f652c101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:00.113 INFO:tasks.workunit.client.0.smithi045.stdout:6/127: stat d9/d1a/d1d/l24 0 2024-09-18T12:52:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.112+0000 7f6531e9d640 1 -- 172.21.15.45:0/61276107 shutdown_connections 2024-09-18T12:52:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.112+0000 7f6531e9d640 1 -- 172.21.15.45:0/61276107 wait complete. 2024-09-18T12:52:00.114 INFO:tasks.workunit.client.0.smithi045.stdout:5/55: creat d6/db/f12 x:0 0 0 2024-09-18T12:52:00.114 INFO:tasks.workunit.client.1.smithi161.stdout:8/272: dwrite d0/d3/fb [0,4194304] 0 2024-09-18T12:52:00.116 INFO:tasks.workunit.client.0.smithi045.stdout:2/48: chown c4 16139 1 2024-09-18T12:52:00.117 INFO:tasks.workunit.client.0.smithi045.stdout:3/90: dwrite d0/f4 [4194304,4194304] 0 2024-09-18T12:52:00.118 INFO:tasks.workunit.client.0.smithi045.stdout:2/49: chown d5/fd 0 1 2024-09-18T12:52:00.119 INFO:tasks.workunit.client.0.smithi045.stdout:2/50: chown d5/ca 1296582336 1 2024-09-18T12:52:00.121 INFO:tasks.workunit.client.1.smithi161.stdout:8/273: dwrite d0/d3/fb [0,4194304] 0 2024-09-18T12:52:00.121 INFO:tasks.workunit.client.1.smithi161.stdout:0/194: creat df/d29/d36/f43 x:0 0 0 2024-09-18T12:52:00.122 INFO:tasks.workunit.client.1.smithi161.stdout:8/274: write d0/d3/f3d [1860409,48849] 0 2024-09-18T12:52:00.127 INFO:tasks.workunit.client.1.smithi161.stdout:1/159: link d1/f15 d1/d26/f2e 0 2024-09-18T12:52:00.129 INFO:tasks.workunit.client.1.smithi161.stdout:3/276: creat d1/d2e/d24/d1d/f5d x:0 0 0 2024-09-18T12:52:00.131 INFO:tasks.workunit.client.1.smithi161.stdout:9/176: dwrite d0/f3 [0,4194304] 0 2024-09-18T12:52:00.132 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:52:00.132 INFO:tasks.workunit.client.0.smithi045.stdout:4/94: creat db/d1b/f25 x:0 0 0 2024-09-18T12:52:00.133 INFO:tasks.workunit.client.1.smithi161.stdout:3/277: chown d1/d2e/f17 482 1 2024-09-18T12:52:00.133 INFO:tasks.workunit.client.0.smithi045.stdout:4/95: write f7 [814402,107676] 0 2024-09-18T12:52:00.135 INFO:tasks.workunit.client.1.smithi161.stdout:7/182: unlink d3/f6 0 2024-09-18T12:52:00.135 INFO:tasks.workunit.client.1.smithi161.stdout:5/193: dread d3/d14/f1b [0,4194304] 0 2024-09-18T12:52:00.136 INFO:tasks.workunit.client.1.smithi161.stdout:5/194: dread - d3/f2a zero size 2024-09-18T12:52:00.137 INFO:tasks.workunit.client.1.smithi161.stdout:8/275: dwrite d0/d3/d10/d21/d4a/f4f [0,4194304] 0 2024-09-18T12:52:00.137 INFO:tasks.workunit.client.1.smithi161.stdout:7/183: truncate d3/f23 965335 0 2024-09-18T12:52:00.140 INFO:tasks.workunit.client.1.smithi161.stdout:7/184: truncate d3/f11 107961 0 2024-09-18T12:52:00.140 INFO:tasks.workunit.client.0.smithi045.stdout:1/18: creat d0/f7 x:0 0 0 2024-09-18T12:52:00.141 INFO:tasks.workunit.client.0.smithi045.stdout:1/19: chown d0/f6 67 1 2024-09-18T12:52:00.147 INFO:tasks.workunit.client.1.smithi161.stdout:1/160: creat d1/d26/f2f x:0 0 0 2024-09-18T12:52:00.147 INFO:tasks.workunit.client.1.smithi161.stdout:5/195: dwrite d3/d14/d20/f3c [0,4194304] 0 2024-09-18T12:52:00.149 INFO:tasks.workunit.client.1.smithi161.stdout:6/214: dwrite d4/f10 [0,4194304] 0 2024-09-18T12:52:00.150 INFO:tasks.workunit.client.0.smithi045.stdout:3/91: creat d0/d7/f1d x:0 0 0 2024-09-18T12:52:00.150 INFO:tasks.workunit.client.1.smithi161.stdout:6/215: dread - d4/d39/d26/d20/d28/f3b zero size 2024-09-18T12:52:00.151 INFO:tasks.workunit.client.0.smithi045.stdout:2/51: mknod d5/de/c14 0 2024-09-18T12:52:00.151 INFO:tasks.workunit.client.0.smithi045.stdout:7/61: dwrite f3 [0,4194304] 0 2024-09-18T12:52:00.152 INFO:tasks.workunit.client.0.smithi045.stdout:3/92: read d0/fe [251647,92851] 0 2024-09-18T12:52:00.152 INFO:tasks.workunit.client.1.smithi161.stdout:6/216: dread - d4/d39/d26/d20/d28/f37 zero size 2024-09-18T12:52:00.154 INFO:tasks.workunit.client.1.smithi161.stdout:6/217: write d4/d39/d3a/f3f [1014963,27492] 0 2024-09-18T12:52:00.155 INFO:tasks.workunit.client.1.smithi161.stdout:6/218: chown d4/d39/d26/f40 0 1 2024-09-18T12:52:00.157 INFO:tasks.workunit.client.1.smithi161.stdout:6/219: chown d4/d39/d26/d20/d28/f3b 2 1 2024-09-18T12:52:00.158 INFO:tasks.workunit.client.1.smithi161.stdout:6/220: readlink d4/d39/l34 0 2024-09-18T12:52:00.159 INFO:tasks.workunit.client.1.smithi161.stdout:6/221: chown d4/d1a/l12 6443977 1 2024-09-18T12:52:00.160 INFO:tasks.workunit.client.1.smithi161.stdout:6/222: read d4/d1a/d1c/f25 [71243,48251] 0 2024-09-18T12:52:00.161 INFO:tasks.workunit.client.1.smithi161.stdout:7/185: creat d3/d8/d15/f27 x:0 0 0 2024-09-18T12:52:00.161 INFO:tasks.workunit.client.1.smithi161.stdout:6/223: stat d4/d1a/d1c 0 2024-09-18T12:52:00.164 INFO:tasks.workunit.client.1.smithi161.stdout:7/186: write d3/d8/d15/d1a/f22 [597187,46530] 0 2024-09-18T12:52:00.164 INFO:tasks.workunit.client.1.smithi161.stdout:0/195: rename df/c21 to df/d29/d2d/d37/c44 0 2024-09-18T12:52:00.165 INFO:tasks.workunit.client.0.smithi045.stdout:1/20: creat d0/f8 x:0 0 0 2024-09-18T12:52:00.166 INFO:tasks.workunit.client.0.smithi045.stdout:1/21: readlink d0/l1 0 2024-09-18T12:52:00.167 INFO:tasks.workunit.client.1.smithi161.stdout:5/196: creat d3/d14/d20/f3e x:0 0 0 2024-09-18T12:52:00.168 INFO:tasks.workunit.client.1.smithi161.stdout:9/177: truncate d0/fd 1750799 0 2024-09-18T12:52:00.170 INFO:tasks.workunit.client.1.smithi161.stdout:5/197: truncate d3/d9/f2d 941074 0 2024-09-18T12:52:00.171 INFO:tasks.workunit.client.0.smithi045.stdout:2/52: symlink d5/l15 0 2024-09-18T12:52:00.172 INFO:tasks.workunit.client.0.smithi045.stdout:7/62: mknod ce 0 2024-09-18T12:52:00.172 INFO:tasks.workunit.client.0.smithi045.stdout:7/63: stat l4 0 2024-09-18T12:52:00.172 INFO:tasks.workunit.client.1.smithi161.stdout:2/243: sync 2024-09-18T12:52:00.172 INFO:tasks.workunit.client.1.smithi161.stdout:5/198: fdatasync d3/d14/d20/f32 0 2024-09-18T12:52:00.173 INFO:tasks.workunit.client.1.smithi161.stdout:0/196: mkdir df/d29/d36/d45 0 2024-09-18T12:52:00.173 INFO:tasks.workunit.client.1.smithi161.stdout:5/199: chown d3/d14/f19 80462919 1 2024-09-18T12:52:00.173 INFO:tasks.workunit.client.0.smithi045.stdout:3/93: mkdir d0/d1e 0 2024-09-18T12:52:00.174 INFO:tasks.workunit.client.0.smithi045.stdout:3/94: truncate d0/f16 600432 0 2024-09-18T12:52:00.175 INFO:tasks.workunit.client.1.smithi161.stdout:7/187: dwrite d3/f17 [0,4194304] 0 2024-09-18T12:52:00.175 INFO:tasks.workunit.client.1.smithi161.stdout:3/278: rename d1/d2e/d3d/f39 to d1/d2e/d3d/d49/f5e 0 2024-09-18T12:52:00.175 INFO:tasks.workunit.client.1.smithi161.stdout:1/161: rename d1/da/d1f to d1/da/d1f/d30 22 2024-09-18T12:52:00.176 INFO:tasks.workunit.client.1.smithi161.stdout:7/188: chown d3/f23 304 1 2024-09-18T12:52:00.177 INFO:tasks.workunit.client.1.smithi161.stdout:8/276: creat d0/f5a x:0 0 0 2024-09-18T12:52:00.177 INFO:tasks.workunit.client.1.smithi161.stdout:7/189: chown d3/d8/d15/d1a/f22 43707144 1 2024-09-18T12:52:00.178 INFO:tasks.workunit.client.0.smithi045.stdout:4/96: mknod db/de/d1a/c26 0 2024-09-18T12:52:00.178 INFO:tasks.workunit.client.1.smithi161.stdout:9/178: readlink d0/l1c 0 2024-09-18T12:52:00.181 INFO:tasks.workunit.client.0.smithi045.stdout:1/22: creat d0/f9 x:0 0 0 2024-09-18T12:52:00.181 INFO:tasks.workunit.client.1.smithi161.stdout:6/224: dread d4/d1a/f11 [0,4194304] 0 2024-09-18T12:52:00.182 INFO:tasks.workunit.client.0.smithi045.stdout:0/41: link l3 d6/ld 0 2024-09-18T12:52:00.183 INFO:tasks.workunit.client.0.smithi045.stdout:2/53: rmdir d5/de 39 2024-09-18T12:52:00.184 INFO:tasks.workunit.client.0.smithi045.stdout:3/95: dwrite d0/fb [4194304,4194304] 0 2024-09-18T12:52:00.185 INFO:tasks.workunit.client.0.smithi045.stdout:1/23: truncate d0/f7 797927 0 2024-09-18T12:52:00.185 INFO:tasks.workunit.client.0.smithi045.stdout:7/64: rename l6 to lf 0 2024-09-18T12:52:00.186 INFO:tasks.workunit.client.1.smithi161.stdout:2/244: readlink d0/d1/l21 0 2024-09-18T12:52:00.187 INFO:tasks.workunit.client.0.smithi045.stdout:1/24: stat d0/f8 0 2024-09-18T12:52:00.192 INFO:tasks.workunit.client.0.smithi045.stdout:8/33: getdents . 0 2024-09-18T12:52:00.194 INFO:tasks.workunit.client.0.smithi045.stdout:8/34: dread - f6 zero size 2024-09-18T12:52:00.195 INFO:tasks.workunit.client.1.smithi161.stdout:4/229: sync 2024-09-18T12:52:00.195 INFO:tasks.workunit.client.1.smithi161.stdout:5/200: symlink d3/l3f 0 2024-09-18T12:52:00.197 INFO:tasks.workunit.client.1.smithi161.stdout:1/162: mkdir d1/da/d31 0 2024-09-18T12:52:00.198 INFO:tasks.workunit.client.1.smithi161.stdout:1/163: truncate d1/d26/fb 1275233 0 2024-09-18T12:52:00.199 INFO:tasks.workunit.client.0.smithi045.stdout:7/65: mknod c10 0 2024-09-18T12:52:00.203 INFO:tasks.workunit.client.0.smithi045.stdout:0/42: dwrite d6/d7/fa [0,4194304] 0 2024-09-18T12:52:00.203 INFO:tasks.workunit.client.0.smithi045.stdout:7/66: dread - fd zero size 2024-09-18T12:52:00.203 INFO:tasks.workunit.client.0.smithi045.stdout:5/56: dwrite d6/f7 [0,4194304] 0 2024-09-18T12:52:00.204 INFO:tasks.workunit.client.0.smithi045.stdout:1/25: creat d0/fa x:0 0 0 2024-09-18T12:52:00.205 INFO:tasks.workunit.client.0.smithi045.stdout:3/96: dwrite d0/f4 [4194304,4194304] 0 2024-09-18T12:52:00.205 INFO:tasks.workunit.client.1.smithi161.stdout:8/277: mkdir d0/d38/d5b 0 2024-09-18T12:52:00.207 INFO:tasks.workunit.client.1.smithi161.stdout:8/278: write d0/d3/d10/d21/d4a/d52/f58 [161210,11802] 0 2024-09-18T12:52:00.209 INFO:tasks.workunit.client.0.smithi045.stdout:3/97: chown d0/d7/c1b 2 1 2024-09-18T12:52:00.212 INFO:tasks.workunit.client.0.smithi045.stdout:6/128: truncate d9/f28 2331762 0 2024-09-18T12:52:00.214 INFO:tasks.workunit.client.1.smithi161.stdout:9/179: symlink d0/d16/d25/d28/l3a 0 2024-09-18T12:52:00.214 INFO:tasks.workunit.client.0.smithi045.stdout:9/18: dread d0/f2 [0,4194304] 0 2024-09-18T12:52:00.215 INFO:tasks.workunit.client.1.smithi161.stdout:9/180: write d0/d16/d25/f27 [677926,54416] 0 2024-09-18T12:52:00.216 INFO:tasks.workunit.client.1.smithi161.stdout:6/225: mkdir d4/d39/d26/d20/d45 0 2024-09-18T12:52:00.217 INFO:tasks.workunit.client.0.smithi045.stdout:1/26: dwrite d0/fa [0,4194304] 0 2024-09-18T12:52:00.223 INFO:tasks.workunit.client.1.smithi161.stdout:4/230: rename d5/l24 to d5/d27/d3a/d47/d49/l4a 0 2024-09-18T12:52:00.226 INFO:tasks.workunit.client.0.smithi045.stdout:2/54: mkdir d5/de/d16 0 2024-09-18T12:52:00.226 INFO:tasks.workunit.client.0.smithi045.stdout:2/55: fsync d5/fb 0 2024-09-18T12:52:00.227 INFO:tasks.workunit.client.1.smithi161.stdout:0/197: getdents df/d29/d36/d45 0 2024-09-18T12:52:00.230 INFO:tasks.workunit.client.1.smithi161.stdout:5/201: rename d3/f33 to d3/f40 0 2024-09-18T12:52:00.231 INFO:tasks.workunit.client.1.smithi161.stdout:1/164: symlink d1/d26/l32 0 2024-09-18T12:52:00.232 INFO:tasks.workunit.client.0.smithi045.stdout:7/67: creat f11 x:0 0 0 2024-09-18T12:52:00.235 INFO:tasks.workunit.client.1.smithi161.stdout:3/279: link d1/d2e/d24/d1d/f4f d1/d2e/d3d/d49/f5f 0 2024-09-18T12:52:00.236 INFO:tasks.workunit.client.0.smithi045.stdout:5/57: mknod d6/df/c13 0 2024-09-18T12:52:00.236 INFO:tasks.workunit.client.1.smithi161.stdout:1/165: dwrite d1/d26/f7 [0,4194304] 0 2024-09-18T12:52:00.237 INFO:tasks.workunit.client.0.smithi045.stdout:5/58: chown d6/f7 110022 1 2024-09-18T12:52:00.237 INFO:tasks.workunit.client.1.smithi161.stdout:1/166: write d1/d26/f10 [669920,22784] 0 2024-09-18T12:52:00.238 INFO:tasks.workunit.client.0.smithi045.stdout:3/98: chown d0/d7/l14 2 1 2024-09-18T12:52:00.238 INFO:tasks.workunit.client.0.smithi045.stdout:5/59: truncate d6/db/f12 347106 0 2024-09-18T12:52:00.238 INFO:tasks.workunit.client.1.smithi161.stdout:9/181: read d0/f5 [1919835,128783] 0 2024-09-18T12:52:00.239 INFO:tasks.workunit.client.0.smithi045.stdout:3/99: write d0/f4 [8676686,69284] 0 2024-09-18T12:52:00.240 INFO:tasks.workunit.client.0.smithi045.stdout:6/129: rmdir d9/d1a/d1d 39 2024-09-18T12:52:00.240 INFO:tasks.workunit.client.1.smithi161.stdout:6/226: mkdir d4/d39/d46 0 2024-09-18T12:52:00.241 INFO:tasks.workunit.client.1.smithi161.stdout:2/245: mkdir d0/d1/d3b/d3d/d4f 0 2024-09-18T12:52:00.241 INFO:tasks.workunit.client.1.smithi161.stdout:6/227: fsync d4/d39/d3a/f3f 0 2024-09-18T12:52:00.242 INFO:tasks.workunit.client.0.smithi045.stdout:9/19: creat d0/d3/f7 x:0 0 0 2024-09-18T12:52:00.242 INFO:tasks.workunit.client.1.smithi161.stdout:6/228: stat d4/f19 0 2024-09-18T12:52:00.242 INFO:tasks.workunit.client.0.smithi045.stdout:9/20: stat d0/d3/l4 0 2024-09-18T12:52:00.243 INFO:tasks.workunit.client.1.smithi161.stdout:6/229: write d4/d1a/d1c/f24 [2036631,75401] 0 2024-09-18T12:52:00.246 INFO:tasks.workunit.client.1.smithi161.stdout:5/202: creat d3/d9/f41 x:0 0 0 2024-09-18T12:52:00.248 INFO:tasks.workunit.client.1.smithi161.stdout:8/279: link d0/d3/d10/d21/f49 d0/d38/f5c 0 2024-09-18T12:52:00.251 INFO:tasks.workunit.client.1.smithi161.stdout:3/280: rename d1/d2e/d24/d1d/l34 to d1/d2e/d3d/d49/l60 0 2024-09-18T12:52:00.257 INFO:tasks.workunit.client.1.smithi161.stdout:1/167: dread d1/d26/fe [0,4194304] 0 2024-09-18T12:52:00.257 INFO:tasks.workunit.client.1.smithi161.stdout:4/231: getdents d5/d27/d44 0 2024-09-18T12:52:00.258 INFO:tasks.workunit.client.1.smithi161.stdout:1/168: chown d1/d1d 1402573047 1 2024-09-18T12:52:00.259 INFO:tasks.workunit.client.1.smithi161.stdout:6/230: mkdir d4/d39/d47 0 2024-09-18T12:52:00.261 INFO:tasks.workunit.client.1.smithi161.stdout:4/232: write d5/d27/f37 [763979,63672] 0 2024-09-18T12:52:00.261 INFO:tasks.workunit.client.0.smithi045.stdout:1/27: creat d0/fb x:0 0 0 2024-09-18T12:52:00.261 INFO:tasks.workunit.client.1.smithi161.stdout:8/280: fdatasync d0/f16 0 2024-09-18T12:52:00.262 INFO:tasks.workunit.client.0.smithi045.stdout:4/97: getdents db/d1b 0 2024-09-18T12:52:00.262 INFO:tasks.workunit.client.0.smithi045.stdout:1/28: chown d0 90 1 2024-09-18T12:52:00.263 INFO:tasks.workunit.client.1.smithi161.stdout:2/246: rename d0/d5/d43/d23/c33 to d0/d4/c50 0 2024-09-18T12:52:00.263 INFO:tasks.workunit.client.1.smithi161.stdout:6/231: chown d4/d39/d3a/f29 6 1 2024-09-18T12:52:00.264 INFO:tasks.workunit.client.0.smithi045.stdout:3/100: unlink d0/fb 0 2024-09-18T12:52:00.264 INFO:tasks.workunit.client.0.smithi045.stdout:5/60: stat c4 0 2024-09-18T12:52:00.265 INFO:tasks.workunit.client.1.smithi161.stdout:3/281: unlink d1/d2e/d3d/l59 0 2024-09-18T12:52:00.265 INFO:tasks.workunit.client.1.smithi161.stdout:7/190: dwrite d3/f19 [0,4194304] 0 2024-09-18T12:52:00.266 INFO:tasks.workunit.client.1.smithi161.stdout:0/198: dread df/f32 [0,4194304] 0 2024-09-18T12:52:00.266 INFO:tasks.workunit.client.1.smithi161.stdout:2/247: dread - d0/d1/d3b/f42 zero size 2024-09-18T12:52:00.266 INFO:tasks.workunit.client.0.smithi045.stdout:5/61: write d6/df/f11 [297059,2384] 0 2024-09-18T12:52:00.269 INFO:tasks.workunit.client.0.smithi045.stdout:9/21: symlink d0/d3/l8 0 2024-09-18T12:52:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.268+0000 7f2f89d1f640 1 -- 172.21.15.45:0/3632221129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f84101a60 msgr2=0x7f2f84101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.268+0000 7f2f89d1f640 1 --2- 172.21.15.45:0/3632221129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f84101a60 0x7f2f84101ee0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009880 tx=0x7f2f7402a4b0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.269+0000 7f2f89d1f640 1 -- 172.21.15.45:0/3632221129 shutdown_connections 2024-09-18T12:52:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.269+0000 7f2f89d1f640 1 --2- 172.21.15.45:0/3632221129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f84101a60 0x7f2f84101ee0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.269+0000 7f2f89d1f640 1 --2- 172.21.15.45:0/3632221129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84100860 0x7f2f84100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.269+0000 7f2f89d1f640 1 -- 172.21.15.45:0/3632221129 >> 172.21.15.45:0/3632221129 conn(0x7f2f840fc010 msgr2=0x7f2f840fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:00.271 INFO:tasks.workunit.client.0.smithi045.stdout:3/101: truncate d0/d7/f1d 637908 0 2024-09-18T12:52:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.270+0000 7f2f89d1f640 1 -- 172.21.15.45:0/3632221129 shutdown_connections 2024-09-18T12:52:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.271+0000 7f2f89d1f640 1 -- 172.21.15.45:0/3632221129 wait complete. 2024-09-18T12:52:00.272 INFO:tasks.workunit.client.0.smithi045.stdout:8/35: link f5 f9 0 2024-09-18T12:52:00.274 INFO:tasks.workunit.client.1.smithi161.stdout:6/232: dwrite d4/f10 [0,4194304] 0 2024-09-18T12:52:00.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.272+0000 7f2f89d1f640 1 Processor -- start 2024-09-18T12:52:00.274 INFO:tasks.workunit.client.0.smithi045.stdout:9/22: write d0/d3/f7 [755384,20135] 0 2024-09-18T12:52:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.273+0000 7f2f89d1f640 1 -- start start 2024-09-18T12:52:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.274+0000 7f2f89d1f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84100860 0x7f2f841963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.274+0000 7f2f89d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f84101a60 0x7f2f84196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.274+0000 7f2f89d1f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2f84109680 con 0x7f2f84101a60 2024-09-18T12:52:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.274+0000 7f2f89d1f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2f84109500 con 0x7f2f84100860 2024-09-18T12:52:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.274+0000 7f2f82ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f84101a60 0x7f2f84196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.274+0000 7f2f82ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f84101a60 0x7f2f84196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36018/0 (socket says 172.21.15.45:36018) 2024-09-18T12:52:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.274+0000 7f2f82ffd640 1 -- 172.21.15.45:0/418407941 learned_addr learned my addr 172.21.15.45:0/418407941 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:52:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.275+0000 7f2f837fe640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84100860 0x7f2f841963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:00.277 INFO:tasks.workunit.client.0.smithi045.stdout:4/98: dwrite f7 [0,4194304] 0 2024-09-18T12:52:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.275+0000 7f2f82ffd640 1 -- 172.21.15.45:0/418407941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84100860 msgr2=0x7f2f841963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.275+0000 7f2f82ffd640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84100860 0x7f2f841963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.275+0000 7f2f82ffd640 1 -- 172.21.15.45:0/418407941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f84196f80 con 0x7f2f84101a60 2024-09-18T12:52:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.275+0000 7f2f82ffd640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f84101a60 0x7f2f84196900 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009230 tx=0x7f2f740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:00.278 INFO:tasks.workunit.client.1.smithi161.stdout:3/282: dwrite d1/f19 [4194304,4194304] 0 2024-09-18T12:52:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.277+0000 7f2f80ff9640 1 -- 172.21.15.45:0/418407941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f7403f070 con 0x7f2f84101a60 2024-09-18T12:52:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.277+0000 7f2f80ff9640 1 -- 172.21.15.45:0/418407941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f74004b80 con 0x7f2f84101a60 2024-09-18T12:52:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.277+0000 7f2f80ff9640 1 -- 172.21.15.45:0/418407941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f74035030 con 0x7f2f84101a60 2024-09-18T12:52:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.277+0000 7f2f89d1f640 1 -- 172.21.15.45:0/418407941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8419b960 con 0x7f2f84101a60 2024-09-18T12:52:00.279 INFO:tasks.workunit.client.1.smithi161.stdout:0/199: dwrite df/f26 [0,4194304] 0 2024-09-18T12:52:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.277+0000 7f2f89d1f640 1 -- 172.21.15.45:0/418407941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8419be30 con 0x7f2f84101a60 2024-09-18T12:52:00.281 INFO:tasks.workunit.client.0.smithi045.stdout:4/99: write db/d1b/f23 [22860,128437] 0 2024-09-18T12:52:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.280+0000 7f2f89d1f640 1 -- 172.21.15.45:0/418407941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f700052c0 con 0x7f2f84101a60 2024-09-18T12:52:00.282 INFO:tasks.workunit.client.1.smithi161.stdout:6/233: truncate d4/d39/d26/d20/d28/f3d 1334021 0 2024-09-18T12:52:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.282+0000 7f2f80ff9640 1 -- 172.21.15.45:0/418407941 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f2f74042070 con 0x7f2f84101a60 2024-09-18T12:52:00.284 INFO:tasks.workunit.client.0.smithi045.stdout:5/62: dwrite d6/db/fe [0,4194304] 0 2024-09-18T12:52:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.282+0000 7f2f80ff9640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f2f6c074ab0 0x7f2f6c076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.283+0000 7f2f80ff9640 1 -- 172.21.15.45:0/418407941 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f2f740b6d30 con 0x7f2f84101a60 2024-09-18T12:52:00.287 INFO:tasks.workunit.client.0.smithi045.stdout:4/100: write f9 [1799651,50917] 0 2024-09-18T12:52:00.287 INFO:tasks.workunit.client.1.smithi161.stdout:5/203: fsync d3/d9/f41 0 2024-09-18T12:52:00.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.286+0000 7f2f837fe640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f2f6c074ab0 0x7f2f6c076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:00.290 INFO:tasks.workunit.client.0.smithi045.stdout:6/130: mknod d9/d1a/c2c 0 2024-09-18T12:52:00.290 INFO:tasks.workunit.client.1.smithi161.stdout:5/204: write d3/d14/f19 [495789,38572] 0 2024-09-18T12:52:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.289+0000 7f2f837fe640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f2f6c074ab0 0x7f2f6c076f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2f78005fd0 tx=0x7f2f78005850 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:00.291 INFO:tasks.workunit.client.1.smithi161.stdout:5/205: read d3/fd [4273120,22545] 0 2024-09-18T12:52:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.293+0000 7f2f80ff9640 1 -- 172.21.15.45:0/418407941 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f2f740823e0 con 0x7f2f84101a60 2024-09-18T12:52:00.296 INFO:tasks.workunit.client.0.smithi045.stdout:8/36: chown f5 375 1 2024-09-18T12:52:00.300 INFO:tasks.workunit.client.0.smithi045.stdout:9/23: creat d0/f9 x:0 0 0 2024-09-18T12:52:00.301 INFO:tasks.workunit.client.0.smithi045.stdout:9/24: readlink d0/d3/l8 0 2024-09-18T12:52:00.302 INFO:tasks.workunit.client.1.smithi161.stdout:7/191: mknod d3/c28 0 2024-09-18T12:52:00.303 INFO:tasks.workunit.client.0.smithi045.stdout:7/68: link c5 c12 0 2024-09-18T12:52:00.307 INFO:tasks.workunit.client.0.smithi045.stdout:0/43: truncate f4 3604220 0 2024-09-18T12:52:00.308 INFO:tasks.workunit.client.1.smithi161.stdout:9/182: creat d0/f3b x:0 0 0 2024-09-18T12:52:00.309 INFO:tasks.workunit.client.0.smithi045.stdout:5/63: unlink d6/df/c13 0 2024-09-18T12:52:00.310 INFO:tasks.workunit.client.0.smithi045.stdout:5/64: chown c4 5947047 1 2024-09-18T12:52:00.312 INFO:tasks.workunit.client.0.smithi045.stdout:5/65: write d6/f7 [5068394,52214] 0 2024-09-18T12:52:00.312 INFO:tasks.workunit.client.1.smithi161.stdout:0/200: rename df/d29/d36/d45 to df/d29/d46 0 2024-09-18T12:52:00.316 INFO:tasks.workunit.client.1.smithi161.stdout:9/183: dwrite d0/db/f26 [0,4194304] 0 2024-09-18T12:52:00.316 INFO:tasks.workunit.client.1.smithi161.stdout:3/283: dwrite d1/d2e/d14/f30 [0,4194304] 0 2024-09-18T12:52:00.316 INFO:tasks.workunit.client.1.smithi161.stdout:5/206: creat d3/d3b/f42 x:0 0 0 2024-09-18T12:52:00.317 INFO:tasks.workunit.client.0.smithi045.stdout:0/44: dwrite d6/d7/fa [0,4194304] 0 2024-09-18T12:52:00.319 INFO:tasks.workunit.client.1.smithi161.stdout:8/281: mknod d0/d38/d5b/c5d 0 2024-09-18T12:52:00.319 INFO:tasks.workunit.client.0.smithi045.stdout:7/69: fsync f7 0 2024-09-18T12:52:00.321 INFO:tasks.workunit.client.1.smithi161.stdout:2/248: mknod d0/d1/d3b/d3d/d4f/c51 0 2024-09-18T12:52:00.321 INFO:tasks.workunit.client.1.smithi161.stdout:9/184: write d0/d16/d12/f15 [324859,108825] 0 2024-09-18T12:52:00.323 INFO:tasks.workunit.client.1.smithi161.stdout:1/169: symlink d1/da/d31/l33 0 2024-09-18T12:52:00.325 INFO:tasks.workunit.client.0.smithi045.stdout:5/66: dwrite d6/db/fe [0,4194304] 0 2024-09-18T12:52:00.328 INFO:tasks.workunit.client.0.smithi045.stdout:5/67: write d6/df/f11 [1301996,123759] 0 2024-09-18T12:52:00.329 INFO:tasks.workunit.client.1.smithi161.stdout:1/170: dread d1/d26/f9 [0,4194304] 0 2024-09-18T12:52:00.329 INFO:tasks.workunit.client.0.smithi045.stdout:4/101: mknod db/d20/c27 0 2024-09-18T12:52:00.330 INFO:tasks.workunit.client.0.smithi045.stdout:7/70: dread f7 [0,4194304] 0 2024-09-18T12:52:00.330 INFO:tasks.workunit.client.0.smithi045.stdout:6/131: mkdir d9/d1a/d2d 0 2024-09-18T12:52:00.331 INFO:tasks.workunit.client.0.smithi045.stdout:7/71: stat ce 0 2024-09-18T12:52:00.331 INFO:tasks.workunit.client.1.smithi161.stdout:2/249: dwrite d0/d1/f3 [4194304,4194304] 0 2024-09-18T12:52:00.334 INFO:tasks.workunit.client.1.smithi161.stdout:4/233: write d5/f20 [125382,38719] 0 2024-09-18T12:52:00.337 INFO:tasks.workunit.client.1.smithi161.stdout:7/192: rename d3/d8/d15/f27 to d3/d8/f29 0 2024-09-18T12:52:00.338 INFO:tasks.workunit.client.1.smithi161.stdout:4/234: rename d5 to d5/d27/d3a/d4b 22 2024-09-18T12:52:00.339 INFO:tasks.workunit.client.1.smithi161.stdout:4/235: chown d5/d27/l41 2036 1 2024-09-18T12:52:00.341 INFO:tasks.workunit.client.1.smithi161.stdout:4/236: fdatasync d5/fe 0 2024-09-18T12:52:00.341 INFO:tasks.workunit.client.1.smithi161.stdout:3/284: symlink d1/d2e/d14/d2c/l61 0 2024-09-18T12:52:00.342 INFO:tasks.workunit.client.1.smithi161.stdout:7/193: dread d3/f23 [0,4194304] 0 2024-09-18T12:52:00.344 INFO:tasks.workunit.client.0.smithi045.stdout:1/29: truncate d0/fa 1524232 0 2024-09-18T12:52:00.344 INFO:tasks.workunit.client.1.smithi161.stdout:5/207: mknod d3/d8/c43 0 2024-09-18T12:52:00.345 INFO:tasks.workunit.client.1.smithi161.stdout:7/194: fsync d3/f17 0 2024-09-18T12:52:00.345 INFO:tasks.workunit.client.1.smithi161.stdout:8/282: creat d0/d38/d5b/f5e x:0 0 0 2024-09-18T12:52:00.345 INFO:tasks.workunit.client.1.smithi161.stdout:1/171: dread d1/d26/f10 [0,4194304] 0 2024-09-18T12:52:00.346 INFO:tasks.workunit.client.1.smithi161.stdout:5/208: chown d3/d9/f15 93111481 1 2024-09-18T12:52:00.346 INFO:tasks.workunit.client.1.smithi161.stdout:0/201: dread df/f2b [0,4194304] 0 2024-09-18T12:52:00.347 INFO:tasks.workunit.client.1.smithi161.stdout:7/195: read - d3/d8/f29 zero size 2024-09-18T12:52:00.347 INFO:tasks.workunit.client.1.smithi161.stdout:3/285: chown d1/d2e/d24/d1d/f2a 1543 1 2024-09-18T12:52:00.370 INFO:tasks.workunit.client.1.smithi161.stdout:6/234: sync 2024-09-18T12:52:00.371 INFO:tasks.workunit.client.1.smithi161.stdout:6/235: write d4/d39/d26/d20/f2a [868891,66825] 0 2024-09-18T12:52:00.429 INFO:tasks.workunit.client.0.smithi045.stdout:5/68: mkdir d6/d14 0 2024-09-18T12:52:00.433 INFO:tasks.workunit.client.0.smithi045.stdout:5/69: dread d6/db/fe [0,4194304] 0 2024-09-18T12:52:00.433 INFO:tasks.workunit.client.0.smithi045.stdout:5/70: chown d6/df 1393 1 2024-09-18T12:52:00.436 INFO:tasks.workunit.client.0.smithi045.stdout:7/72: mkdir d13 0 2024-09-18T12:52:00.436 INFO:tasks.workunit.client.0.smithi045.stdout:7/73: chown f3 2264 1 2024-09-18T12:52:00.439 INFO:tasks.workunit.client.1.smithi161.stdout:2/250: mkdir d0/d4/d52 0 2024-09-18T12:52:00.443 INFO:tasks.workunit.client.0.smithi045.stdout:8/37: link f5 fa 0 2024-09-18T12:52:00.445 INFO:tasks.workunit.client.0.smithi045.stdout:9/25: link d0/d3/l4 d0/la 0 2024-09-18T12:52:00.450 INFO:tasks.workunit.client.1.smithi161.stdout:4/237: mkdir d5/d27/d3a/d4c 0 2024-09-18T12:52:00.456 INFO:tasks.workunit.client.1.smithi161.stdout:8/283: mkdir d0/d3/d5f 0 2024-09-18T12:52:00.458 INFO:tasks.workunit.client.1.smithi161.stdout:5/209: mkdir d3/d44 0 2024-09-18T12:52:00.461 INFO:tasks.workunit.client.1.smithi161.stdout:1/172: chown d1/d26/d17/c1c 463643 1 2024-09-18T12:52:00.462 INFO:tasks.workunit.client.0.smithi045.stdout:5/71: mkdir d6/db/d15 0 2024-09-18T12:52:00.464 INFO:tasks.workunit.client.0.smithi045.stdout:7/74: unlink ca 0 2024-09-18T12:52:00.465 INFO:tasks.workunit.client.1.smithi161.stdout:0/202: mknod df/d29/c47 0 2024-09-18T12:52:00.466 INFO:tasks.workunit.client.1.smithi161.stdout:3/286: symlink d1/d2e/d3d/d49/l62 0 2024-09-18T12:52:00.467 INFO:tasks.workunit.client.1.smithi161.stdout:3/287: fsync d1/d2e/d24/f45 0 2024-09-18T12:52:00.468 INFO:tasks.workunit.client.1.smithi161.stdout:6/236: mkdir d4/d39/d48 0 2024-09-18T12:52:00.469 INFO:tasks.workunit.client.0.smithi045.stdout:1/30: link d0/f9 d0/fc 0 2024-09-18T12:52:00.470 INFO:tasks.workunit.client.1.smithi161.stdout:8/284: dread d0/d3/d10/d21/f3a [0,4194304] 0 2024-09-18T12:52:00.471 INFO:tasks.workunit.client.0.smithi045.stdout:6/132: creat d9/d1a/f2e x:0 0 0 2024-09-18T12:52:00.473 INFO:tasks.workunit.client.0.smithi045.stdout:4/102: rmdir db/d1b/d24 0 2024-09-18T12:52:00.474 INFO:tasks.workunit.client.0.smithi045.stdout:4/103: dread - db/d1b/f25 zero size 2024-09-18T12:52:00.476 INFO:tasks.workunit.client.0.smithi045.stdout:5/72: mknod d6/df/c16 0 2024-09-18T12:52:00.478 INFO:tasks.workunit.client.1.smithi161.stdout:4/238: mkdir d5/d32/d39/d4d 0 2024-09-18T12:52:00.481 INFO:tasks.workunit.client.0.smithi045.stdout:4/104: dwrite db/f21 [0,4194304] 0 2024-09-18T12:52:00.481 INFO:tasks.workunit.client.0.smithi045.stdout:9/26: mknod d0/d3/d6/cb 0 2024-09-18T12:52:00.483 INFO:tasks.workunit.client.0.smithi045.stdout:1/31: creat d0/fd x:0 0 0 2024-09-18T12:52:00.488 INFO:tasks.workunit.client.0.smithi045.stdout:3/102: rename d0/d7/f12 to d0/f1f 0 2024-09-18T12:52:00.490 INFO:tasks.workunit.client.1.smithi161.stdout:0/203: write df/f15 [2573751,17494] 0 2024-09-18T12:52:00.492 INFO:tasks.workunit.client.0.smithi045.stdout:7/75: symlink d13/l14 0 2024-09-18T12:52:00.493 INFO:tasks.workunit.client.0.smithi045.stdout:8/38: write f6 [237881,61108] 0 2024-09-18T12:52:00.493 INFO:tasks.workunit.client.0.smithi045.stdout:5/73: mknod d6/df/c17 0 2024-09-18T12:52:00.495 INFO:tasks.workunit.client.0.smithi045.stdout:5/74: write d6/df/f11 [764070,76006] 0 2024-09-18T12:52:00.496 INFO:tasks.workunit.client.1.smithi161.stdout:0/204: dwrite df/d30/f38 [0,4194304] 0 2024-09-18T12:52:00.497 INFO:tasks.workunit.client.1.smithi161.stdout:0/205: dread - df/d29/d2d/d37/f42 zero size 2024-09-18T12:52:00.500 INFO:tasks.workunit.client.1.smithi161.stdout:9/185: creat d0/db/f3c x:0 0 0 2024-09-18T12:52:00.500 INFO:tasks.workunit.client.0.smithi045.stdout:4/105: fdatasync db/d10/d13/f14 0 2024-09-18T12:52:00.504 INFO:tasks.workunit.client.0.smithi045.stdout:0/45: read f4 [2524816,84085] 0 2024-09-18T12:52:00.505 INFO:tasks.workunit.client.0.smithi045.stdout:1/32: creat d0/fe x:0 0 0 2024-09-18T12:52:00.507 INFO:tasks.workunit.client.1.smithi161.stdout:4/239: creat d5/d32/d39/f4e x:0 0 0 2024-09-18T12:52:00.508 INFO:tasks.workunit.client.0.smithi045.stdout:7/76: mknod d13/c15 0 2024-09-18T12:52:00.509 INFO:tasks.workunit.client.0.smithi045.stdout:8/39: symlink lb 0 2024-09-18T12:52:00.514 INFO:tasks.workunit.client.1.smithi161.stdout:3/288: symlink d1/d2e/d3d/d53/l63 0 2024-09-18T12:52:00.517 INFO:tasks.workunit.client.0.smithi045.stdout:0/46: readlink d6/ld 0 2024-09-18T12:52:00.517 INFO:tasks.workunit.client.1.smithi161.stdout:7/196: dwrite d3/f4 [0,4194304] 0 2024-09-18T12:52:00.518 INFO:tasks.workunit.client.0.smithi045.stdout:0/47: chown f4 60 1 2024-09-18T12:52:00.518 INFO:tasks.workunit.client.0.smithi045.stdout:1/33: creat d0/ff x:0 0 0 2024-09-18T12:52:00.520 INFO:tasks.workunit.client.0.smithi045.stdout:9/27: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:52:00.520 INFO:tasks.workunit.client.1.smithi161.stdout:8/285: dwrite d0/f16 [0,4194304] 0 2024-09-18T12:52:00.520 INFO:tasks.workunit.client.0.smithi045.stdout:7/77: rmdir d13 39 2024-09-18T12:52:00.521 INFO:tasks.workunit.client.0.smithi045.stdout:1/34: dread - d0/fd zero size 2024-09-18T12:52:00.521 INFO:tasks.workunit.client.0.smithi045.stdout:9/28: fsync d0/d3/f7 0 2024-09-18T12:52:00.524 INFO:tasks.workunit.client.1.smithi161.stdout:2/251: rename d0/d1d to d0/d5/d53 0 2024-09-18T12:52:00.525 INFO:tasks.workunit.client.1.smithi161.stdout:8/286: dread d0/d3/fb [0,4194304] 0 2024-09-18T12:52:00.526 INFO:tasks.workunit.client.1.smithi161.stdout:8/287: stat d0/d3/c6 0 2024-09-18T12:52:00.529 INFO:tasks.workunit.client.0.smithi045.stdout:5/75: creat d6/db/d15/f18 x:0 0 0 2024-09-18T12:52:00.530 INFO:tasks.workunit.client.0.smithi045.stdout:4/106: truncate db/d10/d13/f14 6490418 0 2024-09-18T12:52:00.531 INFO:tasks.workunit.client.1.smithi161.stdout:1/173: dwrite d1/da/f18 [0,4194304] 0 2024-09-18T12:52:00.532 INFO:tasks.workunit.client.0.smithi045.stdout:0/48: creat d6/d7/fe x:0 0 0 2024-09-18T12:52:00.533 INFO:tasks.workunit.client.0.smithi045.stdout:0/49: stat d6/d7/fa 0 2024-09-18T12:52:00.534 INFO:tasks.workunit.client.0.smithi045.stdout:0/50: chown d6/d7/l8 16037648 1 2024-09-18T12:52:00.534 INFO:tasks.workunit.client.1.smithi161.stdout:1/174: dread d1/f15 [0,4194304] 0 2024-09-18T12:52:00.534 INFO:tasks.workunit.client.1.smithi161.stdout:2/252: dwrite d0/d5/f47 [0,4194304] 0 2024-09-18T12:52:00.535 INFO:tasks.workunit.client.0.smithi045.stdout:0/51: chown d6/d7/fe 23 1 2024-09-18T12:52:00.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/253: fdatasync d0/d1/f3 0 2024-09-18T12:52:00.536 INFO:tasks.workunit.client.0.smithi045.stdout:0/52: write d6/d7/fa [3523273,62767] 0 2024-09-18T12:52:00.537 INFO:tasks.workunit.client.0.smithi045.stdout:7/78: chown l4 985916820 1 2024-09-18T12:52:00.538 INFO:tasks.workunit.client.0.smithi045.stdout:7/79: dread - f11 zero size 2024-09-18T12:52:00.538 INFO:tasks.workunit.client.1.smithi161.stdout:3/289: creat d1/d2e/d24/d1d/f64 x:0 0 0 2024-09-18T12:52:00.539 INFO:tasks.workunit.client.0.smithi045.stdout:9/29: creat d0/fc x:0 0 0 2024-09-18T12:52:00.540 INFO:tasks.workunit.client.1.smithi161.stdout:7/197: symlink d3/d8/d15/d1a/l2a 0 2024-09-18T12:52:00.541 INFO:tasks.workunit.client.1.smithi161.stdout:3/290: write d1/d2e/f28 [2196034,27694] 0 2024-09-18T12:52:00.542 INFO:tasks.workunit.client.1.smithi161.stdout:7/198: truncate d3/d8/d20/f21 1665159 0 2024-09-18T12:52:00.543 INFO:tasks.workunit.client.0.smithi045.stdout:9/30: dread d0/f2 [0,4194304] 0 2024-09-18T12:52:00.544 INFO:tasks.workunit.client.0.smithi045.stdout:9/31: read - d0/fc zero size 2024-09-18T12:52:00.548 INFO:tasks.workunit.client.1.smithi161.stdout:3/291: dwrite d1/d2e/d14/f4a [0,4194304] 0 2024-09-18T12:52:00.549 INFO:tasks.workunit.client.1.smithi161.stdout:3/292: chown d1/d2e/d3d/c29 11003 1 2024-09-18T12:52:00.551 INFO:tasks.workunit.client.1.smithi161.stdout:3/293: chown d1/d2e/d3d/l2f 16691191 1 2024-09-18T12:52:00.552 INFO:tasks.workunit.client.0.smithi045.stdout:5/76: unlink d6/df/c16 0 2024-09-18T12:52:00.553 INFO:tasks.workunit.client.0.smithi045.stdout:9/32: fdatasync d0/f2 0 2024-09-18T12:52:00.553 INFO:tasks.workunit.client.1.smithi161.stdout:5/210: rename d3/d8/c26 to d3/d44/c45 0 2024-09-18T12:52:00.554 INFO:tasks.workunit.client.0.smithi045.stdout:9/33: dread - d0/fc zero size 2024-09-18T12:52:00.554 INFO:tasks.workunit.client.0.smithi045.stdout:5/77: fsync d6/db/f12 0 2024-09-18T12:52:00.556 INFO:tasks.workunit.client.1.smithi161.stdout:0/206: truncate df/d30/f3a 719606 0 2024-09-18T12:52:00.561 INFO:tasks.workunit.client.0.smithi045.stdout:0/53: creat d6/d7/ff x:0 0 0 2024-09-18T12:52:00.562 INFO:tasks.workunit.client.1.smithi161.stdout:6/237: sync 2024-09-18T12:52:00.563 INFO:tasks.workunit.client.1.smithi161.stdout:6/238: chown d4/d1a/d1c 39185 1 2024-09-18T12:52:00.564 INFO:tasks.workunit.client.0.smithi045.stdout:5/78: dwrite d6/db/f12 [0,4194304] 0 2024-09-18T12:52:00.566 INFO:tasks.workunit.client.0.smithi045.stdout:8/40: write f9 [397413,46176] 0 2024-09-18T12:52:00.568 INFO:tasks.workunit.client.1.smithi161.stdout:2/254: dread d0/f38 [0,4194304] 0 2024-09-18T12:52:00.570 INFO:tasks.workunit.client.1.smithi161.stdout:9/186: dwrite d0/f22 [0,4194304] 0 2024-09-18T12:52:00.571 INFO:tasks.workunit.client.1.smithi161.stdout:9/187: dread - d0/db/d18/f36 zero size 2024-09-18T12:52:00.573 INFO:tasks.workunit.client.0.smithi045.stdout:8/41: dread f5 [0,4194304] 0 2024-09-18T12:52:00.574 INFO:tasks.workunit.client.0.smithi045.stdout:8/42: fsync fa 0 2024-09-18T12:52:00.574 INFO:tasks.workunit.client.0.smithi045.stdout:8/43: chown f7 392566 1 2024-09-18T12:52:00.575 INFO:tasks.workunit.client.0.smithi045.stdout:8/44: readlink lb 0 2024-09-18T12:52:00.575 INFO:tasks.workunit.client.1.smithi161.stdout:9/188: dread d0/db/f26 [0,4194304] 0 2024-09-18T12:52:00.577 INFO:tasks.workunit.client.0.smithi045.stdout:9/34: creat d0/d3/d6/fd x:0 0 0 2024-09-18T12:52:00.579 INFO:tasks.workunit.client.1.smithi161.stdout:7/199: mknod d3/c2b 0 2024-09-18T12:52:00.583 INFO:tasks.workunit.client.0.smithi045.stdout:4/107: read db/d10/d13/f14 [4058220,96951] 0 2024-09-18T12:52:00.584 INFO:tasks.workunit.client.0.smithi045.stdout:4/108: write db/f21 [4076673,27432] 0 2024-09-18T12:52:00.586 INFO:tasks.workunit.client.1.smithi161.stdout:3/294: mkdir d1/d2e/d14/d65 0 2024-09-18T12:52:00.586 INFO:tasks.workunit.client.1.smithi161.stdout:7/200: dwrite d3/d8/d20/f21 [0,4194304] 0 2024-09-18T12:52:00.589 INFO:tasks.workunit.client.0.smithi045.stdout:4/109: dread f7 [0,4194304] 0 2024-09-18T12:52:00.590 INFO:tasks.workunit.client.0.smithi045.stdout:7/80: unlink cb 0 2024-09-18T12:52:00.591 INFO:tasks.workunit.client.0.smithi045.stdout:4/110: write f9 [3322496,115723] 0 2024-09-18T12:52:00.591 INFO:tasks.workunit.client.0.smithi045.stdout:7/81: dread - fc zero size 2024-09-18T12:52:00.593 INFO:tasks.workunit.client.1.smithi161.stdout:4/240: rename d5/l13 to d5/d32/d39/d4d/l4f 0 2024-09-18T12:52:00.594 INFO:tasks.workunit.client.1.smithi161.stdout:4/241: write d5/d27/f35 [185302,61775] 0 2024-09-18T12:52:00.596 INFO:tasks.workunit.client.0.smithi045.stdout:5/79: rename d6/d14 to d6/db/d19 0 2024-09-18T12:52:00.597 INFO:tasks.workunit.client.0.smithi045.stdout:9/35: fsync d0/d3/d6/fd 0 2024-09-18T12:52:00.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.597+0000 7f2f89d1f640 1 -- 172.21.15.45:0/418407941 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2f70000bf0 con 0x7f2f6c074ab0 2024-09-18T12:52:00.600 INFO:tasks.workunit.client.1.smithi161.stdout:0/207: write df/f2b [615871,125390] 0 2024-09-18T12:52:00.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.599+0000 7f2f80ff9640 1 -- 172.21.15.45:0/418407941 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f2f70000bf0 con 0x7f2f6c074ab0 2024-09-18T12:52:00.601 INFO:tasks.workunit.client.1.smithi161.stdout:4/242: dwrite d5/f17 [0,4194304] 0 2024-09-18T12:52:00.602 INFO:tasks.workunit.client.1.smithi161.stdout:0/208: write df/d29/d2d/d37/f42 [892378,36397] 0 2024-09-18T12:52:00.603 INFO:tasks.workunit.client.1.smithi161.stdout:6/239: mknod d4/d39/d3a/c49 0 2024-09-18T12:52:00.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 -- 172.21.15.45:0/418407941 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f2f6c074ab0 msgr2=0x7f2f6c076f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:00.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f2f6c074ab0 0x7f2f6c076f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2f78005fd0 tx=0x7f2f78005850 comp rx=0 tx=0).stop 2024-09-18T12:52:00.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 -- 172.21.15.45:0/418407941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f84101a60 msgr2=0x7f2f84196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:00.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f84101a60 0x7f2f84196900 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009230 tx=0x7f2f740046c0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 -- 172.21.15.45:0/418407941 shutdown_connections 2024-09-18T12:52:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f2f6c074ab0 0x7f2f6c076f70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f84101a60 0x7f2f84196900 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 --2- 172.21.15.45:0/418407941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f84100860 0x7f2f841963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 -- 172.21.15.45:0/418407941 >> 172.21.15.45:0/418407941 conn(0x7f2f840fc010 msgr2=0x7f2f84104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 -- 172.21.15.45:0/418407941 shutdown_connections 2024-09-18T12:52:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.602+0000 7f2f89d1f640 1 -- 172.21.15.45:0/418407941 wait complete. 2024-09-18T12:52:00.605 INFO:tasks.workunit.client.1.smithi161.stdout:6/240: fsync d4/d1a/f13 0 2024-09-18T12:52:00.605 INFO:tasks.workunit.client.0.smithi045.stdout:8/45: mknod cc 0 2024-09-18T12:52:00.606 INFO:tasks.workunit.client.0.smithi045.stdout:8/46: chown lb 22 1 2024-09-18T12:52:00.606 INFO:tasks.workunit.client.1.smithi161.stdout:1/175: symlink d1/da/l34 0 2024-09-18T12:52:00.608 INFO:tasks.workunit.client.1.smithi161.stdout:2/255: mknod d0/d1/d3b/c54 0 2024-09-18T12:52:00.611 INFO:tasks.workunit.client.1.smithi161.stdout:4/243: dwrite d5/f36 [4194304,4194304] 0 2024-09-18T12:52:00.612 INFO:tasks.workunit.client.0.smithi045.stdout:0/54: dwrite f4 [0,4194304] 0 2024-09-18T12:52:00.613 INFO:tasks.workunit.client.1.smithi161.stdout:9/189: mknod d0/d16/d25/d28/c3d 0 2024-09-18T12:52:00.615 INFO:tasks.workunit.client.1.smithi161.stdout:3/295: rmdir d1/d2e/d3d/d49 39 2024-09-18T12:52:00.617 INFO:tasks.workunit.client.1.smithi161.stdout:9/190: write d0/d16/d12/f14 [752228,60024] 0 2024-09-18T12:52:00.619 INFO:tasks.workunit.client.1.smithi161.stdout:7/201: truncate d3/f23 976656 0 2024-09-18T12:52:00.621 INFO:tasks.workunit.client.1.smithi161.stdout:2/256: dwrite d0/d1/d3b/f42 [0,4194304] 0 2024-09-18T12:52:00.622 INFO:tasks.workunit.client.1.smithi161.stdout:4/244: dwrite d5/d14/f1e [0,4194304] 0 2024-09-18T12:52:00.624 INFO:tasks.workunit.client.0.smithi045.stdout:5/80: write d6/db/fe [1702775,92976] 0 2024-09-18T12:52:00.625 INFO:tasks.workunit.client.1.smithi161.stdout:5/211: mkdir d3/d14/d20/d21/d46 0 2024-09-18T12:52:00.626 INFO:tasks.workunit.client.0.smithi045.stdout:9/36: creat d0/d3/fe x:0 0 0 2024-09-18T12:52:00.627 INFO:tasks.workunit.client.1.smithi161.stdout:5/212: readlink d3/d14/d20/l28 0 2024-09-18T12:52:00.628 INFO:tasks.workunit.client.0.smithi045.stdout:9/37: write d0/d3/f7 [16899,67553] 0 2024-09-18T12:52:00.628 INFO:tasks.workunit.client.0.smithi045.stdout:1/35: getdents d0 0 2024-09-18T12:52:00.629 INFO:tasks.workunit.client.0.smithi045.stdout:1/36: chown d0/l5 38236773 1 2024-09-18T12:52:00.630 INFO:tasks.workunit.client.1.smithi161.stdout:4/245: dwrite d5/d14/f1e [0,4194304] 0 2024-09-18T12:52:00.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/246: chown d5/fe 316008602 1 2024-09-18T12:52:00.631 INFO:tasks.workunit.client.0.smithi045.stdout:8/47: write fa [1332859,121217] 0 2024-09-18T12:52:00.632 INFO:tasks.workunit.client.1.smithi161.stdout:4/247: readlink d5/la 0 2024-09-18T12:52:00.633 INFO:tasks.workunit.client.0.smithi045.stdout:0/55: mknod d6/d7/c10 0 2024-09-18T12:52:00.634 INFO:tasks.workunit.client.1.smithi161.stdout:0/209: fsync df/d29/d2d/d37/f3e 0 2024-09-18T12:52:00.637 INFO:tasks.workunit.client.0.smithi045.stdout:7/82: rename f7 to d13/f16 0 2024-09-18T12:52:00.638 INFO:tasks.workunit.client.1.smithi161.stdout:1/176: truncate d1/d26/f2e 1781640 0 2024-09-18T12:52:00.638 INFO:tasks.workunit.client.1.smithi161.stdout:1/177: chown d1/da 4260583 1 2024-09-18T12:52:00.639 INFO:tasks.workunit.client.0.smithi045.stdout:4/111: mknod db/c28 0 2024-09-18T12:52:00.639 INFO:tasks.workunit.client.1.smithi161.stdout:4/248: dwrite d5/d32/d39/f4e [0,4194304] 0 2024-09-18T12:52:00.640 INFO:tasks.workunit.client.1.smithi161.stdout:4/249: fsync d5/f17 0 2024-09-18T12:52:00.644 INFO:tasks.workunit.client.0.smithi045.stdout:0/56: dwrite d6/d7/fa [0,4194304] 0 2024-09-18T12:52:00.645 INFO:tasks.workunit.client.0.smithi045.stdout:5/81: mknod d6/db/d19/c1a 0 2024-09-18T12:52:00.645 INFO:tasks.workunit.client.0.smithi045.stdout:9/38: fsync d0/f2 0 2024-09-18T12:52:00.648 INFO:tasks.workunit.client.1.smithi161.stdout:4/250: dwrite d5/fc [0,4194304] 0 2024-09-18T12:52:00.649 INFO:tasks.workunit.client.1.smithi161.stdout:4/251: write d5/f22 [4981068,15185] 0 2024-09-18T12:52:00.654 INFO:tasks.workunit.client.0.smithi045.stdout:1/37: symlink d0/l10 0 2024-09-18T12:52:00.656 INFO:tasks.workunit.client.0.smithi045.stdout:5/82: dwrite d6/db/f12 [0,4194304] 0 2024-09-18T12:52:00.656 INFO:tasks.workunit.client.0.smithi045.stdout:1/38: dread - d0/fb zero size 2024-09-18T12:52:00.657 INFO:tasks.workunit.client.0.smithi045.stdout:8/48: creat fd x:0 0 0 2024-09-18T12:52:00.658 INFO:tasks.workunit.client.0.smithi045.stdout:1/39: truncate d0/f7 975542 0 2024-09-18T12:52:00.659 INFO:tasks.workunit.client.0.smithi045.stdout:8/49: chown f5 14643 1 2024-09-18T12:52:00.662 INFO:tasks.workunit.client.1.smithi161.stdout:9/191: unlink d0/db/f13 0 2024-09-18T12:52:00.668 INFO:tasks.workunit.client.1.smithi161.stdout:7/202: write d3/d8/f29 [548776,101541] 0 2024-09-18T12:52:00.669 INFO:tasks.workunit.client.0.smithi045.stdout:7/83: chown c9 0 1 2024-09-18T12:52:00.670 INFO:tasks.workunit.client.0.smithi045.stdout:7/84: fdatasync f2 0 2024-09-18T12:52:00.671 INFO:tasks.workunit.client.0.smithi045.stdout:9/39: mknod d0/d3/cf 0 2024-09-18T12:52:00.672 INFO:tasks.workunit.client.0.smithi045.stdout:9/40: read - d0/f9 zero size 2024-09-18T12:52:00.673 INFO:tasks.workunit.client.1.smithi161.stdout:8/288: getdents d0/d38 0 2024-09-18T12:52:00.673 INFO:tasks.workunit.client.0.smithi045.stdout:1/40: mknod d0/c11 0 2024-09-18T12:52:00.674 INFO:tasks.workunit.client.0.smithi045.stdout:8/50: symlink le 0 2024-09-18T12:52:00.675 INFO:tasks.workunit.client.0.smithi045.stdout:5/83: symlink d6/db/d15/l1b 0 2024-09-18T12:52:00.676 INFO:tasks.workunit.client.1.smithi161.stdout:0/210: creat df/d29/d2d/d37/f48 x:0 0 0 2024-09-18T12:52:00.677 INFO:tasks.workunit.client.1.smithi161.stdout:1/178: symlink d1/d1d/l35 0 2024-09-18T12:52:00.678 INFO:tasks.workunit.client.0.smithi045.stdout:7/85: creat d13/f17 x:0 0 0 2024-09-18T12:52:00.678 INFO:tasks.workunit.client.0.smithi045.stdout:9/41: rmdir d0 39 2024-09-18T12:52:00.679 INFO:tasks.workunit.client.0.smithi045.stdout:1/41: mkdir d0/d12 0 2024-09-18T12:52:00.680 INFO:tasks.workunit.client.0.smithi045.stdout:8/51: unlink le 0 2024-09-18T12:52:00.684 INFO:tasks.workunit.client.0.smithi045.stdout:5/84: creat d6/db/d15/f1c x:0 0 0 2024-09-18T12:52:00.685 INFO:tasks.workunit.client.0.smithi045.stdout:9/42: truncate d0/f9 626186 0 2024-09-18T12:52:00.686 INFO:tasks.workunit.client.0.smithi045.stdout:9/43: write d0/d3/f7 [305834,50952] 0 2024-09-18T12:52:00.687 INFO:tasks.workunit.client.0.smithi045.stdout:9/44: chown d0/f9 4506 1 2024-09-18T12:52:00.688 INFO:tasks.workunit.client.1.smithi161.stdout:9/192: symlink d0/d16/d25/l3e 0 2024-09-18T12:52:00.688 INFO:tasks.workunit.client.1.smithi161.stdout:3/296: dwrite d1/d2e/d24/d1d/f4f [0,4194304] 0 2024-09-18T12:52:00.688 INFO:tasks.workunit.client.0.smithi045.stdout:9/45: write d0/d3/d6/fd [916410,119590] 0 2024-09-18T12:52:00.689 INFO:tasks.workunit.client.0.smithi045.stdout:8/52: creat ff x:0 0 0 2024-09-18T12:52:00.689 INFO:tasks.workunit.client.1.smithi161.stdout:3/297: stat d1/d2e/d14 0 2024-09-18T12:52:00.689 INFO:tasks.workunit.client.1.smithi161.stdout:9/193: fdatasync d0/d16/d25/f27 0 2024-09-18T12:52:00.690 INFO:tasks.workunit.client.0.smithi045.stdout:8/53: dread f0 [0,4194304] 0 2024-09-18T12:52:00.690 INFO:tasks.workunit.client.1.smithi161.stdout:3/298: truncate d1/d2e/d3d/f7 4414028 0 2024-09-18T12:52:00.691 INFO:tasks.workunit.client.0.smithi045.stdout:5/85: mknod d6/db/d19/c1d 0 2024-09-18T12:52:00.691 INFO:tasks.workunit.client.0.smithi045.stdout:8/54: write fa [678109,30954] 0 2024-09-18T12:52:00.692 INFO:tasks.workunit.client.0.smithi045.stdout:5/86: fdatasync d6/db/fe 0 2024-09-18T12:52:00.695 INFO:tasks.workunit.client.1.smithi161.stdout:2/257: creat d0/d1/d4c/f55 x:0 0 0 2024-09-18T12:52:00.698 INFO:tasks.workunit.client.0.smithi045.stdout:1/42: creat d0/d12/f13 x:0 0 0 2024-09-18T12:52:00.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/241: creat d4/d1a/d1c/f4a x:0 0 0 2024-09-18T12:52:00.700 INFO:tasks.workunit.client.0.smithi045.stdout:5/87: dwrite d6/db/fe [0,4194304] 0 2024-09-18T12:52:00.700 INFO:tasks.workunit.client.1.smithi161.stdout:6/242: dread - d4/d1a/d1c/d3e/f42 zero size 2024-09-18T12:52:00.701 INFO:tasks.workunit.client.0.smithi045.stdout:9/46: mkdir d0/d3/d6/d10 0 2024-09-18T12:52:00.701 INFO:tasks.workunit.client.1.smithi161.stdout:0/211: creat df/d29/d46/f49 x:0 0 0 2024-09-18T12:52:00.702 INFO:tasks.workunit.client.0.smithi045.stdout:5/88: write d6/db/f12 [4624159,55556] 0 2024-09-18T12:52:00.703 INFO:tasks.workunit.client.1.smithi161.stdout:1/179: symlink d1/da/d31/l36 0 2024-09-18T12:52:00.703 INFO:tasks.workunit.client.1.smithi161.stdout:5/213: sync 2024-09-18T12:52:00.705 INFO:tasks.workunit.client.0.smithi045.stdout:8/55: symlink l10 0 2024-09-18T12:52:00.706 INFO:tasks.workunit.client.1.smithi161.stdout:0/212: dread df/f26 [0,4194304] 0 2024-09-18T12:52:00.707 INFO:tasks.workunit.client.1.smithi161.stdout:0/213: chown df/d29/d2d 0 1 2024-09-18T12:52:00.708 INFO:tasks.workunit.client.1.smithi161.stdout:0/214: chown df/d29/l35 219 1 2024-09-18T12:52:00.709 INFO:tasks.workunit.client.1.smithi161.stdout:3/299: dread d1/d2e/d24/f45 [0,4194304] 0 2024-09-18T12:52:00.711 INFO:tasks.workunit.client.1.smithi161.stdout:2/258: mkdir d0/d1/d3b/d3d/d4f/d56 0 2024-09-18T12:52:00.711 INFO:tasks.workunit.client.0.smithi045.stdout:9/47: creat d0/d3/f11 x:0 0 0 2024-09-18T12:52:00.712 INFO:tasks.workunit.client.1.smithi161.stdout:8/289: creat d0/d3/d5f/f60 x:0 0 0 2024-09-18T12:52:00.712 INFO:tasks.workunit.client.0.smithi045.stdout:5/89: dwrite d6/df/f11 [0,4194304] 0 2024-09-18T12:52:00.713 INFO:tasks.workunit.client.1.smithi161.stdout:0/215: write df/d29/d2d/d37/f3e [699368,40550] 0 2024-09-18T12:52:00.714 INFO:tasks.workunit.client.0.smithi045.stdout:8/56: mkdir d11 0 2024-09-18T12:52:00.715 INFO:tasks.workunit.client.0.smithi045.stdout:7/86: link c5 d13/c18 0 2024-09-18T12:52:00.715 INFO:tasks.workunit.client.1.smithi161.stdout:8/290: truncate d0/d3/d1e/f50 942063 0 2024-09-18T12:52:00.716 INFO:tasks.workunit.client.0.smithi045.stdout:7/87: write fc [604174,97793] 0 2024-09-18T12:52:00.716 INFO:tasks.workunit.client.1.smithi161.stdout:8/291: write d0/d3/d10/d21/f37 [77282,8935] 0 2024-09-18T12:52:00.718 INFO:tasks.workunit.client.1.smithi161.stdout:8/292: write d0/d3/d10/d21/d4a/f4f [3071479,122245] 0 2024-09-18T12:52:00.721 INFO:tasks.workunit.client.0.smithi045.stdout:5/90: mknod d6/db/c1e 0 2024-09-18T12:52:00.722 INFO:tasks.workunit.client.0.smithi045.stdout:5/91: chown d6/db/d15/l1b 764885 1 2024-09-18T12:52:00.723 INFO:tasks.workunit.client.1.smithi161.stdout:3/300: unlink d1/d2e/d14/f4a 0 2024-09-18T12:52:00.724 INFO:tasks.workunit.client.0.smithi045.stdout:5/92: dread - d6/db/d15/f18 zero size 2024-09-18T12:52:00.724 INFO:tasks.workunit.client.1.smithi161.stdout:8/293: fsync d0/d3/d10/d21/f37 0 2024-09-18T12:52:00.725 INFO:tasks.workunit.client.1.smithi161.stdout:5/214: dwrite d3/d9/f1c [0,4194304] 0 2024-09-18T12:52:00.726 INFO:tasks.workunit.client.0.smithi045.stdout:7/88: mkdir d13/d19 0 2024-09-18T12:52:00.727 INFO:tasks.workunit.client.0.smithi045.stdout:7/89: truncate f11 908836 0 2024-09-18T12:52:00.730 INFO:tasks.workunit.client.1.smithi161.stdout:0/216: mknod df/d29/d2d/c4a 0 2024-09-18T12:52:00.731 INFO:tasks.workunit.client.0.smithi045.stdout:7/90: dread f2 [0,4194304] 0 2024-09-18T12:52:00.733 INFO:tasks.workunit.client.1.smithi161.stdout:9/194: dread d0/f24 [0,4194304] 0 2024-09-18T12:52:00.733 INFO:tasks.workunit.client.0.smithi045.stdout:8/57: creat d11/f12 x:0 0 0 2024-09-18T12:52:00.736 INFO:tasks.workunit.client.0.smithi045.stdout:5/93: rename d6/db/d15/f1c to d6/db/d19/f1f 0 2024-09-18T12:52:00.738 INFO:tasks.workunit.client.1.smithi161.stdout:4/252: getdents d5/d27/d3a 0 2024-09-18T12:52:00.741 INFO:tasks.workunit.client.0.smithi045.stdout:5/94: dread d6/f7 [0,4194304] 0 2024-09-18T12:52:00.741 INFO:tasks.workunit.client.1.smithi161.stdout:1/180: link d1/d26/f7 d1/d26/d17/f37 0 2024-09-18T12:52:00.742 INFO:tasks.workunit.client.0.smithi045.stdout:7/91: mkdir d13/d1a 0 2024-09-18T12:52:00.742 INFO:tasks.workunit.client.0.smithi045.stdout:5/95: truncate d6/db/d15/f18 686803 0 2024-09-18T12:52:00.748 INFO:tasks.workunit.client.0.smithi045.stdout:9/48: link d0/la d0/d3/d6/d10/l12 0 2024-09-18T12:52:00.752 INFO:tasks.workunit.client.1.smithi161.stdout:7/203: dwrite d3/f23 [0,4194304] 0 2024-09-18T12:52:00.752 INFO:tasks.workunit.client.1.smithi161.stdout:8/294: creat d0/d3/d5f/f61 x:0 0 0 2024-09-18T12:52:00.753 INFO:tasks.workunit.client.0.smithi045.stdout:5/96: dwrite d6/db/fe [0,4194304] 0 2024-09-18T12:52:00.754 INFO:tasks.workunit.client.1.smithi161.stdout:5/215: mkdir d3/d9/d47 0 2024-09-18T12:52:00.754 INFO:tasks.workunit.client.0.smithi045.stdout:1/43: dwrite d0/fc [0,4194304] 0 2024-09-18T12:52:00.754 INFO:tasks.workunit.client.1.smithi161.stdout:5/216: stat d3/d8/l16 0 2024-09-18T12:52:00.758 INFO:tasks.workunit.client.1.smithi161.stdout:0/217: readlink df/l1d 0 2024-09-18T12:52:00.760 INFO:tasks.workunit.client.0.smithi045.stdout:7/92: link d13/f17 d13/d1a/f1b 0 2024-09-18T12:52:00.760 INFO:tasks.workunit.client.1.smithi161.stdout:8/295: dwrite d0/d3/d10/f42 [0,4194304] 0 2024-09-18T12:52:00.761 INFO:tasks.workunit.client.1.smithi161.stdout:8/296: chown d0/d38 2864796 1 2024-09-18T12:52:00.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.760+0000 7f52a1bfe640 1 -- 172.21.15.45:0/1333715239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f529c101a80 msgr2=0x7f529c101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:00.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.760+0000 7f52a1bfe640 1 --2- 172.21.15.45:0/1333715239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f529c101a80 0x7f529c101f00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5290009880 tx=0x7f529002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.760+0000 7f52a1bfe640 1 -- 172.21.15.45:0/1333715239 shutdown_connections 2024-09-18T12:52:00.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.760+0000 7f52a1bfe640 1 --2- 172.21.15.45:0/1333715239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f529c101a80 0x7f529c101f00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.760+0000 7f52a1bfe640 1 --2- 172.21.15.45:0/1333715239 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c100880 0x7f529c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.760+0000 7f52a1bfe640 1 -- 172.21.15.45:0/1333715239 >> 172.21.15.45:0/1333715239 conn(0x7f529c0fc030 msgr2=0x7f529c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:00.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.760+0000 7f52a1bfe640 1 -- 172.21.15.45:0/1333715239 shutdown_connections 2024-09-18T12:52:00.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.760+0000 7f52a1bfe640 1 -- 172.21.15.45:0/1333715239 wait complete. 2024-09-18T12:52:00.764 INFO:tasks.workunit.client.1.smithi161.stdout:9/195: creat d0/d16/d25/d28/f3f x:0 0 0 2024-09-18T12:52:00.764 INFO:tasks.workunit.client.1.smithi161.stdout:8/297: fsync d0/d3/d10/d21/f32 0 2024-09-18T12:52:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.761+0000 7f52a1bfe640 1 Processor -- start 2024-09-18T12:52:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.761+0000 7f52a1bfe640 1 -- start start 2024-09-18T12:52:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.761+0000 7f52a1bfe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c100880 0x7f529c104ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.761+0000 7f52a1bfe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f529c101a80 0x7f529c103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.762+0000 7f52a1bfe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f529c1096a0 con 0x7f529c101a80 2024-09-18T12:52:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.762+0000 7f52a1bfe640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f529c109520 con 0x7f529c100880 2024-09-18T12:52:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.762+0000 7f529affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f529c101a80 0x7f529c103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.762+0000 7f529affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f529c101a80 0x7f529c103190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36040/0 (socket says 172.21.15.45:36040) 2024-09-18T12:52:00.766 INFO:tasks.workunit.client.0.smithi045.stdout:9/49: symlink d0/d3/d6/l13 0 2024-09-18T12:52:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.762+0000 7f529affd640 1 -- 172.21.15.45:0/3418329030 learned_addr learned my addr 172.21.15.45:0/3418329030 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:52:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.762+0000 7f529b7fe640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c100880 0x7f529c104ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.762+0000 7f529affd640 1 -- 172.21.15.45:0/3418329030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c100880 msgr2=0x7f529c104ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.762+0000 7f529affd640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c100880 0x7f529c104ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.762+0000 7f529affd640 1 -- 172.21.15.45:0/3418329030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c1036d0 con 0x7f529c101a80 2024-09-18T12:52:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.763+0000 7f529affd640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f529c101a80 0x7f529c103190 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5290009230 tx=0x7f5290004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.763+0000 7f5298ff9640 1 -- 172.21.15.45:0/3418329030 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f529003f070 con 0x7f529c101a80 2024-09-18T12:52:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.763+0000 7f5298ff9640 1 -- 172.21.15.45:0/3418329030 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5290004a90 con 0x7f529c101a80 2024-09-18T12:52:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.763+0000 7f5298ff9640 1 -- 172.21.15.45:0/3418329030 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5290035030 con 0x7f529c101a80 2024-09-18T12:52:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.763+0000 7f52a1bfe640 1 -- 172.21.15.45:0/3418329030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529c103960 con 0x7f529c101a80 2024-09-18T12:52:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.763+0000 7f52a1bfe640 1 -- 172.21.15.45:0/3418329030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529c103e90 con 0x7f529c101a80 2024-09-18T12:52:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.765+0000 7f52a1bfe640 1 -- 172.21.15.45:0/3418329030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529c100c80 con 0x7f529c101a80 2024-09-18T12:52:00.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.767+0000 7f5298ff9640 1 -- 172.21.15.45:0/3418329030 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f5290042070 con 0x7f529c101a80 2024-09-18T12:52:00.769 INFO:tasks.workunit.client.0.smithi045.stdout:5/97: dread d6/f7 [4194304,4194304] 0 2024-09-18T12:52:00.770 INFO:tasks.workunit.client.1.smithi161.stdout:8/298: write d0/d3/d10/f57 [487437,115002] 0 2024-09-18T12:52:00.770 INFO:tasks.workunit.client.1.smithi161.stdout:8/299: fdatasync d0/f16 0 2024-09-18T12:52:00.770 INFO:tasks.workunit.client.1.smithi161.stdout:8/300: chown d0 60274214 1 2024-09-18T12:52:00.770 INFO:tasks.workunit.client.1.smithi161.stdout:8/301: truncate d0/d38/d5b/f5e 321281 0 2024-09-18T12:52:00.770 INFO:tasks.workunit.client.1.smithi161.stdout:1/181: symlink d1/d1d/l38 0 2024-09-18T12:52:00.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.768+0000 7f5298ff9640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f5284074ad0 0x7f5284076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:00.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.768+0000 7f5298ff9640 1 -- 172.21.15.45:0/3418329030 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f52900b6e40 con 0x7f529c101a80 2024-09-18T12:52:00.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.769+0000 7f529b7fe640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f5284074ad0 0x7f5284076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:00.771 INFO:tasks.workunit.client.0.smithi045.stdout:1/44: rename d0/l1 to d0/l14 0 2024-09-18T12:52:00.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.770+0000 7f529b7fe640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f5284074ad0 0x7f5284076f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f529c1018e0 tx=0x7f528c009500 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:00.775 INFO:tasks.workunit.client.1.smithi161.stdout:3/301: symlink d1/l66 0 2024-09-18T12:52:00.776 INFO:tasks.workunit.client.1.smithi161.stdout:3/302: chown d1/d2e/f4b 30734857 1 2024-09-18T12:52:00.777 INFO:tasks.workunit.client.0.smithi045.stdout:5/98: rename d6/db/d19/c1d to d6/db/d15/c20 0 2024-09-18T12:52:00.777 INFO:tasks.workunit.client.1.smithi161.stdout:7/204: mknod d3/d8/d15/d1a/c2c 0 2024-09-18T12:52:00.778 INFO:tasks.workunit.client.0.smithi045.stdout:5/99: fsync d6/db/d15/f18 0 2024-09-18T12:52:00.780 INFO:tasks.workunit.client.0.smithi045.stdout:1/45: unlink d0/f8 0 2024-09-18T12:52:00.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:00.779+0000 7f5298ff9640 1 -- 172.21.15.45:0/3418329030 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f52900823b0 con 0x7f529c101a80 2024-09-18T12:52:00.781 INFO:tasks.workunit.client.1.smithi161.stdout:6/243: getdents d4 0 2024-09-18T12:52:00.782 INFO:tasks.workunit.client.1.smithi161.stdout:0/218: creat df/d29/d2d/f4b x:0 0 0 2024-09-18T12:52:00.783 INFO:tasks.workunit.client.1.smithi161.stdout:0/219: chown l7 10743 1 2024-09-18T12:52:00.784 INFO:tasks.workunit.client.0.smithi045.stdout:1/46: creat d0/d12/f15 x:0 0 0 2024-09-18T12:52:00.785 INFO:tasks.workunit.client.1.smithi161.stdout:0/220: dread - df/f22 zero size 2024-09-18T12:52:00.785 INFO:tasks.workunit.client.1.smithi161.stdout:7/205: dwrite d3/d8/d15/d1a/f22 [0,4194304] 0 2024-09-18T12:52:00.786 INFO:tasks.workunit.client.1.smithi161.stdout:0/221: write df/f1c [599427,20723] 0 2024-09-18T12:52:00.786 INFO:tasks.workunit.client.1.smithi161.stdout:7/206: fsync d3/d8/d20/f21 0 2024-09-18T12:52:00.787 INFO:tasks.workunit.client.1.smithi161.stdout:8/302: symlink d0/d3/l62 0 2024-09-18T12:52:00.787 INFO:tasks.workunit.client.1.smithi161.stdout:2/259: sync 2024-09-18T12:52:00.788 INFO:tasks.workunit.client.1.smithi161.stdout:1/182: rmdir d1/d1d 39 2024-09-18T12:52:00.789 INFO:tasks.workunit.client.1.smithi161.stdout:1/183: chown d1/da 0 1 2024-09-18T12:52:00.789 INFO:tasks.workunit.client.1.smithi161.stdout:8/303: write d0/d3/d1e/f46 [975448,64758] 0 2024-09-18T12:52:00.790 INFO:tasks.workunit.client.1.smithi161.stdout:3/303: unlink d1/d2e/d3d/c51 0 2024-09-18T12:52:00.792 INFO:tasks.workunit.client.1.smithi161.stdout:6/244: creat d4/d39/d26/d20/d28/f4b x:0 0 0 2024-09-18T12:52:00.795 INFO:tasks.workunit.client.1.smithi161.stdout:9/196: symlink d0/db/l40 0 2024-09-18T12:52:00.797 INFO:tasks.workunit.client.1.smithi161.stdout:0/222: creat df/d29/d2d/f4c x:0 0 0 2024-09-18T12:52:00.797 INFO:tasks.workunit.client.1.smithi161.stdout:7/207: rmdir d3/d8/d15 39 2024-09-18T12:52:00.797 INFO:tasks.workunit.client.1.smithi161.stdout:5/217: link d3/d14/d20/l37 d3/d14/d20/d21/d24/l48 0 2024-09-18T12:52:00.798 INFO:tasks.workunit.client.0.smithi045.stdout:5/100: truncate d6/f7 2344536 0 2024-09-18T12:52:00.798 INFO:tasks.workunit.client.1.smithi161.stdout:1/184: truncate d1/d26/fb 1822109 0 2024-09-18T12:52:00.799 INFO:tasks.workunit.client.1.smithi161.stdout:9/197: stat d0/d16/d25 0 2024-09-18T12:52:00.801 INFO:tasks.workunit.client.1.smithi161.stdout:3/304: write d1/d2e/d24/d1d/f43 [436663,44391] 0 2024-09-18T12:52:00.801 INFO:tasks.workunit.client.0.smithi045.stdout:5/101: fdatasync d6/f7 0 2024-09-18T12:52:00.801 INFO:tasks.workunit.client.0.smithi045.stdout:9/50: getdents d0/d3/d6 0 2024-09-18T12:52:00.802 INFO:tasks.workunit.client.1.smithi161.stdout:8/304: dwrite d0/f45 [0,4194304] 0 2024-09-18T12:52:00.804 INFO:tasks.workunit.client.1.smithi161.stdout:0/223: mkdir df/d30/d4d 0 2024-09-18T12:52:00.804 INFO:tasks.workunit.client.0.smithi045.stdout:5/102: symlink d6/l21 0 2024-09-18T12:52:00.805 INFO:tasks.workunit.client.1.smithi161.stdout:2/260: dwrite d0/d5/d43/f18 [0,4194304] 0 2024-09-18T12:52:00.807 INFO:tasks.workunit.client.0.smithi045.stdout:9/51: symlink d0/d3/d6/l14 0 2024-09-18T12:52:00.808 INFO:tasks.workunit.client.1.smithi161.stdout:8/305: dread - d0/f55 zero size 2024-09-18T12:52:00.808 INFO:tasks.workunit.client.1.smithi161.stdout:9/198: fdatasync d0/d16/d25/d28/f33 0 2024-09-18T12:52:00.813 INFO:tasks.workunit.client.0.smithi045.stdout:5/103: dwrite d6/db/f12 [0,4194304] 0 2024-09-18T12:52:00.814 INFO:tasks.workunit.client.1.smithi161.stdout:5/218: dwrite d3/d14/d20/f3c [0,4194304] 0 2024-09-18T12:52:00.815 INFO:tasks.workunit.client.0.smithi045.stdout:5/104: stat d6/la 0 2024-09-18T12:52:00.816 INFO:tasks.workunit.client.0.smithi045.stdout:5/105: write d6/db/d15/f18 [1475042,52171] 0 2024-09-18T12:52:00.820 INFO:tasks.workunit.client.1.smithi161.stdout:0/224: dread df/d30/f3a [0,4194304] 0 2024-09-18T12:52:00.820 INFO:tasks.workunit.client.1.smithi161.stdout:3/305: dwrite d1/d2e/d24/d1d/f43 [0,4194304] 0 2024-09-18T12:52:00.821 INFO:tasks.workunit.client.1.smithi161.stdout:0/225: fsync fd 0 2024-09-18T12:52:00.822 INFO:tasks.workunit.client.1.smithi161.stdout:3/306: write d1/d2e/d14/d2c/f33 [222499,27921] 0 2024-09-18T12:52:00.825 INFO:tasks.workunit.client.0.smithi045.stdout:5/106: symlink d6/l22 0 2024-09-18T12:52:00.826 INFO:tasks.workunit.client.1.smithi161.stdout:4/253: truncate d5/d32/f38 1997907 0 2024-09-18T12:52:00.828 INFO:tasks.workunit.client.1.smithi161.stdout:0/226: write df/d29/d2d/f4c [239491,5730] 0 2024-09-18T12:52:00.829 INFO:tasks.workunit.client.1.smithi161.stdout:8/306: rename d0/d3/d1e/f4c to d0/d3/d10/f63 0 2024-09-18T12:52:00.831 INFO:tasks.workunit.client.0.smithi045.stdout:1/47: truncate d0/f6 488819 0 2024-09-18T12:52:00.835 INFO:tasks.workunit.client.0.smithi045.stdout:5/107: dwrite d6/df/f11 [0,4194304] 0 2024-09-18T12:52:00.836 INFO:tasks.workunit.client.1.smithi161.stdout:6/245: dread d4/ff [4194304,4194304] 0 2024-09-18T12:52:00.836 INFO:tasks.workunit.client.0.smithi045.stdout:1/48: dread d0/fa [0,4194304] 0 2024-09-18T12:52:00.837 INFO:tasks.workunit.client.1.smithi161.stdout:1/185: truncate d1/d26/d17/f37 2754587 0 2024-09-18T12:52:00.841 INFO:tasks.workunit.client.0.smithi045.stdout:5/108: creat d6/df/f23 x:0 0 0 2024-09-18T12:52:00.842 INFO:tasks.workunit.client.1.smithi161.stdout:1/186: dwrite d1/f28 [0,4194304] 0 2024-09-18T12:52:00.846 INFO:tasks.workunit.client.1.smithi161.stdout:3/307: creat d1/d2e/d24/d1d/f67 x:0 0 0 2024-09-18T12:52:00.848 INFO:tasks.workunit.client.0.smithi045.stdout:5/109: rename c0 to d6/db/c24 0 2024-09-18T12:52:00.849 INFO:tasks.workunit.client.1.smithi161.stdout:3/308: chown d1/d2e/d24/d1d/l3e 2093665598 1 2024-09-18T12:52:00.849 INFO:tasks.workunit.client.1.smithi161.stdout:2/261: mknod d0/d1/d3b/d3d/d4f/d56/c57 0 2024-09-18T12:52:00.853 INFO:tasks.workunit.client.0.smithi045.stdout:5/110: dread d6/db/d15/f18 [0,4194304] 0 2024-09-18T12:52:00.855 INFO:tasks.workunit.client.0.smithi045.stdout:5/111: write d6/db/f12 [2364206,3850] 0 2024-09-18T12:52:00.855 INFO:tasks.workunit.client.0.smithi045.stdout:9/52: truncate d0/d3/d6/fd 599186 0 2024-09-18T12:52:00.856 INFO:tasks.workunit.client.0.smithi045.stdout:9/53: fsync d0/f2 0 2024-09-18T12:52:00.861 INFO:tasks.workunit.client.0.smithi045.stdout:5/112: dread d6/df/f11 [0,4194304] 0 2024-09-18T12:52:00.862 INFO:tasks.workunit.client.1.smithi161.stdout:8/307: creat d0/d3/d1e/d34/f64 x:0 0 0 2024-09-18T12:52:00.864 INFO:tasks.workunit.client.1.smithi161.stdout:7/208: write d3/d8/d15/f26 [9405892,24540] 0 2024-09-18T12:52:00.865 INFO:tasks.workunit.client.1.smithi161.stdout:7/209: chown d3/c2b 3610566 1 2024-09-18T12:52:00.866 INFO:tasks.workunit.client.1.smithi161.stdout:7/210: write d3/f7 [9766101,59240] 0 2024-09-18T12:52:00.867 INFO:tasks.workunit.client.1.smithi161.stdout:6/246: unlink d4/d39/l34 0 2024-09-18T12:52:00.868 INFO:tasks.workunit.client.1.smithi161.stdout:6/247: read d4/d1a/f14 [251018,45164] 0 2024-09-18T12:52:00.872 INFO:tasks.workunit.client.1.smithi161.stdout:3/309: rmdir d1/d2e/d24 39 2024-09-18T12:52:00.874 INFO:tasks.workunit.client.1.smithi161.stdout:2/262: truncate d0/d1/df/f1b 355615 0 2024-09-18T12:52:00.874 INFO:tasks.workunit.client.1.smithi161.stdout:2/263: fdatasync d0/d1/f3 0 2024-09-18T12:52:00.876 INFO:tasks.workunit.client.0.smithi045.stdout:1/49: dwrite d0/fa [0,4194304] 0 2024-09-18T12:52:00.878 INFO:tasks.workunit.client.0.smithi045.stdout:5/113: dwrite d6/f7 [0,4194304] 0 2024-09-18T12:52:00.879 INFO:tasks.workunit.client.1.smithi161.stdout:0/227: mknod df/d30/d4d/c4e 0 2024-09-18T12:52:00.879 INFO:tasks.workunit.client.1.smithi161.stdout:0/228: stat ce 0 2024-09-18T12:52:00.879 INFO:tasks.workunit.client.0.smithi045.stdout:5/114: read d6/db/f12 [3650060,53105] 0 2024-09-18T12:52:00.881 INFO:tasks.workunit.client.0.smithi045.stdout:5/115: write d6/df/f23 [710270,25424] 0 2024-09-18T12:52:00.885 INFO:tasks.workunit.client.1.smithi161.stdout:4/254: rename d5/d27/d3a/d47/d49/l4a to d5/d32/d39/d4d/l50 0 2024-09-18T12:52:00.886 INFO:tasks.workunit.client.1.smithi161.stdout:0/229: read df/f28 [1427591,14167] 0 2024-09-18T12:52:00.890 INFO:tasks.workunit.client.0.smithi045.stdout:5/116: creat d6/db/d15/f25 x:0 0 0 2024-09-18T12:52:00.891 INFO:tasks.workunit.client.0.smithi045.stdout:5/117: chown d6/db/lc 7286 1 2024-09-18T12:52:00.898 INFO:tasks.workunit.client.0.smithi045.stdout:5/118: unlink d6/l10 0 2024-09-18T12:52:00.898 INFO:tasks.workunit.client.1.smithi161.stdout:9/199: link d0/l8 d0/d16/d25/d28/l41 0 2024-09-18T12:52:00.899 INFO:tasks.workunit.client.1.smithi161.stdout:9/200: chown d0/d16/l2b 50 1 2024-09-18T12:52:00.899 INFO:tasks.workunit.client.0.smithi045.stdout:9/54: truncate d0/d3/f7 195664 0 2024-09-18T12:52:00.900 INFO:tasks.workunit.client.0.smithi045.stdout:9/55: dread - d0/fc zero size 2024-09-18T12:52:00.906 INFO:tasks.workunit.client.1.smithi161.stdout:8/308: rename d0/l20 to d0/d3/d10/d21/l65 0 2024-09-18T12:52:00.906 INFO:tasks.workunit.client.1.smithi161.stdout:8/309: fsync d0/f45 0 2024-09-18T12:52:00.906 INFO:tasks.workunit.client.1.smithi161.stdout:4/255: symlink d5/d14/l51 0 2024-09-18T12:52:00.908 INFO:tasks.workunit.client.0.smithi045.stdout:5/119: dwrite d6/db/d15/f18 [0,4194304] 0 2024-09-18T12:52:00.909 INFO:tasks.workunit.client.0.smithi045.stdout:5/120: dread - d6/db/d15/f25 zero size 2024-09-18T12:52:00.912 INFO:tasks.workunit.client.1.smithi161.stdout:7/211: symlink d3/d8/l2d 0 2024-09-18T12:52:00.914 INFO:tasks.workunit.client.1.smithi161.stdout:0/230: dwrite df/f1b [0,4194304] 0 2024-09-18T12:52:00.915 INFO:tasks.workunit.client.1.smithi161.stdout:3/310: mkdir d1/d2e/d68 0 2024-09-18T12:52:00.915 INFO:tasks.workunit.client.0.smithi045.stdout:5/121: dread d6/db/d15/f18 [0,4194304] 0 2024-09-18T12:52:00.916 INFO:tasks.workunit.client.0.smithi045.stdout:5/122: chown d6/db/fe 5194 1 2024-09-18T12:52:00.925 INFO:tasks.workunit.client.1.smithi161.stdout:6/248: rename d4/d1a/d1c/l32 to d4/d39/d47/l4c 0 2024-09-18T12:52:00.925 INFO:tasks.workunit.client.1.smithi161.stdout:6/249: fsync d4/fa 0 2024-09-18T12:52:00.926 INFO:tasks.workunit.client.1.smithi161.stdout:4/256: creat d5/d32/d39/d4d/f52 x:0 0 0 2024-09-18T12:52:00.928 INFO:tasks.workunit.client.1.smithi161.stdout:7/212: unlink d3/c13 0 2024-09-18T12:52:00.928 INFO:tasks.workunit.client.1.smithi161.stdout:7/213: chown d3/d8/d15 38212 1 2024-09-18T12:52:00.932 INFO:tasks.workunit.client.1.smithi161.stdout:8/310: rename d0/d38 to d0/d3/d10/d21/d4a/d52/d66 0 2024-09-18T12:52:00.933 INFO:tasks.workunit.client.1.smithi161.stdout:8/311: write d0/d3/d10/f42 [2118473,79737] 0 2024-09-18T12:52:00.936 INFO:tasks.workunit.client.1.smithi161.stdout:9/201: creat d0/f42 x:0 0 0 2024-09-18T12:52:00.937 INFO:tasks.workunit.client.1.smithi161.stdout:8/312: symlink d0/d3/d5f/l67 0 2024-09-18T12:52:00.937 INFO:tasks.workunit.client.0.smithi045.stdout:5/123: write d6/db/f12 [2992850,60841] 0 2024-09-18T12:52:00.943 INFO:tasks.workunit.client.0.smithi045.stdout:5/124: link d6/f7 d6/df/f26 0 2024-09-18T12:52:00.944 INFO:tasks.workunit.client.0.smithi045.stdout:5/125: chown d6/l22 1888019 1 2024-09-18T12:52:00.944 INFO:tasks.workunit.client.0.smithi045.stdout:9/56: dwrite d0/d3/f7 [0,4194304] 0 2024-09-18T12:52:00.945 INFO:tasks.workunit.client.0.smithi045.stdout:9/57: read - d0/d3/f11 zero size 2024-09-18T12:52:00.946 INFO:tasks.workunit.client.0.smithi045.stdout:5/126: dread - d6/db/d15/f25 zero size 2024-09-18T12:52:00.947 INFO:tasks.workunit.client.0.smithi045.stdout:9/58: truncate d0/d3/f11 525209 0 2024-09-18T12:52:00.952 INFO:tasks.workunit.client.0.smithi045.stdout:9/59: mknod d0/d3/d6/d10/c15 0 2024-09-18T12:52:00.953 INFO:tasks.workunit.client.0.smithi045.stdout:9/60: chown d0/d3/d6/d10/c15 1 1 2024-09-18T12:52:00.954 INFO:tasks.workunit.client.0.smithi045.stdout:9/61: chown d0/d3/d6/cb 0 1 2024-09-18T12:52:00.956 INFO:tasks.workunit.client.0.smithi045.stdout:9/62: rename d0 to d0/d3/d16 22 2024-09-18T12:52:00.956 INFO:tasks.workunit.client.0.smithi045.stdout:9/63: chown d0/d3/l8 3620148 1 2024-09-18T12:52:00.956 INFO:tasks.workunit.client.0.smithi045.stdout:5/127: link d6/db/d15/c20 d6/df/c27 0 2024-09-18T12:52:00.957 INFO:tasks.workunit.client.0.smithi045.stdout:9/64: write d0/fc [252939,51317] 0 2024-09-18T12:52:00.958 INFO:tasks.workunit.client.0.smithi045.stdout:5/128: mkdir d6/d28 0 2024-09-18T12:52:00.958 INFO:tasks.workunit.client.0.smithi045.stdout:9/65: stat d0/d3/d6/d10/c15 0 2024-09-18T12:52:00.959 INFO:tasks.workunit.client.0.smithi045.stdout:5/129: fsync d6/df/f11 0 2024-09-18T12:52:00.960 INFO:tasks.workunit.client.0.smithi045.stdout:9/66: mknod d0/d3/c17 0 2024-09-18T12:52:00.963 INFO:tasks.workunit.client.0.smithi045.stdout:5/130: dread d6/df/f26 [0,4194304] 0 2024-09-18T12:52:00.964 INFO:tasks.workunit.client.0.smithi045.stdout:9/67: getdents d0 0 2024-09-18T12:52:00.966 INFO:tasks.workunit.client.0.smithi045.stdout:5/131: unlink d6/db/ld 0 2024-09-18T12:52:00.969 INFO:tasks.workunit.client.0.smithi045.stdout:5/132: dread d6/df/f11 [0,4194304] 0 2024-09-18T12:52:00.971 INFO:tasks.workunit.client.0.smithi045.stdout:5/133: link d6/db/lc d6/df/l29 0 2024-09-18T12:52:00.972 INFO:tasks.workunit.client.0.smithi045.stdout:5/134: write d6/db/d15/f18 [4901771,21173] 0 2024-09-18T12:52:00.975 INFO:tasks.workunit.client.0.smithi045.stdout:5/135: rename d6/db/d15 to d6/d2a 0 2024-09-18T12:52:00.979 INFO:tasks.workunit.client.1.smithi161.stdout:1/187: truncate d1/d26/f7 2902786 0 2024-09-18T12:52:00.979 INFO:tasks.workunit.client.1.smithi161.stdout:5/219: sync 2024-09-18T12:52:00.980 INFO:tasks.workunit.client.1.smithi161.stdout:0/231: truncate df/d29/f2c 2381031 0 2024-09-18T12:52:00.981 INFO:tasks.workunit.client.1.smithi161.stdout:6/250: dwrite d4/d1a/f1b [0,4194304] 0 2024-09-18T12:52:00.982 INFO:tasks.workunit.client.1.smithi161.stdout:4/257: dwrite d5/ff [0,4194304] 0 2024-09-18T12:52:00.982 INFO:tasks.workunit.client.0.smithi045.stdout:5/136: rmdir d6/d2a 39 2024-09-18T12:52:00.983 INFO:tasks.workunit.client.1.smithi161.stdout:9/202: mknod d0/d16/d12/c43 0 2024-09-18T12:52:00.984 INFO:tasks.workunit.client.1.smithi161.stdout:8/313: creat d0/d3/f68 x:0 0 0 2024-09-18T12:52:00.986 INFO:tasks.workunit.client.1.smithi161.stdout:6/251: fdatasync d4/d39/d26/d20/d28/f3d 0 2024-09-18T12:52:00.986 INFO:tasks.workunit.client.0.smithi045.stdout:5/137: mkdir d6/d28/d2b 0 2024-09-18T12:52:00.988 INFO:tasks.workunit.client.1.smithi161.stdout:2/264: dread d0/d1/df/f1b [0,4194304] 0 2024-09-18T12:52:00.988 INFO:tasks.workunit.client.1.smithi161.stdout:5/220: creat d3/d14/d20/d21/d46/f49 x:0 0 0 2024-09-18T12:52:00.989 INFO:tasks.workunit.client.1.smithi161.stdout:4/258: rmdir d5/d27/d3a/d47 39 2024-09-18T12:52:00.989 INFO:tasks.workunit.client.1.smithi161.stdout:2/265: chown d0/d1/d4c/f55 957677296 1 2024-09-18T12:52:00.989 INFO:tasks.workunit.client.1.smithi161.stdout:8/314: read d0/d3/d10/f22 [1940860,19090] 0 2024-09-18T12:52:00.990 INFO:tasks.workunit.client.1.smithi161.stdout:4/259: fdatasync d5/f36 0 2024-09-18T12:52:00.990 INFO:tasks.workunit.client.1.smithi161.stdout:4/260: chown d5/d27/l34 15026469 1 2024-09-18T12:52:00.991 INFO:tasks.workunit.client.1.smithi161.stdout:4/261: stat d5/fc 0 2024-09-18T12:52:00.992 INFO:tasks.workunit.client.1.smithi161.stdout:4/262: write d5/d32/d39/f40 [267550,122925] 0 2024-09-18T12:52:00.993 INFO:tasks.workunit.client.1.smithi161.stdout:4/263: fdatasync d5/d14/f3f 0 2024-09-18T12:52:00.993 INFO:tasks.workunit.client.1.smithi161.stdout:6/252: mkdir d4/d1a/d1c/d3e/d4d 0 2024-09-18T12:52:00.995 INFO:tasks.workunit.client.1.smithi161.stdout:1/188: rename d1/d26/d17 to d1/da/d39 0 2024-09-18T12:52:00.999 INFO:tasks.workunit.client.0.smithi045.stdout:5/138: truncate d6/db/f12 258317 0 2024-09-18T12:52:01.000 INFO:tasks.workunit.client.1.smithi161.stdout:9/203: symlink d0/d16/l44 0 2024-09-18T12:52:01.002 INFO:tasks.workunit.client.0.smithi045.stdout:5/139: creat d6/db/f2c x:0 0 0 2024-09-18T12:52:01.003 INFO:tasks.workunit.client.1.smithi161.stdout:8/315: rmdir d0/d3/d1e 39 2024-09-18T12:52:01.003 INFO:tasks.workunit.client.0.smithi045.stdout:5/140: stat d6/d28 0 2024-09-18T12:52:01.003 INFO:tasks.workunit.client.0.smithi045.stdout:5/141: readlink d6/l22 0 2024-09-18T12:52:01.004 INFO:tasks.workunit.client.1.smithi161.stdout:2/266: mkdir d0/d1/d3b/d58 0 2024-09-18T12:52:01.004 INFO:tasks.workunit.client.1.smithi161.stdout:4/264: creat d5/d32/f53 x:0 0 0 2024-09-18T12:52:01.005 INFO:tasks.workunit.client.1.smithi161.stdout:6/253: mknod d4/d39/d26/d20/c4e 0 2024-09-18T12:52:01.006 INFO:tasks.workunit.client.1.smithi161.stdout:6/254: write d4/d1a/f1b [2488424,125861] 0 2024-09-18T12:52:01.006 INFO:tasks.workunit.client.1.smithi161.stdout:0/232: rename df/f1b to df/d30/d4d/f4f 0 2024-09-18T12:52:01.007 INFO:tasks.workunit.client.0.smithi045.stdout:5/142: creat d6/d28/d2b/f2d x:0 0 0 2024-09-18T12:52:01.008 INFO:tasks.workunit.client.1.smithi161.stdout:5/221: getdents d3/d9/d47 0 2024-09-18T12:52:01.009 INFO:tasks.workunit.client.0.smithi045.stdout:5/143: symlink d6/d28/l2e 0 2024-09-18T12:52:01.011 INFO:tasks.workunit.client.1.smithi161.stdout:1/189: rmdir d1/da/d39 39 2024-09-18T12:52:01.015 INFO:tasks.workunit.client.1.smithi161.stdout:5/222: dwrite d3/d9/f1c [0,4194304] 0 2024-09-18T12:52:01.017 INFO:tasks.workunit.client.0.smithi045.stdout:5/144: dread d6/d2a/f18 [0,4194304] 0 2024-09-18T12:52:01.018 INFO:tasks.workunit.client.0.smithi045.stdout:5/145: chown d6/l9 0 1 2024-09-18T12:52:01.018 INFO:tasks.workunit.client.1.smithi161.stdout:6/255: rmdir d4/d1a/d1c 39 2024-09-18T12:52:01.023 INFO:tasks.workunit.client.0.smithi045.stdout:5/146: rmdir d6/d28 39 2024-09-18T12:52:01.024 INFO:tasks.workunit.client.0.smithi045.stdout:5/147: chown d6/db 204475 1 2024-09-18T12:52:01.024 INFO:tasks.workunit.client.1.smithi161.stdout:4/265: write d5/f8 [7851244,99630] 0 2024-09-18T12:52:01.026 INFO:tasks.workunit.client.1.smithi161.stdout:9/204: rename d0/db/d18/d2d to d0/d16/d25/d28/d45 0 2024-09-18T12:52:01.029 INFO:tasks.workunit.client.1.smithi161.stdout:3/311: sync 2024-09-18T12:52:01.029 INFO:tasks.workunit.client.1.smithi161.stdout:7/214: sync 2024-09-18T12:52:01.029 INFO:tasks.workunit.client.1.smithi161.stdout:2/267: creat d0/d4/d52/f59 x:0 0 0 2024-09-18T12:52:01.031 INFO:tasks.workunit.client.0.smithi045.stdout:5/148: dwrite d6/db/f2c [0,4194304] 0 2024-09-18T12:52:01.031 INFO:tasks.workunit.client.1.smithi161.stdout:3/312: chown d1/d2e/d14/d2c/l4e 101152 1 2024-09-18T12:52:01.031 INFO:tasks.workunit.client.1.smithi161.stdout:1/190: mkdir d1/d26/d3a 0 2024-09-18T12:52:01.032 INFO:tasks.workunit.client.1.smithi161.stdout:4/266: dwrite d5/d14/f3f [0,4194304] 0 2024-09-18T12:52:01.035 INFO:tasks.workunit.client.1.smithi161.stdout:3/313: write d1/d2e/d14/f30 [4897321,10245] 0 2024-09-18T12:52:01.035 INFO:tasks.workunit.client.1.smithi161.stdout:9/205: unlink d0/f5 0 2024-09-18T12:52:01.037 INFO:tasks.workunit.client.1.smithi161.stdout:4/267: write d5/d32/f42 [341729,23792] 0 2024-09-18T12:52:01.038 INFO:tasks.workunit.client.0.smithi045.stdout:5/149: dread d6/d2a/f18 [0,4194304] 0 2024-09-18T12:52:01.039 INFO:tasks.workunit.client.0.smithi045.stdout:5/150: dread - d6/d2a/f25 zero size 2024-09-18T12:52:01.039 INFO:tasks.workunit.client.1.smithi161.stdout:2/268: dread - d0/d5/d43/d35/f3e zero size 2024-09-18T12:52:01.040 INFO:tasks.workunit.client.0.smithi045.stdout:5/151: chown d6/d2a/f18 0 1 2024-09-18T12:52:01.043 INFO:tasks.workunit.client.1.smithi161.stdout:2/269: write d0/d5/f47 [4060381,62970] 0 2024-09-18T12:52:01.043 INFO:tasks.workunit.client.1.smithi161.stdout:5/223: unlink d3/d14/l1d 0 2024-09-18T12:52:01.045 INFO:tasks.workunit.client.1.smithi161.stdout:7/215: dread d3/d8/d15/d1a/f22 [0,4194304] 0 2024-09-18T12:52:01.046 INFO:tasks.workunit.client.1.smithi161.stdout:0/233: creat df/f50 x:0 0 0 2024-09-18T12:52:01.047 INFO:tasks.workunit.client.1.smithi161.stdout:7/216: dread d3/f11 [0,4194304] 0 2024-09-18T12:52:01.048 INFO:tasks.workunit.client.1.smithi161.stdout:0/234: read - df/f22 zero size 2024-09-18T12:52:01.048 INFO:tasks.workunit.client.1.smithi161.stdout:1/191: dread d1/f15 [0,4194304] 0 2024-09-18T12:52:01.051 INFO:tasks.workunit.client.1.smithi161.stdout:9/206: unlink d0/db/d18/l23 0 2024-09-18T12:52:01.054 INFO:tasks.workunit.client.1.smithi161.stdout:8/316: rename d0/d3/d1e/d34/f35 to d0/d3/f69 0 2024-09-18T12:52:01.055 INFO:tasks.workunit.client.1.smithi161.stdout:4/268: dwrite d5/d32/f45 [0,4194304] 0 2024-09-18T12:52:01.056 INFO:tasks.workunit.client.1.smithi161.stdout:3/314: mkdir d1/d2e/d68/d69 0 2024-09-18T12:52:01.056 INFO:tasks.workunit.client.1.smithi161.stdout:1/192: write d1/ff [1033583,125346] 0 2024-09-18T12:52:01.057 INFO:tasks.workunit.client.1.smithi161.stdout:0/235: mkdir df/d29/d46/d51 0 2024-09-18T12:52:01.059 INFO:tasks.workunit.client.1.smithi161.stdout:5/224: rename d3/d14/d20/d21/d24/l3a to d3/d14/d20/d21/d24/l4a 0 2024-09-18T12:52:01.059 INFO:tasks.workunit.client.1.smithi161.stdout:2/270: dread d0/d1/d3b/f42 [0,4194304] 0 2024-09-18T12:52:01.062 INFO:tasks.workunit.client.1.smithi161.stdout:9/207: mkdir d0/d16/d25/d46 0 2024-09-18T12:52:01.062 INFO:tasks.workunit.client.1.smithi161.stdout:7/217: dread d3/f4 [0,4194304] 0 2024-09-18T12:52:01.063 INFO:tasks.workunit.client.1.smithi161.stdout:0/236: symlink df/d29/l52 0 2024-09-18T12:52:01.064 INFO:tasks.workunit.client.1.smithi161.stdout:3/315: fdatasync d1/d2e/d24/f45 0 2024-09-18T12:52:01.065 INFO:tasks.workunit.client.1.smithi161.stdout:1/193: dread d1/f15 [0,4194304] 0 2024-09-18T12:52:01.065 INFO:tasks.workunit.client.1.smithi161.stdout:2/271: creat d0/d1/d3b/f5a x:0 0 0 2024-09-18T12:52:01.065 INFO:tasks.workunit.client.1.smithi161.stdout:8/317: mknod d0/d3/d1e/c6a 0 2024-09-18T12:52:01.065 INFO:tasks.workunit.client.0.smithi045.stdout:5/152: write d6/f7 [796164,80069] 0 2024-09-18T12:52:01.066 INFO:tasks.workunit.client.1.smithi161.stdout:7/218: creat d3/f2e x:0 0 0 2024-09-18T12:52:01.067 INFO:tasks.workunit.client.1.smithi161.stdout:2/272: write d0/d5/d43/f37 [209441,90525] 0 2024-09-18T12:52:01.069 INFO:tasks.workunit.client.1.smithi161.stdout:7/219: truncate d3/f2e 750725 0 2024-09-18T12:52:01.069 INFO:tasks.workunit.client.1.smithi161.stdout:0/237: creat df/d29/f53 x:0 0 0 2024-09-18T12:52:01.071 INFO:tasks.workunit.client.1.smithi161.stdout:7/220: write d3/f19 [4574424,59456] 0 2024-09-18T12:52:01.074 INFO:tasks.workunit.client.1.smithi161.stdout:9/208: dread d0/db/f26 [0,4194304] 0 2024-09-18T12:52:01.074 INFO:tasks.workunit.client.0.smithi045.stdout:5/153: rename d6/df/c17 to d6/c2f 0 2024-09-18T12:52:01.076 INFO:tasks.workunit.client.1.smithi161.stdout:7/221: write d3/f19 [5387774,53200] 0 2024-09-18T12:52:01.078 INFO:tasks.workunit.client.1.smithi161.stdout:8/318: dread d0/d3/f3d [0,4194304] 0 2024-09-18T12:52:01.079 INFO:tasks.workunit.client.1.smithi161.stdout:9/209: chown d0/d16/d12/c43 5438991 1 2024-09-18T12:52:01.079 INFO:tasks.workunit.client.1.smithi161.stdout:6/256: dwrite d4/d1a/d1c/f25 [0,4194304] 0 2024-09-18T12:52:01.080 INFO:tasks.workunit.client.1.smithi161.stdout:8/319: write d0/f2a [1609772,29339] 0 2024-09-18T12:52:01.081 INFO:tasks.workunit.client.0.smithi045.stdout:5/154: mknod d6/d28/c30 0 2024-09-18T12:52:01.082 INFO:tasks.workunit.client.1.smithi161.stdout:8/320: write d0/d3/d1e/d34/f64 [136374,8658] 0 2024-09-18T12:52:01.083 INFO:tasks.workunit.client.0.smithi045.stdout:5/155: write d6/df/f11 [3193839,83459] 0 2024-09-18T12:52:01.083 INFO:tasks.workunit.client.1.smithi161.stdout:0/238: mknod df/d29/d2d/d37/c54 0 2024-09-18T12:52:01.087 INFO:tasks.workunit.client.1.smithi161.stdout:4/269: link d5/d27/l28 d5/d27/d3a/d4c/l54 0 2024-09-18T12:52:01.089 INFO:tasks.workunit.client.1.smithi161.stdout:6/257: dwrite d4/d39/d26/f2b [0,4194304] 0 2024-09-18T12:52:01.089 INFO:tasks.workunit.client.1.smithi161.stdout:4/270: write d5/f20 [6027743,21368] 0 2024-09-18T12:52:01.089 INFO:tasks.workunit.client.0.smithi045.stdout:5/156: dread d6/db/fe [0,4194304] 0 2024-09-18T12:52:01.091 INFO:tasks.workunit.client.1.smithi161.stdout:4/271: dread - d5/d27/d3a/f3c zero size 2024-09-18T12:52:01.091 INFO:tasks.workunit.client.1.smithi161.stdout:2/273: link d0/d1/f3 d0/d5/d53/f5b 0 2024-09-18T12:52:01.093 INFO:tasks.workunit.client.1.smithi161.stdout:7/222: fsync d3/d8/d15/d1a/f22 0 2024-09-18T12:52:01.094 INFO:tasks.workunit.client.0.smithi045.stdout:5/157: stat d6/d2a/c20 0 2024-09-18T12:52:01.095 INFO:tasks.workunit.client.1.smithi161.stdout:3/316: write d1/d2e/d24/f3a [5386067,1390] 0 2024-09-18T12:52:01.096 INFO:tasks.workunit.client.0.smithi045.stdout:5/158: write d6/d2a/f25 [47232,31819] 0 2024-09-18T12:52:01.096 INFO:tasks.workunit.client.1.smithi161.stdout:0/239: stat df/c18 0 2024-09-18T12:52:01.098 INFO:tasks.workunit.client.1.smithi161.stdout:1/194: dread d1/d26/f8 [0,4194304] 0 2024-09-18T12:52:01.099 INFO:tasks.workunit.client.0.smithi045.stdout:5/159: write d6/d2a/f18 [5080683,118762] 0 2024-09-18T12:52:01.100 INFO:tasks.workunit.client.1.smithi161.stdout:4/272: write d5/d27/f46 [404583,48258] 0 2024-09-18T12:52:01.101 INFO:tasks.workunit.client.1.smithi161.stdout:2/274: rename d0/d5/c31 to d0/d4/c5c 0 2024-09-18T12:52:01.102 INFO:tasks.workunit.client.1.smithi161.stdout:7/223: creat d3/d8/d20/f2f x:0 0 0 2024-09-18T12:52:01.102 INFO:tasks.workunit.client.1.smithi161.stdout:9/210: mkdir d0/d47 0 2024-09-18T12:52:01.103 INFO:tasks.workunit.client.1.smithi161.stdout:7/224: stat d3/d8/l2d 0 2024-09-18T12:52:01.103 INFO:tasks.workunit.client.1.smithi161.stdout:9/211: dread - d0/d16/f35 zero size 2024-09-18T12:52:01.103 INFO:tasks.workunit.client.0.smithi045.stdout:5/160: mkdir d6/db/d19/d31 0 2024-09-18T12:52:01.104 INFO:tasks.workunit.client.1.smithi161.stdout:0/240: mkdir df/d29/d2d/d37/d55 0 2024-09-18T12:52:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.104+0000 7f52a1bfe640 1 -- 172.21.15.45:0/3418329030 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f529c062630 con 0x7f5284074ad0 2024-09-18T12:52:01.106 INFO:tasks.workunit.client.0.smithi045.stdout:5/161: mknod d6/d28/d2b/c32 0 2024-09-18T12:52:01.108 INFO:tasks.workunit.client.1.smithi161.stdout:3/317: rename d1/d2e/d24/d1d/f67 to d1/d2e/d14/d65/f6a 0 2024-09-18T12:52:01.109 INFO:tasks.workunit.client.1.smithi161.stdout:2/275: creat d0/d1/d3b/d3d/f5d x:0 0 0 2024-09-18T12:52:01.110 INFO:tasks.workunit.client.1.smithi161.stdout:3/318: fdatasync d1/d2e/f4b 0 2024-09-18T12:52:01.112 INFO:tasks.workunit.client.1.smithi161.stdout:7/225: dwrite d3/d8/f29 [0,4194304] 0 2024-09-18T12:52:01.112 INFO:tasks.workunit.client.1.smithi161.stdout:1/195: rmdir d1/d1d 39 2024-09-18T12:52:01.114 INFO:tasks.workunit.client.1.smithi161.stdout:6/258: link d4/d39/d3a/c49 d4/d39/d46/c4f 0 2024-09-18T12:52:01.115 INFO:tasks.workunit.client.1.smithi161.stdout:4/273: creat d5/d27/d44/f55 x:0 0 0 2024-09-18T12:52:01.117 INFO:tasks.workunit.client.1.smithi161.stdout:9/212: mkdir d0/d47/d48 0 2024-09-18T12:52:01.119 INFO:tasks.workunit.client.1.smithi161.stdout:8/321: dread d0/d3/d10/f18 [0,4194304] 0 2024-09-18T12:52:01.121 INFO:tasks.workunit.client.1.smithi161.stdout:9/213: truncate d0/d16/d12/f15 544014 0 2024-09-18T12:52:01.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.121+0000 7f5298ff9640 1 -- 172.21.15.45:0/3418329030 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f529c062630 con 0x7f5284074ad0 2024-09-18T12:52:01.123 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:52:01.123 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (6m) 32s ago 7m 26.9M - 0.25.0 c8568f914cd2 de7ae4bc8025 2024-09-18T12:52:01.123 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 starting - - - - 2024-09-18T12:52:01.123 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (7m) 35s ago 7m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de a49472bef49e 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (8m) 32s ago 8m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (7m) 35s ago 7m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (6m) 32s ago 7m 78.3M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (2m) 32s ago 2m 115M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (2m) 32s ago 2m 127M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (2m) 35s ago 2m 13.8M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (2m) 35s ago 2m 12.2M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:9283,8765,8443 running (9m) 32s ago 9m 210M - 19.1.1-330-gc2ddf972 ebb0615149de 84d721f8241b 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (61s) 35s ago 7m 491M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 0fb3c7114540 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (9m) 32s ago 9m 54.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (7m) 35s ago 7m 41.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:52:01.124 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (8m) 32s ago 8m 17.0M - 1.5.0 0da6a335fe13 39666fd05306 2024-09-18T12:52:01.125 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (7m) 35s ago 7m 16.6M - 1.5.0 0da6a335fe13 ed4fe4d74f39 2024-09-18T12:52:01.125 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (6m) 32s ago 6m 81.5M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:52:01.125 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (5m) 32s ago 5m 85.3M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:52:01.125 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (4m) 32s ago 4m 71.4M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:52:01.125 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (4m) 35s ago 4m 77.4M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:52:01.125 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (4m) 35s ago 4m 80.0M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:52:01.126 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (3m) 35s ago 3m 75.4M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:52:01.126 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (6m) 32s ago 7m 61.4M - 2.43.0 a07b618ecd1d 411e86f6fecd 2024-09-18T12:52:01.126 INFO:tasks.workunit.client.0.smithi045.stdout:5/162: truncate d6/f7 2875466 0 2024-09-18T12:52:01.127 INFO:tasks.workunit.client.1.smithi161.stdout:8/322: write d0/f9 [4486142,44867] 0 2024-09-18T12:52:01.127 INFO:tasks.workunit.client.1.smithi161.stdout:1/196: creat d1/d26/d3a/f3b x:0 0 0 2024-09-18T12:52:01.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.125+0000 7f52a1bfe640 1 -- 172.21.15.45:0/3418329030 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f5284074ad0 msgr2=0x7f5284076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.125+0000 7f52a1bfe640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f5284074ad0 0x7f5284076f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f529c1018e0 tx=0x7f528c009500 comp rx=0 tx=0).stop 2024-09-18T12:52:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.125+0000 7f52a1bfe640 1 -- 172.21.15.45:0/3418329030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f529c101a80 msgr2=0x7f529c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.125+0000 7f52a1bfe640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f529c101a80 0x7f529c103190 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5290009230 tx=0x7f5290004570 comp rx=0 tx=0).stop 2024-09-18T12:52:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.126+0000 7f52a1bfe640 1 -- 172.21.15.45:0/3418329030 shutdown_connections 2024-09-18T12:52:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.126+0000 7f52a1bfe640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f5284074ad0 0x7f5284076f90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.126+0000 7f52a1bfe640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f529c101a80 0x7f529c103190 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.126+0000 7f52a1bfe640 1 --2- 172.21.15.45:0/3418329030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f529c100880 0x7f529c104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.126+0000 7f52a1bfe640 1 -- 172.21.15.45:0/3418329030 >> 172.21.15.45:0/3418329030 conn(0x7f529c0fc030 msgr2=0x7f529c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:01.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.127+0000 7f52a1bfe640 1 -- 172.21.15.45:0/3418329030 shutdown_connections 2024-09-18T12:52:01.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.127+0000 7f52a1bfe640 1 -- 172.21.15.45:0/3418329030 wait complete. 2024-09-18T12:52:01.130 INFO:tasks.workunit.client.1.smithi161.stdout:8/323: chown d0/d3/fb 70634 1 2024-09-18T12:52:01.130 INFO:tasks.workunit.client.1.smithi161.stdout:1/197: fsync d1/d26/fe 0 2024-09-18T12:52:01.131 INFO:tasks.workunit.client.1.smithi161.stdout:2/276: creat d0/d1/f5e x:0 0 0 2024-09-18T12:52:01.131 INFO:tasks.workunit.client.1.smithi161.stdout:4/274: dwrite d5/d32/f53 [0,4194304] 0 2024-09-18T12:52:01.131 INFO:tasks.workunit.client.1.smithi161.stdout:6/259: symlink d4/d39/d26/d31/l50 0 2024-09-18T12:52:01.131 INFO:tasks.workunit.client.1.smithi161.stdout:9/214: rename d0/d16/d12 to d0/d20/d49 0 2024-09-18T12:52:01.131 INFO:tasks.workunit.client.0.smithi045.stdout:5/163: dread d6/df/f11 [0,4194304] 0 2024-09-18T12:52:01.132 INFO:tasks.workunit.client.1.smithi161.stdout:6/260: dread - d4/d39/d26/d20/d28/f3b zero size 2024-09-18T12:52:01.133 INFO:tasks.workunit.client.1.smithi161.stdout:7/226: dread d3/f14 [0,4194304] 0 2024-09-18T12:52:01.133 INFO:tasks.workunit.client.1.smithi161.stdout:6/261: readlink d4/d39/d26/d20/l43 0 2024-09-18T12:52:01.138 INFO:tasks.workunit.client.1.smithi161.stdout:0/241: dwrite df/d29/f2c [0,4194304] 0 2024-09-18T12:52:01.140 INFO:tasks.workunit.client.0.smithi045.stdout:5/164: creat d6/df/f33 x:0 0 0 2024-09-18T12:52:01.144 INFO:tasks.workunit.client.1.smithi161.stdout:2/277: creat d0/d5/d43/d35/f5f x:0 0 0 2024-09-18T12:52:01.145 INFO:tasks.workunit.client.1.smithi161.stdout:5/225: sync 2024-09-18T12:52:01.147 INFO:tasks.workunit.client.0.smithi045.stdout:5/165: symlink d6/db/d19/d31/l34 0 2024-09-18T12:52:01.151 INFO:tasks.workunit.client.0.smithi045.stdout:5/166: creat d6/df/f35 x:0 0 0 2024-09-18T12:52:01.152 INFO:tasks.workunit.client.1.smithi161.stdout:7/227: mknod d3/c30 0 2024-09-18T12:52:01.153 INFO:tasks.workunit.client.1.smithi161.stdout:7/228: read d3/d8/d20/f21 [1387978,5564] 0 2024-09-18T12:52:01.153 INFO:tasks.workunit.client.1.smithi161.stdout:7/229: readlink d3/d8/l1f 0 2024-09-18T12:52:01.154 INFO:tasks.workunit.client.0.smithi045.stdout:5/167: rmdir d6/df 39 2024-09-18T12:52:01.155 INFO:tasks.workunit.client.1.smithi161.stdout:6/262: write d4/d1a/f14 [589301,47782] 0 2024-09-18T12:52:01.155 INFO:tasks.workunit.client.1.smithi161.stdout:3/319: truncate d1/d2e/d3d/d49/f5f 2465567 0 2024-09-18T12:52:01.160 INFO:tasks.workunit.client.1.smithi161.stdout:4/275: symlink d5/d27/d3a/d47/l56 0 2024-09-18T12:52:01.162 INFO:tasks.workunit.client.0.smithi045.stdout:5/168: rename d6/db/d19/f1f to d6/df/f36 0 2024-09-18T12:52:01.165 INFO:tasks.workunit.client.1.smithi161.stdout:0/242: write df/f32 [4749453,24900] 0 2024-09-18T12:52:01.166 INFO:tasks.workunit.client.1.smithi161.stdout:0/243: readlink df/d29/l40 0 2024-09-18T12:52:01.166 INFO:tasks.workunit.client.1.smithi161.stdout:8/324: creat d0/f6b x:0 0 0 2024-09-18T12:52:01.168 INFO:tasks.workunit.client.0.smithi045.stdout:5/169: write d6/df/f36 [323441,59635] 0 2024-09-18T12:52:01.170 INFO:tasks.workunit.client.1.smithi161.stdout:6/263: mkdir d4/d39/d47/d51 0 2024-09-18T12:52:01.172 INFO:tasks.workunit.client.0.smithi045.stdout:5/170: mknod d6/d28/c37 0 2024-09-18T12:52:01.174 INFO:tasks.workunit.client.1.smithi161.stdout:1/198: link d1/d26/f2e d1/da/d31/f3c 0 2024-09-18T12:52:01.174 INFO:tasks.workunit.client.1.smithi161.stdout:0/244: dwrite df/f32 [8388608,4194304] 0 2024-09-18T12:52:01.177 INFO:tasks.workunit.client.1.smithi161.stdout:2/278: dwrite d0/d1/df/f1b [0,4194304] 0 2024-09-18T12:52:01.178 INFO:tasks.workunit.client.1.smithi161.stdout:8/325: unlink d0/f16 0 2024-09-18T12:52:01.179 INFO:tasks.workunit.client.1.smithi161.stdout:7/230: mkdir d3/d8/d15/d1a/d24/d31 0 2024-09-18T12:52:01.180 INFO:tasks.workunit.client.0.smithi045.stdout:5/171: dwrite d6/df/f35 [0,4194304] 0 2024-09-18T12:52:01.181 INFO:tasks.workunit.client.1.smithi161.stdout:9/215: dwrite d0/d16/d25/d28/f38 [0,4194304] 0 2024-09-18T12:52:01.182 INFO:tasks.workunit.client.1.smithi161.stdout:3/320: mkdir d1/d2e/d3d/d6b 0 2024-09-18T12:52:01.185 INFO:tasks.workunit.client.1.smithi161.stdout:6/264: unlink d4/d1a/d1c/f25 0 2024-09-18T12:52:01.186 INFO:tasks.workunit.client.1.smithi161.stdout:7/231: dread d3/f4 [0,4194304] 0 2024-09-18T12:52:01.190 INFO:tasks.workunit.client.1.smithi161.stdout:4/276: creat d5/d27/d3a/d4c/f57 x:0 0 0 2024-09-18T12:52:01.190 INFO:tasks.workunit.client.1.smithi161.stdout:1/199: rename d1/d26/l32 to d1/d26/l3d 0 2024-09-18T12:52:01.193 INFO:tasks.workunit.client.1.smithi161.stdout:0/245: rename df/c18 to df/d29/d46/c56 0 2024-09-18T12:52:01.195 INFO:tasks.workunit.client.1.smithi161.stdout:0/246: fsync df/f28 0 2024-09-18T12:52:01.195 INFO:tasks.workunit.client.1.smithi161.stdout:2/279: creat d0/d4/d52/f60 x:0 0 0 2024-09-18T12:52:01.195 INFO:tasks.workunit.client.1.smithi161.stdout:7/232: dwrite d3/d8/d15/f1e [0,4194304] 0 2024-09-18T12:52:01.197 INFO:tasks.workunit.client.1.smithi161.stdout:2/280: dread - d0/d1/d3b/f5a zero size 2024-09-18T12:52:01.201 INFO:tasks.workunit.client.1.smithi161.stdout:1/200: dwrite d1/da/f18 [0,4194304] 0 2024-09-18T12:52:01.202 INFO:tasks.workunit.client.1.smithi161.stdout:7/233: dread d3/f4 [0,4194304] 0 2024-09-18T12:52:01.203 INFO:tasks.workunit.client.1.smithi161.stdout:3/321: creat d1/d2e/d14/d65/f6c x:0 0 0 2024-09-18T12:52:01.211 INFO:tasks.workunit.client.1.smithi161.stdout:9/216: dwrite d0/f29 [0,4194304] 0 2024-09-18T12:52:01.213 INFO:tasks.workunit.client.1.smithi161.stdout:0/247: creat df/d29/d36/f57 x:0 0 0 2024-09-18T12:52:01.213 INFO:tasks.workunit.client.0.smithi045.stdout:5/172: mknod d6/db/d19/c38 0 2024-09-18T12:52:01.213 INFO:tasks.workunit.client.1.smithi161.stdout:9/217: fsync d0/d16/d25/d28/d45/f37 0 2024-09-18T12:52:01.215 INFO:tasks.workunit.client.1.smithi161.stdout:7/234: dwrite d3/f23 [0,4194304] 0 2024-09-18T12:52:01.217 INFO:tasks.workunit.client.1.smithi161.stdout:0/248: write df/d29/f53 [793431,71043] 0 2024-09-18T12:52:01.219 INFO:tasks.workunit.client.1.smithi161.stdout:7/235: rename d3/d8/d15 to d3/d8/d15/d32 22 2024-09-18T12:52:01.219 INFO:tasks.workunit.client.0.smithi045.stdout:5/173: symlink d6/db/l39 0 2024-09-18T12:52:01.222 INFO:tasks.workunit.client.1.smithi161.stdout:6/265: creat d4/d39/d47/d51/f52 x:0 0 0 2024-09-18T12:52:01.225 INFO:tasks.workunit.client.1.smithi161.stdout:6/266: write d4/d1a/d1c/d3e/f42 [335893,64606] 0 2024-09-18T12:52:01.226 INFO:tasks.workunit.client.0.smithi045.stdout:5/174: rename d6/df/f11 to d6/df/f3a 0 2024-09-18T12:52:01.226 INFO:tasks.workunit.client.1.smithi161.stdout:0/249: dread df/f1c [0,4194304] 0 2024-09-18T12:52:01.228 INFO:tasks.workunit.client.1.smithi161.stdout:0/250: write df/d29/f53 [1565185,38306] 0 2024-09-18T12:52:01.231 INFO:tasks.workunit.client.1.smithi161.stdout:8/326: unlink d0/l3e 0 2024-09-18T12:52:01.232 INFO:tasks.workunit.client.1.smithi161.stdout:3/322: dwrite d1/d2e/d3d/f7 [0,4194304] 0 2024-09-18T12:52:01.233 INFO:tasks.workunit.client.0.smithi045.stdout:5/175: symlink d6/l3b 0 2024-09-18T12:52:01.236 INFO:tasks.workunit.client.1.smithi161.stdout:7/236: write d3/f4 [4246247,130915] 0 2024-09-18T12:52:01.237 INFO:tasks.workunit.client.1.smithi161.stdout:7/237: fsync d3/f19 0 2024-09-18T12:52:01.237 INFO:tasks.workunit.client.1.smithi161.stdout:0/251: dwrite df/d30/f38 [0,4194304] 0 2024-09-18T12:52:01.238 INFO:tasks.workunit.client.0.smithi045.stdout:5/176: symlink d6/db/d19/d31/l3c 0 2024-09-18T12:52:01.240 INFO:tasks.workunit.client.1.smithi161.stdout:2/281: write d0/d5/d53/f5b [6378789,113613] 0 2024-09-18T12:52:01.242 INFO:tasks.workunit.client.1.smithi161.stdout:4/277: creat d5/d27/d3a/f58 x:0 0 0 2024-09-18T12:52:01.245 INFO:tasks.workunit.client.1.smithi161.stdout:9/218: creat d0/d47/d48/f4a x:0 0 0 2024-09-18T12:52:01.250 INFO:tasks.workunit.client.0.smithi045.stdout:5/177: getdents d6/db 0 2024-09-18T12:52:01.251 INFO:tasks.workunit.client.1.smithi161.stdout:6/267: dwrite d4/d39/d3a/f3c [0,4194304] 0 2024-09-18T12:52:01.252 INFO:tasks.workunit.client.1.smithi161.stdout:4/278: dwrite d5/d32/d39/f4e [0,4194304] 0 2024-09-18T12:52:01.252 INFO:tasks.workunit.client.0.smithi045.stdout:5/178: write d6/d2a/f18 [5036019,106964] 0 2024-09-18T12:52:01.253 INFO:tasks.workunit.client.1.smithi161.stdout:4/279: write d5/f22 [5648379,99906] 0 2024-09-18T12:52:01.257 INFO:tasks.workunit.client.1.smithi161.stdout:6/268: read d4/d39/d26/d20/d28/f35 [4379194,122317] 0 2024-09-18T12:52:01.257 INFO:tasks.workunit.client.1.smithi161.stdout:9/219: mknod d0/d16/d25/d28/d45/c4b 0 2024-09-18T12:52:01.258 INFO:tasks.workunit.client.1.smithi161.stdout:5/226: sync 2024-09-18T12:52:01.259 INFO:tasks.workunit.client.0.smithi045.stdout:5/179: getdents d6/db/d19 0 2024-09-18T12:52:01.260 INFO:tasks.workunit.client.1.smithi161.stdout:9/220: dread - d0/d16/d25/d28/f31 zero size 2024-09-18T12:52:01.260 INFO:tasks.workunit.client.0.smithi045.stdout:5/180: write d6/df/f36 [1235122,66697] 0 2024-09-18T12:52:01.262 INFO:tasks.workunit.client.1.smithi161.stdout:0/252: mknod df/d29/d46/d51/c58 0 2024-09-18T12:52:01.263 INFO:tasks.workunit.client.1.smithi161.stdout:6/269: write d4/d39/d3a/f3f [325934,122976] 0 2024-09-18T12:52:01.263 INFO:tasks.workunit.client.1.smithi161.stdout:7/238: link d3/f2e d3/d8/d15/f33 0 2024-09-18T12:52:01.264 INFO:tasks.workunit.client.1.smithi161.stdout:4/280: dread d5/f36 [4194304,4194304] 0 2024-09-18T12:52:01.265 INFO:tasks.workunit.client.0.smithi045.stdout:5/181: dread d6/db/f2c [0,4194304] 0 2024-09-18T12:52:01.265 INFO:tasks.workunit.client.1.smithi161.stdout:7/239: write d3/f17 [3814663,126103] 0 2024-09-18T12:52:01.266 INFO:tasks.workunit.client.1.smithi161.stdout:9/221: creat d0/d47/f4c x:0 0 0 2024-09-18T12:52:01.268 INFO:tasks.workunit.client.1.smithi161.stdout:3/323: getdents d1/d2e/d3d 0 2024-09-18T12:52:01.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.265+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/4244594406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6b4100860 msgr2=0x7fe6b4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:01.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.265+0000 7fe6ba8f2640 1 --2- 172.21.15.45:0/4244594406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6b4100860 0x7fe6b4100c60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009880 tx=0x7fe6a402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.266+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/4244594406 shutdown_connections 2024-09-18T12:52:01.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.266+0000 7fe6ba8f2640 1 --2- 172.21.15.45:0/4244594406 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b4101a60 0x7fe6b4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.266+0000 7fe6ba8f2640 1 --2- 172.21.15.45:0/4244594406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6b4100860 0x7fe6b4100c60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.266+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/4244594406 >> 172.21.15.45:0/4244594406 conn(0x7fe6b40fc010 msgr2=0x7fe6b40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:01.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.266+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/4244594406 shutdown_connections 2024-09-18T12:52:01.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.266+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/4244594406 wait complete. 2024-09-18T12:52:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.266+0000 7fe6ba8f2640 1 Processor -- start 2024-09-18T12:52:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.267+0000 7fe6ba8f2640 1 -- start start 2024-09-18T12:52:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.267+0000 7fe6ba8f2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b4100860 0x7fe6b419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.267+0000 7fe6ba8f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6b4101a60 0x7fe6b419e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.267+0000 7fe6ba8f2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b41085f0 con 0x7fe6b4101a60 2024-09-18T12:52:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.267+0000 7fe6ba8f2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b4108470 con 0x7fe6b4100860 2024-09-18T12:52:01.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.267+0000 7fe6b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6b4101a60 0x7fe6b419e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:01.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.267+0000 7fe6b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6b4101a60 0x7fe6b419e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36058/0 (socket says 172.21.15.45:36058) 2024-09-18T12:52:01.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.267+0000 7fe6b37fe640 1 -- 172.21.15.45:0/952684787 learned_addr learned my addr 172.21.15.45:0/952684787 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:52:01.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.267+0000 7fe6b3fff640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b4100860 0x7fe6b419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:01.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.268+0000 7fe6b37fe640 1 -- 172.21.15.45:0/952684787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b4100860 msgr2=0x7fe6b419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:01.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.268+0000 7fe6b37fe640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b4100860 0x7fe6b419db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.268+0000 7fe6b37fe640 1 -- 172.21.15.45:0/952684787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b419e700 con 0x7fe6b4101a60 2024-09-18T12:52:01.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.268+0000 7fe6b37fe640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6b4101a60 0x7fe6b419e080 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00b420 tx=0x7fe69c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:01.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.268+0000 7fe6b17fa640 1 -- 172.21.15.45:0/952684787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe69c011630 con 0x7fe6b4101a60 2024-09-18T12:52:01.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.268+0000 7fe6b17fa640 1 -- 172.21.15.45:0/952684787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe69c016070 con 0x7fe6b4101a60 2024-09-18T12:52:01.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.268+0000 7fe6b17fa640 1 -- 172.21.15.45:0/952684787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe69c010d40 con 0x7fe6b4101a60 2024-09-18T12:52:01.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.268+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/952684787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b41a3140 con 0x7fe6b4101a60 2024-09-18T12:52:01.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.268+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/952684787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b41a3750 con 0x7fe6b4101a60 2024-09-18T12:52:01.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.270+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/952684787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b4109f50 con 0x7fe6b4101a60 2024-09-18T12:52:01.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.272+0000 7fe6b17fa640 1 -- 172.21.15.45:0/952684787 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fe69c0117d0 con 0x7fe6b4101a60 2024-09-18T12:52:01.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.272+0000 7fe6b17fa640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fe6a0074a80 0x7fe6a0076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:01.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.272+0000 7fe6b17fa640 1 -- 172.21.15.45:0/952684787 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7fe69c095aa0 con 0x7fe6b4101a60 2024-09-18T12:52:01.279 INFO:tasks.workunit.client.0.smithi045.stdout:5/182: unlink d6/c2f 0 2024-09-18T12:52:01.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.274+0000 7fe6b3fff640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fe6a0074a80 0x7fe6a0076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:01.281 INFO:tasks.workunit.client.0.smithi045.stdout:5/183: fdatasync d6/d2a/f25 0 2024-09-18T12:52:01.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.275+0000 7fe6b3fff640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fe6a0074a80 0x7fe6a0076f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4006010 tx=0x7fe6a4005a20 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:01.283 INFO:tasks.workunit.client.1.smithi161.stdout:4/281: write d5/f17 [2840347,27707] 0 2024-09-18T12:52:01.283 INFO:tasks.workunit.client.1.smithi161.stdout:2/282: getdents d0/d5/d43/d35 0 2024-09-18T12:52:01.283 INFO:tasks.workunit.client.1.smithi161.stdout:6/270: creat d4/d39/d26/d31/f53 x:0 0 0 2024-09-18T12:52:01.283 INFO:tasks.workunit.client.1.smithi161.stdout:1/201: truncate d1/f1b 977521 0 2024-09-18T12:52:01.283 INFO:tasks.workunit.client.1.smithi161.stdout:9/222: write d0/d16/d25/d28/f38 [915605,31507] 0 2024-09-18T12:52:01.283 INFO:tasks.workunit.client.1.smithi161.stdout:1/202: write d1/d26/f24 [373052,33079] 0 2024-09-18T12:52:01.284 INFO:tasks.workunit.client.1.smithi161.stdout:9/223: dread - d0/d16/d25/d28/f31 zero size 2024-09-18T12:52:01.284 INFO:tasks.workunit.client.1.smithi161.stdout:5/227: dwrite d3/d3b/f3d [0,4194304] 0 2024-09-18T12:52:01.284 INFO:tasks.workunit.client.1.smithi161.stdout:3/324: mknod d1/d2e/d3d/d53/c6d 0 2024-09-18T12:52:01.284 INFO:tasks.workunit.client.1.smithi161.stdout:9/224: write d0/f22 [1645894,81054] 0 2024-09-18T12:52:01.284 INFO:tasks.workunit.client.1.smithi161.stdout:5/228: write d3/d3b/f42 [66675,29883] 0 2024-09-18T12:52:01.284 INFO:tasks.workunit.client.1.smithi161.stdout:9/225: chown d0/d20/d49/f15 85201880 1 2024-09-18T12:52:01.285 INFO:tasks.workunit.client.0.smithi045.stdout:5/184: write d6/df/f36 [1502016,50680] 0 2024-09-18T12:52:01.285 INFO:tasks.workunit.client.0.smithi045.stdout:5/185: chown d6/db 3 1 2024-09-18T12:52:01.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.278+0000 7fe6b17fa640 1 -- 172.21.15.45:0/952684787 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe69c01f060 con 0x7fe6b4101a60 2024-09-18T12:52:01.287 INFO:tasks.workunit.client.0.smithi045.stdout:5/186: creat d6/d28/d2b/f3d x:0 0 0 2024-09-18T12:52:01.287 INFO:tasks.workunit.client.1.smithi161.stdout:4/282: mknod d5/d27/c59 0 2024-09-18T12:52:01.287 INFO:tasks.workunit.client.1.smithi161.stdout:6/271: read d4/f10 [450525,128251] 0 2024-09-18T12:52:01.287 INFO:tasks.workunit.client.1.smithi161.stdout:2/283: creat d0/d1/d3b/f61 x:0 0 0 2024-09-18T12:52:01.288 INFO:tasks.workunit.client.1.smithi161.stdout:7/240: creat d3/d8/d15/d1a/d24/d31/f34 x:0 0 0 2024-09-18T12:52:01.290 INFO:tasks.workunit.client.0.smithi045.stdout:5/187: rename d6/df to d6/d3e 0 2024-09-18T12:52:01.294 INFO:tasks.workunit.client.1.smithi161.stdout:4/283: creat d5/d27/d44/f5a x:0 0 0 2024-09-18T12:52:01.294 INFO:tasks.workunit.client.1.smithi161.stdout:9/226: dwrite d0/d16/d25/d28/f38 [0,4194304] 0 2024-09-18T12:52:01.294 INFO:tasks.workunit.client.1.smithi161.stdout:5/229: dread d3/d14/f19 [0,4194304] 0 2024-09-18T12:52:01.295 INFO:tasks.workunit.client.0.smithi045.stdout:5/188: creat d6/d3e/f3f x:0 0 0 2024-09-18T12:52:01.295 INFO:tasks.workunit.client.0.smithi045.stdout:5/189: truncate d6/d2a/f25 246414 0 2024-09-18T12:52:01.299 INFO:tasks.workunit.client.1.smithi161.stdout:2/284: creat d0/d4/f62 x:0 0 0 2024-09-18T12:52:01.299 INFO:tasks.workunit.client.1.smithi161.stdout:3/325: dwrite d1/d2e/d14/d65/f6a [0,4194304] 0 2024-09-18T12:52:01.299 INFO:tasks.workunit.client.1.smithi161.stdout:4/284: write d5/f17 [2457651,84593] 0 2024-09-18T12:52:01.299 INFO:tasks.workunit.client.1.smithi161.stdout:6/272: mknod d4/d39/d26/d31/c54 0 2024-09-18T12:52:01.303 INFO:tasks.workunit.client.1.smithi161.stdout:7/241: dwrite d3/d8/d15/d1a/f22 [0,4194304] 0 2024-09-18T12:52:01.311 INFO:tasks.workunit.client.1.smithi161.stdout:5/230: rmdir d3/d9 39 2024-09-18T12:52:01.311 INFO:tasks.workunit.client.1.smithi161.stdout:9/227: mknod d0/d16/d25/d28/c4d 0 2024-09-18T12:52:01.313 INFO:tasks.workunit.client.1.smithi161.stdout:8/327: dread d0/d3/d10/d21/f3a [0,4194304] 0 2024-09-18T12:52:01.315 INFO:tasks.workunit.client.1.smithi161.stdout:2/285: stat d0/d1/c19 0 2024-09-18T12:52:01.316 INFO:tasks.workunit.client.1.smithi161.stdout:6/273: rename d4/d39/d26/d20/f2a to d4/d39/d26/f55 0 2024-09-18T12:52:01.319 INFO:tasks.workunit.client.1.smithi161.stdout:1/203: link d1/fc d1/da/d31/f3e 0 2024-09-18T12:52:01.319 INFO:tasks.workunit.client.1.smithi161.stdout:6/274: chown d4/d39/d26/f55 444 1 2024-09-18T12:52:01.321 INFO:tasks.workunit.client.1.smithi161.stdout:5/231: fsync d3/f40 0 2024-09-18T12:52:01.321 INFO:tasks.workunit.client.1.smithi161.stdout:9/228: dwrite d0/d16/d25/d28/f3f [0,4194304] 0 2024-09-18T12:52:01.321 INFO:tasks.workunit.client.1.smithi161.stdout:8/328: fsync d0/d3/d10/d21/f3a 0 2024-09-18T12:52:01.323 INFO:tasks.workunit.client.1.smithi161.stdout:9/229: truncate d0/f42 657764 0 2024-09-18T12:52:01.323 INFO:tasks.workunit.client.0.smithi045.stdout:5/190: truncate d6/d3e/f35 361949 0 2024-09-18T12:52:01.324 INFO:tasks.workunit.client.0.smithi045.stdout:5/191: fsync d6/d3e/f23 0 2024-09-18T12:52:01.329 INFO:tasks.workunit.client.1.smithi161.stdout:1/204: dread - d1/da/d1f/f2c zero size 2024-09-18T12:52:01.329 INFO:tasks.workunit.client.0.smithi045.stdout:5/192: fdatasync d6/d3e/f26 0 2024-09-18T12:52:01.330 INFO:tasks.workunit.client.0.smithi045.stdout:5/193: dread - d6/d28/d2b/f3d zero size 2024-09-18T12:52:01.331 INFO:tasks.workunit.client.1.smithi161.stdout:8/329: dwrite d0/d3/d1e/d34/f25 [0,4194304] 0 2024-09-18T12:52:01.336 INFO:tasks.workunit.client.1.smithi161.stdout:7/242: dread d3/f7 [4194304,4194304] 0 2024-09-18T12:52:01.337 INFO:tasks.workunit.client.1.smithi161.stdout:9/230: mknod d0/d16/d25/d28/d45/c4e 0 2024-09-18T12:52:01.337 INFO:tasks.workunit.client.1.smithi161.stdout:3/326: dread d1/d2e/f4b [0,4194304] 0 2024-09-18T12:52:01.337 INFO:tasks.workunit.client.1.smithi161.stdout:7/243: stat d3/d8 0 2024-09-18T12:52:01.338 INFO:tasks.workunit.client.0.smithi045.stdout:5/194: mknod d6/d3e/c40 0 2024-09-18T12:52:01.343 INFO:tasks.workunit.client.1.smithi161.stdout:4/285: rename d5/d32/d39/d4d/l4f to d5/d14/l5b 0 2024-09-18T12:52:01.346 INFO:tasks.workunit.client.0.smithi045.stdout:5/195: mknod d6/d3e/c41 0 2024-09-18T12:52:01.346 INFO:tasks.workunit.client.1.smithi161.stdout:2/286: write d0/d5/d43/d35/f3e [120476,47456] 0 2024-09-18T12:52:01.347 INFO:tasks.workunit.client.1.smithi161.stdout:6/275: creat d4/d39/d48/f56 x:0 0 0 2024-09-18T12:52:01.348 INFO:tasks.workunit.client.1.smithi161.stdout:6/276: dread - d4/d39/d48/f56 zero size 2024-09-18T12:52:01.349 INFO:tasks.workunit.client.0.smithi045.stdout:5/196: fdatasync d6/db/f2c 0 2024-09-18T12:52:01.349 INFO:tasks.workunit.client.1.smithi161.stdout:1/205: truncate d1/da/f16 1622513 0 2024-09-18T12:52:01.351 INFO:tasks.workunit.client.1.smithi161.stdout:5/232: mkdir d3/d9/d4b 0 2024-09-18T12:52:01.353 INFO:tasks.workunit.client.1.smithi161.stdout:8/330: readlink d0/d3/d10/d21/l65 0 2024-09-18T12:52:01.354 INFO:tasks.workunit.client.1.smithi161.stdout:0/253: sync 2024-09-18T12:52:01.355 INFO:tasks.workunit.client.0.smithi045.stdout:5/197: dwrite d6/db/f2c [0,4194304] 0 2024-09-18T12:52:01.355 INFO:tasks.workunit.client.0.smithi045.stdout:5/198: stat d6/la 0 2024-09-18T12:52:01.357 INFO:tasks.workunit.client.1.smithi161.stdout:9/231: symlink d0/db/d18/l4f 0 2024-09-18T12:52:01.357 INFO:tasks.workunit.client.1.smithi161.stdout:6/277: dwrite d4/d39/d3a/f1f [0,4194304] 0 2024-09-18T12:52:01.359 INFO:tasks.workunit.client.0.smithi045.stdout:5/199: mknod d6/db/d19/d31/c42 0 2024-09-18T12:52:01.360 INFO:tasks.workunit.client.1.smithi161.stdout:4/286: symlink d5/d27/l5c 0 2024-09-18T12:52:01.360 INFO:tasks.workunit.client.0.smithi045.stdout:5/200: chown d6/l21 60459599 1 2024-09-18T12:52:01.360 INFO:tasks.workunit.client.1.smithi161.stdout:1/206: creat d1/d26/f3f x:0 0 0 2024-09-18T12:52:01.361 INFO:tasks.workunit.client.0.smithi045.stdout:5/201: dread - d6/d3e/f33 zero size 2024-09-18T12:52:01.361 INFO:tasks.workunit.client.0.smithi045.stdout:5/202: fsync d6/d2a/f25 0 2024-09-18T12:52:01.361 INFO:tasks.workunit.client.1.smithi161.stdout:6/278: stat d4/d39/d46 0 2024-09-18T12:52:01.362 INFO:tasks.workunit.client.0.smithi045.stdout:5/203: readlink d6/d2a/l1b 0 2024-09-18T12:52:01.362 INFO:tasks.workunit.client.0.smithi045.stdout:5/204: readlink d6/d28/l2e 0 2024-09-18T12:52:01.363 INFO:tasks.workunit.client.1.smithi161.stdout:0/254: write df/d29/d2d/d37/f48 [189907,127871] 0 2024-09-18T12:52:01.365 INFO:tasks.workunit.client.1.smithi161.stdout:1/207: stat d1/da/d1f/f2c 0 2024-09-18T12:52:01.367 INFO:tasks.workunit.client.1.smithi161.stdout:8/331: link d0/d3/d10/d21/f30 d0/d3/d10/f6c 0 2024-09-18T12:52:01.368 INFO:tasks.workunit.client.1.smithi161.stdout:5/233: dwrite d3/d14/d20/f3e [0,4194304] 0 2024-09-18T12:52:01.370 INFO:tasks.workunit.client.1.smithi161.stdout:7/244: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:52:01.371 INFO:tasks.workunit.client.0.smithi045.stdout:5/205: dwrite d6/d3e/f23 [0,4194304] 0 2024-09-18T12:52:01.379 INFO:tasks.workunit.client.0.smithi045.stdout:5/206: rename d6/d28/d2b/f3d to d6/db/f43 0 2024-09-18T12:52:01.380 INFO:tasks.workunit.client.0.smithi045.stdout:5/207: chown d6/db/d19/c1a 3 1 2024-09-18T12:52:01.382 INFO:tasks.workunit.client.0.smithi045.stdout:5/208: truncate d6/d2a/f25 1086920 0 2024-09-18T12:52:01.383 INFO:tasks.workunit.client.1.smithi161.stdout:4/287: symlink d5/d27/d3a/d47/l5d 0 2024-09-18T12:52:01.388 INFO:tasks.workunit.client.1.smithi161.stdout:3/327: write d1/f12 [1439200,130215] 0 2024-09-18T12:52:01.391 INFO:tasks.workunit.client.0.smithi045.stdout:5/209: truncate d6/d3e/f26 1402981 0 2024-09-18T12:52:01.391 INFO:tasks.workunit.client.0.smithi045.stdout:5/210: stat d6/d3e/c27 0 2024-09-18T12:52:01.392 INFO:tasks.workunit.client.1.smithi161.stdout:9/232: creat d0/db/f50 x:0 0 0 2024-09-18T12:52:01.392 INFO:tasks.workunit.client.1.smithi161.stdout:2/287: dread d0/f13 [0,4194304] 0 2024-09-18T12:52:01.394 INFO:tasks.workunit.client.1.smithi161.stdout:6/279: symlink d4/d39/d46/l57 0 2024-09-18T12:52:01.396 INFO:tasks.workunit.client.0.smithi045.stdout:5/211: dread d6/db/fe [0,4194304] 0 2024-09-18T12:52:01.396 INFO:tasks.workunit.client.1.smithi161.stdout:3/328: write d1/d2e/d14/f44 [119029,15826] 0 2024-09-18T12:52:01.398 INFO:tasks.workunit.client.1.smithi161.stdout:8/332: dwrite d0/d3/d10/d21/d4a/d52/f58 [0,4194304] 0 2024-09-18T12:52:01.399 INFO:tasks.workunit.client.1.smithi161.stdout:0/255: link df/l1d df/d30/l59 0 2024-09-18T12:52:01.399 INFO:tasks.workunit.client.1.smithi161.stdout:7/245: dwrite d3/f23 [0,4194304] 0 2024-09-18T12:52:01.399 INFO:tasks.workunit.client.1.smithi161.stdout:5/234: dwrite d3/d9/f34 [0,4194304] 0 2024-09-18T12:52:01.401 INFO:tasks.workunit.client.1.smithi161.stdout:6/280: dread - d4/d39/d47/d51/f52 zero size 2024-09-18T12:52:01.401 INFO:tasks.workunit.client.1.smithi161.stdout:2/288: write d0/d4/f2a [849301,38600] 0 2024-09-18T12:52:01.402 INFO:tasks.workunit.client.1.smithi161.stdout:7/246: chown d3/d8/d15/d1a 293 1 2024-09-18T12:52:01.404 INFO:tasks.workunit.client.1.smithi161.stdout:2/289: fsync d0/f41 0 2024-09-18T12:52:01.405 INFO:tasks.workunit.client.1.smithi161.stdout:8/333: fsync d0/d3/d10/f57 0 2024-09-18T12:52:01.406 INFO:tasks.workunit.client.1.smithi161.stdout:0/256: truncate df/d29/f53 2263344 0 2024-09-18T12:52:01.407 INFO:tasks.workunit.client.1.smithi161.stdout:3/329: chown d1/d2e/d24/f45 9911683 1 2024-09-18T12:52:01.410 INFO:tasks.workunit.client.1.smithi161.stdout:3/330: chown d1/d2e/d3d/d53/l63 905 1 2024-09-18T12:52:01.411 INFO:tasks.workunit.client.1.smithi161.stdout:8/334: read d0/d3/d1e/d34/f64 [100251,38808] 0 2024-09-18T12:52:01.416 INFO:tasks.workunit.client.1.smithi161.stdout:2/290: readlink d0/d4/l4e 0 2024-09-18T12:52:01.418 INFO:tasks.workunit.client.1.smithi161.stdout:7/247: symlink d3/l35 0 2024-09-18T12:52:01.420 INFO:tasks.workunit.client.1.smithi161.stdout:0/257: dwrite df/d29/d2d/d37/f48 [0,4194304] 0 2024-09-18T12:52:01.423 INFO:tasks.workunit.client.1.smithi161.stdout:3/331: dwrite d1/f19 [0,4194304] 0 2024-09-18T12:52:01.423 INFO:tasks.workunit.client.1.smithi161.stdout:9/233: link d0/d20/d49/c43 d0/d16/c51 0 2024-09-18T12:52:01.423 INFO:tasks.workunit.client.0.smithi045.stdout:5/212: write d6/d3e/f35 [1347147,26544] 0 2024-09-18T12:52:01.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/332: chown d1/d2e/d14/d2c/f33 378 1 2024-09-18T12:52:01.425 INFO:tasks.workunit.client.1.smithi161.stdout:9/234: write d0/db/d18/f36 [803163,72324] 0 2024-09-18T12:52:01.426 INFO:tasks.workunit.client.1.smithi161.stdout:6/281: dread d4/d1a/d1c/f24 [0,4194304] 0 2024-09-18T12:52:01.426 INFO:tasks.workunit.client.1.smithi161.stdout:5/235: fdatasync d3/d9/f34 0 2024-09-18T12:52:01.427 INFO:tasks.workunit.client.1.smithi161.stdout:2/291: mknod d0/d5/d43/d23/c63 0 2024-09-18T12:52:01.428 INFO:tasks.workunit.client.1.smithi161.stdout:2/292: dread - d0/d4/d52/f59 zero size 2024-09-18T12:52:01.430 INFO:tasks.workunit.client.0.smithi045.stdout:5/213: creat d6/db/d19/d31/f44 x:0 0 0 2024-09-18T12:52:01.439 INFO:tasks.workunit.client.1.smithi161.stdout:7/248: write d3/f11 [434480,114683] 0 2024-09-18T12:52:01.440 INFO:tasks.workunit.client.1.smithi161.stdout:2/293: dwrite d0/d5/d43/f45 [0,4194304] 0 2024-09-18T12:52:01.440 INFO:tasks.workunit.client.1.smithi161.stdout:7/249: stat d3/d8/l1f 0 2024-09-18T12:52:01.440 INFO:tasks.workunit.client.0.smithi045.stdout:5/214: creat d6/db/d19/d31/f45 x:0 0 0 2024-09-18T12:52:01.440 INFO:tasks.workunit.client.0.smithi045.stdout:5/215: chown d6/db/d19 9779 1 2024-09-18T12:52:01.442 INFO:tasks.workunit.client.1.smithi161.stdout:0/258: write df/f26 [743412,19219] 0 2024-09-18T12:52:01.444 INFO:tasks.workunit.client.1.smithi161.stdout:0/259: readlink df/l2a 0 2024-09-18T12:52:01.444 INFO:tasks.workunit.client.0.smithi045.stdout:5/216: mknod d6/d28/d2b/c46 0 2024-09-18T12:52:01.448 INFO:tasks.workunit.client.1.smithi161.stdout:8/335: rename d0/d3/d10/d21/l65 to d0/d3/l6d 0 2024-09-18T12:52:01.448 INFO:tasks.workunit.client.1.smithi161.stdout:7/250: mkdir d3/d36 0 2024-09-18T12:52:01.449 INFO:tasks.workunit.client.1.smithi161.stdout:2/294: creat d0/d1/d3b/d3d/f64 x:0 0 0 2024-09-18T12:52:01.449 INFO:tasks.workunit.client.1.smithi161.stdout:9/235: symlink d0/d16/l52 0 2024-09-18T12:52:01.453 INFO:tasks.workunit.client.1.smithi161.stdout:0/260: dwrite df/d29/f3b [0,4194304] 0 2024-09-18T12:52:01.453 INFO:tasks.workunit.client.1.smithi161.stdout:8/336: dread d0/d3/d10/d21/f37 [0,4194304] 0 2024-09-18T12:52:01.454 INFO:tasks.workunit.client.1.smithi161.stdout:5/236: rename d3/d9/d47 to d3/d14/d4c 0 2024-09-18T12:52:01.454 INFO:tasks.workunit.client.1.smithi161.stdout:7/251: rmdir d3/d8/d15/d1a 39 2024-09-18T12:52:01.456 INFO:tasks.workunit.client.1.smithi161.stdout:7/252: write d3/f23 [4134647,11113] 0 2024-09-18T12:52:01.457 INFO:tasks.workunit.client.1.smithi161.stdout:2/295: symlink d0/d1/d3b/d3d/l65 0 2024-09-18T12:52:01.457 INFO:tasks.workunit.client.1.smithi161.stdout:7/253: write d3/d8/f29 [3538302,75139] 0 2024-09-18T12:52:01.458 INFO:tasks.workunit.client.0.smithi045.stdout:5/217: fsync d6/db/d19/d31/f45 0 2024-09-18T12:52:01.458 INFO:tasks.workunit.client.1.smithi161.stdout:2/296: dread - d0/d5/d43/d35/f44 zero size 2024-09-18T12:52:01.459 INFO:tasks.workunit.client.1.smithi161.stdout:7/254: write d3/f19 [5874078,13688] 0 2024-09-18T12:52:01.460 INFO:tasks.workunit.client.1.smithi161.stdout:2/297: chown d0/d1/df/l46 1 1 2024-09-18T12:52:01.460 INFO:tasks.workunit.client.1.smithi161.stdout:7/255: write d3/d8/f29 [3164300,95469] 0 2024-09-18T12:52:01.461 INFO:tasks.workunit.client.0.smithi045.stdout:2/56: sync 2024-09-18T12:52:01.461 INFO:tasks.workunit.client.1.smithi161.stdout:7/256: chown d3/f11 3383930 1 2024-09-18T12:52:01.462 INFO:tasks.workunit.client.0.smithi045.stdout:2/57: write d5/f11 [727761,31602] 0 2024-09-18T12:52:01.463 INFO:tasks.workunit.client.1.smithi161.stdout:6/282: getdents d4/d39/d26/d20 0 2024-09-18T12:52:01.464 INFO:tasks.workunit.client.1.smithi161.stdout:6/283: truncate d4/d39/d26/f55 4714595 0 2024-09-18T12:52:01.465 INFO:tasks.workunit.client.0.smithi045.stdout:5/218: mknod d6/db/d19/c47 0 2024-09-18T12:52:01.469 INFO:tasks.workunit.client.0.smithi045.stdout:2/58: rename d5/l10 to d5/de/d16/l17 0 2024-09-18T12:52:01.469 INFO:tasks.workunit.client.0.smithi045.stdout:2/59: fsync d5/fd 0 2024-09-18T12:52:01.471 INFO:tasks.workunit.client.0.smithi045.stdout:5/219: rmdir d6 39 2024-09-18T12:52:01.475 INFO:tasks.workunit.client.0.smithi045.stdout:2/60: rename c2 to d5/de/c18 0 2024-09-18T12:52:01.476 INFO:tasks.workunit.client.0.smithi045.stdout:2/61: dread - d5/f8 zero size 2024-09-18T12:52:01.477 INFO:tasks.workunit.client.1.smithi161.stdout:0/261: symlink df/l5a 0 2024-09-18T12:52:01.481 INFO:tasks.workunit.client.0.smithi045.stdout:5/220: write d6/db/f2c [82200,6881] 0 2024-09-18T12:52:01.483 INFO:tasks.workunit.client.0.smithi045.stdout:2/62: dwrite d5/fd [0,4194304] 0 2024-09-18T12:52:01.484 INFO:tasks.workunit.client.1.smithi161.stdout:5/237: dwrite d3/fd [0,4194304] 0 2024-09-18T12:52:01.487 INFO:tasks.workunit.client.0.smithi045.stdout:2/63: dread d5/de/ff [0,4194304] 0 2024-09-18T12:52:01.489 INFO:tasks.workunit.client.1.smithi161.stdout:6/284: write d4/d39/d26/f55 [594149,27972] 0 2024-09-18T12:52:01.491 INFO:tasks.workunit.client.0.smithi045.stdout:5/221: rename d6/l21 to d6/db/l48 0 2024-09-18T12:52:01.497 INFO:tasks.workunit.client.0.smithi045.stdout:2/64: rename d5/l15 to d5/de/d16/l19 0 2024-09-18T12:52:01.498 INFO:tasks.workunit.client.1.smithi161.stdout:0/262: creat df/d29/d36/f5b x:0 0 0 2024-09-18T12:52:01.499 INFO:tasks.workunit.client.1.smithi161.stdout:0/263: write df/f26 [3770911,99916] 0 2024-09-18T12:52:01.499 INFO:tasks.workunit.client.0.smithi045.stdout:5/222: write d6/d3e/f3a [1307746,32271] 0 2024-09-18T12:52:01.500 INFO:tasks.workunit.client.0.smithi045.stdout:5/223: write d6/d3e/f36 [932448,63181] 0 2024-09-18T12:52:01.501 INFO:tasks.workunit.client.1.smithi161.stdout:2/298: rename d0/d5/l2c to d0/d1/d3b/d58/l66 0 2024-09-18T12:52:01.502 INFO:tasks.workunit.client.1.smithi161.stdout:8/337: truncate d0/d3/d1e/f46 603881 0 2024-09-18T12:52:01.503 INFO:tasks.workunit.client.0.smithi045.stdout:2/65: unlink d5/fb 0 2024-09-18T12:52:01.506 INFO:tasks.workunit.client.0.smithi045.stdout:5/224: unlink d6/db/d19/d31/f44 0 2024-09-18T12:52:01.506 INFO:tasks.workunit.client.1.smithi161.stdout:6/285: symlink d4/d39/d26/d20/d28/l58 0 2024-09-18T12:52:01.507 INFO:tasks.workunit.client.1.smithi161.stdout:6/286: chown d4/d1a/l38 1560607 1 2024-09-18T12:52:01.508 INFO:tasks.workunit.client.1.smithi161.stdout:0/264: symlink df/d29/l5c 0 2024-09-18T12:52:01.509 INFO:tasks.workunit.client.0.smithi045.stdout:5/225: symlink d6/db/d19/l49 0 2024-09-18T12:52:01.510 INFO:tasks.workunit.client.0.smithi045.stdout:2/66: symlink d5/l1a 0 2024-09-18T12:52:01.511 INFO:tasks.workunit.client.1.smithi161.stdout:8/338: mkdir d0/d3/d10/d21/d4a/d52/d66/d5b/d6e 0 2024-09-18T12:52:01.511 INFO:tasks.workunit.client.1.smithi161.stdout:6/287: dread d4/d39/d3a/f1f [0,4194304] 0 2024-09-18T12:52:01.511 INFO:tasks.workunit.client.1.smithi161.stdout:5/238: creat d3/d9/d4b/f4d x:0 0 0 2024-09-18T12:52:01.511 INFO:tasks.workunit.client.1.smithi161.stdout:7/257: link d3/d8/d20/c25 d3/d36/c37 0 2024-09-18T12:52:01.512 INFO:tasks.workunit.client.1.smithi161.stdout:6/288: chown d4/d39/d26/d20/d45 31343 1 2024-09-18T12:52:01.513 INFO:tasks.workunit.client.0.smithi045.stdout:2/67: unlink d5/f11 0 2024-09-18T12:52:01.514 INFO:tasks.workunit.client.1.smithi161.stdout:0/265: mknod df/d29/c5d 0 2024-09-18T12:52:01.516 INFO:tasks.workunit.client.1.smithi161.stdout:2/299: dwrite d0/d1/f3f [0,4194304] 0 2024-09-18T12:52:01.517 INFO:tasks.workunit.client.1.smithi161.stdout:0/266: chown df/d30/d4d/c4e 1 1 2024-09-18T12:52:01.518 INFO:tasks.workunit.client.0.smithi045.stdout:5/226: dwrite d6/d28/d2b/f2d [0,4194304] 0 2024-09-18T12:52:01.519 INFO:tasks.workunit.client.1.smithi161.stdout:2/300: dread - d0/d1/d4c/f55 zero size 2024-09-18T12:52:01.519 INFO:tasks.workunit.client.0.smithi045.stdout:2/68: dread d5/f9 [0,4194304] 0 2024-09-18T12:52:01.520 INFO:tasks.workunit.client.0.smithi045.stdout:2/69: truncate d5/de/f13 88178 0 2024-09-18T12:52:01.521 INFO:tasks.workunit.client.0.smithi045.stdout:2/70: dread - d5/f8 zero size 2024-09-18T12:52:01.521 INFO:tasks.workunit.client.1.smithi161.stdout:0/267: dread - df/d29/d36/f57 zero size 2024-09-18T12:52:01.521 INFO:tasks.workunit.client.0.smithi045.stdout:2/71: write d5/f12 [125577,26054] 0 2024-09-18T12:52:01.522 INFO:tasks.workunit.client.1.smithi161.stdout:6/289: link d4/d1a/f1b d4/d39/d26/d31/f59 0 2024-09-18T12:52:01.523 INFO:tasks.workunit.client.1.smithi161.stdout:5/239: dread d3/d14/f1b [0,4194304] 0 2024-09-18T12:52:01.525 INFO:tasks.workunit.client.1.smithi161.stdout:5/240: read d3/d9/f2d [77994,25391] 0 2024-09-18T12:52:01.526 INFO:tasks.workunit.client.0.smithi045.stdout:2/72: creat d5/de/f1b x:0 0 0 2024-09-18T12:52:01.527 INFO:tasks.workunit.client.0.smithi045.stdout:2/73: truncate d5/de/f1b 456143 0 2024-09-18T12:52:01.529 INFO:tasks.workunit.client.1.smithi161.stdout:8/339: dwrite d0/f12 [0,4194304] 0 2024-09-18T12:52:01.529 INFO:tasks.workunit.client.1.smithi161.stdout:2/301: mkdir d0/d1/d4c/d67 0 2024-09-18T12:52:01.530 INFO:tasks.workunit.client.0.smithi045.stdout:5/227: mknod d6/c4a 0 2024-09-18T12:52:01.533 INFO:tasks.workunit.client.1.smithi161.stdout:7/258: rename d3/d8/d20 to d3/d8/d15/d38 0 2024-09-18T12:52:01.533 INFO:tasks.workunit.client.0.smithi045.stdout:2/74: dread d5/de/ff [0,4194304] 0 2024-09-18T12:52:01.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/302: dread d0/d1/d3b/f42 [0,4194304] 0 2024-09-18T12:52:01.536 INFO:tasks.workunit.client.0.smithi045.stdout:2/75: truncate d5/f8 388584 0 2024-09-18T12:52:01.537 INFO:tasks.workunit.client.0.smithi045.stdout:5/228: dread d6/d3e/f23 [0,4194304] 0 2024-09-18T12:52:01.539 INFO:tasks.workunit.client.0.smithi045.stdout:5/229: write d6/d2a/f25 [996237,82659] 0 2024-09-18T12:52:01.540 INFO:tasks.workunit.client.1.smithi161.stdout:2/303: dread d0/f13 [0,4194304] 0 2024-09-18T12:52:01.541 INFO:tasks.workunit.client.1.smithi161.stdout:1/208: sync 2024-09-18T12:52:01.542 INFO:tasks.workunit.client.1.smithi161.stdout:6/290: mknod d4/d39/d26/d20/c5a 0 2024-09-18T12:52:01.543 INFO:tasks.workunit.client.0.smithi045.stdout:3/103: sync 2024-09-18T12:52:01.543 INFO:tasks.workunit.client.0.smithi045.stdout:6/133: sync 2024-09-18T12:52:01.544 INFO:tasks.workunit.client.0.smithi045.stdout:6/134: stat f5 0 2024-09-18T12:52:01.549 INFO:tasks.workunit.client.1.smithi161.stdout:5/241: dread d3/d9/f1c [0,4194304] 0 2024-09-18T12:52:01.550 INFO:tasks.workunit.client.1.smithi161.stdout:8/340: mkdir d0/d3/d5f/d6f 0 2024-09-18T12:52:01.554 INFO:tasks.workunit.client.1.smithi161.stdout:2/304: creat d0/d4/f68 x:0 0 0 2024-09-18T12:52:01.555 INFO:tasks.workunit.client.1.smithi161.stdout:7/259: dread d3/f17 [0,4194304] 0 2024-09-18T12:52:01.556 INFO:tasks.workunit.client.1.smithi161.stdout:7/260: write d3/f19 [1551356,110419] 0 2024-09-18T12:52:01.556 INFO:tasks.workunit.client.0.smithi045.stdout:3/104: mknod d0/d7/c20 0 2024-09-18T12:52:01.557 INFO:tasks.workunit.client.1.smithi161.stdout:6/291: fsync d4/d1a/f11 0 2024-09-18T12:52:01.559 INFO:tasks.workunit.client.1.smithi161.stdout:0/268: symlink df/d29/d2d/d37/d55/l5e 0 2024-09-18T12:52:01.559 INFO:tasks.workunit.client.1.smithi161.stdout:0/269: fdatasync df/f50 0 2024-09-18T12:52:01.561 INFO:tasks.workunit.client.1.smithi161.stdout:2/305: dwrite d0/d4/d52/f60 [0,4194304] 0 2024-09-18T12:52:01.563 INFO:tasks.workunit.client.1.smithi161.stdout:5/242: rmdir d3/d44 39 2024-09-18T12:52:01.565 INFO:tasks.workunit.client.1.smithi161.stdout:8/341: mkdir d0/d3/d10/d21/d4a/d52/d70 0 2024-09-18T12:52:01.571 INFO:tasks.workunit.client.0.smithi045.stdout:2/76: rename d5/de/d16/l19 to d5/l1c 0 2024-09-18T12:52:01.572 INFO:tasks.workunit.client.0.smithi045.stdout:2/77: dread d5/f8 [0,4194304] 0 2024-09-18T12:52:01.573 INFO:tasks.workunit.client.0.smithi045.stdout:3/105: symlink d0/d1e/l21 0 2024-09-18T12:52:01.573 INFO:tasks.workunit.client.0.smithi045.stdout:2/78: fsync d5/de/f13 0 2024-09-18T12:52:01.574 INFO:tasks.workunit.client.0.smithi045.stdout:2/79: chown d5/de/c14 1624196648 1 2024-09-18T12:52:01.576 INFO:tasks.workunit.client.0.smithi045.stdout:5/230: rename d6/d3e/c40 to d6/d2a/c4b 0 2024-09-18T12:52:01.577 INFO:tasks.workunit.client.1.smithi161.stdout:8/342: dread d0/d3/d10/d21/f48 [0,4194304] 0 2024-09-18T12:52:01.579 INFO:tasks.workunit.client.1.smithi161.stdout:6/292: creat d4/d39/d26/d31/f5b x:0 0 0 2024-09-18T12:52:01.579 INFO:tasks.workunit.client.1.smithi161.stdout:6/293: chown d4/d39/d48/f56 85 1 2024-09-18T12:52:01.581 INFO:tasks.workunit.client.1.smithi161.stdout:0/270: creat df/d29/d46/f5f x:0 0 0 2024-09-18T12:52:01.581 INFO:tasks.workunit.client.0.smithi045.stdout:2/80: dwrite d5/f9 [0,4194304] 0 2024-09-18T12:52:01.582 INFO:tasks.workunit.client.0.smithi045.stdout:2/81: readlink d5/l1a 0 2024-09-18T12:52:01.583 INFO:tasks.workunit.client.0.smithi045.stdout:6/135: truncate d9/f2b 209740 0 2024-09-18T12:52:01.585 INFO:tasks.workunit.client.0.smithi045.stdout:5/231: stat d6/f7 0 2024-09-18T12:52:01.588 INFO:tasks.workunit.client.1.smithi161.stdout:2/306: mknod d0/d1/d3b/d3d/c69 0 2024-09-18T12:52:01.588 INFO:tasks.workunit.client.1.smithi161.stdout:3/333: sync 2024-09-18T12:52:01.588 INFO:tasks.workunit.client.1.smithi161.stdout:4/288: sync 2024-09-18T12:52:01.590 INFO:tasks.workunit.client.0.smithi045.stdout:2/82: dwrite d5/f9 [0,4194304] 0 2024-09-18T12:52:01.592 INFO:tasks.workunit.client.0.smithi045.stdout:2/83: truncate d5/fd 4845896 0 2024-09-18T12:52:01.596 INFO:tasks.workunit.client.1.smithi161.stdout:7/261: creat d3/d8/d15/d1a/f39 x:0 0 0 2024-09-18T12:52:01.597 INFO:tasks.workunit.client.1.smithi161.stdout:7/262: read d3/f2e [620748,7301] 0 2024-09-18T12:52:01.597 INFO:tasks.workunit.client.0.smithi045.stdout:0/57: sync 2024-09-18T12:52:01.597 INFO:tasks.workunit.client.0.smithi045.stdout:8/58: sync 2024-09-18T12:52:01.597 INFO:tasks.workunit.client.0.smithi045.stdout:4/112: sync 2024-09-18T12:52:01.598 INFO:tasks.workunit.client.1.smithi161.stdout:8/343: creat d0/d3/d10/d21/d4a/d52/d66/f71 x:0 0 0 2024-09-18T12:52:01.599 INFO:tasks.workunit.client.0.smithi045.stdout:5/232: rmdir d6/d2a 39 2024-09-18T12:52:01.599 INFO:tasks.workunit.client.1.smithi161.stdout:6/294: symlink d4/d39/d3a/l5c 0 2024-09-18T12:52:01.602 INFO:tasks.workunit.client.1.smithi161.stdout:2/307: chown d0/d1/f2e 3820 1 2024-09-18T12:52:01.604 INFO:tasks.workunit.client.0.smithi045.stdout:8/59: creat d11/f13 x:0 0 0 2024-09-18T12:52:01.605 INFO:tasks.workunit.client.0.smithi045.stdout:4/113: mknod db/d10/c29 0 2024-09-18T12:52:01.606 INFO:tasks.workunit.client.1.smithi161.stdout:4/289: rename d5/d27/d3a/d47/l5d to d5/l5e 0 2024-09-18T12:52:01.607 INFO:tasks.workunit.client.0.smithi045.stdout:6/136: dwrite d9/f18 [0,4194304] 0 2024-09-18T12:52:01.607 INFO:tasks.workunit.client.1.smithi161.stdout:2/308: dwrite d0/d1/d3b/d3d/f5d [0,4194304] 0 2024-09-18T12:52:01.608 INFO:tasks.workunit.client.1.smithi161.stdout:2/309: write d0/d1/d3b/d3d/f64 [479358,89219] 0 2024-09-18T12:52:01.609 INFO:tasks.workunit.client.1.smithi161.stdout:2/310: rename d0/d1 to d0/d1/d3b/d58/d6a 22 2024-09-18T12:52:01.610 INFO:tasks.workunit.client.0.smithi045.stdout:3/106: getdents d0 0 2024-09-18T12:52:01.610 INFO:tasks.workunit.client.0.smithi045.stdout:4/114: write db/d1b/f23 [357578,101496] 0 2024-09-18T12:52:01.610 INFO:tasks.workunit.client.0.smithi045.stdout:0/58: dread f4 [0,4194304] 0 2024-09-18T12:52:01.611 INFO:tasks.workunit.client.1.smithi161.stdout:2/311: read d0/f13 [4578212,51041] 0 2024-09-18T12:52:01.612 INFO:tasks.workunit.client.1.smithi161.stdout:2/312: write d0/d5/d43/f37 [931449,54550] 0 2024-09-18T12:52:01.616 INFO:tasks.workunit.client.0.smithi045.stdout:8/60: dwrite fa [0,4194304] 0 2024-09-18T12:52:01.618 INFO:tasks.workunit.client.0.smithi045.stdout:8/61: write d11/f13 [831766,39489] 0 2024-09-18T12:52:01.619 INFO:tasks.workunit.client.0.smithi045.stdout:2/84: truncate d5/f8 336876 0 2024-09-18T12:52:01.625 INFO:tasks.workunit.client.1.smithi161.stdout:8/344: fsync d0/d3/d10/f18 0 2024-09-18T12:52:01.627 INFO:tasks.workunit.client.1.smithi161.stdout:1/209: dwrite d1/da/d39/f37 [0,4194304] 0 2024-09-18T12:52:01.627 INFO:tasks.workunit.client.0.smithi045.stdout:3/107: mkdir d0/d22 0 2024-09-18T12:52:01.628 INFO:tasks.workunit.client.1.smithi161.stdout:6/295: symlink d4/d1a/d1c/d3e/l5d 0 2024-09-18T12:52:01.630 INFO:tasks.workunit.client.1.smithi161.stdout:9/236: sync 2024-09-18T12:52:01.631 INFO:tasks.workunit.client.0.smithi045.stdout:5/233: write d6/db/f12 [382348,108017] 0 2024-09-18T12:52:01.631 INFO:tasks.workunit.client.0.smithi045.stdout:4/115: symlink db/d10/l2a 0 2024-09-18T12:52:01.632 INFO:tasks.workunit.client.1.smithi161.stdout:7/263: dwrite d3/f17 [0,4194304] 0 2024-09-18T12:52:01.632 INFO:tasks.workunit.client.1.smithi161.stdout:9/237: chown d0/db/d18/l34 176067 1 2024-09-18T12:52:01.632 INFO:tasks.workunit.client.0.smithi045.stdout:4/116: dread - db/d1b/f25 zero size 2024-09-18T12:52:01.633 INFO:tasks.workunit.client.0.smithi045.stdout:8/62: mkdir d11/d14 0 2024-09-18T12:52:01.634 INFO:tasks.workunit.client.0.smithi045.stdout:8/63: chown lb 15752829 1 2024-09-18T12:52:01.635 INFO:tasks.workunit.client.1.smithi161.stdout:7/264: write d3/d8/d15/d1a/f22 [2050670,35145] 0 2024-09-18T12:52:01.636 INFO:tasks.workunit.client.1.smithi161.stdout:4/290: mkdir d5/d14/d5f 0 2024-09-18T12:52:01.639 INFO:tasks.workunit.client.1.smithi161.stdout:4/291: truncate d5/d27/d3a/d4c/f57 396997 0 2024-09-18T12:52:01.640 INFO:tasks.workunit.client.1.smithi161.stdout:0/271: truncate df/d30/d4d/f4f 190066 0 2024-09-18T12:52:01.640 INFO:tasks.workunit.client.1.smithi161.stdout:6/296: dwrite d4/d39/d3a/f3c [0,4194304] 0 2024-09-18T12:52:01.642 INFO:tasks.workunit.client.1.smithi161.stdout:0/272: read df/f28 [2620200,22760] 0 2024-09-18T12:52:01.643 INFO:tasks.workunit.client.1.smithi161.stdout:2/313: chown d0/d1/d3b/d58/l66 17 1 2024-09-18T12:52:01.647 INFO:tasks.workunit.client.1.smithi161.stdout:7/265: dwrite d3/d8/d15/d1a/f22 [0,4194304] 0 2024-09-18T12:52:01.647 INFO:tasks.workunit.client.1.smithi161.stdout:8/345: creat d0/d3/d5f/f72 x:0 0 0 2024-09-18T12:52:01.649 INFO:tasks.workunit.client.0.smithi045.stdout:6/137: getdents d9/d1a/d2d 0 2024-09-18T12:52:01.649 INFO:tasks.workunit.client.0.smithi045.stdout:3/108: dwrite d0/d7/f10 [0,4194304] 0 2024-09-18T12:52:01.650 INFO:tasks.workunit.client.0.smithi045.stdout:5/234: mkdir d6/d28/d4c 0 2024-09-18T12:52:01.653 INFO:tasks.workunit.client.0.smithi045.stdout:4/117: rename fa to db/d10/d13/f2b 0 2024-09-18T12:52:01.655 INFO:tasks.workunit.client.0.smithi045.stdout:8/64: fdatasync f0 0 2024-09-18T12:52:01.655 INFO:tasks.workunit.client.0.smithi045.stdout:8/65: readlink l10 0 2024-09-18T12:52:01.655 INFO:tasks.workunit.client.1.smithi161.stdout:3/334: creat d1/d2e/f6e x:0 0 0 2024-09-18T12:52:01.656 INFO:tasks.workunit.client.0.smithi045.stdout:2/85: mknod d5/c1d 0 2024-09-18T12:52:01.657 INFO:tasks.workunit.client.1.smithi161.stdout:7/266: chown d3/d8/d15/d1a/d24/d31/f34 1082 1 2024-09-18T12:52:01.659 INFO:tasks.workunit.client.1.smithi161.stdout:4/292: dwrite d5/d32/d39/f4e [0,4194304] 0 2024-09-18T12:52:01.659 INFO:tasks.workunit.client.1.smithi161.stdout:0/273: dread df/d29/f3b [0,4194304] 0 2024-09-18T12:52:01.660 INFO:tasks.workunit.client.1.smithi161.stdout:5/243: getdents d3/d14 0 2024-09-18T12:52:01.662 INFO:tasks.workunit.client.1.smithi161.stdout:2/314: dwrite d0/d5/d43/d35/f3e [0,4194304] 0 2024-09-18T12:52:01.664 INFO:tasks.workunit.client.0.smithi045.stdout:5/235: fdatasync d6/d2a/f18 0 2024-09-18T12:52:01.665 INFO:tasks.workunit.client.1.smithi161.stdout:4/293: write d5/f20 [4363213,117885] 0 2024-09-18T12:52:01.666 INFO:tasks.workunit.client.1.smithi161.stdout:6/297: symlink d4/d39/d46/l5e 0 2024-09-18T12:52:01.666 INFO:tasks.workunit.client.1.smithi161.stdout:7/267: truncate d3/f23 4995150 0 2024-09-18T12:52:01.671 INFO:tasks.workunit.client.1.smithi161.stdout:4/294: stat d5/f21 0 2024-09-18T12:52:01.673 INFO:tasks.workunit.client.1.smithi161.stdout:2/315: read d0/d5/d43/f18 [1940419,31972] 0 2024-09-18T12:52:01.674 INFO:tasks.workunit.client.1.smithi161.stdout:9/238: mkdir d0/d16/d25/d46/d53 0 2024-09-18T12:52:01.674 INFO:tasks.workunit.client.0.smithi045.stdout:5/236: symlink d6/d2a/l4d 0 2024-09-18T12:52:01.676 INFO:tasks.workunit.client.0.smithi045.stdout:4/118: mkdir db/d2c 0 2024-09-18T12:52:01.676 INFO:tasks.workunit.client.0.smithi045.stdout:4/119: fdatasync f9 0 2024-09-18T12:52:01.677 INFO:tasks.workunit.client.1.smithi161.stdout:0/274: dread df/d30/f3a [0,4194304] 0 2024-09-18T12:52:01.679 INFO:tasks.workunit.client.1.smithi161.stdout:1/210: dwrite d1/f5 [0,4194304] 0 2024-09-18T12:52:01.680 INFO:tasks.workunit.client.1.smithi161.stdout:0/275: truncate df/d29/d2d/f4c 1163793 0 2024-09-18T12:52:01.680 INFO:tasks.workunit.client.1.smithi161.stdout:5/244: creat d3/d14/f4e x:0 0 0 2024-09-18T12:52:01.681 INFO:tasks.workunit.client.1.smithi161.stdout:0/276: fdatasync df/f32 0 2024-09-18T12:52:01.681 INFO:tasks.workunit.client.1.smithi161.stdout:1/211: write f0 [2721147,49265] 0 2024-09-18T12:52:01.681 INFO:tasks.workunit.client.0.smithi045.stdout:2/86: mknod d5/c1e 0 2024-09-18T12:52:01.683 INFO:tasks.workunit.client.0.smithi045.stdout:3/109: creat d0/d7/f23 x:0 0 0 2024-09-18T12:52:01.685 INFO:tasks.workunit.client.0.smithi045.stdout:5/237: chown d6/d3e/l29 4848667 1 2024-09-18T12:52:01.690 INFO:tasks.workunit.client.0.smithi045.stdout:8/66: truncate fa 2271037 0 2024-09-18T12:52:01.693 INFO:tasks.workunit.client.0.smithi045.stdout:4/120: rename db/d10/d13/f14 to db/de/d1e/f2d 0 2024-09-18T12:52:01.697 INFO:tasks.workunit.client.0.smithi045.stdout:3/110: read d0/d7/f1d [25246,36728] 0 2024-09-18T12:52:01.697 INFO:tasks.workunit.client.0.smithi045.stdout:5/238: rmdir d6 39 2024-09-18T12:52:01.698 INFO:tasks.workunit.client.0.smithi045.stdout:8/67: symlink d11/l15 0 2024-09-18T12:52:01.701 INFO:tasks.workunit.client.0.smithi045.stdout:3/111: write d0/f16 [73523,70255] 0 2024-09-18T12:52:01.704 INFO:tasks.workunit.client.0.smithi045.stdout:4/121: dwrite f9 [0,4194304] 0 2024-09-18T12:52:01.706 INFO:tasks.workunit.client.0.smithi045.stdout:4/122: write db/d1b/f25 [894374,130308] 0 2024-09-18T12:52:01.707 INFO:tasks.workunit.client.1.smithi161.stdout:3/335: dread d1/d2e/d24/d1d/f4f [0,4194304] 0 2024-09-18T12:52:01.709 INFO:tasks.workunit.client.1.smithi161.stdout:1/212: readlink d1/d1d/l35 0 2024-09-18T12:52:01.713 INFO:tasks.workunit.client.1.smithi161.stdout:2/316: dwrite d0/d1/f2e [0,4194304] 0 2024-09-18T12:52:01.714 INFO:tasks.workunit.client.1.smithi161.stdout:4/295: mkdir d5/d27/d3a/d60 0 2024-09-18T12:52:01.715 INFO:tasks.workunit.client.0.smithi045.stdout:8/68: dwrite f6 [0,4194304] 0 2024-09-18T12:52:01.718 INFO:tasks.workunit.client.0.smithi045.stdout:2/87: creat d5/f1f x:0 0 0 2024-09-18T12:52:01.719 INFO:tasks.workunit.client.0.smithi045.stdout:4/123: dread f9 [0,4194304] 0 2024-09-18T12:52:01.719 INFO:tasks.workunit.client.1.smithi161.stdout:1/213: dread d1/d26/f8 [0,4194304] 0 2024-09-18T12:52:01.719 INFO:tasks.workunit.client.1.smithi161.stdout:3/336: dwrite d1/d2e/d24/f3a [0,4194304] 0 2024-09-18T12:52:01.720 INFO:tasks.workunit.client.1.smithi161.stdout:0/277: dread df/f15 [0,4194304] 0 2024-09-18T12:52:01.723 INFO:tasks.workunit.client.0.smithi045.stdout:8/69: creat d11/f16 x:0 0 0 2024-09-18T12:52:01.726 INFO:tasks.workunit.client.1.smithi161.stdout:7/268: rename d3/l5 to d3/d8/d15/l3a 0 2024-09-18T12:52:01.726 INFO:tasks.workunit.client.0.smithi045.stdout:3/112: mknod d0/d22/c24 0 2024-09-18T12:52:01.726 INFO:tasks.workunit.client.0.smithi045.stdout:5/239: dread d6/d2a/f25 [0,4194304] 0 2024-09-18T12:52:01.727 INFO:tasks.workunit.client.1.smithi161.stdout:2/317: dread d0/d1/f2e [0,4194304] 0 2024-09-18T12:52:01.730 INFO:tasks.workunit.client.1.smithi161.stdout:8/346: link d0/d3/f69 d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 0 2024-09-18T12:52:01.730 INFO:tasks.workunit.client.0.smithi045.stdout:4/124: mkdir db/de/d1a/d2e 0 2024-09-18T12:52:01.731 INFO:tasks.workunit.client.1.smithi161.stdout:2/318: readlink d0/d4/l1e 0 2024-09-18T12:52:01.731 INFO:tasks.workunit.client.1.smithi161.stdout:4/296: dwrite d5/f17 [0,4194304] 0 2024-09-18T12:52:01.736 INFO:tasks.workunit.client.0.smithi045.stdout:2/88: mknod d5/c20 0 2024-09-18T12:52:01.737 INFO:tasks.workunit.client.1.smithi161.stdout:3/337: dwrite d1/d2e/f4b [0,4194304] 0 2024-09-18T12:52:01.739 INFO:tasks.workunit.client.1.smithi161.stdout:5/245: rename d3/d9/f15 to d3/d9/d4b/f4f 0 2024-09-18T12:52:01.739 INFO:tasks.workunit.client.0.smithi045.stdout:4/125: mkdir db/d10/d2f 0 2024-09-18T12:52:01.739 INFO:tasks.workunit.client.1.smithi161.stdout:2/319: write d0/d1/df/f1b [1490997,34711] 0 2024-09-18T12:52:01.740 INFO:tasks.workunit.client.1.smithi161.stdout:1/214: dwrite d1/d26/fe [0,4194304] 0 2024-09-18T12:52:01.740 INFO:tasks.workunit.client.1.smithi161.stdout:9/239: link d0/d16/d25/d28/d45/c4b d0/db/c54 0 2024-09-18T12:52:01.742 INFO:tasks.workunit.client.1.smithi161.stdout:1/215: readlink d1/da/d39/l27 0 2024-09-18T12:52:01.744 INFO:tasks.workunit.client.1.smithi161.stdout:7/269: dread d3/f17 [0,4194304] 0 2024-09-18T12:52:01.744 INFO:tasks.workunit.client.0.smithi045.stdout:8/70: link f0 d11/f17 0 2024-09-18T12:52:01.745 INFO:tasks.workunit.client.0.smithi045.stdout:5/240: dwrite d6/db/f43 [0,4194304] 0 2024-09-18T12:52:01.747 INFO:tasks.workunit.client.1.smithi161.stdout:4/297: dread d5/d27/f35 [0,4194304] 0 2024-09-18T12:52:01.748 INFO:tasks.workunit.client.0.smithi045.stdout:2/89: symlink d5/de/l21 0 2024-09-18T12:52:01.749 INFO:tasks.workunit.client.1.smithi161.stdout:9/240: dwrite d0/d47/f4c [0,4194304] 0 2024-09-18T12:52:01.750 INFO:tasks.workunit.client.1.smithi161.stdout:9/241: readlink d0/d16/d25/l3e 0 2024-09-18T12:52:01.750 INFO:tasks.workunit.client.1.smithi161.stdout:9/242: dread - d0/f3b zero size 2024-09-18T12:52:01.750 INFO:tasks.workunit.client.0.smithi045.stdout:4/126: chown db/d10/d13/l1c 46 1 2024-09-18T12:52:01.750 INFO:tasks.workunit.client.0.smithi045.stdout:2/90: truncate d5/f1f 590037 0 2024-09-18T12:52:01.751 INFO:tasks.workunit.client.1.smithi161.stdout:9/243: read d0/d47/f4c [335784,50923] 0 2024-09-18T12:52:01.751 INFO:tasks.workunit.client.0.smithi045.stdout:2/91: fsync d5/de/f13 0 2024-09-18T12:52:01.761 INFO:tasks.workunit.client.1.smithi161.stdout:3/338: creat d1/d2e/d68/f6f x:0 0 0 2024-09-18T12:52:01.762 INFO:tasks.workunit.client.0.smithi045.stdout:4/127: dread db/d1b/f23 [0,4194304] 0 2024-09-18T12:52:01.763 INFO:tasks.workunit.client.0.smithi045.stdout:5/241: creat d6/d28/d2b/f4e x:0 0 0 2024-09-18T12:52:01.764 INFO:tasks.workunit.client.0.smithi045.stdout:3/113: link d0/c15 d0/d1e/c25 0 2024-09-18T12:52:01.768 INFO:tasks.workunit.client.1.smithi161.stdout:1/216: dread d1/f5 [0,4194304] 0 2024-09-18T12:52:01.768 INFO:tasks.workunit.client.1.smithi161.stdout:5/246: rename d3/d14/d20/l22 to d3/d14/l50 0 2024-09-18T12:52:01.769 INFO:tasks.workunit.client.1.smithi161.stdout:1/217: write d1/d26/f2f [758603,90693] 0 2024-09-18T12:52:01.769 INFO:tasks.workunit.client.0.smithi045.stdout:8/71: creat d11/d14/f18 x:0 0 0 2024-09-18T12:52:01.770 INFO:tasks.workunit.client.1.smithi161.stdout:0/278: write df/f1c [1454336,19881] 0 2024-09-18T12:52:01.775 INFO:tasks.workunit.client.0.smithi045.stdout:5/242: rename d6/d3e/f23 to d6/db/d19/f4f 0 2024-09-18T12:52:01.777 INFO:tasks.workunit.client.0.smithi045.stdout:3/114: chown d0/f1f 0 1 2024-09-18T12:52:01.777 INFO:tasks.workunit.client.1.smithi161.stdout:4/298: mkdir d5/d27/d44/d61 0 2024-09-18T12:52:01.779 INFO:tasks.workunit.client.1.smithi161.stdout:8/347: write d0/d3/d10/d21/f48 [1284165,58345] 0 2024-09-18T12:52:01.783 INFO:tasks.workunit.client.0.smithi045.stdout:5/243: creat d6/db/f50 x:0 0 0 2024-09-18T12:52:01.784 INFO:tasks.workunit.client.1.smithi161.stdout:2/320: creat d0/d1/d4c/d67/f6b x:0 0 0 2024-09-18T12:52:01.786 INFO:tasks.workunit.client.0.smithi045.stdout:3/115: creat d0/d22/f26 x:0 0 0 2024-09-18T12:52:01.790 INFO:tasks.workunit.client.0.smithi045.stdout:4/128: creat db/f30 x:0 0 0 2024-09-18T12:52:01.793 INFO:tasks.workunit.client.0.smithi045.stdout:3/116: symlink d0/d22/l27 0 2024-09-18T12:52:01.793 INFO:tasks.workunit.client.0.smithi045.stdout:5/244: dwrite d6/d3e/f33 [0,4194304] 0 2024-09-18T12:52:01.793 INFO:tasks.workunit.client.0.smithi045.stdout:4/129: write db/d1b/f25 [2050154,116580] 0 2024-09-18T12:52:01.795 INFO:tasks.workunit.client.0.smithi045.stdout:4/130: dread - db/f30 zero size 2024-09-18T12:52:01.796 INFO:tasks.workunit.client.1.smithi161.stdout:4/299: creat d5/d27/d3a/d47/f62 x:0 0 0 2024-09-18T12:52:01.797 INFO:tasks.workunit.client.0.smithi045.stdout:7/93: sync 2024-09-18T12:52:01.797 INFO:tasks.workunit.client.0.smithi045.stdout:9/68: sync 2024-09-18T12:52:01.797 INFO:tasks.workunit.client.0.smithi045.stdout:1/50: sync 2024-09-18T12:52:01.801 INFO:tasks.workunit.client.1.smithi161.stdout:8/348: rename d0/d3/d10/d21/l3b to d0/d3/d10/d21/l74 0 2024-09-18T12:52:01.803 INFO:tasks.workunit.client.0.smithi045.stdout:3/117: creat d0/d22/f28 x:0 0 0 2024-09-18T12:52:01.806 INFO:tasks.workunit.client.0.smithi045.stdout:8/72: getdents d11 0 2024-09-18T12:52:01.808 INFO:tasks.workunit.client.1.smithi161.stdout:2/321: symlink d0/d5/d43/d35/l6c 0 2024-09-18T12:52:01.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.807+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/952684787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe6b41a3a70 con 0x7fe6b4101a60 2024-09-18T12:52:01.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.808+0000 7fe6b17fa640 1 -- 172.21.15.45:0/952684787 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7fe69c061260 con 0x7fe6b4101a60 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:52:01.810 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:52:01.811 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:52:01.811 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:52:01.811 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:52:01.811 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13, 2024-09-18T12:52:01.811 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:52:01.811 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:52:01.811 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:52:01.811 INFO:tasks.workunit.client.0.smithi045.stdout:5/245: dwrite d6/db/f50 [0,4194304] 0 2024-09-18T12:52:01.812 INFO:tasks.workunit.client.0.smithi045.stdout:9/69: symlink d0/l18 0 2024-09-18T12:52:01.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/952684787 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fe6a0074a80 msgr2=0x7fe6a0076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:01.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fe6a0074a80 0x7fe6a0076f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4006010 tx=0x7fe6a4005a20 comp rx=0 tx=0).stop 2024-09-18T12:52:01.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/952684787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6b4101a60 msgr2=0x7fe6b419e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:01.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6b4101a60 0x7fe6b419e080 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00b420 tx=0x7fe69c00b8e0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/952684787 shutdown_connections 2024-09-18T12:52:01.814 INFO:tasks.workunit.client.0.smithi045.stdout:1/51: chown d0/l14 1421 1 2024-09-18T12:52:01.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fe6a0074a80 0x7fe6a0076f40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6b4101a60 0x7fe6b419e080 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 --2- 172.21.15.45:0/952684787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6b4100860 0x7fe6b419db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/952684787 >> 172.21.15.45:0/952684787 conn(0x7fe6b40fc010 msgr2=0x7fe6b40fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:01.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/952684787 shutdown_connections 2024-09-18T12:52:01.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.812+0000 7fe6ba8f2640 1 -- 172.21.15.45:0/952684787 wait complete. 2024-09-18T12:52:01.815 INFO:tasks.workunit.client.1.smithi161.stdout:5/247: link d3/d9/f1c d3/d9/d4b/f51 0 2024-09-18T12:52:01.815 INFO:tasks.workunit.client.0.smithi045.stdout:4/131: dwrite db/f21 [4194304,4194304] 0 2024-09-18T12:52:01.816 INFO:tasks.workunit.client.1.smithi161.stdout:3/339: truncate d1/d2e/f17 2916849 0 2024-09-18T12:52:01.818 INFO:tasks.workunit.client.0.smithi045.stdout:3/118: mkdir d0/d29 0 2024-09-18T12:52:01.819 INFO:tasks.workunit.client.0.smithi045.stdout:4/132: chown db/d1b/c1d 57 1 2024-09-18T12:52:01.820 INFO:tasks.workunit.client.1.smithi161.stdout:4/300: rename d5/d32/d39/f40 to d5/d27/d44/f63 0 2024-09-18T12:52:01.822 INFO:tasks.workunit.client.0.smithi045.stdout:8/73: rename d11/d14/f18 to d11/d14/f19 0 2024-09-18T12:52:01.822 INFO:tasks.workunit.client.0.smithi045.stdout:8/74: chown d11/d14 1 1 2024-09-18T12:52:01.822 INFO:tasks.workunit.client.1.smithi161.stdout:4/301: chown d5/d14/c18 2936421 1 2024-09-18T12:52:01.822 INFO:tasks.workunit.client.1.smithi161.stdout:5/248: dwrite d3/d9/f41 [0,4194304] 0 2024-09-18T12:52:01.823 INFO:tasks.workunit.client.1.smithi161.stdout:6/298: sync 2024-09-18T12:52:01.823 INFO:tasks.workunit.client.0.smithi045.stdout:1/52: rmdir d0 39 2024-09-18T12:52:01.825 INFO:tasks.workunit.client.1.smithi161.stdout:4/302: dread d5/d27/f35 [0,4194304] 0 2024-09-18T12:52:01.825 INFO:tasks.workunit.client.1.smithi161.stdout:5/249: dread - d3/f2a zero size 2024-09-18T12:52:01.827 INFO:tasks.workunit.client.1.smithi161.stdout:5/250: chown d3/d3b 30801 1 2024-09-18T12:52:01.828 INFO:tasks.workunit.client.0.smithi045.stdout:9/70: symlink d0/d3/d6/l19 0 2024-09-18T12:52:01.828 INFO:tasks.workunit.client.1.smithi161.stdout:4/303: readlink d5/d27/d3a/l3e 0 2024-09-18T12:52:01.830 INFO:tasks.workunit.client.1.smithi161.stdout:9/244: creat d0/db/f55 x:0 0 0 2024-09-18T12:52:01.831 INFO:tasks.workunit.client.1.smithi161.stdout:2/322: mknod d0/d5/d43/d23/c6d 0 2024-09-18T12:52:01.832 INFO:tasks.workunit.client.1.smithi161.stdout:5/251: dread - d3/d9/d4b/f4d zero size 2024-09-18T12:52:01.832 INFO:tasks.workunit.client.1.smithi161.stdout:0/279: link df/d29/d2d/c4a df/d29/d36/c60 0 2024-09-18T12:52:01.832 INFO:tasks.workunit.client.0.smithi045.stdout:9/71: dread d0/d3/f11 [0,4194304] 0 2024-09-18T12:52:01.833 INFO:tasks.workunit.client.0.smithi045.stdout:8/75: mknod d11/d14/c1a 0 2024-09-18T12:52:01.833 INFO:tasks.workunit.client.0.smithi045.stdout:5/246: dread d6/db/d19/f4f [0,4194304] 0 2024-09-18T12:52:01.836 INFO:tasks.workunit.client.1.smithi161.stdout:2/323: fdatasync d0/d5/d53/f4b 0 2024-09-18T12:52:01.837 INFO:tasks.workunit.client.0.smithi045.stdout:8/76: chown d11/f17 12104518 1 2024-09-18T12:52:01.837 INFO:tasks.workunit.client.0.smithi045.stdout:3/119: dread d0/d7/f9 [0,4194304] 0 2024-09-18T12:52:01.837 INFO:tasks.workunit.client.0.smithi045.stdout:8/77: dread f0 [0,4194304] 0 2024-09-18T12:52:01.837 INFO:tasks.workunit.client.1.smithi161.stdout:6/299: dwrite d4/d39/d3a/f29 [4194304,4194304] 0 2024-09-18T12:52:01.838 INFO:tasks.workunit.client.1.smithi161.stdout:5/252: write d3/d9/d4b/f4d [680814,115709] 0 2024-09-18T12:52:01.839 INFO:tasks.workunit.client.1.smithi161.stdout:1/218: dwrite d1/f1b [0,4194304] 0 2024-09-18T12:52:01.839 INFO:tasks.workunit.client.1.smithi161.stdout:2/324: stat d0/d1/df/f40 0 2024-09-18T12:52:01.839 INFO:tasks.workunit.client.1.smithi161.stdout:5/253: fdatasync d3/fd 0 2024-09-18T12:52:01.842 INFO:tasks.workunit.client.0.smithi045.stdout:1/53: readlink d0/l14 0 2024-09-18T12:52:01.843 INFO:tasks.workunit.client.1.smithi161.stdout:8/349: symlink d0/d3/l75 0 2024-09-18T12:52:01.844 INFO:tasks.workunit.client.0.smithi045.stdout:1/54: readlink d0/l10 0 2024-09-18T12:52:01.847 INFO:tasks.workunit.client.0.smithi045.stdout:3/120: dwrite d0/d7/f9 [4194304,4194304] 0 2024-09-18T12:52:01.847 INFO:tasks.workunit.client.0.smithi045.stdout:1/55: truncate d0/d12/f15 942829 0 2024-09-18T12:52:01.849 INFO:tasks.workunit.client.1.smithi161.stdout:6/300: dwrite d4/d39/d26/d20/d28/f3b [0,4194304] 0 2024-09-18T12:52:01.851 INFO:tasks.workunit.client.1.smithi161.stdout:6/301: chown d4/d39/d26/d20/c27 19759 1 2024-09-18T12:52:01.851 INFO:tasks.workunit.client.1.smithi161.stdout:4/304: creat d5/d27/d3a/d4c/f64 x:0 0 0 2024-09-18T12:52:01.853 INFO:tasks.workunit.client.0.smithi045.stdout:4/133: symlink db/d2c/l31 0 2024-09-18T12:52:01.853 INFO:tasks.workunit.client.0.smithi045.stdout:4/134: stat c5 0 2024-09-18T12:52:01.855 INFO:tasks.workunit.client.0.smithi045.stdout:9/72: creat d0/f1a x:0 0 0 2024-09-18T12:52:01.856 INFO:tasks.workunit.client.0.smithi045.stdout:9/73: stat d0/d3/f7 0 2024-09-18T12:52:01.857 INFO:tasks.workunit.client.0.smithi045.stdout:9/74: read d0/f2 [247399,10299] 0 2024-09-18T12:52:01.858 INFO:tasks.workunit.client.1.smithi161.stdout:6/302: dwrite d4/d39/d48/f56 [0,4194304] 0 2024-09-18T12:52:01.859 INFO:tasks.workunit.client.1.smithi161.stdout:6/303: chown d4/d1a/d1c/d3e/f42 91448993 1 2024-09-18T12:52:01.864 INFO:tasks.workunit.client.1.smithi161.stdout:2/325: creat d0/d1/df/f6e x:0 0 0 2024-09-18T12:52:01.866 INFO:tasks.workunit.client.1.smithi161.stdout:7/270: sync 2024-09-18T12:52:01.868 INFO:tasks.workunit.client.0.smithi045.stdout:7/94: getdents d13/d1a 0 2024-09-18T12:52:01.869 INFO:tasks.workunit.client.0.smithi045.stdout:1/56: stat d0/f6 0 2024-09-18T12:52:01.871 INFO:tasks.workunit.client.0.smithi045.stdout:1/57: chown d0/f2 0 1 2024-09-18T12:52:01.871 INFO:tasks.workunit.client.0.smithi045.stdout:8/78: dread f5 [0,4194304] 0 2024-09-18T12:52:01.871 INFO:tasks.workunit.client.1.smithi161.stdout:7/271: dwrite d3/d8/d15/d1a/f39 [0,4194304] 0 2024-09-18T12:52:01.872 INFO:tasks.workunit.client.0.smithi045.stdout:1/58: stat d0/fc 0 2024-09-18T12:52:01.875 INFO:tasks.workunit.client.1.smithi161.stdout:3/340: link d1/d2e/d14/l55 d1/d2e/d68/d69/l70 0 2024-09-18T12:52:01.878 INFO:tasks.workunit.client.0.smithi045.stdout:4/135: unlink f7 0 2024-09-18T12:52:01.881 INFO:tasks.workunit.client.0.smithi045.stdout:5/247: write d6/f7 [2405639,122975] 0 2024-09-18T12:52:01.882 INFO:tasks.workunit.client.0.smithi045.stdout:9/75: creat d0/d3/d6/d10/f1b x:0 0 0 2024-09-18T12:52:01.883 INFO:tasks.workunit.client.1.smithi161.stdout:0/280: mkdir df/d61 0 2024-09-18T12:52:01.884 INFO:tasks.workunit.client.0.smithi045.stdout:7/95: mkdir d13/d1c 0 2024-09-18T12:52:01.886 INFO:tasks.workunit.client.1.smithi161.stdout:9/245: creat d0/d16/d25/d46/d53/f56 x:0 0 0 2024-09-18T12:52:01.886 INFO:tasks.workunit.client.1.smithi161.stdout:9/246: readlink d0/d16/l44 0 2024-09-18T12:52:01.893 INFO:tasks.workunit.client.0.smithi045.stdout:1/59: creat d0/f16 x:0 0 0 2024-09-18T12:52:01.894 INFO:tasks.workunit.client.0.smithi045.stdout:3/121: dwrite d0/d7/f1d [0,4194304] 0 2024-09-18T12:52:01.894 INFO:tasks.workunit.client.0.smithi045.stdout:1/60: chown d0/f2 131002782 1 2024-09-18T12:52:01.896 INFO:tasks.workunit.client.1.smithi161.stdout:8/350: symlink d0/l76 0 2024-09-18T12:52:01.899 INFO:tasks.workunit.client.0.smithi045.stdout:5/248: mkdir d6/d28/d2b/d51 0 2024-09-18T12:52:01.901 INFO:tasks.workunit.client.1.smithi161.stdout:3/341: creat d1/d2e/d3d/f71 x:0 0 0 2024-09-18T12:52:01.905 INFO:tasks.workunit.client.0.smithi045.stdout:8/79: write f5 [2489910,28250] 0 2024-09-18T12:52:01.905 INFO:tasks.workunit.client.0.smithi045.stdout:3/122: dwrite d0/d22/f26 [0,4194304] 0 2024-09-18T12:52:01.907 INFO:tasks.workunit.client.0.smithi045.stdout:3/123: fsync d0/d7/f23 0 2024-09-18T12:52:01.908 INFO:tasks.workunit.client.0.smithi045.stdout:3/124: write d0/d22/f28 [798377,74873] 0 2024-09-18T12:52:01.909 INFO:tasks.workunit.client.0.smithi045.stdout:3/125: write d0/f4 [896889,38796] 0 2024-09-18T12:52:01.910 INFO:tasks.workunit.client.1.smithi161.stdout:1/219: link d1/da/d31/l36 d1/d1d/l40 0 2024-09-18T12:52:01.913 INFO:tasks.workunit.client.0.smithi045.stdout:7/96: symlink d13/d1c/l1d 0 2024-09-18T12:52:01.914 INFO:tasks.workunit.client.1.smithi161.stdout:5/254: rename d3/d9/d4b/f4d to d3/d14/d20/d21/f52 0 2024-09-18T12:52:01.915 INFO:tasks.workunit.client.1.smithi161.stdout:4/305: truncate d5/d27/f37 832884 0 2024-09-18T12:52:01.916 INFO:tasks.workunit.client.1.smithi161.stdout:4/306: chown d5/f36 222 1 2024-09-18T12:52:01.917 INFO:tasks.workunit.client.0.smithi045.stdout:1/61: write d0/f6 [417480,10438] 0 2024-09-18T12:52:01.918 INFO:tasks.workunit.client.0.smithi045.stdout:1/62: chown d0/f7 3 1 2024-09-18T12:52:01.919 INFO:tasks.workunit.client.0.smithi045.stdout:1/63: fsync d0/f2 0 2024-09-18T12:52:01.921 INFO:tasks.workunit.client.1.smithi161.stdout:0/281: dwrite df/f23 [0,4194304] 0 2024-09-18T12:52:01.922 INFO:tasks.workunit.client.1.smithi161.stdout:1/220: symlink d1/da/d31/l41 0 2024-09-18T12:52:01.922 INFO:tasks.workunit.client.0.smithi045.stdout:5/249: creat d6/d28/d2b/d51/f52 x:0 0 0 2024-09-18T12:52:01.923 INFO:tasks.workunit.client.1.smithi161.stdout:1/221: chown d1/d1d/l40 2 1 2024-09-18T12:52:01.923 INFO:tasks.workunit.client.1.smithi161.stdout:0/282: read df/d29/f53 [450866,122631] 0 2024-09-18T12:52:01.923 INFO:tasks.workunit.client.0.smithi045.stdout:5/250: stat d6/db/f43 0 2024-09-18T12:52:01.926 INFO:tasks.workunit.client.0.smithi045.stdout:8/80: link d11/f12 d11/d14/f1b 0 2024-09-18T12:52:01.926 INFO:tasks.workunit.client.1.smithi161.stdout:6/304: rename d4/l9 to d4/d39/d47/d51/l5f 0 2024-09-18T12:52:01.929 INFO:tasks.workunit.client.0.smithi045.stdout:3/126: unlink d0/d7/c17 0 2024-09-18T12:52:01.929 INFO:tasks.workunit.client.1.smithi161.stdout:0/283: dwrite df/f50 [0,4194304] 0 2024-09-18T12:52:01.929 INFO:tasks.workunit.client.1.smithi161.stdout:0/284: readlink l7 0 2024-09-18T12:52:01.930 INFO:tasks.workunit.client.1.smithi161.stdout:0/285: fdatasync df/d29/d46/f5f 0 2024-09-18T12:52:01.930 INFO:tasks.workunit.client.0.smithi045.stdout:5/251: dread d6/db/f50 [0,4194304] 0 2024-09-18T12:52:01.931 INFO:tasks.workunit.client.0.smithi045.stdout:1/64: unlink d0/ff 0 2024-09-18T12:52:01.933 INFO:tasks.workunit.client.0.smithi045.stdout:4/136: link db/de/d1e/f2d db/d10/d2f/f32 0 2024-09-18T12:52:01.934 INFO:tasks.workunit.client.1.smithi161.stdout:8/351: creat d0/d3/d10/d21/d4a/f77 x:0 0 0 2024-09-18T12:52:01.934 INFO:tasks.workunit.client.0.smithi045.stdout:4/137: write db/f21 [6508159,33134] 0 2024-09-18T12:52:01.935 INFO:tasks.workunit.client.0.smithi045.stdout:7/97: creat d13/d19/f1e x:0 0 0 2024-09-18T12:52:01.936 INFO:tasks.workunit.client.0.smithi045.stdout:7/98: chown fd 1023 1 2024-09-18T12:52:01.938 INFO:tasks.workunit.client.1.smithi161.stdout:9/247: link d0/d20/f39 d0/db/f57 0 2024-09-18T12:52:01.939 INFO:tasks.workunit.client.1.smithi161.stdout:9/248: truncate d0/d20/f39 1012289 0 2024-09-18T12:52:01.939 INFO:tasks.workunit.client.1.smithi161.stdout:9/249: chown d0/d16/f35 0 1 2024-09-18T12:52:01.940 INFO:tasks.workunit.client.1.smithi161.stdout:9/250: stat d0/d16/c2a 0 2024-09-18T12:52:01.940 INFO:tasks.workunit.client.1.smithi161.stdout:9/251: chown d0/d16/d25/d46/d53 62 1 2024-09-18T12:52:01.941 INFO:tasks.workunit.client.1.smithi161.stdout:2/326: getdents d0/d1/d3b 0 2024-09-18T12:52:01.943 INFO:tasks.workunit.client.0.smithi045.stdout:8/81: creat d11/d14/f1c x:0 0 0 2024-09-18T12:52:01.944 INFO:tasks.workunit.client.0.smithi045.stdout:4/138: dread db/d1b/f25 [0,4194304] 0 2024-09-18T12:52:01.945 INFO:tasks.workunit.client.0.smithi045.stdout:8/82: truncate d11/f16 873782 0 2024-09-18T12:52:01.946 INFO:tasks.workunit.client.0.smithi045.stdout:8/83: write ff [400482,13574] 0 2024-09-18T12:52:01.946 INFO:tasks.workunit.client.0.smithi045.stdout:3/127: creat d0/d1e/f2a x:0 0 0 2024-09-18T12:52:01.951 INFO:tasks.workunit.client.0.smithi045.stdout:1/65: mkdir d0/d12/d17 0 2024-09-18T12:52:01.957 INFO:tasks.workunit.client.1.smithi161.stdout:4/307: dwrite d5/f2c [0,4194304] 0 2024-09-18T12:52:01.959 INFO:tasks.workunit.client.0.smithi045.stdout:7/99: creat d13/d1c/f1f x:0 0 0 2024-09-18T12:52:01.961 INFO:tasks.workunit.client.1.smithi161.stdout:0/286: creat df/d29/f62 x:0 0 0 2024-09-18T12:52:01.963 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:01 smithi045 ceph-mon[28315]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:01.963 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:01 smithi045 ceph-mon[28315]: pgmap v23: 65 pgs: 65 active+clean; 337 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 23 MiB/s wr, 237 op/s 2024-09-18T12:52:01.963 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:01 smithi045 ceph-mon[28315]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:01.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.961+0000 7feb15901640 1 -- 172.21.15.45:0/4172853599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb10102bf0 msgr2=0x7feb10103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:01.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.961+0000 7feb15901640 1 --2- 172.21.15.45:0/4172853599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb10102bf0 0x7feb10103070 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7feb04009880 tx=0x7feb0402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.963 INFO:tasks.workunit.client.0.smithi045.stdout:4/139: fdatasync f9 0 2024-09-18T12:52:01.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.962+0000 7feb15901640 1 -- 172.21.15.45:0/4172853599 shutdown_connections 2024-09-18T12:52:01.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.962+0000 7feb15901640 1 --2- 172.21.15.45:0/4172853599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb10102bf0 0x7feb10103070 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.962+0000 7feb15901640 1 --2- 172.21.15.45:0/4172853599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb100ffc10 0x7feb10100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.962+0000 7feb15901640 1 -- 172.21.15.45:0/4172853599 >> 172.21.15.45:0/4172853599 conn(0x7feb100fb760 msgr2=0x7feb100fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:01.965 INFO:tasks.workunit.client.1.smithi161.stdout:7/272: getdents d3/d36 0 2024-09-18T12:52:01.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.964+0000 7feb15901640 1 -- 172.21.15.45:0/4172853599 shutdown_connections 2024-09-18T12:52:01.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.964+0000 7feb15901640 1 -- 172.21.15.45:0/4172853599 wait complete. 2024-09-18T12:52:01.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.965+0000 7feb15901640 1 Processor -- start 2024-09-18T12:52:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.965+0000 7feb15901640 1 -- start start 2024-09-18T12:52:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.965+0000 7feb15901640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb100ffc10 0x7feb1019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:01.967 INFO:tasks.workunit.client.0.smithi045.stdout:8/84: rename l10 to d11/d14/l1d 0 2024-09-18T12:52:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.966+0000 7feb15901640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb10102bf0 0x7feb1019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.966+0000 7feb15901640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7feb1010a790 con 0x7feb100ffc10 2024-09-18T12:52:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.966+0000 7feb15901640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7feb1010a610 con 0x7feb10102bf0 2024-09-18T12:52:01.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.966+0000 7feb0effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb100ffc10 0x7feb1019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:01.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.966+0000 7feb0effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb100ffc10 0x7feb1019dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36086/0 (socket says 172.21.15.45:36086) 2024-09-18T12:52:01.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.966+0000 7feb0effd640 1 -- 172.21.15.45:0/720023615 learned_addr learned my addr 172.21.15.45:0/720023615 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:52:01.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.966+0000 7feb0e7fc640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb10102bf0 0x7feb1019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:01.968 INFO:tasks.workunit.client.1.smithi161.stdout:8/352: creat d0/d3/d5f/f78 x:0 0 0 2024-09-18T12:52:01.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.967+0000 7feb0effd640 1 -- 172.21.15.45:0/720023615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb10102bf0 msgr2=0x7feb1019e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:01.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.967+0000 7feb0effd640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb10102bf0 0x7feb1019e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.967+0000 7feb0effd640 1 -- 172.21.15.45:0/720023615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1019e690 con 0x7feb100ffc10 2024-09-18T12:52:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.967+0000 7feb0effd640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb100ffc10 0x7feb1019dad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feb0000e940 tx=0x7feb0000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.967+0000 7feb148ff640 1 -- 172.21.15.45:0/720023615 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb0000cac0 con 0x7feb100ffc10 2024-09-18T12:52:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.967+0000 7feb148ff640 1 -- 172.21.15.45:0/720023615 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb0000cc60 con 0x7feb100ffc10 2024-09-18T12:52:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.967+0000 7feb148ff640 1 -- 172.21.15.45:0/720023615 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb00003e30 con 0x7feb100ffc10 2024-09-18T12:52:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.967+0000 7feb15901640 1 -- 172.21.15.45:0/720023615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb101a30d0 con 0x7feb100ffc10 2024-09-18T12:52:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.968+0000 7feb15901640 1 -- 172.21.15.45:0/720023615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb101a3660 con 0x7feb100ffc10 2024-09-18T12:52:01.970 INFO:tasks.workunit.client.0.smithi045.stdout:1/66: symlink d0/l18 0 2024-09-18T12:52:01.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.969+0000 7feb15901640 1 -- 172.21.15.45:0/720023615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb10100010 con 0x7feb100ffc10 2024-09-18T12:52:01.971 INFO:tasks.workunit.client.0.smithi045.stdout:1/67: stat d0/d12 0 2024-09-18T12:52:01.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.971+0000 7feb148ff640 1 -- 172.21.15.45:0/720023615 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7feb00004000 con 0x7feb100ffc10 2024-09-18T12:52:01.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.971+0000 7feb148ff640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7feaf8074ab0 0x7feaf8076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:01.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.972+0000 7feb148ff640 1 -- 172.21.15.45:0/720023615 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7feb00096740 con 0x7feb100ffc10 2024-09-18T12:52:01.973 INFO:tasks.workunit.client.1.smithi161.stdout:2/327: symlink d0/d1/d3b/d3d/d4f/l6f 0 2024-09-18T12:52:01.973 INFO:tasks.workunit.client.1.smithi161.stdout:2/328: fdatasync d0/d4/f2a 0 2024-09-18T12:52:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.972+0000 7feb0e7fc640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7feaf8074ab0 0x7feaf8076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:01.974 INFO:tasks.workunit.client.0.smithi045.stdout:4/140: dwrite db/f21 [0,4194304] 0 2024-09-18T12:52:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.973+0000 7feb0e7fc640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7feaf8074ab0 0x7feaf8076f70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb1019ef80 tx=0x7feb04009620 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:01.977 INFO:tasks.workunit.client.1.smithi161.stdout:1/222: mknod d1/c42 0 2024-09-18T12:52:01.980 INFO:tasks.workunit.client.0.smithi045.stdout:3/128: rename d0/d7/f9 to d0/d22/f2b 0 2024-09-18T12:52:01.980 INFO:tasks.workunit.client.1.smithi161.stdout:1/223: dread - d1/d26/d3a/f3b zero size 2024-09-18T12:52:01.980 INFO:tasks.workunit.client.1.smithi161.stdout:3/342: rename d1/d2e/d3d/d6b to d1/d2e/d14/d2c/d72 0 2024-09-18T12:52:01.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:01.980+0000 7feb148ff640 1 -- 172.21.15.45:0/720023615 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7feb00061df0 con 0x7feb100ffc10 2024-09-18T12:52:01.982 INFO:tasks.workunit.client.0.smithi045.stdout:1/68: symlink d0/l19 0 2024-09-18T12:52:01.983 INFO:tasks.workunit.client.0.smithi045.stdout:1/69: dread - d0/fe zero size 2024-09-18T12:52:01.983 INFO:tasks.workunit.client.1.smithi161.stdout:5/255: link c1 d3/d8/c53 0 2024-09-18T12:52:01.984 INFO:tasks.workunit.client.1.smithi161.stdout:4/308: mknod d5/d14/c65 0 2024-09-18T12:52:01.984 INFO:tasks.workunit.client.0.smithi045.stdout:7/100: getdents d13/d1a 0 2024-09-18T12:52:01.986 INFO:tasks.workunit.client.0.smithi045.stdout:8/85: rename f5 to d11/d14/f1e 0 2024-09-18T12:52:01.987 INFO:tasks.workunit.client.0.smithi045.stdout:3/129: readlink d0/d7/l14 0 2024-09-18T12:52:01.988 INFO:tasks.workunit.client.0.smithi045.stdout:3/130: dread - d0/f1a zero size 2024-09-18T12:52:01.988 INFO:tasks.workunit.client.1.smithi161.stdout:1/224: dread d1/f28 [0,4194304] 0 2024-09-18T12:52:01.989 INFO:tasks.workunit.client.0.smithi045.stdout:1/70: dread d0/fa [0,4194304] 0 2024-09-18T12:52:01.989 INFO:tasks.workunit.client.0.smithi045.stdout:1/71: readlink d0/l18 0 2024-09-18T12:52:01.991 INFO:tasks.workunit.client.1.smithi161.stdout:9/252: symlink d0/d16/l58 0 2024-09-18T12:52:01.994 INFO:tasks.workunit.client.0.smithi045.stdout:7/101: unlink d13/d1c/l1d 0 2024-09-18T12:52:01.996 INFO:tasks.workunit.client.0.smithi045.stdout:8/86: rmdir d11 39 2024-09-18T12:52:01.997 INFO:tasks.workunit.client.1.smithi161.stdout:9/253: dwrite d0/d16/f35 [0,4194304] 0 2024-09-18T12:52:01.997 INFO:tasks.workunit.client.0.smithi045.stdout:8/87: stat ff 0 2024-09-18T12:52:01.999 INFO:tasks.workunit.client.0.smithi045.stdout:3/131: dwrite d0/f18 [0,4194304] 0 2024-09-18T12:52:01.999 INFO:tasks.workunit.client.0.smithi045.stdout:8/88: chown f0 5900767 1 2024-09-18T12:52:02.001 INFO:tasks.workunit.client.1.smithi161.stdout:8/353: rename d0/d3/l62 to d0/d3/d10/d21/d4a/d52/d70/l79 0 2024-09-18T12:52:02.002 INFO:tasks.workunit.client.0.smithi045.stdout:7/102: dread d13/f16 [0,4194304] 0 2024-09-18T12:52:02.004 INFO:tasks.workunit.client.0.smithi045.stdout:1/72: rename d0/l18 to d0/d12/l1a 0 2024-09-18T12:52:02.005 INFO:tasks.workunit.client.0.smithi045.stdout:7/103: read fc [19356,32774] 0 2024-09-18T12:52:02.012 INFO:tasks.workunit.client.1.smithi161.stdout:6/305: creat d4/d1a/f60 x:0 0 0 2024-09-18T12:52:02.013 INFO:tasks.workunit.client.1.smithi161.stdout:6/306: chown d4/d39/d26/d20/d28/f3b 0 1 2024-09-18T12:52:02.015 INFO:tasks.workunit.client.1.smithi161.stdout:5/256: mkdir d3/d3b/d54 0 2024-09-18T12:52:02.018 INFO:tasks.workunit.client.0.smithi045.stdout:3/132: mkdir d0/d1e/d2c 0 2024-09-18T12:52:02.019 INFO:tasks.workunit.client.1.smithi161.stdout:0/287: mknod df/c63 0 2024-09-18T12:52:02.019 INFO:tasks.workunit.client.1.smithi161.stdout:7/273: dwrite d3/d8/d15/f33 [0,4194304] 0 2024-09-18T12:52:02.020 INFO:tasks.workunit.client.1.smithi161.stdout:7/274: chown d3/f7 1113610 1 2024-09-18T12:52:02.021 INFO:tasks.workunit.client.0.smithi045.stdout:1/73: rmdir d0/d12 39 2024-09-18T12:52:02.023 INFO:tasks.workunit.client.0.smithi045.stdout:4/141: dwrite db/de/d1e/f2d [0,4194304] 0 2024-09-18T12:52:02.024 INFO:tasks.workunit.client.0.smithi045.stdout:7/104: mknod d13/d19/c20 0 2024-09-18T12:52:02.025 INFO:tasks.workunit.client.0.smithi045.stdout:4/142: stat db/d10/d13 0 2024-09-18T12:52:02.034 INFO:tasks.workunit.client.0.smithi045.stdout:3/133: rename d0/d7/l14 to d0/d1e/l2d 0 2024-09-18T12:52:02.036 INFO:tasks.workunit.client.1.smithi161.stdout:2/329: rename d0/f38 to d0/d1/d3b/d3d/d4f/d56/f70 0 2024-09-18T12:52:02.036 INFO:tasks.workunit.client.0.smithi045.stdout:1/74: dread d0/d12/f15 [0,4194304] 0 2024-09-18T12:52:02.038 INFO:tasks.workunit.client.0.smithi045.stdout:4/143: mknod db/d20/c33 0 2024-09-18T12:52:02.040 INFO:tasks.workunit.client.1.smithi161.stdout:6/307: mkdir d4/d61 0 2024-09-18T12:52:02.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:01 smithi161 ceph-mon[35784]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:02.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:01 smithi161 ceph-mon[35784]: pgmap v23: 65 pgs: 65 active+clean; 337 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 23 MiB/s wr, 237 op/s 2024-09-18T12:52:02.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:01 smithi161 ceph-mon[35784]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:02.046 INFO:tasks.workunit.client.0.smithi045.stdout:1/75: mkdir d0/d12/d1b 0 2024-09-18T12:52:02.049 INFO:tasks.workunit.client.0.smithi045.stdout:1/76: rename d0/d12/d1b to d0/d12/d1b/d1c 22 2024-09-18T12:52:02.051 INFO:tasks.workunit.client.1.smithi161.stdout:0/288: creat df/d29/d46/f64 x:0 0 0 2024-09-18T12:52:02.052 INFO:tasks.workunit.client.1.smithi161.stdout:0/289: read df/d29/d2d/d37/f48 [2160943,30396] 0 2024-09-18T12:52:02.054 INFO:tasks.workunit.client.0.smithi045.stdout:8/89: dwrite d11/f17 [0,4194304] 0 2024-09-18T12:52:02.055 INFO:tasks.workunit.client.1.smithi161.stdout:4/309: truncate d5/f20 115061 0 2024-09-18T12:52:02.056 INFO:tasks.workunit.client.0.smithi045.stdout:8/90: read - d11/d14/f19 zero size 2024-09-18T12:52:02.057 INFO:tasks.workunit.client.0.smithi045.stdout:1/77: mknod d0/d12/c1d 0 2024-09-18T12:52:02.059 INFO:tasks.workunit.client.0.smithi045.stdout:7/105: dwrite d13/f17 [0,4194304] 0 2024-09-18T12:52:02.059 INFO:tasks.workunit.client.0.smithi045.stdout:1/78: readlink d0/l5 0 2024-09-18T12:52:02.063 INFO:tasks.workunit.client.1.smithi161.stdout:3/343: link d1/c1c d1/d2e/d68/c73 0 2024-09-18T12:52:02.064 INFO:tasks.workunit.client.1.smithi161.stdout:3/344: write d1/d2e/d24/d1d/f2a [2970813,72264] 0 2024-09-18T12:52:02.064 INFO:tasks.workunit.client.0.smithi045.stdout:8/91: rename c3 to d11/d14/c1f 0 2024-09-18T12:52:02.064 INFO:tasks.workunit.client.1.smithi161.stdout:3/345: dread - d1/f54 zero size 2024-09-18T12:52:02.065 INFO:tasks.workunit.client.0.smithi045.stdout:3/134: dwrite d0/f1f [0,4194304] 0 2024-09-18T12:52:02.067 INFO:tasks.workunit.client.0.smithi045.stdout:3/135: chown d0/d22/f26 2021054652 1 2024-09-18T12:52:02.067 INFO:tasks.workunit.client.0.smithi045.stdout:8/92: chown d11/d14/f1c 0 1 2024-09-18T12:52:02.069 INFO:tasks.workunit.client.0.smithi045.stdout:7/106: mknod d13/c21 0 2024-09-18T12:52:02.070 INFO:tasks.workunit.client.1.smithi161.stdout:6/308: chown c3 239849 1 2024-09-18T12:52:02.071 INFO:tasks.workunit.client.1.smithi161.stdout:9/254: truncate d0/f22 26939 0 2024-09-18T12:52:02.073 INFO:tasks.workunit.client.0.smithi045.stdout:1/79: fdatasync d0/fa 0 2024-09-18T12:52:02.076 INFO:tasks.workunit.client.0.smithi045.stdout:7/107: symlink d13/l22 0 2024-09-18T12:52:02.079 INFO:tasks.workunit.client.0.smithi045.stdout:8/93: dwrite f0 [0,4194304] 0 2024-09-18T12:52:02.079 INFO:tasks.workunit.client.0.smithi045.stdout:1/80: write d0/f2 [1023835,98035] 0 2024-09-18T12:52:02.080 INFO:tasks.workunit.client.1.smithi161.stdout:1/225: link d1/da/d39/f37 d1/da/f43 0 2024-09-18T12:52:02.084 INFO:tasks.workunit.client.1.smithi161.stdout:5/257: truncate d3/d9/f12 2815987 0 2024-09-18T12:52:02.086 INFO:tasks.workunit.client.1.smithi161.stdout:5/258: dread - d3/f2a zero size 2024-09-18T12:52:02.087 INFO:tasks.workunit.client.0.smithi045.stdout:7/108: rename d13/d19/f1e to d13/f23 0 2024-09-18T12:52:02.088 INFO:tasks.workunit.client.1.smithi161.stdout:8/354: dwrite d0/d3/d1e/f46 [0,4194304] 0 2024-09-18T12:52:02.089 INFO:tasks.workunit.client.0.smithi045.stdout:1/81: dwrite d0/f9 [0,4194304] 0 2024-09-18T12:52:02.091 INFO:tasks.workunit.client.0.smithi045.stdout:8/94: mkdir d11/d20 0 2024-09-18T12:52:02.094 INFO:tasks.workunit.client.1.smithi161.stdout:3/346: creat d1/d2e/d68/f74 x:0 0 0 2024-09-18T12:52:02.095 INFO:tasks.workunit.client.1.smithi161.stdout:3/347: dread - d1/f54 zero size 2024-09-18T12:52:02.096 INFO:tasks.workunit.client.1.smithi161.stdout:5/259: dwrite d3/d14/d20/f3c [0,4194304] 0 2024-09-18T12:52:02.096 INFO:tasks.workunit.client.1.smithi161.stdout:6/309: write d4/f10 [4479188,110577] 0 2024-09-18T12:52:02.101 INFO:tasks.workunit.client.1.smithi161.stdout:9/255: write d0/f24 [3663542,54608] 0 2024-09-18T12:52:02.105 INFO:tasks.workunit.client.0.smithi045.stdout:8/95: symlink d11/l21 0 2024-09-18T12:52:02.107 INFO:tasks.workunit.client.1.smithi161.stdout:7/275: creat d3/d8/d15/f3b x:0 0 0 2024-09-18T12:52:02.109 INFO:tasks.workunit.client.1.smithi161.stdout:0/290: fdatasync df/d30/d4d/f4f 0 2024-09-18T12:52:02.115 INFO:tasks.workunit.client.1.smithi161.stdout:0/291: dwrite df/f1c [0,4194304] 0 2024-09-18T12:52:02.115 INFO:tasks.workunit.client.0.smithi045.stdout:8/96: unlink d11/l21 0 2024-09-18T12:52:02.116 INFO:tasks.workunit.client.1.smithi161.stdout:0/292: write df/d29/d2d/f4b [340142,129309] 0 2024-09-18T12:52:02.118 INFO:tasks.workunit.client.1.smithi161.stdout:2/330: rename d0/d1/d3b/d58 to d0/d71 0 2024-09-18T12:52:02.118 INFO:tasks.workunit.client.0.smithi045.stdout:7/109: link fc d13/f24 0 2024-09-18T12:52:02.120 INFO:tasks.workunit.client.0.smithi045.stdout:7/110: dread - d13/d1c/f1f zero size 2024-09-18T12:52:02.123 INFO:tasks.workunit.client.0.smithi045.stdout:1/82: rmdir d0/d12/d1b 0 2024-09-18T12:52:02.125 INFO:tasks.workunit.client.0.smithi045.stdout:8/97: dwrite d11/f17 [0,4194304] 0 2024-09-18T12:52:02.125 INFO:tasks.workunit.client.1.smithi161.stdout:3/348: unlink d1/d2e/f37 0 2024-09-18T12:52:02.126 INFO:tasks.workunit.client.0.smithi045.stdout:1/83: write d0/fe [88312,120886] 0 2024-09-18T12:52:02.126 INFO:tasks.workunit.client.1.smithi161.stdout:3/349: fdatasync d1/f12 0 2024-09-18T12:52:02.128 INFO:tasks.workunit.client.0.smithi045.stdout:7/111: creat d13/d1a/f25 x:0 0 0 2024-09-18T12:52:02.129 INFO:tasks.workunit.client.1.smithi161.stdout:9/256: mkdir d0/d16/d25/d46/d53/d59 0 2024-09-18T12:52:02.129 INFO:tasks.workunit.client.0.smithi045.stdout:1/84: write d0/fd [650396,68080] 0 2024-09-18T12:52:02.129 INFO:tasks.workunit.client.1.smithi161.stdout:3/350: chown d1/d2e/d24/d1d/l3e 619 1 2024-09-18T12:52:02.130 INFO:tasks.workunit.client.0.smithi045.stdout:1/85: fsync d0/fb 0 2024-09-18T12:52:02.131 INFO:tasks.workunit.client.1.smithi161.stdout:5/260: dwrite d3/d14/f19 [0,4194304] 0 2024-09-18T12:52:02.133 INFO:tasks.workunit.client.0.smithi045.stdout:7/112: unlink d13/d19/c20 0 2024-09-18T12:52:02.133 INFO:tasks.workunit.client.0.smithi045.stdout:1/86: dread d0/f9 [0,4194304] 0 2024-09-18T12:52:02.135 INFO:tasks.workunit.client.0.smithi045.stdout:1/87: dread - d0/f16 zero size 2024-09-18T12:52:02.138 INFO:tasks.workunit.client.1.smithi161.stdout:0/293: symlink df/d29/d46/l65 0 2024-09-18T12:52:02.139 INFO:tasks.workunit.client.0.smithi045.stdout:8/98: read d11/f13 [586939,41102] 0 2024-09-18T12:52:02.141 INFO:tasks.workunit.client.0.smithi045.stdout:7/113: dread f3 [0,4194304] 0 2024-09-18T12:52:02.141 INFO:tasks.workunit.client.1.smithi161.stdout:2/331: mknod d0/d1/d3b/d3d/d4f/d56/c72 0 2024-09-18T12:52:02.142 INFO:tasks.workunit.client.0.smithi045.stdout:7/114: fdatasync d13/f17 0 2024-09-18T12:52:02.143 INFO:tasks.workunit.client.0.smithi045.stdout:8/99: fsync d11/f12 0 2024-09-18T12:52:02.146 INFO:tasks.workunit.client.0.smithi045.stdout:1/88: dwrite d0/f16 [0,4194304] 0 2024-09-18T12:52:02.147 INFO:tasks.workunit.client.1.smithi161.stdout:9/257: mknod d0/d16/d25/c5a 0 2024-09-18T12:52:02.148 INFO:tasks.workunit.client.0.smithi045.stdout:7/115: creat d13/d19/f26 x:0 0 0 2024-09-18T12:52:02.153 INFO:tasks.workunit.client.1.smithi161.stdout:9/258: dwrite d0/d20/d49/f19 [0,4194304] 0 2024-09-18T12:52:02.156 INFO:tasks.workunit.client.1.smithi161.stdout:0/294: rename df/d30/f38 to df/d29/d46/d51/f66 0 2024-09-18T12:52:02.158 INFO:tasks.workunit.client.0.smithi045.stdout:8/100: dwrite d11/f13 [0,4194304] 0 2024-09-18T12:52:02.158 INFO:tasks.workunit.client.0.smithi045.stdout:1/89: rename d0/d12/l1a to d0/d12/l1e 0 2024-09-18T12:52:02.160 INFO:tasks.workunit.client.1.smithi161.stdout:8/355: creat d0/f7a x:0 0 0 2024-09-18T12:52:02.162 INFO:tasks.workunit.client.1.smithi161.stdout:2/332: fsync d0/f13 0 2024-09-18T12:52:02.165 INFO:tasks.workunit.client.0.smithi045.stdout:8/101: write d11/d14/f1e [670813,16078] 0 2024-09-18T12:52:02.166 INFO:tasks.workunit.client.1.smithi161.stdout:3/351: mknod d1/d2e/d68/d69/c75 0 2024-09-18T12:52:02.167 INFO:tasks.workunit.client.0.smithi045.stdout:8/102: truncate d11/d14/f1c 634341 0 2024-09-18T12:52:02.168 INFO:tasks.workunit.client.1.smithi161.stdout:8/356: dwrite d0/d3/d10/f42 [0,4194304] 0 2024-09-18T12:52:02.170 INFO:tasks.workunit.client.1.smithi161.stdout:5/261: truncate d3/fd 1660 0 2024-09-18T12:52:02.172 INFO:tasks.workunit.client.0.smithi045.stdout:8/103: stat d11/d14/l1d 0 2024-09-18T12:52:02.172 INFO:tasks.workunit.client.0.smithi045.stdout:8/104: stat l1 0 2024-09-18T12:52:02.172 INFO:tasks.workunit.client.0.smithi045.stdout:1/90: fdatasync d0/f16 0 2024-09-18T12:52:02.173 INFO:tasks.workunit.client.0.smithi045.stdout:1/91: fsync d0/fd 0 2024-09-18T12:52:02.173 INFO:tasks.workunit.client.1.smithi161.stdout:4/310: dread d5/f20 [0,4194304] 0 2024-09-18T12:52:02.174 INFO:tasks.workunit.client.1.smithi161.stdout:4/311: readlink d5/l2b 0 2024-09-18T12:52:02.177 INFO:tasks.workunit.client.0.smithi045.stdout:1/92: write d0/fe [443043,38439] 0 2024-09-18T12:52:02.179 INFO:tasks.workunit.client.1.smithi161.stdout:5/262: dwrite d3/d3b/f42 [0,4194304] 0 2024-09-18T12:52:02.184 INFO:tasks.workunit.client.0.smithi045.stdout:8/105: dwrite fa [0,4194304] 0 2024-09-18T12:52:02.184 INFO:tasks.workunit.client.1.smithi161.stdout:7/276: getdents d3/d8/d15/d1a 0 2024-09-18T12:52:02.185 INFO:tasks.workunit.client.1.smithi161.stdout:2/333: mknod d0/d1/d3b/d3d/d4f/d56/c73 0 2024-09-18T12:52:02.186 INFO:tasks.workunit.client.1.smithi161.stdout:3/352: mkdir d1/d2e/d14/d65/d76 0 2024-09-18T12:52:02.190 INFO:tasks.workunit.client.1.smithi161.stdout:8/357: mknod d0/d3/d5f/c7b 0 2024-09-18T12:52:02.192 INFO:tasks.workunit.client.1.smithi161.stdout:7/277: read d3/f14 [232675,51089] 0 2024-09-18T12:52:02.193 INFO:tasks.workunit.client.1.smithi161.stdout:8/358: chown d0/d3/d5f/l67 7959 1 2024-09-18T12:52:02.194 INFO:tasks.workunit.client.1.smithi161.stdout:9/259: symlink d0/d16/d25/d46/d53/d59/l5b 0 2024-09-18T12:52:02.195 INFO:tasks.workunit.client.1.smithi161.stdout:7/278: readlink d3/d8/d15/d1a/l2a 0 2024-09-18T12:52:02.195 INFO:tasks.workunit.client.1.smithi161.stdout:0/295: symlink df/d61/l67 0 2024-09-18T12:52:02.196 INFO:tasks.workunit.client.1.smithi161.stdout:3/353: dwrite d1/d2e/f6e [0,4194304] 0 2024-09-18T12:52:02.198 INFO:tasks.workunit.client.1.smithi161.stdout:4/312: rename d5/d14/f3f to d5/d27/f66 0 2024-09-18T12:52:02.198 INFO:tasks.workunit.client.1.smithi161.stdout:3/354: stat d1/d2e/d24/d1d/f2a 0 2024-09-18T12:52:02.198 INFO:tasks.workunit.client.1.smithi161.stdout:7/279: dread - d3/d8/d15/d1a/d24/d31/f34 zero size 2024-09-18T12:52:02.201 INFO:tasks.workunit.client.0.smithi045.stdout:1/93: getdents d0 0 2024-09-18T12:52:02.205 INFO:tasks.workunit.client.1.smithi161.stdout:9/260: dwrite d0/d16/d25/d28/f33 [0,4194304] 0 2024-09-18T12:52:02.205 INFO:tasks.workunit.client.1.smithi161.stdout:8/359: rmdir d0/d3/d10/d21/d4a 39 2024-09-18T12:52:02.206 INFO:tasks.workunit.client.1.smithi161.stdout:1/226: sync 2024-09-18T12:52:02.206 INFO:tasks.workunit.client.1.smithi161.stdout:9/261: write d0/f3b [688005,126833] 0 2024-09-18T12:52:02.207 INFO:tasks.workunit.client.0.smithi045.stdout:1/94: creat d0/f1f x:0 0 0 2024-09-18T12:52:02.207 INFO:tasks.workunit.client.1.smithi161.stdout:9/262: chown d0/db/f50 2802 1 2024-09-18T12:52:02.208 INFO:tasks.workunit.client.0.smithi045.stdout:8/106: write f6 [4322096,72343] 0 2024-09-18T12:52:02.208 INFO:tasks.workunit.client.0.smithi045.stdout:8/107: fsync f0 0 2024-09-18T12:52:02.209 INFO:tasks.workunit.client.0.smithi045.stdout:8/108: write ff [728692,83456] 0 2024-09-18T12:52:02.210 INFO:tasks.workunit.client.1.smithi161.stdout:0/296: write df/f24 [74690,119978] 0 2024-09-18T12:52:02.214 INFO:tasks.workunit.client.1.smithi161.stdout:4/313: mkdir d5/d14/d67 0 2024-09-18T12:52:02.218 INFO:tasks.workunit.client.1.smithi161.stdout:9/263: dwrite d0/f29 [4194304,4194304] 0 2024-09-18T12:52:02.220 INFO:tasks.workunit.client.1.smithi161.stdout:9/264: fdatasync d0/d20/d49/f14 0 2024-09-18T12:52:02.220 INFO:tasks.workunit.client.1.smithi161.stdout:0/297: dwrite df/d29/d2d/f4b [0,4194304] 0 2024-09-18T12:52:02.225 INFO:tasks.workunit.client.0.smithi045.stdout:8/109: getdents d11 0 2024-09-18T12:52:02.227 INFO:tasks.workunit.client.0.smithi045.stdout:8/110: dread d11/f16 [0,4194304] 0 2024-09-18T12:52:02.228 INFO:tasks.workunit.client.0.smithi045.stdout:8/111: write fd [898682,3476] 0 2024-09-18T12:52:02.231 INFO:tasks.workunit.client.0.smithi045.stdout:8/112: mknod d11/d14/c22 0 2024-09-18T12:52:02.234 INFO:tasks.workunit.client.0.smithi045.stdout:8/113: unlink d11/d14/c1a 0 2024-09-18T12:52:02.235 INFO:tasks.workunit.client.0.smithi045.stdout:8/114: write f7 [3347820,88691] 0 2024-09-18T12:52:02.236 INFO:tasks.workunit.client.0.smithi045.stdout:1/95: truncate d0/fe 246150 0 2024-09-18T12:52:02.236 INFO:tasks.workunit.client.0.smithi045.stdout:8/115: chown d11/f12 13792520 1 2024-09-18T12:52:02.237 INFO:tasks.workunit.client.0.smithi045.stdout:8/116: write f6 [1335431,105728] 0 2024-09-18T12:52:02.239 INFO:tasks.workunit.client.0.smithi045.stdout:1/96: mkdir d0/d12/d20 0 2024-09-18T12:52:02.241 INFO:tasks.workunit.client.0.smithi045.stdout:8/117: mkdir d11/d23 0 2024-09-18T12:52:02.241 INFO:tasks.workunit.client.0.smithi045.stdout:1/97: fdatasync d0/f16 0 2024-09-18T12:52:02.242 INFO:tasks.workunit.client.0.smithi045.stdout:8/118: mknod d11/d14/c24 0 2024-09-18T12:52:02.246 INFO:tasks.workunit.client.0.smithi045.stdout:8/119: getdents d11/d20 0 2024-09-18T12:52:02.250 INFO:tasks.workunit.client.0.smithi045.stdout:8/120: creat d11/f25 x:0 0 0 2024-09-18T12:52:02.250 INFO:tasks.workunit.client.0.smithi045.stdout:1/98: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:52:02.251 INFO:tasks.workunit.client.0.smithi045.stdout:8/121: fdatasync f9 0 2024-09-18T12:52:02.255 INFO:tasks.workunit.client.0.smithi045.stdout:1/99: creat d0/d12/d20/f21 x:0 0 0 2024-09-18T12:52:02.257 INFO:tasks.workunit.client.0.smithi045.stdout:8/122: dread f6 [0,4194304] 0 2024-09-18T12:52:02.257 INFO:tasks.workunit.client.0.smithi045.stdout:1/100: write d0/f2 [2375315,61341] 0 2024-09-18T12:52:02.258 INFO:tasks.workunit.client.1.smithi161.stdout:8/360: unlink d0/d3/d1e/c2c 0 2024-09-18T12:52:02.258 INFO:tasks.workunit.client.0.smithi045.stdout:8/123: dread d11/d14/f1c [0,4194304] 0 2024-09-18T12:52:02.259 INFO:tasks.workunit.client.1.smithi161.stdout:3/355: symlink d1/d2e/d14/d65/d76/l77 0 2024-09-18T12:52:02.259 INFO:tasks.workunit.client.1.smithi161.stdout:2/334: creat d0/d5/f74 x:0 0 0 2024-09-18T12:52:02.260 INFO:tasks.workunit.client.1.smithi161.stdout:3/356: stat d1/f5c 0 2024-09-18T12:52:02.262 INFO:tasks.workunit.client.0.smithi045.stdout:8/124: dread ff [0,4194304] 0 2024-09-18T12:52:02.265 INFO:tasks.workunit.client.1.smithi161.stdout:0/298: dwrite df/d29/d36/f43 [0,4194304] 0 2024-09-18T12:52:02.281 INFO:tasks.workunit.client.0.smithi045.stdout:0/59: sync 2024-09-18T12:52:02.284 INFO:tasks.workunit.client.0.smithi045.stdout:1/101: truncate d0/fa 4382142 0 2024-09-18T12:52:02.285 INFO:tasks.workunit.client.1.smithi161.stdout:5/263: getdents d3/d14/d20/d21/d24 0 2024-09-18T12:52:02.285 INFO:tasks.workunit.client.0.smithi045.stdout:8/125: dwrite ff [0,4194304] 0 2024-09-18T12:52:02.287 INFO:tasks.workunit.client.0.smithi045.stdout:1/102: write d0/d12/d20/f21 [394067,120426] 0 2024-09-18T12:52:02.288 INFO:tasks.workunit.client.1.smithi161.stdout:7/280: creat d3/d8/d15/f3c x:0 0 0 2024-09-18T12:52:02.289 INFO:tasks.workunit.client.1.smithi161.stdout:8/361: readlink d0/d3/d10/d21/d4a/d52/d66/l53 0 2024-09-18T12:52:02.290 INFO:tasks.workunit.client.0.smithi045.stdout:0/60: mkdir d6/d11 0 2024-09-18T12:52:02.290 INFO:tasks.workunit.client.0.smithi045.stdout:0/61: stat d6/d7/c9 0 2024-09-18T12:52:02.291 INFO:tasks.workunit.client.1.smithi161.stdout:1/227: link d1/da/d31/l36 d1/d26/d3a/l44 0 2024-09-18T12:52:02.292 INFO:tasks.workunit.client.1.smithi161.stdout:1/228: stat d1/d26/l1e 0 2024-09-18T12:52:02.293 INFO:tasks.workunit.client.1.smithi161.stdout:1/229: fsync d1/ff 0 2024-09-18T12:52:02.295 INFO:tasks.workunit.client.1.smithi161.stdout:7/281: dwrite d3/d8/f29 [0,4194304] 0 2024-09-18T12:52:02.297 INFO:tasks.workunit.client.0.smithi045.stdout:8/126: mknod d11/d23/c26 0 2024-09-18T12:52:02.298 INFO:tasks.workunit.client.0.smithi045.stdout:8/127: write f7 [3824478,122406] 0 2024-09-18T12:52:02.298 INFO:tasks.workunit.client.1.smithi161.stdout:6/310: sync 2024-09-18T12:52:02.300 INFO:tasks.workunit.client.1.smithi161.stdout:6/311: chown d4/d39/d47/d51 3382734 1 2024-09-18T12:52:02.300 INFO:tasks.workunit.client.0.smithi045.stdout:0/62: mknod d6/c12 0 2024-09-18T12:52:02.302 INFO:tasks.workunit.client.1.smithi161.stdout:0/299: fsync df/d29/f3b 0 2024-09-18T12:52:02.303 INFO:tasks.workunit.client.0.smithi045.stdout:0/63: write d6/d7/fa [206974,94004] 0 2024-09-18T12:52:02.303 INFO:tasks.workunit.client.1.smithi161.stdout:1/230: dwrite d1/d26/fe [0,4194304] 0 2024-09-18T12:52:02.305 INFO:tasks.workunit.client.0.smithi045.stdout:1/103: rename d0/f9 to d0/d12/d20/f22 0 2024-09-18T12:52:02.306 INFO:tasks.workunit.client.1.smithi161.stdout:5/264: rmdir d3/d14 39 2024-09-18T12:52:02.316 INFO:tasks.workunit.client.1.smithi161.stdout:8/362: dread d0/d3/d10/d21/d4a/f4f [0,4194304] 0 2024-09-18T12:52:02.316 INFO:tasks.workunit.client.1.smithi161.stdout:8/363: stat d0/d3/d5f/f78 0 2024-09-18T12:52:02.318 INFO:tasks.workunit.client.0.smithi045.stdout:8/128: link d11/d14/f1e d11/d20/f27 0 2024-09-18T12:52:02.322 INFO:tasks.workunit.client.1.smithi161.stdout:6/312: chown d4/d39/d46/c4f 3 1 2024-09-18T12:52:02.322 INFO:tasks.workunit.client.0.smithi045.stdout:8/129: write f6 [936115,30313] 0 2024-09-18T12:52:02.323 INFO:tasks.workunit.client.1.smithi161.stdout:0/300: write df/d29/d2d/d37/f48 [849126,93650] 0 2024-09-18T12:52:02.323 INFO:tasks.workunit.client.1.smithi161.stdout:4/314: sync 2024-09-18T12:52:02.325 INFO:tasks.workunit.client.0.smithi045.stdout:1/104: write d0/f7 [1598263,88368] 0 2024-09-18T12:52:02.325 INFO:tasks.workunit.client.0.smithi045.stdout:0/64: rmdir d6/d11 0 2024-09-18T12:52:02.327 INFO:tasks.workunit.client.1.smithi161.stdout:2/335: creat d0/f75 x:0 0 0 2024-09-18T12:52:02.328 INFO:tasks.workunit.client.1.smithi161.stdout:3/357: dwrite d1/d2e/f17 [0,4194304] 0 2024-09-18T12:52:02.329 INFO:tasks.workunit.client.0.smithi045.stdout:0/65: mknod d6/d7/c13 0 2024-09-18T12:52:02.330 INFO:tasks.workunit.client.1.smithi161.stdout:3/358: dread - d1/d2e/d14/d2c/f31 zero size 2024-09-18T12:52:02.331 INFO:tasks.workunit.client.1.smithi161.stdout:9/265: link d0/d20/d49/c43 d0/d16/d25/d46/d53/d59/c5c 0 2024-09-18T12:52:02.332 INFO:tasks.workunit.client.1.smithi161.stdout:6/313: unlink d4/d1a/f60 0 2024-09-18T12:52:02.332 INFO:tasks.workunit.client.1.smithi161.stdout:0/301: rmdir df/d30/d4d 39 2024-09-18T12:52:02.333 INFO:tasks.workunit.client.0.smithi045.stdout:0/66: creat d6/d7/f14 x:0 0 0 2024-09-18T12:52:02.334 INFO:tasks.workunit.client.0.smithi045.stdout:8/130: dwrite ff [4194304,4194304] 0 2024-09-18T12:52:02.334 INFO:tasks.workunit.client.1.smithi161.stdout:5/265: dwrite d3/d9/d4b/f4f [0,4194304] 0 2024-09-18T12:52:02.335 INFO:tasks.workunit.client.0.smithi045.stdout:0/67: dread - d6/d7/ff zero size 2024-09-18T12:52:02.335 INFO:tasks.workunit.client.1.smithi161.stdout:0/302: chown df/l2a 19987 1 2024-09-18T12:52:02.335 INFO:tasks.workunit.client.0.smithi045.stdout:0/68: dread - d6/d7/ff zero size 2024-09-18T12:52:02.336 INFO:tasks.workunit.client.1.smithi161.stdout:5/266: stat d3/d9/f38 0 2024-09-18T12:52:02.338 INFO:tasks.workunit.client.1.smithi161.stdout:2/336: unlink d0/d1/df/f6e 0 2024-09-18T12:52:02.342 INFO:tasks.workunit.client.0.smithi045.stdout:0/69: rename d6/d7/fe to d6/d7/f15 0 2024-09-18T12:52:02.343 INFO:tasks.workunit.client.1.smithi161.stdout:3/359: mkdir d1/d2e/d14/d78 0 2024-09-18T12:52:02.344 INFO:tasks.workunit.client.0.smithi045.stdout:0/70: write d6/d7/ff [391069,66134] 0 2024-09-18T12:52:02.344 INFO:tasks.workunit.client.0.smithi045.stdout:8/131: mknod d11/d20/c28 0 2024-09-18T12:52:02.344 INFO:tasks.workunit.client.0.smithi045.stdout:0/71: readlink d6/ld 0 2024-09-18T12:52:02.350 INFO:tasks.workunit.client.0.smithi045.stdout:0/72: fdatasync d6/d7/ff 0 2024-09-18T12:52:02.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.351+0000 7feb15901640 1 -- 172.21.15.45:0/720023615 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feb10062630 con 0x7feaf8074ab0 2024-09-18T12:52:02.353 INFO:tasks.workunit.client.1.smithi161.stdout:3/360: dwrite d1/d2e/d24/d1d/f64 [0,4194304] 0 2024-09-18T12:52:02.353 INFO:tasks.workunit.client.1.smithi161.stdout:3/361: chown d1/d2e/d14 58 1 2024-09-18T12:52:02.354 INFO:tasks.workunit.client.1.smithi161.stdout:6/314: unlink d4/d39/d26/d20/c4e 0 2024-09-18T12:52:02.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.353+0000 7feb148ff640 1 -- 172.21.15.45:0/720023615 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7feb10062630 con 0x7feaf8074ab0 2024-09-18T12:52:02.355 INFO:tasks.workunit.client.0.smithi045.stdout:0/73: dread f4 [0,4194304] 0 2024-09-18T12:52:02.355 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:52:02.355 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:52:02.355 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:52:02.355 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:52:02.356 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [], 2024-09-18T12:52:02.356 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "1/2 daemons upgraded", 2024-09-18T12:52:02.356 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "", 2024-09-18T12:52:02.356 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:52:02.356 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:52:02.356 INFO:tasks.workunit.client.0.smithi045.stdout:0/74: write d6/d7/fa [1332782,130215] 0 2024-09-18T12:52:02.357 INFO:tasks.workunit.client.0.smithi045.stdout:1/105: truncate d0/f6 123397 0 2024-09-18T12:52:02.357 INFO:tasks.workunit.client.1.smithi161.stdout:9/266: creat d0/d16/d25/d46/d53/d59/f5d x:0 0 0 2024-09-18T12:52:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 -- 172.21.15.45:0/720023615 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7feaf8074ab0 msgr2=0x7feaf8076f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7feaf8074ab0 0x7feaf8076f70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb1019ef80 tx=0x7feb04009620 comp rx=0 tx=0).stop 2024-09-18T12:52:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 -- 172.21.15.45:0/720023615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb100ffc10 msgr2=0x7feb1019dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb100ffc10 0x7feb1019dad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feb0000e940 tx=0x7feb0000ee00 comp rx=0 tx=0).stop 2024-09-18T12:52:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 -- 172.21.15.45:0/720023615 shutdown_connections 2024-09-18T12:52:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7feaf8074ab0 0x7feaf8076f70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb10102bf0 0x7feb1019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 --2- 172.21.15.45:0/720023615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb100ffc10 0x7feb1019dad0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 -- 172.21.15.45:0/720023615 >> 172.21.15.45:0/720023615 conn(0x7feb100fb760 msgr2=0x7feb10104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:02.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 -- 172.21.15.45:0/720023615 shutdown_connections 2024-09-18T12:52:02.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:02.357+0000 7feb15901640 1 -- 172.21.15.45:0/720023615 wait complete. 2024-09-18T12:52:02.360 INFO:tasks.workunit.client.1.smithi161.stdout:8/364: dread d0/f12 [0,4194304] 0 2024-09-18T12:52:02.361 INFO:tasks.workunit.client.1.smithi161.stdout:8/365: chown d0/d3/d10/f6c 456706 1 2024-09-18T12:52:02.361 INFO:tasks.workunit.client.1.smithi161.stdout:0/303: mknod df/d29/c68 0 2024-09-18T12:52:02.361 INFO:tasks.workunit.client.1.smithi161.stdout:0/304: fsync df/f32 0 2024-09-18T12:52:02.365 INFO:tasks.workunit.client.0.smithi045.stdout:1/106: dwrite d0/f1f [0,4194304] 0 2024-09-18T12:52:02.366 INFO:tasks.workunit.client.1.smithi161.stdout:8/366: dwrite d0/d3/d10/f18 [0,4194304] 0 2024-09-18T12:52:02.369 INFO:tasks.workunit.client.1.smithi161.stdout:4/315: truncate d5/f8 6748898 0 2024-09-18T12:52:02.374 INFO:tasks.workunit.client.1.smithi161.stdout:7/282: getdents d3/d8/d15/d1a/d24 0 2024-09-18T12:52:02.376 INFO:tasks.workunit.client.0.smithi045.stdout:8/132: dwrite d11/d20/f27 [0,4194304] 0 2024-09-18T12:52:02.377 INFO:tasks.workunit.client.0.smithi045.stdout:0/75: link d6/ld d6/d7/l16 0 2024-09-18T12:52:02.377 INFO:tasks.workunit.client.0.smithi045.stdout:8/133: write f7 [2728422,92278] 0 2024-09-18T12:52:02.378 INFO:tasks.workunit.client.1.smithi161.stdout:1/231: getdents d1/da/d31 0 2024-09-18T12:52:02.379 INFO:tasks.workunit.client.0.smithi045.stdout:8/134: write f9 [4103992,72332] 0 2024-09-18T12:52:02.382 INFO:tasks.workunit.client.1.smithi161.stdout:3/362: creat d1/d2e/d14/d65/f79 x:0 0 0 2024-09-18T12:52:02.384 INFO:tasks.workunit.client.0.smithi045.stdout:0/76: mknod d6/d7/c17 0 2024-09-18T12:52:02.386 INFO:tasks.workunit.client.1.smithi161.stdout:6/315: creat d4/d39/d3a/f62 x:0 0 0 2024-09-18T12:52:02.388 INFO:tasks.workunit.client.0.smithi045.stdout:1/107: creat d0/f23 x:0 0 0 2024-09-18T12:52:02.388 INFO:tasks.workunit.client.1.smithi161.stdout:0/305: mkdir df/d29/d2d/d69 0 2024-09-18T12:52:02.389 INFO:tasks.workunit.client.1.smithi161.stdout:0/306: readlink df/l2f 0 2024-09-18T12:52:02.389 INFO:tasks.workunit.client.0.smithi045.stdout:8/135: read d11/d14/f1c [597680,107258] 0 2024-09-18T12:52:02.389 INFO:tasks.workunit.client.1.smithi161.stdout:0/307: write df/f50 [3648059,82733] 0 2024-09-18T12:52:02.390 INFO:tasks.workunit.client.1.smithi161.stdout:5/267: symlink d3/l55 0 2024-09-18T12:52:02.390 INFO:tasks.workunit.client.0.smithi045.stdout:0/77: readlink l3 0 2024-09-18T12:52:02.391 INFO:tasks.workunit.client.1.smithi161.stdout:8/367: write d0/f9 [4877578,28960] 0 2024-09-18T12:52:02.392 INFO:tasks.workunit.client.1.smithi161.stdout:4/316: fsync d5/fc 0 2024-09-18T12:52:02.393 INFO:tasks.workunit.client.1.smithi161.stdout:4/317: fsync d5/ff 0 2024-09-18T12:52:02.393 INFO:tasks.workunit.client.0.smithi045.stdout:1/108: rmdir d0 39 2024-09-18T12:52:02.394 INFO:tasks.workunit.client.1.smithi161.stdout:2/337: mknod d0/d5/d43/c76 0 2024-09-18T12:52:02.395 INFO:tasks.workunit.client.1.smithi161.stdout:2/338: write d0/d4/f62 [815241,110101] 0 2024-09-18T12:52:02.396 INFO:tasks.workunit.client.1.smithi161.stdout:7/283: mknod d3/d8/d15/d1a/d24/d31/c3d 0 2024-09-18T12:52:02.397 INFO:tasks.workunit.client.0.smithi045.stdout:8/136: dwrite fd [0,4194304] 0 2024-09-18T12:52:02.398 INFO:tasks.workunit.client.1.smithi161.stdout:4/318: dread d5/f17 [0,4194304] 0 2024-09-18T12:52:02.399 INFO:tasks.workunit.client.0.smithi045.stdout:8/137: write f7 [2874865,130272] 0 2024-09-18T12:52:02.399 INFO:tasks.workunit.client.0.smithi045.stdout:0/78: unlink d6/d7/l8 0 2024-09-18T12:52:02.399 INFO:tasks.workunit.client.1.smithi161.stdout:4/319: chown d5/d14/l51 298 1 2024-09-18T12:52:02.400 INFO:tasks.workunit.client.1.smithi161.stdout:1/232: mkdir d1/da/d1f/d45 0 2024-09-18T12:52:02.401 INFO:tasks.workunit.client.1.smithi161.stdout:1/233: write d1/d26/d3a/f3b [29034,32581] 0 2024-09-18T12:52:02.405 INFO:tasks.workunit.client.0.smithi045.stdout:8/138: symlink d11/d20/l29 0 2024-09-18T12:52:02.406 INFO:tasks.workunit.client.1.smithi161.stdout:9/267: truncate d0/d16/d25/f27 584835 0 2024-09-18T12:52:02.407 INFO:tasks.workunit.client.0.smithi045.stdout:0/79: fsync d6/d7/f15 0 2024-09-18T12:52:02.408 INFO:tasks.workunit.client.0.smithi045.stdout:0/80: fsync d6/d7/ff 0 2024-09-18T12:52:02.409 INFO:tasks.workunit.client.1.smithi161.stdout:6/316: creat d4/d1a/d1c/d3e/f63 x:0 0 0 2024-09-18T12:52:02.409 INFO:tasks.workunit.client.0.smithi045.stdout:0/81: fdatasync d6/d7/fa 0 2024-09-18T12:52:02.410 INFO:tasks.workunit.client.0.smithi045.stdout:1/109: readlink d0/l19 0 2024-09-18T12:52:02.410 INFO:tasks.workunit.client.1.smithi161.stdout:6/317: fdatasync d4/d1a/d1c/d3e/f42 0 2024-09-18T12:52:02.412 INFO:tasks.workunit.client.1.smithi161.stdout:2/339: dread d0/f24 [0,4194304] 0 2024-09-18T12:52:02.413 INFO:tasks.workunit.client.1.smithi161.stdout:9/268: dwrite d0/d16/d25/d46/d53/f56 [0,4194304] 0 2024-09-18T12:52:02.413 INFO:tasks.workunit.client.0.smithi045.stdout:8/139: creat d11/d23/f2a x:0 0 0 2024-09-18T12:52:02.414 INFO:tasks.workunit.client.0.smithi045.stdout:8/140: stat d11/f17 0 2024-09-18T12:52:02.414 INFO:tasks.workunit.client.1.smithi161.stdout:9/269: write d0/f29 [5249380,12747] 0 2024-09-18T12:52:02.416 INFO:tasks.workunit.client.0.smithi045.stdout:1/110: dwrite d0/f1f [0,4194304] 0 2024-09-18T12:52:02.418 INFO:tasks.workunit.client.0.smithi045.stdout:0/82: rmdir d6/d7 39 2024-09-18T12:52:02.418 INFO:tasks.workunit.client.0.smithi045.stdout:0/83: read f4 [1047977,9456] 0 2024-09-18T12:52:02.422 INFO:tasks.workunit.client.1.smithi161.stdout:2/340: dwrite d0/d4/f68 [0,4194304] 0 2024-09-18T12:52:02.423 INFO:tasks.workunit.client.0.smithi045.stdout:8/141: stat d11/d14/c1f 0 2024-09-18T12:52:02.424 INFO:tasks.workunit.client.1.smithi161.stdout:8/368: rmdir d0/d3/d10/d21/d4a/d52/d66 39 2024-09-18T12:52:02.426 INFO:tasks.workunit.client.1.smithi161.stdout:2/341: write d0/d5/f74 [364452,110785] 0 2024-09-18T12:52:02.426 INFO:tasks.workunit.client.1.smithi161.stdout:0/308: write df/d30/f3a [1083851,59104] 0 2024-09-18T12:52:02.427 INFO:tasks.workunit.client.0.smithi045.stdout:0/84: write f4 [2656585,42438] 0 2024-09-18T12:52:02.427 INFO:tasks.workunit.client.0.smithi045.stdout:0/85: readlink d6/ld 0 2024-09-18T12:52:02.428 INFO:tasks.workunit.client.1.smithi161.stdout:2/342: dread - d0/d4/d52/f59 zero size 2024-09-18T12:52:02.429 INFO:tasks.workunit.client.0.smithi045.stdout:8/142: rename d11/f25 to d11/d23/f2b 0 2024-09-18T12:52:02.429 INFO:tasks.workunit.client.0.smithi045.stdout:1/111: dread d0/fd [0,4194304] 0 2024-09-18T12:52:02.430 INFO:tasks.workunit.client.0.smithi045.stdout:8/143: write f0 [5148185,99323] 0 2024-09-18T12:52:02.432 INFO:tasks.workunit.client.1.smithi161.stdout:7/284: symlink d3/d8/d15/d1a/d24/l3e 0 2024-09-18T12:52:02.434 INFO:tasks.workunit.client.0.smithi045.stdout:0/86: dread - d6/d7/f14 zero size 2024-09-18T12:52:02.435 INFO:tasks.workunit.client.0.smithi045.stdout:0/87: dread - d6/d7/f14 zero size 2024-09-18T12:52:02.437 INFO:tasks.workunit.client.1.smithi161.stdout:1/234: fsync d1/d26/f8 0 2024-09-18T12:52:02.437 INFO:tasks.workunit.client.1.smithi161.stdout:3/363: rename d1/d2e/d3d/d53 to d1/d2e/d14/d65/d7a 0 2024-09-18T12:52:02.438 INFO:tasks.workunit.client.0.smithi045.stdout:1/112: creat d0/d12/f24 x:0 0 0 2024-09-18T12:52:02.442 INFO:tasks.workunit.client.0.smithi045.stdout:1/113: stat d0/f6 0 2024-09-18T12:52:02.442 INFO:tasks.workunit.client.0.smithi045.stdout:0/88: dwrite d6/d7/fa [0,4194304] 0 2024-09-18T12:52:02.442 INFO:tasks.workunit.client.0.smithi045.stdout:1/114: chown d0/d12 2 1 2024-09-18T12:52:02.443 INFO:tasks.workunit.client.0.smithi045.stdout:0/89: chown d6 1222 1 2024-09-18T12:52:02.444 INFO:tasks.workunit.client.1.smithi161.stdout:5/268: chown d3/d44/c45 1891 1 2024-09-18T12:52:02.446 INFO:tasks.workunit.client.1.smithi161.stdout:9/270: chown d0/d16/d25/d46/d53/d59/c5c 5671 1 2024-09-18T12:52:02.448 INFO:tasks.workunit.client.0.smithi045.stdout:1/115: mkdir d0/d12/d25 0 2024-09-18T12:52:02.450 INFO:tasks.workunit.client.0.smithi045.stdout:0/90: mknod d6/c18 0 2024-09-18T12:52:02.451 INFO:tasks.workunit.client.0.smithi045.stdout:0/91: stat d6/d7/c10 0 2024-09-18T12:52:02.457 INFO:tasks.workunit.client.0.smithi045.stdout:1/116: dread d0/f2 [0,4194304] 0 2024-09-18T12:52:02.458 INFO:tasks.workunit.client.1.smithi161.stdout:8/369: unlink d0/d3/d10/d21/l26 0 2024-09-18T12:52:02.459 INFO:tasks.workunit.client.0.smithi045.stdout:0/92: unlink d6/d7/cc 0 2024-09-18T12:52:02.460 INFO:tasks.workunit.client.1.smithi161.stdout:2/343: symlink d0/d1/d3b/d3d/d4f/d56/l77 0 2024-09-18T12:52:02.461 INFO:tasks.workunit.client.1.smithi161.stdout:2/344: truncate d0/d4/d52/f59 748028 0 2024-09-18T12:52:02.462 INFO:tasks.workunit.client.0.smithi045.stdout:1/117: mknod d0/d12/c26 0 2024-09-18T12:52:02.463 INFO:tasks.workunit.client.0.smithi045.stdout:0/93: creat d6/d7/f19 x:0 0 0 2024-09-18T12:52:02.464 INFO:tasks.workunit.client.0.smithi045.stdout:0/94: fdatasync d6/d7/f15 0 2024-09-18T12:52:02.465 INFO:tasks.workunit.client.1.smithi161.stdout:4/320: link d5/d27/d3a/d4c/f57 d5/d32/d39/d4d/f68 0 2024-09-18T12:52:02.465 INFO:tasks.workunit.client.0.smithi045.stdout:0/95: dread - d6/d7/f14 zero size 2024-09-18T12:52:02.466 INFO:tasks.workunit.client.1.smithi161.stdout:4/321: write d5/d14/f23 [220378,50781] 0 2024-09-18T12:52:02.467 INFO:tasks.workunit.client.0.smithi045.stdout:1/118: creat d0/d12/f27 x:0 0 0 2024-09-18T12:52:02.468 INFO:tasks.workunit.client.1.smithi161.stdout:1/235: mknod d1/d26/c46 0 2024-09-18T12:52:02.469 INFO:tasks.workunit.client.0.smithi045.stdout:1/119: dread d0/fd [0,4194304] 0 2024-09-18T12:52:02.470 INFO:tasks.workunit.client.1.smithi161.stdout:6/318: symlink d4/d1a/d1c/l64 0 2024-09-18T12:52:02.471 INFO:tasks.workunit.client.0.smithi045.stdout:0/96: symlink d6/l1a 0 2024-09-18T12:52:02.473 INFO:tasks.workunit.client.1.smithi161.stdout:0/309: getdents df/d29/d2d/d69 0 2024-09-18T12:52:02.474 INFO:tasks.workunit.client.1.smithi161.stdout:0/310: write df/d30/f3a [1137658,121089] 0 2024-09-18T12:52:02.475 INFO:tasks.workunit.client.1.smithi161.stdout:2/345: mkdir d0/d4/d78 0 2024-09-18T12:52:02.476 INFO:tasks.workunit.client.1.smithi161.stdout:4/322: read d5/f16 [2344052,75785] 0 2024-09-18T12:52:02.477 INFO:tasks.workunit.client.0.smithi045.stdout:0/97: dwrite d6/d7/f14 [0,4194304] 0 2024-09-18T12:52:02.479 INFO:tasks.workunit.client.1.smithi161.stdout:0/311: dread df/d29/d2d/d37/f48 [0,4194304] 0 2024-09-18T12:52:02.479 INFO:tasks.workunit.client.1.smithi161.stdout:3/364: symlink d1/d2e/d3d/d49/l7b 0 2024-09-18T12:52:02.480 INFO:tasks.workunit.client.1.smithi161.stdout:6/319: symlink d4/d39/d47/l65 0 2024-09-18T12:52:02.481 INFO:tasks.workunit.client.0.smithi045.stdout:0/98: symlink d6/d7/l1b 0 2024-09-18T12:52:02.485 INFO:tasks.workunit.client.1.smithi161.stdout:8/370: mknod d0/d3/d10/d21/c7c 0 2024-09-18T12:52:02.486 INFO:tasks.workunit.client.1.smithi161.stdout:8/371: write d0/d3/d5f/f72 [159464,66147] 0 2024-09-18T12:52:02.489 INFO:tasks.workunit.client.0.smithi045.stdout:0/99: dwrite f4 [0,4194304] 0 2024-09-18T12:52:02.490 INFO:tasks.workunit.client.0.smithi045.stdout:0/100: fsync d6/d7/ff 0 2024-09-18T12:52:02.491 INFO:tasks.workunit.client.1.smithi161.stdout:1/236: creat d1/da/d1f/d45/f47 x:0 0 0 2024-09-18T12:52:02.491 INFO:tasks.workunit.client.0.smithi045.stdout:0/101: readlink d6/d7/l1b 0 2024-09-18T12:52:02.492 INFO:tasks.workunit.client.0.smithi045.stdout:0/102: dread - d6/d7/f19 zero size 2024-09-18T12:52:02.495 INFO:tasks.workunit.client.1.smithi161.stdout:0/312: mknod df/d29/c6a 0 2024-09-18T12:52:02.496 INFO:tasks.workunit.client.1.smithi161.stdout:6/320: rmdir d4 39 2024-09-18T12:52:02.497 INFO:tasks.workunit.client.0.smithi045.stdout:0/103: dread d6/d7/ff [0,4194304] 0 2024-09-18T12:52:02.498 INFO:tasks.workunit.client.1.smithi161.stdout:5/269: creat d3/f56 x:0 0 0 2024-09-18T12:52:02.499 INFO:tasks.workunit.client.1.smithi161.stdout:9/271: truncate d0/d16/d25/f27 401205 0 2024-09-18T12:52:02.499 INFO:tasks.workunit.client.0.smithi045.stdout:1/120: dwrite d0/f6 [0,4194304] 0 2024-09-18T12:52:02.500 INFO:tasks.workunit.client.1.smithi161.stdout:0/313: dread df/d29/f3c [0,4194304] 0 2024-09-18T12:52:02.501 INFO:tasks.workunit.client.1.smithi161.stdout:8/372: chown d0/d3/d10/d21/d4a/d52/d70/l79 53569914 1 2024-09-18T12:52:02.503 INFO:tasks.workunit.client.0.smithi045.stdout:0/104: mkdir d6/d7/d1c 0 2024-09-18T12:52:02.503 INFO:tasks.workunit.client.0.smithi045.stdout:0/105: readlink l3 0 2024-09-18T12:52:02.505 INFO:tasks.workunit.client.0.smithi045.stdout:0/106: truncate d6/d7/fa 4256735 0 2024-09-18T12:52:02.505 INFO:tasks.workunit.client.0.smithi045.stdout:1/121: creat d0/d12/d20/f28 x:0 0 0 2024-09-18T12:52:02.508 INFO:tasks.workunit.client.0.smithi045.stdout:0/107: rmdir d6/d7 39 2024-09-18T12:52:02.509 INFO:tasks.workunit.client.1.smithi161.stdout:4/323: mkdir d5/d14/d5f/d69 0 2024-09-18T12:52:02.509 INFO:tasks.workunit.client.1.smithi161.stdout:4/324: readlink d5/l6 0 2024-09-18T12:52:02.510 INFO:tasks.workunit.client.1.smithi161.stdout:4/325: stat d5/d27/d3a/d4c/f64 0 2024-09-18T12:52:02.512 INFO:tasks.workunit.client.1.smithi161.stdout:3/365: mknod d1/c7c 0 2024-09-18T12:52:02.513 INFO:tasks.workunit.client.0.smithi045.stdout:1/122: getdents d0/d12/d17 0 2024-09-18T12:52:02.515 INFO:tasks.workunit.client.1.smithi161.stdout:5/270: write d3/d14/f19 [3075100,30248] 0 2024-09-18T12:52:02.516 INFO:tasks.workunit.client.1.smithi161.stdout:9/272: creat d0/d20/f5e x:0 0 0 2024-09-18T12:52:02.517 INFO:tasks.workunit.client.1.smithi161.stdout:7/285: sync 2024-09-18T12:52:02.517 INFO:tasks.workunit.client.1.smithi161.stdout:7/286: chown d3/f7 6013 1 2024-09-18T12:52:02.518 INFO:tasks.workunit.client.0.smithi045.stdout:0/108: creat d6/f1d x:0 0 0 2024-09-18T12:52:02.518 INFO:tasks.workunit.client.1.smithi161.stdout:8/373: mknod d0/d3/d10/c7d 0 2024-09-18T12:52:02.520 INFO:tasks.workunit.client.1.smithi161.stdout:8/374: write d0/d3/d1e/d34/f25 [2616683,35773] 0 2024-09-18T12:52:02.521 INFO:tasks.workunit.client.1.smithi161.stdout:1/237: mkdir d1/d48 0 2024-09-18T12:52:02.521 INFO:tasks.workunit.client.1.smithi161.stdout:8/375: write d0/d3/d10/d21/f37 [1063023,77315] 0 2024-09-18T12:52:02.521 INFO:tasks.workunit.client.1.smithi161.stdout:2/346: link d0/d1/d3b/d3d/c69 d0/d1/d3b/d3d/c79 0 2024-09-18T12:52:02.523 INFO:tasks.workunit.client.1.smithi161.stdout:2/347: stat d0/d5/d43/d35/f5f 0 2024-09-18T12:52:02.523 INFO:tasks.workunit.client.1.smithi161.stdout:3/366: mkdir d1/d2e/d68/d69/d7d 0 2024-09-18T12:52:02.524 INFO:tasks.workunit.client.1.smithi161.stdout:3/367: chown d1/c1c 233 1 2024-09-18T12:52:02.524 INFO:tasks.workunit.client.0.smithi045.stdout:1/123: write d0/d12/d20/f22 [4924598,97902] 0 2024-09-18T12:52:02.527 INFO:tasks.workunit.client.1.smithi161.stdout:0/314: rename df/d29/d46/c56 to df/d29/d2d/d37/c6b 0 2024-09-18T12:52:02.532 INFO:tasks.workunit.client.1.smithi161.stdout:6/321: creat d4/d61/f66 x:0 0 0 2024-09-18T12:52:02.532 INFO:tasks.workunit.client.0.smithi045.stdout:1/124: dwrite d0/fb [0,4194304] 0 2024-09-18T12:52:02.533 INFO:tasks.workunit.client.0.smithi045.stdout:1/125: dread - d0/d12/f13 zero size 2024-09-18T12:52:02.535 INFO:tasks.workunit.client.1.smithi161.stdout:3/368: chown d1/d2e/f4b 0 1 2024-09-18T12:52:02.535 INFO:tasks.workunit.client.1.smithi161.stdout:9/273: truncate d0/fd 1320006 0 2024-09-18T12:52:02.536 INFO:tasks.workunit.client.1.smithi161.stdout:9/274: write d0/d20/d49/f19 [595129,110786] 0 2024-09-18T12:52:02.537 INFO:tasks.workunit.client.1.smithi161.stdout:9/275: dread - d0/d20/f5e zero size 2024-09-18T12:52:02.538 INFO:tasks.workunit.client.1.smithi161.stdout:9/276: stat d0/f3b 0 2024-09-18T12:52:02.540 INFO:tasks.workunit.client.1.smithi161.stdout:7/287: symlink d3/d8/l3f 0 2024-09-18T12:52:02.542 INFO:tasks.workunit.client.0.smithi045.stdout:1/126: dwrite d0/d12/d20/f21 [0,4194304] 0 2024-09-18T12:52:02.542 INFO:tasks.workunit.client.1.smithi161.stdout:5/271: rename d3/l27 to d3/d8/l57 0 2024-09-18T12:52:02.542 INFO:tasks.workunit.client.1.smithi161.stdout:1/238: dread d1/da/d31/f3e [0,4194304] 0 2024-09-18T12:52:02.543 INFO:tasks.workunit.client.1.smithi161.stdout:0/315: creat df/d61/f6c x:0 0 0 2024-09-18T12:52:02.543 INFO:tasks.workunit.client.1.smithi161.stdout:1/239: write d1/d26/f8 [4529167,30455] 0 2024-09-18T12:52:02.544 INFO:tasks.workunit.client.1.smithi161.stdout:8/376: symlink d0/d3/d1e/l7e 0 2024-09-18T12:52:02.544 INFO:tasks.workunit.client.1.smithi161.stdout:1/240: stat d1/da/l34 0 2024-09-18T12:52:02.546 INFO:tasks.workunit.client.1.smithi161.stdout:3/369: symlink d1/d2e/d14/d65/d76/l7e 0 2024-09-18T12:52:02.547 INFO:tasks.workunit.client.0.smithi045.stdout:1/127: dread d0/d12/d20/f21 [0,4194304] 0 2024-09-18T12:52:02.549 INFO:tasks.workunit.client.1.smithi161.stdout:7/288: mknod d3/d8/d15/d1a/d24/d31/c40 0 2024-09-18T12:52:02.551 INFO:tasks.workunit.client.1.smithi161.stdout:2/348: rename d0/d1/d3b/f42 to d0/d5/d43/d35/f7a 0 2024-09-18T12:52:02.552 INFO:tasks.workunit.client.1.smithi161.stdout:2/349: chown d0/d5/d53/c3c 7 1 2024-09-18T12:52:02.552 INFO:tasks.workunit.client.1.smithi161.stdout:5/272: creat d3/d9/d4b/f58 x:0 0 0 2024-09-18T12:52:02.554 INFO:tasks.workunit.client.1.smithi161.stdout:5/273: readlink d3/d14/d20/d21/d24/l4a 0 2024-09-18T12:52:02.555 INFO:tasks.workunit.client.1.smithi161.stdout:0/316: symlink df/d29/d2d/d37/l6d 0 2024-09-18T12:52:02.558 INFO:tasks.workunit.client.1.smithi161.stdout:1/241: truncate d1/d26/f9 385186 0 2024-09-18T12:52:02.559 INFO:tasks.workunit.client.1.smithi161.stdout:1/242: write d1/d26/f13 [2493550,118557] 0 2024-09-18T12:52:02.559 INFO:tasks.workunit.client.1.smithi161.stdout:9/277: mknod d0/d16/c5f 0 2024-09-18T12:52:02.560 INFO:tasks.workunit.client.1.smithi161.stdout:7/289: creat d3/d8/d15/d1a/f41 x:0 0 0 2024-09-18T12:52:02.561 INFO:tasks.workunit.client.1.smithi161.stdout:7/290: write d3/f23 [1036133,76074] 0 2024-09-18T12:52:02.562 INFO:tasks.workunit.client.1.smithi161.stdout:3/370: rename d1/l40 to d1/d2e/d24/l7f 0 2024-09-18T12:52:02.563 INFO:tasks.workunit.client.1.smithi161.stdout:3/371: fsync d1/d2e/d14/f58 0 2024-09-18T12:52:02.564 INFO:tasks.workunit.client.1.smithi161.stdout:5/274: creat d3/d8/f59 x:0 0 0 2024-09-18T12:52:02.565 INFO:tasks.workunit.client.1.smithi161.stdout:0/317: creat df/d29/d2d/f6e x:0 0 0 2024-09-18T12:52:02.566 INFO:tasks.workunit.client.0.smithi045.stdout:1/128: truncate d0/f6 2819589 0 2024-09-18T12:52:02.567 INFO:tasks.workunit.client.1.smithi161.stdout:9/278: creat d0/d16/d25/d28/d45/f60 x:0 0 0 2024-09-18T12:52:02.567 INFO:tasks.workunit.client.1.smithi161.stdout:2/350: dread d0/d1/d3b/d3d/d4f/d56/f70 [0,4194304] 0 2024-09-18T12:52:02.569 INFO:tasks.workunit.client.1.smithi161.stdout:6/322: getdents d4/d1a/d1c 0 2024-09-18T12:52:02.570 INFO:tasks.workunit.client.1.smithi161.stdout:7/291: symlink d3/d8/d15/d1a/d24/l42 0 2024-09-18T12:52:02.579 INFO:tasks.workunit.client.1.smithi161.stdout:9/279: creat d0/d47/d48/f61 x:0 0 0 2024-09-18T12:52:02.580 INFO:tasks.workunit.client.1.smithi161.stdout:6/323: symlink d4/d39/d48/l67 0 2024-09-18T12:52:02.583 INFO:tasks.workunit.client.1.smithi161.stdout:8/377: link d0/d3/d1e/l7e d0/d3/d1e/l7f 0 2024-09-18T12:52:02.584 INFO:tasks.workunit.client.1.smithi161.stdout:0/318: symlink df/d30/d4d/l6f 0 2024-09-18T12:52:02.586 INFO:tasks.workunit.client.0.smithi045.stdout:1/129: dwrite d0/d12/f15 [0,4194304] 0 2024-09-18T12:52:02.586 INFO:tasks.workunit.client.1.smithi161.stdout:9/280: dwrite d0/db/f3c [0,4194304] 0 2024-09-18T12:52:02.589 INFO:tasks.workunit.client.1.smithi161.stdout:3/372: link d1/d2e/d68/f74 d1/d2e/d3d/f80 0 2024-09-18T12:52:02.592 INFO:tasks.workunit.client.1.smithi161.stdout:1/243: truncate d1/da/f18 2705007 0 2024-09-18T12:52:02.595 INFO:tasks.workunit.client.1.smithi161.stdout:5/275: dwrite d3/d14/f30 [0,4194304] 0 2024-09-18T12:52:02.595 INFO:tasks.workunit.client.0.smithi045.stdout:1/130: dread d0/fa [0,4194304] 0 2024-09-18T12:52:02.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/378: dwrite d0/d3/d10/f42 [0,4194304] 0 2024-09-18T12:52:02.598 INFO:tasks.workunit.client.1.smithi161.stdout:0/319: dwrite df/f32 [0,4194304] 0 2024-09-18T12:52:02.599 INFO:tasks.workunit.client.0.smithi045.stdout:1/131: fdatasync d0/d12/d20/f21 0 2024-09-18T12:52:02.599 INFO:tasks.workunit.client.1.smithi161.stdout:4/326: sync 2024-09-18T12:52:02.599 INFO:tasks.workunit.client.1.smithi161.stdout:5/276: write d3/f13 [3296111,28722] 0 2024-09-18T12:52:02.599 INFO:tasks.workunit.client.1.smithi161.stdout:2/351: creat d0/f7b x:0 0 0 2024-09-18T12:52:02.600 INFO:tasks.workunit.client.1.smithi161.stdout:6/324: mkdir d4/d39/d26/d20/d45/d68 0 2024-09-18T12:52:02.601 INFO:tasks.workunit.client.1.smithi161.stdout:5/277: dread - d3/f56 zero size 2024-09-18T12:52:02.602 INFO:tasks.workunit.client.1.smithi161.stdout:0/320: write df/f1c [2245893,13729] 0 2024-09-18T12:52:02.604 INFO:tasks.workunit.client.1.smithi161.stdout:3/373: dwrite d1/f19 [0,4194304] 0 2024-09-18T12:52:02.604 INFO:tasks.workunit.client.1.smithi161.stdout:1/244: mknod d1/d1d/c49 0 2024-09-18T12:52:02.611 INFO:tasks.workunit.client.1.smithi161.stdout:6/325: mkdir d4/d61/d69 0 2024-09-18T12:52:02.613 INFO:tasks.workunit.client.0.smithi045.stdout:1/132: getdents d0/d12 0 2024-09-18T12:52:02.614 INFO:tasks.workunit.client.1.smithi161.stdout:7/292: link d3/c1b d3/c43 0 2024-09-18T12:52:02.616 INFO:tasks.workunit.client.1.smithi161.stdout:7/293: write d3/d8/d15/d1a/f39 [28154,8695] 0 2024-09-18T12:52:02.618 INFO:tasks.workunit.client.0.smithi045.stdout:1/133: truncate d0/fc 5535205 0 2024-09-18T12:52:02.620 INFO:tasks.workunit.client.1.smithi161.stdout:1/245: unlink d1/f1b 0 2024-09-18T12:52:02.620 INFO:tasks.workunit.client.1.smithi161.stdout:6/326: dwrite d4/d39/d48/f56 [4194304,4194304] 0 2024-09-18T12:52:02.620 INFO:tasks.workunit.client.1.smithi161.stdout:6/327: stat d4/d1a/f11 0 2024-09-18T12:52:02.621 INFO:tasks.workunit.client.1.smithi161.stdout:9/281: rename d0/d20/f5e to d0/d16/f62 0 2024-09-18T12:52:02.622 INFO:tasks.workunit.client.1.smithi161.stdout:6/328: readlink d4/d39/d26/d20/l43 0 2024-09-18T12:52:02.623 INFO:tasks.workunit.client.1.smithi161.stdout:9/282: stat d0/d16/d25/d28/l3a 0 2024-09-18T12:52:02.623 INFO:tasks.workunit.client.1.smithi161.stdout:9/283: chown d0/d16/d25/d28/l3a 10 1 2024-09-18T12:52:02.624 INFO:tasks.workunit.client.1.smithi161.stdout:8/379: getdents d0/d3/d5f/d6f 0 2024-09-18T12:52:02.631 INFO:tasks.workunit.client.0.smithi045.stdout:6/138: sync 2024-09-18T12:52:02.632 INFO:tasks.workunit.client.0.smithi045.stdout:6/139: stat d9/f18 0 2024-09-18T12:52:02.632 INFO:tasks.workunit.client.0.smithi045.stdout:1/134: rmdir d0/d12/d25 0 2024-09-18T12:52:02.633 INFO:tasks.workunit.client.0.smithi045.stdout:6/140: chown d9/f12 1875 1 2024-09-18T12:52:02.634 INFO:tasks.workunit.client.1.smithi161.stdout:0/321: unlink df/d29/d2d/d37/c6b 0 2024-09-18T12:52:02.636 INFO:tasks.workunit.client.1.smithi161.stdout:5/278: write d3/d9/d4b/f51 [1503035,17505] 0 2024-09-18T12:52:02.637 INFO:tasks.workunit.client.1.smithi161.stdout:7/294: mkdir d3/d8/d15/d1a/d44 0 2024-09-18T12:52:02.637 INFO:tasks.workunit.client.1.smithi161.stdout:5/279: write d3/d9/f34 [747567,55617] 0 2024-09-18T12:52:02.638 INFO:tasks.workunit.client.1.smithi161.stdout:5/280: dread - d3/d14/d20/d21/d46/f49 zero size 2024-09-18T12:52:02.639 INFO:tasks.workunit.client.1.smithi161.stdout:5/281: write d3/d14/f4e [714641,115194] 0 2024-09-18T12:52:02.639 INFO:tasks.workunit.client.0.smithi045.stdout:6/141: mkdir d9/d2f 0 2024-09-18T12:52:02.642 INFO:tasks.workunit.client.0.smithi045.stdout:6/142: write d9/f29 [602614,106621] 0 2024-09-18T12:52:02.643 INFO:tasks.workunit.client.0.smithi045.stdout:6/143: chown d9/d2f 30443 1 2024-09-18T12:52:02.643 INFO:tasks.workunit.client.0.smithi045.stdout:1/135: dwrite d0/f7 [0,4194304] 0 2024-09-18T12:52:02.644 INFO:tasks.workunit.client.0.smithi045.stdout:6/144: dread - d9/d1a/f2e zero size 2024-09-18T12:52:02.645 INFO:tasks.workunit.client.1.smithi161.stdout:2/352: rename d0/d5/f47 to d0/d4/f7c 0 2024-09-18T12:52:02.645 INFO:tasks.workunit.client.1.smithi161.stdout:2/353: fdatasync d0/d1/df/f34 0 2024-09-18T12:52:02.646 INFO:tasks.workunit.client.1.smithi161.stdout:9/284: creat d0/d20/d49/f63 x:0 0 0 2024-09-18T12:52:02.650 INFO:tasks.workunit.client.0.smithi045.stdout:6/145: read - d9/ff zero size 2024-09-18T12:52:02.652 INFO:tasks.workunit.client.1.smithi161.stdout:1/246: write d1/d26/f2e [1382444,97720] 0 2024-09-18T12:52:02.652 INFO:tasks.workunit.client.1.smithi161.stdout:0/322: symlink df/d29/d46/d51/l70 0 2024-09-18T12:52:02.653 INFO:tasks.workunit.client.0.smithi045.stdout:6/146: dread - d9/d1a/d1d/f25 zero size 2024-09-18T12:52:02.654 INFO:tasks.workunit.client.1.smithi161.stdout:7/295: symlink d3/d8/d15/d1a/d24/d31/l45 0 2024-09-18T12:52:02.655 INFO:tasks.workunit.client.0.smithi045.stdout:1/136: write d0/fa [274654,78414] 0 2024-09-18T12:52:02.656 INFO:tasks.workunit.client.1.smithi161.stdout:8/380: dwrite d0/f55 [0,4194304] 0 2024-09-18T12:52:02.658 INFO:tasks.workunit.client.1.smithi161.stdout:3/374: rename d1/d2e/d3d/d49/f5e to d1/d2e/d14/d65/f81 0 2024-09-18T12:52:02.659 INFO:tasks.workunit.client.1.smithi161.stdout:2/354: mkdir d0/d5/d53/d7d 0 2024-09-18T12:52:02.659 INFO:tasks.workunit.client.1.smithi161.stdout:4/327: getdents d5/d27/d3a/d47/d49 0 2024-09-18T12:52:02.660 INFO:tasks.workunit.client.1.smithi161.stdout:3/375: write d1/d2e/d24/f47 [1694504,53613] 0 2024-09-18T12:52:02.660 INFO:tasks.workunit.client.1.smithi161.stdout:2/355: stat d0/d1/d3b/f5a 0 2024-09-18T12:52:02.661 INFO:tasks.workunit.client.1.smithi161.stdout:1/247: symlink d1/da/d39/l4a 0 2024-09-18T12:52:02.661 INFO:tasks.workunit.client.1.smithi161.stdout:2/356: stat d0/f41 0 2024-09-18T12:52:02.661 INFO:tasks.workunit.client.1.smithi161.stdout:4/328: truncate d5/f2c 4285200 0 2024-09-18T12:52:02.663 INFO:tasks.workunit.client.1.smithi161.stdout:5/282: creat d3/d3b/d54/f5a x:0 0 0 2024-09-18T12:52:02.664 INFO:tasks.workunit.client.0.smithi045.stdout:6/147: dread d9/f2b [0,4194304] 0 2024-09-18T12:52:02.665 INFO:tasks.workunit.client.1.smithi161.stdout:6/329: rename d4/d39/d46/l5e to d4/d39/d26/l6a 0 2024-09-18T12:52:02.666 INFO:tasks.workunit.client.0.smithi045.stdout:6/148: mkdir d9/d30 0 2024-09-18T12:52:02.668 INFO:tasks.workunit.client.1.smithi161.stdout:3/376: symlink d1/d2e/d14/l82 0 2024-09-18T12:52:02.669 INFO:tasks.workunit.client.1.smithi161.stdout:1/248: creat d1/da/d1f/f4b x:0 0 0 2024-09-18T12:52:02.669 INFO:tasks.workunit.client.1.smithi161.stdout:4/329: dwrite d5/d32/f53 [0,4194304] 0 2024-09-18T12:52:02.669 INFO:tasks.workunit.client.0.smithi045.stdout:1/137: fdatasync d0/fa 0 2024-09-18T12:52:02.671 INFO:tasks.workunit.client.1.smithi161.stdout:5/283: symlink d3/d14/d4c/l5b 0 2024-09-18T12:52:02.673 INFO:tasks.workunit.client.1.smithi161.stdout:9/285: creat d0/f64 x:0 0 0 2024-09-18T12:52:02.676 INFO:tasks.workunit.client.1.smithi161.stdout:2/357: rename d0/d1/d3b/d3d/d4f/d56 to d0/d1/d3b/d7e 0 2024-09-18T12:52:02.678 INFO:tasks.workunit.client.0.smithi045.stdout:6/149: rename d9/d1a/c1c to d9/d1a/c31 0 2024-09-18T12:52:02.679 INFO:tasks.workunit.client.1.smithi161.stdout:6/330: creat d4/f6b x:0 0 0 2024-09-18T12:52:02.680 INFO:tasks.workunit.client.0.smithi045.stdout:1/138: mknod d0/d12/d17/c29 0 2024-09-18T12:52:02.680 INFO:tasks.workunit.client.1.smithi161.stdout:6/331: read - d4/d39/d47/d51/f52 zero size 2024-09-18T12:52:02.681 INFO:tasks.workunit.client.1.smithi161.stdout:6/332: dread - d4/d39/d47/d51/f52 zero size 2024-09-18T12:52:02.682 INFO:tasks.workunit.client.0.smithi045.stdout:6/150: fsync d9/ff 0 2024-09-18T12:52:02.684 INFO:tasks.workunit.client.0.smithi045.stdout:6/151: dread d9/f2b [0,4194304] 0 2024-09-18T12:52:02.684 INFO:tasks.workunit.client.1.smithi161.stdout:7/296: creat d3/d8/d15/f46 x:0 0 0 2024-09-18T12:52:02.685 INFO:tasks.workunit.client.1.smithi161.stdout:8/381: dread d0/d3/d10/d21/d4a/d52/f58 [0,4194304] 0 2024-09-18T12:52:02.686 INFO:tasks.workunit.client.0.smithi045.stdout:1/139: chown d0/l14 205473952 1 2024-09-18T12:52:02.690 INFO:tasks.workunit.client.0.smithi045.stdout:6/152: mkdir d9/d1a/d2d/d32 0 2024-09-18T12:52:02.691 INFO:tasks.workunit.client.0.smithi045.stdout:6/153: chown d9/d1a/c2c 8839 1 2024-09-18T12:52:02.691 INFO:tasks.workunit.client.0.smithi045.stdout:6/154: chown d9 186537447 1 2024-09-18T12:52:02.696 INFO:tasks.workunit.client.0.smithi045.stdout:6/155: link d9/d1a/d1d/f25 d9/d30/f33 0 2024-09-18T12:52:02.698 INFO:tasks.workunit.client.0.smithi045.stdout:6/156: fsync d9/f28 0 2024-09-18T12:52:02.700 INFO:tasks.workunit.client.0.smithi045.stdout:6/157: dread d9/fc [4194304,4194304] 0 2024-09-18T12:52:02.701 INFO:tasks.workunit.client.0.smithi045.stdout:6/158: dread - d9/d1a/f2e zero size 2024-09-18T12:52:02.701 INFO:tasks.workunit.client.0.smithi045.stdout:6/159: chown d9/d1a/d1d 3071741 1 2024-09-18T12:52:02.703 INFO:tasks.workunit.client.0.smithi045.stdout:6/160: unlink d9/d1a/d1d/f26 0 2024-09-18T12:52:02.704 INFO:tasks.workunit.client.0.smithi045.stdout:6/161: chown d9/d1a/f2e 5706 1 2024-09-18T12:52:02.706 INFO:tasks.workunit.client.0.smithi045.stdout:6/162: mknod d9/d1a/d1d/c34 0 2024-09-18T12:52:02.708 INFO:tasks.workunit.client.0.smithi045.stdout:6/163: creat d9/d30/f35 x:0 0 0 2024-09-18T12:52:02.710 INFO:tasks.workunit.client.0.smithi045.stdout:6/164: fsync d9/d30/f33 0 2024-09-18T12:52:02.712 INFO:tasks.workunit.client.0.smithi045.stdout:6/165: creat d9/d30/f36 x:0 0 0 2024-09-18T12:52:02.712 INFO:tasks.workunit.client.0.smithi045.stdout:6/166: read d9/f18 [1411298,75207] 0 2024-09-18T12:52:02.714 INFO:tasks.workunit.client.0.smithi045.stdout:6/167: readlink d9/d1a/l2a 0 2024-09-18T12:52:02.719 INFO:tasks.workunit.client.0.smithi045.stdout:6/168: dwrite d9/f13 [0,4194304] 0 2024-09-18T12:52:02.722 INFO:tasks.workunit.client.0.smithi045.stdout:6/169: creat d9/d1a/f37 x:0 0 0 2024-09-18T12:52:02.723 INFO:tasks.workunit.client.0.smithi045.stdout:6/170: read d9/f2b [138557,124072] 0 2024-09-18T12:52:02.724 INFO:tasks.workunit.client.0.smithi045.stdout:6/171: mkdir d9/d1a/d2d/d38 0 2024-09-18T12:52:02.727 INFO:tasks.workunit.client.0.smithi045.stdout:6/172: rmdir d9/d2f 0 2024-09-18T12:52:02.727 INFO:tasks.workunit.client.1.smithi161.stdout:1/249: symlink d1/da/d1f/l4c 0 2024-09-18T12:52:02.727 INFO:tasks.workunit.client.1.smithi161.stdout:5/284: symlink d3/d8/l5c 0 2024-09-18T12:52:02.728 INFO:tasks.workunit.client.1.smithi161.stdout:7/297: mknod d3/d8/d15/d1a/c47 0 2024-09-18T12:52:02.728 INFO:tasks.workunit.client.1.smithi161.stdout:6/333: dread d4/d39/d3a/f3f [0,4194304] 0 2024-09-18T12:52:02.729 INFO:tasks.workunit.client.1.smithi161.stdout:5/285: write d3/d14/f19 [4478721,130118] 0 2024-09-18T12:52:02.729 INFO:tasks.workunit.client.1.smithi161.stdout:3/377: mkdir d1/d2e/d14/d78/d83 0 2024-09-18T12:52:02.729 INFO:tasks.workunit.client.1.smithi161.stdout:7/298: chown d3/d8/d15/d1a 75 1 2024-09-18T12:52:02.730 INFO:tasks.workunit.client.0.smithi045.stdout:6/173: rename d9/l16 to d9/d30/l39 0 2024-09-18T12:52:02.730 INFO:tasks.workunit.client.1.smithi161.stdout:2/358: creat d0/d4/d78/f7f x:0 0 0 2024-09-18T12:52:02.730 INFO:tasks.workunit.client.0.smithi045.stdout:6/174: read - d9/ff zero size 2024-09-18T12:52:02.732 INFO:tasks.workunit.client.1.smithi161.stdout:2/359: read - d0/d5/d43/d35/f5f zero size 2024-09-18T12:52:02.732 INFO:tasks.workunit.client.1.smithi161.stdout:8/382: creat d0/d3/d5f/d6f/f80 x:0 0 0 2024-09-18T12:52:02.733 INFO:tasks.workunit.client.1.smithi161.stdout:1/250: dread d1/d1d/f21 [0,4194304] 0 2024-09-18T12:52:02.733 INFO:tasks.workunit.client.1.smithi161.stdout:3/378: mkdir d1/d2e/d24/d84 0 2024-09-18T12:52:02.734 INFO:tasks.workunit.client.1.smithi161.stdout:1/251: readlink d1/d1d/l38 0 2024-09-18T12:52:02.736 INFO:tasks.workunit.client.1.smithi161.stdout:7/299: mknod d3/d8/c48 0 2024-09-18T12:52:02.736 INFO:tasks.workunit.client.1.smithi161.stdout:4/330: dwrite d5/f8 [4194304,4194304] 0 2024-09-18T12:52:02.737 INFO:tasks.workunit.client.1.smithi161.stdout:2/360: fdatasync d0/d1/d3b/d7e/f70 0 2024-09-18T12:52:02.737 INFO:tasks.workunit.client.1.smithi161.stdout:7/300: chown d3/d8/l1f 119874953 1 2024-09-18T12:52:02.739 INFO:tasks.workunit.client.0.smithi045.stdout:6/175: getdents d9/d1a/d2d 0 2024-09-18T12:52:02.740 INFO:tasks.workunit.client.0.smithi045.stdout:6/176: readlink d9/l20 0 2024-09-18T12:52:02.740 INFO:tasks.workunit.client.0.smithi045.stdout:6/177: chown d9/l20 1465286794 1 2024-09-18T12:52:02.741 INFO:tasks.workunit.client.1.smithi161.stdout:1/252: mknod d1/da/d39/c4d 0 2024-09-18T12:52:02.743 INFO:tasks.workunit.client.1.smithi161.stdout:4/331: dwrite d5/d27/d3a/f3d [0,4194304] 0 2024-09-18T12:52:02.745 INFO:tasks.workunit.client.1.smithi161.stdout:8/383: creat d0/d3/f81 x:0 0 0 2024-09-18T12:52:02.748 INFO:tasks.workunit.client.1.smithi161.stdout:2/361: mkdir d0/d5/d43/d35/d80 0 2024-09-18T12:52:02.749 INFO:tasks.workunit.client.1.smithi161.stdout:3/379: symlink d1/d2e/d14/d78/d83/l85 0 2024-09-18T12:52:02.752 INFO:tasks.workunit.client.1.smithi161.stdout:7/301: mknod d3/d8/d15/d1a/d44/c49 0 2024-09-18T12:52:02.753 INFO:tasks.workunit.client.1.smithi161.stdout:3/380: fsync d1/d2e/d14/d65/f6a 0 2024-09-18T12:52:02.756 INFO:tasks.workunit.client.1.smithi161.stdout:8/384: rename d0/d3/d5f/d6f to d0/d3/d10/d21/d4a/d52/d82 0 2024-09-18T12:52:02.757 INFO:tasks.workunit.client.1.smithi161.stdout:3/381: chown d1/d2e/d14/d2c/l4e 68 1 2024-09-18T12:52:02.758 INFO:tasks.workunit.client.1.smithi161.stdout:7/302: mkdir d3/d8/d15/d1a/d4a 0 2024-09-18T12:52:02.759 INFO:tasks.workunit.client.1.smithi161.stdout:6/334: dwrite d4/d39/d26/d31/f59 [0,4194304] 0 2024-09-18T12:52:02.759 INFO:tasks.workunit.client.1.smithi161.stdout:3/382: dread - d1/f54 zero size 2024-09-18T12:52:02.759 INFO:tasks.workunit.client.1.smithi161.stdout:8/385: chown d0/d3/d10/d21/f37 11100 1 2024-09-18T12:52:02.760 INFO:tasks.workunit.client.1.smithi161.stdout:2/362: rename d0/d4/f7c to d0/d5/d53/f81 0 2024-09-18T12:52:02.761 INFO:tasks.workunit.client.1.smithi161.stdout:7/303: write d3/f19 [3894451,77605] 0 2024-09-18T12:52:02.761 INFO:tasks.workunit.client.1.smithi161.stdout:1/253: link d1/d26/c2b d1/c4e 0 2024-09-18T12:52:02.762 INFO:tasks.workunit.client.1.smithi161.stdout:4/332: dwrite d5/d27/f66 [4194304,4194304] 0 2024-09-18T12:52:02.763 INFO:tasks.workunit.client.1.smithi161.stdout:8/386: read - d0/d3/d5f/f60 zero size 2024-09-18T12:52:02.764 INFO:tasks.workunit.client.1.smithi161.stdout:6/335: symlink d4/d39/d46/l6c 0 2024-09-18T12:52:02.764 INFO:tasks.workunit.client.1.smithi161.stdout:0/323: sync 2024-09-18T12:52:02.765 INFO:tasks.workunit.client.1.smithi161.stdout:1/254: truncate d1/d26/f3f 684962 0 2024-09-18T12:52:02.765 INFO:tasks.workunit.client.1.smithi161.stdout:2/363: symlink d0/d1/d3b/d7e/l82 0 2024-09-18T12:52:02.767 INFO:tasks.workunit.client.1.smithi161.stdout:2/364: write d0/f13 [9092221,72968] 0 2024-09-18T12:52:02.768 INFO:tasks.workunit.client.1.smithi161.stdout:7/304: mkdir d3/d8/d4b 0 2024-09-18T12:52:02.768 INFO:tasks.workunit.client.1.smithi161.stdout:3/383: mknod d1/d2e/d3d/c86 0 2024-09-18T12:52:02.770 INFO:tasks.workunit.client.1.smithi161.stdout:6/336: creat d4/d39/d3a/f6d x:0 0 0 2024-09-18T12:52:02.771 INFO:tasks.workunit.client.1.smithi161.stdout:4/333: dread d5/d27/d3a/f3d [0,4194304] 0 2024-09-18T12:52:02.772 INFO:tasks.workunit.client.1.smithi161.stdout:0/324: mkdir df/d30/d71 0 2024-09-18T12:52:02.774 INFO:tasks.workunit.client.1.smithi161.stdout:7/305: creat d3/d8/d15/d1a/d24/f4c x:0 0 0 2024-09-18T12:52:02.774 INFO:tasks.workunit.client.1.smithi161.stdout:0/325: read df/f23 [6766731,57845] 0 2024-09-18T12:52:02.776 INFO:tasks.workunit.client.1.smithi161.stdout:8/387: dwrite d0/d3/d10/d21/d4a/f4f [0,4194304] 0 2024-09-18T12:52:02.777 INFO:tasks.workunit.client.1.smithi161.stdout:1/255: link d1/da/d1f/d45/f47 d1/d26/d3a/f4f 0 2024-09-18T12:52:02.777 INFO:tasks.workunit.client.1.smithi161.stdout:7/306: dread d3/f23 [4194304,4194304] 0 2024-09-18T12:52:02.779 INFO:tasks.workunit.client.1.smithi161.stdout:4/334: symlink d5/d27/d44/l6a 0 2024-09-18T12:52:02.784 INFO:tasks.workunit.client.1.smithi161.stdout:6/337: rename d4/d39/d47/d51/l5f to d4/d61/l6e 0 2024-09-18T12:52:02.785 INFO:tasks.workunit.client.1.smithi161.stdout:6/338: fdatasync d4/d39/d26/d31/f53 0 2024-09-18T12:52:02.786 INFO:tasks.workunit.client.1.smithi161.stdout:1/256: creat d1/d26/f50 x:0 0 0 2024-09-18T12:52:02.786 INFO:tasks.workunit.client.1.smithi161.stdout:8/388: rmdir d0/d3/d1e/d34 39 2024-09-18T12:52:02.787 INFO:tasks.workunit.client.1.smithi161.stdout:1/257: truncate d1/f5 5329746 0 2024-09-18T12:52:02.789 INFO:tasks.workunit.client.1.smithi161.stdout:0/326: link df/d29/d36/f43 df/d61/f72 0 2024-09-18T12:52:02.791 INFO:tasks.workunit.client.1.smithi161.stdout:0/327: readlink df/d29/d2d/d37/d55/l5e 0 2024-09-18T12:52:02.791 INFO:tasks.workunit.client.1.smithi161.stdout:8/389: dread d0/f55 [0,4194304] 0 2024-09-18T12:52:02.794 INFO:tasks.workunit.client.1.smithi161.stdout:1/258: dwrite d1/da/d31/f3c [0,4194304] 0 2024-09-18T12:52:02.795 INFO:tasks.workunit.client.1.smithi161.stdout:1/259: stat d1/d26/f7 0 2024-09-18T12:52:02.797 INFO:tasks.workunit.client.1.smithi161.stdout:0/328: link ce df/d29/d46/d51/c73 0 2024-09-18T12:52:02.797 INFO:tasks.workunit.client.1.smithi161.stdout:1/260: write d1/d26/f2f [1689585,79466] 0 2024-09-18T12:52:02.800 INFO:tasks.workunit.client.1.smithi161.stdout:0/329: write df/d29/d46/f49 [379869,5483] 0 2024-09-18T12:52:02.802 INFO:tasks.workunit.client.1.smithi161.stdout:8/390: dwrite d0/d3/d10/f22 [0,4194304] 0 2024-09-18T12:52:02.802 INFO:tasks.workunit.client.1.smithi161.stdout:1/261: creat d1/da/d1f/f51 x:0 0 0 2024-09-18T12:52:02.803 INFO:tasks.workunit.client.1.smithi161.stdout:7/307: dread d3/d8/d15/d38/f21 [0,4194304] 0 2024-09-18T12:52:02.806 INFO:tasks.workunit.client.1.smithi161.stdout:1/262: mkdir d1/d26/d3a/d52 0 2024-09-18T12:52:02.812 INFO:tasks.workunit.client.1.smithi161.stdout:8/391: mknod d0/d3/d10/d21/d4a/d52/d66/c83 0 2024-09-18T12:52:02.813 INFO:tasks.workunit.client.1.smithi161.stdout:1/263: creat d1/da/d31/f53 x:0 0 0 2024-09-18T12:52:02.816 INFO:tasks.workunit.client.1.smithi161.stdout:8/392: rename d0/f55 to d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f84 0 2024-09-18T12:52:02.818 INFO:tasks.workunit.client.1.smithi161.stdout:1/264: fsync d1/d26/d3a/f4f 0 2024-09-18T12:52:02.819 INFO:tasks.workunit.client.1.smithi161.stdout:6/339: link d4/d61/l6e d4/d39/l6f 0 2024-09-18T12:52:02.819 INFO:tasks.workunit.client.1.smithi161.stdout:4/335: dwrite d5/d32/f38 [0,4194304] 0 2024-09-18T12:52:02.826 INFO:tasks.workunit.client.1.smithi161.stdout:0/330: dwrite df/f23 [0,4194304] 0 2024-09-18T12:52:02.829 INFO:tasks.workunit.client.1.smithi161.stdout:0/331: fdatasync df/f22 0 2024-09-18T12:52:02.830 INFO:tasks.workunit.client.1.smithi161.stdout:6/340: link d4/d39/d3a/f1f d4/d39/d47/d51/f70 0 2024-09-18T12:52:02.836 INFO:tasks.workunit.client.1.smithi161.stdout:8/393: dwrite d0/d3/d10/d21/d4a/f4f [0,4194304] 0 2024-09-18T12:52:02.836 INFO:tasks.workunit.client.1.smithi161.stdout:1/265: dwrite d1/d26/fb [0,4194304] 0 2024-09-18T12:52:02.837 INFO:tasks.workunit.client.1.smithi161.stdout:4/336: dwrite d5/ff [4194304,4194304] 0 2024-09-18T12:52:02.839 INFO:tasks.workunit.client.1.smithi161.stdout:6/341: creat d4/f71 x:0 0 0 2024-09-18T12:52:02.841 INFO:tasks.workunit.client.1.smithi161.stdout:6/342: dread - d4/d61/f66 zero size 2024-09-18T12:52:02.843 INFO:tasks.workunit.client.1.smithi161.stdout:0/332: rename df/d29/f3d to df/d29/d46/f74 0 2024-09-18T12:52:02.844 INFO:tasks.workunit.client.1.smithi161.stdout:1/266: mknod d1/d1d/c54 0 2024-09-18T12:52:02.846 INFO:tasks.workunit.client.1.smithi161.stdout:8/394: chown d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 1360 1 2024-09-18T12:52:02.847 INFO:tasks.workunit.client.1.smithi161.stdout:6/343: truncate d4/d1a/d1c/d3e/f63 466680 0 2024-09-18T12:52:02.848 INFO:tasks.workunit.client.1.smithi161.stdout:0/333: creat df/d61/f75 x:0 0 0 2024-09-18T12:52:02.849 INFO:tasks.workunit.client.1.smithi161.stdout:1/267: fsync d1/d26/d3a/f4f 0 2024-09-18T12:52:02.849 INFO:tasks.workunit.client.1.smithi161.stdout:6/344: write d4/d1a/d1c/d3e/f63 [562646,28655] 0 2024-09-18T12:52:02.854 INFO:tasks.workunit.client.1.smithi161.stdout:4/337: link d5/d27/l31 d5/d14/l6b 0 2024-09-18T12:52:02.854 INFO:tasks.workunit.client.1.smithi161.stdout:0/334: chown df/d29/d2d/d37/c44 540769 1 2024-09-18T12:52:02.855 INFO:tasks.workunit.client.1.smithi161.stdout:8/395: mknod d0/d3/c85 0 2024-09-18T12:52:02.856 INFO:tasks.workunit.client.1.smithi161.stdout:0/335: chown df/d30/c33 12058 1 2024-09-18T12:52:02.856 INFO:tasks.workunit.client.1.smithi161.stdout:1/268: dwrite d1/da/d31/f53 [0,4194304] 0 2024-09-18T12:52:02.859 INFO:tasks.workunit.client.1.smithi161.stdout:4/338: mkdir d5/d27/d44/d61/d6c 0 2024-09-18T12:52:02.862 INFO:tasks.workunit.client.1.smithi161.stdout:1/269: symlink d1/d48/l55 0 2024-09-18T12:52:02.862 INFO:tasks.workunit.client.1.smithi161.stdout:9/286: sync 2024-09-18T12:52:02.864 INFO:tasks.workunit.client.1.smithi161.stdout:4/339: readlink d5/d14/l5b 0 2024-09-18T12:52:02.866 INFO:tasks.workunit.client.1.smithi161.stdout:6/345: write d4/d39/d3a/f1f [2590997,33247] 0 2024-09-18T12:52:02.867 INFO:tasks.workunit.client.1.smithi161.stdout:8/396: dwrite d0/d3/d10/f22 [0,4194304] 0 2024-09-18T12:52:02.868 INFO:tasks.workunit.client.1.smithi161.stdout:4/340: write d5/d27/d3a/f3c [202787,70726] 0 2024-09-18T12:52:02.868 INFO:tasks.workunit.client.1.smithi161.stdout:9/287: write d0/d16/f62 [549777,128999] 0 2024-09-18T12:52:02.868 INFO:tasks.workunit.client.1.smithi161.stdout:0/336: dwrite df/d29/f62 [0,4194304] 0 2024-09-18T12:52:02.874 INFO:tasks.workunit.client.1.smithi161.stdout:6/346: write d4/f19 [3988247,21494] 0 2024-09-18T12:52:02.874 INFO:tasks.workunit.client.1.smithi161.stdout:1/270: mknod d1/d26/d3a/d52/c56 0 2024-09-18T12:52:02.874 INFO:tasks.workunit.client.1.smithi161.stdout:4/341: fdatasync d5/f8 0 2024-09-18T12:52:02.875 INFO:tasks.workunit.client.1.smithi161.stdout:9/288: fdatasync d0/d20/d49/f15 0 2024-09-18T12:52:02.876 INFO:tasks.workunit.client.1.smithi161.stdout:6/347: stat d4/d39/d3a/f6d 0 2024-09-18T12:52:02.877 INFO:tasks.workunit.client.1.smithi161.stdout:8/397: unlink d0/d3/f3d 0 2024-09-18T12:52:02.877 INFO:tasks.workunit.client.1.smithi161.stdout:6/348: write d4/d39/d47/d51/f70 [5166840,50773] 0 2024-09-18T12:52:02.878 INFO:tasks.workunit.client.1.smithi161.stdout:6/349: write d4/ff [5097793,129075] 0 2024-09-18T12:52:02.880 INFO:tasks.workunit.client.0.smithi045.stdout:2/92: sync 2024-09-18T12:52:02.881 INFO:tasks.workunit.client.1.smithi161.stdout:4/342: mkdir d5/d14/d6d 0 2024-09-18T12:52:02.883 INFO:tasks.workunit.client.1.smithi161.stdout:9/289: mkdir d0/d20/d49/d65 0 2024-09-18T12:52:02.884 INFO:tasks.workunit.client.0.smithi045.stdout:2/93: fsync d5/de/ff 0 2024-09-18T12:52:02.885 INFO:tasks.workunit.client.0.smithi045.stdout:2/94: dread d5/de/f13 [0,4194304] 0 2024-09-18T12:52:02.889 INFO:tasks.workunit.client.1.smithi161.stdout:1/271: truncate d1/ff 2625882 0 2024-09-18T12:52:02.890 INFO:tasks.workunit.client.1.smithi161.stdout:0/337: write df/d30/d4d/f4f [1134957,53874] 0 2024-09-18T12:52:02.891 INFO:tasks.workunit.client.1.smithi161.stdout:9/290: chown d0/d16/d25/f27 18482 1 2024-09-18T12:52:02.892 INFO:tasks.workunit.client.0.smithi045.stdout:2/95: dwrite d5/de/ff [0,4194304] 0 2024-09-18T12:52:02.893 INFO:tasks.workunit.client.1.smithi161.stdout:1/272: dread d1/d26/fb [0,4194304] 0 2024-09-18T12:52:02.894 INFO:tasks.workunit.client.1.smithi161.stdout:6/350: creat d4/d1a/d1c/d3e/d4d/f72 x:0 0 0 2024-09-18T12:52:02.895 INFO:tasks.workunit.client.1.smithi161.stdout:4/343: mkdir d5/d14/d5f/d69/d6e 0 2024-09-18T12:52:02.900 INFO:tasks.workunit.client.1.smithi161.stdout:8/398: creat d0/d3/d10/d21/f86 x:0 0 0 2024-09-18T12:52:02.902 INFO:tasks.workunit.client.0.smithi045.stdout:2/96: creat d5/f22 x:0 0 0 2024-09-18T12:52:02.905 INFO:tasks.workunit.client.1.smithi161.stdout:6/351: symlink d4/d39/d26/d31/l73 0 2024-09-18T12:52:02.905 INFO:tasks.workunit.client.1.smithi161.stdout:6/352: write d4/d1a/f11 [5081477,31974] 0 2024-09-18T12:52:02.906 INFO:tasks.workunit.client.0.smithi045.stdout:2/97: unlink d5/c1e 0 2024-09-18T12:52:02.906 INFO:tasks.workunit.client.0.smithi045.stdout:2/98: fdatasync d5/f9 0 2024-09-18T12:52:02.912 INFO:tasks.workunit.client.1.smithi161.stdout:1/273: dwrite d1/d26/f10 [0,4194304] 0 2024-09-18T12:52:02.913 INFO:tasks.workunit.client.1.smithi161.stdout:1/274: truncate d1/da/d1f/f51 115453 0 2024-09-18T12:52:02.914 INFO:tasks.workunit.client.1.smithi161.stdout:1/275: chown d1/da/d31 40019 1 2024-09-18T12:52:02.915 INFO:tasks.workunit.client.1.smithi161.stdout:1/276: chown d1/d26/c1a 173697 1 2024-09-18T12:52:02.916 INFO:tasks.workunit.client.0.smithi045.stdout:2/99: truncate d5/f9 337822 0 2024-09-18T12:52:02.918 INFO:tasks.workunit.client.1.smithi161.stdout:0/338: truncate df/f26 884598 0 2024-09-18T12:52:02.919 INFO:tasks.workunit.client.1.smithi161.stdout:4/344: getdents d5/d32/d39 0 2024-09-18T12:52:02.920 INFO:tasks.workunit.client.1.smithi161.stdout:1/277: creat d1/d1d/f57 x:0 0 0 2024-09-18T12:52:02.920 INFO:tasks.workunit.client.1.smithi161.stdout:6/353: truncate d4/d39/d48/f56 3769687 0 2024-09-18T12:52:02.921 INFO:tasks.workunit.client.1.smithi161.stdout:4/345: readlink d5/d27/l34 0 2024-09-18T12:52:02.921 INFO:tasks.workunit.client.1.smithi161.stdout:9/291: dwrite d0/fd [0,4194304] 0 2024-09-18T12:52:02.921 INFO:tasks.workunit.client.0.smithi045.stdout:2/100: rename d5/cc to d5/de/d16/c23 0 2024-09-18T12:52:02.923 INFO:tasks.workunit.client.1.smithi161.stdout:9/292: chown d0/d47/f4c 180 1 2024-09-18T12:52:02.924 INFO:tasks.workunit.client.0.smithi045.stdout:2/101: mknod d5/de/d16/c24 0 2024-09-18T12:52:02.924 INFO:tasks.workunit.client.1.smithi161.stdout:8/399: getdents d0/d3/d10/d21/d4a/d52/d70 0 2024-09-18T12:52:02.926 INFO:tasks.workunit.client.1.smithi161.stdout:4/346: symlink d5/d32/d39/d4d/l6f 0 2024-09-18T12:52:02.929 INFO:tasks.workunit.client.1.smithi161.stdout:4/347: chown d5/fc 0 1 2024-09-18T12:52:02.931 INFO:tasks.workunit.client.1.smithi161.stdout:0/339: dwrite df/d61/f75 [0,4194304] 0 2024-09-18T12:52:02.931 INFO:tasks.workunit.client.1.smithi161.stdout:1/278: dread d1/d26/f2f [0,4194304] 0 2024-09-18T12:52:02.933 INFO:tasks.workunit.client.0.smithi045.stdout:2/102: fsync d5/f8 0 2024-09-18T12:52:02.935 INFO:tasks.workunit.client.0.smithi045.stdout:2/103: dread d5/de/f13 [0,4194304] 0 2024-09-18T12:52:02.937 INFO:tasks.workunit.client.1.smithi161.stdout:1/279: dwrite d1/da/d31/f53 [0,4194304] 0 2024-09-18T12:52:02.942 INFO:tasks.workunit.client.1.smithi161.stdout:0/340: creat df/d30/d4d/f76 x:0 0 0 2024-09-18T12:52:02.945 INFO:tasks.workunit.client.0.smithi045.stdout:2/104: link d5/c20 d5/de/c25 0 2024-09-18T12:52:02.948 INFO:tasks.workunit.client.1.smithi161.stdout:1/280: symlink d1/da/d1f/l58 0 2024-09-18T12:52:02.950 INFO:tasks.workunit.client.1.smithi161.stdout:6/354: getdents d4/d39/d26/d20/d28 0 2024-09-18T12:52:02.950 INFO:tasks.workunit.client.1.smithi161.stdout:6/355: fdatasync d4/f10 0 2024-09-18T12:52:02.953 INFO:tasks.workunit.client.0.smithi045.stdout:2/105: rename d5/de/c25 to d5/de/d16/c26 0 2024-09-18T12:52:02.954 INFO:tasks.workunit.client.1.smithi161.stdout:4/348: symlink d5/d27/d3a/l70 0 2024-09-18T12:52:02.957 INFO:tasks.workunit.client.0.smithi045.stdout:2/106: unlink d5/c1d 0 2024-09-18T12:52:02.958 INFO:tasks.workunit.client.1.smithi161.stdout:9/293: truncate d0/f29 5514105 0 2024-09-18T12:52:02.960 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:02 smithi045 ceph-mon[28315]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:02.960 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:02 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/952684787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:02.961 INFO:tasks.workunit.client.0.smithi045.stdout:2/107: mkdir d5/de/d16/d27 0 2024-09-18T12:52:02.961 INFO:tasks.workunit.client.1.smithi161.stdout:0/341: dread df/d29/d46/f74 [0,4194304] 0 2024-09-18T12:52:02.962 INFO:tasks.workunit.client.1.smithi161.stdout:6/356: creat d4/d39/f74 x:0 0 0 2024-09-18T12:52:02.962 INFO:tasks.workunit.client.1.smithi161.stdout:5/286: sync 2024-09-18T12:52:02.964 INFO:tasks.workunit.client.1.smithi161.stdout:1/281: link d1/f15 d1/d26/d3a/d52/f59 0 2024-09-18T12:52:02.964 INFO:tasks.workunit.client.1.smithi161.stdout:0/342: write df/d29/d46/f49 [769032,86033] 0 2024-09-18T12:52:02.965 INFO:tasks.workunit.client.1.smithi161.stdout:8/400: dwrite d0/d3/d1e/d34/f64 [0,4194304] 0 2024-09-18T12:52:02.965 INFO:tasks.workunit.client.0.smithi045.stdout:2/108: dread d5/de/ff [0,4194304] 0 2024-09-18T12:52:02.965 INFO:tasks.workunit.client.1.smithi161.stdout:5/287: write d3/d9/d4b/f4f [1350520,40661] 0 2024-09-18T12:52:02.966 INFO:tasks.workunit.client.1.smithi161.stdout:9/294: creat d0/d16/d25/d28/d45/f66 x:0 0 0 2024-09-18T12:52:02.970 INFO:tasks.workunit.client.0.smithi045.stdout:2/109: creat d5/de/f28 x:0 0 0 2024-09-18T12:52:02.970 INFO:tasks.workunit.client.1.smithi161.stdout:8/401: read d0/d3/d10/f22 [4084227,128826] 0 2024-09-18T12:52:02.973 INFO:tasks.workunit.client.1.smithi161.stdout:1/282: mknod d1/d1d/c5a 0 2024-09-18T12:52:02.975 INFO:tasks.workunit.client.0.smithi045.stdout:2/110: symlink d5/de/d16/l29 0 2024-09-18T12:52:02.977 INFO:tasks.workunit.client.1.smithi161.stdout:5/288: symlink d3/d3b/d54/l5d 0 2024-09-18T12:52:02.981 INFO:tasks.workunit.client.1.smithi161.stdout:6/357: dread d4/ff [0,4194304] 0 2024-09-18T12:52:02.982 INFO:tasks.workunit.client.1.smithi161.stdout:0/343: truncate df/d29/d2d/d37/f48 4626272 0 2024-09-18T12:52:02.983 INFO:tasks.workunit.client.1.smithi161.stdout:5/289: dwrite d3/d9/f34 [0,4194304] 0 2024-09-18T12:52:02.986 INFO:tasks.workunit.client.1.smithi161.stdout:5/290: read d3/d14/d20/d21/f52 [380097,125031] 0 2024-09-18T12:52:02.986 INFO:tasks.workunit.client.1.smithi161.stdout:1/283: write d1/d26/f7 [416122,72023] 0 2024-09-18T12:52:02.987 INFO:tasks.workunit.client.1.smithi161.stdout:4/349: getdents d5/d32/d39/d4d 0 2024-09-18T12:52:02.987 INFO:tasks.workunit.client.0.smithi045.stdout:2/111: dwrite d5/de/ff [0,4194304] 0 2024-09-18T12:52:02.989 INFO:tasks.workunit.client.1.smithi161.stdout:4/350: read d5/f21 [318251,9791] 0 2024-09-18T12:52:02.990 INFO:tasks.workunit.client.1.smithi161.stdout:9/295: getdents d0/d20/d49/d65 0 2024-09-18T12:52:02.991 INFO:tasks.workunit.client.1.smithi161.stdout:8/402: mkdir d0/d3/d10/d21/d87 0 2024-09-18T12:52:02.991 INFO:tasks.workunit.client.1.smithi161.stdout:8/403: dread - d0/d3/d10/f63 zero size 2024-09-18T12:52:02.995 INFO:tasks.workunit.client.1.smithi161.stdout:4/351: dread d5/d32/f42 [0,4194304] 0 2024-09-18T12:52:02.998 INFO:tasks.workunit.client.0.smithi045.stdout:2/112: symlink d5/de/d16/d27/l2a 0 2024-09-18T12:52:02.999 INFO:tasks.workunit.client.0.smithi045.stdout:2/113: write d5/f1f [1272569,67841] 0 2024-09-18T12:52:03.000 INFO:tasks.workunit.client.1.smithi161.stdout:5/291: unlink d3/d9/d4b/f58 0 2024-09-18T12:52:03.002 INFO:tasks.workunit.client.1.smithi161.stdout:4/352: dwrite d5/d32/f42 [0,4194304] 0 2024-09-18T12:52:03.002 INFO:tasks.workunit.client.0.smithi045.stdout:2/114: mknod d5/de/c2b 0 2024-09-18T12:52:03.003 INFO:tasks.workunit.client.1.smithi161.stdout:9/296: readlink d0/d16/d25/d28/l41 0 2024-09-18T12:52:03.004 INFO:tasks.workunit.client.1.smithi161.stdout:8/404: symlink d0/d3/d10/d21/d4a/d52/d66/l88 0 2024-09-18T12:52:03.004 INFO:tasks.workunit.client.0.smithi045.stdout:2/115: rmdir d5 39 2024-09-18T12:52:03.005 INFO:tasks.workunit.client.1.smithi161.stdout:0/344: creat df/d29/d2d/d69/f77 x:0 0 0 2024-09-18T12:52:03.008 INFO:tasks.workunit.client.1.smithi161.stdout:1/284: fdatasync d1/da/f18 0 2024-09-18T12:52:03.008 INFO:tasks.workunit.client.1.smithi161.stdout:1/285: chown d1/c42 33998 1 2024-09-18T12:52:03.010 INFO:tasks.workunit.client.0.smithi045.stdout:2/116: stat d5/de/d16/c23 0 2024-09-18T12:52:03.012 INFO:tasks.workunit.client.1.smithi161.stdout:5/292: write d3/d14/d20/f2c [1043936,69522] 0 2024-09-18T12:52:03.013 INFO:tasks.workunit.client.1.smithi161.stdout:4/353: dread d5/d27/f46 [0,4194304] 0 2024-09-18T12:52:03.014 INFO:tasks.workunit.client.1.smithi161.stdout:9/297: dwrite d0/d16/d25/d46/d53/f56 [4194304,4194304] 0 2024-09-18T12:52:03.014 INFO:tasks.workunit.client.1.smithi161.stdout:8/405: mkdir d0/d3/d10/d21/d4a/d52/d66/d5b/d89 0 2024-09-18T12:52:03.015 INFO:tasks.workunit.client.0.smithi045.stdout:2/117: stat d5/de/c18 0 2024-09-18T12:52:03.017 INFO:tasks.workunit.client.1.smithi161.stdout:0/345: dwrite df/d29/d2d/f4c [0,4194304] 0 2024-09-18T12:52:03.017 INFO:tasks.workunit.client.1.smithi161.stdout:8/406: chown d0/d3/d5f/l67 18929 1 2024-09-18T12:52:03.018 INFO:tasks.workunit.client.1.smithi161.stdout:1/286: creat d1/d26/f5b x:0 0 0 2024-09-18T12:52:03.023 INFO:tasks.workunit.client.1.smithi161.stdout:0/346: dread df/d29/d46/f74 [0,4194304] 0 2024-09-18T12:52:03.023 INFO:tasks.workunit.client.0.smithi045.stdout:2/118: dwrite d5/f12 [0,4194304] 0 2024-09-18T12:52:03.028 INFO:tasks.workunit.client.1.smithi161.stdout:1/287: mkdir d1/da/d1f/d45/d5c 0 2024-09-18T12:52:03.030 INFO:tasks.workunit.client.1.smithi161.stdout:5/293: symlink d3/d14/d20/d21/l5e 0 2024-09-18T12:52:03.030 INFO:tasks.workunit.client.1.smithi161.stdout:0/347: dread df/d30/f3a [0,4194304] 0 2024-09-18T12:52:03.032 INFO:tasks.workunit.client.1.smithi161.stdout:4/354: dwrite d5/d32/f42 [0,4194304] 0 2024-09-18T12:52:03.032 INFO:tasks.workunit.client.1.smithi161.stdout:0/348: fsync fd 0 2024-09-18T12:52:03.032 INFO:tasks.workunit.client.1.smithi161.stdout:9/298: dwrite d0/db/f17 [0,4194304] 0 2024-09-18T12:52:03.033 INFO:tasks.workunit.client.0.smithi045.stdout:2/119: mkdir d5/d2c 0 2024-09-18T12:52:03.034 INFO:tasks.workunit.client.0.smithi045.stdout:2/120: stat d5/c20 0 2024-09-18T12:52:03.035 INFO:tasks.workunit.client.0.smithi045.stdout:2/121: truncate d5/de/f28 1014257 0 2024-09-18T12:52:03.037 INFO:tasks.workunit.client.0.smithi045.stdout:2/122: write d5/de/f1b [1224803,37711] 0 2024-09-18T12:52:03.037 INFO:tasks.workunit.client.1.smithi161.stdout:9/299: chown d0/d16/c51 14604 1 2024-09-18T12:52:03.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:02 smithi161 ceph-mon[35784]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:03.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:02 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/952684787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:03.042 INFO:tasks.workunit.client.1.smithi161.stdout:1/288: fdatasync d1/da/d1f/d45/f47 0 2024-09-18T12:52:03.043 INFO:tasks.workunit.client.1.smithi161.stdout:4/355: fdatasync d5/f16 0 2024-09-18T12:52:03.044 INFO:tasks.workunit.client.1.smithi161.stdout:4/356: stat d5/d27/d3a/f3d 0 2024-09-18T12:52:03.044 INFO:tasks.workunit.client.0.smithi045.stdout:2/123: rename d5/de/d16/c23 to d5/de/c2d 0 2024-09-18T12:52:03.046 INFO:tasks.workunit.client.0.smithi045.stdout:2/124: truncate d5/f12 5235841 0 2024-09-18T12:52:03.047 INFO:tasks.workunit.client.0.smithi045.stdout:2/125: fdatasync d5/de/ff 0 2024-09-18T12:52:03.047 INFO:tasks.workunit.client.1.smithi161.stdout:5/294: creat d3/d9/d4b/f5f x:0 0 0 2024-09-18T12:52:03.048 INFO:tasks.workunit.client.1.smithi161.stdout:5/295: chown d3/d14/d4c/l5b 17691 1 2024-09-18T12:52:03.048 INFO:tasks.workunit.client.1.smithi161.stdout:9/300: rmdir d0/d16/d25/d28/d45 39 2024-09-18T12:52:03.048 INFO:tasks.workunit.client.1.smithi161.stdout:0/349: mkdir df/d29/d46/d78 0 2024-09-18T12:52:03.049 INFO:tasks.workunit.client.1.smithi161.stdout:9/301: readlink d0/d16/d25/d28/l3a 0 2024-09-18T12:52:03.049 INFO:tasks.workunit.client.1.smithi161.stdout:0/350: chown df/d29/l40 1 1 2024-09-18T12:52:03.050 INFO:tasks.workunit.client.1.smithi161.stdout:8/407: dread d0/d3/d10/d21/f49 [0,4194304] 0 2024-09-18T12:52:03.051 INFO:tasks.workunit.client.0.smithi045.stdout:2/126: creat d5/de/d16/f2e x:0 0 0 2024-09-18T12:52:03.053 INFO:tasks.workunit.client.1.smithi161.stdout:4/357: rename d5/d14/l48 to d5/d14/d5f/d69/l71 0 2024-09-18T12:52:03.054 INFO:tasks.workunit.client.1.smithi161.stdout:5/296: mknod d3/d14/c60 0 2024-09-18T12:52:03.055 INFO:tasks.workunit.client.1.smithi161.stdout:3/384: sync 2024-09-18T12:52:03.055 INFO:tasks.workunit.client.1.smithi161.stdout:2/365: sync 2024-09-18T12:52:03.056 INFO:tasks.workunit.client.0.smithi045.stdout:2/127: symlink d5/d2c/l2f 0 2024-09-18T12:52:03.056 INFO:tasks.workunit.client.0.smithi045.stdout:2/128: readlink d5/d2c/l2f 0 2024-09-18T12:52:03.057 INFO:tasks.workunit.client.1.smithi161.stdout:5/297: dread - d3/d9/d4b/f5f zero size 2024-09-18T12:52:03.057 INFO:tasks.workunit.client.1.smithi161.stdout:9/302: dwrite d0/f64 [0,4194304] 0 2024-09-18T12:52:03.057 INFO:tasks.workunit.client.1.smithi161.stdout:3/385: fdatasync d1/f54 0 2024-09-18T12:52:03.057 INFO:tasks.workunit.client.1.smithi161.stdout:8/408: creat d0/d3/d10/d21/d4a/d52/d66/d5b/f8a x:0 0 0 2024-09-18T12:52:03.058 INFO:tasks.workunit.client.1.smithi161.stdout:2/366: write d0/d1/d4c/f55 [329316,105052] 0 2024-09-18T12:52:03.060 INFO:tasks.workunit.client.0.smithi045.stdout:2/129: mknod d5/d2c/c30 0 2024-09-18T12:52:03.061 INFO:tasks.workunit.client.1.smithi161.stdout:8/409: write d0/d3/d10/f18 [1913948,64271] 0 2024-09-18T12:52:03.064 INFO:tasks.workunit.client.1.smithi161.stdout:4/358: dwrite d5/f36 [0,4194304] 0 2024-09-18T12:52:03.064 INFO:tasks.workunit.client.0.smithi045.stdout:2/130: creat d5/de/d16/f31 x:0 0 0 2024-09-18T12:52:03.065 INFO:tasks.workunit.client.1.smithi161.stdout:3/386: creat d1/d2e/d68/f87 x:0 0 0 2024-09-18T12:52:03.066 INFO:tasks.workunit.client.1.smithi161.stdout:1/289: getdents d1/d26/d3a/d52 0 2024-09-18T12:52:03.066 INFO:tasks.workunit.client.1.smithi161.stdout:0/351: write df/d30/f3a [582409,70509] 0 2024-09-18T12:52:03.069 INFO:tasks.workunit.client.1.smithi161.stdout:0/352: dread df/d30/f3a [0,4194304] 0 2024-09-18T12:52:03.071 INFO:tasks.workunit.client.1.smithi161.stdout:2/367: creat d0/d1/d3b/f83 x:0 0 0 2024-09-18T12:52:03.071 INFO:tasks.workunit.client.1.smithi161.stdout:2/368: chown d0/d1/d3b/d7e/c73 11276000 1 2024-09-18T12:52:03.073 INFO:tasks.workunit.client.0.smithi045.stdout:2/131: dwrite d5/de/f28 [0,4194304] 0 2024-09-18T12:52:03.075 INFO:tasks.workunit.client.1.smithi161.stdout:8/410: mkdir d0/d3/d10/d21/d4a/d52/d82/d8b 0 2024-09-18T12:52:03.078 INFO:tasks.workunit.client.0.smithi045.stdout:2/132: creat d5/de/f32 x:0 0 0 2024-09-18T12:52:03.079 INFO:tasks.workunit.client.0.smithi045.stdout:2/133: write d5/fd [1799403,18834] 0 2024-09-18T12:52:03.084 INFO:tasks.workunit.client.0.smithi045.stdout:2/134: rename d5/de/d16/d27 to d5/de/d33 0 2024-09-18T12:52:03.091 INFO:tasks.workunit.client.0.smithi045.stdout:2/135: dwrite d5/de/f32 [0,4194304] 0 2024-09-18T12:52:03.096 INFO:tasks.workunit.client.0.smithi045.stdout:2/136: creat d5/f34 x:0 0 0 2024-09-18T12:52:03.098 INFO:tasks.workunit.client.0.smithi045.stdout:2/137: mkdir d5/d35 0 2024-09-18T12:52:03.100 INFO:tasks.workunit.client.0.smithi045.stdout:2/138: creat d5/de/d16/f36 x:0 0 0 2024-09-18T12:52:03.101 INFO:tasks.workunit.client.1.smithi161.stdout:9/303: link d0/d16/l52 d0/d47/l67 0 2024-09-18T12:52:03.101 INFO:tasks.workunit.client.1.smithi161.stdout:3/387: truncate d1/d2e/d24/f45 1676484 0 2024-09-18T12:52:03.101 INFO:tasks.workunit.client.0.smithi045.stdout:2/139: write d5/de/ff [4340100,128838] 0 2024-09-18T12:52:03.102 INFO:tasks.workunit.client.1.smithi161.stdout:4/359: write d5/f20 [392116,49519] 0 2024-09-18T12:52:03.102 INFO:tasks.workunit.client.1.smithi161.stdout:9/304: dread - d0/d47/d48/f4a zero size 2024-09-18T12:52:03.104 INFO:tasks.workunit.client.1.smithi161.stdout:8/411: symlink d0/d3/d1e/l8c 0 2024-09-18T12:52:03.105 INFO:tasks.workunit.client.1.smithi161.stdout:2/369: rename d0/d5/d43/l2f to d0/l84 0 2024-09-18T12:52:03.106 INFO:tasks.workunit.client.1.smithi161.stdout:0/353: getdents df/d29/d36 0 2024-09-18T12:52:03.107 INFO:tasks.workunit.client.1.smithi161.stdout:8/412: write d0/d3/d1e/f46 [1499697,95042] 0 2024-09-18T12:52:03.107 INFO:tasks.workunit.client.1.smithi161.stdout:2/370: chown d0/d4/d52/f59 32317844 1 2024-09-18T12:52:03.108 INFO:tasks.workunit.client.1.smithi161.stdout:9/305: creat d0/d16/d25/d46/f68 x:0 0 0 2024-09-18T12:52:03.110 INFO:tasks.workunit.client.1.smithi161.stdout:5/298: dwrite d3/d9/f12 [0,4194304] 0 2024-09-18T12:52:03.110 INFO:tasks.workunit.client.1.smithi161.stdout:0/354: write df/d30/f3f [336805,40046] 0 2024-09-18T12:52:03.111 INFO:tasks.workunit.client.1.smithi161.stdout:2/371: stat d0/d1/d3b/d3d/d4f 0 2024-09-18T12:52:03.112 INFO:tasks.workunit.client.1.smithi161.stdout:8/413: chown d0/f2a 236724396 1 2024-09-18T12:52:03.113 INFO:tasks.workunit.client.1.smithi161.stdout:9/306: creat d0/db/d18/f69 x:0 0 0 2024-09-18T12:52:03.114 INFO:tasks.workunit.client.1.smithi161.stdout:4/360: dread d5/d32/f38 [0,4194304] 0 2024-09-18T12:52:03.114 INFO:tasks.workunit.client.1.smithi161.stdout:3/388: dread d1/f12 [0,4194304] 0 2024-09-18T12:52:03.115 INFO:tasks.workunit.client.1.smithi161.stdout:5/299: mkdir d3/d14/d20/d21/d24/d61 0 2024-09-18T12:52:03.116 INFO:tasks.workunit.client.1.smithi161.stdout:4/361: fdatasync d5/d32/f53 0 2024-09-18T12:52:03.117 INFO:tasks.workunit.client.1.smithi161.stdout:0/355: truncate df/f15 712841 0 2024-09-18T12:52:03.119 INFO:tasks.workunit.client.1.smithi161.stdout:5/300: symlink d3/d44/l62 0 2024-09-18T12:52:03.121 INFO:tasks.workunit.client.1.smithi161.stdout:4/362: creat d5/d27/f72 x:0 0 0 2024-09-18T12:52:03.121 INFO:tasks.workunit.client.1.smithi161.stdout:0/356: fdatasync df/d29/d2d/d37/f3e 0 2024-09-18T12:52:03.122 INFO:tasks.workunit.client.1.smithi161.stdout:8/414: getdents d0/d3/d10/d21/d4a/d52 0 2024-09-18T12:52:03.122 INFO:tasks.workunit.client.1.smithi161.stdout:3/389: rmdir d1/d2e/d14/d78/d83 39 2024-09-18T12:52:03.123 INFO:tasks.workunit.client.1.smithi161.stdout:5/301: creat d3/d14/f63 x:0 0 0 2024-09-18T12:52:03.125 INFO:tasks.workunit.client.1.smithi161.stdout:4/363: stat d5/d14/l6b 0 2024-09-18T12:52:03.125 INFO:tasks.workunit.client.1.smithi161.stdout:0/357: creat df/d61/f79 x:0 0 0 2024-09-18T12:52:03.126 INFO:tasks.workunit.client.1.smithi161.stdout:2/372: dwrite d0/d5/d43/d35/f5f [0,4194304] 0 2024-09-18T12:52:03.126 INFO:tasks.workunit.client.1.smithi161.stdout:8/415: mknod d0/d3/d10/c8d 0 2024-09-18T12:52:03.127 INFO:tasks.workunit.client.1.smithi161.stdout:3/390: read - d1/d2e/d14/d2c/f31 zero size 2024-09-18T12:52:03.127 INFO:tasks.workunit.client.1.smithi161.stdout:9/307: dwrite d0/d16/d25/d28/f38 [0,4194304] 0 2024-09-18T12:52:03.131 INFO:tasks.workunit.client.1.smithi161.stdout:0/358: mkdir df/d29/d36/d7a 0 2024-09-18T12:52:03.132 INFO:tasks.workunit.client.1.smithi161.stdout:2/373: unlink d0/d1/c19 0 2024-09-18T12:52:03.136 INFO:tasks.workunit.client.1.smithi161.stdout:4/364: unlink d5/d27/l28 0 2024-09-18T12:52:03.136 INFO:tasks.workunit.client.1.smithi161.stdout:4/365: chown d5/d27/d44/f5a 21 1 2024-09-18T12:52:03.137 INFO:tasks.workunit.client.1.smithi161.stdout:4/366: stat d5/d32/d39 0 2024-09-18T12:52:03.138 INFO:tasks.workunit.client.1.smithi161.stdout:9/308: rmdir d0/d16/d25/d28 39 2024-09-18T12:52:03.141 INFO:tasks.workunit.client.1.smithi161.stdout:7/308: sync 2024-09-18T12:52:03.142 INFO:tasks.workunit.client.1.smithi161.stdout:3/391: mkdir d1/d2e/d14/d65/d76/d88 0 2024-09-18T12:52:03.143 INFO:tasks.workunit.client.1.smithi161.stdout:9/309: dread d0/db/d18/f36 [0,4194304] 0 2024-09-18T12:52:03.144 INFO:tasks.workunit.client.1.smithi161.stdout:8/416: mknod d0/c8e 0 2024-09-18T12:52:03.144 INFO:tasks.workunit.client.1.smithi161.stdout:5/302: write d3/d14/d20/d21/d24/f36 [181451,43825] 0 2024-09-18T12:52:03.146 INFO:tasks.workunit.client.1.smithi161.stdout:0/359: read df/d29/f53 [608584,82327] 0 2024-09-18T12:52:03.146 INFO:tasks.workunit.client.1.smithi161.stdout:2/374: creat d0/d4/d52/f85 x:0 0 0 2024-09-18T12:52:03.147 INFO:tasks.workunit.client.0.smithi045.stdout:2/140: rmdir d5/d35 0 2024-09-18T12:52:03.148 INFO:tasks.workunit.client.1.smithi161.stdout:0/360: write df/d29/d2d/d69/f77 [44556,83255] 0 2024-09-18T12:52:03.149 INFO:tasks.workunit.client.1.smithi161.stdout:4/367: creat d5/d27/d3a/d47/f73 x:0 0 0 2024-09-18T12:52:03.150 INFO:tasks.workunit.client.1.smithi161.stdout:4/368: read - d5/d27/d3a/d4c/f64 zero size 2024-09-18T12:52:03.151 INFO:tasks.workunit.client.0.smithi045.stdout:2/141: rename d5/de/f13 to d5/de/d33/f37 0 2024-09-18T12:52:03.154 INFO:tasks.workunit.client.1.smithi161.stdout:3/392: unlink d1/d2e/d68/f74 0 2024-09-18T12:52:03.155 INFO:tasks.workunit.client.0.smithi045.stdout:2/142: symlink d5/de/l38 0 2024-09-18T12:52:03.156 INFO:tasks.workunit.client.0.smithi045.stdout:2/143: dread - d5/f34 zero size 2024-09-18T12:52:03.159 INFO:tasks.workunit.client.1.smithi161.stdout:5/303: mknod d3/d44/c64 0 2024-09-18T12:52:03.160 INFO:tasks.workunit.client.1.smithi161.stdout:7/309: dread d3/d8/d15/f33 [0,4194304] 0 2024-09-18T12:52:03.161 INFO:tasks.workunit.client.1.smithi161.stdout:7/310: dread - d3/d8/d15/f3c zero size 2024-09-18T12:52:03.162 INFO:tasks.workunit.client.1.smithi161.stdout:2/375: mknod d0/d1/d3b/d7e/c86 0 2024-09-18T12:52:03.165 INFO:tasks.workunit.client.1.smithi161.stdout:0/361: dread df/d29/f3b [0,4194304] 0 2024-09-18T12:52:03.166 INFO:tasks.workunit.client.1.smithi161.stdout:3/393: mkdir d1/d2e/d24/d1d/d89 0 2024-09-18T12:52:03.167 INFO:tasks.workunit.client.0.smithi045.stdout:2/144: link d5/de/d16/l17 d5/de/d33/l39 0 2024-09-18T12:52:03.168 INFO:tasks.workunit.client.1.smithi161.stdout:7/311: dwrite d3/d8/d15/f3b [0,4194304] 0 2024-09-18T12:52:03.168 INFO:tasks.workunit.client.1.smithi161.stdout:8/417: symlink d0/d3/d1e/l8f 0 2024-09-18T12:52:03.169 INFO:tasks.workunit.client.1.smithi161.stdout:3/394: write d1/d2e/d24/d1d/f2a [1346462,43767] 0 2024-09-18T12:52:03.171 INFO:tasks.workunit.client.0.smithi045.stdout:2/145: dread d5/de/f28 [0,4194304] 0 2024-09-18T12:52:03.173 INFO:tasks.workunit.client.1.smithi161.stdout:3/395: dread - d1/d2e/d3d/f71 zero size 2024-09-18T12:52:03.174 INFO:tasks.workunit.client.1.smithi161.stdout:5/304: rename d3/d9/d4b/f4f to d3/d14/d20/d21/d46/f65 0 2024-09-18T12:52:03.175 INFO:tasks.workunit.client.1.smithi161.stdout:5/305: write d3/d9/d4b/f51 [92292,69481] 0 2024-09-18T12:52:03.178 INFO:tasks.workunit.client.1.smithi161.stdout:5/306: readlink d3/d14/d20/d21/d24/l4a 0 2024-09-18T12:52:03.179 INFO:tasks.workunit.client.1.smithi161.stdout:5/307: write d3/d3b/d54/f5a [973398,71319] 0 2024-09-18T12:52:03.180 INFO:tasks.workunit.client.0.smithi045.stdout:2/146: mkdir d5/d3a 0 2024-09-18T12:52:03.180 INFO:tasks.workunit.client.1.smithi161.stdout:5/308: fsync d3/fd 0 2024-09-18T12:52:03.180 INFO:tasks.workunit.client.1.smithi161.stdout:3/396: dwrite d1/d2e/d14/d2c/f31 [0,4194304] 0 2024-09-18T12:52:03.183 INFO:tasks.workunit.client.1.smithi161.stdout:7/312: mkdir d3/d8/d15/d38/d4d 0 2024-09-18T12:52:03.184 INFO:tasks.workunit.client.0.smithi045.stdout:2/147: creat d5/de/d16/f3b x:0 0 0 2024-09-18T12:52:03.185 INFO:tasks.workunit.client.0.smithi045.stdout:2/148: truncate d5/f34 532950 0 2024-09-18T12:52:03.186 INFO:tasks.workunit.client.1.smithi161.stdout:2/376: dread d0/d5/d53/f5b [4194304,4194304] 0 2024-09-18T12:52:03.187 INFO:tasks.workunit.client.0.smithi045.stdout:2/149: truncate d5/de/d16/f2e 50872 0 2024-09-18T12:52:03.191 INFO:tasks.workunit.client.0.smithi045.stdout:2/150: dread d5/de/f32 [0,4194304] 0 2024-09-18T12:52:03.192 INFO:tasks.workunit.client.1.smithi161.stdout:7/313: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:52:03.193 INFO:tasks.workunit.client.1.smithi161.stdout:3/397: creat d1/d2e/d14/d65/d7a/f8a x:0 0 0 2024-09-18T12:52:03.194 INFO:tasks.workunit.client.1.smithi161.stdout:4/369: link d5/d14/l2a d5/d27/d3a/d4c/l74 0 2024-09-18T12:52:03.196 INFO:tasks.workunit.client.1.smithi161.stdout:9/310: link d0/d16/d25/d28/d45/c4e d0/d20/c6a 0 2024-09-18T12:52:03.197 INFO:tasks.workunit.client.0.smithi045.stdout:2/151: link d5/f34 d5/de/d33/f3c 0 2024-09-18T12:52:03.197 INFO:tasks.workunit.client.1.smithi161.stdout:2/377: dwrite d0/d1/df/f34 [0,4194304] 0 2024-09-18T12:52:03.198 INFO:tasks.workunit.client.1.smithi161.stdout:8/418: dread d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 [0,4194304] 0 2024-09-18T12:52:03.203 INFO:tasks.workunit.client.0.smithi045.stdout:2/152: unlink d5/de/d16/l29 0 2024-09-18T12:52:03.207 INFO:tasks.workunit.client.1.smithi161.stdout:9/311: creat d0/d20/f6b x:0 0 0 2024-09-18T12:52:03.212 INFO:tasks.workunit.client.0.smithi045.stdout:2/153: creat d5/de/d33/f3d x:0 0 0 2024-09-18T12:52:03.212 INFO:tasks.workunit.client.0.smithi045.stdout:2/154: chown d5/d2c/c30 8248 1 2024-09-18T12:52:03.212 INFO:tasks.workunit.client.1.smithi161.stdout:3/398: dread d1/d2e/f17 [0,4194304] 0 2024-09-18T12:52:03.212 INFO:tasks.workunit.client.1.smithi161.stdout:5/309: creat d3/f66 x:0 0 0 2024-09-18T12:52:03.215 INFO:tasks.workunit.client.0.smithi045.stdout:2/155: mkdir d5/d3a/d3e 0 2024-09-18T12:52:03.217 INFO:tasks.workunit.client.0.smithi045.stdout:2/156: symlink d5/de/d33/l3f 0 2024-09-18T12:52:03.218 INFO:tasks.workunit.client.1.smithi161.stdout:6/358: sync 2024-09-18T12:52:03.219 INFO:tasks.workunit.client.0.smithi045.stdout:2/157: rename d5/f8 to d5/de/d33/f40 0 2024-09-18T12:52:03.221 INFO:tasks.workunit.client.0.smithi045.stdout:2/158: mknod d5/d3a/d3e/c41 0 2024-09-18T12:52:03.221 INFO:tasks.workunit.client.0.smithi045.stdout:2/159: read - d5/de/d16/f31 zero size 2024-09-18T12:52:03.223 INFO:tasks.workunit.client.0.smithi045.stdout:2/160: creat d5/f42 x:0 0 0 2024-09-18T12:52:03.223 INFO:tasks.workunit.client.0.smithi045.stdout:2/161: chown d5/fd 1479297 1 2024-09-18T12:52:03.224 INFO:tasks.workunit.client.0.smithi045.stdout:2/162: chown d5/de/f1b 1 1 2024-09-18T12:52:03.225 INFO:tasks.workunit.client.0.smithi045.stdout:2/163: read d5/de/f28 [3237517,9765] 0 2024-09-18T12:52:03.226 INFO:tasks.workunit.client.0.smithi045.stdout:2/164: truncate d5/de/d16/f31 428031 0 2024-09-18T12:52:03.226 INFO:tasks.workunit.client.0.smithi045.stdout:2/165: dread - d5/f22 zero size 2024-09-18T12:52:03.228 INFO:tasks.workunit.client.0.smithi045.stdout:2/166: creat d5/de/d33/f43 x:0 0 0 2024-09-18T12:52:03.228 INFO:tasks.workunit.client.1.smithi161.stdout:4/370: getdents d5/d27/d3a/d60 0 2024-09-18T12:52:03.228 INFO:tasks.workunit.client.1.smithi161.stdout:9/312: rename d0/d16/f35 to d0/d20/f6c 0 2024-09-18T12:52:03.228 INFO:tasks.workunit.client.1.smithi161.stdout:2/378: symlink d0/d5/d43/l87 0 2024-09-18T12:52:03.229 INFO:tasks.workunit.client.1.smithi161.stdout:2/379: chown d0/d1/f3f 0 1 2024-09-18T12:52:03.230 INFO:tasks.workunit.client.1.smithi161.stdout:2/380: chown d0/d1/d3b 2036 1 2024-09-18T12:52:03.230 INFO:tasks.workunit.client.1.smithi161.stdout:6/359: rmdir d4/d1a 39 2024-09-18T12:52:03.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/314: getdents d3/d8/d15/d1a/d44 0 2024-09-18T12:52:03.234 INFO:tasks.workunit.client.1.smithi161.stdout:9/313: mknod d0/d20/c6d 0 2024-09-18T12:52:03.235 INFO:tasks.workunit.client.0.smithi045.stdout:2/167: dwrite d5/de/f1b [0,4194304] 0 2024-09-18T12:52:03.235 INFO:tasks.workunit.client.1.smithi161.stdout:9/314: readlink d0/d16/l58 0 2024-09-18T12:52:03.236 INFO:tasks.workunit.client.1.smithi161.stdout:4/371: creat d5/d14/d5f/f75 x:0 0 0 2024-09-18T12:52:03.239 INFO:tasks.workunit.client.1.smithi161.stdout:6/360: write d4/d1a/d1c/f2c [1760394,27081] 0 2024-09-18T12:52:03.239 INFO:tasks.workunit.client.0.smithi045.stdout:2/168: mknod d5/d3a/c44 0 2024-09-18T12:52:03.239 INFO:tasks.workunit.client.1.smithi161.stdout:7/315: dwrite d3/d8/d15/d1a/d24/d31/f34 [0,4194304] 0 2024-09-18T12:52:03.241 INFO:tasks.workunit.client.1.smithi161.stdout:5/310: link d3/d44/c45 d3/d14/d20/c67 0 2024-09-18T12:52:03.241 INFO:tasks.workunit.client.1.smithi161.stdout:7/316: stat d3/d8/d15/d1a/f22 0 2024-09-18T12:52:03.242 INFO:tasks.workunit.client.1.smithi161.stdout:3/399: link d1/d2e/d24/d1d/f64 d1/f8b 0 2024-09-18T12:52:03.248 INFO:tasks.workunit.client.0.smithi045.stdout:2/169: link d5/de/d33/f43 d5/d3a/f45 0 2024-09-18T12:52:03.249 INFO:tasks.workunit.client.1.smithi161.stdout:2/381: dread d0/d1/f2e [0,4194304] 0 2024-09-18T12:52:03.249 INFO:tasks.workunit.client.1.smithi161.stdout:4/372: unlink d5/d27/d3a/f3c 0 2024-09-18T12:52:03.250 INFO:tasks.workunit.client.1.smithi161.stdout:6/361: write d4/d1a/f13 [4704886,50028] 0 2024-09-18T12:52:03.252 INFO:tasks.workunit.client.1.smithi161.stdout:5/311: mknod d3/d14/c68 0 2024-09-18T12:52:03.253 INFO:tasks.workunit.client.1.smithi161.stdout:3/400: dread d1/d2e/d24/d1d/f4f [0,4194304] 0 2024-09-18T12:52:03.253 INFO:tasks.workunit.client.1.smithi161.stdout:6/362: chown d4/d39/d46/l57 100 1 2024-09-18T12:52:03.253 INFO:tasks.workunit.client.1.smithi161.stdout:4/373: write d5/d27/d44/f5a [915451,60676] 0 2024-09-18T12:52:03.253 INFO:tasks.workunit.client.1.smithi161.stdout:7/317: symlink d3/l4e 0 2024-09-18T12:52:03.256 INFO:tasks.workunit.client.1.smithi161.stdout:7/318: stat d3/d8/d15/d1a/d24/f4c 0 2024-09-18T12:52:03.256 INFO:tasks.workunit.client.0.smithi045.stdout:2/170: mkdir d5/d46 0 2024-09-18T12:52:03.257 INFO:tasks.workunit.client.1.smithi161.stdout:2/382: dread d0/d1/df/f34 [0,4194304] 0 2024-09-18T12:52:03.257 INFO:tasks.workunit.client.1.smithi161.stdout:7/319: write d3/d8/d15/f3b [4403083,31424] 0 2024-09-18T12:52:03.258 INFO:tasks.workunit.client.1.smithi161.stdout:7/320: stat d3/d8/d15/d1a/f39 0 2024-09-18T12:52:03.260 INFO:tasks.workunit.client.1.smithi161.stdout:5/312: creat d3/d3b/d54/f69 x:0 0 0 2024-09-18T12:52:03.261 INFO:tasks.workunit.client.1.smithi161.stdout:6/363: rmdir d4/d39/d47/d51 39 2024-09-18T12:52:03.262 INFO:tasks.workunit.client.1.smithi161.stdout:5/313: write d3/d14/d20/d21/d46/f49 [646910,7992] 0 2024-09-18T12:52:03.263 INFO:tasks.workunit.client.1.smithi161.stdout:6/364: dread - d4/d39/d26/d20/d28/f37 zero size 2024-09-18T12:52:03.263 INFO:tasks.workunit.client.1.smithi161.stdout:4/374: rename d5/d14/f1e to d5/d14/d67/f76 0 2024-09-18T12:52:03.263 INFO:tasks.workunit.client.1.smithi161.stdout:9/315: write d0/f22 [824334,118347] 0 2024-09-18T12:52:03.264 INFO:tasks.workunit.client.1.smithi161.stdout:9/316: chown d0/db/f57 3940 1 2024-09-18T12:52:03.265 INFO:tasks.workunit.client.1.smithi161.stdout:9/317: readlink d0/d16/d25/l30 0 2024-09-18T12:52:03.266 INFO:tasks.workunit.client.1.smithi161.stdout:2/383: rmdir d0/d5/d43/d35 39 2024-09-18T12:52:03.270 INFO:tasks.workunit.client.0.smithi045.stdout:2/171: write d5/f9 [928650,54255] 0 2024-09-18T12:52:03.271 INFO:tasks.workunit.client.1.smithi161.stdout:4/375: creat d5/d14/d5f/d69/f77 x:0 0 0 2024-09-18T12:52:03.271 INFO:tasks.workunit.client.1.smithi161.stdout:6/365: symlink d4/d39/d26/d20/d45/l75 0 2024-09-18T12:52:03.272 INFO:tasks.workunit.client.0.smithi045.stdout:2/172: symlink d5/d2c/l47 0 2024-09-18T12:52:03.272 INFO:tasks.workunit.client.1.smithi161.stdout:6/366: readlink d4/d1a/d1c/l64 0 2024-09-18T12:52:03.273 INFO:tasks.workunit.client.1.smithi161.stdout:9/318: rmdir d0/db/d18 39 2024-09-18T12:52:03.275 INFO:tasks.workunit.client.0.smithi045.stdout:2/173: mknod d5/c48 0 2024-09-18T12:52:03.276 INFO:tasks.workunit.client.0.smithi045.stdout:2/174: chown d5/c6 44 1 2024-09-18T12:52:03.277 INFO:tasks.workunit.client.1.smithi161.stdout:5/314: link d3/d3b/d54/f5a d3/f6a 0 2024-09-18T12:52:03.279 INFO:tasks.workunit.client.0.smithi045.stdout:2/175: rmdir d5/de/d33 39 2024-09-18T12:52:03.280 INFO:tasks.workunit.client.1.smithi161.stdout:7/321: truncate d3/f2e 3067225 0 2024-09-18T12:52:03.283 INFO:tasks.workunit.client.1.smithi161.stdout:6/367: dread d4/d39/d26/f2b [0,4194304] 0 2024-09-18T12:52:03.283 INFO:tasks.workunit.client.1.smithi161.stdout:4/376: truncate d5/d27/d44/f63 17046 0 2024-09-18T12:52:03.285 INFO:tasks.workunit.client.1.smithi161.stdout:9/319: getdents d0/d16 0 2024-09-18T12:52:03.285 INFO:tasks.workunit.client.1.smithi161.stdout:4/377: read d5/f20 [178297,13375] 0 2024-09-18T12:52:03.285 INFO:tasks.workunit.client.1.smithi161.stdout:7/322: getdents d3/d8/d15/d38/d4d 0 2024-09-18T12:52:03.286 INFO:tasks.workunit.client.1.smithi161.stdout:4/378: chown d5/d32/d39 682661272 1 2024-09-18T12:52:03.286 INFO:tasks.workunit.client.0.smithi045.stdout:2/176: getdents d5/de 0 2024-09-18T12:52:03.287 INFO:tasks.workunit.client.1.smithi161.stdout:6/368: rmdir d4/d39/d26/d20/d28 39 2024-09-18T12:52:03.288 INFO:tasks.workunit.client.1.smithi161.stdout:5/315: getdents d3/d44 0 2024-09-18T12:52:03.288 INFO:tasks.workunit.client.0.smithi045.stdout:2/177: truncate d5/d3a/f45 463763 0 2024-09-18T12:52:03.289 INFO:tasks.workunit.client.1.smithi161.stdout:6/369: chown d4/d1a/d1c/f2c 4 1 2024-09-18T12:52:03.289 INFO:tasks.workunit.client.1.smithi161.stdout:5/316: fsync d3/d9/f41 0 2024-09-18T12:52:03.289 INFO:tasks.workunit.client.1.smithi161.stdout:7/323: mkdir d3/d8/d4f 0 2024-09-18T12:52:03.290 INFO:tasks.workunit.client.0.smithi045.stdout:2/178: rmdir d5/de/d33 39 2024-09-18T12:52:03.291 INFO:tasks.workunit.client.1.smithi161.stdout:4/379: dread d5/d27/d3a/f3d [0,4194304] 0 2024-09-18T12:52:03.291 INFO:tasks.workunit.client.1.smithi161.stdout:6/370: mkdir d4/d39/d26/d31/d76 0 2024-09-18T12:52:03.292 INFO:tasks.workunit.client.1.smithi161.stdout:7/324: mkdir d3/d50 0 2024-09-18T12:52:03.295 INFO:tasks.workunit.client.1.smithi161.stdout:5/317: dread d3/d14/d20/f2e [0,4194304] 0 2024-09-18T12:52:03.298 INFO:tasks.workunit.client.1.smithi161.stdout:4/380: creat d5/d32/d39/d4d/f78 x:0 0 0 2024-09-18T12:52:03.298 INFO:tasks.workunit.client.0.smithi045.stdout:2/179: chown d5/de/d33/l2a 28116 1 2024-09-18T12:52:03.299 INFO:tasks.workunit.client.1.smithi161.stdout:4/381: fdatasync d5/d27/d44/f5a 0 2024-09-18T12:52:03.299 INFO:tasks.workunit.client.1.smithi161.stdout:7/325: creat d3/d8/d15/d1a/d24/f51 x:0 0 0 2024-09-18T12:52:03.299 INFO:tasks.workunit.client.1.smithi161.stdout:5/318: dread d3/d14/f1b [0,4194304] 0 2024-09-18T12:52:03.300 INFO:tasks.workunit.client.1.smithi161.stdout:9/320: dread d0/db/f26 [0,4194304] 0 2024-09-18T12:52:03.301 INFO:tasks.workunit.client.1.smithi161.stdout:6/371: mknod d4/d1a/c77 0 2024-09-18T12:52:03.302 INFO:tasks.workunit.client.0.smithi045.stdout:2/180: symlink d5/l49 0 2024-09-18T12:52:03.303 INFO:tasks.workunit.client.1.smithi161.stdout:4/382: mknod d5/d27/c79 0 2024-09-18T12:52:03.306 INFO:tasks.workunit.client.0.smithi045.stdout:2/181: fdatasync d5/de/d33/f40 0 2024-09-18T12:52:03.311 INFO:tasks.workunit.client.1.smithi161.stdout:9/321: creat d0/f6e x:0 0 0 2024-09-18T12:52:03.311 INFO:tasks.workunit.client.1.smithi161.stdout:9/322: readlink d0/db/l40 0 2024-09-18T12:52:03.311 INFO:tasks.workunit.client.1.smithi161.stdout:4/383: truncate d5/d27/f37 997239 0 2024-09-18T12:52:03.312 INFO:tasks.workunit.client.1.smithi161.stdout:1/290: sync 2024-09-18T12:52:03.312 INFO:tasks.workunit.client.1.smithi161.stdout:7/326: rename d3/d8/d15/d1a/l2a to d3/d8/l52 0 2024-09-18T12:52:03.313 INFO:tasks.workunit.client.1.smithi161.stdout:6/372: getdents d4/d39/d26/d20/d28 0 2024-09-18T12:52:03.313 INFO:tasks.workunit.client.1.smithi161.stdout:7/327: write d3/f11 [964410,117177] 0 2024-09-18T12:52:03.314 INFO:tasks.workunit.client.1.smithi161.stdout:7/328: stat d3/d8/d15/d1a/d24/d31 0 2024-09-18T12:52:03.317 INFO:tasks.workunit.client.1.smithi161.stdout:5/319: rename d3/f35 to d3/d14/d20/d21/d24/d61/f6b 0 2024-09-18T12:52:03.318 INFO:tasks.workunit.client.1.smithi161.stdout:9/323: dwrite d0/d20/f6c [0,4194304] 0 2024-09-18T12:52:03.323 INFO:tasks.workunit.client.1.smithi161.stdout:4/384: creat d5/d27/d3a/f7a x:0 0 0 2024-09-18T12:52:03.325 INFO:tasks.workunit.client.1.smithi161.stdout:4/385: read d5/d32/d39/f4e [3715964,33827] 0 2024-09-18T12:52:03.325 INFO:tasks.workunit.client.1.smithi161.stdout:1/291: dwrite d1/da/d31/f3c [0,4194304] 0 2024-09-18T12:52:03.327 INFO:tasks.workunit.client.1.smithi161.stdout:1/292: write d1/d26/f10 [2629878,92003] 0 2024-09-18T12:52:03.328 INFO:tasks.workunit.client.1.smithi161.stdout:6/373: write d4/d39/d48/f56 [693226,111560] 0 2024-09-18T12:52:03.330 INFO:tasks.workunit.client.1.smithi161.stdout:6/374: write d4/d1a/d1c/f2c [1021720,71305] 0 2024-09-18T12:52:03.331 INFO:tasks.workunit.client.1.smithi161.stdout:9/324: unlink d0/c6 0 2024-09-18T12:52:03.331 INFO:tasks.workunit.client.1.smithi161.stdout:4/386: fdatasync d5/d27/d3a/f3d 0 2024-09-18T12:52:03.332 INFO:tasks.workunit.client.1.smithi161.stdout:9/325: stat d0/l8 0 2024-09-18T12:52:03.333 INFO:tasks.workunit.client.1.smithi161.stdout:4/387: write d5/f17 [2007268,43598] 0 2024-09-18T12:52:03.333 INFO:tasks.workunit.client.1.smithi161.stdout:1/293: unlink d1/d1d/l38 0 2024-09-18T12:52:03.335 INFO:tasks.workunit.client.1.smithi161.stdout:7/329: getdents d3/d8/d15/d1a/d24 0 2024-09-18T12:52:03.338 INFO:tasks.workunit.client.1.smithi161.stdout:5/320: truncate d3/d3b/f42 178908 0 2024-09-18T12:52:03.339 INFO:tasks.workunit.client.1.smithi161.stdout:4/388: mkdir d5/d27/d3a/d47/d49/d7b 0 2024-09-18T12:52:03.341 INFO:tasks.workunit.client.1.smithi161.stdout:1/294: rename d1/d26/f5b to d1/d26/d3a/f5d 0 2024-09-18T12:52:03.343 INFO:tasks.workunit.client.1.smithi161.stdout:1/295: chown d1/d1d/f21 129899 1 2024-09-18T12:52:03.344 INFO:tasks.workunit.client.1.smithi161.stdout:6/375: dwrite d4/d39/d47/d51/f52 [0,4194304] 0 2024-09-18T12:52:03.348 INFO:tasks.workunit.client.1.smithi161.stdout:1/296: mknod d1/d26/d3a/d52/c5e 0 2024-09-18T12:52:03.349 INFO:tasks.workunit.client.1.smithi161.stdout:4/389: dwrite d5/d32/f53 [0,4194304] 0 2024-09-18T12:52:03.350 INFO:tasks.workunit.client.1.smithi161.stdout:6/376: creat d4/d1a/d1c/d3e/d4d/f78 x:0 0 0 2024-09-18T12:52:03.352 INFO:tasks.workunit.client.1.smithi161.stdout:0/362: sync 2024-09-18T12:52:03.352 INFO:tasks.workunit.client.1.smithi161.stdout:8/419: sync 2024-09-18T12:52:03.355 INFO:tasks.workunit.client.1.smithi161.stdout:1/297: mknod d1/d26/d3a/d52/c5f 0 2024-09-18T12:52:03.356 INFO:tasks.workunit.client.1.smithi161.stdout:4/390: symlink d5/d14/d5f/l7c 0 2024-09-18T12:52:03.357 INFO:tasks.workunit.client.1.smithi161.stdout:0/363: chown df/d30/c34 15 1 2024-09-18T12:52:03.357 INFO:tasks.workunit.client.1.smithi161.stdout:6/377: read d4/d1a/f14 [1806121,76664] 0 2024-09-18T12:52:03.358 INFO:tasks.workunit.client.1.smithi161.stdout:9/326: dwrite d0/d16/d25/f27 [0,4194304] 0 2024-09-18T12:52:03.359 INFO:tasks.workunit.client.1.smithi161.stdout:5/321: truncate d3/d14/d20/d21/d46/f65 1069768 0 2024-09-18T12:52:03.359 INFO:tasks.workunit.client.1.smithi161.stdout:1/298: chown d1/da/d1f/d45/d5c 1713693 1 2024-09-18T12:52:03.360 INFO:tasks.workunit.client.1.smithi161.stdout:0/364: chown df/l5a 1530 1 2024-09-18T12:52:03.362 INFO:tasks.workunit.client.1.smithi161.stdout:8/420: dread d0/d3/d10/d21/d4a/d52/d66/d5b/f5e [0,4194304] 0 2024-09-18T12:52:03.363 INFO:tasks.workunit.client.1.smithi161.stdout:1/299: dread - d1/da/d1f/f2c zero size 2024-09-18T12:52:03.364 INFO:tasks.workunit.client.1.smithi161.stdout:4/391: mknod d5/d27/d44/d61/d6c/c7d 0 2024-09-18T12:52:03.365 INFO:tasks.workunit.client.1.smithi161.stdout:0/365: stat df/d29/d2d/d37/d55 0 2024-09-18T12:52:03.365 INFO:tasks.workunit.client.1.smithi161.stdout:7/330: dwrite d3/d8/d15/f33 [0,4194304] 0 2024-09-18T12:52:03.369 INFO:tasks.workunit.client.1.smithi161.stdout:7/331: write d3/f19 [2704080,107023] 0 2024-09-18T12:52:03.369 INFO:tasks.workunit.client.1.smithi161.stdout:0/366: write df/f24 [793071,33908] 0 2024-09-18T12:52:03.370 INFO:tasks.workunit.client.1.smithi161.stdout:1/300: mknod d1/c60 0 2024-09-18T12:52:03.370 INFO:tasks.workunit.client.1.smithi161.stdout:4/392: write d5/d14/d5f/d69/f77 [431632,54533] 0 2024-09-18T12:52:03.371 INFO:tasks.workunit.client.1.smithi161.stdout:8/421: truncate d0/d3/d5f/f72 489873 0 2024-09-18T12:52:03.373 INFO:tasks.workunit.client.1.smithi161.stdout:4/393: fsync d5/d27/f72 0 2024-09-18T12:52:03.374 INFO:tasks.workunit.client.1.smithi161.stdout:9/327: dwrite d0/d20/d49/f63 [0,4194304] 0 2024-09-18T12:52:03.377 INFO:tasks.workunit.client.1.smithi161.stdout:7/332: symlink d3/d8/d4b/l53 0 2024-09-18T12:52:03.380 INFO:tasks.workunit.client.1.smithi161.stdout:9/328: chown d0/d16/d25/d28/d45/f66 4769 1 2024-09-18T12:52:03.382 INFO:tasks.workunit.client.1.smithi161.stdout:4/394: getdents d5/d27/d3a/d60 0 2024-09-18T12:52:03.384 INFO:tasks.workunit.client.1.smithi161.stdout:9/329: rmdir d0/d20/d49 39 2024-09-18T12:52:03.385 INFO:tasks.workunit.client.1.smithi161.stdout:0/367: dwrite df/f2b [0,4194304] 0 2024-09-18T12:52:03.387 INFO:tasks.workunit.client.1.smithi161.stdout:5/322: dread d3/d14/f4e [0,4194304] 0 2024-09-18T12:52:03.387 INFO:tasks.workunit.client.1.smithi161.stdout:8/422: dwrite d0/d3/d1e/d34/f39 [0,4194304] 0 2024-09-18T12:52:03.389 INFO:tasks.workunit.client.0.smithi045.stdout:2/182: chown d5/de/d16/c26 53310782 1 2024-09-18T12:52:03.390 INFO:tasks.workunit.client.0.smithi045.stdout:2/183: fdatasync d5/de/d16/f2e 0 2024-09-18T12:52:03.391 INFO:tasks.workunit.client.0.smithi045.stdout:2/184: chown d5/de/d16/c26 1 1 2024-09-18T12:52:03.391 INFO:tasks.workunit.client.1.smithi161.stdout:1/301: truncate d1/d26/f24 156851 0 2024-09-18T12:52:03.393 INFO:tasks.workunit.client.1.smithi161.stdout:9/330: read d0/d16/d25/d28/f33 [2226972,105401] 0 2024-09-18T12:52:03.395 INFO:tasks.workunit.client.1.smithi161.stdout:5/323: symlink d3/d14/d20/d21/d24/l6c 0 2024-09-18T12:52:03.396 INFO:tasks.workunit.client.1.smithi161.stdout:0/368: rename df/d29/d36/f57 to df/d30/d4d/f7b 0 2024-09-18T12:52:03.398 INFO:tasks.workunit.client.0.smithi045.stdout:2/185: rename d5/l49 to d5/d3a/d3e/l4a 0 2024-09-18T12:52:03.399 INFO:tasks.workunit.client.1.smithi161.stdout:0/369: truncate df/d61/f79 128961 0 2024-09-18T12:52:03.401 INFO:tasks.workunit.client.1.smithi161.stdout:6/378: dread d4/d39/d26/d20/d28/f3b [0,4194304] 0 2024-09-18T12:52:03.402 INFO:tasks.workunit.client.1.smithi161.stdout:4/395: dread d5/fe [4194304,4194304] 0 2024-09-18T12:52:03.402 INFO:tasks.workunit.client.1.smithi161.stdout:9/331: dwrite d0/f3b [0,4194304] 0 2024-09-18T12:52:03.403 INFO:tasks.workunit.client.1.smithi161.stdout:5/324: dread d3/f6a [0,4194304] 0 2024-09-18T12:52:03.403 INFO:tasks.workunit.client.0.smithi045.stdout:2/186: mknod d5/d2c/c4b 0 2024-09-18T12:52:03.404 INFO:tasks.workunit.client.1.smithi161.stdout:8/423: write d0/f2a [577323,41556] 0 2024-09-18T12:52:03.406 INFO:tasks.workunit.client.1.smithi161.stdout:0/370: symlink df/d30/d4d/l7c 0 2024-09-18T12:52:03.407 INFO:tasks.workunit.client.0.smithi045.stdout:2/187: creat d5/d3a/f4c x:0 0 0 2024-09-18T12:52:03.408 INFO:tasks.workunit.client.1.smithi161.stdout:2/384: sync 2024-09-18T12:52:03.408 INFO:tasks.workunit.client.1.smithi161.stdout:3/401: sync 2024-09-18T12:52:03.409 INFO:tasks.workunit.client.1.smithi161.stdout:4/396: creat d5/d14/d67/f7e x:0 0 0 2024-09-18T12:52:03.410 INFO:tasks.workunit.client.1.smithi161.stdout:2/385: truncate d0/d4/f2a 1428510 0 2024-09-18T12:52:03.411 INFO:tasks.workunit.client.1.smithi161.stdout:4/397: chown d5/d32/f53 127 1 2024-09-18T12:52:03.411 INFO:tasks.workunit.client.1.smithi161.stdout:2/386: write d0/d1/d3b/f83 [624587,26006] 0 2024-09-18T12:52:03.412 INFO:tasks.workunit.client.0.smithi045.stdout:2/188: rmdir d5/d3a/d3e 39 2024-09-18T12:52:03.416 INFO:tasks.workunit.client.1.smithi161.stdout:7/333: dread d3/f19 [0,4194304] 0 2024-09-18T12:52:03.416 INFO:tasks.workunit.client.1.smithi161.stdout:5/325: creat d3/d9/f6d x:0 0 0 2024-09-18T12:52:03.418 INFO:tasks.workunit.client.0.smithi045.stdout:2/189: rename d5/de to d5/d2c/d4d 0 2024-09-18T12:52:03.418 INFO:tasks.workunit.client.0.smithi045.stdout:2/190: stat d5/f34 0 2024-09-18T12:52:03.419 INFO:tasks.workunit.client.1.smithi161.stdout:8/424: creat d0/d3/d1e/d34/f90 x:0 0 0 2024-09-18T12:52:03.420 INFO:tasks.workunit.client.1.smithi161.stdout:0/371: mknod df/d29/d46/d51/c7d 0 2024-09-18T12:52:03.420 INFO:tasks.workunit.client.1.smithi161.stdout:8/425: chown d0/d3/d10/d21/l59 1 1 2024-09-18T12:52:03.421 INFO:tasks.workunit.client.1.smithi161.stdout:3/402: mkdir d1/d2e/d14/d65/d76/d8c 0 2024-09-18T12:52:03.422 INFO:tasks.workunit.client.1.smithi161.stdout:1/302: truncate d1/d26/f2f 859803 0 2024-09-18T12:52:03.424 INFO:tasks.workunit.client.1.smithi161.stdout:2/387: creat d0/d1/d3b/d3d/f88 x:0 0 0 2024-09-18T12:52:03.424 INFO:tasks.workunit.client.1.smithi161.stdout:7/334: symlink d3/d8/d4b/l54 0 2024-09-18T12:52:03.426 INFO:tasks.workunit.client.0.smithi045.stdout:2/191: creat d5/d2c/d4d/f4e x:0 0 0 2024-09-18T12:52:03.428 INFO:tasks.workunit.client.1.smithi161.stdout:5/326: creat d3/d9/f6e x:0 0 0 2024-09-18T12:52:03.429 INFO:tasks.workunit.client.1.smithi161.stdout:5/327: chown d3/d14/f19 55211 1 2024-09-18T12:52:03.429 INFO:tasks.workunit.client.1.smithi161.stdout:5/328: dread - d3/d9/f6e zero size 2024-09-18T12:52:03.433 INFO:tasks.workunit.client.1.smithi161.stdout:0/372: creat df/d61/f7e x:0 0 0 2024-09-18T12:52:03.433 INFO:tasks.workunit.client.0.smithi045.stdout:2/192: dwrite d5/f9 [0,4194304] 0 2024-09-18T12:52:03.434 INFO:tasks.workunit.client.1.smithi161.stdout:5/329: dread d3/f13 [4194304,4194304] 0 2024-09-18T12:52:03.435 INFO:tasks.workunit.client.1.smithi161.stdout:5/330: truncate d3/d9/f41 5027273 0 2024-09-18T12:52:03.436 INFO:tasks.workunit.client.1.smithi161.stdout:5/331: truncate d3/f40 948121 0 2024-09-18T12:52:03.442 INFO:tasks.workunit.client.0.smithi045.stdout:2/193: fsync d5/d2c/d4d/f28 0 2024-09-18T12:52:03.443 INFO:tasks.workunit.client.1.smithi161.stdout:1/303: creat d1/da/d39/f61 x:0 0 0 2024-09-18T12:52:03.443 INFO:tasks.workunit.client.1.smithi161.stdout:4/398: getdents d5/d27/d3a/d47/d49/d7b 0 2024-09-18T12:52:03.443 INFO:tasks.workunit.client.1.smithi161.stdout:7/335: mkdir d3/d8/d15/d38/d55 0 2024-09-18T12:52:03.444 INFO:tasks.workunit.client.1.smithi161.stdout:4/399: read - d5/d14/d5f/f75 zero size 2024-09-18T12:52:03.445 INFO:tasks.workunit.client.1.smithi161.stdout:4/400: chown d5/d27/d44/l6a 7112 1 2024-09-18T12:52:03.447 INFO:tasks.workunit.client.1.smithi161.stdout:9/332: dwrite d0/db/d18/f36 [0,4194304] 0 2024-09-18T12:52:03.449 INFO:tasks.workunit.client.1.smithi161.stdout:8/426: mkdir d0/d3/d91 0 2024-09-18T12:52:03.450 INFO:tasks.workunit.client.1.smithi161.stdout:6/379: truncate d4/d39/d26/f2b 2892627 0 2024-09-18T12:52:03.452 INFO:tasks.workunit.client.1.smithi161.stdout:5/332: rmdir d3/d9/d4b 39 2024-09-18T12:52:03.453 INFO:tasks.workunit.client.1.smithi161.stdout:4/401: dwrite d5/d14/f29 [0,4194304] 0 2024-09-18T12:52:03.454 INFO:tasks.workunit.client.1.smithi161.stdout:5/333: fdatasync d3/d8/f59 0 2024-09-18T12:52:03.455 INFO:tasks.workunit.client.1.smithi161.stdout:4/402: chown d5/f1a 35595916 1 2024-09-18T12:52:03.458 INFO:tasks.workunit.client.1.smithi161.stdout:6/380: dwrite d4/ff [0,4194304] 0 2024-09-18T12:52:03.458 INFO:tasks.workunit.client.0.smithi045.stdout:2/194: dwrite d5/d2c/d4d/f32 [0,4194304] 0 2024-09-18T12:52:03.461 INFO:tasks.workunit.client.1.smithi161.stdout:2/388: creat d0/d5/d53/d7d/f89 x:0 0 0 2024-09-18T12:52:03.462 INFO:tasks.workunit.client.1.smithi161.stdout:2/389: readlink d0/d1/d3b/d7e/l82 0 2024-09-18T12:52:03.466 INFO:tasks.workunit.client.0.smithi045.stdout:2/195: dread d5/f12 [0,4194304] 0 2024-09-18T12:52:03.468 INFO:tasks.workunit.client.0.smithi045.stdout:2/196: dread d5/f34 [0,4194304] 0 2024-09-18T12:52:03.476 INFO:tasks.workunit.client.1.smithi161.stdout:7/336: rename d3/d8/d15/f46 to d3/d8/d4b/f56 0 2024-09-18T12:52:03.476 INFO:tasks.workunit.client.0.smithi045.stdout:2/197: rmdir d5/d2c/d4d/d16 39 2024-09-18T12:52:03.477 INFO:tasks.workunit.client.1.smithi161.stdout:0/373: write df/d29/d36/f43 [4187168,112400] 0 2024-09-18T12:52:03.477 INFO:tasks.workunit.client.0.smithi045.stdout:2/198: write d5/d2c/d4d/f4e [372163,66536] 0 2024-09-18T12:52:03.478 INFO:tasks.workunit.client.0.smithi045.stdout:2/199: dread - d5/f42 zero size 2024-09-18T12:52:03.479 INFO:tasks.workunit.client.1.smithi161.stdout:5/334: mkdir d3/d44/d6f 0 2024-09-18T12:52:03.481 INFO:tasks.workunit.client.1.smithi161.stdout:4/403: chown d5/d14/l2a 993253 1 2024-09-18T12:52:03.481 INFO:tasks.workunit.client.0.smithi045.stdout:2/200: creat d5/d2c/d4d/d33/f4f x:0 0 0 2024-09-18T12:52:03.484 INFO:tasks.workunit.client.1.smithi161.stdout:7/337: dwrite d3/d8/d15/d38/f2f [0,4194304] 0 2024-09-18T12:52:03.486 INFO:tasks.workunit.client.1.smithi161.stdout:9/333: mkdir d0/db/d6f 0 2024-09-18T12:52:03.489 INFO:tasks.workunit.client.1.smithi161.stdout:6/381: rename d4/d39/d26/d20/c5a to d4/d39/d26/d20/d45/d68/c79 0 2024-09-18T12:52:03.491 INFO:tasks.workunit.client.1.smithi161.stdout:3/403: getdents d1/d2e 0 2024-09-18T12:52:03.492 INFO:tasks.workunit.client.1.smithi161.stdout:3/404: chown d1/d2e/d14 21 1 2024-09-18T12:52:03.494 INFO:tasks.workunit.client.0.smithi045.stdout:2/201: getdents d5 0 2024-09-18T12:52:03.495 INFO:tasks.workunit.client.1.smithi161.stdout:1/304: creat d1/f62 x:0 0 0 2024-09-18T12:52:03.495 INFO:tasks.workunit.client.1.smithi161.stdout:0/374: dread df/f1c [0,4194304] 0 2024-09-18T12:52:03.497 INFO:tasks.workunit.client.0.smithi045.stdout:2/202: unlink d5/f12 0 2024-09-18T12:52:03.498 INFO:tasks.workunit.client.1.smithi161.stdout:4/404: mknod d5/d14/d5f/d69/c7f 0 2024-09-18T12:52:03.500 INFO:tasks.workunit.client.0.smithi045.stdout:9/76: sync 2024-09-18T12:52:03.501 INFO:tasks.workunit.client.1.smithi161.stdout:1/305: dwrite d1/d26/f2e [0,4194304] 0 2024-09-18T12:52:03.504 INFO:tasks.workunit.client.1.smithi161.stdout:8/427: creat d0/d3/f92 x:0 0 0 2024-09-18T12:52:03.504 INFO:tasks.workunit.client.1.smithi161.stdout:2/390: dwrite d0/d5/d43/d35/f7a [0,4194304] 0 2024-09-18T12:52:03.504 INFO:tasks.workunit.client.0.smithi045.stdout:9/77: dread d0/f2 [0,4194304] 0 2024-09-18T12:52:03.506 INFO:tasks.workunit.client.1.smithi161.stdout:2/391: fsync d0/d5/f74 0 2024-09-18T12:52:03.509 INFO:tasks.workunit.client.1.smithi161.stdout:2/392: dread - d0/d1/d3b/f61 zero size 2024-09-18T12:52:03.510 INFO:tasks.workunit.client.1.smithi161.stdout:0/375: rmdir df/d29/d2d/d37/d55 39 2024-09-18T12:52:03.511 INFO:tasks.workunit.client.1.smithi161.stdout:9/334: dwrite d0/db/f26 [4194304,4194304] 0 2024-09-18T12:52:03.512 INFO:tasks.workunit.client.1.smithi161.stdout:1/306: dwrite d1/d26/fe [0,4194304] 0 2024-09-18T12:52:03.514 INFO:tasks.workunit.client.0.smithi045.stdout:9/78: dwrite d0/f2 [4194304,4194304] 0 2024-09-18T12:52:03.514 INFO:tasks.workunit.client.1.smithi161.stdout:7/338: symlink d3/d8/d4f/l57 0 2024-09-18T12:52:03.516 INFO:tasks.workunit.client.1.smithi161.stdout:7/339: write d3/d8/d15/f3c [233526,83613] 0 2024-09-18T12:52:03.518 INFO:tasks.workunit.client.1.smithi161.stdout:6/382: mknod d4/c7a 0 2024-09-18T12:52:03.521 INFO:tasks.workunit.client.1.smithi161.stdout:6/383: write d4/d61/f66 [855146,103212] 0 2024-09-18T12:52:03.522 INFO:tasks.workunit.client.0.smithi045.stdout:9/79: symlink d0/d3/l1c 0 2024-09-18T12:52:03.523 INFO:tasks.workunit.client.0.smithi045.stdout:9/80: stat d0/d3 0 2024-09-18T12:52:03.525 INFO:tasks.workunit.client.1.smithi161.stdout:3/405: write d1/d2e/d24/d1d/f4f [3238462,25068] 0 2024-09-18T12:52:03.527 INFO:tasks.workunit.client.1.smithi161.stdout:5/335: truncate d3/d3b/f3d 381221 0 2024-09-18T12:52:03.529 INFO:tasks.workunit.client.1.smithi161.stdout:9/335: dwrite d0/d20/f6b [0,4194304] 0 2024-09-18T12:52:03.531 INFO:tasks.workunit.client.1.smithi161.stdout:2/393: mkdir d0/d1/df/d8a 0 2024-09-18T12:52:03.534 INFO:tasks.workunit.client.1.smithi161.stdout:0/376: symlink df/d29/l7f 0 2024-09-18T12:52:03.535 INFO:tasks.workunit.client.0.smithi045.stdout:2/203: symlink d5/d2c/d4d/d16/l50 0 2024-09-18T12:52:03.535 INFO:tasks.workunit.client.1.smithi161.stdout:4/405: dwrite d5/d27/f46 [0,4194304] 0 2024-09-18T12:52:03.535 INFO:tasks.workunit.client.1.smithi161.stdout:1/307: symlink d1/d26/d3a/l63 0 2024-09-18T12:52:03.537 INFO:tasks.workunit.client.0.smithi045.stdout:5/252: sync 2024-09-18T12:52:03.538 INFO:tasks.workunit.client.1.smithi161.stdout:6/384: dwrite d4/d1a/f1b [0,4194304] 0 2024-09-18T12:52:03.541 INFO:tasks.workunit.client.1.smithi161.stdout:2/394: dread d0/d5/d43/d35/f5f [0,4194304] 0 2024-09-18T12:52:03.544 INFO:tasks.workunit.client.0.smithi045.stdout:2/204: symlink d5/d2c/d4d/l51 0 2024-09-18T12:52:03.545 INFO:tasks.workunit.client.1.smithi161.stdout:3/406: chown d1/d2e/d3d/c5a 1569889 1 2024-09-18T12:52:03.549 INFO:tasks.workunit.client.0.smithi045.stdout:5/253: dwrite d6/d28/d2b/f4e [0,4194304] 0 2024-09-18T12:52:03.551 INFO:tasks.workunit.client.1.smithi161.stdout:9/336: symlink d0/db/d18/l70 0 2024-09-18T12:52:03.558 INFO:tasks.workunit.client.0.smithi045.stdout:5/254: dread d6/db/d19/f4f [0,4194304] 0 2024-09-18T12:52:03.559 INFO:tasks.workunit.client.0.smithi045.stdout:2/205: chown d5/d3a/d3e 1028250021 1 2024-09-18T12:52:03.565 INFO:tasks.workunit.client.1.smithi161.stdout:7/340: write d3/f23 [5954849,107999] 0 2024-09-18T12:52:03.565 INFO:tasks.workunit.client.1.smithi161.stdout:5/336: dread d3/d14/d20/d21/d46/f65 [0,4194304] 0 2024-09-18T12:52:03.566 INFO:tasks.workunit.client.0.smithi045.stdout:9/81: dwrite d0/d3/d6/fd [0,4194304] 0 2024-09-18T12:52:03.566 INFO:tasks.workunit.client.0.smithi045.stdout:2/206: read - d5/f42 zero size 2024-09-18T12:52:03.568 INFO:tasks.workunit.client.0.smithi045.stdout:2/207: chown d5/d2c/d4d/f4e 180269 1 2024-09-18T12:52:03.568 INFO:tasks.workunit.client.1.smithi161.stdout:6/385: rmdir d4/d61 39 2024-09-18T12:52:03.569 INFO:tasks.workunit.client.1.smithi161.stdout:8/428: link d0/d3/d10/l2d d0/d3/d91/l93 0 2024-09-18T12:52:03.571 INFO:tasks.workunit.client.1.smithi161.stdout:2/395: mkdir d0/d4/d52/d8b 0 2024-09-18T12:52:03.572 INFO:tasks.workunit.client.1.smithi161.stdout:2/396: chown d0/d4/f2a 938 1 2024-09-18T12:52:03.573 INFO:tasks.workunit.client.1.smithi161.stdout:3/407: fsync d1/f8b 0 2024-09-18T12:52:03.573 INFO:tasks.workunit.client.1.smithi161.stdout:2/397: chown d0/d1/d3b/f83 1 1 2024-09-18T12:52:03.573 INFO:tasks.workunit.client.1.smithi161.stdout:3/408: read - d1/f54 zero size 2024-09-18T12:52:03.575 INFO:tasks.workunit.client.0.smithi045.stdout:9/82: dwrite d0/d3/d6/d10/f1b [0,4194304] 0 2024-09-18T12:52:03.577 INFO:tasks.workunit.client.0.smithi045.stdout:9/83: chown d0/d3/l1c 6233711 1 2024-09-18T12:52:03.581 INFO:tasks.workunit.client.1.smithi161.stdout:1/308: unlink d1/d26/l3d 0 2024-09-18T12:52:03.581 INFO:tasks.workunit.client.1.smithi161.stdout:1/309: fdatasync d1/f62 0 2024-09-18T12:52:03.583 INFO:tasks.workunit.client.0.smithi045.stdout:2/208: dwrite d5/d2c/d4d/ff [0,4194304] 0 2024-09-18T12:52:03.584 INFO:tasks.workunit.client.1.smithi161.stdout:6/386: stat d4/d61 0 2024-09-18T12:52:03.586 INFO:tasks.workunit.client.0.smithi045.stdout:9/84: dread d0/f2 [0,4194304] 0 2024-09-18T12:52:03.586 INFO:tasks.workunit.client.1.smithi161.stdout:8/429: mkdir d0/d3/d10/d21/d4a/d52/d94 0 2024-09-18T12:52:03.586 INFO:tasks.workunit.client.1.smithi161.stdout:6/387: stat d4/d39/d26/d20/d45/l75 0 2024-09-18T12:52:03.590 INFO:tasks.workunit.client.0.smithi045.stdout:9/85: dread d0/d3/f11 [0,4194304] 0 2024-09-18T12:52:03.590 INFO:tasks.workunit.client.1.smithi161.stdout:0/377: creat df/d30/f80 x:0 0 0 2024-09-18T12:52:03.590 INFO:tasks.workunit.client.1.smithi161.stdout:0/378: fsync df/d29/d2d/d69/f77 0 2024-09-18T12:52:03.591 INFO:tasks.workunit.client.0.smithi045.stdout:8/144: sync 2024-09-18T12:52:03.592 INFO:tasks.workunit.client.0.smithi045.stdout:0/109: sync 2024-09-18T12:52:03.592 INFO:tasks.workunit.client.0.smithi045.stdout:7/116: sync 2024-09-18T12:52:03.592 INFO:tasks.workunit.client.0.smithi045.stdout:6/178: sync 2024-09-18T12:52:03.592 INFO:tasks.workunit.client.0.smithi045.stdout:4/144: sync 2024-09-18T12:52:03.592 INFO:tasks.workunit.client.0.smithi045.stdout:1/140: sync 2024-09-18T12:52:03.592 INFO:tasks.workunit.client.0.smithi045.stdout:3/136: sync 2024-09-18T12:52:03.593 INFO:tasks.workunit.client.1.smithi161.stdout:1/310: unlink d1/da/d39/c1c 0 2024-09-18T12:52:03.594 INFO:tasks.workunit.client.1.smithi161.stdout:1/311: write d1/da/d1f/f4b [943009,98343] 0 2024-09-18T12:52:03.594 INFO:tasks.workunit.client.1.smithi161.stdout:5/337: unlink d3/d14/l50 0 2024-09-18T12:52:03.595 INFO:tasks.workunit.client.1.smithi161.stdout:0/379: read df/f23 [6567505,23825] 0 2024-09-18T12:52:03.596 INFO:tasks.workunit.client.1.smithi161.stdout:5/338: dread - d3/d14/f63 zero size 2024-09-18T12:52:03.597 INFO:tasks.workunit.client.0.smithi045.stdout:9/86: creat d0/d3/d6/f1d x:0 0 0 2024-09-18T12:52:03.597 INFO:tasks.workunit.client.1.smithi161.stdout:9/337: dread d0/db/d18/f21 [0,4194304] 0 2024-09-18T12:52:03.597 INFO:tasks.workunit.client.1.smithi161.stdout:7/341: creat d3/d8/d15/d38/d55/f58 x:0 0 0 2024-09-18T12:52:03.599 INFO:tasks.workunit.client.1.smithi161.stdout:4/406: rename d5/fe to d5/d27/d3a/f80 0 2024-09-18T12:52:03.602 INFO:tasks.workunit.client.1.smithi161.stdout:2/398: creat d0/d4/d52/d8b/f8c x:0 0 0 2024-09-18T12:52:03.602 INFO:tasks.workunit.client.0.smithi045.stdout:5/255: dread d6/db/fe [0,4194304] 0 2024-09-18T12:52:03.603 INFO:tasks.workunit.client.0.smithi045.stdout:4/145: symlink db/d2c/l34 0 2024-09-18T12:52:03.606 INFO:tasks.workunit.client.1.smithi161.stdout:3/409: creat d1/d2e/d14/d65/d76/d8c/f8d x:0 0 0 2024-09-18T12:52:03.607 INFO:tasks.workunit.client.0.smithi045.stdout:8/145: dread fa [0,4194304] 0 2024-09-18T12:52:03.607 INFO:tasks.workunit.client.0.smithi045.stdout:7/117: creat d13/d1a/f27 x:0 0 0 2024-09-18T12:52:03.607 INFO:tasks.workunit.client.0.smithi045.stdout:4/146: stat db/de/d1a 0 2024-09-18T12:52:03.607 INFO:tasks.workunit.client.0.smithi045.stdout:3/137: dwrite d0/d7/f23 [0,4194304] 0 2024-09-18T12:52:03.607 INFO:tasks.workunit.client.0.smithi045.stdout:6/179: truncate d9/f28 2502714 0 2024-09-18T12:52:03.608 INFO:tasks.workunit.client.1.smithi161.stdout:6/388: dwrite d4/d39/d26/f40 [0,4194304] 0 2024-09-18T12:52:03.608 INFO:tasks.workunit.client.1.smithi161.stdout:3/410: write d1/d2e/d24/d1d/f43 [3101673,27554] 0 2024-09-18T12:52:03.610 INFO:tasks.workunit.client.1.smithi161.stdout:3/411: write d1/d2e/d24/d1d/f2a [9015513,54480] 0 2024-09-18T12:52:03.610 INFO:tasks.workunit.client.1.smithi161.stdout:6/389: read d4/d1a/f11 [3120813,116468] 0 2024-09-18T12:52:03.612 INFO:tasks.workunit.client.0.smithi045.stdout:4/147: write db/f21 [8928940,5815] 0 2024-09-18T12:52:03.614 INFO:tasks.workunit.client.1.smithi161.stdout:6/390: write d4/d39/d26/d20/d28/f4b [34851,49590] 0 2024-09-18T12:52:03.614 INFO:tasks.workunit.client.0.smithi045.stdout:1/141: dread d0/fe [0,4194304] 0 2024-09-18T12:52:03.615 INFO:tasks.workunit.client.0.smithi045.stdout:4/148: readlink db/d2c/l31 0 2024-09-18T12:52:03.616 INFO:tasks.workunit.client.0.smithi045.stdout:6/180: dread d9/f2b [0,4194304] 0 2024-09-18T12:52:03.620 INFO:tasks.workunit.client.0.smithi045.stdout:0/110: dwrite d6/d7/f14 [4194304,4194304] 0 2024-09-18T12:52:03.621 INFO:tasks.workunit.client.0.smithi045.stdout:0/111: chown d6/d7/d1c 41 1 2024-09-18T12:52:03.622 INFO:tasks.workunit.client.1.smithi161.stdout:5/339: unlink d3/f2a 0 2024-09-18T12:52:03.622 INFO:tasks.workunit.client.0.smithi045.stdout:0/112: fsync f4 0 2024-09-18T12:52:03.624 INFO:tasks.workunit.client.0.smithi045.stdout:0/113: chown d6/d7/fa 3 1 2024-09-18T12:52:03.625 INFO:tasks.workunit.client.0.smithi045.stdout:3/138: dwrite d0/d1e/f2a [0,4194304] 0 2024-09-18T12:52:03.626 INFO:tasks.workunit.client.0.smithi045.stdout:0/114: chown d6/d7/c10 1182035 1 2024-09-18T12:52:03.627 INFO:tasks.workunit.client.0.smithi045.stdout:1/142: truncate d0/d12/d20/f28 673491 0 2024-09-18T12:52:03.629 INFO:tasks.workunit.client.0.smithi045.stdout:3/139: write d0/f16 [933240,45103] 0 2024-09-18T12:52:03.630 INFO:tasks.workunit.client.0.smithi045.stdout:1/143: dread - d0/d12/f13 zero size 2024-09-18T12:52:03.635 INFO:tasks.workunit.client.1.smithi161.stdout:4/407: creat d5/d27/f81 x:0 0 0 2024-09-18T12:52:03.636 INFO:tasks.workunit.client.0.smithi045.stdout:5/256: dread d6/d3e/f26 [0,4194304] 0 2024-09-18T12:52:03.637 INFO:tasks.workunit.client.1.smithi161.stdout:4/408: write d5/d14/d5f/f75 [238070,93626] 0 2024-09-18T12:52:03.637 INFO:tasks.workunit.client.0.smithi045.stdout:2/209: link d5/d3a/f45 d5/d46/f52 0 2024-09-18T12:52:03.640 INFO:tasks.workunit.client.0.smithi045.stdout:8/146: unlink d11/d14/f1c 0 2024-09-18T12:52:03.641 INFO:tasks.workunit.client.0.smithi045.stdout:8/147: fsync d11/f17 0 2024-09-18T12:52:03.642 INFO:tasks.workunit.client.0.smithi045.stdout:2/210: dread d5/d2c/d4d/f28 [0,4194304] 0 2024-09-18T12:52:03.642 INFO:tasks.workunit.client.0.smithi045.stdout:8/148: write d11/d23/f2a [372479,119526] 0 2024-09-18T12:52:03.643 INFO:tasks.workunit.client.0.smithi045.stdout:7/118: write fc [588415,53694] 0 2024-09-18T12:52:03.644 INFO:tasks.workunit.client.0.smithi045.stdout:2/211: fdatasync d5/d2c/d4d/f4e 0 2024-09-18T12:52:03.645 INFO:tasks.workunit.client.0.smithi045.stdout:4/149: mkdir db/d2c/d35 0 2024-09-18T12:52:03.648 INFO:tasks.workunit.client.0.smithi045.stdout:6/181: mknod d9/c3a 0 2024-09-18T12:52:03.649 INFO:tasks.workunit.client.0.smithi045.stdout:6/182: readlink d9/d1a/d1d/l1e 0 2024-09-18T12:52:03.649 INFO:tasks.workunit.client.0.smithi045.stdout:8/149: dread fd [0,4194304] 0 2024-09-18T12:52:03.649 INFO:tasks.workunit.client.1.smithi161.stdout:6/391: symlink d4/d39/d26/l7b 0 2024-09-18T12:52:03.651 INFO:tasks.workunit.client.0.smithi045.stdout:9/87: rename d0/d3/l4 to d0/d3/d6/d10/l1e 0 2024-09-18T12:52:03.651 INFO:tasks.workunit.client.1.smithi161.stdout:6/392: truncate d4/d1a/d1c/d3e/d4d/f78 996506 0 2024-09-18T12:52:03.651 INFO:tasks.workunit.client.0.smithi045.stdout:9/88: fdatasync d0/d3/d6/f1d 0 2024-09-18T12:52:03.653 INFO:tasks.workunit.client.0.smithi045.stdout:9/89: truncate d0/d3/fe 568444 0 2024-09-18T12:52:03.655 INFO:tasks.workunit.client.0.smithi045.stdout:3/140: creat d0/d22/f2e x:0 0 0 2024-09-18T12:52:03.656 INFO:tasks.workunit.client.0.smithi045.stdout:1/144: symlink d0/d12/d20/l2a 0 2024-09-18T12:52:03.657 INFO:tasks.workunit.client.0.smithi045.stdout:1/145: chown d0/d12/f27 2605994 1 2024-09-18T12:52:03.657 INFO:tasks.workunit.client.0.smithi045.stdout:1/146: chown d0/f2 104099 1 2024-09-18T12:52:03.658 INFO:tasks.workunit.client.0.smithi045.stdout:1/147: truncate d0/f7 5217358 0 2024-09-18T12:52:03.661 INFO:tasks.workunit.client.0.smithi045.stdout:1/148: chown d0/d12/f13 38975146 1 2024-09-18T12:52:03.661 INFO:tasks.workunit.client.0.smithi045.stdout:1/149: write d0/f23 [409600,60565] 0 2024-09-18T12:52:03.662 INFO:tasks.workunit.client.1.smithi161.stdout:0/380: truncate df/f24 108279 0 2024-09-18T12:52:03.662 INFO:tasks.workunit.client.1.smithi161.stdout:5/340: dwrite d3/d9/d4b/f51 [0,4194304] 0 2024-09-18T12:52:03.662 INFO:tasks.workunit.client.1.smithi161.stdout:5/341: chown d3/d9/f2d 708547 1 2024-09-18T12:52:03.663 INFO:tasks.workunit.client.0.smithi045.stdout:5/257: mkdir d6/db/d19/d31/d53 0 2024-09-18T12:52:03.664 INFO:tasks.workunit.client.0.smithi045.stdout:5/258: stat d6/d2a/l4d 0 2024-09-18T12:52:03.666 INFO:tasks.workunit.client.1.smithi161.stdout:0/381: dwrite df/d61/f72 [4194304,4194304] 0 2024-09-18T12:52:03.669 INFO:tasks.workunit.client.1.smithi161.stdout:9/338: truncate d0/d20/f6c 1027452 0 2024-09-18T12:52:03.670 INFO:tasks.workunit.client.1.smithi161.stdout:7/342: mkdir d3/d8/d15/d1a/d4a/d59 0 2024-09-18T12:52:03.673 INFO:tasks.workunit.client.1.smithi161.stdout:2/399: symlink d0/d1/df/d8a/l8d 0 2024-09-18T12:52:03.675 INFO:tasks.workunit.client.1.smithi161.stdout:5/342: fdatasync d3/d9/f1c 0 2024-09-18T12:52:03.676 INFO:tasks.workunit.client.1.smithi161.stdout:5/343: chown d3/l3f 10016817 1 2024-09-18T12:52:03.679 INFO:tasks.workunit.client.0.smithi045.stdout:7/119: mkdir d13/d1a/d28 0 2024-09-18T12:52:03.682 INFO:tasks.workunit.client.1.smithi161.stdout:3/412: creat d1/d2e/d14/d65/d76/d88/f8e x:0 0 0 2024-09-18T12:52:03.684 INFO:tasks.workunit.client.0.smithi045.stdout:0/115: symlink d6/l1e 0 2024-09-18T12:52:03.685 INFO:tasks.workunit.client.0.smithi045.stdout:7/120: dread fc [0,4194304] 0 2024-09-18T12:52:03.685 INFO:tasks.workunit.client.1.smithi161.stdout:6/393: mkdir d4/d1a/d1c/d7c 0 2024-09-18T12:52:03.686 INFO:tasks.workunit.client.0.smithi045.stdout:0/116: truncate d6/d7/f15 624350 0 2024-09-18T12:52:03.686 INFO:tasks.workunit.client.0.smithi045.stdout:3/141: mknod d0/d22/c2f 0 2024-09-18T12:52:03.687 INFO:tasks.workunit.client.0.smithi045.stdout:0/117: write d6/d7/f15 [1368671,95331] 0 2024-09-18T12:52:03.689 INFO:tasks.workunit.client.0.smithi045.stdout:1/150: mkdir d0/d12/d17/d2b 0 2024-09-18T12:52:03.691 INFO:tasks.workunit.client.0.smithi045.stdout:0/118: dread f4 [0,4194304] 0 2024-09-18T12:52:03.695 INFO:tasks.workunit.client.0.smithi045.stdout:2/212: rename d5/f1f to d5/d46/f53 0 2024-09-18T12:52:03.697 INFO:tasks.workunit.client.1.smithi161.stdout:7/343: rename d3/l4e to d3/d8/d15/d1a/d44/l5a 0 2024-09-18T12:52:03.697 INFO:tasks.workunit.client.1.smithi161.stdout:7/344: chown d3/c30 3903 1 2024-09-18T12:52:03.698 INFO:tasks.workunit.client.0.smithi045.stdout:7/121: mkdir d13/d19/d29 0 2024-09-18T12:52:03.698 INFO:tasks.workunit.client.1.smithi161.stdout:2/400: symlink d0/d1/d3b/d3d/l8e 0 2024-09-18T12:52:03.699 INFO:tasks.workunit.client.1.smithi161.stdout:2/401: chown d0/d1/d3b/d3d/d4f/c51 494 1 2024-09-18T12:52:03.700 INFO:tasks.workunit.client.1.smithi161.stdout:5/344: unlink d3/d14/f63 0 2024-09-18T12:52:03.701 INFO:tasks.workunit.client.1.smithi161.stdout:5/345: readlink d3/l3f 0 2024-09-18T12:52:03.701 INFO:tasks.workunit.client.0.smithi045.stdout:3/142: symlink d0/d22/l30 0 2024-09-18T12:52:03.702 INFO:tasks.workunit.client.1.smithi161.stdout:4/409: dread - d5/d27/d3a/d4c/f64 zero size 2024-09-18T12:52:03.702 INFO:tasks.workunit.client.0.smithi045.stdout:5/259: write d6/db/d19/f4f [1298559,52603] 0 2024-09-18T12:52:03.704 INFO:tasks.workunit.client.1.smithi161.stdout:4/410: truncate d5/d27/f72 471115 0 2024-09-18T12:52:03.705 INFO:tasks.workunit.client.1.smithi161.stdout:3/413: creat d1/d2e/d14/d65/f8f x:0 0 0 2024-09-18T12:52:03.705 INFO:tasks.workunit.client.1.smithi161.stdout:2/402: dwrite d0/f41 [0,4194304] 0 2024-09-18T12:52:03.707 INFO:tasks.workunit.client.1.smithi161.stdout:5/346: dread d3/d9/d4b/f51 [0,4194304] 0 2024-09-18T12:52:03.707 INFO:tasks.workunit.client.1.smithi161.stdout:8/430: creat d0/d3/d10/d21/d4a/d52/f95 x:0 0 0 2024-09-18T12:52:03.708 INFO:tasks.workunit.client.0.smithi045.stdout:0/119: creat d6/d7/f1f x:0 0 0 2024-09-18T12:52:03.708 INFO:tasks.workunit.client.0.smithi045.stdout:0/120: readlink d6/d7/l16 0 2024-09-18T12:52:03.709 INFO:tasks.workunit.client.0.smithi045.stdout:0/121: dread - d6/f1d zero size 2024-09-18T12:52:03.710 INFO:tasks.workunit.client.1.smithi161.stdout:1/312: link d1/da/l29 d1/d26/l64 0 2024-09-18T12:52:03.712 INFO:tasks.workunit.client.1.smithi161.stdout:0/382: creat df/d29/d36/d7a/f81 x:0 0 0 2024-09-18T12:52:03.713 INFO:tasks.workunit.client.1.smithi161.stdout:2/403: dread d0/d1/d3b/d3d/f64 [0,4194304] 0 2024-09-18T12:52:03.713 INFO:tasks.workunit.client.1.smithi161.stdout:0/383: truncate df/f50 5204324 0 2024-09-18T12:52:03.714 INFO:tasks.workunit.client.0.smithi045.stdout:9/90: rename d0/d3/d6/f1d to d0/d3/f1f 0 2024-09-18T12:52:03.715 INFO:tasks.workunit.client.0.smithi045.stdout:7/122: mknod d13/d1c/c2a 0 2024-09-18T12:52:03.716 INFO:tasks.workunit.client.0.smithi045.stdout:7/123: fdatasync d13/d1a/f25 0 2024-09-18T12:52:03.718 INFO:tasks.workunit.client.0.smithi045.stdout:7/124: write d13/d1a/f27 [62934,46339] 0 2024-09-18T12:52:03.721 INFO:tasks.workunit.client.0.smithi045.stdout:5/260: unlink d6/db/c1e 0 2024-09-18T12:52:03.724 INFO:tasks.workunit.client.1.smithi161.stdout:4/411: truncate d5/f1a 985242 0 2024-09-18T12:52:03.724 INFO:tasks.workunit.client.1.smithi161.stdout:4/412: chown d5/d27/c79 11590 1 2024-09-18T12:52:03.724 INFO:tasks.workunit.client.0.smithi045.stdout:8/150: getdents d11/d20 0 2024-09-18T12:52:03.725 INFO:tasks.workunit.client.0.smithi045.stdout:8/151: chown fd 15269 1 2024-09-18T12:52:03.726 INFO:tasks.workunit.client.0.smithi045.stdout:7/125: dwrite d13/d1c/f1f [0,4194304] 0 2024-09-18T12:52:03.728 INFO:tasks.workunit.client.0.smithi045.stdout:0/122: mknod d6/d7/c20 0 2024-09-18T12:52:03.729 INFO:tasks.workunit.client.1.smithi161.stdout:5/347: chown d3/d14/d20 32860 1 2024-09-18T12:52:03.737 INFO:tasks.workunit.client.1.smithi161.stdout:6/394: dwrite d4/d1a/d1c/d3e/d4d/f72 [0,4194304] 0 2024-09-18T12:52:03.738 INFO:tasks.workunit.client.0.smithi045.stdout:2/213: fsync d5/d2c/d4d/d16/f36 0 2024-09-18T12:52:03.740 INFO:tasks.workunit.client.0.smithi045.stdout:5/261: mkdir d6/db/d54 0 2024-09-18T12:52:03.747 INFO:tasks.workunit.client.0.smithi045.stdout:9/91: dread d0/d3/f7 [0,4194304] 0 2024-09-18T12:52:03.748 INFO:tasks.workunit.client.0.smithi045.stdout:3/143: truncate d0/d22/f28 783126 0 2024-09-18T12:52:03.749 INFO:tasks.workunit.client.0.smithi045.stdout:8/152: mkdir d11/d14/d2c 0 2024-09-18T12:52:03.751 INFO:tasks.workunit.client.0.smithi045.stdout:7/126: creat d13/d1c/f2b x:0 0 0 2024-09-18T12:52:03.752 INFO:tasks.workunit.client.0.smithi045.stdout:7/127: dread - d13/d19/f26 zero size 2024-09-18T12:52:03.752 INFO:tasks.workunit.client.0.smithi045.stdout:7/128: chown d13/f23 14115 1 2024-09-18T12:52:03.753 INFO:tasks.workunit.client.0.smithi045.stdout:0/123: mkdir d6/d7/d21 0 2024-09-18T12:52:03.757 INFO:tasks.workunit.client.0.smithi045.stdout:7/129: dread d13/d1c/f1f [0,4194304] 0 2024-09-18T12:52:03.757 INFO:tasks.workunit.client.1.smithi161.stdout:9/339: getdents d0/d20 0 2024-09-18T12:52:03.757 INFO:tasks.workunit.client.0.smithi045.stdout:1/151: link d0/f6 d0/d12/d20/f2c 0 2024-09-18T12:52:03.758 INFO:tasks.workunit.client.0.smithi045.stdout:0/124: dread d6/d7/f14 [0,4194304] 0 2024-09-18T12:52:03.758 INFO:tasks.workunit.client.0.smithi045.stdout:1/152: fsync d0/f1f 0 2024-09-18T12:52:03.758 INFO:tasks.workunit.client.1.smithi161.stdout:2/404: symlink d0/d5/d43/d35/d80/l8f 0 2024-09-18T12:52:03.759 INFO:tasks.workunit.client.1.smithi161.stdout:1/313: dwrite d1/d1d/f57 [0,4194304] 0 2024-09-18T12:52:03.760 INFO:tasks.workunit.client.0.smithi045.stdout:9/92: mknod d0/d3/c20 0 2024-09-18T12:52:03.763 INFO:tasks.workunit.client.0.smithi045.stdout:3/144: symlink d0/l31 0 2024-09-18T12:52:03.763 INFO:tasks.workunit.client.1.smithi161.stdout:6/395: read d4/d1a/f14 [540221,76979] 0 2024-09-18T12:52:03.765 INFO:tasks.workunit.client.1.smithi161.stdout:0/384: rename df/l1e to df/d29/d36/l82 0 2024-09-18T12:52:03.767 INFO:tasks.workunit.client.0.smithi045.stdout:8/153: mknod d11/c2d 0 2024-09-18T12:52:03.767 INFO:tasks.workunit.client.0.smithi045.stdout:7/130: dwrite d13/d1c/f2b [0,4194304] 0 2024-09-18T12:52:03.769 INFO:tasks.workunit.client.1.smithi161.stdout:6/396: dwrite d4/d39/d3a/f62 [0,4194304] 0 2024-09-18T12:52:03.773 INFO:tasks.workunit.client.1.smithi161.stdout:4/413: mknod d5/d27/d3a/d4c/c82 0 2024-09-18T12:52:03.774 INFO:tasks.workunit.client.0.smithi045.stdout:8/154: dread fd [0,4194304] 0 2024-09-18T12:52:03.774 INFO:tasks.workunit.client.0.smithi045.stdout:8/155: stat l1 0 2024-09-18T12:52:03.780 INFO:tasks.workunit.client.1.smithi161.stdout:9/340: creat d0/d20/f71 x:0 0 0 2024-09-18T12:52:03.786 INFO:tasks.workunit.client.1.smithi161.stdout:8/431: rename d0/d3/d5f to d0/d3/d10/d21/d4a/d52/d82/d96 0 2024-09-18T12:52:03.788 INFO:tasks.workunit.client.0.smithi045.stdout:9/93: symlink d0/d3/d6/l21 0 2024-09-18T12:52:03.789 INFO:tasks.workunit.client.1.smithi161.stdout:0/385: symlink df/d29/d2d/l83 0 2024-09-18T12:52:03.789 INFO:tasks.workunit.client.1.smithi161.stdout:0/386: dread - df/d29/d2d/f6e zero size 2024-09-18T12:52:03.790 INFO:tasks.workunit.client.1.smithi161.stdout:0/387: stat df/d29/d2d/d69/f77 0 2024-09-18T12:52:03.792 INFO:tasks.workunit.client.1.smithi161.stdout:7/345: link d3/c1b d3/d50/c5b 0 2024-09-18T12:52:03.793 INFO:tasks.workunit.client.0.smithi045.stdout:5/262: truncate d6/d28/d2b/f2d 4181163 0 2024-09-18T12:52:03.796 INFO:tasks.workunit.client.1.smithi161.stdout:3/414: getdents d1/d2e/d24 0 2024-09-18T12:52:03.797 INFO:tasks.workunit.client.0.smithi045.stdout:5/263: dread d6/db/f12 [0,4194304] 0 2024-09-18T12:52:03.800 INFO:tasks.workunit.client.0.smithi045.stdout:2/214: creat d5/d2c/d4d/f54 x:0 0 0 2024-09-18T12:52:03.800 INFO:tasks.workunit.client.1.smithi161.stdout:6/397: dwrite d4/d1a/d1c/f4a [0,4194304] 0 2024-09-18T12:52:03.801 INFO:tasks.workunit.client.1.smithi161.stdout:5/348: link d3/d9/f12 d3/d14/d20/d21/d24/f70 0 2024-09-18T12:52:03.803 INFO:tasks.workunit.client.1.smithi161.stdout:9/341: creat d0/d16/d25/d46/d53/f72 x:0 0 0 2024-09-18T12:52:03.804 INFO:tasks.workunit.client.1.smithi161.stdout:1/314: rmdir d1/d48 39 2024-09-18T12:52:03.807 INFO:tasks.workunit.client.0.smithi045.stdout:9/94: creat d0/d3/d6/f22 x:0 0 0 2024-09-18T12:52:03.808 INFO:tasks.workunit.client.1.smithi161.stdout:8/432: symlink d0/d3/d1e/d34/l97 0 2024-09-18T12:52:03.809 INFO:tasks.workunit.client.0.smithi045.stdout:3/145: mknod d0/d29/c32 0 2024-09-18T12:52:03.809 INFO:tasks.workunit.client.1.smithi161.stdout:0/388: rmdir df/d29/d36 39 2024-09-18T12:52:03.809 INFO:tasks.workunit.client.1.smithi161.stdout:0/389: readlink df/d29/l40 0 2024-09-18T12:52:03.811 INFO:tasks.workunit.client.1.smithi161.stdout:7/346: unlink d3/f17 0 2024-09-18T12:52:03.813 INFO:tasks.workunit.client.1.smithi161.stdout:0/390: dread df/d30/f3f [0,4194304] 0 2024-09-18T12:52:03.813 INFO:tasks.workunit.client.1.smithi161.stdout:3/415: mkdir d1/d2e/d14/d90 0 2024-09-18T12:52:03.816 INFO:tasks.workunit.client.1.smithi161.stdout:4/414: fdatasync d5/d27/f37 0 2024-09-18T12:52:03.816 INFO:tasks.workunit.client.0.smithi045.stdout:0/125: link d6/ld d6/d7/l22 0 2024-09-18T12:52:03.817 INFO:tasks.workunit.client.0.smithi045.stdout:0/126: chown d6/d7/c13 171563 1 2024-09-18T12:52:03.817 INFO:tasks.workunit.client.1.smithi161.stdout:6/398: dread d4/d39/d47/d51/f70 [0,4194304] 0 2024-09-18T12:52:03.818 INFO:tasks.workunit.client.1.smithi161.stdout:6/399: chown d4/d39/d46/c4f 1651621 1 2024-09-18T12:52:03.818 INFO:tasks.workunit.client.0.smithi045.stdout:1/153: rename d0/d12/d17 to d0/d2d 0 2024-09-18T12:52:03.819 INFO:tasks.workunit.client.0.smithi045.stdout:1/154: fdatasync d0/fc 0 2024-09-18T12:52:03.821 INFO:tasks.workunit.client.1.smithi161.stdout:5/349: mknod d3/d9/d4b/c71 0 2024-09-18T12:52:03.822 INFO:tasks.workunit.client.0.smithi045.stdout:9/95: mkdir d0/d23 0 2024-09-18T12:52:03.825 INFO:tasks.workunit.client.0.smithi045.stdout:3/146: write d0/fe [3567132,60990] 0 2024-09-18T12:52:03.826 INFO:tasks.workunit.client.0.smithi045.stdout:3/147: read d0/d7/f23 [3264285,123941] 0 2024-09-18T12:52:03.828 INFO:tasks.workunit.client.0.smithi045.stdout:3/148: chown d0/d22 0 1 2024-09-18T12:52:03.830 INFO:tasks.workunit.client.1.smithi161.stdout:2/405: rename d0/d4/c50 to d0/d4/d52/d8b/c90 0 2024-09-18T12:52:03.831 INFO:tasks.workunit.client.1.smithi161.stdout:2/406: readlink d0/d5/d43/d23/l2d 0 2024-09-18T12:52:03.831 INFO:tasks.workunit.client.1.smithi161.stdout:6/400: dread d4/d1a/f14 [0,4194304] 0 2024-09-18T12:52:03.832 INFO:tasks.workunit.client.0.smithi045.stdout:3/149: dwrite d0/f1f [4194304,4194304] 0 2024-09-18T12:52:03.832 INFO:tasks.workunit.client.1.smithi161.stdout:6/401: truncate d4/f10 4763645 0 2024-09-18T12:52:03.833 INFO:tasks.workunit.client.0.smithi045.stdout:3/150: fsync d0/f16 0 2024-09-18T12:52:03.834 INFO:tasks.workunit.client.0.smithi045.stdout:5/264: mknod d6/d28/d4c/c55 0 2024-09-18T12:52:03.835 INFO:tasks.workunit.client.0.smithi045.stdout:5/265: chown d6/db/l39 119 1 2024-09-18T12:52:03.836 INFO:tasks.workunit.client.0.smithi045.stdout:5/266: fsync d6/db/d19/d31/f45 0 2024-09-18T12:52:03.841 INFO:tasks.workunit.client.1.smithi161.stdout:3/416: creat d1/d2e/d14/d65/f91 x:0 0 0 2024-09-18T12:52:03.841 INFO:tasks.workunit.client.0.smithi045.stdout:1/155: readlink d0/l10 0 2024-09-18T12:52:03.841 INFO:tasks.workunit.client.0.smithi045.stdout:1/156: fdatasync d0/f7 0 2024-09-18T12:52:03.843 INFO:tasks.workunit.client.0.smithi045.stdout:9/96: rename d0/d3/f11 to d0/d23/f24 0 2024-09-18T12:52:03.846 INFO:tasks.workunit.client.1.smithi161.stdout:5/350: mknod d3/d14/d4c/c72 0 2024-09-18T12:52:03.848 INFO:tasks.workunit.client.1.smithi161.stdout:9/342: chown d0/d20/c6d 1006799864 1 2024-09-18T12:52:03.849 INFO:tasks.workunit.client.0.smithi045.stdout:7/131: getdents d13 0 2024-09-18T12:52:03.849 INFO:tasks.workunit.client.1.smithi161.stdout:1/315: mknod d1/d26/d3a/c65 0 2024-09-18T12:52:03.850 INFO:tasks.workunit.client.1.smithi161.stdout:9/343: write d0/d16/d25/d28/d45/f37 [49223,87696] 0 2024-09-18T12:52:03.852 INFO:tasks.workunit.client.1.smithi161.stdout:4/415: rename d5/d14/l5b to d5/d14/d6d/l83 0 2024-09-18T12:52:03.852 INFO:tasks.workunit.client.1.smithi161.stdout:8/433: dwrite d0/d3/d10/f6c [0,4194304] 0 2024-09-18T12:52:03.853 INFO:tasks.workunit.client.0.smithi045.stdout:3/151: mkdir d0/d33 0 2024-09-18T12:52:03.853 INFO:tasks.workunit.client.1.smithi161.stdout:4/416: chown d5/d27/d3a/d4c/f64 77778 1 2024-09-18T12:52:03.854 INFO:tasks.workunit.client.1.smithi161.stdout:2/407: mknod d0/d71/c91 0 2024-09-18T12:52:03.855 INFO:tasks.workunit.client.1.smithi161.stdout:6/402: fsync d4/d39/d3a/f3f 0 2024-09-18T12:52:03.858 INFO:tasks.workunit.client.1.smithi161.stdout:7/347: symlink d3/d8/l5c 0 2024-09-18T12:52:03.860 INFO:tasks.workunit.client.1.smithi161.stdout:0/391: mkdir df/d84 0 2024-09-18T12:52:03.861 INFO:tasks.workunit.client.1.smithi161.stdout:8/434: dwrite d0/d3/d10/f18 [0,4194304] 0 2024-09-18T12:52:03.862 INFO:tasks.workunit.client.1.smithi161.stdout:7/348: truncate d3/d8/d15/d1a/f41 509865 0 2024-09-18T12:52:03.862 INFO:tasks.workunit.client.1.smithi161.stdout:3/417: mkdir d1/d2e/d68/d92 0 2024-09-18T12:52:03.863 INFO:tasks.workunit.client.1.smithi161.stdout:7/349: chown d3/d8/d15/d1a/f41 1 1 2024-09-18T12:52:03.863 INFO:tasks.workunit.client.1.smithi161.stdout:8/435: chown d0/d3/d10/d21/d4a/f77 7 1 2024-09-18T12:52:03.865 INFO:tasks.workunit.client.1.smithi161.stdout:7/350: write d3/d8/f29 [3672881,93506] 0 2024-09-18T12:52:03.866 INFO:tasks.workunit.client.0.smithi045.stdout:9/97: symlink d0/d23/l25 0 2024-09-18T12:52:03.867 INFO:tasks.workunit.client.1.smithi161.stdout:5/351: dread d3/d14/d20/f2e [0,4194304] 0 2024-09-18T12:52:03.867 INFO:tasks.workunit.client.0.smithi045.stdout:9/98: chown d0/d3/d6/d10 3355536 1 2024-09-18T12:52:03.871 INFO:tasks.workunit.client.1.smithi161.stdout:8/436: dread d0/d3/d1e/d34/f39 [0,4194304] 0 2024-09-18T12:52:03.872 INFO:tasks.workunit.client.1.smithi161.stdout:8/437: write d0/d3/d10/f6c [2001748,46302] 0 2024-09-18T12:52:03.873 INFO:tasks.workunit.client.0.smithi045.stdout:3/152: unlink d0/f4 0 2024-09-18T12:52:03.874 INFO:tasks.workunit.client.1.smithi161.stdout:9/344: rmdir d0/d16 39 2024-09-18T12:52:03.875 INFO:tasks.workunit.client.0.smithi045.stdout:5/267: fsync d6/d28/d2b/f2d 0 2024-09-18T12:52:03.876 INFO:tasks.workunit.client.1.smithi161.stdout:1/316: dwrite d1/fc [0,4194304] 0 2024-09-18T12:52:03.876 INFO:tasks.workunit.client.1.smithi161.stdout:4/417: rename d5/d14/d5f/d69 to d5/d14/d67/d84 0 2024-09-18T12:52:03.877 INFO:tasks.workunit.client.1.smithi161.stdout:2/408: dread d0/f24 [0,4194304] 0 2024-09-18T12:52:03.878 INFO:tasks.workunit.client.0.smithi045.stdout:0/127: rmdir d6/d7/d1c 0 2024-09-18T12:52:03.883 INFO:tasks.workunit.client.0.smithi045.stdout:5/268: dwrite d6/d3e/f3f [0,4194304] 0 2024-09-18T12:52:03.892 INFO:tasks.workunit.client.0.smithi045.stdout:5/269: dwrite d6/db/d19/d31/f45 [0,4194304] 0 2024-09-18T12:52:03.916 INFO:tasks.workunit.client.1.smithi161.stdout:0/392: symlink df/d30/d4d/l85 0 2024-09-18T12:52:03.917 INFO:tasks.workunit.client.1.smithi161.stdout:0/393: write fd [3786629,127744] 0 2024-09-18T12:52:03.919 INFO:tasks.workunit.client.0.smithi045.stdout:9/99: readlink d0/d3/d6/d10/l1e 0 2024-09-18T12:52:03.920 INFO:tasks.workunit.client.0.smithi045.stdout:9/100: chown d0/d3/d6/d10/c15 9 1 2024-09-18T12:52:03.922 INFO:tasks.workunit.client.0.smithi045.stdout:7/132: getdents d13/d1a/d28 0 2024-09-18T12:52:03.923 INFO:tasks.workunit.client.0.smithi045.stdout:7/133: truncate d13/d1a/f27 1148409 0 2024-09-18T12:52:03.931 INFO:tasks.workunit.client.1.smithi161.stdout:3/418: dread d1/d2e/d3d/f22 [0,4194304] 0 2024-09-18T12:52:03.931 INFO:tasks.workunit.client.0.smithi045.stdout:7/134: dwrite f11 [0,4194304] 0 2024-09-18T12:52:03.933 INFO:tasks.workunit.client.1.smithi161.stdout:7/351: mknod d3/d8/d4f/c5d 0 2024-09-18T12:52:03.934 INFO:tasks.workunit.client.0.smithi045.stdout:2/215: getdents d5/d3a 0 2024-09-18T12:52:03.938 INFO:tasks.workunit.client.1.smithi161.stdout:7/352: read d3/f14 [1543698,86393] 0 2024-09-18T12:52:03.938 INFO:tasks.workunit.client.1.smithi161.stdout:7/353: write d3/d8/d15/d1a/f22 [49411,49183] 0 2024-09-18T12:52:03.943 INFO:tasks.workunit.client.0.smithi045.stdout:1/157: rename d0/d12/d20 to d0/d2e 0 2024-09-18T12:52:03.945 INFO:tasks.workunit.client.0.smithi045.stdout:1/158: write d0/f1f [4938421,82401] 0 2024-09-18T12:52:03.945 INFO:tasks.workunit.client.1.smithi161.stdout:1/317: readlink d1/da/l29 0 2024-09-18T12:52:03.947 INFO:tasks.workunit.client.0.smithi045.stdout:5/270: symlink d6/db/d19/d31/l56 0 2024-09-18T12:52:03.955 INFO:tasks.workunit.client.0.smithi045.stdout:5/271: dwrite d6/d3e/f33 [0,4194304] 0 2024-09-18T12:52:03.955 INFO:tasks.workunit.client.1.smithi161.stdout:4/418: creat d5/d27/d3a/d47/d49/f85 x:0 0 0 2024-09-18T12:52:03.957 INFO:tasks.workunit.client.1.smithi161.stdout:3/419: dread d1/f5c [0,4194304] 0 2024-09-18T12:52:03.959 INFO:tasks.workunit.client.0.smithi045.stdout:5/272: dread d6/d3e/f26 [0,4194304] 0 2024-09-18T12:52:03.960 INFO:tasks.workunit.client.1.smithi161.stdout:2/409: symlink d0/d1/d4c/d67/l92 0 2024-09-18T12:52:03.960 INFO:tasks.workunit.client.0.smithi045.stdout:5/273: write d6/d3e/f3a [2919738,18426] 0 2024-09-18T12:52:03.961 INFO:tasks.workunit.client.1.smithi161.stdout:2/410: read d0/d5/d43/f37 [342560,115555] 0 2024-09-18T12:52:03.966 INFO:tasks.workunit.client.0.smithi045.stdout:3/153: mknod d0/d7/c34 0 2024-09-18T12:52:03.968 INFO:tasks.workunit.client.0.smithi045.stdout:7/135: write f3 [385817,92460] 0 2024-09-18T12:52:03.975 INFO:tasks.workunit.client.0.smithi045.stdout:2/216: chown d5/d2c/d4d/c14 48210719 1 2024-09-18T12:52:03.975 INFO:tasks.workunit.client.0.smithi045.stdout:7/136: dwrite f3 [0,4194304] 0 2024-09-18T12:52:03.977 INFO:tasks.workunit.client.0.smithi045.stdout:7/137: write d13/d1a/f25 [590485,113678] 0 2024-09-18T12:52:03.980 INFO:tasks.workunit.client.0.smithi045.stdout:1/159: truncate d0/f6 556296 0 2024-09-18T12:52:03.981 INFO:tasks.workunit.client.0.smithi045.stdout:1/160: chown d0/fd 64254 1 2024-09-18T12:52:03.982 INFO:tasks.workunit.client.0.smithi045.stdout:7/138: dread f3 [0,4194304] 0 2024-09-18T12:52:03.982 INFO:tasks.workunit.client.0.smithi045.stdout:1/161: readlink d0/d12/l1e 0 2024-09-18T12:52:03.993 INFO:tasks.workunit.client.0.smithi045.stdout:5/274: symlink d6/d2a/l57 0 2024-09-18T12:52:03.995 INFO:tasks.workunit.client.1.smithi161.stdout:1/318: symlink d1/d26/d3a/d52/l66 0 2024-09-18T12:52:03.997 INFO:tasks.workunit.client.1.smithi161.stdout:4/419: creat d5/d14/f86 x:0 0 0 2024-09-18T12:52:03.998 INFO:tasks.workunit.client.1.smithi161.stdout:4/420: write d5/f36 [1196548,63851] 0 2024-09-18T12:52:04.007 INFO:tasks.workunit.client.0.smithi045.stdout:7/139: creat d13/d19/f2c x:0 0 0 2024-09-18T12:52:04.009 INFO:tasks.workunit.client.1.smithi161.stdout:2/411: write d0/d5/d43/d35/f5f [1722013,89988] 0 2024-09-18T12:52:04.010 INFO:tasks.workunit.client.1.smithi161.stdout:2/412: stat d0/d1/d3b/d3d/d4f 0 2024-09-18T12:52:04.014 INFO:tasks.workunit.client.1.smithi161.stdout:7/354: mknod d3/d8/d15/c5e 0 2024-09-18T12:52:04.014 INFO:tasks.workunit.client.1.smithi161.stdout:7/355: chown d3/d8/d15/d1a/d24/d31 3148979 1 2024-09-18T12:52:04.015 INFO:tasks.workunit.client.0.smithi045.stdout:5/275: symlink d6/d28/d2b/l58 0 2024-09-18T12:52:04.019 INFO:tasks.workunit.client.1.smithi161.stdout:1/319: creat d1/da/d39/f67 x:0 0 0 2024-09-18T12:52:04.024 INFO:tasks.workunit.client.1.smithi161.stdout:4/421: rmdir d5/d14/d6d 39 2024-09-18T12:52:04.025 INFO:tasks.workunit.client.1.smithi161.stdout:4/422: dread d5/d32/d39/d4d/f68 [0,4194304] 0 2024-09-18T12:52:04.028 INFO:tasks.workunit.client.0.smithi045.stdout:1/162: creat d0/d2d/d2b/f2f x:0 0 0 2024-09-18T12:52:04.030 INFO:tasks.workunit.client.0.smithi045.stdout:5/276: symlink d6/d28/d4c/l59 0 2024-09-18T12:52:04.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:03 smithi045 ceph-mon[28315]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:04.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:03 smithi045 ceph-mon[28315]: pgmap v24: 65 pgs: 65 active+clean; 956 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 126 MiB/s wr, 380 op/s 2024-09-18T12:52:04.034 INFO:tasks.workunit.client.0.smithi045.stdout:7/140: link f3 d13/d19/f2d 0 2024-09-18T12:52:04.035 INFO:tasks.workunit.client.1.smithi161.stdout:2/413: dread d0/d5/d43/f37 [0,4194304] 0 2024-09-18T12:52:04.035 INFO:tasks.workunit.client.1.smithi161.stdout:7/356: creat d3/d8/d15/d38/f5f x:0 0 0 2024-09-18T12:52:04.036 INFO:tasks.workunit.client.1.smithi161.stdout:2/414: write d0/d4/d52/f60 [3746390,84916] 0 2024-09-18T12:52:04.036 INFO:tasks.workunit.client.0.smithi045.stdout:1/163: mkdir d0/d2d/d2b/d30 0 2024-09-18T12:52:04.037 INFO:tasks.workunit.client.1.smithi161.stdout:5/352: sync 2024-09-18T12:52:04.038 INFO:tasks.workunit.client.1.smithi161.stdout:9/345: creat d0/d16/d25/d28/f73 x:0 0 0 2024-09-18T12:52:04.040 INFO:tasks.workunit.client.0.smithi045.stdout:5/277: mkdir d6/db/d5a 0 2024-09-18T12:52:04.041 INFO:tasks.workunit.client.0.smithi045.stdout:1/164: dread d0/f1f [4194304,4194304] 0 2024-09-18T12:52:04.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:03 smithi161 ceph-mon[35784]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:04.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:03 smithi161 ceph-mon[35784]: pgmap v24: 65 pgs: 65 active+clean; 956 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 126 MiB/s wr, 380 op/s 2024-09-18T12:52:04.042 INFO:tasks.workunit.client.0.smithi045.stdout:7/141: creat d13/d1a/f2e x:0 0 0 2024-09-18T12:52:04.043 INFO:tasks.workunit.client.1.smithi161.stdout:4/423: rmdir d5/d27/d44 39 2024-09-18T12:52:04.043 INFO:tasks.workunit.client.0.smithi045.stdout:1/165: truncate d0/d12/f13 718331 0 2024-09-18T12:52:04.048 INFO:tasks.workunit.client.1.smithi161.stdout:9/346: dread d0/d47/f4c [0,4194304] 0 2024-09-18T12:52:04.050 INFO:tasks.workunit.client.0.smithi045.stdout:7/142: rename l4 to d13/l2f 0 2024-09-18T12:52:04.050 INFO:tasks.workunit.client.1.smithi161.stdout:2/415: readlink d0/d5/l28 0 2024-09-18T12:52:04.052 INFO:tasks.workunit.client.1.smithi161.stdout:5/353: creat d3/d8/f73 x:0 0 0 2024-09-18T12:52:04.053 INFO:tasks.workunit.client.1.smithi161.stdout:5/354: fsync d3/d14/f30 0 2024-09-18T12:52:04.056 INFO:tasks.workunit.client.0.smithi045.stdout:7/143: dread d13/f24 [0,4194304] 0 2024-09-18T12:52:04.057 INFO:tasks.workunit.client.1.smithi161.stdout:3/420: unlink d1/f54 0 2024-09-18T12:52:04.058 INFO:tasks.workunit.client.1.smithi161.stdout:3/421: dread - d1/d2e/d24/d1d/f5d zero size 2024-09-18T12:52:04.059 INFO:tasks.workunit.client.1.smithi161.stdout:6/403: truncate d4/d39/d26/d31/f59 339265 0 2024-09-18T12:52:04.060 INFO:tasks.workunit.client.0.smithi045.stdout:7/144: mknod d13/d19/c30 0 2024-09-18T12:52:04.063 INFO:tasks.workunit.client.1.smithi161.stdout:4/424: symlink d5/d27/d3a/d4c/l87 0 2024-09-18T12:52:04.064 INFO:tasks.workunit.client.1.smithi161.stdout:9/347: mkdir d0/d20/d74 0 2024-09-18T12:52:04.068 INFO:tasks.workunit.client.1.smithi161.stdout:9/348: creat d0/d47/d48/f75 x:0 0 0 2024-09-18T12:52:04.069 INFO:tasks.workunit.client.1.smithi161.stdout:6/404: symlink d4/d39/d26/d31/d76/l7d 0 2024-09-18T12:52:04.071 INFO:tasks.workunit.client.1.smithi161.stdout:4/425: creat d5/d27/d44/f88 x:0 0 0 2024-09-18T12:52:04.072 INFO:tasks.workunit.client.1.smithi161.stdout:9/349: write d0/d16/d25/d28/f33 [1852725,86480] 0 2024-09-18T12:52:04.073 INFO:tasks.workunit.client.0.smithi045.stdout:9/101: write d0/d23/f24 [1293920,20584] 0 2024-09-18T12:52:04.074 INFO:tasks.workunit.client.1.smithi161.stdout:4/426: write d5/d32/d39/d4d/f78 [153879,31090] 0 2024-09-18T12:52:04.074 INFO:tasks.workunit.client.0.smithi045.stdout:9/102: truncate d0/d3/f1f 61004 0 2024-09-18T12:52:04.075 INFO:tasks.workunit.client.1.smithi161.stdout:6/405: dwrite d4/f10 [0,4194304] 0 2024-09-18T12:52:04.076 INFO:tasks.workunit.client.0.smithi045.stdout:9/103: write d0/d3/d6/f22 [611768,59926] 0 2024-09-18T12:52:04.079 INFO:tasks.workunit.client.1.smithi161.stdout:4/427: mknod d5/d27/d3a/c89 0 2024-09-18T12:52:04.080 INFO:tasks.workunit.client.1.smithi161.stdout:6/406: symlink d4/d39/d26/d31/l7e 0 2024-09-18T12:52:04.081 INFO:tasks.workunit.client.1.smithi161.stdout:4/428: truncate d5/d27/d3a/f7a 712815 0 2024-09-18T12:52:04.082 INFO:tasks.workunit.client.1.smithi161.stdout:8/438: rename d0/d3/d1e/d34 to d0/d3/d10/d21/d4a/d52/d82/d96/d98 0 2024-09-18T12:52:04.083 INFO:tasks.workunit.client.1.smithi161.stdout:8/439: write d0/d3/d10/d21/f48 [29607,97820] 0 2024-09-18T12:52:04.083 INFO:tasks.workunit.client.1.smithi161.stdout:4/429: chown d5/l5e 0 1 2024-09-18T12:52:04.085 INFO:tasks.workunit.client.0.smithi045.stdout:9/104: getdents d0/d3 0 2024-09-18T12:52:04.087 INFO:tasks.workunit.client.1.smithi161.stdout:0/394: rename df/d61 to df/d84/d86 0 2024-09-18T12:52:04.088 INFO:tasks.workunit.client.0.smithi045.stdout:9/105: mkdir d0/d3/d6/d10/d26 0 2024-09-18T12:52:04.092 INFO:tasks.workunit.client.1.smithi161.stdout:8/440: read d0/d3/d10/d21/d4a/d52/d66/f5c [1010132,6308] 0 2024-09-18T12:52:04.092 INFO:tasks.workunit.client.1.smithi161.stdout:0/395: dwrite df/f32 [8388608,4194304] 0 2024-09-18T12:52:04.092 INFO:tasks.workunit.client.0.smithi045.stdout:3/154: symlink d0/l35 0 2024-09-18T12:52:04.094 INFO:tasks.workunit.client.1.smithi161.stdout:9/350: rename d0/d20/f71 to d0/d16/f76 0 2024-09-18T12:52:04.097 INFO:tasks.workunit.client.0.smithi045.stdout:2/217: dwrite d5/f9 [4194304,4194304] 0 2024-09-18T12:52:04.098 INFO:tasks.workunit.client.1.smithi161.stdout:9/351: dread d0/f3b [0,4194304] 0 2024-09-18T12:52:04.098 INFO:tasks.workunit.client.0.smithi045.stdout:9/106: dwrite d0/d3/d6/f22 [0,4194304] 0 2024-09-18T12:52:04.099 INFO:tasks.workunit.client.1.smithi161.stdout:9/352: write d0/db/d18/f69 [382882,128255] 0 2024-09-18T12:52:04.099 INFO:tasks.workunit.client.0.smithi045.stdout:9/107: stat d0/d3/d6/d10 0 2024-09-18T12:52:04.151 INFO:tasks.workunit.client.1.smithi161.stdout:7/357: sync 2024-09-18T12:52:04.169 INFO:tasks.workunit.client.1.smithi161.stdout:2/416: sync 2024-09-18T12:52:04.207 INFO:tasks.workunit.client.1.smithi161.stdout:6/407: creat d4/d39/d47/f7f x:0 0 0 2024-09-18T12:52:04.208 INFO:tasks.workunit.client.1.smithi161.stdout:4/430: mkdir d5/d27/d3a/d60/d8a 0 2024-09-18T12:52:04.211 INFO:tasks.workunit.client.0.smithi045.stdout:2/218: dread d5/f34 [0,4194304] 0 2024-09-18T12:52:04.213 INFO:tasks.workunit.client.1.smithi161.stdout:4/431: dwrite d5/d32/d39/d4d/f52 [0,4194304] 0 2024-09-18T12:52:04.215 INFO:tasks.workunit.client.1.smithi161.stdout:4/432: read d5/d14/f23 [100440,110170] 0 2024-09-18T12:52:04.232 INFO:tasks.workunit.client.1.smithi161.stdout:8/441: rename d0/d3/d10/d21/f32 to d0/d3/d10/d21/d4a/d52/d94/f99 0 2024-09-18T12:52:04.235 INFO:tasks.workunit.client.1.smithi161.stdout:9/353: stat d0/db/c54 0 2024-09-18T12:52:04.236 INFO:tasks.workunit.client.0.smithi045.stdout:9/108: dwrite d0/f2 [8388608,4194304] 0 2024-09-18T12:52:04.240 INFO:tasks.workunit.client.1.smithi161.stdout:8/442: dwrite d0/d3/d10/d21/d4a/f77 [0,4194304] 0 2024-09-18T12:52:04.240 INFO:tasks.workunit.client.1.smithi161.stdout:8/443: chown d0/d3/fb 6855609 1 2024-09-18T12:52:04.240 INFO:tasks.workunit.client.1.smithi161.stdout:2/417: mkdir d0/d1/d3b/d93 0 2024-09-18T12:52:04.242 INFO:tasks.workunit.client.1.smithi161.stdout:2/418: write d0/d1/df/f1b [3344549,80295] 0 2024-09-18T12:52:04.243 INFO:tasks.workunit.client.1.smithi161.stdout:6/408: creat d4/d39/f80 x:0 0 0 2024-09-18T12:52:04.245 INFO:tasks.workunit.client.1.smithi161.stdout:0/396: creat df/d30/d71/f87 x:0 0 0 2024-09-18T12:52:04.246 INFO:tasks.workunit.client.0.smithi045.stdout:5/278: write d6/db/f12 [1533274,6660] 0 2024-09-18T12:52:04.248 INFO:tasks.workunit.client.0.smithi045.stdout:5/279: truncate d6/db/d19/d31/f45 5009338 0 2024-09-18T12:52:04.249 INFO:tasks.workunit.client.0.smithi045.stdout:5/280: fsync d6/db/d19/f4f 0 2024-09-18T12:52:04.253 INFO:tasks.workunit.client.0.smithi045.stdout:5/281: dread d6/db/fe [0,4194304] 0 2024-09-18T12:52:04.256 INFO:tasks.workunit.client.1.smithi161.stdout:1/320: dwrite d1/d26/f9 [0,4194304] 0 2024-09-18T12:52:04.258 INFO:tasks.workunit.client.0.smithi045.stdout:7/145: rename d13/d19 to d13/d31 0 2024-09-18T12:52:04.259 INFO:tasks.workunit.client.0.smithi045.stdout:7/146: write d13/d1a/f1b [2234552,70829] 0 2024-09-18T12:52:04.260 INFO:tasks.workunit.client.1.smithi161.stdout:4/433: rename d5/l30 to d5/d32/d39/d4d/l8b 0 2024-09-18T12:52:04.261 INFO:tasks.workunit.client.1.smithi161.stdout:5/355: write d3/d9/f12 [3372937,92601] 0 2024-09-18T12:52:04.261 INFO:tasks.workunit.client.1.smithi161.stdout:2/419: dread d0/d1/df/f34 [0,4194304] 0 2024-09-18T12:52:04.263 INFO:tasks.workunit.client.0.smithi045.stdout:7/147: chown d13/l2f 2066763 1 2024-09-18T12:52:04.265 INFO:tasks.workunit.client.1.smithi161.stdout:9/354: creat d0/d47/f77 x:0 0 0 2024-09-18T12:52:04.267 INFO:tasks.workunit.client.1.smithi161.stdout:7/358: creat d3/d8/d15/d1a/d4a/d59/f60 x:0 0 0 2024-09-18T12:52:04.268 INFO:tasks.workunit.client.0.smithi045.stdout:7/148: creat d13/f32 x:0 0 0 2024-09-18T12:52:04.268 INFO:tasks.workunit.client.0.smithi045.stdout:7/149: readlink lf 0 2024-09-18T12:52:04.270 INFO:tasks.workunit.client.0.smithi045.stdout:7/150: chown d13/f23 246256348 1 2024-09-18T12:52:04.270 INFO:tasks.workunit.client.1.smithi161.stdout:7/359: read d3/d8/d15/f33 [2441211,41082] 0 2024-09-18T12:52:04.270 INFO:tasks.workunit.client.1.smithi161.stdout:2/420: dwrite d0/d5/d43/d35/f3e [0,4194304] 0 2024-09-18T12:52:04.270 INFO:tasks.workunit.client.1.smithi161.stdout:3/422: dwrite d1/d2e/d24/f45 [0,4194304] 0 2024-09-18T12:52:04.273 INFO:tasks.workunit.client.1.smithi161.stdout:6/409: mkdir d4/d39/d26/d20/d28/d81 0 2024-09-18T12:52:04.273 INFO:tasks.workunit.client.0.smithi045.stdout:1/166: dwrite d0/f6 [0,4194304] 0 2024-09-18T12:52:04.274 INFO:tasks.workunit.client.0.smithi045.stdout:1/167: write d0/d12/f15 [2470263,106904] 0 2024-09-18T12:52:04.276 INFO:tasks.workunit.client.0.smithi045.stdout:1/168: dread d0/d2e/f28 [0,4194304] 0 2024-09-18T12:52:04.280 INFO:tasks.workunit.client.1.smithi161.stdout:4/434: mknod d5/c8c 0 2024-09-18T12:52:04.287 INFO:tasks.workunit.client.0.smithi045.stdout:1/169: mknod d0/d2d/d2b/c31 0 2024-09-18T12:52:04.288 INFO:tasks.workunit.client.0.smithi045.stdout:1/170: write d0/d12/f15 [1762880,113323] 0 2024-09-18T12:52:04.290 INFO:tasks.workunit.client.0.smithi045.stdout:5/282: dread d6/db/f2c [0,4194304] 0 2024-09-18T12:52:04.292 INFO:tasks.workunit.client.0.smithi045.stdout:3/155: truncate d0/f1f 1027465 0 2024-09-18T12:52:04.293 INFO:tasks.workunit.client.0.smithi045.stdout:3/156: read d0/f18 [3193739,21248] 0 2024-09-18T12:52:04.294 INFO:tasks.workunit.client.0.smithi045.stdout:3/157: read - d0/d22/f2e zero size 2024-09-18T12:52:04.297 INFO:tasks.workunit.client.0.smithi045.stdout:1/171: mkdir d0/d12/d32 0 2024-09-18T12:52:04.297 INFO:tasks.workunit.client.0.smithi045.stdout:9/109: truncate d0/f9 542247 0 2024-09-18T12:52:04.299 INFO:tasks.workunit.client.1.smithi161.stdout:7/360: rename d3/f19 to d3/d8/d4f/f61 0 2024-09-18T12:52:04.300 INFO:tasks.workunit.client.1.smithi161.stdout:8/444: dwrite d0/d3/d10/d21/d4a/d52/f58 [0,4194304] 0 2024-09-18T12:52:04.300 INFO:tasks.workunit.client.0.smithi045.stdout:5/283: rmdir d6/d28/d2b/d51 39 2024-09-18T12:52:04.301 INFO:tasks.workunit.client.0.smithi045.stdout:3/158: dwrite d0/d7/f1d [0,4194304] 0 2024-09-18T12:52:04.301 INFO:tasks.workunit.client.1.smithi161.stdout:2/421: write d0/d1/df/f40 [732822,97850] 0 2024-09-18T12:52:04.302 INFO:tasks.workunit.client.0.smithi045.stdout:2/219: truncate d5/fd 2522031 0 2024-09-18T12:52:04.303 INFO:tasks.workunit.client.0.smithi045.stdout:7/151: getdents d13/d1c 0 2024-09-18T12:52:04.311 INFO:tasks.workunit.client.1.smithi161.stdout:0/397: link df/f28 df/d29/d2d/f88 0 2024-09-18T12:52:04.312 INFO:tasks.workunit.client.0.smithi045.stdout:3/159: dwrite d0/f1a [0,4194304] 0 2024-09-18T12:52:04.315 INFO:tasks.workunit.client.1.smithi161.stdout:6/410: fsync d4/d39/d26/d20/d28/f3b 0 2024-09-18T12:52:04.316 INFO:tasks.workunit.client.1.smithi161.stdout:6/411: read d4/d39/d26/d20/d28/f3b [1374824,51609] 0 2024-09-18T12:52:04.316 INFO:tasks.workunit.client.0.smithi045.stdout:9/110: rmdir d0/d3 39 2024-09-18T12:52:04.318 INFO:tasks.workunit.client.0.smithi045.stdout:5/284: symlink d6/d2a/l5b 0 2024-09-18T12:52:04.319 INFO:tasks.workunit.client.1.smithi161.stdout:5/356: truncate d3/d3b/f42 839709 0 2024-09-18T12:52:04.320 INFO:tasks.workunit.client.0.smithi045.stdout:3/160: dwrite d0/d22/f2e [0,4194304] 0 2024-09-18T12:52:04.320 INFO:tasks.workunit.client.1.smithi161.stdout:1/321: sync 2024-09-18T12:52:04.322 INFO:tasks.workunit.client.1.smithi161.stdout:9/355: symlink d0/d20/l78 0 2024-09-18T12:52:04.323 INFO:tasks.workunit.client.0.smithi045.stdout:7/152: mkdir d13/d31/d33 0 2024-09-18T12:52:04.323 INFO:tasks.workunit.client.0.smithi045.stdout:5/285: dread d6/db/fe [0,4194304] 0 2024-09-18T12:52:04.324 INFO:tasks.workunit.client.0.smithi045.stdout:5/286: chown d6/d2a/f25 14713443 1 2024-09-18T12:52:04.327 INFO:tasks.workunit.client.1.smithi161.stdout:7/361: creat d3/d8/d15/d1a/d24/d31/f62 x:0 0 0 2024-09-18T12:52:04.329 INFO:tasks.workunit.client.1.smithi161.stdout:8/445: write d0/d3/d10/f63 [663006,37783] 0 2024-09-18T12:52:04.330 INFO:tasks.workunit.client.1.smithi161.stdout:8/446: dread - d0/d3/d10/d21/d4a/d52/d82/d96/f60 zero size 2024-09-18T12:52:04.331 INFO:tasks.workunit.client.1.smithi161.stdout:2/422: symlink d0/d1/d4c/d67/l94 0 2024-09-18T12:52:04.332 INFO:tasks.workunit.client.1.smithi161.stdout:8/447: write d0/d3/d10/d21/d4a/d52/f58 [3760074,89041] 0 2024-09-18T12:52:04.333 INFO:tasks.workunit.client.1.smithi161.stdout:8/448: fsync d0/d3/d10/d21/f48 0 2024-09-18T12:52:04.334 INFO:tasks.workunit.client.1.smithi161.stdout:3/423: rename d1/l3b to d1/d2e/d3d/d49/l93 0 2024-09-18T12:52:04.335 INFO:tasks.workunit.client.1.smithi161.stdout:3/424: chown d1/d2e/d14/f56 45 1 2024-09-18T12:52:04.335 INFO:tasks.workunit.client.0.smithi045.stdout:3/161: chown d0/d22/f28 780124 1 2024-09-18T12:52:04.336 INFO:tasks.workunit.client.1.smithi161.stdout:3/425: chown d1/d2e/d14/d65/d76/l77 29 1 2024-09-18T12:52:04.337 INFO:tasks.workunit.client.1.smithi161.stdout:3/426: write d1/d2e/d14/d65/f79 [1005168,54589] 0 2024-09-18T12:52:04.339 INFO:tasks.workunit.client.1.smithi161.stdout:0/398: mkdir df/d84/d89 0 2024-09-18T12:52:04.339 INFO:tasks.workunit.client.1.smithi161.stdout:0/399: stat df/f1c 0 2024-09-18T12:52:04.344 INFO:tasks.workunit.client.1.smithi161.stdout:7/362: dread d3/d8/d15/f1e [0,4194304] 0 2024-09-18T12:52:04.344 INFO:tasks.workunit.client.0.smithi045.stdout:5/287: mkdir d6/d2a/d5c 0 2024-09-18T12:52:04.345 INFO:tasks.workunit.client.0.smithi045.stdout:5/288: stat d6/d3e/l29 0 2024-09-18T12:52:04.349 INFO:tasks.workunit.client.0.smithi045.stdout:9/111: rename d0/d3/d6/l13 to d0/d3/l27 0 2024-09-18T12:52:04.349 INFO:tasks.workunit.client.0.smithi045.stdout:9/112: chown d0/d3/l8 121835 1 2024-09-18T12:52:04.351 INFO:tasks.workunit.client.1.smithi161.stdout:1/322: truncate d1/da/d1f/d45/f47 1029630 0 2024-09-18T12:52:04.353 INFO:tasks.workunit.client.0.smithi045.stdout:7/153: getdents d13/d31/d33 0 2024-09-18T12:52:04.355 INFO:tasks.workunit.client.0.smithi045.stdout:5/289: mknod d6/db/d19/d31/c5d 0 2024-09-18T12:52:04.355 INFO:tasks.workunit.client.0.smithi045.stdout:7/154: read d13/f16 [437709,84089] 0 2024-09-18T12:52:04.355 INFO:tasks.workunit.client.0.smithi045.stdout:5/290: readlink d6/d2a/l57 0 2024-09-18T12:52:04.357 INFO:tasks.workunit.client.0.smithi045.stdout:9/113: symlink d0/d3/d6/l28 0 2024-09-18T12:52:04.357 INFO:tasks.workunit.client.0.smithi045.stdout:9/114: chown d0/d3/d6/l19 1 1 2024-09-18T12:52:04.362 INFO:tasks.workunit.client.1.smithi161.stdout:2/423: rename d0/d1/d4c/d67/l92 to d0/d5/d53/l95 0 2024-09-18T12:52:04.364 INFO:tasks.workunit.client.0.smithi045.stdout:5/291: mkdir d6/d28/d5e 0 2024-09-18T12:52:04.365 INFO:tasks.workunit.client.1.smithi161.stdout:3/427: dread - d1/d2e/d3d/f80 zero size 2024-09-18T12:52:04.365 INFO:tasks.workunit.client.1.smithi161.stdout:3/428: stat d1/d2e/d14/f30 0 2024-09-18T12:52:04.365 INFO:tasks.workunit.client.0.smithi045.stdout:3/162: link d0/l35 d0/d33/l36 0 2024-09-18T12:52:04.366 INFO:tasks.workunit.client.1.smithi161.stdout:3/429: dread - d1/d2e/d14/d65/d76/d88/f8e zero size 2024-09-18T12:52:04.366 INFO:tasks.workunit.client.0.smithi045.stdout:2/220: write d5/d46/f52 [653709,9414] 0 2024-09-18T12:52:04.367 INFO:tasks.workunit.client.1.smithi161.stdout:0/400: mkdir df/d84/d8a 0 2024-09-18T12:52:04.369 INFO:tasks.workunit.client.0.smithi045.stdout:7/155: creat d13/d1a/d28/f34 x:0 0 0 2024-09-18T12:52:04.370 INFO:tasks.workunit.client.1.smithi161.stdout:7/363: write d3/d8/d4f/f61 [4612783,98655] 0 2024-09-18T12:52:04.372 INFO:tasks.workunit.client.1.smithi161.stdout:7/364: write d3/d8/d15/d1a/d24/d31/f62 [699827,103879] 0 2024-09-18T12:52:04.372 INFO:tasks.workunit.client.1.smithi161.stdout:6/412: write d4/d1a/f11 [2342908,119155] 0 2024-09-18T12:52:04.372 INFO:tasks.workunit.client.1.smithi161.stdout:7/365: chown d3/d8 16054 1 2024-09-18T12:52:04.375 INFO:tasks.workunit.client.1.smithi161.stdout:1/323: mknod d1/da/d1f/d45/c68 0 2024-09-18T12:52:04.376 INFO:tasks.workunit.client.0.smithi045.stdout:2/221: creat d5/d2c/d4d/d33/f55 x:0 0 0 2024-09-18T12:52:04.376 INFO:tasks.workunit.client.1.smithi161.stdout:1/324: fdatasync d1/d26/f7 0 2024-09-18T12:52:04.377 INFO:tasks.workunit.client.0.smithi045.stdout:2/222: chown d5/d2c/d4d/d33/l3f 252 1 2024-09-18T12:52:04.378 INFO:tasks.workunit.client.1.smithi161.stdout:6/413: dwrite d4/f6b [0,4194304] 0 2024-09-18T12:52:04.379 INFO:tasks.workunit.client.0.smithi045.stdout:7/156: symlink d13/d1c/l35 0 2024-09-18T12:52:04.380 INFO:tasks.workunit.client.0.smithi045.stdout:7/157: write d13/d31/f26 [408502,119816] 0 2024-09-18T12:52:04.380 INFO:tasks.workunit.client.0.smithi045.stdout:5/292: creat d6/db/d5a/f5f x:0 0 0 2024-09-18T12:52:04.382 INFO:tasks.workunit.client.0.smithi045.stdout:5/293: fdatasync d6/d3e/f33 0 2024-09-18T12:52:04.382 INFO:tasks.workunit.client.1.smithi161.stdout:2/424: mkdir d0/d1/d4c/d67/d96 0 2024-09-18T12:52:04.384 INFO:tasks.workunit.client.1.smithi161.stdout:2/425: dread - d0/d1/f5e zero size 2024-09-18T12:52:04.384 INFO:tasks.workunit.client.0.smithi045.stdout:5/294: write d6/db/f43 [1571529,15854] 0 2024-09-18T12:52:04.385 INFO:tasks.workunit.client.1.smithi161.stdout:6/414: dwrite d4/d1a/d1c/d3e/d4d/f72 [0,4194304] 0 2024-09-18T12:52:04.386 INFO:tasks.workunit.client.0.smithi045.stdout:3/163: mknod d0/d7/c37 0 2024-09-18T12:52:04.388 INFO:tasks.workunit.client.0.smithi045.stdout:2/223: mknod d5/d2c/d4d/d16/c56 0 2024-09-18T12:52:04.390 INFO:tasks.workunit.client.0.smithi045.stdout:2/224: write d5/d2c/d4d/d33/f55 [861449,110780] 0 2024-09-18T12:52:04.393 INFO:tasks.workunit.client.1.smithi161.stdout:6/415: dwrite d4/d39/d3a/f6d [0,4194304] 0 2024-09-18T12:52:04.394 INFO:tasks.workunit.client.1.smithi161.stdout:0/401: truncate df/d29/d36/d7a/f81 916406 0 2024-09-18T12:52:04.395 INFO:tasks.workunit.client.1.smithi161.stdout:4/435: link d5/c1d d5/d27/d3a/c8d 0 2024-09-18T12:52:04.398 INFO:tasks.workunit.client.0.smithi045.stdout:3/164: creat d0/d1e/f38 x:0 0 0 2024-09-18T12:52:04.400 INFO:tasks.workunit.client.1.smithi161.stdout:5/357: creat d3/d14/d20/f74 x:0 0 0 2024-09-18T12:52:04.400 INFO:tasks.workunit.client.0.smithi045.stdout:9/115: truncate d0/d3/f1f 22981 0 2024-09-18T12:52:04.401 INFO:tasks.workunit.client.0.smithi045.stdout:9/116: fdatasync d0/fc 0 2024-09-18T12:52:04.401 INFO:tasks.workunit.client.0.smithi045.stdout:2/225: fdatasync d5/f42 0 2024-09-18T12:52:04.405 INFO:tasks.workunit.client.0.smithi045.stdout:9/117: dread d0/f2 [8388608,4194304] 0 2024-09-18T12:52:04.407 INFO:tasks.workunit.client.0.smithi045.stdout:3/165: rename d0/d33 to d0/d1e/d39 0 2024-09-18T12:52:04.408 INFO:tasks.workunit.client.1.smithi161.stdout:9/356: creat d0/d16/d25/d28/d45/f79 x:0 0 0 2024-09-18T12:52:04.409 INFO:tasks.workunit.client.1.smithi161.stdout:9/357: dread - d0/d47/d48/f75 zero size 2024-09-18T12:52:04.410 INFO:tasks.workunit.client.1.smithi161.stdout:1/325: creat d1/d26/d3a/d52/f69 x:0 0 0 2024-09-18T12:52:04.410 INFO:tasks.workunit.client.0.smithi045.stdout:3/166: dread d0/f1a [0,4194304] 0 2024-09-18T12:52:04.411 INFO:tasks.workunit.client.1.smithi161.stdout:1/326: readlink d1/da/l29 0 2024-09-18T12:52:04.411 INFO:tasks.workunit.client.1.smithi161.stdout:3/430: write d1/d2e/d3d/f22 [773176,32426] 0 2024-09-18T12:52:04.413 INFO:tasks.workunit.client.0.smithi045.stdout:2/226: symlink d5/d2c/l57 0 2024-09-18T12:52:04.415 INFO:tasks.workunit.client.0.smithi045.stdout:2/227: write d5/d2c/d4d/d33/f3d [273024,124135] 0 2024-09-18T12:52:04.417 INFO:tasks.workunit.client.1.smithi161.stdout:2/426: creat d0/d4/d52/d8b/f97 x:0 0 0 2024-09-18T12:52:04.419 INFO:tasks.workunit.client.0.smithi045.stdout:9/118: creat d0/d3/d6/d10/f29 x:0 0 0 2024-09-18T12:52:04.419 INFO:tasks.workunit.client.0.smithi045.stdout:7/158: truncate d13/d31/f26 328095 0 2024-09-18T12:52:04.423 INFO:tasks.workunit.client.0.smithi045.stdout:2/228: dwrite d5/d2c/d4d/d16/f3b [0,4194304] 0 2024-09-18T12:52:04.434 INFO:tasks.workunit.client.0.smithi045.stdout:9/119: creat d0/d3/d6/d10/f2a x:0 0 0 2024-09-18T12:52:04.435 INFO:tasks.workunit.client.0.smithi045.stdout:9/120: fdatasync d0/d23/f24 0 2024-09-18T12:52:04.435 INFO:tasks.workunit.client.0.smithi045.stdout:9/121: chown d0/l18 18364 1 2024-09-18T12:52:04.438 INFO:tasks.workunit.client.0.smithi045.stdout:2/229: creat d5/d2c/f58 x:0 0 0 2024-09-18T12:52:04.438 INFO:tasks.workunit.client.1.smithi161.stdout:5/358: dwrite d3/d14/d20/f32 [0,4194304] 0 2024-09-18T12:52:04.439 INFO:tasks.workunit.client.1.smithi161.stdout:8/449: getdents d0/d3/d1e 0 2024-09-18T12:52:04.441 INFO:tasks.workunit.client.1.smithi161.stdout:0/402: creat df/d84/d89/f8b x:0 0 0 2024-09-18T12:52:04.446 INFO:tasks.workunit.client.1.smithi161.stdout:7/366: link d3/c43 d3/d8/d4f/c63 0 2024-09-18T12:52:04.446 INFO:tasks.workunit.client.1.smithi161.stdout:1/327: dwrite d1/f62 [0,4194304] 0 2024-09-18T12:52:04.449 INFO:tasks.workunit.client.0.smithi045.stdout:2/230: mknod d5/c59 0 2024-09-18T12:52:04.460 INFO:tasks.workunit.client.0.smithi045.stdout:3/167: write d0/d22/f28 [1114400,51558] 0 2024-09-18T12:52:04.461 INFO:tasks.workunit.client.0.smithi045.stdout:3/168: write d0/d22/f26 [3398405,100879] 0 2024-09-18T12:52:04.462 INFO:tasks.workunit.client.1.smithi161.stdout:6/416: sync 2024-09-18T12:52:04.463 INFO:tasks.workunit.client.1.smithi161.stdout:6/417: chown d4/d39/d26/d31/d76 322 1 2024-09-18T12:52:04.467 INFO:tasks.workunit.client.1.smithi161.stdout:0/403: symlink df/d29/d2d/l8c 0 2024-09-18T12:52:04.469 INFO:tasks.workunit.client.0.smithi045.stdout:2/231: creat d5/d2c/d4d/f5a x:0 0 0 2024-09-18T12:52:04.472 INFO:tasks.workunit.client.1.smithi161.stdout:3/431: dwrite d1/d2e/f28 [8388608,4194304] 0 2024-09-18T12:52:04.473 INFO:tasks.workunit.client.1.smithi161.stdout:3/432: chown d1/c7c 5 1 2024-09-18T12:52:04.473 INFO:tasks.workunit.client.0.smithi045.stdout:3/169: mkdir d0/d1e/d2c/d3a 0 2024-09-18T12:52:04.475 INFO:tasks.workunit.client.0.smithi045.stdout:9/122: write d0/f9 [534040,59816] 0 2024-09-18T12:52:04.477 INFO:tasks.workunit.client.0.smithi045.stdout:9/123: fsync d0/d3/d6/fd 0 2024-09-18T12:52:04.478 INFO:tasks.workunit.client.0.smithi045.stdout:2/232: dwrite d5/d2c/d4d/ff [0,4194304] 0 2024-09-18T12:52:04.478 INFO:tasks.workunit.client.0.smithi045.stdout:7/159: truncate d13/d31/f26 1152079 0 2024-09-18T12:52:04.479 INFO:tasks.workunit.client.1.smithi161.stdout:1/328: mknod d1/d26/d3a/c6a 0 2024-09-18T12:52:04.480 INFO:tasks.workunit.client.0.smithi045.stdout:3/170: mknod d0/d1e/d2c/c3b 0 2024-09-18T12:52:04.481 INFO:tasks.workunit.client.1.smithi161.stdout:2/427: write d0/d1/f7 [2605636,54474] 0 2024-09-18T12:52:04.482 INFO:tasks.workunit.client.0.smithi045.stdout:3/171: truncate d0/d22/f2e 4830373 0 2024-09-18T12:52:04.482 INFO:tasks.workunit.client.1.smithi161.stdout:8/450: write d0/d3/d10/d21/f49 [4339464,12417] 0 2024-09-18T12:52:04.483 INFO:tasks.workunit.client.1.smithi161.stdout:1/329: chown d1/d26/l64 0 1 2024-09-18T12:52:04.483 INFO:tasks.workunit.client.1.smithi161.stdout:4/436: dwrite d5/d27/d44/f63 [0,4194304] 0 2024-09-18T12:52:04.483 INFO:tasks.workunit.client.0.smithi045.stdout:9/124: creat d0/d3/f2b x:0 0 0 2024-09-18T12:52:04.484 INFO:tasks.workunit.client.1.smithi161.stdout:3/433: dread d1/f50 [8388608,4194304] 0 2024-09-18T12:52:04.488 INFO:tasks.workunit.client.0.smithi045.stdout:7/160: mknod d13/d1a/c36 0 2024-09-18T12:52:04.489 INFO:tasks.workunit.client.1.smithi161.stdout:6/418: creat d4/d39/d48/f82 x:0 0 0 2024-09-18T12:52:04.491 INFO:tasks.workunit.client.0.smithi045.stdout:3/172: dwrite d0/d22/f26 [0,4194304] 0 2024-09-18T12:52:04.491 INFO:tasks.workunit.client.0.smithi045.stdout:9/125: mkdir d0/d3/d6/d10/d2c 0 2024-09-18T12:52:04.492 INFO:tasks.workunit.client.0.smithi045.stdout:3/173: dread - d0/d1e/f38 zero size 2024-09-18T12:52:04.493 INFO:tasks.workunit.client.1.smithi161.stdout:9/358: dwrite d0/d20/f6c [0,4194304] 0 2024-09-18T12:52:04.494 INFO:tasks.workunit.client.0.smithi045.stdout:3/174: stat d0/d1e/d2c 0 2024-09-18T12:52:04.495 INFO:tasks.workunit.client.1.smithi161.stdout:7/367: write d3/d8/d15/f33 [2311404,43149] 0 2024-09-18T12:52:04.496 INFO:tasks.workunit.client.0.smithi045.stdout:2/233: creat d5/d3a/f5b x:0 0 0 2024-09-18T12:52:04.499 INFO:tasks.workunit.client.1.smithi161.stdout:1/330: dwrite d1/d26/f8 [0,4194304] 0 2024-09-18T12:52:04.504 INFO:tasks.workunit.client.1.smithi161.stdout:6/419: dwrite d4/d39/d26/d31/f53 [0,4194304] 0 2024-09-18T12:52:04.506 INFO:tasks.workunit.client.1.smithi161.stdout:6/420: write d4/d39/d48/f82 [987108,137] 0 2024-09-18T12:52:04.592 INFO:tasks.workunit.client.0.smithi045.stdout:3/175: rename d0/d22/f2b to d0/d1e/d2c/d3a/f3c 0 2024-09-18T12:52:04.593 INFO:tasks.workunit.client.0.smithi045.stdout:4/150: sync 2024-09-18T12:52:04.595 INFO:tasks.workunit.client.0.smithi045.stdout:9/126: link d0/d3/d6/d10/f29 d0/d3/d6/f2d 0 2024-09-18T12:52:04.597 INFO:tasks.workunit.client.0.smithi045.stdout:9/127: read - d0/d3/d6/d10/f29 zero size 2024-09-18T12:52:04.599 INFO:tasks.workunit.client.0.smithi045.stdout:4/151: dwrite db/de/d1e/f2d [0,4194304] 0 2024-09-18T12:52:04.599 INFO:tasks.workunit.client.1.smithi161.stdout:4/437: rename d5/f16 to d5/d32/d39/f8e 0 2024-09-18T12:52:04.601 INFO:tasks.workunit.client.1.smithi161.stdout:3/434: mknod d1/d2e/d14/d65/d76/c94 0 2024-09-18T12:52:04.601 INFO:tasks.workunit.client.1.smithi161.stdout:3/435: dread - d1/d2e/d68/f6f zero size 2024-09-18T12:52:04.603 INFO:tasks.workunit.client.1.smithi161.stdout:8/451: fdatasync d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f84 0 2024-09-18T12:52:04.608 INFO:tasks.workunit.client.0.smithi045.stdout:3/176: creat d0/d22/f3d x:0 0 0 2024-09-18T12:52:04.608 INFO:tasks.workunit.client.0.smithi045.stdout:4/152: dwrite db/f30 [0,4194304] 0 2024-09-18T12:52:04.611 INFO:tasks.workunit.client.1.smithi161.stdout:5/359: getdents d3 0 2024-09-18T12:52:04.612 INFO:tasks.workunit.client.1.smithi161.stdout:5/360: write d3/d9/f41 [3520917,86664] 0 2024-09-18T12:52:04.616 INFO:tasks.workunit.client.1.smithi161.stdout:7/368: mkdir d3/d8/d15/d1a/d4a/d64 0 2024-09-18T12:52:04.618 INFO:tasks.workunit.client.1.smithi161.stdout:1/331: rmdir d1/d26/d3a 39 2024-09-18T12:52:04.618 INFO:tasks.workunit.client.1.smithi161.stdout:2/428: write d0/d1/d3b/d3d/f64 [1610525,51782] 0 2024-09-18T12:52:04.618 INFO:tasks.workunit.client.1.smithi161.stdout:5/361: dwrite d3/d9/f12 [0,4194304] 0 2024-09-18T12:52:04.620 INFO:tasks.workunit.client.1.smithi161.stdout:5/362: write d3/d9/f6d [162614,73285] 0 2024-09-18T12:52:04.623 INFO:tasks.workunit.client.1.smithi161.stdout:6/421: write d4/d39/d3a/f1f [4415473,72118] 0 2024-09-18T12:52:04.625 INFO:tasks.workunit.client.0.smithi045.stdout:3/177: creat d0/f3e x:0 0 0 2024-09-18T12:52:04.631 INFO:tasks.workunit.client.0.smithi045.stdout:2/234: rename d5/d2c/d4d/ff to d5/f5c 0 2024-09-18T12:52:04.632 INFO:tasks.workunit.client.1.smithi161.stdout:4/438: mkdir d5/d27/d44/d61/d6c/d8f 0 2024-09-18T12:52:04.635 INFO:tasks.workunit.client.0.smithi045.stdout:4/153: creat db/d10/d2f/f36 x:0 0 0 2024-09-18T12:52:04.638 INFO:tasks.workunit.client.1.smithi161.stdout:0/404: creat df/d29/f8d x:0 0 0 2024-09-18T12:52:04.640 INFO:tasks.workunit.client.0.smithi045.stdout:9/128: rename d0/d23 to d0/d3/d6/d10/d26/d2e 0 2024-09-18T12:52:04.645 INFO:tasks.workunit.client.0.smithi045.stdout:3/178: dread d0/d7/f10 [0,4194304] 0 2024-09-18T12:52:04.646 INFO:tasks.workunit.client.1.smithi161.stdout:7/369: creat d3/d36/f65 x:0 0 0 2024-09-18T12:52:04.647 INFO:tasks.workunit.client.1.smithi161.stdout:7/370: write d3/d8/d15/d1a/d4a/d59/f60 [165857,114153] 0 2024-09-18T12:52:04.647 INFO:tasks.workunit.client.0.smithi045.stdout:4/154: rename c5 to db/d2c/c37 0 2024-09-18T12:52:04.648 INFO:tasks.workunit.client.1.smithi161.stdout:7/371: write d3/d8/d15/d38/f21 [3129928,28092] 0 2024-09-18T12:52:04.648 INFO:tasks.workunit.client.0.smithi045.stdout:4/155: fdatasync db/d10/d2f/f32 0 2024-09-18T12:52:04.649 INFO:tasks.workunit.client.1.smithi161.stdout:1/332: mkdir d1/da/d1f/d6b 0 2024-09-18T12:52:04.650 INFO:tasks.workunit.client.1.smithi161.stdout:7/372: read d3/d8/d15/f3c [86792,124862] 0 2024-09-18T12:52:04.650 INFO:tasks.workunit.client.1.smithi161.stdout:1/333: read f0 [3393310,7641] 0 2024-09-18T12:52:04.651 INFO:tasks.workunit.client.0.smithi045.stdout:9/129: rename d0/d3/d6/cb to d0/d3/d6/c2f 0 2024-09-18T12:52:04.651 INFO:tasks.workunit.client.1.smithi161.stdout:2/429: mkdir d0/d5/d43/d35/d98 0 2024-09-18T12:52:04.652 INFO:tasks.workunit.client.1.smithi161.stdout:2/430: write d0/d4/d52/d8b/f97 [101551,19458] 0 2024-09-18T12:52:04.653 INFO:tasks.workunit.client.0.smithi045.stdout:2/235: creat d5/d3a/d3e/f5d x:0 0 0 2024-09-18T12:52:04.653 INFO:tasks.workunit.client.1.smithi161.stdout:2/431: dread - d0/d1/d4c/d67/f6b zero size 2024-09-18T12:52:04.653 INFO:tasks.workunit.client.1.smithi161.stdout:9/359: truncate d0/db/d18/f36 68006 0 2024-09-18T12:52:04.655 INFO:tasks.workunit.client.0.smithi045.stdout:3/179: mkdir d0/d1e/d2c/d3f 0 2024-09-18T12:52:04.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/422: truncate d4/d1a/f14 2717989 0 2024-09-18T12:52:04.657 INFO:tasks.workunit.client.1.smithi161.stdout:4/439: creat d5/d14/d67/f90 x:0 0 0 2024-09-18T12:52:04.657 INFO:tasks.workunit.client.1.smithi161.stdout:3/436: creat d1/d2e/d14/d90/f95 x:0 0 0 2024-09-18T12:52:04.658 INFO:tasks.workunit.client.1.smithi161.stdout:6/423: fdatasync d4/d1a/d1c/d3e/f42 0 2024-09-18T12:52:04.658 INFO:tasks.workunit.client.1.smithi161.stdout:8/452: symlink d0/d3/d10/d21/d87/l9a 0 2024-09-18T12:52:04.660 INFO:tasks.workunit.client.1.smithi161.stdout:0/405: mknod df/d84/d86/c8e 0 2024-09-18T12:52:04.660 INFO:tasks.workunit.client.0.smithi045.stdout:4/156: dread db/d1b/f23 [0,4194304] 0 2024-09-18T12:52:04.661 INFO:tasks.workunit.client.0.smithi045.stdout:9/130: creat d0/d3/d6/d10/d2c/f30 x:0 0 0 2024-09-18T12:52:04.661 INFO:tasks.workunit.client.0.smithi045.stdout:3/180: dwrite d0/d22/f2e [0,4194304] 0 2024-09-18T12:52:04.666 INFO:tasks.workunit.client.1.smithi161.stdout:7/373: stat d3/c1b 0 2024-09-18T12:52:04.669 INFO:tasks.workunit.client.0.smithi045.stdout:9/131: dread d0/f2 [8388608,4194304] 0 2024-09-18T12:52:04.669 INFO:tasks.workunit.client.1.smithi161.stdout:2/432: rmdir d0/d1 39 2024-09-18T12:52:04.670 INFO:tasks.workunit.client.0.smithi045.stdout:4/157: symlink db/l38 0 2024-09-18T12:52:04.671 INFO:tasks.workunit.client.0.smithi045.stdout:4/158: fdatasync db/f30 0 2024-09-18T12:52:04.674 INFO:tasks.workunit.client.1.smithi161.stdout:5/363: symlink d3/d9/l75 0 2024-09-18T12:52:04.675 INFO:tasks.workunit.client.0.smithi045.stdout:9/132: creat d0/d3/f31 x:0 0 0 2024-09-18T12:52:04.676 INFO:tasks.workunit.client.1.smithi161.stdout:4/440: readlink d5/d27/d3a/d4c/l54 0 2024-09-18T12:52:04.680 INFO:tasks.workunit.client.0.smithi045.stdout:9/133: dread d0/d3/d6/fd [0,4194304] 0 2024-09-18T12:52:04.680 INFO:tasks.workunit.client.0.smithi045.stdout:4/159: symlink db/d1b/l39 0 2024-09-18T12:52:04.681 INFO:tasks.workunit.client.0.smithi045.stdout:9/134: write d0/f1a [1006446,61609] 0 2024-09-18T12:52:04.683 INFO:tasks.workunit.client.0.smithi045.stdout:9/135: write d0/d3/d6/d10/f1b [2587379,62714] 0 2024-09-18T12:52:04.684 INFO:tasks.workunit.client.0.smithi045.stdout:3/181: write d0/f1a [30640,45696] 0 2024-09-18T12:52:04.687 INFO:tasks.workunit.client.0.smithi045.stdout:3/182: truncate d0/d1e/f38 35731 0 2024-09-18T12:52:04.688 INFO:tasks.workunit.client.1.smithi161.stdout:1/334: mknod d1/d48/c6c 0 2024-09-18T12:52:04.689 INFO:tasks.workunit.client.0.smithi045.stdout:4/160: dwrite db/d10/d2f/f32 [4194304,4194304] 0 2024-09-18T12:52:04.689 INFO:tasks.workunit.client.0.smithi045.stdout:9/136: creat d0/d3/d6/d10/d26/d2e/f32 x:0 0 0 2024-09-18T12:52:04.692 INFO:tasks.workunit.client.0.smithi045.stdout:9/137: truncate d0/d3/d6/d10/d26/d2e/f32 521528 0 2024-09-18T12:52:04.693 INFO:tasks.workunit.client.0.smithi045.stdout:3/183: creat d0/d1e/f40 x:0 0 0 2024-09-18T12:52:04.695 INFO:tasks.workunit.client.1.smithi161.stdout:9/360: symlink d0/db/l7a 0 2024-09-18T12:52:04.697 INFO:tasks.workunit.client.0.smithi045.stdout:3/184: creat d0/f41 x:0 0 0 2024-09-18T12:52:04.697 INFO:tasks.workunit.client.1.smithi161.stdout:9/361: write d0/d16/d25/d28/f33 [1479502,58514] 0 2024-09-18T12:52:04.698 INFO:tasks.workunit.client.0.smithi045.stdout:4/161: mknod db/d2c/d35/c3a 0 2024-09-18T12:52:04.698 INFO:tasks.workunit.client.0.smithi045.stdout:4/162: readlink l1 0 2024-09-18T12:52:04.699 INFO:tasks.workunit.client.0.smithi045.stdout:3/185: rmdir d0/d1e/d39 39 2024-09-18T12:52:04.700 INFO:tasks.workunit.client.1.smithi161.stdout:3/437: dwrite d1/f8b [0,4194304] 0 2024-09-18T12:52:04.702 INFO:tasks.workunit.client.0.smithi045.stdout:9/138: link d0/d3/d6/d10/f1b d0/d3/d6/f33 0 2024-09-18T12:52:04.703 INFO:tasks.workunit.client.1.smithi161.stdout:8/453: creat d0/d3/d91/f9b x:0 0 0 2024-09-18T12:52:04.704 INFO:tasks.workunit.client.1.smithi161.stdout:5/364: dwrite d3/d14/d20/f2e [0,4194304] 0 2024-09-18T12:52:04.704 INFO:tasks.workunit.client.0.smithi045.stdout:4/163: rename db/d1b/f25 to db/d2c/d35/f3b 0 2024-09-18T12:52:04.707 INFO:tasks.workunit.client.0.smithi045.stdout:3/186: rmdir d0/d22 39 2024-09-18T12:52:04.708 INFO:tasks.workunit.client.0.smithi045.stdout:3/187: dread - d0/d1e/f40 zero size 2024-09-18T12:52:04.713 INFO:tasks.workunit.client.0.smithi045.stdout:3/188: creat d0/d1e/d2c/f42 x:0 0 0 2024-09-18T12:52:04.715 INFO:tasks.workunit.client.1.smithi161.stdout:1/335: creat d1/da/d1f/d45/f6d x:0 0 0 2024-09-18T12:52:04.717 INFO:tasks.workunit.client.1.smithi161.stdout:7/374: creat d3/d50/f66 x:0 0 0 2024-09-18T12:52:04.717 INFO:tasks.workunit.client.1.smithi161.stdout:6/424: write d4/d39/d26/d31/f59 [876710,43704] 0 2024-09-18T12:52:04.718 INFO:tasks.workunit.client.1.smithi161.stdout:7/375: chown d3/d8/d15/d1a/d24/l3e 46 1 2024-09-18T12:52:04.719 INFO:tasks.workunit.client.1.smithi161.stdout:2/433: unlink d0/d1/df/f40 0 2024-09-18T12:52:04.721 INFO:tasks.workunit.client.1.smithi161.stdout:2/434: write d0/d5/d43/d35/f7a [3569864,61914] 0 2024-09-18T12:52:04.725 INFO:tasks.workunit.client.1.smithi161.stdout:6/425: dwrite d4/d39/d26/d31/f53 [0,4194304] 0 2024-09-18T12:52:04.725 INFO:tasks.workunit.client.0.smithi045.stdout:3/189: link d0/f3e d0/d1e/d39/f43 0 2024-09-18T12:52:04.728 INFO:tasks.workunit.client.1.smithi161.stdout:3/438: creat d1/d2e/d68/d69/f96 x:0 0 0 2024-09-18T12:52:04.729 INFO:tasks.workunit.client.1.smithi161.stdout:8/454: dread d0/f9 [0,4194304] 0 2024-09-18T12:52:04.730 INFO:tasks.workunit.client.0.smithi045.stdout:3/190: write d0/d1e/d2c/d3a/f3c [2848799,12910] 0 2024-09-18T12:52:04.731 INFO:tasks.workunit.client.1.smithi161.stdout:2/435: dwrite d0/d5/d43/f45 [0,4194304] 0 2024-09-18T12:52:04.732 INFO:tasks.workunit.client.1.smithi161.stdout:8/455: write d0/d3/d10/f6c [154727,33032] 0 2024-09-18T12:52:04.732 INFO:tasks.workunit.client.0.smithi045.stdout:3/191: chown d0/f16 1452 1 2024-09-18T12:52:04.733 INFO:tasks.workunit.client.1.smithi161.stdout:2/436: write d0/d1/d4c/f55 [610888,1078] 0 2024-09-18T12:52:04.734 INFO:tasks.workunit.client.1.smithi161.stdout:5/365: fsync d3/d14/d20/d21/d46/f65 0 2024-09-18T12:52:04.736 INFO:tasks.workunit.client.0.smithi045.stdout:9/139: dwrite d0/d3/d6/f2d [0,4194304] 0 2024-09-18T12:52:04.737 INFO:tasks.workunit.client.1.smithi161.stdout:3/439: dread d1/d2e/d24/f45 [0,4194304] 0 2024-09-18T12:52:04.737 INFO:tasks.workunit.client.0.smithi045.stdout:9/140: dread - d0/d3/d6/d10/d2c/f30 zero size 2024-09-18T12:52:04.738 INFO:tasks.workunit.client.1.smithi161.stdout:0/406: link df/d29/d46/d51/c58 df/d84/d89/c8f 0 2024-09-18T12:52:04.740 INFO:tasks.workunit.client.1.smithi161.stdout:4/441: truncate d5/d27/d3a/f80 102441 0 2024-09-18T12:52:04.745 INFO:tasks.workunit.client.0.smithi045.stdout:9/141: fsync d0/d3/d6/d10/f1b 0 2024-09-18T12:52:04.745 INFO:tasks.workunit.client.1.smithi161.stdout:9/362: dread d0/f3 [0,4194304] 0 2024-09-18T12:52:04.748 INFO:tasks.workunit.client.1.smithi161.stdout:4/442: dwrite d5/d32/d39/d4d/f78 [0,4194304] 0 2024-09-18T12:52:04.749 INFO:tasks.workunit.client.0.smithi045.stdout:9/142: rmdir d0/d3 39 2024-09-18T12:52:04.756 INFO:tasks.workunit.client.0.smithi045.stdout:9/143: stat d0/d3/fe 0 2024-09-18T12:52:04.759 INFO:tasks.workunit.client.1.smithi161.stdout:8/456: fdatasync d0/f5a 0 2024-09-18T12:52:04.761 INFO:tasks.workunit.client.1.smithi161.stdout:5/366: symlink d3/d8/l76 0 2024-09-18T12:52:04.762 INFO:tasks.workunit.client.1.smithi161.stdout:0/407: dread df/f2b [0,4194304] 0 2024-09-18T12:52:04.763 INFO:tasks.workunit.client.1.smithi161.stdout:3/440: mknod d1/d2e/d14/c97 0 2024-09-18T12:52:04.763 INFO:tasks.workunit.client.1.smithi161.stdout:5/367: dread - d3/d14/d20/d21/d24/d61/f6b zero size 2024-09-18T12:52:04.765 INFO:tasks.workunit.client.1.smithi161.stdout:2/437: dread d0/d1/f3 [0,4194304] 0 2024-09-18T12:52:04.766 INFO:tasks.workunit.client.1.smithi161.stdout:1/336: mknod d1/da/d1f/d6b/c6e 0 2024-09-18T12:52:04.767 INFO:tasks.workunit.client.1.smithi161.stdout:2/438: dread - d0/d1/d4c/d67/f6b zero size 2024-09-18T12:52:04.767 INFO:tasks.workunit.client.0.smithi045.stdout:3/192: dwrite d0/f1f [0,4194304] 0 2024-09-18T12:52:04.768 INFO:tasks.workunit.client.1.smithi161.stdout:1/337: dread - d1/da/d1f/d45/f6d zero size 2024-09-18T12:52:04.769 INFO:tasks.workunit.client.1.smithi161.stdout:2/439: readlink d0/d1/d3b/d7e/l77 0 2024-09-18T12:52:04.769 INFO:tasks.workunit.client.0.smithi045.stdout:9/144: getdents d0 0 2024-09-18T12:52:04.771 INFO:tasks.workunit.client.0.smithi045.stdout:9/145: chown d0/d3/d6/d10/l1e 48795937 1 2024-09-18T12:52:04.772 INFO:tasks.workunit.client.1.smithi161.stdout:7/376: symlink d3/d8/d15/d1a/d4a/d64/l67 0 2024-09-18T12:52:04.773 INFO:tasks.workunit.client.1.smithi161.stdout:3/441: dwrite d1/d2e/d24/d1d/f64 [0,4194304] 0 2024-09-18T12:52:04.773 INFO:tasks.workunit.client.0.smithi045.stdout:9/146: chown d0/d3/l27 3 1 2024-09-18T12:52:04.776 INFO:tasks.workunit.client.0.smithi045.stdout:3/193: mkdir d0/d1e/d2c/d3f/d44 0 2024-09-18T12:52:04.776 INFO:tasks.workunit.client.1.smithi161.stdout:4/443: creat d5/f91 x:0 0 0 2024-09-18T12:52:04.776 INFO:tasks.workunit.client.0.smithi045.stdout:3/194: read d0/f1a [2907328,104781] 0 2024-09-18T12:52:04.778 INFO:tasks.workunit.client.0.smithi045.stdout:9/147: symlink d0/d3/d6/d10/l34 0 2024-09-18T12:52:04.779 INFO:tasks.workunit.client.1.smithi161.stdout:6/426: truncate d4/fa 3729798 0 2024-09-18T12:52:04.780 INFO:tasks.workunit.client.1.smithi161.stdout:8/457: dread d0/d3/d10/d21/d4a/d52/d82/d96/d98/f25 [0,4194304] 0 2024-09-18T12:52:04.781 INFO:tasks.workunit.client.1.smithi161.stdout:1/338: dwrite d1/fc [4194304,4194304] 0 2024-09-18T12:52:04.782 INFO:tasks.workunit.client.0.smithi045.stdout:3/195: mkdir d0/d1e/d2c/d3a/d45 0 2024-09-18T12:52:04.782 INFO:tasks.workunit.client.1.smithi161.stdout:8/458: write d0/d3/d1e/f46 [2144174,42416] 0 2024-09-18T12:52:04.783 INFO:tasks.workunit.client.0.smithi045.stdout:9/148: dread d0/d3/d6/f2d [0,4194304] 0 2024-09-18T12:52:04.785 INFO:tasks.workunit.client.0.smithi045.stdout:9/149: chown d0/d3/d6/d10/d26/d2e/l25 6379 1 2024-09-18T12:52:04.788 INFO:tasks.workunit.client.0.smithi045.stdout:3/196: mknod d0/d29/c46 0 2024-09-18T12:52:04.789 INFO:tasks.workunit.client.1.smithi161.stdout:6/427: dread d4/d39/d3a/f3f [0,4194304] 0 2024-09-18T12:52:04.789 INFO:tasks.workunit.client.1.smithi161.stdout:5/368: creat d3/d8/f77 x:0 0 0 2024-09-18T12:52:04.790 INFO:tasks.workunit.client.1.smithi161.stdout:5/369: fsync d3/d9/d4b/f51 0 2024-09-18T12:52:04.793 INFO:tasks.workunit.client.1.smithi161.stdout:9/363: unlink d0/d20/d49/f63 0 2024-09-18T12:52:04.794 INFO:tasks.workunit.client.0.smithi045.stdout:9/150: dwrite d0/d3/f2b [0,4194304] 0 2024-09-18T12:52:04.798 INFO:tasks.workunit.client.0.smithi045.stdout:3/197: rename d0/d1e/f40 to d0/d1e/d2c/d3a/f47 0 2024-09-18T12:52:04.800 INFO:tasks.workunit.client.1.smithi161.stdout:0/408: dread df/f15 [0,4194304] 0 2024-09-18T12:52:04.801 INFO:tasks.workunit.client.1.smithi161.stdout:0/409: write df/f22 [713544,1850] 0 2024-09-18T12:52:04.802 INFO:tasks.workunit.client.1.smithi161.stdout:3/442: mknod d1/d2e/d14/d65/d7a/c98 0 2024-09-18T12:52:04.803 INFO:tasks.workunit.client.1.smithi161.stdout:3/443: chown d1/d2e/d3d/f80 6329031 1 2024-09-18T12:52:04.807 INFO:tasks.workunit.client.0.smithi045.stdout:3/198: creat d0/f48 x:0 0 0 2024-09-18T12:52:04.808 INFO:tasks.workunit.client.1.smithi161.stdout:6/428: unlink d4/d39/d3a/f3c 0 2024-09-18T12:52:04.809 INFO:tasks.workunit.client.1.smithi161.stdout:6/429: write d4/d1a/f11 [3992190,84253] 0 2024-09-18T12:52:04.809 INFO:tasks.workunit.client.1.smithi161.stdout:8/459: dread d0/d3/d10/d21/d4a/d52/d82/d96/d98/f39 [0,4194304] 0 2024-09-18T12:52:04.809 INFO:tasks.workunit.client.0.smithi045.stdout:6/183: sync 2024-09-18T12:52:04.811 INFO:tasks.workunit.client.1.smithi161.stdout:9/364: fdatasync d0/d47/f4c 0 2024-09-18T12:52:04.813 INFO:tasks.workunit.client.0.smithi045.stdout:3/199: dread d0/d22/f2e [0,4194304] 0 2024-09-18T12:52:04.813 INFO:tasks.workunit.client.0.smithi045.stdout:3/200: chown d0/f1f 14811716 1 2024-09-18T12:52:04.814 INFO:tasks.workunit.client.0.smithi045.stdout:3/201: write d0/f48 [240564,75453] 0 2024-09-18T12:52:04.815 INFO:tasks.workunit.client.1.smithi161.stdout:6/430: dwrite d4/d39/d26/d31/f5b [0,4194304] 0 2024-09-18T12:52:04.815 INFO:tasks.workunit.client.1.smithi161.stdout:4/444: symlink d5/d14/d6d/l92 0 2024-09-18T12:52:04.817 INFO:tasks.workunit.client.1.smithi161.stdout:4/445: write d5/d32/f42 [5108216,103000] 0 2024-09-18T12:52:04.819 INFO:tasks.workunit.client.1.smithi161.stdout:0/410: rename df/d29/d2d to df/d29/d46/d90 0 2024-09-18T12:52:04.819 INFO:tasks.workunit.client.0.smithi045.stdout:9/151: write d0/d3/f1f [262247,78708] 0 2024-09-18T12:52:04.820 INFO:tasks.workunit.client.1.smithi161.stdout:8/460: rename d0 to d0/d3/d10/d9c 22 2024-09-18T12:52:04.822 INFO:tasks.workunit.client.0.smithi045.stdout:6/184: link d9/f18 d9/d1a/d2d/f3b 0 2024-09-18T12:52:04.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/411: write df/f32 [10881958,130687] 0 2024-09-18T12:52:04.822 INFO:tasks.workunit.client.1.smithi161.stdout:3/444: creat d1/d2e/d68/d69/f99 x:0 0 0 2024-09-18T12:52:04.825 INFO:tasks.workunit.client.1.smithi161.stdout:6/431: dwrite d4/ff [4194304,4194304] 0 2024-09-18T12:52:04.826 INFO:tasks.workunit.client.0.smithi045.stdout:6/185: chown c4 186 1 2024-09-18T12:52:04.826 INFO:tasks.workunit.client.1.smithi161.stdout:8/461: chown d0/d3/d10/d21/d4a/d52/d82/d96/f60 64 1 2024-09-18T12:52:04.827 INFO:tasks.workunit.client.1.smithi161.stdout:4/446: dwrite d5/d14/d67/f7e [0,4194304] 0 2024-09-18T12:52:04.829 INFO:tasks.workunit.client.0.smithi045.stdout:9/152: dwrite d0/f9 [0,4194304] 0 2024-09-18T12:52:04.832 INFO:tasks.workunit.client.1.smithi161.stdout:9/365: truncate d0/d16/f62 1272717 0 2024-09-18T12:52:04.836 INFO:tasks.workunit.client.1.smithi161.stdout:3/445: dwrite d1/d2e/d24/f47 [0,4194304] 0 2024-09-18T12:52:04.838 INFO:tasks.workunit.client.1.smithi161.stdout:8/462: dread d0/d3/d10/d21/f30 [0,4194304] 0 2024-09-18T12:52:04.840 INFO:tasks.workunit.client.1.smithi161.stdout:6/432: read d4/d39/d26/f55 [3922382,21704] 0 2024-09-18T12:52:04.843 INFO:tasks.workunit.client.0.smithi045.stdout:3/202: dwrite d0/d1e/d39/f43 [0,4194304] 0 2024-09-18T12:52:04.846 INFO:tasks.workunit.client.1.smithi161.stdout:1/339: rmdir d1/da/d1f/d45/d5c 0 2024-09-18T12:52:04.849 INFO:tasks.workunit.client.1.smithi161.stdout:0/412: rename df/f28 to df/d84/d89/f91 0 2024-09-18T12:52:04.849 INFO:tasks.workunit.client.0.smithi045.stdout:6/186: write d9/f19 [436212,5015] 0 2024-09-18T12:52:04.850 INFO:tasks.workunit.client.1.smithi161.stdout:5/370: link d3/d9/l75 d3/d3b/d54/l78 0 2024-09-18T12:52:04.850 INFO:tasks.workunit.client.0.smithi045.stdout:6/187: write d9/f13 [2349376,119070] 0 2024-09-18T12:52:04.853 INFO:tasks.workunit.client.1.smithi161.stdout:2/440: getdents d0/d5/d43 0 2024-09-18T12:52:04.853 INFO:tasks.workunit.client.0.smithi045.stdout:3/203: creat d0/d1e/d2c/d3a/d45/f49 x:0 0 0 2024-09-18T12:52:04.853 INFO:tasks.workunit.client.0.smithi045.stdout:9/153: truncate d0/d3/fe 34889 0 2024-09-18T12:52:04.854 INFO:tasks.workunit.client.1.smithi161.stdout:5/371: write d3/d14/d20/f74 [165487,115615] 0 2024-09-18T12:52:04.859 INFO:tasks.workunit.client.1.smithi161.stdout:1/340: dwrite d1/d26/f50 [0,4194304] 0 2024-09-18T12:52:04.860 INFO:tasks.workunit.client.1.smithi161.stdout:6/433: mkdir d4/d1a/d1c/d3e/d83 0 2024-09-18T12:52:04.861 INFO:tasks.workunit.client.1.smithi161.stdout:8/463: symlink d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/l9d 0 2024-09-18T12:52:04.861 INFO:tasks.workunit.client.1.smithi161.stdout:1/341: chown d1/d26/f3f 210204 1 2024-09-18T12:52:04.864 INFO:tasks.workunit.client.1.smithi161.stdout:0/413: dread df/d30/f3f [0,4194304] 0 2024-09-18T12:52:04.865 INFO:tasks.workunit.client.1.smithi161.stdout:1/342: write d1/da/d1f/f51 [794401,111614] 0 2024-09-18T12:52:04.866 INFO:tasks.workunit.client.1.smithi161.stdout:6/434: fsync d4/d39/d26/d20/d28/f35 0 2024-09-18T12:52:04.868 INFO:tasks.workunit.client.1.smithi161.stdout:5/372: dwrite d3/d8/f77 [0,4194304] 0 2024-09-18T12:52:04.871 INFO:tasks.workunit.client.1.smithi161.stdout:0/414: write df/d29/d46/d90/d37/f42 [505034,30336] 0 2024-09-18T12:52:04.871 INFO:tasks.workunit.client.1.smithi161.stdout:5/373: write d3/f40 [1708163,71703] 0 2024-09-18T12:52:04.873 INFO:tasks.workunit.client.1.smithi161.stdout:1/343: symlink d1/da/d1f/d45/l6f 0 2024-09-18T12:52:04.873 INFO:tasks.workunit.client.1.smithi161.stdout:8/464: link d0/l76 d0/d3/d10/d21/d4a/d52/d82/d96/l9e 0 2024-09-18T12:52:04.874 INFO:tasks.workunit.client.1.smithi161.stdout:5/374: write d3/d8/f73 [56445,90060] 0 2024-09-18T12:52:04.875 INFO:tasks.workunit.client.1.smithi161.stdout:4/447: dread d5/d27/f66 [0,4194304] 0 2024-09-18T12:52:04.875 INFO:tasks.workunit.client.1.smithi161.stdout:8/465: write d0/f2a [3348875,4908] 0 2024-09-18T12:52:04.876 INFO:tasks.workunit.client.1.smithi161.stdout:4/448: chown d5/d27/l5c 4063 1 2024-09-18T12:52:04.877 INFO:tasks.workunit.client.1.smithi161.stdout:0/415: mkdir df/d30/d4d/d92 0 2024-09-18T12:52:04.881 INFO:tasks.workunit.client.1.smithi161.stdout:3/446: dread d1/d2e/d14/d2c/f31 [0,4194304] 0 2024-09-18T12:52:04.881 INFO:tasks.workunit.client.1.smithi161.stdout:8/466: symlink d0/d3/d10/d21/d4a/d52/d94/l9f 0 2024-09-18T12:52:04.882 INFO:tasks.workunit.client.1.smithi161.stdout:4/449: mknod d5/d14/d67/d84/d6e/c93 0 2024-09-18T12:52:04.883 INFO:tasks.workunit.client.1.smithi161.stdout:8/467: write d0/d3/f81 [81218,74215] 0 2024-09-18T12:52:04.889 INFO:tasks.workunit.client.1.smithi161.stdout:8/468: write d0/f12 [4624494,23521] 0 2024-09-18T12:52:04.889 INFO:tasks.workunit.client.1.smithi161.stdout:5/375: dwrite d3/d14/f4e [0,4194304] 0 2024-09-18T12:52:04.891 INFO:tasks.workunit.client.1.smithi161.stdout:0/416: dwrite df/d30/d4d/f7b [0,4194304] 0 2024-09-18T12:52:04.896 INFO:tasks.workunit.client.1.smithi161.stdout:0/417: symlink df/d29/d46/d90/d37/d55/l93 0 2024-09-18T12:52:04.897 INFO:tasks.workunit.client.1.smithi161.stdout:5/376: dread d3/d8/f77 [0,4194304] 0 2024-09-18T12:52:04.898 INFO:tasks.workunit.client.0.smithi045.stdout:6/188: dread d9/f19 [0,4194304] 0 2024-09-18T12:52:04.898 INFO:tasks.workunit.client.0.smithi045.stdout:6/189: dread - d9/ff zero size 2024-09-18T12:52:04.899 INFO:tasks.workunit.client.1.smithi161.stdout:5/377: mknod d3/d14/d20/d21/d46/c79 0 2024-09-18T12:52:04.900 INFO:tasks.workunit.client.0.smithi045.stdout:6/190: fsync d9/f12 0 2024-09-18T12:52:04.903 INFO:tasks.workunit.client.1.smithi161.stdout:0/418: getdents df/d29/d46/d51 0 2024-09-18T12:52:04.904 INFO:tasks.workunit.client.1.smithi161.stdout:0/419: chown df/d29/d46/d51/c7d 4 1 2024-09-18T12:52:04.904 INFO:tasks.workunit.client.0.smithi045.stdout:6/191: fdatasync d9/d1a/d2d/f3b 0 2024-09-18T12:52:04.906 INFO:tasks.workunit.client.1.smithi161.stdout:0/420: mkdir df/d29/d36/d94 0 2024-09-18T12:52:04.909 INFO:tasks.workunit.client.0.smithi045.stdout:6/192: mknod d9/d1a/d2d/d38/c3c 0 2024-09-18T12:52:04.910 INFO:tasks.workunit.client.1.smithi161.stdout:0/421: mkdir df/d30/d4d/d92/d95 0 2024-09-18T12:52:04.910 INFO:tasks.workunit.client.1.smithi161.stdout:7/377: sync 2024-09-18T12:52:04.912 INFO:tasks.workunit.client.0.smithi045.stdout:6/193: creat d9/d1a/d2d/d38/f3d x:0 0 0 2024-09-18T12:52:04.912 INFO:tasks.workunit.client.1.smithi161.stdout:5/378: getdents d3 0 2024-09-18T12:52:04.915 INFO:tasks.workunit.client.1.smithi161.stdout:7/378: creat d3/d8/d15/d1a/d24/d31/f68 x:0 0 0 2024-09-18T12:52:04.916 INFO:tasks.workunit.client.0.smithi045.stdout:6/194: creat d9/d30/f3e x:0 0 0 2024-09-18T12:52:04.917 INFO:tasks.workunit.client.1.smithi161.stdout:5/379: mknod d3/d3b/d54/c7a 0 2024-09-18T12:52:04.919 INFO:tasks.workunit.client.1.smithi161.stdout:7/379: rename d3/d8/d15/f33 to d3/d8/d15/d1a/d4a/d59/f69 0 2024-09-18T12:52:04.920 INFO:tasks.workunit.client.1.smithi161.stdout:7/380: write d3/d8/d15/f3b [4561081,116293] 0 2024-09-18T12:52:04.922 INFO:tasks.workunit.client.1.smithi161.stdout:5/380: rename d3/d14/d4c to d3/d3b/d7b 0 2024-09-18T12:52:04.924 INFO:tasks.workunit.client.1.smithi161.stdout:5/381: write d3/d8/f59 [51391,125610] 0 2024-09-18T12:52:04.927 INFO:tasks.workunit.client.1.smithi161.stdout:7/381: dwrite d3/d8/d4f/f61 [4194304,4194304] 0 2024-09-18T12:52:04.930 INFO:tasks.workunit.client.1.smithi161.stdout:7/382: dread - d3/d8/d15/d1a/d24/f4c zero size 2024-09-18T12:52:04.931 INFO:tasks.workunit.client.1.smithi161.stdout:5/382: dwrite d3/d14/d20/f3e [0,4194304] 0 2024-09-18T12:52:04.932 INFO:tasks.workunit.client.1.smithi161.stdout:5/383: write d3/d9/f34 [3512725,40379] 0 2024-09-18T12:52:04.939 INFO:tasks.workunit.client.1.smithi161.stdout:9/366: dread d0/db/d18/f36 [0,4194304] 0 2024-09-18T12:52:04.942 INFO:tasks.workunit.client.1.smithi161.stdout:5/384: dwrite d3/d9/d4b/f51 [4194304,4194304] 0 2024-09-18T12:52:04.944 INFO:tasks.workunit.client.1.smithi161.stdout:5/385: fsync d3/d9/f41 0 2024-09-18T12:52:04.944 INFO:tasks.workunit.client.1.smithi161.stdout:6/435: sync 2024-09-18T12:52:04.957 INFO:tasks.workunit.client.1.smithi161.stdout:9/367: creat d0/d16/d25/d28/f7b x:0 0 0 2024-09-18T12:52:04.959 INFO:tasks.workunit.client.1.smithi161.stdout:2/441: write d0/d5/d43/f37 [556491,117029] 0 2024-09-18T12:52:04.960 INFO:tasks.workunit.client.1.smithi161.stdout:6/436: getdents d4/d39/d26/d20/d28 0 2024-09-18T12:52:04.961 INFO:tasks.workunit.client.1.smithi161.stdout:2/442: dread - d0/d1/f5e zero size 2024-09-18T12:52:04.962 INFO:tasks.workunit.client.1.smithi161.stdout:8/469: getdents d0/d3/d10/d21/d4a/d52/d82/d96 0 2024-09-18T12:52:04.964 INFO:tasks.workunit.client.1.smithi161.stdout:1/344: write d1/d26/f2f [73819,119663] 0 2024-09-18T12:52:04.966 INFO:tasks.workunit.client.1.smithi161.stdout:9/368: dwrite d0/f42 [0,4194304] 0 2024-09-18T12:52:04.966 INFO:tasks.workunit.client.1.smithi161.stdout:6/437: truncate d4/d39/d26/f55 1493312 0 2024-09-18T12:52:04.969 INFO:tasks.workunit.client.1.smithi161.stdout:3/447: truncate d1/d2e/f4b 4689511 0 2024-09-18T12:52:04.972 INFO:tasks.workunit.client.1.smithi161.stdout:6/438: dread d4/d1a/d1c/d3e/d4d/f78 [0,4194304] 0 2024-09-18T12:52:04.973 INFO:tasks.workunit.client.1.smithi161.stdout:9/369: creat d0/d16/d25/d46/d53/f7c x:0 0 0 2024-09-18T12:52:04.974 INFO:tasks.workunit.client.1.smithi161.stdout:0/422: write df/d29/f2c [4248424,112620] 0 2024-09-18T12:52:04.974 INFO:tasks.workunit.client.1.smithi161.stdout:3/448: readlink d1/d2e/d14/l82 0 2024-09-18T12:52:04.974 INFO:tasks.workunit.client.1.smithi161.stdout:6/439: readlink d4/d1a/l12 0 2024-09-18T12:52:04.976 INFO:tasks.workunit.client.1.smithi161.stdout:5/386: rmdir d3/d3b/d7b 39 2024-09-18T12:52:04.977 INFO:tasks.workunit.client.1.smithi161.stdout:4/450: dwrite d5/d32/d39/f4e [4194304,4194304] 0 2024-09-18T12:52:04.978 INFO:tasks.workunit.client.1.smithi161.stdout:7/383: write d3/d8/d15/f3c [1070539,69506] 0 2024-09-18T12:52:04.979 INFO:tasks.workunit.client.1.smithi161.stdout:5/387: write d3/fd [775834,89191] 0 2024-09-18T12:52:04.983 INFO:tasks.workunit.client.1.smithi161.stdout:3/449: mkdir d1/d2e/d24/d84/d9a 0 2024-09-18T12:52:04.984 INFO:tasks.workunit.client.1.smithi161.stdout:4/451: symlink d5/d14/d6d/l94 0 2024-09-18T12:52:04.986 INFO:tasks.workunit.client.1.smithi161.stdout:5/388: read d3/d8/f59 [77209,62077] 0 2024-09-18T12:52:04.987 INFO:tasks.workunit.client.1.smithi161.stdout:8/470: write d0/d3/d10/f22 [4558293,62832] 0 2024-09-18T12:52:04.990 INFO:tasks.workunit.client.1.smithi161.stdout:2/443: dread d0/f24 [0,4194304] 0 2024-09-18T12:52:04.994 INFO:tasks.workunit.client.1.smithi161.stdout:9/370: dwrite d0/d16/f62 [0,4194304] 0 2024-09-18T12:52:04.997 INFO:tasks.workunit.client.1.smithi161.stdout:5/389: symlink d3/d14/d20/d21/d24/d61/l7c 0 2024-09-18T12:52:04.998 INFO:tasks.workunit.client.1.smithi161.stdout:2/444: read d0/d1/d3b/f83 [620136,7550] 0 2024-09-18T12:52:05.000 INFO:tasks.workunit.client.1.smithi161.stdout:3/450: unlink d1/d2e/f4b 0 2024-09-18T12:52:05.001 INFO:tasks.workunit.client.1.smithi161.stdout:0/423: dwrite df/d29/d46/d90/f6e [0,4194304] 0 2024-09-18T12:52:05.002 INFO:tasks.workunit.client.1.smithi161.stdout:9/371: mknod d0/d47/c7d 0 2024-09-18T12:52:05.004 INFO:tasks.workunit.client.1.smithi161.stdout:9/372: chown d0/d20 55 1 2024-09-18T12:52:05.006 INFO:tasks.workunit.client.1.smithi161.stdout:5/390: creat d3/d14/d20/d21/d24/f7d x:0 0 0 2024-09-18T12:52:05.007 INFO:tasks.workunit.client.1.smithi161.stdout:7/384: dwrite d3/d8/d15/d1a/d24/f4c [0,4194304] 0 2024-09-18T12:52:05.008 INFO:tasks.workunit.client.1.smithi161.stdout:2/445: creat d0/d1/d3b/d3d/f99 x:0 0 0 2024-09-18T12:52:05.009 INFO:tasks.workunit.client.1.smithi161.stdout:0/424: mkdir df/d30/d71/d96 0 2024-09-18T12:52:05.009 INFO:tasks.workunit.client.1.smithi161.stdout:9/373: truncate d0/db/f50 519848 0 2024-09-18T12:52:05.010 INFO:tasks.workunit.client.1.smithi161.stdout:5/391: creat d3/f7e x:0 0 0 2024-09-18T12:52:05.012 INFO:tasks.workunit.client.1.smithi161.stdout:2/446: fsync d0/d4/f2a 0 2024-09-18T12:52:05.012 INFO:tasks.workunit.client.1.smithi161.stdout:7/385: rmdir d3/d8/d15/d38 39 2024-09-18T12:52:05.012 INFO:tasks.workunit.client.1.smithi161.stdout:9/374: fdatasync d0/d16/d25/d46/d53/f56 0 2024-09-18T12:52:05.013 INFO:tasks.workunit.client.1.smithi161.stdout:3/451: dread d1/d2e/d14/d65/f79 [0,4194304] 0 2024-09-18T12:52:05.019 INFO:tasks.workunit.client.1.smithi161.stdout:9/375: chown d0/d16/d25/d46/d53/d59/l5b 121710 1 2024-09-18T12:52:05.019 INFO:tasks.workunit.client.1.smithi161.stdout:3/452: write d1/d2e/d3d/f7 [2210046,53318] 0 2024-09-18T12:52:05.019 INFO:tasks.workunit.client.1.smithi161.stdout:7/386: symlink d3/d8/d15/d1a/d24/l6a 0 2024-09-18T12:52:05.023 INFO:tasks.workunit.client.1.smithi161.stdout:4/452: dread d5/f8 [0,4194304] 0 2024-09-18T12:52:05.024 INFO:tasks.workunit.client.1.smithi161.stdout:2/447: dwrite d0/d1/f7 [4194304,4194304] 0 2024-09-18T12:52:05.026 INFO:tasks.workunit.client.1.smithi161.stdout:2/448: write d0/f7b [923748,128849] 0 2024-09-18T12:52:05.029 INFO:tasks.workunit.client.1.smithi161.stdout:4/453: mkdir d5/d27/d3a/d60/d95 0 2024-09-18T12:52:05.030 INFO:tasks.workunit.client.1.smithi161.stdout:8/471: dread d0/d3/d10/d21/d4a/d52/d82/d96/d98/f64 [0,4194304] 0 2024-09-18T12:52:05.032 INFO:tasks.workunit.client.1.smithi161.stdout:4/454: write d5/d27/d3a/d47/f62 [54051,57450] 0 2024-09-18T12:52:05.032 INFO:tasks.workunit.client.1.smithi161.stdout:7/387: getdents d3/d8/d15/d1a/d4a 0 2024-09-18T12:52:05.033 INFO:tasks.workunit.client.1.smithi161.stdout:5/392: truncate d3/d14/f4e 2854437 0 2024-09-18T12:52:05.035 INFO:tasks.workunit.client.1.smithi161.stdout:4/455: chown d5/d27/d3a/l3e 4052808 1 2024-09-18T12:52:05.035 INFO:tasks.workunit.client.1.smithi161.stdout:5/393: stat d3/d3b/d54/c7a 0 2024-09-18T12:52:05.035 INFO:tasks.workunit.client.1.smithi161.stdout:2/449: creat d0/f9a x:0 0 0 2024-09-18T12:52:05.037 INFO:tasks.workunit.client.1.smithi161.stdout:7/388: creat d3/f6b x:0 0 0 2024-09-18T12:52:05.038 INFO:tasks.workunit.client.1.smithi161.stdout:8/472: creat d0/d3/d10/d21/d4a/d52/d66/d5b/fa0 x:0 0 0 2024-09-18T12:52:05.040 INFO:tasks.workunit.client.1.smithi161.stdout:4/456: rename d5/d14/f29 to d5/d32/d39/d4d/f96 0 2024-09-18T12:52:05.042 INFO:tasks.workunit.client.1.smithi161.stdout:2/450: mkdir d0/d1/d3b/d3d/d4f/d9b 0 2024-09-18T12:52:05.043 INFO:tasks.workunit.client.1.smithi161.stdout:3/453: dwrite d1/d2e/d3d/f80 [0,4194304] 0 2024-09-18T12:52:05.046 INFO:tasks.workunit.client.1.smithi161.stdout:0/425: dread df/d29/d46/d90/d37/f48 [0,4194304] 0 2024-09-18T12:52:05.048 INFO:tasks.workunit.client.1.smithi161.stdout:0/426: dread - df/d30/d4d/f76 zero size 2024-09-18T12:52:05.048 INFO:tasks.workunit.client.1.smithi161.stdout:4/457: symlink d5/d27/d44/l97 0 2024-09-18T12:52:05.049 INFO:tasks.workunit.client.1.smithi161.stdout:5/394: dread d3/d14/d20/d21/d46/f65 [0,4194304] 0 2024-09-18T12:52:05.050 INFO:tasks.workunit.client.1.smithi161.stdout:7/389: creat d3/d8/d15/d38/d55/f6c x:0 0 0 2024-09-18T12:52:05.051 INFO:tasks.workunit.client.1.smithi161.stdout:7/390: write d3/f7 [6184238,4034] 0 2024-09-18T12:52:05.053 INFO:tasks.workunit.client.1.smithi161.stdout:7/391: write d3/d50/f66 [878285,90462] 0 2024-09-18T12:52:05.053 INFO:tasks.workunit.client.1.smithi161.stdout:2/451: unlink d0/d1/d3b/d7e/l82 0 2024-09-18T12:52:05.056 INFO:tasks.workunit.client.1.smithi161.stdout:0/427: symlink df/d84/l97 0 2024-09-18T12:52:05.058 INFO:tasks.workunit.client.1.smithi161.stdout:4/458: unlink d5/d27/d3a/l70 0 2024-09-18T12:52:05.059 INFO:tasks.workunit.client.1.smithi161.stdout:5/395: symlink d3/l7f 0 2024-09-18T12:52:05.059 INFO:tasks.workunit.client.1.smithi161.stdout:7/392: dwrite d3/d8/d15/d1a/d24/f51 [0,4194304] 0 2024-09-18T12:52:05.061 INFO:tasks.workunit.client.1.smithi161.stdout:2/452: creat d0/d4/d78/f9c x:0 0 0 2024-09-18T12:52:05.061 INFO:tasks.workunit.client.1.smithi161.stdout:2/453: stat d0/d1/d3b/d93 0 2024-09-18T12:52:05.062 INFO:tasks.workunit.client.1.smithi161.stdout:2/454: fsync d0/f75 0 2024-09-18T12:52:05.063 INFO:tasks.workunit.client.1.smithi161.stdout:8/473: rename d0/d3/l75 to d0/d3/d10/d21/la1 0 2024-09-18T12:52:05.064 INFO:tasks.workunit.client.1.smithi161.stdout:4/459: rmdir d5/d32 39 2024-09-18T12:52:05.065 INFO:tasks.workunit.client.1.smithi161.stdout:8/474: truncate d0/d3/d10/d21/d4a/d52/d82/d96/d98/f25 4534538 0 2024-09-18T12:52:05.065 INFO:tasks.workunit.client.1.smithi161.stdout:4/460: chown d5/d27/l5c 81413768 1 2024-09-18T12:52:05.065 INFO:tasks.workunit.client.1.smithi161.stdout:4/461: read d5/f8 [2018952,17292] 0 2024-09-18T12:52:05.066 INFO:tasks.workunit.client.1.smithi161.stdout:8/475: write d0/d3/d10/d21/d4a/d52/f95 [873051,3309] 0 2024-09-18T12:52:05.069 INFO:tasks.workunit.client.1.smithi161.stdout:2/455: write d0/d1/df/f34 [1936110,74761] 0 2024-09-18T12:52:05.070 INFO:tasks.workunit.client.1.smithi161.stdout:0/428: mkdir df/d98 0 2024-09-18T12:52:05.074 INFO:tasks.workunit.client.1.smithi161.stdout:7/393: dwrite d3/f2e [0,4194304] 0 2024-09-18T12:52:05.074 INFO:tasks.workunit.client.1.smithi161.stdout:3/454: getdents d1/d2e/d14 0 2024-09-18T12:52:05.075 INFO:tasks.workunit.client.1.smithi161.stdout:2/456: rmdir d0/d1/d3b/d3d 39 2024-09-18T12:52:05.077 INFO:tasks.workunit.client.1.smithi161.stdout:8/476: mknod d0/d3/d10/d21/ca2 0 2024-09-18T12:52:05.078 INFO:tasks.workunit.client.1.smithi161.stdout:8/477: chown d0/d3/d10/d21/d4a/l54 79744414 1 2024-09-18T12:52:05.079 INFO:tasks.workunit.client.1.smithi161.stdout:4/462: symlink d5/d27/d3a/d60/d8a/l98 0 2024-09-18T12:52:05.083 INFO:tasks.workunit.client.1.smithi161.stdout:7/394: rename d3/f14 to d3/f6d 0 2024-09-18T12:52:05.085 INFO:tasks.workunit.client.1.smithi161.stdout:2/457: mkdir d0/d4/d9d 0 2024-09-18T12:52:05.086 INFO:tasks.workunit.client.1.smithi161.stdout:2/458: truncate d0/d1/f3f 4200050 0 2024-09-18T12:52:05.088 INFO:tasks.workunit.client.1.smithi161.stdout:7/395: dread d3/d8/d15/d1a/d24/f4c [0,4194304] 0 2024-09-18T12:52:05.089 INFO:tasks.workunit.client.1.smithi161.stdout:4/463: rename d5/d14/d67/f7e to d5/d27/d3a/d47/f99 0 2024-09-18T12:52:05.090 INFO:tasks.workunit.client.0.smithi045.stdout:8/156: sync 2024-09-18T12:52:05.090 INFO:tasks.workunit.client.1.smithi161.stdout:5/396: getdents d3/d14 0 2024-09-18T12:52:05.093 INFO:tasks.workunit.client.1.smithi161.stdout:4/464: write d5/ff [5062764,1061] 0 2024-09-18T12:52:05.093 INFO:tasks.workunit.client.1.smithi161.stdout:8/478: write d0/d3/d10/d21/d4a/d52/d66/d5b/f5e [1030480,10118] 0 2024-09-18T12:52:05.093 INFO:tasks.workunit.client.0.smithi045.stdout:8/157: creat d11/d20/f2e x:0 0 0 2024-09-18T12:52:05.094 INFO:tasks.workunit.client.0.smithi045.stdout:8/158: chown cc 0 1 2024-09-18T12:52:05.095 INFO:tasks.workunit.client.0.smithi045.stdout:8/159: write f7 [132222,60217] 0 2024-09-18T12:52:05.097 INFO:tasks.workunit.client.1.smithi161.stdout:0/429: dwrite df/d29/d46/d90/d37/f48 [0,4194304] 0 2024-09-18T12:52:05.098 INFO:tasks.workunit.client.1.smithi161.stdout:3/455: creat d1/d2e/d3d/f9b x:0 0 0 2024-09-18T12:52:05.099 INFO:tasks.workunit.client.1.smithi161.stdout:2/459: dwrite d0/d1/f5e [0,4194304] 0 2024-09-18T12:52:05.101 INFO:tasks.workunit.client.1.smithi161.stdout:0/430: fdatasync df/d29/d36/d7a/f81 0 2024-09-18T12:52:05.103 INFO:tasks.workunit.client.1.smithi161.stdout:8/479: fdatasync d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 0 2024-09-18T12:52:05.103 INFO:tasks.workunit.client.1.smithi161.stdout:4/465: write d5/d14/d67/f76 [1240729,100311] 0 2024-09-18T12:52:05.105 INFO:tasks.workunit.client.1.smithi161.stdout:5/397: dwrite d3/d14/f30 [0,4194304] 0 2024-09-18T12:52:05.107 INFO:tasks.workunit.client.1.smithi161.stdout:2/460: mknod d0/c9e 0 2024-09-18T12:52:05.108 INFO:tasks.workunit.client.1.smithi161.stdout:4/466: write d5/d27/f46 [965623,116669] 0 2024-09-18T12:52:05.109 INFO:tasks.workunit.client.1.smithi161.stdout:5/398: read d3/d9/f12 [3355613,94213] 0 2024-09-18T12:52:05.110 INFO:tasks.workunit.client.1.smithi161.stdout:6/440: sync 2024-09-18T12:52:05.110 INFO:tasks.workunit.client.1.smithi161.stdout:1/345: sync 2024-09-18T12:52:05.112 INFO:tasks.workunit.client.1.smithi161.stdout:7/396: getdents d3/d8/d15/d1a/d4a/d64 0 2024-09-18T12:52:05.114 INFO:tasks.workunit.client.1.smithi161.stdout:6/441: chown d4/fa 68 1 2024-09-18T12:52:05.115 INFO:tasks.workunit.client.1.smithi161.stdout:5/399: rename d3/d14/f30 to d3/d14/f80 0 2024-09-18T12:52:05.116 INFO:tasks.workunit.client.1.smithi161.stdout:6/442: write d4/d39/d3a/f62 [4244452,57512] 0 2024-09-18T12:52:05.117 INFO:tasks.workunit.client.1.smithi161.stdout:1/346: stat d1/d26/d3a/d52/c56 0 2024-09-18T12:52:05.118 INFO:tasks.workunit.client.1.smithi161.stdout:6/443: fsync d4/d39/d26/d20/d28/f37 0 2024-09-18T12:52:05.118 INFO:tasks.workunit.client.1.smithi161.stdout:1/347: write d1/fc [5269812,28899] 0 2024-09-18T12:52:05.120 INFO:tasks.workunit.client.1.smithi161.stdout:4/467: chown d5/d32/d39/d4d/l8b 1168975 1 2024-09-18T12:52:05.124 INFO:tasks.workunit.client.1.smithi161.stdout:3/456: getdents d1/d2e/d14/d78/d83 0 2024-09-18T12:52:05.125 INFO:tasks.workunit.client.1.smithi161.stdout:8/480: dwrite d0/d3/d10/d21/f30 [0,4194304] 0 2024-09-18T12:52:05.125 INFO:tasks.workunit.client.1.smithi161.stdout:6/444: symlink d4/d1a/d1c/d3e/l84 0 2024-09-18T12:52:05.126 INFO:tasks.workunit.client.1.smithi161.stdout:4/468: symlink d5/d14/d67/l9a 0 2024-09-18T12:52:05.129 INFO:tasks.workunit.client.1.smithi161.stdout:3/457: write d1/d2e/d14/d65/f91 [322790,31648] 0 2024-09-18T12:52:05.129 INFO:tasks.workunit.client.1.smithi161.stdout:2/461: getdents d0/d4/d52/d8b 0 2024-09-18T12:52:05.129 INFO:tasks.workunit.client.1.smithi161.stdout:5/400: mknod d3/d3b/d7b/c81 0 2024-09-18T12:52:05.131 INFO:tasks.workunit.client.1.smithi161.stdout:5/401: fdatasync d3/d9/f38 0 2024-09-18T12:52:05.131 INFO:tasks.workunit.client.1.smithi161.stdout:0/431: dread df/d29/d46/f74 [0,4194304] 0 2024-09-18T12:52:05.131 INFO:tasks.workunit.client.1.smithi161.stdout:4/469: write d5/d32/d39/d4d/f52 [3728995,13281] 0 2024-09-18T12:52:05.131 INFO:tasks.workunit.client.1.smithi161.stdout:6/445: mknod d4/d39/d3a/c85 0 2024-09-18T12:52:05.133 INFO:tasks.workunit.client.1.smithi161.stdout:8/481: creat d0/d3/d10/d21/d4a/d52/d82/d96/fa3 x:0 0 0 2024-09-18T12:52:05.134 INFO:tasks.workunit.client.1.smithi161.stdout:4/470: chown d5/d27/f81 82 1 2024-09-18T12:52:05.134 INFO:tasks.workunit.client.1.smithi161.stdout:3/458: mknod d1/d2e/d68/c9c 0 2024-09-18T12:52:05.135 INFO:tasks.workunit.client.1.smithi161.stdout:5/402: mkdir d3/d3b/d7b/d82 0 2024-09-18T12:52:05.136 INFO:tasks.workunit.client.1.smithi161.stdout:3/459: fdatasync d1/d2e/d14/d65/d76/d8c/f8d 0 2024-09-18T12:52:05.137 INFO:tasks.workunit.client.1.smithi161.stdout:1/348: getdents d1/d26 0 2024-09-18T12:52:05.138 INFO:tasks.workunit.client.1.smithi161.stdout:1/349: rename d1/da to d1/da/d1f/d6b/d70 22 2024-09-18T12:52:05.138 INFO:tasks.workunit.client.1.smithi161.stdout:1/350: stat d1/d26/d3a 0 2024-09-18T12:52:05.138 INFO:tasks.workunit.client.1.smithi161.stdout:2/462: unlink d0/d5/l29 0 2024-09-18T12:52:05.139 INFO:tasks.workunit.client.1.smithi161.stdout:1/351: write d1/d26/d3a/f3b [345639,5025] 0 2024-09-18T12:52:05.140 INFO:tasks.workunit.client.1.smithi161.stdout:0/432: symlink df/d30/d4d/l99 0 2024-09-18T12:52:05.141 INFO:tasks.workunit.client.1.smithi161.stdout:6/446: mknod d4/d39/d47/d51/c86 0 2024-09-18T12:52:05.144 INFO:tasks.workunit.client.1.smithi161.stdout:3/460: mkdir d1/d2e/d14/d65/d76/d8c/d9d 0 2024-09-18T12:52:05.145 INFO:tasks.workunit.client.1.smithi161.stdout:3/461: stat d1/d2e/f5b 0 2024-09-18T12:52:05.146 INFO:tasks.workunit.client.1.smithi161.stdout:4/471: mkdir d5/d27/d3a/d9b 0 2024-09-18T12:52:05.147 INFO:tasks.workunit.client.1.smithi161.stdout:5/403: dread d3/d3b/f42 [0,4194304] 0 2024-09-18T12:52:05.147 INFO:tasks.workunit.client.1.smithi161.stdout:1/352: dwrite d1/d26/d3a/d52/f59 [0,4194304] 0 2024-09-18T12:52:05.149 INFO:tasks.workunit.client.1.smithi161.stdout:5/404: write d3/d9/f1c [6801641,46517] 0 2024-09-18T12:52:05.149 INFO:tasks.workunit.client.1.smithi161.stdout:1/353: stat d1/da/d1f/l22 0 2024-09-18T12:52:05.149 INFO:tasks.workunit.client.1.smithi161.stdout:6/447: rename d4/d39/d46 to d4/d61/d69/d87 0 2024-09-18T12:52:05.149 INFO:tasks.workunit.client.1.smithi161.stdout:2/463: mkdir d0/d4/d9d/d9f 0 2024-09-18T12:52:05.150 INFO:tasks.workunit.client.1.smithi161.stdout:5/405: stat d3/d9/f12 0 2024-09-18T12:52:05.152 INFO:tasks.workunit.client.1.smithi161.stdout:3/462: symlink d1/d2e/d14/d65/l9e 0 2024-09-18T12:52:05.155 INFO:tasks.workunit.client.1.smithi161.stdout:5/406: dwrite d3/d9/f41 [0,4194304] 0 2024-09-18T12:52:05.156 INFO:tasks.workunit.client.1.smithi161.stdout:4/472: truncate d5/f20 535662 0 2024-09-18T12:52:05.160 INFO:tasks.workunit.client.1.smithi161.stdout:0/433: creat df/d29/d46/d90/d37/f9a x:0 0 0 2024-09-18T12:52:05.160 INFO:tasks.workunit.client.1.smithi161.stdout:8/482: truncate d0/d3/d10/f22 1762542 0 2024-09-18T12:52:05.161 INFO:tasks.workunit.client.1.smithi161.stdout:5/407: read d3/d9/f12 [1465176,110841] 0 2024-09-18T12:52:05.162 INFO:tasks.workunit.client.1.smithi161.stdout:1/354: mkdir d1/d71 0 2024-09-18T12:52:05.162 INFO:tasks.workunit.client.1.smithi161.stdout:6/448: mkdir d4/d39/d47/d88 0 2024-09-18T12:52:05.164 INFO:tasks.workunit.client.1.smithi161.stdout:3/463: link d1/d2e/d24/f47 d1/d2e/d24/d1d/f9f 0 2024-09-18T12:52:05.164 INFO:tasks.workunit.client.1.smithi161.stdout:8/483: mknod d0/d3/d1e/ca4 0 2024-09-18T12:52:05.165 INFO:tasks.workunit.client.1.smithi161.stdout:0/434: creat df/d30/d4d/f9b x:0 0 0 2024-09-18T12:52:05.166 INFO:tasks.workunit.client.1.smithi161.stdout:2/464: creat d0/fa0 x:0 0 0 2024-09-18T12:52:05.166 INFO:tasks.workunit.client.1.smithi161.stdout:5/408: rmdir d3/d3b 39 2024-09-18T12:52:05.167 INFO:tasks.workunit.client.1.smithi161.stdout:4/473: dwrite d5/d32/d39/d4d/f52 [0,4194304] 0 2024-09-18T12:52:05.168 INFO:tasks.workunit.client.0.smithi045.stdout:1/172: sync 2024-09-18T12:52:05.168 INFO:tasks.workunit.client.0.smithi045.stdout:0/128: sync 2024-09-18T12:52:05.169 INFO:tasks.workunit.client.1.smithi161.stdout:6/449: fdatasync d4/d39/d26/f2b 0 2024-09-18T12:52:05.169 INFO:tasks.workunit.client.0.smithi045.stdout:0/129: truncate d6/d7/ff 1256249 0 2024-09-18T12:52:05.170 INFO:tasks.workunit.client.0.smithi045.stdout:0/130: chown d6/lb 229551 1 2024-09-18T12:52:05.170 INFO:tasks.workunit.client.0.smithi045.stdout:1/173: mkdir d0/d2d/d2b/d33 0 2024-09-18T12:52:05.170 INFO:tasks.workunit.client.1.smithi161.stdout:2/465: chown d0/d4/d52/f59 7774 1 2024-09-18T12:52:05.170 INFO:tasks.workunit.client.1.smithi161.stdout:5/409: write d3/d9/f6d [224290,120751] 0 2024-09-18T12:52:05.171 INFO:tasks.workunit.client.0.smithi045.stdout:1/174: fsync d0/d2e/f2c 0 2024-09-18T12:52:05.174 INFO:tasks.workunit.client.1.smithi161.stdout:9/376: sync 2024-09-18T12:52:05.175 INFO:tasks.workunit.client.0.smithi045.stdout:0/131: mkdir d6/d7/d21/d23 0 2024-09-18T12:52:05.175 INFO:tasks.workunit.client.0.smithi045.stdout:0/132: read - d6/d7/f19 zero size 2024-09-18T12:52:05.176 INFO:tasks.workunit.client.1.smithi161.stdout:2/466: write d0/f75 [488047,128374] 0 2024-09-18T12:52:05.176 INFO:tasks.workunit.client.0.smithi045.stdout:0/133: read - d6/f1d zero size 2024-09-18T12:52:05.177 INFO:tasks.workunit.client.1.smithi161.stdout:6/450: dread - d4/d39/d26/d20/d28/f37 zero size 2024-09-18T12:52:05.178 INFO:tasks.workunit.client.1.smithi161.stdout:3/464: dwrite d1/f12 [0,4194304] 0 2024-09-18T12:52:05.179 INFO:tasks.workunit.client.0.smithi045.stdout:1/175: rename d0/fd to d0/d2d/f34 0 2024-09-18T12:52:05.179 INFO:tasks.workunit.client.1.smithi161.stdout:2/467: chown d0/d5/d43/d35/f5f 51822 1 2024-09-18T12:52:05.180 INFO:tasks.workunit.client.1.smithi161.stdout:2/468: dread - d0/d5/d53/f4b zero size 2024-09-18T12:52:05.181 INFO:tasks.workunit.client.1.smithi161.stdout:4/474: unlink d5/d27/d3a/d47/f62 0 2024-09-18T12:52:05.181 INFO:tasks.workunit.client.0.smithi045.stdout:0/134: readlink d6/d7/l22 0 2024-09-18T12:52:05.184 INFO:tasks.workunit.client.1.smithi161.stdout:8/484: rmdir d0/d3/d10/d21/d4a/d52/d66/d5b/d89 0 2024-09-18T12:52:05.185 INFO:tasks.workunit.client.1.smithi161.stdout:4/475: write d5/d27/d3a/d4c/f64 [443485,129815] 0 2024-09-18T12:52:05.187 INFO:tasks.workunit.client.1.smithi161.stdout:6/451: dwrite d4/d1a/d1c/d3e/d4d/f72 [0,4194304] 0 2024-09-18T12:52:05.191 INFO:tasks.workunit.client.0.smithi045.stdout:0/135: creat d6/d7/d21/f24 x:0 0 0 2024-09-18T12:52:05.199 INFO:tasks.workunit.client.0.smithi045.stdout:0/136: rename d6/d7/f19 to d6/d7/d21/d23/f25 0 2024-09-18T12:52:05.199 INFO:tasks.workunit.client.0.smithi045.stdout:0/137: dread - d6/f1d zero size 2024-09-18T12:52:05.201 INFO:tasks.workunit.client.1.smithi161.stdout:0/435: link df/d29/l40 df/d29/d46/l9c 0 2024-09-18T12:52:05.201 INFO:tasks.workunit.client.0.smithi045.stdout:1/176: rmdir d0/d2d/d2b/d33 0 2024-09-18T12:52:05.202 INFO:tasks.workunit.client.1.smithi161.stdout:9/377: rename d0/d16/d25/d46/d53/d59/f5d to d0/d20/d49/f7e 0 2024-09-18T12:52:05.202 INFO:tasks.workunit.client.0.smithi045.stdout:1/177: stat d0/d2d/d2b 0 2024-09-18T12:52:05.202 INFO:tasks.workunit.client.1.smithi161.stdout:2/469: mknod d0/d4/d78/ca1 0 2024-09-18T12:52:05.204 INFO:tasks.workunit.client.1.smithi161.stdout:9/378: dread d0/db/f57 [0,4194304] 0 2024-09-18T12:52:05.204 INFO:tasks.workunit.client.1.smithi161.stdout:9/379: chown d0/d20/f6c 14 1 2024-09-18T12:52:05.205 INFO:tasks.workunit.client.0.smithi045.stdout:0/138: rmdir d6/d7 39 2024-09-18T12:52:05.206 INFO:tasks.workunit.client.0.smithi045.stdout:0/139: readlink d6/ld 0 2024-09-18T12:52:05.208 INFO:tasks.workunit.client.1.smithi161.stdout:1/355: dread d1/da/d31/f53 [0,4194304] 0 2024-09-18T12:52:05.209 INFO:tasks.workunit.client.0.smithi045.stdout:1/178: dwrite d0/d12/f13 [0,4194304] 0 2024-09-18T12:52:05.215 INFO:tasks.workunit.client.1.smithi161.stdout:0/436: fsync df/d30/f3a 0 2024-09-18T12:52:05.215 INFO:tasks.workunit.client.1.smithi161.stdout:5/410: write d3/d14/f4e [746390,111458] 0 2024-09-18T12:52:05.217 INFO:tasks.workunit.client.0.smithi045.stdout:1/179: creat d0/d2d/f35 x:0 0 0 2024-09-18T12:52:05.218 INFO:tasks.workunit.client.1.smithi161.stdout:2/470: mknod d0/d5/d53/d7d/ca2 0 2024-09-18T12:52:05.220 INFO:tasks.workunit.client.0.smithi045.stdout:1/180: unlink d0/d12/c26 0 2024-09-18T12:52:05.222 INFO:tasks.workunit.client.1.smithi161.stdout:8/485: write d0/d3/d1e/f46 [4927536,112779] 0 2024-09-18T12:52:05.223 INFO:tasks.workunit.client.1.smithi161.stdout:9/380: mkdir d0/d47/d48/d7f 0 2024-09-18T12:52:05.225 INFO:tasks.workunit.client.1.smithi161.stdout:6/452: truncate d4/d1a/f14 2879285 0 2024-09-18T12:52:05.228 INFO:tasks.workunit.client.0.smithi045.stdout:0/140: getdents d6/d7 0 2024-09-18T12:52:05.230 INFO:tasks.workunit.client.1.smithi161.stdout:1/356: dwrite d1/d26/d3a/f5d [0,4194304] 0 2024-09-18T12:52:05.230 INFO:tasks.workunit.client.1.smithi161.stdout:2/471: rmdir d0/d1/d3b/d7e 39 2024-09-18T12:52:05.231 INFO:tasks.workunit.client.0.smithi045.stdout:1/181: getdents d0 0 2024-09-18T12:52:05.232 INFO:tasks.workunit.client.1.smithi161.stdout:8/486: rmdir d0/d3/d10/d21/d4a/d52/d94 39 2024-09-18T12:52:05.234 INFO:tasks.workunit.client.0.smithi045.stdout:1/182: rename d0/f1f to d0/d2d/d2b/f36 0 2024-09-18T12:52:05.234 INFO:tasks.workunit.client.1.smithi161.stdout:8/487: write d0/d3/d10/d21/f49 [521159,123837] 0 2024-09-18T12:52:05.238 INFO:tasks.workunit.client.1.smithi161.stdout:0/437: creat df/d30/d71/d96/f9d x:0 0 0 2024-09-18T12:52:05.240 INFO:tasks.workunit.client.1.smithi161.stdout:2/472: creat d0/d5/d43/d35/fa3 x:0 0 0 2024-09-18T12:52:05.241 INFO:tasks.workunit.client.0.smithi045.stdout:0/141: truncate d6/d7/fa 101586 0 2024-09-18T12:52:05.242 INFO:tasks.workunit.client.0.smithi045.stdout:0/142: chown d6/d7/f1f 74822 1 2024-09-18T12:52:05.242 INFO:tasks.workunit.client.1.smithi161.stdout:6/453: link d4/d39/d48/f82 d4/d61/f89 0 2024-09-18T12:52:05.243 INFO:tasks.workunit.client.1.smithi161.stdout:6/454: readlink d4/d39/d26/d20/d28/l58 0 2024-09-18T12:52:05.244 INFO:tasks.workunit.client.1.smithi161.stdout:7/397: sync 2024-09-18T12:52:05.244 INFO:tasks.workunit.client.1.smithi161.stdout:6/455: chown d4/d39/d26/d31/l7e 3271392 1 2024-09-18T12:52:05.244 INFO:tasks.workunit.client.1.smithi161.stdout:7/398: chown d3/d36/f65 1011715 1 2024-09-18T12:52:05.245 INFO:tasks.workunit.client.1.smithi161.stdout:7/399: stat d3/d8/d15/d1a/d4a/d59 0 2024-09-18T12:52:05.287 INFO:tasks.workunit.client.1.smithi161.stdout:3/465: sync 2024-09-18T12:52:05.322 INFO:tasks.workunit.client.1.smithi161.stdout:4/476: sync 2024-09-18T12:52:05.380 INFO:tasks.workunit.client.1.smithi161.stdout:1/357: mknod d1/c72 0 2024-09-18T12:52:05.383 INFO:tasks.workunit.client.1.smithi161.stdout:9/381: write d0/d20/f39 [2013002,6278] 0 2024-09-18T12:52:05.383 INFO:tasks.workunit.client.1.smithi161.stdout:2/473: write d0/f24 [1520616,58311] 0 2024-09-18T12:52:05.386 INFO:tasks.workunit.client.1.smithi161.stdout:8/488: symlink d0/d3/la5 0 2024-09-18T12:52:05.387 INFO:tasks.workunit.client.1.smithi161.stdout:8/489: chown d0/d3/d10/c4d 2311649 1 2024-09-18T12:52:05.387 INFO:tasks.workunit.client.0.smithi045.stdout:1/183: truncate d0/d2e/f22 356669 0 2024-09-18T12:52:05.388 INFO:tasks.workunit.client.0.smithi045.stdout:0/143: getdents d6 0 2024-09-18T12:52:05.389 INFO:tasks.workunit.client.1.smithi161.stdout:5/411: getdents d3/d14/d20/d21 0 2024-09-18T12:52:05.389 INFO:tasks.workunit.client.1.smithi161.stdout:2/474: dwrite d0/d4/d78/f7f [0,4194304] 0 2024-09-18T12:52:05.390 INFO:tasks.workunit.client.1.smithi161.stdout:6/456: rename d4/d1a/d1c/d3e/f63 to d4/d39/d47/d88/f8a 0 2024-09-18T12:52:05.391 INFO:tasks.workunit.client.1.smithi161.stdout:7/400: chown d3/d8/d15/d1a/d44/l5a 21 1 2024-09-18T12:52:05.392 INFO:tasks.workunit.client.1.smithi161.stdout:3/466: symlink d1/d2e/d14/d78/d83/la0 0 2024-09-18T12:52:05.394 INFO:tasks.workunit.client.1.smithi161.stdout:3/467: dread - d1/d2e/d24/d1d/f5d zero size 2024-09-18T12:52:05.394 INFO:tasks.workunit.client.1.smithi161.stdout:1/358: write d1/f5 [2153291,6279] 0 2024-09-18T12:52:05.397 INFO:tasks.workunit.client.1.smithi161.stdout:2/475: dwrite d0/d1/d4c/d67/f6b [0,4194304] 0 2024-09-18T12:52:05.397 INFO:tasks.workunit.client.1.smithi161.stdout:0/438: link df/f50 df/d30/d4d/d92/f9e 0 2024-09-18T12:52:05.398 INFO:tasks.workunit.client.1.smithi161.stdout:1/359: read d1/d26/d3a/f3b [256586,81090] 0 2024-09-18T12:52:05.400 INFO:tasks.workunit.client.1.smithi161.stdout:6/457: readlink d4/d61/l6e 0 2024-09-18T12:52:05.401 INFO:tasks.workunit.client.1.smithi161.stdout:0/439: write df/d29/d46/d90/d37/f42 [353010,56025] 0 2024-09-18T12:52:05.401 INFO:tasks.workunit.client.0.smithi045.stdout:1/184: dwrite d0/f6 [0,4194304] 0 2024-09-18T12:52:05.402 INFO:tasks.workunit.client.1.smithi161.stdout:6/458: chown d4/d1a/l33 2 1 2024-09-18T12:52:05.403 INFO:tasks.workunit.client.0.smithi045.stdout:0/144: dwrite d6/d7/f14 [0,4194304] 0 2024-09-18T12:52:05.403 INFO:tasks.workunit.client.1.smithi161.stdout:4/477: symlink d5/d27/l9c 0 2024-09-18T12:52:05.412 INFO:tasks.workunit.client.1.smithi161.stdout:3/468: creat d1/d2e/d14/d65/fa1 x:0 0 0 2024-09-18T12:52:05.416 INFO:tasks.workunit.client.1.smithi161.stdout:1/360: mkdir d1/da/d1f/d45/d73 0 2024-09-18T12:52:05.421 INFO:tasks.workunit.client.1.smithi161.stdout:0/440: creat df/d30/d71/f9f x:0 0 0 2024-09-18T12:52:05.421 INFO:tasks.workunit.client.1.smithi161.stdout:6/459: creat d4/d39/d48/f8b x:0 0 0 2024-09-18T12:52:05.422 INFO:tasks.workunit.client.1.smithi161.stdout:4/478: rename d5/f91 to d5/d14/d67/d84/d6e/f9d 0 2024-09-18T12:52:05.422 INFO:tasks.workunit.client.1.smithi161.stdout:2/476: dread d0/d5/d43/f18 [0,4194304] 0 2024-09-18T12:52:05.423 INFO:tasks.workunit.client.1.smithi161.stdout:8/490: creat d0/d3/fa6 x:0 0 0 2024-09-18T12:52:05.424 INFO:tasks.workunit.client.1.smithi161.stdout:3/469: creat d1/d2e/d14/d65/d7a/fa2 x:0 0 0 2024-09-18T12:52:05.425 INFO:tasks.workunit.client.1.smithi161.stdout:8/491: write d0/d3/f92 [374352,237] 0 2024-09-18T12:52:05.425 INFO:tasks.workunit.client.1.smithi161.stdout:6/460: read d4/f6b [2432302,93982] 0 2024-09-18T12:52:05.427 INFO:tasks.workunit.client.1.smithi161.stdout:1/361: creat d1/d26/d3a/d52/f74 x:0 0 0 2024-09-18T12:52:05.431 INFO:tasks.workunit.client.1.smithi161.stdout:7/401: getdents d3/d8/d15/d38 0 2024-09-18T12:52:05.431 INFO:tasks.workunit.client.0.smithi045.stdout:0/145: truncate d6/d7/f14 1837328 0 2024-09-18T12:52:05.432 INFO:tasks.workunit.client.0.smithi045.stdout:0/146: write d6/d7/ff [550102,63276] 0 2024-09-18T12:52:05.433 INFO:tasks.workunit.client.1.smithi161.stdout:2/477: rename d0/d4/d78/f7f to d0/d1/d4c/d67/fa4 0 2024-09-18T12:52:05.433 INFO:tasks.workunit.client.1.smithi161.stdout:4/479: dwrite d5/d14/d5f/f75 [0,4194304] 0 2024-09-18T12:52:05.435 INFO:tasks.workunit.client.1.smithi161.stdout:2/478: write d0/d1/d4c/f55 [1652649,28] 0 2024-09-18T12:52:05.435 INFO:tasks.workunit.client.0.smithi045.stdout:0/147: rmdir d6/d7/d21/d23 39 2024-09-18T12:52:05.435 INFO:tasks.workunit.client.1.smithi161.stdout:4/480: dread d5/d27/f72 [0,4194304] 0 2024-09-18T12:52:05.442 INFO:tasks.workunit.client.0.smithi045.stdout:0/148: dread - d6/d7/d21/d23/f25 zero size 2024-09-18T12:52:05.442 INFO:tasks.workunit.client.0.smithi045.stdout:5/295: sync 2024-09-18T12:52:05.444 INFO:tasks.workunit.client.0.smithi045.stdout:0/149: chown d6/d7/f15 4 1 2024-09-18T12:52:05.444 INFO:tasks.workunit.client.0.smithi045.stdout:5/296: fdatasync d6/db/f12 0 2024-09-18T12:52:05.444 INFO:tasks.workunit.client.1.smithi161.stdout:1/362: unlink d1/da/d1f/f4b 0 2024-09-18T12:52:05.446 INFO:tasks.workunit.client.0.smithi045.stdout:1/185: write d0/d2d/d2b/f36 [4172031,50081] 0 2024-09-18T12:52:05.447 INFO:tasks.workunit.client.1.smithi161.stdout:9/382: sync 2024-09-18T12:52:05.450 INFO:tasks.workunit.client.1.smithi161.stdout:7/402: creat d3/d8/d15/d1a/d4a/d59/f6e x:0 0 0 2024-09-18T12:52:05.450 INFO:tasks.workunit.client.1.smithi161.stdout:8/492: dread d0/f2a [0,4194304] 0 2024-09-18T12:52:05.450 INFO:tasks.workunit.client.0.smithi045.stdout:5/297: creat d6/d2a/f60 x:0 0 0 2024-09-18T12:52:05.453 INFO:tasks.workunit.client.0.smithi045.stdout:0/150: rename d6/d7/c13 to d6/c26 0 2024-09-18T12:52:05.453 INFO:tasks.workunit.client.0.smithi045.stdout:5/298: dread d6/f7 [0,4194304] 0 2024-09-18T12:52:05.454 INFO:tasks.workunit.client.1.smithi161.stdout:9/383: truncate d0/d16/d25/d28/f7b 510899 0 2024-09-18T12:52:05.454 INFO:tasks.workunit.client.1.smithi161.stdout:1/363: dwrite d1/d26/f7 [4194304,4194304] 0 2024-09-18T12:52:05.460 INFO:tasks.workunit.client.1.smithi161.stdout:1/364: write d1/d26/f50 [1242502,125269] 0 2024-09-18T12:52:05.461 INFO:tasks.workunit.client.1.smithi161.stdout:4/481: symlink d5/d32/d39/d4d/l9e 0 2024-09-18T12:52:05.463 INFO:tasks.workunit.client.1.smithi161.stdout:7/403: dwrite d3/f23 [0,4194304] 0 2024-09-18T12:52:05.466 INFO:tasks.workunit.client.1.smithi161.stdout:4/482: write d5/d27/d44/f55 [585567,91154] 0 2024-09-18T12:52:05.467 INFO:tasks.workunit.client.1.smithi161.stdout:5/412: dwrite d3/d3b/f3d [0,4194304] 0 2024-09-18T12:52:05.469 INFO:tasks.workunit.client.1.smithi161.stdout:0/441: dwrite df/f15 [0,4194304] 0 2024-09-18T12:52:05.473 INFO:tasks.workunit.client.1.smithi161.stdout:7/404: write d3/d8/d15/d38/d55/f6c [806606,47176] 0 2024-09-18T12:52:05.481 INFO:tasks.workunit.client.1.smithi161.stdout:0/442: dwrite df/d29/d36/f5b [0,4194304] 0 2024-09-18T12:52:05.492 INFO:tasks.workunit.client.0.smithi045.stdout:7/161: sync 2024-09-18T12:52:05.527 INFO:tasks.workunit.client.0.smithi045.stdout:1/186: mkdir d0/d12/d32/d37 0 2024-09-18T12:52:05.532 INFO:tasks.workunit.client.1.smithi161.stdout:6/461: write d4/d1a/d1c/d3e/d4d/f78 [273147,54286] 0 2024-09-18T12:52:05.533 INFO:tasks.workunit.client.1.smithi161.stdout:6/462: readlink d4/d1a/d1c/d3e/l5d 0 2024-09-18T12:52:05.533 INFO:tasks.workunit.client.0.smithi045.stdout:1/187: dwrite d0/d12/f15 [0,4194304] 0 2024-09-18T12:52:05.534 INFO:tasks.workunit.client.1.smithi161.stdout:6/463: chown d4/d39/f80 13 1 2024-09-18T12:52:05.539 INFO:tasks.workunit.client.1.smithi161.stdout:3/470: truncate d1/d2e/d14/d65/f6a 2692267 0 2024-09-18T12:52:05.542 INFO:tasks.workunit.client.0.smithi045.stdout:1/188: fdatasync d0/d2e/f22 0 2024-09-18T12:52:05.547 INFO:tasks.workunit.client.1.smithi161.stdout:9/384: rmdir d0/d16/d25/d46 39 2024-09-18T12:52:05.547 INFO:tasks.workunit.client.1.smithi161.stdout:9/385: write d0/db/f55 [630937,72787] 0 2024-09-18T12:52:05.550 INFO:tasks.workunit.client.1.smithi161.stdout:2/479: mkdir d0/d1/d3b/d3d/da5 0 2024-09-18T12:52:05.551 INFO:tasks.workunit.client.0.smithi045.stdout:0/151: rmdir d6/d7 39 2024-09-18T12:52:05.551 INFO:tasks.workunit.client.1.smithi161.stdout:1/365: mknod d1/da/d1f/c75 0 2024-09-18T12:52:05.554 INFO:tasks.workunit.client.1.smithi161.stdout:5/413: rmdir d3/d44 39 2024-09-18T12:52:05.554 INFO:tasks.workunit.client.1.smithi161.stdout:5/414: chown d3/cc 0 1 2024-09-18T12:52:05.556 INFO:tasks.workunit.client.1.smithi161.stdout:7/405: rename d3/d8/d15/d38/d55/f58 to d3/d8/d4b/f6f 0 2024-09-18T12:52:05.558 INFO:tasks.workunit.client.1.smithi161.stdout:0/443: symlink df/d29/d46/d51/la0 0 2024-09-18T12:52:05.561 INFO:tasks.workunit.client.1.smithi161.stdout:3/471: unlink d1/d2e/d68/c9c 0 2024-09-18T12:52:05.562 INFO:tasks.workunit.client.0.smithi045.stdout:7/162: truncate d13/d1c/f2b 3991571 0 2024-09-18T12:52:05.563 INFO:tasks.workunit.client.0.smithi045.stdout:0/152: dwrite d6/d7/f1f [0,4194304] 0 2024-09-18T12:52:05.565 INFO:tasks.workunit.client.1.smithi161.stdout:9/386: creat d0/db/d18/f80 x:0 0 0 2024-09-18T12:52:05.574 INFO:tasks.workunit.client.1.smithi161.stdout:2/480: rename d0/d1/d3b/d3d/f64 to d0/d5/d43/d35/d98/fa6 0 2024-09-18T12:52:05.577 INFO:tasks.workunit.client.1.smithi161.stdout:7/406: creat d3/d8/d15/d38/f70 x:0 0 0 2024-09-18T12:52:05.578 INFO:tasks.workunit.client.0.smithi045.stdout:0/153: mknod d6/c27 0 2024-09-18T12:52:05.578 INFO:tasks.workunit.client.1.smithi161.stdout:6/464: mknod d4/d1a/d1c/c8c 0 2024-09-18T12:52:05.580 INFO:tasks.workunit.client.1.smithi161.stdout:2/481: dread d0/d5/d43/f37 [0,4194304] 0 2024-09-18T12:52:05.580 INFO:tasks.workunit.client.1.smithi161.stdout:6/465: read d4/d39/d26/f2b [1802932,103402] 0 2024-09-18T12:52:05.581 INFO:tasks.workunit.client.1.smithi161.stdout:6/466: stat d4/d1a/d1c/d3e/f42 0 2024-09-18T12:52:05.582 INFO:tasks.workunit.client.1.smithi161.stdout:3/472: mknod d1/d2e/d14/d65/d7a/ca3 0 2024-09-18T12:52:05.584 INFO:tasks.workunit.client.1.smithi161.stdout:8/493: creat d0/d3/d10/d21/d4a/d52/fa7 x:0 0 0 2024-09-18T12:52:05.585 INFO:tasks.workunit.client.0.smithi045.stdout:0/154: dwrite d6/d7/ff [0,4194304] 0 2024-09-18T12:52:05.587 INFO:tasks.workunit.client.0.smithi045.stdout:2/236: sync 2024-09-18T12:52:05.587 INFO:tasks.workunit.client.0.smithi045.stdout:4/164: sync 2024-09-18T12:52:05.590 INFO:tasks.workunit.client.0.smithi045.stdout:0/155: creat d6/d7/d21/d23/f28 x:0 0 0 2024-09-18T12:52:05.593 INFO:tasks.workunit.client.1.smithi161.stdout:3/473: dread d1/d2e/d3d/d49/f5f [0,4194304] 0 2024-09-18T12:52:05.593 INFO:tasks.workunit.client.0.smithi045.stdout:4/165: mknod db/de/d1a/c3c 0 2024-09-18T12:52:05.597 INFO:tasks.workunit.client.0.smithi045.stdout:7/163: dwrite d13/d31/f2d [4194304,4194304] 0 2024-09-18T12:52:05.597 INFO:tasks.workunit.client.0.smithi045.stdout:4/166: stat db/f30 0 2024-09-18T12:52:05.597 INFO:tasks.workunit.client.0.smithi045.stdout:0/156: creat d6/d7/f29 x:0 0 0 2024-09-18T12:52:05.598 INFO:tasks.workunit.client.1.smithi161.stdout:7/407: creat d3/d8/d15/d1a/d24/d31/f71 x:0 0 0 2024-09-18T12:52:05.599 INFO:tasks.workunit.client.1.smithi161.stdout:7/408: fdatasync d3/d8/d15/f3c 0 2024-09-18T12:52:05.601 INFO:tasks.workunit.client.1.smithi161.stdout:2/482: rename d0/d5/d43/d23/l2d to d0/d4/d9d/d9f/la7 0 2024-09-18T12:52:05.602 INFO:tasks.workunit.client.1.smithi161.stdout:2/483: stat d0/c9e 0 2024-09-18T12:52:05.602 INFO:tasks.workunit.client.1.smithi161.stdout:2/484: chown d0/fa0 1021558730 1 2024-09-18T12:52:05.603 INFO:tasks.workunit.client.0.smithi045.stdout:1/189: dwrite d0/fc [0,4194304] 0 2024-09-18T12:52:05.604 INFO:tasks.workunit.client.1.smithi161.stdout:2/485: write d0/f24 [3795841,96709] 0 2024-09-18T12:52:05.605 INFO:tasks.workunit.client.1.smithi161.stdout:8/494: chown d0/d3/d10/d21/d4a/d52/d94/f99 2 1 2024-09-18T12:52:05.605 INFO:tasks.workunit.client.1.smithi161.stdout:1/366: link d1/d26/d3a/d52/l66 d1/d71/l76 0 2024-09-18T12:52:05.606 INFO:tasks.workunit.client.0.smithi045.stdout:2/237: dwrite d5/d3a/f5b [0,4194304] 0 2024-09-18T12:52:05.607 INFO:tasks.workunit.client.1.smithi161.stdout:8/495: chown d0/d3/d10/d21/d4a/d52/d82/d96/d98/f25 45402464 1 2024-09-18T12:52:05.608 INFO:tasks.workunit.client.0.smithi045.stdout:4/167: read db/d10/d13/f2b [1852808,49944] 0 2024-09-18T12:52:05.613 INFO:tasks.workunit.client.1.smithi161.stdout:4/483: link d5/d27/d3a/d4c/l87 d5/d27/d3a/l9f 0 2024-09-18T12:52:05.613 INFO:tasks.workunit.client.1.smithi161.stdout:1/367: dwrite d1/d26/d3a/d52/f59 [0,4194304] 0 2024-09-18T12:52:05.618 INFO:tasks.workunit.client.0.smithi045.stdout:4/168: dwrite db/f30 [0,4194304] 0 2024-09-18T12:52:05.619 INFO:tasks.workunit.client.0.smithi045.stdout:1/190: mknod d0/d2e/c38 0 2024-09-18T12:52:05.619 INFO:tasks.workunit.client.0.smithi045.stdout:4/169: write f9 [5398885,61385] 0 2024-09-18T12:52:05.621 INFO:tasks.workunit.client.0.smithi045.stdout:4/170: dread - db/d10/d2f/f36 zero size 2024-09-18T12:52:05.623 INFO:tasks.workunit.client.0.smithi045.stdout:4/171: write db/f21 [7089429,14260] 0 2024-09-18T12:52:05.627 INFO:tasks.workunit.client.0.smithi045.stdout:2/238: unlink d5/d2c/d4d/d16/f36 0 2024-09-18T12:52:05.630 INFO:tasks.workunit.client.0.smithi045.stdout:1/191: unlink d0/d2e/f21 0 2024-09-18T12:52:05.633 INFO:tasks.workunit.client.1.smithi161.stdout:6/467: rename d4/ff to d4/d1a/d1c/d3e/d83/f8d 0 2024-09-18T12:52:05.633 INFO:tasks.workunit.client.1.smithi161.stdout:6/468: chown d4/d39/d26/d20 440 1 2024-09-18T12:52:05.637 INFO:tasks.workunit.client.0.smithi045.stdout:7/164: truncate d13/f17 3402046 0 2024-09-18T12:52:05.637 INFO:tasks.workunit.client.0.smithi045.stdout:7/165: stat c10 0 2024-09-18T12:52:05.637 INFO:tasks.workunit.client.1.smithi161.stdout:2/486: mkdir d0/d1/df/d8a/da8 0 2024-09-18T12:52:05.639 INFO:tasks.workunit.client.0.smithi045.stdout:1/192: mknod d0/d2d/c39 0 2024-09-18T12:52:05.640 INFO:tasks.workunit.client.0.smithi045.stdout:1/193: write d0/d2d/d2b/f2f [710243,126497] 0 2024-09-18T12:52:05.640 INFO:tasks.workunit.client.0.smithi045.stdout:0/157: rename d6/l1e to d6/d7/d21/l2a 0 2024-09-18T12:52:05.641 INFO:tasks.workunit.client.1.smithi161.stdout:5/415: getdents d3/d3b/d7b 0 2024-09-18T12:52:05.642 INFO:tasks.workunit.client.0.smithi045.stdout:7/166: mkdir d13/d1c/d37 0 2024-09-18T12:52:05.646 INFO:tasks.workunit.client.1.smithi161.stdout:1/368: creat d1/da/d31/f77 x:0 0 0 2024-09-18T12:52:05.646 INFO:tasks.workunit.client.1.smithi161.stdout:1/369: readlink d1/d1d/l25 0 2024-09-18T12:52:05.646 INFO:tasks.workunit.client.1.smithi161.stdout:0/444: getdents df/d29/d46/d51 0 2024-09-18T12:52:05.647 INFO:tasks.workunit.client.1.smithi161.stdout:1/370: readlink d1/da/d1f/d45/l6f 0 2024-09-18T12:52:05.647 INFO:tasks.workunit.client.1.smithi161.stdout:0/445: fdatasync df/d84/d86/f75 0 2024-09-18T12:52:05.647 INFO:tasks.workunit.client.0.smithi045.stdout:1/194: dwrite d0/d2e/f22 [0,4194304] 0 2024-09-18T12:52:05.648 INFO:tasks.workunit.client.1.smithi161.stdout:1/371: write d1/da/d39/f61 [908396,94505] 0 2024-09-18T12:52:05.648 INFO:tasks.workunit.client.0.smithi045.stdout:1/195: stat d0/d12/l1e 0 2024-09-18T12:52:05.649 INFO:tasks.workunit.client.0.smithi045.stdout:1/196: stat d0/d2d/f34 0 2024-09-18T12:52:05.649 INFO:tasks.workunit.client.0.smithi045.stdout:2/239: rename d5/d2c/d4d/c2d to d5/d2c/c5e 0 2024-09-18T12:52:05.650 INFO:tasks.workunit.client.0.smithi045.stdout:2/240: chown d5/d3a 539342 1 2024-09-18T12:52:05.653 INFO:tasks.workunit.client.1.smithi161.stdout:2/487: dread d0/d5/d43/d35/f7a [0,4194304] 0 2024-09-18T12:52:05.655 INFO:tasks.workunit.client.0.smithi045.stdout:0/158: rename d6/c27 to d6/d7/c2b 0 2024-09-18T12:52:05.658 INFO:tasks.workunit.client.1.smithi161.stdout:6/469: unlink d4/d39/d3a/l5c 0 2024-09-18T12:52:05.659 INFO:tasks.workunit.client.1.smithi161.stdout:6/470: write d4/d39/d26/f40 [2439425,73042] 0 2024-09-18T12:52:05.664 INFO:tasks.workunit.client.0.smithi045.stdout:7/167: rename c9 to d13/d1a/d28/c38 0 2024-09-18T12:52:05.666 INFO:tasks.workunit.client.0.smithi045.stdout:0/159: fsync d6/d7/f14 0 2024-09-18T12:52:05.668 INFO:tasks.workunit.client.1.smithi161.stdout:4/484: truncate d5/f8 2714274 0 2024-09-18T12:52:05.670 INFO:tasks.workunit.client.0.smithi045.stdout:1/197: creat d0/f3a x:0 0 0 2024-09-18T12:52:05.671 INFO:tasks.workunit.client.1.smithi161.stdout:0/446: symlink df/d84/la1 0 2024-09-18T12:52:05.672 INFO:tasks.workunit.client.1.smithi161.stdout:0/447: write df/d29/d46/d90/d37/f3e [1412208,125560] 0 2024-09-18T12:52:05.672 INFO:tasks.workunit.client.0.smithi045.stdout:7/168: unlink d13/f23 0 2024-09-18T12:52:05.675 INFO:tasks.workunit.client.0.smithi045.stdout:0/160: mknod d6/d7/d21/d23/c2c 0 2024-09-18T12:52:05.675 INFO:tasks.workunit.client.0.smithi045.stdout:0/161: fsync d6/d7/d21/f24 0 2024-09-18T12:52:05.677 INFO:tasks.workunit.client.1.smithi161.stdout:9/387: rename d0/d16/d25/d28/d45/c4e to d0/d16/d25/d46/c81 0 2024-09-18T12:52:05.683 INFO:tasks.workunit.client.0.smithi045.stdout:0/162: chown d6/c18 111 1 2024-09-18T12:52:05.685 INFO:tasks.workunit.client.0.smithi045.stdout:0/163: read d6/d7/f15 [828221,62950] 0 2024-09-18T12:52:05.686 INFO:tasks.workunit.client.0.smithi045.stdout:1/198: creat d0/d12/f3b x:0 0 0 2024-09-18T12:52:05.690 INFO:tasks.workunit.client.0.smithi045.stdout:2/241: truncate d5/d46/f53 59016 0 2024-09-18T12:52:05.692 INFO:tasks.workunit.client.1.smithi161.stdout:9/388: symlink d0/d16/d25/d46/d53/d59/l82 0 2024-09-18T12:52:05.693 INFO:tasks.workunit.client.1.smithi161.stdout:9/389: write d0/f6e [120343,41915] 0 2024-09-18T12:52:05.694 INFO:tasks.workunit.client.0.smithi045.stdout:2/242: fsync d5/f42 0 2024-09-18T12:52:05.696 INFO:tasks.workunit.client.1.smithi161.stdout:8/496: link d0/d3/c33 d0/d3/d91/ca8 0 2024-09-18T12:52:05.697 INFO:tasks.workunit.client.1.smithi161.stdout:8/497: write d0/f12 [1279794,25928] 0 2024-09-18T12:52:05.697 INFO:tasks.workunit.client.0.smithi045.stdout:7/169: dwrite d13/f24 [0,4194304] 0 2024-09-18T12:52:05.703 INFO:tasks.workunit.client.0.smithi045.stdout:0/164: creat d6/f2d x:0 0 0 2024-09-18T12:52:05.706 INFO:tasks.workunit.client.0.smithi045.stdout:7/170: dwrite d13/d1a/f27 [0,4194304] 0 2024-09-18T12:52:05.706 INFO:tasks.workunit.client.0.smithi045.stdout:7/171: chown d13/d1a 4 1 2024-09-18T12:52:05.707 INFO:tasks.workunit.client.0.smithi045.stdout:1/199: creat d0/f3c x:0 0 0 2024-09-18T12:52:05.708 INFO:tasks.workunit.client.0.smithi045.stdout:7/172: write f11 [156206,67668] 0 2024-09-18T12:52:05.709 INFO:tasks.workunit.client.1.smithi161.stdout:9/390: dread d0/f3 [0,4194304] 0 2024-09-18T12:52:05.711 INFO:tasks.workunit.client.0.smithi045.stdout:2/243: mkdir d5/d5f 0 2024-09-18T12:52:05.713 INFO:tasks.workunit.client.1.smithi161.stdout:3/474: sync 2024-09-18T12:52:05.713 INFO:tasks.workunit.client.1.smithi161.stdout:7/409: sync 2024-09-18T12:52:05.714 INFO:tasks.workunit.client.0.smithi045.stdout:0/165: unlink d6/d7/l16 0 2024-09-18T12:52:05.716 INFO:tasks.workunit.client.1.smithi161.stdout:4/485: creat d5/d27/d3a/d4c/fa0 x:0 0 0 2024-09-18T12:52:05.716 INFO:tasks.workunit.client.1.smithi161.stdout:7/410: readlink d3/d8/d15/d1a/d4a/d64/l67 0 2024-09-18T12:52:05.716 INFO:tasks.workunit.client.1.smithi161.stdout:6/471: dwrite d4/d1a/f14 [0,4194304] 0 2024-09-18T12:52:05.718 INFO:tasks.workunit.client.1.smithi161.stdout:1/372: getdents d1/d26/d3a 0 2024-09-18T12:52:05.719 INFO:tasks.workunit.client.0.smithi045.stdout:1/200: read d0/d2d/d2b/f2f [712573,109296] 0 2024-09-18T12:52:05.719 INFO:tasks.workunit.client.1.smithi161.stdout:7/411: truncate d3/d8/d15/d38/f21 4700814 0 2024-09-18T12:52:05.720 INFO:tasks.workunit.client.1.smithi161.stdout:1/373: write d1/da/d1f/d45/f6d [536652,7005] 0 2024-09-18T12:52:05.720 INFO:tasks.workunit.client.1.smithi161.stdout:0/448: rename df/d29/d46/d90/d37/f9a to df/d29/fa2 0 2024-09-18T12:52:05.721 INFO:tasks.workunit.client.1.smithi161.stdout:2/488: getdents d0/d1/df/d8a 0 2024-09-18T12:52:05.722 INFO:tasks.workunit.client.0.smithi045.stdout:2/244: write d5/d3a/f45 [1295514,126142] 0 2024-09-18T12:52:05.724 INFO:tasks.workunit.client.0.smithi045.stdout:2/245: write d5/d2c/d4d/f4e [653480,44554] 0 2024-09-18T12:52:05.725 INFO:tasks.workunit.client.1.smithi161.stdout:2/489: dread d0/f75 [0,4194304] 0 2024-09-18T12:52:05.726 INFO:tasks.workunit.client.0.smithi045.stdout:2/246: write d5/d2c/d4d/d16/f3b [2424719,64231] 0 2024-09-18T12:52:05.727 INFO:tasks.workunit.client.1.smithi161.stdout:3/475: mknod d1/d2e/d14/d78/d83/ca4 0 2024-09-18T12:52:05.728 INFO:tasks.workunit.client.0.smithi045.stdout:2/247: read d5/d2c/d4d/d33/f40 [70446,107156] 0 2024-09-18T12:52:05.729 INFO:tasks.workunit.client.0.smithi045.stdout:2/248: chown d5/d2c/d4d/d16/c26 1 1 2024-09-18T12:52:05.732 INFO:tasks.workunit.client.1.smithi161.stdout:9/391: dread d0/fd [0,4194304] 0 2024-09-18T12:52:05.732 INFO:tasks.workunit.client.1.smithi161.stdout:4/486: mkdir d5/d14/d5f/da1 0 2024-09-18T12:52:05.733 INFO:tasks.workunit.client.0.smithi045.stdout:7/173: truncate f2 3360729 0 2024-09-18T12:52:05.734 INFO:tasks.workunit.client.1.smithi161.stdout:8/498: symlink d0/d3/d10/d21/la9 0 2024-09-18T12:52:05.734 INFO:tasks.workunit.client.1.smithi161.stdout:8/499: fdatasync d0/d3/d10/d21/f37 0 2024-09-18T12:52:05.736 INFO:tasks.workunit.client.1.smithi161.stdout:8/500: chown d0/d3/d1e/f46 21286 1 2024-09-18T12:52:05.736 INFO:tasks.workunit.client.1.smithi161.stdout:9/392: dread d0/fd [0,4194304] 0 2024-09-18T12:52:05.736 INFO:tasks.workunit.client.1.smithi161.stdout:7/412: rename d3/d8/d15/d1a/d24/l6a to d3/d8/d4b/l72 0 2024-09-18T12:52:05.737 INFO:tasks.workunit.client.1.smithi161.stdout:7/413: dread - d3/d8/d15/d1a/d24/d31/f71 zero size 2024-09-18T12:52:05.742 INFO:tasks.workunit.client.1.smithi161.stdout:6/472: symlink d4/l8e 0 2024-09-18T12:52:05.742 INFO:tasks.workunit.client.1.smithi161.stdout:6/473: chown d4/d1a/c77 511748425 1 2024-09-18T12:52:05.744 INFO:tasks.workunit.client.0.smithi045.stdout:1/201: mkdir d0/d2d/d2b/d30/d3d 0 2024-09-18T12:52:05.747 INFO:tasks.workunit.client.1.smithi161.stdout:2/490: rename d0/d4/d9d to d0/d71/da9 0 2024-09-18T12:52:05.749 INFO:tasks.workunit.client.0.smithi045.stdout:0/166: rename d6/d7/f15 to d6/d7/d21/f2e 0 2024-09-18T12:52:05.751 INFO:tasks.workunit.client.1.smithi161.stdout:0/449: dwrite df/d30/f3a [0,4194304] 0 2024-09-18T12:52:05.751 INFO:tasks.workunit.client.0.smithi045.stdout:1/202: dwrite d0/d12/f24 [0,4194304] 0 2024-09-18T12:52:05.752 INFO:tasks.workunit.client.1.smithi161.stdout:0/450: chown df/d29/d36 617884 1 2024-09-18T12:52:05.754 INFO:tasks.workunit.client.0.smithi045.stdout:7/174: link d13/d1a/d28/f34 d13/d1a/d28/f39 0 2024-09-18T12:52:05.755 INFO:tasks.workunit.client.0.smithi045.stdout:6/195: sync 2024-09-18T12:52:05.755 INFO:tasks.workunit.client.0.smithi045.stdout:9/154: sync 2024-09-18T12:52:05.755 INFO:tasks.workunit.client.0.smithi045.stdout:3/204: sync 2024-09-18T12:52:05.755 INFO:tasks.workunit.client.0.smithi045.stdout:8/160: sync 2024-09-18T12:52:05.755 INFO:tasks.workunit.client.0.smithi045.stdout:5/299: sync 2024-09-18T12:52:05.756 INFO:tasks.workunit.client.1.smithi161.stdout:2/491: dwrite d0/d4/f68 [0,4194304] 0 2024-09-18T12:52:05.758 INFO:tasks.workunit.client.0.smithi045.stdout:0/167: symlink d6/d7/l2f 0 2024-09-18T12:52:05.759 INFO:tasks.workunit.client.1.smithi161.stdout:7/414: dread d3/f4 [0,4194304] 0 2024-09-18T12:52:05.763 INFO:tasks.workunit.client.1.smithi161.stdout:7/415: write d3/d8/d15/d1a/d4a/d59/f60 [650925,127337] 0 2024-09-18T12:52:05.765 INFO:tasks.workunit.client.1.smithi161.stdout:6/474: symlink d4/l8f 0 2024-09-18T12:52:05.766 INFO:tasks.workunit.client.0.smithi045.stdout:2/249: dwrite d5/d2c/d4d/d33/f3c [0,4194304] 0 2024-09-18T12:52:05.767 INFO:tasks.workunit.client.1.smithi161.stdout:6/475: dread - d4/d39/f74 zero size 2024-09-18T12:52:05.767 INFO:tasks.workunit.client.1.smithi161.stdout:2/492: rmdir d0/d5/d43/d35/d98 39 2024-09-18T12:52:05.767 INFO:tasks.workunit.client.0.smithi045.stdout:7/175: truncate d13/d1a/d28/f39 249803 0 2024-09-18T12:52:05.770 INFO:tasks.workunit.client.1.smithi161.stdout:7/416: dwrite d3/d8/d15/d38/f70 [0,4194304] 0 2024-09-18T12:52:05.771 INFO:tasks.workunit.client.0.smithi045.stdout:9/155: rename d0/f9 to d0/d3/d6/d10/d2c/f35 0 2024-09-18T12:52:05.772 INFO:tasks.workunit.client.0.smithi045.stdout:8/161: dread d11/f16 [0,4194304] 0 2024-09-18T12:52:05.773 INFO:tasks.workunit.client.0.smithi045.stdout:3/205: dwrite d0/f1f [0,4194304] 0 2024-09-18T12:52:05.774 INFO:tasks.workunit.client.0.smithi045.stdout:8/162: readlink l1 0 2024-09-18T12:52:05.776 INFO:tasks.workunit.client.1.smithi161.stdout:0/451: symlink df/d29/d46/d78/la3 0 2024-09-18T12:52:05.776 INFO:tasks.workunit.client.0.smithi045.stdout:5/300: dread d6/db/d19/d31/f45 [0,4194304] 0 2024-09-18T12:52:05.777 INFO:tasks.workunit.client.0.smithi045.stdout:5/301: stat d6/f7 0 2024-09-18T12:52:05.778 INFO:tasks.workunit.client.1.smithi161.stdout:0/452: write df/f15 [2928705,92012] 0 2024-09-18T12:52:05.779 INFO:tasks.workunit.client.0.smithi045.stdout:7/176: dread fc [0,4194304] 0 2024-09-18T12:52:05.780 INFO:tasks.workunit.client.0.smithi045.stdout:1/203: dread d0/d2e/f28 [0,4194304] 0 2024-09-18T12:52:05.781 INFO:tasks.workunit.client.1.smithi161.stdout:5/416: sync 2024-09-18T12:52:05.781 INFO:tasks.workunit.client.1.smithi161.stdout:6/476: creat d4/d61/d69/f90 x:0 0 0 2024-09-18T12:52:05.781 INFO:tasks.workunit.client.1.smithi161.stdout:5/417: stat d3/d14/d20/f32 0 2024-09-18T12:52:05.785 INFO:tasks.workunit.client.1.smithi161.stdout:2/493: fdatasync d0/d5/d43/f37 0 2024-09-18T12:52:05.786 INFO:tasks.workunit.client.0.smithi045.stdout:5/302: dwrite d6/d28/d2b/f4e [0,4194304] 0 2024-09-18T12:52:05.786 INFO:tasks.workunit.client.0.smithi045.stdout:2/250: rmdir d5/d3a 39 2024-09-18T12:52:05.789 INFO:tasks.workunit.client.1.smithi161.stdout:4/487: truncate d5/f36 2279498 0 2024-09-18T12:52:05.790 INFO:tasks.workunit.client.1.smithi161.stdout:0/453: dwrite df/d84/d86/f7e [0,4194304] 0 2024-09-18T12:52:05.791 INFO:tasks.workunit.client.1.smithi161.stdout:5/418: dread d3/d14/d20/d21/d46/f49 [0,4194304] 0 2024-09-18T12:52:05.794 INFO:tasks.workunit.client.1.smithi161.stdout:3/476: rename d1/d2e/d14/d65/d7a to d1/da5 0 2024-09-18T12:52:05.797 INFO:tasks.workunit.client.0.smithi045.stdout:8/163: mknod d11/c2f 0 2024-09-18T12:52:05.798 INFO:tasks.workunit.client.0.smithi045.stdout:8/164: chown lb 12795 1 2024-09-18T12:52:05.798 INFO:tasks.workunit.client.0.smithi045.stdout:8/165: chown d11/c2f 27 1 2024-09-18T12:52:05.799 INFO:tasks.workunit.client.0.smithi045.stdout:8/166: readlink l1 0 2024-09-18T12:52:05.799 INFO:tasks.workunit.client.0.smithi045.stdout:3/206: creat d0/d1e/d2c/d3a/f4a x:0 0 0 2024-09-18T12:52:05.800 INFO:tasks.workunit.client.1.smithi161.stdout:2/494: dwrite d0/d1/d3b/d3d/f88 [0,4194304] 0 2024-09-18T12:52:05.802 INFO:tasks.workunit.client.1.smithi161.stdout:2/495: write d0/d4/d52/f60 [3599564,60939] 0 2024-09-18T12:52:05.803 INFO:tasks.workunit.client.0.smithi045.stdout:7/177: rename d13/d31/f2c to d13/d1a/d28/f3a 0 2024-09-18T12:52:05.804 INFO:tasks.workunit.client.1.smithi161.stdout:2/496: fdatasync d0/d5/d43/d35/fa3 0 2024-09-18T12:52:05.806 INFO:tasks.workunit.client.0.smithi045.stdout:5/303: mkdir d6/d2a/d61 0 2024-09-18T12:52:05.807 INFO:tasks.workunit.client.1.smithi161.stdout:2/497: write d0/d4/d52/f59 [1473612,73429] 0 2024-09-18T12:52:05.808 INFO:tasks.workunit.client.1.smithi161.stdout:4/488: dread d5/d27/d3a/f80 [0,4194304] 0 2024-09-18T12:52:05.809 INFO:tasks.workunit.client.0.smithi045.stdout:3/207: dwrite d0/d1e/f2a [0,4194304] 0 2024-09-18T12:52:05.813 INFO:tasks.workunit.client.0.smithi045.stdout:0/168: creat d6/d7/d21/f30 x:0 0 0 2024-09-18T12:52:05.813 INFO:tasks.workunit.client.0.smithi045.stdout:4/172: sync 2024-09-18T12:52:05.818 INFO:tasks.workunit.client.0.smithi045.stdout:8/167: write d11/d20/f27 [1758461,43087] 0 2024-09-18T12:52:05.818 INFO:tasks.workunit.client.1.smithi161.stdout:8/501: rename d0/d3/d1e/l8f to d0/d3/d10/d21/d87/laa 0 2024-09-18T12:52:05.819 INFO:tasks.workunit.client.1.smithi161.stdout:2/498: symlink d0/d1/df/d8a/laa 0 2024-09-18T12:52:05.821 INFO:tasks.workunit.client.1.smithi161.stdout:2/499: write d0/d1/f7 [5881730,61277] 0 2024-09-18T12:52:05.821 INFO:tasks.workunit.client.0.smithi045.stdout:4/173: write db/d10/d2f/f36 [277481,53699] 0 2024-09-18T12:52:05.824 INFO:tasks.workunit.client.0.smithi045.stdout:4/174: chown db/de 192298903 1 2024-09-18T12:52:05.824 INFO:tasks.workunit.client.1.smithi161.stdout:8/502: symlink d0/d3/d10/lab 0 2024-09-18T12:52:05.824 INFO:tasks.workunit.client.0.smithi045.stdout:6/196: dread d9/f13 [0,4194304] 0 2024-09-18T12:52:05.825 INFO:tasks.workunit.client.1.smithi161.stdout:4/489: dread d5/f1a [0,4194304] 0 2024-09-18T12:52:05.827 INFO:tasks.workunit.client.1.smithi161.stdout:4/490: dread d5/d27/d3a/f7a [0,4194304] 0 2024-09-18T12:52:05.827 INFO:tasks.workunit.client.0.smithi045.stdout:7/178: rename d13/c18 to d13/d31/c3b 0 2024-09-18T12:52:05.829 INFO:tasks.workunit.client.0.smithi045.stdout:3/208: dwrite d0/f41 [0,4194304] 0 2024-09-18T12:52:05.830 INFO:tasks.workunit.client.1.smithi161.stdout:3/477: link d1/d2e/d14/d65/f6a d1/da5/fa6 0 2024-09-18T12:52:05.831 INFO:tasks.workunit.client.0.smithi045.stdout:5/304: dwrite d6/d2a/f60 [0,4194304] 0 2024-09-18T12:52:05.831 INFO:tasks.workunit.client.1.smithi161.stdout:3/478: chown d1/d2e/d3d/f9b 43 1 2024-09-18T12:52:05.832 INFO:tasks.workunit.client.1.smithi161.stdout:3/479: chown d1/d2e/d14/d65/f6c 0 1 2024-09-18T12:52:05.833 INFO:tasks.workunit.client.1.smithi161.stdout:4/491: getdents d5/d14/d5f/da1 0 2024-09-18T12:52:05.834 INFO:tasks.workunit.client.1.smithi161.stdout:0/454: dread df/d30/d4d/d92/f9e [0,4194304] 0 2024-09-18T12:52:05.835 INFO:tasks.workunit.client.0.smithi045.stdout:4/175: chown db/l15 1813 1 2024-09-18T12:52:05.838 INFO:tasks.workunit.client.0.smithi045.stdout:2/251: truncate d5/d3a/f4c 796696 0 2024-09-18T12:52:05.838 INFO:tasks.workunit.client.0.smithi045.stdout:4/176: fsync db/f21 0 2024-09-18T12:52:05.840 INFO:tasks.workunit.client.1.smithi161.stdout:1/374: sync 2024-09-18T12:52:05.842 INFO:tasks.workunit.client.1.smithi161.stdout:0/455: creat df/d29/d46/d90/d37/d55/fa4 x:0 0 0 2024-09-18T12:52:05.843 INFO:tasks.workunit.client.1.smithi161.stdout:8/503: link d0/d3/d10/f22 d0/d3/d10/d21/d4a/d52/d66/d5b/fac 0 2024-09-18T12:52:05.843 INFO:tasks.workunit.client.0.smithi045.stdout:0/169: dwrite d6/f1d [0,4194304] 0 2024-09-18T12:52:05.844 INFO:tasks.workunit.client.1.smithi161.stdout:4/492: dwrite d5/d27/d44/f88 [0,4194304] 0 2024-09-18T12:52:05.846 INFO:tasks.workunit.client.1.smithi161.stdout:8/504: write d0/d3/d10/d21/d4a/d52/d82/d96/f60 [582371,11674] 0 2024-09-18T12:52:05.847 INFO:tasks.workunit.client.1.smithi161.stdout:4/493: write d5/d14/d67/d84/f77 [846505,42640] 0 2024-09-18T12:52:05.850 INFO:tasks.workunit.client.0.smithi045.stdout:0/170: dread d6/f1d [0,4194304] 0 2024-09-18T12:52:05.855 INFO:tasks.workunit.client.1.smithi161.stdout:2/500: dread d0/d1/df/f1b [0,4194304] 0 2024-09-18T12:52:05.859 INFO:tasks.workunit.client.1.smithi161.stdout:7/417: truncate d3/d8/d4f/f61 2066817 0 2024-09-18T12:52:05.862 INFO:tasks.workunit.client.1.smithi161.stdout:3/480: getdents d1/d2e/d24 0 2024-09-18T12:52:05.864 INFO:tasks.workunit.client.1.smithi161.stdout:3/481: chown d1/da5/l63 7 1 2024-09-18T12:52:05.864 INFO:tasks.workunit.client.1.smithi161.stdout:8/505: dread d0/d3/d1e/f50 [0,4194304] 0 2024-09-18T12:52:05.865 INFO:tasks.workunit.client.0.smithi045.stdout:0/171: rmdir d6/d7 39 2024-09-18T12:52:05.868 INFO:tasks.workunit.client.1.smithi161.stdout:4/494: dwrite d5/d32/d39/d4d/f96 [4194304,4194304] 0 2024-09-18T12:52:05.868 INFO:tasks.workunit.client.0.smithi045.stdout:7/179: link d13/d1a/f25 d13/d31/d29/f3c 0 2024-09-18T12:52:05.869 INFO:tasks.workunit.client.0.smithi045.stdout:9/156: fdatasync d0/f2 0 2024-09-18T12:52:05.869 INFO:tasks.workunit.client.1.smithi161.stdout:3/482: write d1/d2e/d14/d65/d76/d88/f8e [62900,74202] 0 2024-09-18T12:52:05.869 INFO:tasks.workunit.client.1.smithi161.stdout:2/501: dread d0/f75 [0,4194304] 0 2024-09-18T12:52:05.873 INFO:tasks.workunit.client.1.smithi161.stdout:7/418: creat d3/d8/d15/d1a/d4a/d59/f73 x:0 0 0 2024-09-18T12:52:05.873 INFO:tasks.workunit.client.0.smithi045.stdout:5/305: creat d6/d2a/d5c/f62 x:0 0 0 2024-09-18T12:52:05.874 INFO:tasks.workunit.client.1.smithi161.stdout:3/483: chown d1/d2e/d14/d65 22046 1 2024-09-18T12:52:05.874 INFO:tasks.workunit.client.0.smithi045.stdout:1/204: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:52:05.877 INFO:tasks.workunit.client.1.smithi161.stdout:5/419: dwrite d3/d14/d20/d21/d46/f65 [0,4194304] 0 2024-09-18T12:52:05.877 INFO:tasks.workunit.client.1.smithi161.stdout:2/502: dread - d0/d5/d43/d35/fa3 zero size 2024-09-18T12:52:05.879 INFO:tasks.workunit.client.1.smithi161.stdout:3/484: chown d1/f19 733560 1 2024-09-18T12:52:05.880 INFO:tasks.workunit.client.0.smithi045.stdout:3/209: link d0/d1e/d2c/d3a/f3c d0/f4b 0 2024-09-18T12:52:05.882 INFO:tasks.workunit.client.1.smithi161.stdout:8/506: dwrite d0/d3/d10/f63 [0,4194304] 0 2024-09-18T12:52:05.889 INFO:tasks.workunit.client.0.smithi045.stdout:6/197: write d9/f28 [2809626,86536] 0 2024-09-18T12:52:05.891 INFO:tasks.workunit.client.0.smithi045.stdout:7/180: read fc [3253198,39759] 0 2024-09-18T12:52:05.894 INFO:tasks.workunit.client.1.smithi161.stdout:0/456: getdents df/d29/d46/d90/d37/d55 0 2024-09-18T12:52:05.895 INFO:tasks.workunit.client.1.smithi161.stdout:3/485: dwrite d1/d2e/d68/d69/f96 [0,4194304] 0 2024-09-18T12:52:05.896 INFO:tasks.workunit.client.1.smithi161.stdout:8/507: dwrite d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f84 [0,4194304] 0 2024-09-18T12:52:05.897 INFO:tasks.workunit.client.1.smithi161.stdout:1/375: write d1/d26/d3a/f3b [1039547,95377] 0 2024-09-18T12:52:05.899 INFO:tasks.workunit.client.1.smithi161.stdout:7/419: mknod d3/d8/d15/d1a/d4a/d59/c74 0 2024-09-18T12:52:05.899 INFO:tasks.workunit.client.1.smithi161.stdout:4/495: dread d5/f2c [0,4194304] 0 2024-09-18T12:52:05.904 INFO:tasks.workunit.client.0.smithi045.stdout:9/157: dwrite d0/d3/f1f [0,4194304] 0 2024-09-18T12:52:05.905 INFO:tasks.workunit.client.0.smithi045.stdout:2/252: link d5/d2c/c30 d5/d2c/c60 0 2024-09-18T12:52:05.905 INFO:tasks.workunit.client.0.smithi045.stdout:9/158: read - d0/d3/f31 zero size 2024-09-18T12:52:05.906 INFO:tasks.workunit.client.1.smithi161.stdout:7/420: dwrite d3/d8/d15/d1a/d4a/d59/f69 [0,4194304] 0 2024-09-18T12:52:05.906 INFO:tasks.workunit.client.1.smithi161.stdout:9/393: sync 2024-09-18T12:52:05.906 INFO:tasks.workunit.client.1.smithi161.stdout:6/477: sync 2024-09-18T12:52:05.907 INFO:tasks.workunit.client.0.smithi045.stdout:6/198: rmdir d9 39 2024-09-18T12:52:05.909 INFO:tasks.workunit.client.1.smithi161.stdout:7/421: chown d3/d8/d15/d1a/d4a/d64/l67 1586 1 2024-09-18T12:52:05.910 INFO:tasks.workunit.client.1.smithi161.stdout:7/422: stat d3/d8/d15/d1a/f41 0 2024-09-18T12:52:05.911 INFO:tasks.workunit.client.1.smithi161.stdout:7/423: write d3/d8/f29 [4258289,10219] 0 2024-09-18T12:52:05.917 INFO:tasks.workunit.client.1.smithi161.stdout:0/457: mkdir df/d84/d86/da5 0 2024-09-18T12:52:05.917 INFO:tasks.workunit.client.1.smithi161.stdout:6/478: dwrite d4/d39/d3a/f29 [4194304,4194304] 0 2024-09-18T12:52:05.918 INFO:tasks.workunit.client.1.smithi161.stdout:0/458: stat df 0 2024-09-18T12:52:05.919 INFO:tasks.workunit.client.1.smithi161.stdout:0/459: chown df/d29/d46/d90/d37/c54 222 1 2024-09-18T12:52:05.920 INFO:tasks.workunit.client.0.smithi045.stdout:5/306: creat d6/db/d19/d31/d53/f63 x:0 0 0 2024-09-18T12:52:05.924 INFO:tasks.workunit.client.0.smithi045.stdout:2/253: unlink d5/c59 0 2024-09-18T12:52:05.924 INFO:tasks.workunit.client.0.smithi045.stdout:4/177: dwrite db/d2c/d35/f3b [0,4194304] 0 2024-09-18T12:52:05.926 INFO:tasks.workunit.client.0.smithi045.stdout:2/254: read d5/d2c/d4d/d16/f3b [17020,12929] 0 2024-09-18T12:52:05.927 INFO:tasks.workunit.client.0.smithi045.stdout:9/159: symlink d0/d3/d6/d10/d2c/l36 0 2024-09-18T12:52:05.928 INFO:tasks.workunit.client.1.smithi161.stdout:1/376: creat d1/da/d31/f78 x:0 0 0 2024-09-18T12:52:05.929 INFO:tasks.workunit.client.0.smithi045.stdout:2/255: write d5/d2c/f58 [245788,66949] 0 2024-09-18T12:52:05.931 INFO:tasks.workunit.client.0.smithi045.stdout:7/181: truncate d13/d1a/f1b 1235364 0 2024-09-18T12:52:05.932 INFO:tasks.workunit.client.0.smithi045.stdout:2/256: write d5/d2c/d4d/f5a [573384,31418] 0 2024-09-18T12:52:05.933 INFO:tasks.workunit.client.0.smithi045.stdout:1/205: rename d0/d12/f24 to d0/f3e 0 2024-09-18T12:52:05.935 INFO:tasks.workunit.client.0.smithi045.stdout:4/178: creat db/de/d1a/f3d x:0 0 0 2024-09-18T12:52:05.936 INFO:tasks.workunit.client.0.smithi045.stdout:1/206: truncate d0/d2e/f22 5043748 0 2024-09-18T12:52:05.937 INFO:tasks.workunit.client.1.smithi161.stdout:9/394: unlink d0/f42 0 2024-09-18T12:52:05.937 INFO:tasks.workunit.client.1.smithi161.stdout:9/395: chown d0/db/d18/f80 177 1 2024-09-18T12:52:05.941 INFO:tasks.workunit.client.0.smithi045.stdout:4/179: dread db/d2c/d35/f3b [0,4194304] 0 2024-09-18T12:52:05.941 INFO:tasks.workunit.client.1.smithi161.stdout:7/424: creat d3/f75 x:0 0 0 2024-09-18T12:52:05.942 INFO:tasks.workunit.client.1.smithi161.stdout:5/420: symlink d3/d44/d6f/l83 0 2024-09-18T12:52:05.943 INFO:tasks.workunit.client.0.smithi045.stdout:7/182: symlink d13/d1a/l3d 0 2024-09-18T12:52:05.945 INFO:tasks.workunit.client.0.smithi045.stdout:3/210: rename d0/f16 to d0/d1e/d2c/d3f/d44/f4c 0 2024-09-18T12:52:05.945 INFO:tasks.workunit.client.1.smithi161.stdout:3/486: write d1/d2e/f5b [2608330,11131] 0 2024-09-18T12:52:05.946 INFO:tasks.workunit.client.1.smithi161.stdout:6/479: creat d4/d39/d48/f91 x:0 0 0 2024-09-18T12:52:05.949 INFO:tasks.workunit.client.1.smithi161.stdout:0/460: mknod df/d29/d36/ca6 0 2024-09-18T12:52:05.950 INFO:tasks.workunit.client.1.smithi161.stdout:8/508: mknod d0/d3/d10/d21/cad 0 2024-09-18T12:52:05.952 INFO:tasks.workunit.client.1.smithi161.stdout:7/425: dread d3/d8/d15/f26 [8388608,4194304] 0 2024-09-18T12:52:05.952 INFO:tasks.workunit.client.1.smithi161.stdout:6/480: dread d4/d1a/d1c/d3e/d4d/f72 [0,4194304] 0 2024-09-18T12:52:05.952 INFO:tasks.workunit.client.1.smithi161.stdout:8/509: stat d0/d3/d10/d21/d4a/d52/d66/l53 0 2024-09-18T12:52:05.952 INFO:tasks.workunit.client.0.smithi045.stdout:1/207: dread d0/d2d/d2b/f2f [0,4194304] 0 2024-09-18T12:52:05.954 INFO:tasks.workunit.client.1.smithi161.stdout:4/496: truncate d5/f20 40957 0 2024-09-18T12:52:05.958 INFO:tasks.workunit.client.0.smithi045.stdout:4/180: mkdir db/de/d1e/d3e 0 2024-09-18T12:52:05.958 INFO:tasks.workunit.client.1.smithi161.stdout:2/503: truncate d0/f7b 159314 0 2024-09-18T12:52:05.961 INFO:tasks.workunit.client.0.smithi045.stdout:7/183: creat d13/d1a/d28/f3e x:0 0 0 2024-09-18T12:52:05.962 INFO:tasks.workunit.client.0.smithi045.stdout:7/184: chown d13/d1c/l35 98527 1 2024-09-18T12:52:05.962 INFO:tasks.workunit.client.0.smithi045.stdout:5/307: dread d6/d28/d2b/f2d [0,4194304] 0 2024-09-18T12:52:05.962 INFO:tasks.workunit.client.0.smithi045.stdout:5/308: readlink d6/d28/d2b/l58 0 2024-09-18T12:52:05.965 INFO:tasks.workunit.client.1.smithi161.stdout:9/396: symlink d0/d47/d48/l83 0 2024-09-18T12:52:05.966 INFO:tasks.workunit.client.1.smithi161.stdout:9/397: fsync d0/d16/d25/d28/f3f 0 2024-09-18T12:52:05.967 INFO:tasks.workunit.client.1.smithi161.stdout:5/421: creat d3/d14/f84 x:0 0 0 2024-09-18T12:52:05.972 INFO:tasks.workunit.client.0.smithi045.stdout:1/208: write d0/fb [5128320,84855] 0 2024-09-18T12:52:05.972 INFO:tasks.workunit.client.1.smithi161.stdout:6/481: readlink d4/d39/d26/l6a 0 2024-09-18T12:52:05.973 INFO:tasks.workunit.client.0.smithi045.stdout:6/199: link d9/d1a/d1d/c34 d9/d1a/d2d/d38/c3f 0 2024-09-18T12:52:05.974 INFO:tasks.workunit.client.1.smithi161.stdout:8/510: creat d0/d3/d10/d21/d4a/d52/d66/d5b/fae x:0 0 0 2024-09-18T12:52:05.977 INFO:tasks.workunit.client.1.smithi161.stdout:4/497: rmdir d5 39 2024-09-18T12:52:05.978 INFO:tasks.workunit.client.0.smithi045.stdout:1/209: dwrite d0/d12/f13 [0,4194304] 0 2024-09-18T12:52:05.981 INFO:tasks.workunit.client.1.smithi161.stdout:1/377: rename d1/d1d/c2d to d1/d26/c79 0 2024-09-18T12:52:05.982 INFO:tasks.workunit.client.0.smithi045.stdout:7/185: symlink d13/d31/l3f 0 2024-09-18T12:52:05.984 INFO:tasks.workunit.client.1.smithi161.stdout:2/504: mkdir d0/d4/dab 0 2024-09-18T12:52:05.985 INFO:tasks.workunit.client.1.smithi161.stdout:2/505: write d0/d4/f68 [4100688,23135] 0 2024-09-18T12:52:05.986 INFO:tasks.workunit.client.1.smithi161.stdout:2/506: write d0/d4/f68 [4455811,61330] 0 2024-09-18T12:52:05.993 INFO:tasks.workunit.client.0.smithi045.stdout:1/210: fdatasync d0/f23 0 2024-09-18T12:52:05.994 INFO:tasks.workunit.client.0.smithi045.stdout:2/257: truncate d5/f34 3556772 0 2024-09-18T12:52:05.996 INFO:tasks.workunit.client.1.smithi161.stdout:0/461: mknod df/d30/d4d/d92/d95/ca7 0 2024-09-18T12:52:05.997 INFO:tasks.workunit.client.0.smithi045.stdout:7/186: write d13/d1a/d28/f3a [162102,91384] 0 2024-09-18T12:52:05.997 INFO:tasks.workunit.client.1.smithi161.stdout:6/482: mknod d4/d61/c92 0 2024-09-18T12:52:06.001 INFO:tasks.workunit.client.0.smithi045.stdout:3/211: creat d0/f4d x:0 0 0 2024-09-18T12:52:06.003 INFO:tasks.workunit.client.1.smithi161.stdout:8/511: rename d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/l9d to d0/d3/d10/d21/d4a/d52/d66/laf 0 2024-09-18T12:52:06.004 INFO:tasks.workunit.client.0.smithi045.stdout:3/212: truncate d0/d22/f3d 894534 0 2024-09-18T12:52:06.004 INFO:tasks.workunit.client.0.smithi045.stdout:7/187: dwrite d13/d1a/f2e [0,4194304] 0 2024-09-18T12:52:06.004 INFO:tasks.workunit.client.1.smithi161.stdout:4/498: dwrite d5/d27/d44/f63 [0,4194304] 0 2024-09-18T12:52:06.006 INFO:tasks.workunit.client.1.smithi161.stdout:1/378: creat d1/da/d1f/f7a x:0 0 0 2024-09-18T12:52:06.008 INFO:tasks.workunit.client.0.smithi045.stdout:2/258: mkdir d5/d2c/d4d/d16/d61 0 2024-09-18T12:52:06.011 INFO:tasks.workunit.client.0.smithi045.stdout:0/172: rename d6/d7/l22 to d6/l31 0 2024-09-18T12:52:06.012 INFO:tasks.workunit.client.1.smithi161.stdout:2/507: symlink d0/d4/d52/lac 0 2024-09-18T12:52:06.012 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:05 smithi045 ceph-mon[28315]: pgmap v25: 65 pgs: 65 active+clean; 956 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 124 MiB/s wr, 243 op/s 2024-09-18T12:52:06.014 INFO:tasks.workunit.client.1.smithi161.stdout:5/422: mkdir d3/d9/d85 0 2024-09-18T12:52:06.015 INFO:tasks.workunit.client.0.smithi045.stdout:3/213: symlink d0/d22/l4e 0 2024-09-18T12:52:06.015 INFO:tasks.workunit.client.0.smithi045.stdout:1/211: dwrite d0/f7 [4194304,4194304] 0 2024-09-18T12:52:06.016 INFO:tasks.workunit.client.0.smithi045.stdout:2/259: read d5/d2c/d4d/f28 [1390004,113913] 0 2024-09-18T12:52:06.018 INFO:tasks.workunit.client.0.smithi045.stdout:9/160: rename d0/d3/d6/d10/l1e to d0/d3/d6/d10/d2c/l37 0 2024-09-18T12:52:06.019 INFO:tasks.workunit.client.0.smithi045.stdout:9/161: write d0/d3/f1f [2445660,9989] 0 2024-09-18T12:52:06.020 INFO:tasks.workunit.client.1.smithi161.stdout:0/462: creat df/d29/d46/d51/fa8 x:0 0 0 2024-09-18T12:52:06.021 INFO:tasks.workunit.client.0.smithi045.stdout:0/173: mkdir d6/d7/d32 0 2024-09-18T12:52:06.022 INFO:tasks.workunit.client.1.smithi161.stdout:6/483: creat d4/d39/d47/d51/f93 x:0 0 0 2024-09-18T12:52:06.025 INFO:tasks.workunit.client.0.smithi045.stdout:2/260: mknod d5/d3a/d3e/c62 0 2024-09-18T12:52:06.027 INFO:tasks.workunit.client.0.smithi045.stdout:4/181: rename db/d20/c33 to db/d10/d2f/c3f 0 2024-09-18T12:52:06.027 INFO:tasks.workunit.client.1.smithi161.stdout:0/463: dwrite df/d29/f3b [4194304,4194304] 0 2024-09-18T12:52:06.028 INFO:tasks.workunit.client.0.smithi045.stdout:4/182: dread - db/de/d1a/f3d zero size 2024-09-18T12:52:06.028 INFO:tasks.workunit.client.1.smithi161.stdout:4/499: creat d5/d27/d3a/d47/fa2 x:0 0 0 2024-09-18T12:52:06.029 INFO:tasks.workunit.client.1.smithi161.stdout:4/500: chown d5/d27/d3a/c8d 1 1 2024-09-18T12:52:06.030 INFO:tasks.workunit.client.1.smithi161.stdout:1/379: creat d1/d26/d3a/f7b x:0 0 0 2024-09-18T12:52:06.035 INFO:tasks.workunit.client.1.smithi161.stdout:5/423: mkdir d3/d44/d6f/d86 0 2024-09-18T12:52:06.035 INFO:tasks.workunit.client.0.smithi045.stdout:9/162: dread d0/d3/d6/f2d [0,4194304] 0 2024-09-18T12:52:06.039 INFO:tasks.workunit.client.0.smithi045.stdout:2/261: creat d5/d2c/f63 x:0 0 0 2024-09-18T12:52:06.039 INFO:tasks.workunit.client.0.smithi045.stdout:9/163: dread d0/d3/d6/d10/f29 [0,4194304] 0 2024-09-18T12:52:06.040 INFO:tasks.workunit.client.1.smithi161.stdout:6/484: creat d4/d39/d26/d20/d28/f94 x:0 0 0 2024-09-18T12:52:06.041 INFO:tasks.workunit.client.1.smithi161.stdout:6/485: readlink d4/d39/d48/l67 0 2024-09-18T12:52:06.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:05 smithi161 ceph-mon[35784]: pgmap v25: 65 pgs: 65 active+clean; 956 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 124 MiB/s wr, 243 op/s 2024-09-18T12:52:06.042 INFO:tasks.workunit.client.0.smithi045.stdout:6/200: rename d9/f29 to d9/d1a/d2d/d38/f40 0 2024-09-18T12:52:06.044 INFO:tasks.workunit.client.0.smithi045.stdout:4/183: mkdir db/d2c/d35/d40 0 2024-09-18T12:52:06.045 INFO:tasks.workunit.client.1.smithi161.stdout:0/464: creat df/d30/d71/fa9 x:0 0 0 2024-09-18T12:52:06.049 INFO:tasks.workunit.client.0.smithi045.stdout:6/201: dwrite d9/d1a/f2e [0,4194304] 0 2024-09-18T12:52:06.049 INFO:tasks.workunit.client.1.smithi161.stdout:1/380: mknod d1/da/d39/c7c 0 2024-09-18T12:52:06.050 INFO:tasks.workunit.client.0.smithi045.stdout:6/202: fdatasync d9/f28 0 2024-09-18T12:52:06.051 INFO:tasks.workunit.client.0.smithi045.stdout:9/164: mknod d0/d3/d6/d10/d26/c38 0 2024-09-18T12:52:06.052 INFO:tasks.workunit.client.0.smithi045.stdout:9/165: write d0/d3/f2b [960576,43017] 0 2024-09-18T12:52:06.054 INFO:tasks.workunit.client.0.smithi045.stdout:9/166: readlink d0/d3/d6/d10/d26/d2e/l25 0 2024-09-18T12:52:06.055 INFO:tasks.workunit.client.1.smithi161.stdout:5/424: mknod d3/d14/c87 0 2024-09-18T12:52:06.057 INFO:tasks.workunit.client.0.smithi045.stdout:1/212: rename d0/d2e/f2c to d0/d2d/d2b/f3f 0 2024-09-18T12:52:06.059 INFO:tasks.workunit.client.0.smithi045.stdout:4/184: symlink db/d1b/l41 0 2024-09-18T12:52:06.059 INFO:tasks.workunit.client.0.smithi045.stdout:4/185: chown db/de/d1a 14252650 1 2024-09-18T12:52:06.060 INFO:tasks.workunit.client.0.smithi045.stdout:4/186: stat db/d10/d13 0 2024-09-18T12:52:06.063 INFO:tasks.workunit.client.1.smithi161.stdout:9/398: sync 2024-09-18T12:52:06.063 INFO:tasks.workunit.client.1.smithi161.stdout:7/426: sync 2024-09-18T12:52:06.064 INFO:tasks.workunit.client.1.smithi161.stdout:4/501: creat d5/d27/d44/d61/d6c/d8f/fa3 x:0 0 0 2024-09-18T12:52:06.064 INFO:tasks.workunit.client.0.smithi045.stdout:7/188: dwrite d13/d31/f26 [0,4194304] 0 2024-09-18T12:52:06.067 INFO:tasks.workunit.client.0.smithi045.stdout:6/203: mknod d9/d1a/d2d/c41 0 2024-09-18T12:52:06.068 INFO:tasks.workunit.client.1.smithi161.stdout:7/427: dread d3/d8/d15/d38/f70 [0,4194304] 0 2024-09-18T12:52:06.068 INFO:tasks.workunit.client.1.smithi161.stdout:7/428: chown d3/d8/d15/d1a/f41 33311 1 2024-09-18T12:52:06.069 INFO:tasks.workunit.client.1.smithi161.stdout:2/508: rename d0/d1/df/d8a/l8d to d0/d1/d3b/lad 0 2024-09-18T12:52:06.069 INFO:tasks.workunit.client.1.smithi161.stdout:7/429: dread - d3/d8/d15/d1a/d4a/d59/f73 zero size 2024-09-18T12:52:06.072 INFO:tasks.workunit.client.1.smithi161.stdout:2/509: dread - d0/d1/d3b/d3d/f99 zero size 2024-09-18T12:52:06.072 INFO:tasks.workunit.client.1.smithi161.stdout:5/425: write d3/d14/d20/d21/d24/d61/f6b [947818,114392] 0 2024-09-18T12:52:06.073 INFO:tasks.workunit.client.0.smithi045.stdout:2/262: link d5/d2c/f58 d5/d2c/d4d/d16/f64 0 2024-09-18T12:52:06.074 INFO:tasks.workunit.client.0.smithi045.stdout:2/263: dread - d5/d2c/d4d/f54 zero size 2024-09-18T12:52:06.075 INFO:tasks.workunit.client.1.smithi161.stdout:3/487: getdents d1/d2e/d14 0 2024-09-18T12:52:06.075 INFO:tasks.workunit.client.0.smithi045.stdout:2/264: read d5/d2c/d4d/f5a [586052,1033] 0 2024-09-18T12:52:06.076 INFO:tasks.workunit.client.1.smithi161.stdout:7/430: dwrite d3/f2e [0,4194304] 0 2024-09-18T12:52:06.077 INFO:tasks.workunit.client.0.smithi045.stdout:2/265: dread d5/d2c/d4d/d33/f40 [0,4194304] 0 2024-09-18T12:52:06.077 INFO:tasks.workunit.client.1.smithi161.stdout:3/488: chown d1/d2e/d14/d65/d76/d88 5295 1 2024-09-18T12:52:06.079 INFO:tasks.workunit.client.1.smithi161.stdout:3/489: write d1/f8b [3320897,115538] 0 2024-09-18T12:52:06.080 INFO:tasks.workunit.client.0.smithi045.stdout:0/174: write d6/d7/fa [61788,85263] 0 2024-09-18T12:52:06.081 INFO:tasks.workunit.client.1.smithi161.stdout:5/426: dwrite d3/d9/f38 [0,4194304] 0 2024-09-18T12:52:06.082 INFO:tasks.workunit.client.1.smithi161.stdout:5/427: stat d3/d9/f2d 0 2024-09-18T12:52:06.083 INFO:tasks.workunit.client.1.smithi161.stdout:5/428: write d3/f66 [503913,26717] 0 2024-09-18T12:52:06.085 INFO:tasks.workunit.client.0.smithi045.stdout:6/204: dread d9/f18 [0,4194304] 0 2024-09-18T12:52:06.088 INFO:tasks.workunit.client.0.smithi045.stdout:4/187: creat db/de/d1e/f42 x:0 0 0 2024-09-18T12:52:06.091 INFO:tasks.workunit.client.1.smithi161.stdout:8/512: sync 2024-09-18T12:52:06.092 INFO:tasks.workunit.client.0.smithi045.stdout:1/213: dwrite d0/f16 [0,4194304] 0 2024-09-18T12:52:06.097 INFO:tasks.workunit.client.1.smithi161.stdout:4/502: symlink d5/d27/d44/d61/d6c/d8f/la4 0 2024-09-18T12:52:06.097 INFO:tasks.workunit.client.1.smithi161.stdout:4/503: chown d5/d27/d3a/d4c/f64 88720344 1 2024-09-18T12:52:06.103 INFO:tasks.workunit.client.0.smithi045.stdout:9/167: rename d0/d3/d6/c2f to d0/d3/c39 0 2024-09-18T12:52:06.105 INFO:tasks.workunit.client.1.smithi161.stdout:2/510: creat d0/d4/d78/fae x:0 0 0 2024-09-18T12:52:06.105 INFO:tasks.workunit.client.0.smithi045.stdout:9/168: write d0/d3/d6/d10/d26/d2e/f32 [755173,36684] 0 2024-09-18T12:52:06.105 INFO:tasks.workunit.client.0.smithi045.stdout:0/175: fsync d6/f1d 0 2024-09-18T12:52:06.106 INFO:tasks.workunit.client.0.smithi045.stdout:9/169: stat d0/d3/d6/d10 0 2024-09-18T12:52:06.106 INFO:tasks.workunit.client.0.smithi045.stdout:9/170: chown d0 28 1 2024-09-18T12:52:06.107 INFO:tasks.workunit.client.0.smithi045.stdout:4/188: rmdir db/de 39 2024-09-18T12:52:06.108 INFO:tasks.workunit.client.0.smithi045.stdout:4/189: chown db/d2c/d35/d40 771306 1 2024-09-18T12:52:06.109 INFO:tasks.workunit.client.1.smithi161.stdout:0/465: truncate df/d30/d4d/f7b 2131004 0 2024-09-18T12:52:06.110 INFO:tasks.workunit.client.0.smithi045.stdout:4/190: write db/f21 [4859077,39361] 0 2024-09-18T12:52:06.110 INFO:tasks.workunit.client.1.smithi161.stdout:7/431: mknod d3/d36/c76 0 2024-09-18T12:52:06.111 INFO:tasks.workunit.client.1.smithi161.stdout:0/466: readlink df/d30/d4d/l99 0 2024-09-18T12:52:06.111 INFO:tasks.workunit.client.0.smithi045.stdout:1/214: mkdir d0/d2d/d2b/d30/d40 0 2024-09-18T12:52:06.113 INFO:tasks.workunit.client.1.smithi161.stdout:2/511: dwrite d0/d4/d52/d8b/f8c [0,4194304] 0 2024-09-18T12:52:06.113 INFO:tasks.workunit.client.1.smithi161.stdout:0/467: readlink df/d30/d4d/l6f 0 2024-09-18T12:52:06.113 INFO:tasks.workunit.client.1.smithi161.stdout:7/432: chown d3/d8/d15/d38/d55/f6c 131 1 2024-09-18T12:52:06.113 INFO:tasks.workunit.client.1.smithi161.stdout:6/486: dwrite d4/d39/d26/f55 [0,4194304] 0 2024-09-18T12:52:06.114 INFO:tasks.workunit.client.1.smithi161.stdout:3/490: fdatasync d1/d2e/d14/d2c/f31 0 2024-09-18T12:52:06.114 INFO:tasks.workunit.client.1.smithi161.stdout:6/487: stat d4/d1a/l12 0 2024-09-18T12:52:06.116 INFO:tasks.workunit.client.0.smithi045.stdout:7/189: rename d13/d1a/f25 to d13/d31/f40 0 2024-09-18T12:52:06.117 INFO:tasks.workunit.client.0.smithi045.stdout:6/205: rename d9/d1a/d2d/d38 to d9/d1a/d2d/d38/d42 22 2024-09-18T12:52:06.117 INFO:tasks.workunit.client.0.smithi045.stdout:9/171: rename d0/d3 to d0/d3/d6/d10/d26/d3a 22 2024-09-18T12:52:06.118 INFO:tasks.workunit.client.1.smithi161.stdout:8/513: mknod d0/d3/d91/cb0 0 2024-09-18T12:52:06.122 INFO:tasks.workunit.client.0.smithi045.stdout:1/215: dwrite d0/d2d/f35 [0,4194304] 0 2024-09-18T12:52:06.123 INFO:tasks.workunit.client.0.smithi045.stdout:9/172: truncate d0/d3/f2b 4221237 0 2024-09-18T12:52:06.124 INFO:tasks.workunit.client.1.smithi161.stdout:7/433: dwrite d3/d8/d15/d1a/d4a/d59/f69 [0,4194304] 0 2024-09-18T12:52:06.125 INFO:tasks.workunit.client.1.smithi161.stdout:9/399: truncate d0/d16/d25/d46/d53/f56 2414181 0 2024-09-18T12:52:06.131 INFO:tasks.workunit.client.1.smithi161.stdout:6/488: unlink d4/d39/d48/f91 0 2024-09-18T12:52:06.131 INFO:tasks.workunit.client.0.smithi045.stdout:2/266: link d5/ca d5/d3a/c65 0 2024-09-18T12:52:06.132 INFO:tasks.workunit.client.1.smithi161.stdout:5/429: mknod d3/d9/c88 0 2024-09-18T12:52:06.132 INFO:tasks.workunit.client.1.smithi161.stdout:3/491: creat d1/d2e/d14/d78/d83/fa7 x:0 0 0 2024-09-18T12:52:06.134 INFO:tasks.workunit.client.1.smithi161.stdout:1/381: dwrite d1/da/d1f/d45/f47 [0,4194304] 0 2024-09-18T12:52:06.134 INFO:tasks.workunit.client.1.smithi161.stdout:5/430: write d3/d14/d20/f3e [4350035,46738] 0 2024-09-18T12:52:06.134 INFO:tasks.workunit.client.0.smithi045.stdout:1/216: mknod d0/d12/c41 0 2024-09-18T12:52:06.136 INFO:tasks.workunit.client.1.smithi161.stdout:1/382: write d1/d26/d3a/d52/f59 [1368655,67652] 0 2024-09-18T12:52:06.136 INFO:tasks.workunit.client.1.smithi161.stdout:2/512: rename d0/d1/df/d8a/laa to d0/d1/d3b/d3d/d4f/laf 0 2024-09-18T12:52:06.138 INFO:tasks.workunit.client.0.smithi045.stdout:4/191: dwrite db/de/d1e/f2d [0,4194304] 0 2024-09-18T12:52:06.140 INFO:tasks.workunit.client.0.smithi045.stdout:6/206: dwrite d9/d30/f35 [0,4194304] 0 2024-09-18T12:52:06.141 INFO:tasks.workunit.client.0.smithi045.stdout:4/192: read - db/de/d1a/f3d zero size 2024-09-18T12:52:06.143 INFO:tasks.workunit.client.1.smithi161.stdout:7/434: mkdir d3/d8/d15/d38/d77 0 2024-09-18T12:52:06.143 INFO:tasks.workunit.client.1.smithi161.stdout:9/400: rmdir d0/d16/d25/d46/d53 39 2024-09-18T12:52:06.145 INFO:tasks.workunit.client.0.smithi045.stdout:4/193: truncate db/d10/d2f/f36 653416 0 2024-09-18T12:52:06.145 INFO:tasks.workunit.client.0.smithi045.stdout:9/173: rename d0/d3/d6/l19 to d0/d3/d6/l3b 0 2024-09-18T12:52:06.148 INFO:tasks.workunit.client.1.smithi161.stdout:6/489: write d4/d1a/f13 [402063,102898] 0 2024-09-18T12:52:06.149 INFO:tasks.workunit.client.0.smithi045.stdout:9/174: readlink d0/d3/d6/l28 0 2024-09-18T12:52:06.150 INFO:tasks.workunit.client.1.smithi161.stdout:7/435: dwrite d3/d8/d15/d1a/d4a/d59/f6e [0,4194304] 0 2024-09-18T12:52:06.152 INFO:tasks.workunit.client.1.smithi161.stdout:6/490: read d4/d39/d3a/f1f [3704419,88940] 0 2024-09-18T12:52:06.152 INFO:tasks.workunit.client.0.smithi045.stdout:6/207: write f5 [4572217,115210] 0 2024-09-18T12:52:06.155 INFO:tasks.workunit.client.0.smithi045.stdout:6/208: chown d9/f28 282284 1 2024-09-18T12:52:06.158 INFO:tasks.workunit.client.0.smithi045.stdout:2/267: dwrite d5/d2c/d4d/f54 [0,4194304] 0 2024-09-18T12:52:06.160 INFO:tasks.workunit.client.1.smithi161.stdout:5/431: rename d3/d8/c43 to d3/d44/d6f/d86/c89 0 2024-09-18T12:52:06.161 INFO:tasks.workunit.client.1.smithi161.stdout:1/383: mknod d1/d26/d3a/c7d 0 2024-09-18T12:52:06.163 INFO:tasks.workunit.client.0.smithi045.stdout:0/176: dread f4 [0,4194304] 0 2024-09-18T12:52:06.164 INFO:tasks.workunit.client.1.smithi161.stdout:8/514: rmdir d0/d3/d10/d21/d4a/d52/d70 39 2024-09-18T12:52:06.164 INFO:tasks.workunit.client.0.smithi045.stdout:4/194: mkdir db/d1b/d43 0 2024-09-18T12:52:06.177 INFO:tasks.workunit.client.0.smithi045.stdout:7/190: dwrite d13/d1a/d28/f34 [0,4194304] 0 2024-09-18T12:52:06.178 INFO:tasks.workunit.client.1.smithi161.stdout:7/436: symlink d3/d50/l78 0 2024-09-18T12:52:06.179 INFO:tasks.workunit.client.1.smithi161.stdout:7/437: chown d3/d8/d15/d1a/d44/c49 0 1 2024-09-18T12:52:06.180 INFO:tasks.workunit.client.0.smithi045.stdout:4/195: fdatasync db/d1b/f23 0 2024-09-18T12:52:06.183 INFO:tasks.workunit.client.1.smithi161.stdout:4/504: truncate d5/d32/d39/d4d/f78 3305406 0 2024-09-18T12:52:06.185 INFO:tasks.workunit.client.0.smithi045.stdout:2/268: creat d5/d2c/d4d/d16/d61/f66 x:0 0 0 2024-09-18T12:52:06.185 INFO:tasks.workunit.client.0.smithi045.stdout:4/196: dread db/d10/d2f/f36 [0,4194304] 0 2024-09-18T12:52:06.186 INFO:tasks.workunit.client.0.smithi045.stdout:1/217: write d0/d2e/f28 [173931,86510] 0 2024-09-18T12:52:06.187 INFO:tasks.workunit.client.1.smithi161.stdout:5/432: creat d3/d14/d20/d21/f8a x:0 0 0 2024-09-18T12:52:06.187 INFO:tasks.workunit.client.0.smithi045.stdout:0/177: creat d6/d7/d32/f33 x:0 0 0 2024-09-18T12:52:06.190 INFO:tasks.workunit.client.0.smithi045.stdout:7/191: creat d13/d1a/f41 x:0 0 0 2024-09-18T12:52:06.191 INFO:tasks.workunit.client.0.smithi045.stdout:7/192: dread - d13/d1a/d28/f3e zero size 2024-09-18T12:52:06.194 INFO:tasks.workunit.client.0.smithi045.stdout:2/269: rmdir d5/d2c 39 2024-09-18T12:52:06.195 INFO:tasks.workunit.client.0.smithi045.stdout:4/197: fsync db/d2c/d35/f3b 0 2024-09-18T12:52:06.196 INFO:tasks.workunit.client.1.smithi161.stdout:7/438: dread d3/d8/d15/d1a/d24/f51 [0,4194304] 0 2024-09-18T12:52:06.196 INFO:tasks.workunit.client.1.smithi161.stdout:9/401: mkdir d0/d47/d48/d7f/d84 0 2024-09-18T12:52:06.197 INFO:tasks.workunit.client.1.smithi161.stdout:9/402: write d0/db/f50 [234701,84285] 0 2024-09-18T12:52:06.197 INFO:tasks.workunit.client.0.smithi045.stdout:1/218: creat d0/d2e/f42 x:0 0 0 2024-09-18T12:52:06.198 INFO:tasks.workunit.client.1.smithi161.stdout:9/403: fsync d0/f24 0 2024-09-18T12:52:06.199 INFO:tasks.workunit.client.1.smithi161.stdout:9/404: stat d0/d16/d25/d28/d45/f79 0 2024-09-18T12:52:06.199 INFO:tasks.workunit.client.1.smithi161.stdout:9/405: chown d0/d16/d25/d28/f33 72842651 1 2024-09-18T12:52:06.200 INFO:tasks.workunit.client.0.smithi045.stdout:2/270: dread d5/d3a/f45 [0,4194304] 0 2024-09-18T12:52:06.200 INFO:tasks.workunit.client.0.smithi045.stdout:0/178: symlink d6/d7/d32/l34 0 2024-09-18T12:52:06.205 INFO:tasks.workunit.client.1.smithi161.stdout:9/406: dwrite d0/d20/d49/f19 [4194304,4194304] 0 2024-09-18T12:52:06.205 INFO:tasks.workunit.client.1.smithi161.stdout:9/407: read d0/fd [3159957,127715] 0 2024-09-18T12:52:06.206 INFO:tasks.workunit.client.0.smithi045.stdout:0/179: dwrite f4 [0,4194304] 0 2024-09-18T12:52:06.208 INFO:tasks.workunit.client.0.smithi045.stdout:4/198: rename db/d10/d2f/f32 to db/d20/f44 0 2024-09-18T12:52:06.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/384: symlink d1/d71/l7e 0 2024-09-18T12:52:06.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/385: fdatasync d1/da/d39/f67 0 2024-09-18T12:52:06.213 INFO:tasks.workunit.client.0.smithi045.stdout:4/199: dread db/d1b/f23 [0,4194304] 0 2024-09-18T12:52:06.214 INFO:tasks.workunit.client.0.smithi045.stdout:4/200: fsync db/d2c/d35/f3b 0 2024-09-18T12:52:06.215 INFO:tasks.workunit.client.1.smithi161.stdout:8/515: mknod d0/d3/cb1 0 2024-09-18T12:52:06.220 INFO:tasks.workunit.client.1.smithi161.stdout:2/513: rmdir d0/d1/d4c/d67/d96 0 2024-09-18T12:52:06.222 INFO:tasks.workunit.client.0.smithi045.stdout:1/219: creat d0/d12/d32/d37/f43 x:0 0 0 2024-09-18T12:52:06.224 INFO:tasks.workunit.client.0.smithi045.stdout:2/271: chown d5/d2c/d4d/l38 109768 1 2024-09-18T12:52:06.224 INFO:tasks.workunit.client.0.smithi045.stdout:2/272: readlink d5/d2c/l57 0 2024-09-18T12:52:06.226 INFO:tasks.workunit.client.0.smithi045.stdout:2/273: dread d5/d2c/d4d/d16/f2e [0,4194304] 0 2024-09-18T12:52:06.226 INFO:tasks.workunit.client.0.smithi045.stdout:0/180: mkdir d6/d35 0 2024-09-18T12:52:06.227 INFO:tasks.workunit.client.1.smithi161.stdout:6/491: creat d4/f95 x:0 0 0 2024-09-18T12:52:06.228 INFO:tasks.workunit.client.0.smithi045.stdout:1/220: mknod d0/d2d/d2b/d30/c44 0 2024-09-18T12:52:06.230 INFO:tasks.workunit.client.0.smithi045.stdout:2/274: write d5/f9 [843188,57287] 0 2024-09-18T12:52:06.230 INFO:tasks.workunit.client.1.smithi161.stdout:1/386: symlink d1/d48/l7f 0 2024-09-18T12:52:06.231 INFO:tasks.workunit.client.0.smithi045.stdout:0/181: rmdir d6/d7 39 2024-09-18T12:52:06.231 INFO:tasks.workunit.client.1.smithi161.stdout:1/387: readlink d1/da/d1f/l22 0 2024-09-18T12:52:06.232 INFO:tasks.workunit.client.1.smithi161.stdout:5/433: mknod d3/d3b/d7b/d82/c8b 0 2024-09-18T12:52:06.233 INFO:tasks.workunit.client.0.smithi045.stdout:1/221: write d0/fa [522908,29610] 0 2024-09-18T12:52:06.234 INFO:tasks.workunit.client.0.smithi045.stdout:1/222: chown d0/d12/l1e 13 1 2024-09-18T12:52:06.235 INFO:tasks.workunit.client.1.smithi161.stdout:8/516: rename d0/d3/la5 to d0/d3/d10/d21/d4a/lb2 0 2024-09-18T12:52:06.235 INFO:tasks.workunit.client.1.smithi161.stdout:6/492: dread d4/d39/d26/d20/d28/f35 [4194304,4194304] 0 2024-09-18T12:52:06.236 INFO:tasks.workunit.client.1.smithi161.stdout:6/493: truncate d4/d39/d48/f8b 194075 0 2024-09-18T12:52:06.237 INFO:tasks.workunit.client.1.smithi161.stdout:6/494: chown d4/d39/d26/f55 100580 1 2024-09-18T12:52:06.237 INFO:tasks.workunit.client.1.smithi161.stdout:7/439: mkdir d3/d8/d79 0 2024-09-18T12:52:06.237 INFO:tasks.workunit.client.1.smithi161.stdout:6/495: dread - d4/d39/f80 zero size 2024-09-18T12:52:06.240 INFO:tasks.workunit.client.0.smithi045.stdout:2/275: symlink d5/d2c/d4d/d16/d61/l67 0 2024-09-18T12:52:06.240 INFO:tasks.workunit.client.0.smithi045.stdout:2/276: read - d5/d2c/f63 zero size 2024-09-18T12:52:06.242 INFO:tasks.workunit.client.0.smithi045.stdout:1/223: creat d0/d2d/f45 x:0 0 0 2024-09-18T12:52:06.243 INFO:tasks.workunit.client.0.smithi045.stdout:1/224: write d0/f23 [298242,30537] 0 2024-09-18T12:52:06.244 INFO:tasks.workunit.client.0.smithi045.stdout:4/201: link db/d2c/c37 db/d2c/d35/d40/c45 0 2024-09-18T12:52:06.245 INFO:tasks.workunit.client.1.smithi161.stdout:5/434: fsync d3/d14/f1b 0 2024-09-18T12:52:06.247 INFO:tasks.workunit.client.1.smithi161.stdout:0/468: sync 2024-09-18T12:52:06.248 INFO:tasks.workunit.client.1.smithi161.stdout:0/469: chown df/d30/d71/fa9 305 1 2024-09-18T12:52:06.248 INFO:tasks.workunit.client.0.smithi045.stdout:0/182: write d6/d7/d21/d23/f25 [402455,35420] 0 2024-09-18T12:52:06.249 INFO:tasks.workunit.client.0.smithi045.stdout:0/183: fdatasync d6/d7/f29 0 2024-09-18T12:52:06.250 INFO:tasks.workunit.client.0.smithi045.stdout:0/184: dread - d6/d7/d21/f24 zero size 2024-09-18T12:52:06.252 INFO:tasks.workunit.client.0.smithi045.stdout:0/185: dread - d6/d7/d21/f24 zero size 2024-09-18T12:52:06.254 INFO:tasks.workunit.client.0.smithi045.stdout:4/202: truncate db/d10/d2f/f36 367819 0 2024-09-18T12:52:06.255 INFO:tasks.workunit.client.0.smithi045.stdout:1/225: dread d0/fb [0,4194304] 0 2024-09-18T12:52:06.260 INFO:tasks.workunit.client.0.smithi045.stdout:4/203: dwrite db/f30 [0,4194304] 0 2024-09-18T12:52:06.261 INFO:tasks.workunit.client.1.smithi161.stdout:2/514: write d0/d5/d43/f37 [906675,28300] 0 2024-09-18T12:52:06.262 INFO:tasks.workunit.client.1.smithi161.stdout:5/435: creat d3/d44/f8c x:0 0 0 2024-09-18T12:52:06.266 INFO:tasks.workunit.client.1.smithi161.stdout:5/436: dread d3/d8/f73 [0,4194304] 0 2024-09-18T12:52:06.266 INFO:tasks.workunit.client.1.smithi161.stdout:0/470: creat df/d30/d71/faa x:0 0 0 2024-09-18T12:52:06.267 INFO:tasks.workunit.client.0.smithi045.stdout:1/226: mkdir d0/d2e/d46 0 2024-09-18T12:52:06.268 INFO:tasks.workunit.client.0.smithi045.stdout:1/227: write d0/f3a [622719,82950] 0 2024-09-18T12:52:06.269 INFO:tasks.workunit.client.1.smithi161.stdout:9/408: rename d0/d16/c10 to d0/d16/d25/d46/d53/d59/c85 0 2024-09-18T12:52:06.272 INFO:tasks.workunit.client.0.smithi045.stdout:1/228: write d0/d2d/f35 [737035,128968] 0 2024-09-18T12:52:06.273 INFO:tasks.workunit.client.1.smithi161.stdout:0/471: dread df/d29/d36/f5b [0,4194304] 0 2024-09-18T12:52:06.273 INFO:tasks.workunit.client.1.smithi161.stdout:9/409: write d0/d16/d25/d28/d45/f66 [12924,97151] 0 2024-09-18T12:52:06.273 INFO:tasks.workunit.client.1.smithi161.stdout:7/440: creat d3/d8/d79/f7a x:0 0 0 2024-09-18T12:52:06.274 INFO:tasks.workunit.client.0.smithi045.stdout:2/277: write d5/d2c/d4d/f28 [1179520,97459] 0 2024-09-18T12:52:06.275 INFO:tasks.workunit.client.1.smithi161.stdout:7/441: read d3/d8/d15/d38/f21 [2560885,128865] 0 2024-09-18T12:52:06.277 INFO:tasks.workunit.client.1.smithi161.stdout:7/442: write d3/d8/d15/d38/f21 [4047427,95151] 0 2024-09-18T12:52:06.278 INFO:tasks.workunit.client.1.smithi161.stdout:7/443: write d3/d8/d15/f3c [1220728,72467] 0 2024-09-18T12:52:06.279 INFO:tasks.workunit.client.0.smithi045.stdout:1/229: readlink d0/l5 0 2024-09-18T12:52:06.281 INFO:tasks.workunit.client.0.smithi045.stdout:4/204: mknod db/d1b/d43/c46 0 2024-09-18T12:52:06.282 INFO:tasks.workunit.client.1.smithi161.stdout:2/515: dread d0/d1/df/f34 [0,4194304] 0 2024-09-18T12:52:06.283 INFO:tasks.workunit.client.1.smithi161.stdout:4/505: dread d5/d32/d39/d4d/f78 [0,4194304] 0 2024-09-18T12:52:06.283 INFO:tasks.workunit.client.1.smithi161.stdout:0/472: fsync df/f1c 0 2024-09-18T12:52:06.284 INFO:tasks.workunit.client.1.smithi161.stdout:6/496: dwrite d4/d39/d26/f2b [0,4194304] 0 2024-09-18T12:52:06.285 INFO:tasks.workunit.client.1.smithi161.stdout:0/473: dread - df/d29/d46/d90/d37/d55/fa4 zero size 2024-09-18T12:52:06.293 INFO:tasks.workunit.client.1.smithi161.stdout:0/474: dread df/d29/d46/f49 [0,4194304] 0 2024-09-18T12:52:06.293 INFO:tasks.workunit.client.0.smithi045.stdout:4/205: dread f9 [0,4194304] 0 2024-09-18T12:52:06.293 INFO:tasks.workunit.client.1.smithi161.stdout:4/506: dwrite d5/d27/d3a/f3d [4194304,4194304] 0 2024-09-18T12:52:06.294 INFO:tasks.workunit.client.0.smithi045.stdout:2/278: creat d5/d2c/d4d/f68 x:0 0 0 2024-09-18T12:52:06.295 INFO:tasks.workunit.client.1.smithi161.stdout:4/507: dread - d5/d27/d3a/d47/fa2 zero size 2024-09-18T12:52:06.297 INFO:tasks.workunit.client.0.smithi045.stdout:0/186: dwrite d6/d7/d21/f2e [0,4194304] 0 2024-09-18T12:52:06.298 INFO:tasks.workunit.client.0.smithi045.stdout:0/187: dread - d6/f2d zero size 2024-09-18T12:52:06.301 INFO:tasks.workunit.client.1.smithi161.stdout:9/410: mkdir d0/d16/d25/d86 0 2024-09-18T12:52:06.302 INFO:tasks.workunit.client.1.smithi161.stdout:9/411: write d0/d47/d48/f61 [335952,45770] 0 2024-09-18T12:52:06.305 INFO:tasks.workunit.client.1.smithi161.stdout:6/497: dread d4/d39/d26/d31/f53 [0,4194304] 0 2024-09-18T12:52:06.309 INFO:tasks.workunit.client.0.smithi045.stdout:4/206: mkdir db/de/d1e/d3e/d47 0 2024-09-18T12:52:06.312 INFO:tasks.workunit.client.0.smithi045.stdout:0/188: rename d6/f1d to d6/f36 0 2024-09-18T12:52:06.313 INFO:tasks.workunit.client.1.smithi161.stdout:0/475: mknod df/d84/cab 0 2024-09-18T12:52:06.314 INFO:tasks.workunit.client.1.smithi161.stdout:4/508: fdatasync d5/d27/d3a/f80 0 2024-09-18T12:52:06.317 INFO:tasks.workunit.client.0.smithi045.stdout:4/207: dwrite db/de/d1a/f3d [0,4194304] 0 2024-09-18T12:52:06.319 INFO:tasks.workunit.client.0.smithi045.stdout:0/189: dread f4 [0,4194304] 0 2024-09-18T12:52:06.321 INFO:tasks.workunit.client.0.smithi045.stdout:0/190: chown d6/d7/fa 0 1 2024-09-18T12:52:06.322 INFO:tasks.workunit.client.0.smithi045.stdout:0/191: dread - d6/d7/d21/f24 zero size 2024-09-18T12:52:06.322 INFO:tasks.workunit.client.1.smithi161.stdout:6/498: read d4/d39/d47/d51/f70 [744455,54326] 0 2024-09-18T12:52:06.323 INFO:tasks.workunit.client.0.smithi045.stdout:4/208: dread db/de/d1a/f3d [0,4194304] 0 2024-09-18T12:52:06.325 INFO:tasks.workunit.client.0.smithi045.stdout:0/192: rmdir d6/d7/d32 39 2024-09-18T12:52:06.326 INFO:tasks.workunit.client.0.smithi045.stdout:4/209: chown db/cc 76407073 1 2024-09-18T12:52:06.327 INFO:tasks.workunit.client.0.smithi045.stdout:0/193: readlink d6/l1a 0 2024-09-18T12:52:06.329 INFO:tasks.workunit.client.1.smithi161.stdout:4/509: creat d5/d14/d67/fa5 x:0 0 0 2024-09-18T12:52:06.329 INFO:tasks.workunit.client.1.smithi161.stdout:5/437: getdents d3/d3b/d7b/d82 0 2024-09-18T12:52:06.330 INFO:tasks.workunit.client.0.smithi045.stdout:0/194: fsync d6/f36 0 2024-09-18T12:52:06.330 INFO:tasks.workunit.client.1.smithi161.stdout:4/510: write d5/d27/d3a/d47/fa2 [933012,113994] 0 2024-09-18T12:52:06.330 INFO:tasks.workunit.client.1.smithi161.stdout:9/412: mknod d0/d16/d25/c87 0 2024-09-18T12:52:06.331 INFO:tasks.workunit.client.1.smithi161.stdout:2/516: link d0/d5/d53/d7d/ca2 d0/d1/d3b/d3d/da5/cb0 0 2024-09-18T12:52:06.331 INFO:tasks.workunit.client.1.smithi161.stdout:4/511: truncate d5/d27/d3a/d4c/fa0 367811 0 2024-09-18T12:52:06.332 INFO:tasks.workunit.client.0.smithi045.stdout:0/195: write d6/d7/d32/f33 [108338,9547] 0 2024-09-18T12:52:06.333 INFO:tasks.workunit.client.1.smithi161.stdout:0/476: mknod df/d29/cac 0 2024-09-18T12:52:06.334 INFO:tasks.workunit.client.0.smithi045.stdout:0/196: write d6/f2d [702321,86639] 0 2024-09-18T12:52:06.334 INFO:tasks.workunit.client.0.smithi045.stdout:4/210: link db/d10/d13/l18 db/de/d1e/d3e/d47/l48 0 2024-09-18T12:52:06.336 INFO:tasks.workunit.client.1.smithi161.stdout:9/413: fsync d0/d20/d49/f7e 0 2024-09-18T12:52:06.338 INFO:tasks.workunit.client.0.smithi045.stdout:4/211: mkdir db/de/d1e/d49 0 2024-09-18T12:52:06.339 INFO:tasks.workunit.client.0.smithi045.stdout:4/212: fsync db/de/d1e/f42 0 2024-09-18T12:52:06.339 INFO:tasks.workunit.client.0.smithi045.stdout:0/197: dread d6/f2d [0,4194304] 0 2024-09-18T12:52:06.340 INFO:tasks.workunit.client.1.smithi161.stdout:2/517: rename d0/d4/d78/ca1 to d0/d1/d4c/cb1 0 2024-09-18T12:52:06.340 INFO:tasks.workunit.client.1.smithi161.stdout:0/477: dread df/d30/d4d/f4f [0,4194304] 0 2024-09-18T12:52:06.340 INFO:tasks.workunit.client.0.smithi045.stdout:4/213: write db/d2c/d35/f3b [2008036,79465] 0 2024-09-18T12:52:06.344 INFO:tasks.workunit.client.1.smithi161.stdout:9/414: dwrite d0/d16/d25/d28/d45/f60 [0,4194304] 0 2024-09-18T12:52:06.345 INFO:tasks.workunit.client.1.smithi161.stdout:9/415: stat d0/d16/d25/d28/d45/c4b 0 2024-09-18T12:52:06.345 INFO:tasks.workunit.client.0.smithi045.stdout:0/198: dwrite d6/f36 [0,4194304] 0 2024-09-18T12:52:06.348 INFO:tasks.workunit.client.1.smithi161.stdout:4/512: write d5/f21 [534431,101533] 0 2024-09-18T12:52:06.351 INFO:tasks.workunit.client.1.smithi161.stdout:6/499: getdents d4/d39 0 2024-09-18T12:52:06.351 INFO:tasks.workunit.client.0.smithi045.stdout:0/199: creat d6/d35/f37 x:0 0 0 2024-09-18T12:52:06.352 INFO:tasks.workunit.client.0.smithi045.stdout:0/200: fdatasync d6/d7/d21/f24 0 2024-09-18T12:52:06.353 INFO:tasks.workunit.client.1.smithi161.stdout:5/438: dwrite d3/f6a [0,4194304] 0 2024-09-18T12:52:06.354 INFO:tasks.workunit.client.1.smithi161.stdout:0/478: mkdir df/d29/d46/d90/d37/dad 0 2024-09-18T12:52:06.355 INFO:tasks.workunit.client.1.smithi161.stdout:5/439: chown d3/d9/f12 11 1 2024-09-18T12:52:06.355 INFO:tasks.workunit.client.1.smithi161.stdout:0/479: fsync df/d29/f3c 0 2024-09-18T12:52:06.356 INFO:tasks.workunit.client.1.smithi161.stdout:2/518: link d0/d4/f2a d0/d4/d52/fb2 0 2024-09-18T12:52:06.358 INFO:tasks.workunit.client.1.smithi161.stdout:3/492: sync 2024-09-18T12:52:06.358 INFO:tasks.workunit.client.1.smithi161.stdout:5/440: read d3/d14/d20/f3e [3348366,40686] 0 2024-09-18T12:52:06.358 INFO:tasks.workunit.client.0.smithi045.stdout:4/214: truncate db/d20/f44 1171613 0 2024-09-18T12:52:06.359 INFO:tasks.workunit.client.0.smithi045.stdout:4/215: write db/f21 [1655901,126355] 0 2024-09-18T12:52:06.360 INFO:tasks.workunit.client.0.smithi045.stdout:0/201: symlink d6/l38 0 2024-09-18T12:52:06.360 INFO:tasks.workunit.client.1.smithi161.stdout:3/493: read d1/f8b [1287327,116030] 0 2024-09-18T12:52:06.361 INFO:tasks.workunit.client.1.smithi161.stdout:5/441: write d3/d9/f6e [644454,22244] 0 2024-09-18T12:52:06.361 INFO:tasks.workunit.client.1.smithi161.stdout:5/442: fdatasync d3/d14/f19 0 2024-09-18T12:52:06.361 INFO:tasks.workunit.client.1.smithi161.stdout:3/494: chown d1/f5c 12 1 2024-09-18T12:52:06.361 INFO:tasks.workunit.client.0.smithi045.stdout:0/202: fdatasync d6/d7/f1f 0 2024-09-18T12:52:06.361 INFO:tasks.workunit.client.1.smithi161.stdout:3/495: chown d1/d2e/d14/d78/d83/la0 213539 1 2024-09-18T12:52:06.362 INFO:tasks.workunit.client.0.smithi045.stdout:0/203: read - d6/d7/f29 zero size 2024-09-18T12:52:06.363 INFO:tasks.workunit.client.1.smithi161.stdout:9/416: truncate d0/d16/d25/d28/f3f 4115496 0 2024-09-18T12:52:06.368 INFO:tasks.workunit.client.0.smithi045.stdout:0/204: mkdir d6/d7/d21/d39 0 2024-09-18T12:52:06.369 INFO:tasks.workunit.client.1.smithi161.stdout:2/519: mknod d0/d4/cb3 0 2024-09-18T12:52:06.369 INFO:tasks.workunit.client.1.smithi161.stdout:2/520: chown d0/d71/da9/d9f 1506238 1 2024-09-18T12:52:06.370 INFO:tasks.workunit.client.0.smithi045.stdout:0/205: truncate d6/d7/d21/d23/f28 577047 0 2024-09-18T12:52:06.370 INFO:tasks.workunit.client.1.smithi161.stdout:2/521: chown d0/d5/d43/f18 1724 1 2024-09-18T12:52:06.371 INFO:tasks.workunit.client.0.smithi045.stdout:0/206: dread - d6/d35/f37 zero size 2024-09-18T12:52:06.371 INFO:tasks.workunit.client.0.smithi045.stdout:0/207: readlink d6/l1a 0 2024-09-18T12:52:06.371 INFO:tasks.workunit.client.1.smithi161.stdout:0/480: rename df/d29/l7f to df/d84/d8a/lae 0 2024-09-18T12:52:06.372 INFO:tasks.workunit.client.1.smithi161.stdout:4/513: mknod d5/ca6 0 2024-09-18T12:52:06.374 INFO:tasks.workunit.client.0.smithi045.stdout:0/208: mknod d6/d35/c3a 0 2024-09-18T12:52:06.378 INFO:tasks.workunit.client.0.smithi045.stdout:0/209: dread d6/d7/ff [0,4194304] 0 2024-09-18T12:52:06.379 INFO:tasks.workunit.client.0.smithi045.stdout:0/210: dread - d6/d7/f29 zero size 2024-09-18T12:52:06.381 INFO:tasks.workunit.client.1.smithi161.stdout:5/443: mkdir d3/d14/d8d 0 2024-09-18T12:52:06.383 INFO:tasks.workunit.client.0.smithi045.stdout:0/211: rmdir d6/d7/d21 39 2024-09-18T12:52:06.385 INFO:tasks.workunit.client.0.smithi045.stdout:0/212: dread d6/d7/d32/f33 [0,4194304] 0 2024-09-18T12:52:06.389 INFO:tasks.workunit.client.0.smithi045.stdout:0/213: write d6/d7/d21/f24 [878605,75988] 0 2024-09-18T12:52:06.390 INFO:tasks.workunit.client.0.smithi045.stdout:0/214: write d6/d7/d21/d23/f28 [512980,83701] 0 2024-09-18T12:52:06.391 INFO:tasks.workunit.client.1.smithi161.stdout:8/517: sync 2024-09-18T12:52:06.391 INFO:tasks.workunit.client.1.smithi161.stdout:1/388: sync 2024-09-18T12:52:06.391 INFO:tasks.workunit.client.1.smithi161.stdout:4/514: fsync d5/d32/f38 0 2024-09-18T12:52:06.393 INFO:tasks.workunit.client.1.smithi161.stdout:4/515: write d5/d27/d44/f55 [1029436,89117] 0 2024-09-18T12:52:06.394 INFO:tasks.workunit.client.1.smithi161.stdout:9/417: write d0/f3 [1695266,24464] 0 2024-09-18T12:52:06.395 INFO:tasks.workunit.client.0.smithi045.stdout:0/215: mkdir d6/d7/d21/d23/d3b 0 2024-09-18T12:52:06.395 INFO:tasks.workunit.client.1.smithi161.stdout:9/418: write d0/f24 [336338,55972] 0 2024-09-18T12:52:06.396 INFO:tasks.workunit.client.1.smithi161.stdout:2/522: write d0/d5/d43/f18 [4808725,27376] 0 2024-09-18T12:52:06.397 INFO:tasks.workunit.client.1.smithi161.stdout:9/419: truncate d0/d16/d25/d46/d53/f7c 145684 0 2024-09-18T12:52:06.397 INFO:tasks.workunit.client.1.smithi161.stdout:3/496: rename d1/d2e/d14/d65/f6a to d1/d2e/d24/d84/fa8 0 2024-09-18T12:52:06.398 INFO:tasks.workunit.client.0.smithi045.stdout:0/216: mkdir d6/d7/d21/d23/d3c 0 2024-09-18T12:52:06.399 INFO:tasks.workunit.client.1.smithi161.stdout:1/389: mknod d1/d26/d3a/d52/c80 0 2024-09-18T12:52:06.400 INFO:tasks.workunit.client.1.smithi161.stdout:1/390: write d1/da/d31/f77 [1038377,118651] 0 2024-09-18T12:52:06.400 INFO:tasks.workunit.client.1.smithi161.stdout:8/518: fdatasync d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 0 2024-09-18T12:52:06.402 INFO:tasks.workunit.client.1.smithi161.stdout:6/500: getdents d4/d1a/d1c 0 2024-09-18T12:52:06.403 INFO:tasks.workunit.client.1.smithi161.stdout:2/523: chown d0/d1/d3b/d7e/f70 50475 1 2024-09-18T12:52:06.405 INFO:tasks.workunit.client.1.smithi161.stdout:8/519: write d0/d3/d10/d21/d4a/d52/d82/d96/d98/f90 [902446,10193] 0 2024-09-18T12:52:06.407 INFO:tasks.workunit.client.1.smithi161.stdout:0/481: creat df/d29/d46/d90/d37/faf x:0 0 0 2024-09-18T12:52:06.408 INFO:tasks.workunit.client.1.smithi161.stdout:3/497: fdatasync d1/d2e/f17 0 2024-09-18T12:52:06.408 INFO:tasks.workunit.client.0.smithi045.stdout:0/217: link d6/c26 d6/d7/c3d 0 2024-09-18T12:52:06.409 INFO:tasks.workunit.client.0.smithi045.stdout:0/218: fdatasync d6/d7/fa 0 2024-09-18T12:52:06.409 INFO:tasks.workunit.client.1.smithi161.stdout:0/482: write df/d84/d86/f72 [9422401,73261] 0 2024-09-18T12:52:06.414 INFO:tasks.workunit.client.1.smithi161.stdout:9/420: dread d0/d16/f62 [0,4194304] 0 2024-09-18T12:52:06.414 INFO:tasks.workunit.client.1.smithi161.stdout:5/444: rename d3/d14/d20/d21 to d3/d9/d4b/d8e 0 2024-09-18T12:52:06.415 INFO:tasks.workunit.client.1.smithi161.stdout:6/501: mknod d4/d1a/d1c/c96 0 2024-09-18T12:52:06.415 INFO:tasks.workunit.client.1.smithi161.stdout:5/445: chown d3/d8/cf 174990638 1 2024-09-18T12:52:06.417 INFO:tasks.workunit.client.1.smithi161.stdout:4/516: truncate d5/d32/f45 3891659 0 2024-09-18T12:52:06.418 INFO:tasks.workunit.client.1.smithi161.stdout:9/421: dread d0/db/d18/f69 [0,4194304] 0 2024-09-18T12:52:06.419 INFO:tasks.workunit.client.1.smithi161.stdout:1/391: dread d1/d26/fb [0,4194304] 0 2024-09-18T12:52:06.419 INFO:tasks.workunit.client.1.smithi161.stdout:3/498: creat d1/d2e/d24/d1d/fa9 x:0 0 0 2024-09-18T12:52:06.420 INFO:tasks.workunit.client.1.smithi161.stdout:0/483: symlink df/d29/d46/d78/lb0 0 2024-09-18T12:52:06.421 INFO:tasks.workunit.client.1.smithi161.stdout:3/499: chown d1/d2e/d14/d65/f8f 33 1 2024-09-18T12:52:06.422 INFO:tasks.workunit.client.1.smithi161.stdout:1/392: read d1/d26/f9 [3274934,36982] 0 2024-09-18T12:52:06.422 INFO:tasks.workunit.client.1.smithi161.stdout:0/484: write df/d84/d86/f75 [4174797,18169] 0 2024-09-18T12:52:06.423 INFO:tasks.workunit.client.0.smithi045.stdout:0/219: dwrite d6/d7/ff [0,4194304] 0 2024-09-18T12:52:06.424 INFO:tasks.workunit.client.0.smithi045.stdout:0/220: readlink d6/d7/d32/l34 0 2024-09-18T12:52:06.424 INFO:tasks.workunit.client.1.smithi161.stdout:3/500: read d1/f5c [22307,39722] 0 2024-09-18T12:52:06.424 INFO:tasks.workunit.client.1.smithi161.stdout:5/446: truncate d3/d8/f59 368654 0 2024-09-18T12:52:06.427 INFO:tasks.workunit.client.1.smithi161.stdout:5/447: truncate d3/f66 535073 0 2024-09-18T12:52:06.428 INFO:tasks.workunit.client.1.smithi161.stdout:0/485: read - df/d29/d46/d90/d37/faf zero size 2024-09-18T12:52:06.428 INFO:tasks.workunit.client.0.smithi045.stdout:0/221: dread d6/d7/ff [0,4194304] 0 2024-09-18T12:52:06.428 INFO:tasks.workunit.client.0.smithi045.stdout:0/222: chown d6 12 1 2024-09-18T12:52:06.428 INFO:tasks.workunit.client.1.smithi161.stdout:4/517: creat d5/d27/d3a/d47/fa7 x:0 0 0 2024-09-18T12:52:06.431 INFO:tasks.workunit.client.1.smithi161.stdout:2/524: dread d0/d5/d43/f45 [0,4194304] 0 2024-09-18T12:52:06.432 INFO:tasks.workunit.client.0.smithi045.stdout:0/223: write d6/f2d [1750375,92165] 0 2024-09-18T12:52:06.432 INFO:tasks.workunit.client.0.smithi045.stdout:0/224: chown d6/d7/d21/d39 1 1 2024-09-18T12:52:06.433 INFO:tasks.workunit.client.1.smithi161.stdout:9/422: dwrite d0/d16/d25/d28/d45/f60 [0,4194304] 0 2024-09-18T12:52:06.436 INFO:tasks.workunit.client.0.smithi045.stdout:0/225: fsync d6/d7/d32/f33 0 2024-09-18T12:52:06.437 INFO:tasks.workunit.client.1.smithi161.stdout:1/393: symlink d1/d71/l81 0 2024-09-18T12:52:06.439 INFO:tasks.workunit.client.1.smithi161.stdout:2/525: dread d0/d1/df/f1b [0,4194304] 0 2024-09-18T12:52:06.440 INFO:tasks.workunit.client.1.smithi161.stdout:2/526: write d0/f13 [2327743,102347] 0 2024-09-18T12:52:06.441 INFO:tasks.workunit.client.0.smithi045.stdout:0/226: chown d6/d7/c3d 19967908 1 2024-09-18T12:52:06.445 INFO:tasks.workunit.client.1.smithi161.stdout:5/448: rename d3/d44/l62 to d3/d9/d4b/l8f 0 2024-09-18T12:52:06.446 INFO:tasks.workunit.client.0.smithi045.stdout:0/227: creat d6/d35/f3e x:0 0 0 2024-09-18T12:52:06.450 INFO:tasks.workunit.client.0.smithi045.stdout:0/228: creat d6/d35/f3f x:0 0 0 2024-09-18T12:52:06.451 INFO:tasks.workunit.client.0.smithi045.stdout:0/229: chown d6/d7/d32 0 1 2024-09-18T12:52:06.457 INFO:tasks.workunit.client.1.smithi161.stdout:1/394: mknod d1/d26/c82 0 2024-09-18T12:52:06.457 INFO:tasks.workunit.client.1.smithi161.stdout:8/520: getdents d0/d3/d10 0 2024-09-18T12:52:06.458 INFO:tasks.workunit.client.1.smithi161.stdout:6/502: dread d4/d1a/d1c/f4a [0,4194304] 0 2024-09-18T12:52:06.458 INFO:tasks.workunit.client.1.smithi161.stdout:2/527: creat d0/d5/d53/d7d/fb4 x:0 0 0 2024-09-18T12:52:06.458 INFO:tasks.workunit.client.1.smithi161.stdout:4/518: symlink d5/d27/la8 0 2024-09-18T12:52:06.459 INFO:tasks.workunit.client.1.smithi161.stdout:0/486: symlink df/d29/d46/d90/d37/lb1 0 2024-09-18T12:52:06.460 INFO:tasks.workunit.client.1.smithi161.stdout:8/521: dread - d0/d3/d10/d21/d4a/d52/d82/d96/fa3 zero size 2024-09-18T12:52:06.460 INFO:tasks.workunit.client.1.smithi161.stdout:0/487: write df/d29/f3b [3562709,93379] 0 2024-09-18T12:52:06.461 INFO:tasks.workunit.client.0.smithi045.stdout:0/230: creat d6/d7/d21/f40 x:0 0 0 2024-09-18T12:52:06.461 INFO:tasks.workunit.client.1.smithi161.stdout:8/522: readlink d0/d3/la 0 2024-09-18T12:52:06.461 INFO:tasks.workunit.client.1.smithi161.stdout:0/488: chown df/d29/f3b 5108 1 2024-09-18T12:52:06.462 INFO:tasks.workunit.client.1.smithi161.stdout:0/489: fsync df/d29/f3c 0 2024-09-18T12:52:06.462 INFO:tasks.workunit.client.1.smithi161.stdout:0/490: read df/d30/f3a [1988174,72476] 0 2024-09-18T12:52:06.464 INFO:tasks.workunit.client.0.smithi045.stdout:0/231: unlink d6/d7/d21/f40 0 2024-09-18T12:52:06.464 INFO:tasks.workunit.client.0.smithi045.stdout:0/232: chown d6/d7/c9 6 1 2024-09-18T12:52:06.465 INFO:tasks.workunit.client.0.smithi045.stdout:5/309: sync 2024-09-18T12:52:06.465 INFO:tasks.workunit.client.0.smithi045.stdout:3/214: sync 2024-09-18T12:52:06.465 INFO:tasks.workunit.client.0.smithi045.stdout:8/168: sync 2024-09-18T12:52:06.472 INFO:tasks.workunit.client.1.smithi161.stdout:9/423: dwrite d0/db/d18/f21 [0,4194304] 0 2024-09-18T12:52:06.473 INFO:tasks.workunit.client.0.smithi045.stdout:3/215: mknod d0/d1e/c4f 0 2024-09-18T12:52:06.474 INFO:tasks.workunit.client.0.smithi045.stdout:0/233: dwrite d6/d35/f3e [0,4194304] 0 2024-09-18T12:52:06.475 INFO:tasks.workunit.client.0.smithi045.stdout:3/216: chown d0/f18 358246 1 2024-09-18T12:52:06.480 INFO:tasks.workunit.client.0.smithi045.stdout:5/310: dwrite d6/d2a/f60 [0,4194304] 0 2024-09-18T12:52:06.484 INFO:tasks.workunit.client.0.smithi045.stdout:3/217: write d0/d1e/d2c/d3a/f4a [892837,33054] 0 2024-09-18T12:52:06.485 INFO:tasks.workunit.client.1.smithi161.stdout:6/503: stat d4/d1a/d1c/f24 0 2024-09-18T12:52:06.486 INFO:tasks.workunit.client.1.smithi161.stdout:1/395: creat d1/da/d1f/d45/f83 x:0 0 0 2024-09-18T12:52:06.487 INFO:tasks.workunit.client.1.smithi161.stdout:1/396: chown d1/da/d1f/c75 697372074 1 2024-09-18T12:52:06.487 INFO:tasks.workunit.client.0.smithi045.stdout:0/234: dwrite d6/d35/f37 [0,4194304] 0 2024-09-18T12:52:06.487 INFO:tasks.workunit.client.0.smithi045.stdout:8/169: dread d11/d20/f27 [0,4194304] 0 2024-09-18T12:52:06.492 INFO:tasks.workunit.client.0.smithi045.stdout:3/218: read d0/f48 [260449,113269] 0 2024-09-18T12:52:06.494 INFO:tasks.workunit.client.0.smithi045.stdout:3/219: write d0/d1e/f38 [655129,122979] 0 2024-09-18T12:52:06.503 INFO:tasks.workunit.client.1.smithi161.stdout:9/424: mkdir d0/d47/d48/d88 0 2024-09-18T12:52:06.504 INFO:tasks.workunit.client.1.smithi161.stdout:4/519: mkdir d5/da9 0 2024-09-18T12:52:06.508 INFO:tasks.workunit.client.0.smithi045.stdout:0/235: symlink d6/d7/d21/l41 0 2024-09-18T12:52:06.509 INFO:tasks.workunit.client.1.smithi161.stdout:5/449: link d3/d9/l17 d3/d8/l90 0 2024-09-18T12:52:06.511 INFO:tasks.workunit.client.1.smithi161.stdout:1/397: dread d1/f15 [0,4194304] 0 2024-09-18T12:52:06.511 INFO:tasks.workunit.client.1.smithi161.stdout:8/523: mknod d0/d3/cb3 0 2024-09-18T12:52:06.512 INFO:tasks.workunit.client.1.smithi161.stdout:1/398: chown d1/da/d39 44404 1 2024-09-18T12:52:06.513 INFO:tasks.workunit.client.1.smithi161.stdout:1/399: write d1/d26/f50 [1707324,60572] 0 2024-09-18T12:52:06.514 INFO:tasks.workunit.client.0.smithi045.stdout:0/236: dwrite d6/d7/d21/f24 [0,4194304] 0 2024-09-18T12:52:06.514 INFO:tasks.workunit.client.0.smithi045.stdout:5/311: rmdir d6/d28/d5e 0 2024-09-18T12:52:06.514 INFO:tasks.workunit.client.1.smithi161.stdout:8/524: write d0/d3/d10/d21/d4a/d52/d66/d5b/f5e [920278,112934] 0 2024-09-18T12:52:06.514 INFO:tasks.workunit.client.1.smithi161.stdout:8/525: chown d0/f9 1927951032 1 2024-09-18T12:52:06.515 INFO:tasks.workunit.client.1.smithi161.stdout:8/526: dread - d0/d3/d10/d21/d4a/d52/d66/d5b/fa0 zero size 2024-09-18T12:52:06.516 INFO:tasks.workunit.client.1.smithi161.stdout:7/444: sync 2024-09-18T12:52:06.517 INFO:tasks.workunit.client.1.smithi161.stdout:0/491: write df/d29/f53 [1837191,64368] 0 2024-09-18T12:52:06.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/445: stat d3/d8/d15/d38/d55 0 2024-09-18T12:52:06.519 INFO:tasks.workunit.client.0.smithi045.stdout:8/170: getdents d11/d23 0 2024-09-18T12:52:06.521 INFO:tasks.workunit.client.1.smithi161.stdout:1/400: dwrite d1/d26/d3a/d52/f69 [0,4194304] 0 2024-09-18T12:52:06.521 INFO:tasks.workunit.client.0.smithi045.stdout:8/171: write f6 [288974,34229] 0 2024-09-18T12:52:06.523 INFO:tasks.workunit.client.0.smithi045.stdout:5/312: dwrite d6/db/f12 [0,4194304] 0 2024-09-18T12:52:06.523 INFO:tasks.workunit.client.0.smithi045.stdout:0/237: creat d6/d7/f42 x:0 0 0 2024-09-18T12:52:06.527 INFO:tasks.workunit.client.0.smithi045.stdout:8/172: truncate d11/f12 1029738 0 2024-09-18T12:52:06.533 INFO:tasks.workunit.client.1.smithi161.stdout:3/501: sync 2024-09-18T12:52:06.534 INFO:tasks.workunit.client.1.smithi161.stdout:3/502: write d1/d2e/d3d/f9b [422962,79548] 0 2024-09-18T12:52:06.535 INFO:tasks.workunit.client.0.smithi045.stdout:8/173: rmdir d11 39 2024-09-18T12:52:06.538 INFO:tasks.workunit.client.0.smithi045.stdout:0/238: mknod d6/d7/d21/d39/c43 0 2024-09-18T12:52:06.539 INFO:tasks.workunit.client.1.smithi161.stdout:4/520: link d5/d27/d3a/f3d d5/d27/d44/d61/d6c/faa 0 2024-09-18T12:52:06.542 INFO:tasks.workunit.client.1.smithi161.stdout:7/446: unlink d3/d8/c48 0 2024-09-18T12:52:06.542 INFO:tasks.workunit.client.1.smithi161.stdout:7/447: stat d3/d8/l5c 0 2024-09-18T12:52:06.543 INFO:tasks.workunit.client.1.smithi161.stdout:6/504: creat d4/f97 x:0 0 0 2024-09-18T12:52:06.545 INFO:tasks.workunit.client.0.smithi045.stdout:8/174: rename lb to d11/d20/l30 0 2024-09-18T12:52:06.545 INFO:tasks.workunit.client.0.smithi045.stdout:8/175: dread - d11/d23/f2b zero size 2024-09-18T12:52:06.546 INFO:tasks.workunit.client.1.smithi161.stdout:0/492: unlink df/d29/d46/d90/d37/f3e 0 2024-09-18T12:52:06.547 INFO:tasks.workunit.client.1.smithi161.stdout:0/493: fsync df/f1c 0 2024-09-18T12:52:06.547 INFO:tasks.workunit.client.1.smithi161.stdout:2/528: getdents d0/d1/d3b/d3d 0 2024-09-18T12:52:06.549 INFO:tasks.workunit.client.1.smithi161.stdout:1/401: mknod d1/da/d1f/d45/c84 0 2024-09-18T12:52:06.549 INFO:tasks.workunit.client.0.smithi045.stdout:0/239: creat d6/d7/d21/f44 x:0 0 0 2024-09-18T12:52:06.551 INFO:tasks.workunit.client.1.smithi161.stdout:8/527: dwrite d0/d3/d10/d21/f3a [0,4194304] 0 2024-09-18T12:52:06.552 INFO:tasks.workunit.client.1.smithi161.stdout:3/503: mknod d1/d2e/caa 0 2024-09-18T12:52:06.555 INFO:tasks.workunit.client.1.smithi161.stdout:9/425: rename d0/d16/d25/l30 to d0/db/l89 0 2024-09-18T12:52:06.555 INFO:tasks.workunit.client.0.smithi045.stdout:8/176: link d11/c2d d11/c31 0 2024-09-18T12:52:06.556 INFO:tasks.workunit.client.0.smithi045.stdout:0/240: dwrite d6/d35/f3e [0,4194304] 0 2024-09-18T12:52:06.557 INFO:tasks.workunit.client.1.smithi161.stdout:4/521: mknod d5/d27/d3a/d60/d8a/cab 0 2024-09-18T12:52:06.558 INFO:tasks.workunit.client.0.smithi045.stdout:0/241: chown d6/d7/d32/l34 18667018 1 2024-09-18T12:52:06.558 INFO:tasks.workunit.client.1.smithi161.stdout:4/522: read d5/d27/d44/f88 [1462359,42914] 0 2024-09-18T12:52:06.559 INFO:tasks.workunit.client.0.smithi045.stdout:0/242: fsync d6/d7/d21/f24 0 2024-09-18T12:52:06.559 INFO:tasks.workunit.client.1.smithi161.stdout:7/448: creat d3/d8/d15/d1a/d4a/d64/f7b x:0 0 0 2024-09-18T12:52:06.560 INFO:tasks.workunit.client.1.smithi161.stdout:7/449: write d3/d8/d15/d38/f5f [712179,54364] 0 2024-09-18T12:52:06.562 INFO:tasks.workunit.client.1.smithi161.stdout:7/450: dread d3/d8/d15/d1a/f41 [0,4194304] 0 2024-09-18T12:52:06.564 INFO:tasks.workunit.client.0.smithi045.stdout:8/177: rename d11/d23/f2a to d11/d23/f32 0 2024-09-18T12:52:06.569 INFO:tasks.workunit.client.1.smithi161.stdout:2/529: stat d0/d5/d53/d7d/ca2 0 2024-09-18T12:52:06.569 INFO:tasks.workunit.client.1.smithi161.stdout:5/450: write d3/d9/d4b/d8e/d46/f49 [3462,35254] 0 2024-09-18T12:52:06.573 INFO:tasks.workunit.client.1.smithi161.stdout:1/402: dread d1/d26/f2e [0,4194304] 0 2024-09-18T12:52:06.577 INFO:tasks.workunit.client.1.smithi161.stdout:3/504: read - d1/d2e/d14/d65/f6c zero size 2024-09-18T12:52:06.577 INFO:tasks.workunit.client.0.smithi045.stdout:8/178: dread d11/d14/f1b [0,4194304] 0 2024-09-18T12:52:06.578 INFO:tasks.workunit.client.0.smithi045.stdout:8/179: fsync d11/d23/f2b 0 2024-09-18T12:52:06.579 INFO:tasks.workunit.client.1.smithi161.stdout:4/523: mknod d5/d27/d44/cac 0 2024-09-18T12:52:06.583 INFO:tasks.workunit.client.1.smithi161.stdout:6/505: link d4/d39/d3a/f6d d4/d61/f98 0 2024-09-18T12:52:06.583 INFO:tasks.workunit.client.1.smithi161.stdout:6/506: readlink d4/d39/d26/d31/l7e 0 2024-09-18T12:52:06.586 INFO:tasks.workunit.client.1.smithi161.stdout:5/451: creat d3/d8/f91 x:0 0 0 2024-09-18T12:52:06.587 INFO:tasks.workunit.client.1.smithi161.stdout:1/403: symlink d1/d48/l85 0 2024-09-18T12:52:06.587 INFO:tasks.workunit.client.1.smithi161.stdout:1/404: chown d1/d26/c1a 726345916 1 2024-09-18T12:52:06.588 INFO:tasks.workunit.client.1.smithi161.stdout:8/528: truncate d0/d3/d10/f22 3682 0 2024-09-18T12:52:06.590 INFO:tasks.workunit.client.1.smithi161.stdout:9/426: symlink d0/d20/d74/l8a 0 2024-09-18T12:52:06.590 INFO:tasks.workunit.client.1.smithi161.stdout:0/494: write df/f24 [508952,115486] 0 2024-09-18T12:52:06.591 INFO:tasks.workunit.client.0.smithi045.stdout:8/180: dwrite d11/f12 [0,4194304] 0 2024-09-18T12:52:06.591 INFO:tasks.workunit.client.0.smithi045.stdout:8/181: read f9 [2804464,84142] 0 2024-09-18T12:52:06.593 INFO:tasks.workunit.client.1.smithi161.stdout:4/524: creat d5/d14/d67/fad x:0 0 0 2024-09-18T12:52:06.594 INFO:tasks.workunit.client.1.smithi161.stdout:4/525: fdatasync d5/d27/d3a/d47/fa2 0 2024-09-18T12:52:06.594 INFO:tasks.workunit.client.0.smithi045.stdout:8/182: read d11/d23/f32 [98113,42758] 0 2024-09-18T12:52:06.595 INFO:tasks.workunit.client.1.smithi161.stdout:4/526: fsync d5/d14/d67/f90 0 2024-09-18T12:52:06.595 INFO:tasks.workunit.client.1.smithi161.stdout:7/451: rename d3/d8/l52 to d3/d50/l7c 0 2024-09-18T12:52:06.596 INFO:tasks.workunit.client.1.smithi161.stdout:3/505: dread d1/d2e/d24/d1d/f4f [0,4194304] 0 2024-09-18T12:52:06.600 INFO:tasks.workunit.client.0.smithi045.stdout:8/183: write fa [3245257,129372] 0 2024-09-18T12:52:06.600 INFO:tasks.workunit.client.1.smithi161.stdout:7/452: dread d3/d8/d15/d38/f70 [0,4194304] 0 2024-09-18T12:52:06.601 INFO:tasks.workunit.client.1.smithi161.stdout:5/452: symlink d3/d3b/d54/l92 0 2024-09-18T12:52:06.601 INFO:tasks.workunit.client.1.smithi161.stdout:7/453: read d3/f11 [866306,65176] 0 2024-09-18T12:52:06.607 INFO:tasks.workunit.client.1.smithi161.stdout:0/495: mknod df/d29/d46/d51/cb2 0 2024-09-18T12:52:06.608 INFO:tasks.workunit.client.0.smithi045.stdout:8/184: link cc d11/c33 0 2024-09-18T12:52:06.608 INFO:tasks.workunit.client.0.smithi045.stdout:8/185: readlink d11/l15 0 2024-09-18T12:52:06.608 INFO:tasks.workunit.client.0.smithi045.stdout:8/186: rename d11 to d11/d23/d34 22 2024-09-18T12:52:06.608 INFO:tasks.workunit.client.1.smithi161.stdout:4/527: mkdir d5/d14/d67/d84/dae 0 2024-09-18T12:52:06.609 INFO:tasks.workunit.client.1.smithi161.stdout:6/507: creat d4/d1a/d1c/d3e/f99 x:0 0 0 2024-09-18T12:52:06.609 INFO:tasks.workunit.client.1.smithi161.stdout:3/506: fdatasync d1/f5c 0 2024-09-18T12:52:06.610 INFO:tasks.workunit.client.1.smithi161.stdout:3/507: write d1/d2e/d68/d69/f96 [2447288,115836] 0 2024-09-18T12:52:06.610 INFO:tasks.workunit.client.0.smithi045.stdout:8/187: mknod d11/c35 0 2024-09-18T12:52:06.611 INFO:tasks.workunit.client.0.smithi045.stdout:8/188: stat d11/d23/f32 0 2024-09-18T12:52:06.612 INFO:tasks.workunit.client.1.smithi161.stdout:2/530: creat d0/d1/fb5 x:0 0 0 2024-09-18T12:52:06.613 INFO:tasks.workunit.client.1.smithi161.stdout:1/405: symlink d1/l86 0 2024-09-18T12:52:06.614 INFO:tasks.workunit.client.0.smithi045.stdout:8/189: readlink d11/d20/l30 0 2024-09-18T12:52:06.617 INFO:tasks.workunit.client.1.smithi161.stdout:8/529: mkdir d0/d3/d10/d21/d4a/d52/db4 0 2024-09-18T12:52:06.617 INFO:tasks.workunit.client.1.smithi161.stdout:7/454: write d3/f4 [2579631,31651] 0 2024-09-18T12:52:06.618 INFO:tasks.workunit.client.1.smithi161.stdout:9/427: mknod d0/d47/d48/d88/c8b 0 2024-09-18T12:52:06.621 INFO:tasks.workunit.client.0.smithi045.stdout:8/190: getdents d11/d20 0 2024-09-18T12:52:06.626 INFO:tasks.workunit.client.1.smithi161.stdout:0/496: rmdir df/d29/d36 39 2024-09-18T12:52:06.626 INFO:tasks.workunit.client.1.smithi161.stdout:9/428: stat d0/d16/d25/l3e 0 2024-09-18T12:52:06.626 INFO:tasks.workunit.client.1.smithi161.stdout:4/528: truncate d5/d14/f23 961732 0 2024-09-18T12:52:06.626 INFO:tasks.workunit.client.1.smithi161.stdout:1/406: truncate d1/d1d/f21 232917 0 2024-09-18T12:52:06.628 INFO:tasks.workunit.client.0.smithi045.stdout:8/191: dwrite d11/d14/f1b [0,4194304] 0 2024-09-18T12:52:06.631 INFO:tasks.workunit.client.1.smithi161.stdout:3/508: dread d1/d2e/d3d/f7 [0,4194304] 0 2024-09-18T12:52:06.633 INFO:tasks.workunit.client.0.smithi045.stdout:8/192: rename ff to d11/d14/f36 0 2024-09-18T12:52:06.633 INFO:tasks.workunit.client.1.smithi161.stdout:8/530: dwrite d0/d3/d91/f9b [0,4194304] 0 2024-09-18T12:52:06.636 INFO:tasks.workunit.client.1.smithi161.stdout:0/497: dwrite df/f24 [0,4194304] 0 2024-09-18T12:52:06.637 INFO:tasks.workunit.client.0.smithi045.stdout:8/193: rename d11/d20/c28 to d11/d14/c37 0 2024-09-18T12:52:06.638 INFO:tasks.workunit.client.0.smithi045.stdout:8/194: read d11/d14/f1b [814520,219] 0 2024-09-18T12:52:06.640 INFO:tasks.workunit.client.1.smithi161.stdout:7/455: dwrite d3/f7 [0,4194304] 0 2024-09-18T12:52:06.641 INFO:tasks.workunit.client.1.smithi161.stdout:7/456: chown d3/c1b 168549 1 2024-09-18T12:52:06.643 INFO:tasks.workunit.client.1.smithi161.stdout:5/453: getdents d3/d8 0 2024-09-18T12:52:06.645 INFO:tasks.workunit.client.1.smithi161.stdout:4/529: creat d5/d27/d3a/d47/d49/d7b/faf x:0 0 0 2024-09-18T12:52:06.645 INFO:tasks.workunit.client.1.smithi161.stdout:4/530: dread - d5/d27/f81 zero size 2024-09-18T12:52:06.647 INFO:tasks.workunit.client.1.smithi161.stdout:8/531: readlink d0/d3/d10/d21/d4a/d52/d82/d96/l9e 0 2024-09-18T12:52:06.653 INFO:tasks.workunit.client.1.smithi161.stdout:1/407: creat d1/da/d1f/d45/d73/f87 x:0 0 0 2024-09-18T12:52:06.654 INFO:tasks.workunit.client.1.smithi161.stdout:1/408: truncate d1/da/d1f/f51 1538831 0 2024-09-18T12:52:06.655 INFO:tasks.workunit.client.1.smithi161.stdout:7/457: write d3/d8/d15/f1e [769814,99717] 0 2024-09-18T12:52:06.655 INFO:tasks.workunit.client.1.smithi161.stdout:5/454: rename d3/d9/d4b/d8e/d46/c79 to d3/d8/c93 0 2024-09-18T12:52:06.657 INFO:tasks.workunit.client.1.smithi161.stdout:7/458: write d3/d8/d15/d38/d55/f6c [402943,41275] 0 2024-09-18T12:52:06.657 INFO:tasks.workunit.client.1.smithi161.stdout:3/509: creat d1/d2e/d24/d1d/d89/fab x:0 0 0 2024-09-18T12:52:06.659 INFO:tasks.workunit.client.1.smithi161.stdout:4/531: read d5/d27/f37 [901590,84098] 0 2024-09-18T12:52:06.660 INFO:tasks.workunit.client.1.smithi161.stdout:9/429: link d0/db/d18/f69 d0/d20/d49/f8c 0 2024-09-18T12:52:06.662 INFO:tasks.workunit.client.1.smithi161.stdout:1/409: unlink d1/d26/f13 0 2024-09-18T12:52:06.663 INFO:tasks.workunit.client.0.smithi045.stdout:8/195: dwrite d11/f16 [0,4194304] 0 2024-09-18T12:52:06.666 INFO:tasks.workunit.client.1.smithi161.stdout:5/455: creat d3/d44/d6f/d86/f94 x:0 0 0 2024-09-18T12:52:06.670 INFO:tasks.workunit.client.1.smithi161.stdout:7/459: mkdir d3/d8/d15/d1a/d24/d31/d7d 0 2024-09-18T12:52:06.670 INFO:tasks.workunit.client.1.smithi161.stdout:9/430: dread d0/db/f57 [0,4194304] 0 2024-09-18T12:52:06.671 INFO:tasks.workunit.client.1.smithi161.stdout:8/532: write d0/d3/d1e/f50 [1525639,22165] 0 2024-09-18T12:52:06.673 INFO:tasks.workunit.client.1.smithi161.stdout:0/498: creat df/d29/fb3 x:0 0 0 2024-09-18T12:52:06.675 INFO:tasks.workunit.client.1.smithi161.stdout:9/431: dread d0/d16/f62 [0,4194304] 0 2024-09-18T12:52:06.676 INFO:tasks.workunit.client.1.smithi161.stdout:1/410: mkdir d1/d26/d88 0 2024-09-18T12:52:06.678 INFO:tasks.workunit.client.1.smithi161.stdout:3/510: creat d1/d2e/d68/d92/fac x:0 0 0 2024-09-18T12:52:06.678 INFO:tasks.workunit.client.1.smithi161.stdout:3/511: fsync d1/da5/fa2 0 2024-09-18T12:52:06.679 INFO:tasks.workunit.client.0.smithi045.stdout:8/196: truncate d11/f12 2386815 0 2024-09-18T12:52:06.679 INFO:tasks.workunit.client.1.smithi161.stdout:7/460: mkdir d3/d7e 0 2024-09-18T12:52:06.680 INFO:tasks.workunit.client.0.smithi045.stdout:8/197: chown d11/c33 364153125 1 2024-09-18T12:52:06.681 INFO:tasks.workunit.client.1.smithi161.stdout:0/499: symlink df/d30/d4d/lb4 0 2024-09-18T12:52:06.684 INFO:tasks.workunit.client.1.smithi161.stdout:1/411: dread d1/d1d/f21 [0,4194304] 0 2024-09-18T12:52:06.684 INFO:tasks.workunit.client.0.smithi045.stdout:8/198: creat d11/d14/d2c/f38 x:0 0 0 2024-09-18T12:52:06.685 INFO:tasks.workunit.client.1.smithi161.stdout:3/512: rename d1/d2e/f17 to d1/d2e/d14/d65/fad 0 2024-09-18T12:52:06.685 INFO:tasks.workunit.client.1.smithi161.stdout:8/533: symlink d0/d3/lb5 0 2024-09-18T12:52:06.686 INFO:tasks.workunit.client.0.smithi045.stdout:8/199: unlink f0 0 2024-09-18T12:52:06.689 INFO:tasks.workunit.client.1.smithi161.stdout:5/456: dread d3/f13 [0,4194304] 0 2024-09-18T12:52:06.689 INFO:tasks.workunit.client.1.smithi161.stdout:0/500: dread df/f22 [0,4194304] 0 2024-09-18T12:52:06.691 INFO:tasks.workunit.client.1.smithi161.stdout:0/501: write df/d84/d86/f79 [738924,49798] 0 2024-09-18T12:52:06.692 INFO:tasks.workunit.client.1.smithi161.stdout:0/502: fsync df/d30/d4d/f9b 0 2024-09-18T12:52:06.693 INFO:tasks.workunit.client.1.smithi161.stdout:3/513: rename d1/d2e/d24/c52 to d1/d2e/d14/d65/d76/cae 0 2024-09-18T12:52:06.693 INFO:tasks.workunit.client.0.smithi045.stdout:8/200: dwrite fa [0,4194304] 0 2024-09-18T12:52:06.694 INFO:tasks.workunit.client.1.smithi161.stdout:7/461: creat d3/d8/d15/d38/d77/f7f x:0 0 0 2024-09-18T12:52:06.694 INFO:tasks.workunit.client.1.smithi161.stdout:4/532: getdents d5/d27/d44/d61 0 2024-09-18T12:52:06.695 INFO:tasks.workunit.client.1.smithi161.stdout:7/462: readlink d3/d8/l3f 0 2024-09-18T12:52:06.696 INFO:tasks.workunit.client.1.smithi161.stdout:7/463: truncate d3/d8/d79/f7a 743522 0 2024-09-18T12:52:06.700 INFO:tasks.workunit.client.1.smithi161.stdout:6/508: sync 2024-09-18T12:52:06.702 INFO:tasks.workunit.client.1.smithi161.stdout:5/457: truncate d3/d14/f1b 37617 0 2024-09-18T12:52:06.702 INFO:tasks.workunit.client.1.smithi161.stdout:6/509: truncate d4/d1a/d1c/d3e/f42 1320369 0 2024-09-18T12:52:06.702 INFO:tasks.workunit.client.1.smithi161.stdout:6/510: fdatasync d4/f71 0 2024-09-18T12:52:06.703 INFO:tasks.workunit.client.0.smithi045.stdout:8/201: getdents d11 0 2024-09-18T12:52:06.704 INFO:tasks.workunit.client.1.smithi161.stdout:0/503: rmdir df/d29/d46/d51 39 2024-09-18T12:52:06.707 INFO:tasks.workunit.client.1.smithi161.stdout:1/412: write d1/da/d31/f3c [3797691,36114] 0 2024-09-18T12:52:06.710 INFO:tasks.workunit.client.1.smithi161.stdout:9/432: getdents d0/d16/d25/d28 0 2024-09-18T12:52:06.716 INFO:tasks.workunit.client.1.smithi161.stdout:6/511: creat d4/d61/d69/f9a x:0 0 0 2024-09-18T12:52:06.717 INFO:tasks.workunit.client.1.smithi161.stdout:7/464: dwrite d3/d8/d15/d38/f70 [4194304,4194304] 0 2024-09-18T12:52:06.719 INFO:tasks.workunit.client.1.smithi161.stdout:7/465: dread - d3/d8/d4b/f56 zero size 2024-09-18T12:52:06.719 INFO:tasks.workunit.client.1.smithi161.stdout:6/512: read d4/d1a/f14 [587900,80909] 0 2024-09-18T12:52:06.720 INFO:tasks.workunit.client.1.smithi161.stdout:7/466: chown d3/d8/d15/d1a/c2c 36813 1 2024-09-18T12:52:06.721 INFO:tasks.workunit.client.1.smithi161.stdout:4/533: creat d5/d14/d67/d84/dae/fb0 x:0 0 0 2024-09-18T12:52:06.722 INFO:tasks.workunit.client.1.smithi161.stdout:1/413: mkdir d1/da/d1f/d45/d89 0 2024-09-18T12:52:06.723 INFO:tasks.workunit.client.0.smithi045.stdout:8/202: write d11/d14/f1b [3001646,95274] 0 2024-09-18T12:52:06.724 INFO:tasks.workunit.client.1.smithi161.stdout:8/534: getdents d0/d3/d91 0 2024-09-18T12:52:06.725 INFO:tasks.workunit.client.1.smithi161.stdout:3/514: write d1/d2e/d3d/f38 [4481709,48009] 0 2024-09-18T12:52:06.727 INFO:tasks.workunit.client.1.smithi161.stdout:0/504: creat df/d98/fb5 x:0 0 0 2024-09-18T12:52:06.730 INFO:tasks.workunit.client.1.smithi161.stdout:7/467: dwrite d3/d8/d15/d1a/d24/d31/f34 [4194304,4194304] 0 2024-09-18T12:52:06.732 INFO:tasks.workunit.client.1.smithi161.stdout:6/513: creat d4/d61/d69/f9b x:0 0 0 2024-09-18T12:52:06.733 INFO:tasks.workunit.client.0.smithi045.stdout:8/203: write d11/d14/d2c/f38 [467577,35386] 0 2024-09-18T12:52:06.733 INFO:tasks.workunit.client.0.smithi045.stdout:8/204: readlink l1 0 2024-09-18T12:52:06.736 INFO:tasks.workunit.client.1.smithi161.stdout:9/433: symlink d0/db/d6f/l8d 0 2024-09-18T12:52:06.740 INFO:tasks.workunit.client.1.smithi161.stdout:3/515: dread d1/d2e/d3d/d49/f5f [0,4194304] 0 2024-09-18T12:52:06.740 INFO:tasks.workunit.client.1.smithi161.stdout:0/505: mkdir df/d84/db6 0 2024-09-18T12:52:06.740 INFO:tasks.workunit.client.1.smithi161.stdout:2/531: sync 2024-09-18T12:52:06.741 INFO:tasks.workunit.client.1.smithi161.stdout:8/535: dwrite d0/d3/d10/d21/d4a/d52/d66/d5b/f8a [0,4194304] 0 2024-09-18T12:52:06.743 INFO:tasks.workunit.client.1.smithi161.stdout:4/534: mknod d5/d14/cb1 0 2024-09-18T12:52:06.744 INFO:tasks.workunit.client.1.smithi161.stdout:6/514: rename d4/d1a/f14 to d4/d39/d26/d31/d76/f9c 0 2024-09-18T12:52:06.746 INFO:tasks.workunit.client.1.smithi161.stdout:0/506: chown df/f1c 4327734 1 2024-09-18T12:52:06.748 INFO:tasks.workunit.client.1.smithi161.stdout:7/468: dwrite d3/d8/d15/f26 [4194304,4194304] 0 2024-09-18T12:52:06.750 INFO:tasks.workunit.client.1.smithi161.stdout:5/458: dwrite d3/d9/d4b/d8e/d24/f70 [0,4194304] 0 2024-09-18T12:52:06.750 INFO:tasks.workunit.client.1.smithi161.stdout:6/515: fdatasync d4/d39/d26/d31/f5b 0 2024-09-18T12:52:06.756 INFO:tasks.workunit.client.1.smithi161.stdout:2/532: creat d0/d5/d53/d7d/fb6 x:0 0 0 2024-09-18T12:52:06.757 INFO:tasks.workunit.client.1.smithi161.stdout:4/535: rename d5/d27/f72 to d5/d14/d5f/da1/fb2 0 2024-09-18T12:52:06.759 INFO:tasks.workunit.client.1.smithi161.stdout:1/414: dread d1/da/f16 [0,4194304] 0 2024-09-18T12:52:06.760 INFO:tasks.workunit.client.1.smithi161.stdout:9/434: link d0/d16/d25/d28/d45/f66 d0/d16/d25/d46/d53/f8e 0 2024-09-18T12:52:06.761 INFO:tasks.workunit.client.1.smithi161.stdout:6/516: mkdir d4/d61/d9d 0 2024-09-18T12:52:06.764 INFO:tasks.workunit.client.1.smithi161.stdout:5/459: dwrite d3/d44/f8c [0,4194304] 0 2024-09-18T12:52:06.765 INFO:tasks.workunit.client.1.smithi161.stdout:5/460: read - d3/f7e zero size 2024-09-18T12:52:06.765 INFO:tasks.workunit.client.0.smithi045.stdout:8/205: dread f7 [0,4194304] 0 2024-09-18T12:52:06.766 INFO:tasks.workunit.client.1.smithi161.stdout:2/533: symlink d0/d5/d43/lb7 0 2024-09-18T12:52:06.770 INFO:tasks.workunit.client.1.smithi161.stdout:3/516: dread d1/d2e/d3d/f38 [4194304,4194304] 0 2024-09-18T12:52:06.770 INFO:tasks.workunit.client.1.smithi161.stdout:9/435: creat d0/d47/f8f x:0 0 0 2024-09-18T12:52:06.771 INFO:tasks.workunit.client.1.smithi161.stdout:6/517: mkdir d4/d1a/d1c/d3e/d83/d9e 0 2024-09-18T12:52:06.772 INFO:tasks.workunit.client.1.smithi161.stdout:7/469: creat d3/d8/f80 x:0 0 0 2024-09-18T12:52:06.774 INFO:tasks.workunit.client.1.smithi161.stdout:4/536: mknod d5/d27/cb3 0 2024-09-18T12:52:06.774 INFO:tasks.workunit.client.0.smithi045.stdout:8/206: dwrite d11/d23/f32 [0,4194304] 0 2024-09-18T12:52:06.777 INFO:tasks.workunit.client.1.smithi161.stdout:2/534: dwrite d0/d4/d52/d8b/f8c [0,4194304] 0 2024-09-18T12:52:06.778 INFO:tasks.workunit.client.1.smithi161.stdout:3/517: rmdir d1/d2e/d24/d1d 39 2024-09-18T12:52:06.779 INFO:tasks.workunit.client.1.smithi161.stdout:2/535: chown d0/f75 5867220 1 2024-09-18T12:52:06.779 INFO:tasks.workunit.client.0.smithi045.stdout:8/207: chown d11/d14/c37 1170704 1 2024-09-18T12:52:06.781 INFO:tasks.workunit.client.1.smithi161.stdout:5/461: link d3/d9/d4b/d8e/d24/f36 d3/d14/d8d/f95 0 2024-09-18T12:52:06.783 INFO:tasks.workunit.client.0.smithi045.stdout:8/208: rmdir d11/d14 39 2024-09-18T12:52:06.784 INFO:tasks.workunit.client.1.smithi161.stdout:9/436: fsync d0/f3b 0 2024-09-18T12:52:06.785 INFO:tasks.workunit.client.1.smithi161.stdout:5/462: write d3/d3b/f3d [4114886,92764] 0 2024-09-18T12:52:06.786 INFO:tasks.workunit.client.1.smithi161.stdout:0/507: link df/f23 df/d29/d46/d90/d37/fb7 0 2024-09-18T12:52:06.788 INFO:tasks.workunit.client.1.smithi161.stdout:7/470: mknod d3/d8/d15/d1a/d4a/d59/c81 0 2024-09-18T12:52:06.789 INFO:tasks.workunit.client.1.smithi161.stdout:0/508: truncate df/d29/fa2 914740 0 2024-09-18T12:52:06.789 INFO:tasks.workunit.client.0.smithi045.stdout:8/209: mkdir d11/d20/d39 0 2024-09-18T12:52:06.791 INFO:tasks.workunit.client.1.smithi161.stdout:8/536: dwrite d0/d3/d10/f22 [0,4194304] 0 2024-09-18T12:52:06.792 INFO:tasks.workunit.client.1.smithi161.stdout:2/536: mknod d0/d5/d53/cb8 0 2024-09-18T12:52:06.795 INFO:tasks.workunit.client.0.smithi045.stdout:8/210: unlink d11/c33 0 2024-09-18T12:52:06.796 INFO:tasks.workunit.client.1.smithi161.stdout:6/518: creat d4/d1a/d1c/d7c/f9f x:0 0 0 2024-09-18T12:52:06.797 INFO:tasks.workunit.client.1.smithi161.stdout:9/437: symlink d0/d16/d25/d46/d53/d59/l90 0 2024-09-18T12:52:06.798 INFO:tasks.workunit.client.1.smithi161.stdout:2/537: dwrite d0/d1/f7 [0,4194304] 0 2024-09-18T12:52:06.798 INFO:tasks.workunit.client.1.smithi161.stdout:5/463: creat d3/d3b/d54/f96 x:0 0 0 2024-09-18T12:52:06.801 INFO:tasks.workunit.client.1.smithi161.stdout:4/537: fsync d5/d32/f45 0 2024-09-18T12:52:06.803 INFO:tasks.workunit.client.1.smithi161.stdout:0/509: write df/f22 [1055543,68479] 0 2024-09-18T12:52:06.804 INFO:tasks.workunit.client.0.smithi045.stdout:8/211: rename d11/d23/f32 to d11/d14/f3a 0 2024-09-18T12:52:06.806 INFO:tasks.workunit.client.1.smithi161.stdout:7/471: symlink d3/d8/d15/d1a/d24/l82 0 2024-09-18T12:52:06.808 INFO:tasks.workunit.client.1.smithi161.stdout:3/518: write d1/d2e/d24/f47 [6039583,48860] 0 2024-09-18T12:52:06.808 INFO:tasks.workunit.client.1.smithi161.stdout:9/438: dwrite d0/d20/d49/f15 [0,4194304] 0 2024-09-18T12:52:06.809 INFO:tasks.workunit.client.0.smithi045.stdout:8/212: rmdir d11/d14/d2c 39 2024-09-18T12:52:06.809 INFO:tasks.workunit.client.1.smithi161.stdout:7/472: fdatasync d3/d8/d15/d1a/d4a/d59/f73 0 2024-09-18T12:52:06.813 INFO:tasks.workunit.client.1.smithi161.stdout:5/464: creat d3/d14/f97 x:0 0 0 2024-09-18T12:52:06.816 INFO:tasks.workunit.client.0.smithi045.stdout:8/213: symlink d11/d14/l3b 0 2024-09-18T12:52:06.817 INFO:tasks.workunit.client.1.smithi161.stdout:2/538: mkdir d0/d1/d4c/d67/db9 0 2024-09-18T12:52:06.819 INFO:tasks.workunit.client.0.smithi045.stdout:8/214: creat d11/d20/f3c x:0 0 0 2024-09-18T12:52:06.821 INFO:tasks.workunit.client.1.smithi161.stdout:4/538: mknod d5/d27/d3a/d47/d49/d7b/cb4 0 2024-09-18T12:52:06.822 INFO:tasks.workunit.client.1.smithi161.stdout:7/473: mkdir d3/d83 0 2024-09-18T12:52:06.824 INFO:tasks.workunit.client.1.smithi161.stdout:3/519: rename d1/d2e/d14/d2c/c36 to d1/d2e/d3d/d49/caf 0 2024-09-18T12:52:06.825 INFO:tasks.workunit.client.0.smithi045.stdout:8/215: dwrite d11/d14/f1e [0,4194304] 0 2024-09-18T12:52:06.825 INFO:tasks.workunit.client.1.smithi161.stdout:3/520: chown d1/d2e/d14/d65 118560559 1 2024-09-18T12:52:06.827 INFO:tasks.workunit.client.1.smithi161.stdout:5/465: read d3/d14/d20/f3e [2978888,113700] 0 2024-09-18T12:52:06.828 INFO:tasks.workunit.client.1.smithi161.stdout:3/521: chown d1/d2e/d14/f30 29 1 2024-09-18T12:52:06.829 INFO:tasks.workunit.client.1.smithi161.stdout:8/537: creat d0/d3/d10/d21/fb6 x:0 0 0 2024-09-18T12:52:06.829 INFO:tasks.workunit.client.1.smithi161.stdout:0/510: dwrite df/d29/d36/d7a/f81 [0,4194304] 0 2024-09-18T12:52:06.832 INFO:tasks.workunit.client.1.smithi161.stdout:9/439: link d0/d20/d49/f7e d0/d47/d48/d7f/f91 0 2024-09-18T12:52:06.833 INFO:tasks.workunit.client.0.smithi045.stdout:8/216: dwrite fd [0,4194304] 0 2024-09-18T12:52:06.834 INFO:tasks.workunit.client.1.smithi161.stdout:8/538: chown d0/d3/d10/c8d 73345452 1 2024-09-18T12:52:06.836 INFO:tasks.workunit.client.1.smithi161.stdout:2/539: stat d0/d5/d43/d35/l6c 0 2024-09-18T12:52:06.837 INFO:tasks.workunit.client.1.smithi161.stdout:6/519: dwrite d4/d39/d3a/f6d [0,4194304] 0 2024-09-18T12:52:06.838 INFO:tasks.workunit.client.0.smithi045.stdout:8/217: unlink d11/d14/c37 0 2024-09-18T12:52:06.843 INFO:tasks.workunit.client.1.smithi161.stdout:0/511: creat df/d30/d71/d96/fb8 x:0 0 0 2024-09-18T12:52:06.846 INFO:tasks.workunit.client.1.smithi161.stdout:6/520: mkdir d4/d61/d69/da0 0 2024-09-18T12:52:06.846 INFO:tasks.workunit.client.1.smithi161.stdout:3/522: getdents d1/d2e/d14/d2c/d72 0 2024-09-18T12:52:06.846 INFO:tasks.workunit.client.1.smithi161.stdout:4/539: rename d5/d32/d39/d4d/l9e to d5/d27/d3a/lb5 0 2024-09-18T12:52:06.846 INFO:tasks.workunit.client.1.smithi161.stdout:9/440: rmdir d0/d16/d25/d46 39 2024-09-18T12:52:06.847 INFO:tasks.workunit.client.0.smithi045.stdout:8/218: dwrite f9 [0,4194304] 0 2024-09-18T12:52:06.851 INFO:tasks.workunit.client.1.smithi161.stdout:1/415: sync 2024-09-18T12:52:06.860 INFO:tasks.workunit.client.1.smithi161.stdout:5/466: write d3/d14/d20/f3e [2436542,114674] 0 2024-09-18T12:52:06.860 INFO:tasks.workunit.client.1.smithi161.stdout:6/521: getdents d4/d1a/d1c/d3e/d83/d9e 0 2024-09-18T12:52:06.863 INFO:tasks.workunit.client.1.smithi161.stdout:7/474: dread d3/d8/d15/d1a/f22 [0,4194304] 0 2024-09-18T12:52:06.863 INFO:tasks.workunit.client.1.smithi161.stdout:2/540: rename d0/d5/d53/d7d/fb4 to d0/d5/d43/fba 0 2024-09-18T12:52:06.863 INFO:tasks.workunit.client.1.smithi161.stdout:0/512: rename df/d29/d46/d90/d69 to df/d29/d46/d90/d69/db9 22 2024-09-18T12:52:06.865 INFO:tasks.workunit.client.1.smithi161.stdout:6/522: mknod d4/d61/d69/ca1 0 2024-09-18T12:52:06.866 INFO:tasks.workunit.client.1.smithi161.stdout:9/441: link d0/d16/d25/d46/d53/f8e d0/d20/d49/d65/f92 0 2024-09-18T12:52:06.866 INFO:tasks.workunit.client.1.smithi161.stdout:5/467: dread d3/f66 [0,4194304] 0 2024-09-18T12:52:06.867 INFO:tasks.workunit.client.1.smithi161.stdout:2/541: creat d0/d1/df/d8a/fbb x:0 0 0 2024-09-18T12:52:06.868 INFO:tasks.workunit.client.1.smithi161.stdout:0/513: mkdir df/d29/d46/d90/d37/d55/dba 0 2024-09-18T12:52:06.869 INFO:tasks.workunit.client.1.smithi161.stdout:8/539: dread d0/f2a [0,4194304] 0 2024-09-18T12:52:06.869 INFO:tasks.workunit.client.1.smithi161.stdout:7/475: dread d3/d8/d15/d1a/f41 [0,4194304] 0 2024-09-18T12:52:06.871 INFO:tasks.workunit.client.1.smithi161.stdout:0/514: chown df/d29/cac 2 1 2024-09-18T12:52:06.871 INFO:tasks.workunit.client.1.smithi161.stdout:9/442: write d0/db/d18/f80 [625731,40757] 0 2024-09-18T12:52:06.871 INFO:tasks.workunit.client.1.smithi161.stdout:5/468: creat d3/d3b/f98 x:0 0 0 2024-09-18T12:52:06.873 INFO:tasks.workunit.client.1.smithi161.stdout:0/515: stat df/d30/c34 0 2024-09-18T12:52:06.874 INFO:tasks.workunit.client.1.smithi161.stdout:7/476: mknod d3/d83/c84 0 2024-09-18T12:52:06.875 INFO:tasks.workunit.client.1.smithi161.stdout:8/540: mkdir d0/d3/d10/d21/d4a/db7 0 2024-09-18T12:52:06.876 INFO:tasks.workunit.client.1.smithi161.stdout:9/443: mkdir d0/d93 0 2024-09-18T12:52:06.876 INFO:tasks.workunit.client.1.smithi161.stdout:4/540: dread d5/d32/f42 [0,4194304] 0 2024-09-18T12:52:06.877 INFO:tasks.workunit.client.1.smithi161.stdout:5/469: creat d3/d9/d4b/f99 x:0 0 0 2024-09-18T12:52:06.877 INFO:tasks.workunit.client.1.smithi161.stdout:7/477: mknod d3/c85 0 2024-09-18T12:52:06.880 INFO:tasks.workunit.client.1.smithi161.stdout:0/516: creat df/d29/d36/fbb x:0 0 0 2024-09-18T12:52:06.880 INFO:tasks.workunit.client.1.smithi161.stdout:6/523: dwrite d4/d39/d26/f55 [4194304,4194304] 0 2024-09-18T12:52:06.881 INFO:tasks.workunit.client.1.smithi161.stdout:8/541: write d0/f7a [106648,122726] 0 2024-09-18T12:52:06.883 INFO:tasks.workunit.client.1.smithi161.stdout:4/541: chown d5/d27/d3a/d4c/l74 1623210 1 2024-09-18T12:52:06.884 INFO:tasks.workunit.client.1.smithi161.stdout:6/524: stat d4/d39/d26/d20/d45/d68 0 2024-09-18T12:52:06.885 INFO:tasks.workunit.client.1.smithi161.stdout:5/470: symlink d3/d14/l9a 0 2024-09-18T12:52:06.888 INFO:tasks.workunit.client.1.smithi161.stdout:8/542: chown d0/d3/d10/d21/d4a/d52/d66/f71 2584 1 2024-09-18T12:52:06.888 INFO:tasks.workunit.client.1.smithi161.stdout:5/471: fsync d3/d3b/d54/f96 0 2024-09-18T12:52:06.892 INFO:tasks.workunit.client.1.smithi161.stdout:4/542: mkdir d5/d32/d39/db6 0 2024-09-18T12:52:06.892 INFO:tasks.workunit.client.0.smithi045.stdout:8/219: dread d11/f17 [0,4194304] 0 2024-09-18T12:52:06.893 INFO:tasks.workunit.client.1.smithi161.stdout:6/525: mkdir d4/d1a/d1c/d3e/d83/da2 0 2024-09-18T12:52:06.895 INFO:tasks.workunit.client.1.smithi161.stdout:9/444: rename d0/d20/d49/l1a to d0/d16/d25/l94 0 2024-09-18T12:52:06.897 INFO:tasks.workunit.client.0.smithi045.stdout:8/220: dread d11/f12 [0,4194304] 0 2024-09-18T12:52:06.897 INFO:tasks.workunit.client.1.smithi161.stdout:5/472: write d3/d44/d6f/d86/f94 [820564,50409] 0 2024-09-18T12:52:06.897 INFO:tasks.workunit.client.0.smithi045.stdout:8/221: chown f7 1 1 2024-09-18T12:52:06.899 INFO:tasks.workunit.client.1.smithi161.stdout:1/416: dread d1/d26/d3a/f5d [0,4194304] 0 2024-09-18T12:52:06.900 INFO:tasks.workunit.client.1.smithi161.stdout:7/478: dwrite d3/d8/d15/d1a/d4a/d64/f7b [0,4194304] 0 2024-09-18T12:52:06.900 INFO:tasks.workunit.client.1.smithi161.stdout:3/523: dwrite d1/f8b [0,4194304] 0 2024-09-18T12:52:06.901 INFO:tasks.workunit.client.1.smithi161.stdout:4/543: creat d5/d27/d3a/d60/d8a/fb7 x:0 0 0 2024-09-18T12:52:06.903 INFO:tasks.workunit.client.1.smithi161.stdout:5/473: chown d3/d3b/d54/f5a 7809831 1 2024-09-18T12:52:06.904 INFO:tasks.workunit.client.1.smithi161.stdout:1/417: readlink d1/d48/l7f 0 2024-09-18T12:52:06.910 INFO:tasks.workunit.client.1.smithi161.stdout:0/517: dread df/d29/f2c [0,4194304] 0 2024-09-18T12:52:06.910 INFO:tasks.workunit.client.1.smithi161.stdout:6/526: mkdir d4/d61/d9d/da3 0 2024-09-18T12:52:06.912 INFO:tasks.workunit.client.1.smithi161.stdout:2/542: dread d0/d1/f3f [0,4194304] 0 2024-09-18T12:52:06.913 INFO:tasks.workunit.client.1.smithi161.stdout:7/479: symlink d3/d8/d15/d1a/d4a/d64/l86 0 2024-09-18T12:52:06.915 INFO:tasks.workunit.client.1.smithi161.stdout:4/544: mkdir d5/d14/d67/d84/dae/db8 0 2024-09-18T12:52:06.915 INFO:tasks.workunit.client.1.smithi161.stdout:0/518: chown df/d84/d86/l67 113056142 1 2024-09-18T12:52:06.917 INFO:tasks.workunit.client.1.smithi161.stdout:1/418: chown d1/d26/d3a/l44 239657 1 2024-09-18T12:52:06.918 INFO:tasks.workunit.client.1.smithi161.stdout:8/543: link d0/d3/d10/d21/d4a/d52/d66/d5b/fa0 d0/d3/d10/d21/fb8 0 2024-09-18T12:52:06.920 INFO:tasks.workunit.client.1.smithi161.stdout:4/545: mkdir d5/da9/db9 0 2024-09-18T12:52:06.923 INFO:tasks.workunit.client.1.smithi161.stdout:3/524: dwrite d1/d2e/d14/d2c/f31 [0,4194304] 0 2024-09-18T12:52:06.924 INFO:tasks.workunit.client.0.smithi045.stdout:8/222: dread d11/d14/f36 [0,4194304] 0 2024-09-18T12:52:06.925 INFO:tasks.workunit.client.1.smithi161.stdout:8/544: readlink d0/d3/d10/lab 0 2024-09-18T12:52:06.925 INFO:tasks.workunit.client.1.smithi161.stdout:5/474: dwrite d3/d9/f1c [0,4194304] 0 2024-09-18T12:52:06.927 INFO:tasks.workunit.client.1.smithi161.stdout:6/527: dread d4/d61/f89 [0,4194304] 0 2024-09-18T12:52:06.929 INFO:tasks.workunit.client.1.smithi161.stdout:9/445: dwrite d0/db/d18/f36 [0,4194304] 0 2024-09-18T12:52:06.930 INFO:tasks.workunit.client.1.smithi161.stdout:0/519: chown df/d29/d46/d90/d37/fb7 208996280 1 2024-09-18T12:52:06.931 INFO:tasks.workunit.client.0.smithi045.stdout:8/223: dwrite f9 [0,4194304] 0 2024-09-18T12:52:06.933 INFO:tasks.workunit.client.1.smithi161.stdout:9/446: write d0/f6e [604242,39875] 0 2024-09-18T12:52:06.935 INFO:tasks.workunit.client.1.smithi161.stdout:6/528: write d4/f97 [175471,71817] 0 2024-09-18T12:52:06.936 INFO:tasks.workunit.client.1.smithi161.stdout:0/520: write df/d84/d86/f75 [5124627,116589] 0 2024-09-18T12:52:06.938 INFO:tasks.workunit.client.1.smithi161.stdout:2/543: truncate d0/d1/d3b/d7e/f70 1939019 0 2024-09-18T12:52:06.942 INFO:tasks.workunit.client.1.smithi161.stdout:5/475: stat d3/d9/d4b/l8f 0 2024-09-18T12:52:06.943 INFO:tasks.workunit.client.1.smithi161.stdout:9/447: read d0/f3b [2772188,121467] 0 2024-09-18T12:52:06.944 INFO:tasks.workunit.client.1.smithi161.stdout:7/480: dwrite d3/d8/d15/d38/f5f [0,4194304] 0 2024-09-18T12:52:06.947 INFO:tasks.workunit.client.1.smithi161.stdout:4/546: getdents d5/d32 0 2024-09-18T12:52:06.949 INFO:tasks.workunit.client.1.smithi161.stdout:0/521: truncate df/f23 912136 0 2024-09-18T12:52:06.952 INFO:tasks.workunit.client.1.smithi161.stdout:3/525: dwrite d1/d2e/d14/f58 [0,4194304] 0 2024-09-18T12:52:06.954 INFO:tasks.workunit.client.1.smithi161.stdout:5/476: truncate d3/d44/d6f/d86/f94 1451433 0 2024-09-18T12:52:06.954 INFO:tasks.workunit.client.1.smithi161.stdout:0/522: unlink df/d30/d4d/l85 0 2024-09-18T12:52:06.955 INFO:tasks.workunit.client.1.smithi161.stdout:6/529: creat d4/d1a/d1c/d3e/d83/d9e/fa4 x:0 0 0 2024-09-18T12:52:06.956 INFO:tasks.workunit.client.1.smithi161.stdout:7/481: fsync d3/f6d 0 2024-09-18T12:52:06.962 INFO:tasks.workunit.client.1.smithi161.stdout:0/523: creat df/d29/d46/d78/fbc x:0 0 0 2024-09-18T12:52:06.964 INFO:tasks.workunit.client.1.smithi161.stdout:6/530: creat d4/d61/fa5 x:0 0 0 2024-09-18T12:52:06.964 INFO:tasks.workunit.client.1.smithi161.stdout:7/482: dread - d3/d8/d15/d1a/d24/d31/f68 zero size 2024-09-18T12:52:06.965 INFO:tasks.workunit.client.0.smithi045.stdout:8/224: dread d11/f13 [0,4194304] 0 2024-09-18T12:52:06.965 INFO:tasks.workunit.client.1.smithi161.stdout:2/544: dwrite d0/d4/d52/f85 [0,4194304] 0 2024-09-18T12:52:06.965 INFO:tasks.workunit.client.1.smithi161.stdout:4/547: rename d5/d14/d5f/da1/fb2 to d5/d27/d3a/d60/d95/fba 0 2024-09-18T12:52:06.967 INFO:tasks.workunit.client.1.smithi161.stdout:5/477: dread d3/d9/f6e [0,4194304] 0 2024-09-18T12:52:06.967 INFO:tasks.workunit.client.1.smithi161.stdout:8/545: dread d0/d3/d10/f63 [0,4194304] 0 2024-09-18T12:52:06.969 INFO:tasks.workunit.client.0.smithi045.stdout:8/225: unlink cc 0 2024-09-18T12:52:06.970 INFO:tasks.workunit.client.0.smithi045.stdout:8/226: dread - d11/d23/f2b zero size 2024-09-18T12:52:06.970 INFO:tasks.workunit.client.1.smithi161.stdout:9/448: getdents d0/d16 0 2024-09-18T12:52:06.970 INFO:tasks.workunit.client.1.smithi161.stdout:6/531: symlink d4/d39/d26/la6 0 2024-09-18T12:52:06.971 INFO:tasks.workunit.client.1.smithi161.stdout:7/483: write d3/d36/f65 [571596,123360] 0 2024-09-18T12:52:06.971 INFO:tasks.workunit.client.1.smithi161.stdout:8/546: readlink d0/d3/la 0 2024-09-18T12:52:06.973 INFO:tasks.workunit.client.1.smithi161.stdout:2/545: write d0/d1/f3 [1471513,54089] 0 2024-09-18T12:52:06.973 INFO:tasks.workunit.client.1.smithi161.stdout:3/526: dwrite d1/d2e/d3d/f7 [0,4194304] 0 2024-09-18T12:52:06.977 INFO:tasks.workunit.client.1.smithi161.stdout:0/524: creat df/d29/d46/d90/d37/d55/fbd x:0 0 0 2024-09-18T12:52:06.979 INFO:tasks.workunit.client.1.smithi161.stdout:9/449: symlink d0/d47/d48/l95 0 2024-09-18T12:52:06.979 INFO:tasks.workunit.client.0.smithi045.stdout:8/227: getdents d11 0 2024-09-18T12:52:06.980 INFO:tasks.workunit.client.0.smithi045.stdout:8/228: stat d11/f17 0 2024-09-18T12:52:06.984 INFO:tasks.workunit.client.1.smithi161.stdout:6/532: symlink d4/la7 0 2024-09-18T12:52:06.984 INFO:tasks.workunit.client.1.smithi161.stdout:7/484: symlink d3/d8/l87 0 2024-09-18T12:52:06.988 INFO:tasks.workunit.client.1.smithi161.stdout:2/546: dwrite d0/d1/d3b/d3d/f99 [0,4194304] 0 2024-09-18T12:52:06.990 INFO:tasks.workunit.client.1.smithi161.stdout:2/547: dread - d0/d5/d43/d35/f44 zero size 2024-09-18T12:52:06.990 INFO:tasks.workunit.client.1.smithi161.stdout:2/548: chown d0/d4/d52/d8b 2944340 1 2024-09-18T12:52:06.991 INFO:tasks.workunit.client.1.smithi161.stdout:0/525: fsync df/f50 0 2024-09-18T12:52:06.994 INFO:tasks.workunit.client.1.smithi161.stdout:3/527: rename d1/da5 to d1/d2e/d24/d1d/d89/db0 0 2024-09-18T12:52:06.998 INFO:tasks.workunit.client.1.smithi161.stdout:9/450: mknod d0/d16/d25/d46/d53/d59/c96 0 2024-09-18T12:52:06.999 INFO:tasks.workunit.client.1.smithi161.stdout:5/478: link d3/d9/d4b/c71 d3/d3b/d7b/c9b 0 2024-09-18T12:52:07.000 INFO:tasks.workunit.client.1.smithi161.stdout:5/479: fdatasync d3/d9/f12 0 2024-09-18T12:52:07.001 INFO:tasks.workunit.client.1.smithi161.stdout:5/480: chown d3/f56 3601 1 2024-09-18T12:52:07.002 INFO:tasks.workunit.client.1.smithi161.stdout:5/481: chown d3/d3b/d54/f69 3775 1 2024-09-18T12:52:07.005 INFO:tasks.workunit.client.1.smithi161.stdout:5/482: chown d3/d3b/d54/l5d 3 1 2024-09-18T12:52:07.005 INFO:tasks.workunit.client.1.smithi161.stdout:8/547: link d0/d3/lb5 d0/d3/d91/lb9 0 2024-09-18T12:52:07.005 INFO:tasks.workunit.client.1.smithi161.stdout:7/485: dread d3/d8/d15/d1a/f39 [0,4194304] 0 2024-09-18T12:52:07.006 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:06 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:07.007 INFO:tasks.workunit.client.1.smithi161.stdout:3/528: rename d1/d2e/d14/d78/d83/l85 to d1/d2e/d24/d84/d9a/lb1 0 2024-09-18T12:52:07.009 INFO:tasks.workunit.client.1.smithi161.stdout:9/451: dwrite d0/d16/d25/d28/d45/f60 [0,4194304] 0 2024-09-18T12:52:07.010 INFO:tasks.workunit.client.1.smithi161.stdout:8/548: fsync d0/d3/d10/d21/d4a/f77 0 2024-09-18T12:52:07.011 INFO:tasks.workunit.client.1.smithi161.stdout:0/526: symlink df/d84/d86/da5/lbe 0 2024-09-18T12:52:07.012 INFO:tasks.workunit.client.0.smithi045.stdout:8/229: dwrite d11/f17 [4194304,4194304] 0 2024-09-18T12:52:07.013 INFO:tasks.workunit.client.1.smithi161.stdout:4/548: dread d5/ff [4194304,4194304] 0 2024-09-18T12:52:07.015 INFO:tasks.workunit.client.1.smithi161.stdout:6/533: creat d4/fa8 x:0 0 0 2024-09-18T12:52:07.015 INFO:tasks.workunit.client.1.smithi161.stdout:2/549: dwrite d0/d5/d43/f18 [0,4194304] 0 2024-09-18T12:52:07.016 INFO:tasks.workunit.client.1.smithi161.stdout:0/527: dread - df/d29/d46/f64 zero size 2024-09-18T12:52:07.017 INFO:tasks.workunit.client.0.smithi045.stdout:8/230: dread d11/f12 [0,4194304] 0 2024-09-18T12:52:07.018 INFO:tasks.workunit.client.1.smithi161.stdout:5/483: rename d3/f40 to d3/d9/d4b/f9c 0 2024-09-18T12:52:07.020 INFO:tasks.workunit.client.1.smithi161.stdout:6/534: write d4/f97 [251806,87826] 0 2024-09-18T12:52:07.020 INFO:tasks.workunit.client.1.smithi161.stdout:7/486: dwrite d3/f6d [0,4194304] 0 2024-09-18T12:52:07.025 INFO:tasks.workunit.client.1.smithi161.stdout:7/487: read d3/d8/d15/d1a/d4a/d59/f6e [3364510,73535] 0 2024-09-18T12:52:07.027 INFO:tasks.workunit.client.1.smithi161.stdout:1/419: sync 2024-09-18T12:52:07.027 INFO:tasks.workunit.client.1.smithi161.stdout:8/549: rename d0/d3/d10/d21/d87 to d0/d3/d10/d21/d4a/d52/d82/d96/dba 0 2024-09-18T12:52:07.028 INFO:tasks.workunit.client.1.smithi161.stdout:6/535: write d4/d1a/f13 [1429874,96672] 0 2024-09-18T12:52:07.029 INFO:tasks.workunit.client.1.smithi161.stdout:0/528: mknod df/d29/d46/d90/d69/cbf 0 2024-09-18T12:52:07.030 INFO:tasks.workunit.client.1.smithi161.stdout:6/536: write d4/f95 [521753,63154] 0 2024-09-18T12:52:07.031 INFO:tasks.workunit.client.1.smithi161.stdout:5/484: creat d3/d3b/d7b/d82/f9d x:0 0 0 2024-09-18T12:52:07.032 INFO:tasks.workunit.client.1.smithi161.stdout:6/537: chown d4/d39/d3a/f1f 0 1 2024-09-18T12:52:07.032 INFO:tasks.workunit.client.1.smithi161.stdout:0/529: write df/d29/d46/d90/d37/d55/fa4 [825478,63902] 0 2024-09-18T12:52:07.033 INFO:tasks.workunit.client.1.smithi161.stdout:3/529: mknod d1/d2e/d24/cb2 0 2024-09-18T12:52:07.034 INFO:tasks.workunit.client.1.smithi161.stdout:3/530: truncate d1/d2e/d3d/f38 5602993 0 2024-09-18T12:52:07.036 INFO:tasks.workunit.client.1.smithi161.stdout:7/488: symlink d3/d36/l88 0 2024-09-18T12:52:07.038 INFO:tasks.workunit.client.1.smithi161.stdout:2/550: creat d0/d1/d3b/d93/fbc x:0 0 0 2024-09-18T12:52:07.042 INFO:tasks.workunit.client.1.smithi161.stdout:1/420: unlink d1/da/d31/l36 0 2024-09-18T12:52:07.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:06 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:07.045 INFO:tasks.workunit.client.1.smithi161.stdout:0/530: read df/d30/d4d/f4f [450851,60026] 0 2024-09-18T12:52:07.046 INFO:tasks.workunit.client.1.smithi161.stdout:0/531: readlink df/d29/d46/d90/d37/d55/l5e 0 2024-09-18T12:52:07.046 INFO:tasks.workunit.client.1.smithi161.stdout:3/531: rename d1/d2e/d14/d2c/c46 to d1/d2e/d14/d2c/d72/cb3 0 2024-09-18T12:52:07.047 INFO:tasks.workunit.client.1.smithi161.stdout:7/489: fsync d3/d8/d4b/f6f 0 2024-09-18T12:52:07.049 INFO:tasks.workunit.client.1.smithi161.stdout:2/551: creat d0/d1/d3b/d93/fbd x:0 0 0 2024-09-18T12:52:07.049 INFO:tasks.workunit.client.1.smithi161.stdout:0/532: write df/d29/f8d [645816,98072] 0 2024-09-18T12:52:07.050 INFO:tasks.workunit.client.1.smithi161.stdout:9/452: dwrite d0/d20/f39 [0,4194304] 0 2024-09-18T12:52:07.051 INFO:tasks.workunit.client.0.smithi045.stdout:8/231: truncate d11/f13 835362 0 2024-09-18T12:52:07.051 INFO:tasks.workunit.client.1.smithi161.stdout:8/550: unlink d0/d3/d10/d21/la1 0 2024-09-18T12:52:07.053 INFO:tasks.workunit.client.1.smithi161.stdout:0/533: stat df/d29/d46/d90/l8c 0 2024-09-18T12:52:07.054 INFO:tasks.workunit.client.0.smithi045.stdout:8/232: write d11/d14/f1b [4031833,55257] 0 2024-09-18T12:52:07.055 INFO:tasks.workunit.client.1.smithi161.stdout:8/551: stat d0/d3/d10/d21/d4a/d52/d66/f71 0 2024-09-18T12:52:07.055 INFO:tasks.workunit.client.1.smithi161.stdout:4/549: dwrite d5/f22 [4194304,4194304] 0 2024-09-18T12:52:07.055 INFO:tasks.workunit.client.0.smithi045.stdout:8/233: chown d11/d23/c26 33 1 2024-09-18T12:52:07.056 INFO:tasks.workunit.client.1.smithi161.stdout:1/421: rename d1/da/d39/c7c to d1/d26/d3a/c8a 0 2024-09-18T12:52:07.059 INFO:tasks.workunit.client.1.smithi161.stdout:1/422: read d1/da/d1f/f51 [1066237,41789] 0 2024-09-18T12:52:07.059 INFO:tasks.workunit.client.1.smithi161.stdout:7/490: mkdir d3/d8/d15/d38/d77/d89 0 2024-09-18T12:52:07.062 INFO:tasks.workunit.client.1.smithi161.stdout:6/538: creat d4/fa9 x:0 0 0 2024-09-18T12:52:07.063 INFO:tasks.workunit.client.1.smithi161.stdout:9/453: fdatasync d0/d47/d48/d7f/f91 0 2024-09-18T12:52:07.064 INFO:tasks.workunit.client.1.smithi161.stdout:9/454: readlink d0/d16/d25/d28/d45/l32 0 2024-09-18T12:52:07.065 INFO:tasks.workunit.client.1.smithi161.stdout:9/455: chown d0/db/f50 140 1 2024-09-18T12:52:07.066 INFO:tasks.workunit.client.1.smithi161.stdout:5/485: write d3/d8/f59 [1294000,114862] 0 2024-09-18T12:52:07.066 INFO:tasks.workunit.client.0.smithi045.stdout:8/234: mkdir d11/d14/d3d 0 2024-09-18T12:52:07.066 INFO:tasks.workunit.client.0.smithi045.stdout:8/235: fdatasync d11/d20/f27 0 2024-09-18T12:52:07.067 INFO:tasks.workunit.client.1.smithi161.stdout:4/550: mknod d5/d14/d67/d84/dae/cbb 0 2024-09-18T12:52:07.068 INFO:tasks.workunit.client.1.smithi161.stdout:8/552: rmdir d0/d3/d10/d21/d4a/d52/d82/d96/dba 39 2024-09-18T12:52:07.070 INFO:tasks.workunit.client.1.smithi161.stdout:2/552: rename d0/d4/f68 to d0/d4/d78/fbe 0 2024-09-18T12:52:07.070 INFO:tasks.workunit.client.0.smithi045.stdout:8/236: getdents d11/d20/d39 0 2024-09-18T12:52:07.071 INFO:tasks.workunit.client.1.smithi161.stdout:2/553: write d0/d4/d52/d8b/f8c [3439679,9777] 0 2024-09-18T12:52:07.074 INFO:tasks.workunit.client.1.smithi161.stdout:6/539: creat d4/d1a/d1c/d3e/d83/faa x:0 0 0 2024-09-18T12:52:07.075 INFO:tasks.workunit.client.0.smithi045.stdout:8/237: rmdir d11 39 2024-09-18T12:52:07.077 INFO:tasks.workunit.client.1.smithi161.stdout:6/540: dread d4/d1a/d1c/d3e/d4d/f78 [0,4194304] 0 2024-09-18T12:52:07.078 INFO:tasks.workunit.client.1.smithi161.stdout:6/541: dread - d4/d1a/d1c/d7c/f9f zero size 2024-09-18T12:52:07.078 INFO:tasks.workunit.client.1.smithi161.stdout:9/456: creat d0/d20/d74/f97 x:0 0 0 2024-09-18T12:52:07.081 INFO:tasks.workunit.client.1.smithi161.stdout:5/486: dread d3/f66 [0,4194304] 0 2024-09-18T12:52:07.085 INFO:tasks.workunit.client.1.smithi161.stdout:4/551: mkdir d5/d27/d3a/d47/dbc 0 2024-09-18T12:52:07.086 INFO:tasks.workunit.client.1.smithi161.stdout:5/487: dwrite d3/d14/f97 [0,4194304] 0 2024-09-18T12:52:07.086 INFO:tasks.workunit.client.0.smithi045.stdout:8/238: creat d11/d20/d39/f3e x:0 0 0 2024-09-18T12:52:07.091 INFO:tasks.workunit.client.0.smithi045.stdout:8/239: dread d11/f17 [0,4194304] 0 2024-09-18T12:52:07.098 INFO:tasks.workunit.client.1.smithi161.stdout:2/554: write d0/d1/df/f34 [3691831,99482] 0 2024-09-18T12:52:07.102 INFO:tasks.workunit.client.1.smithi161.stdout:4/552: write d5/d27/d3a/d47/f99 [1845758,57341] 0 2024-09-18T12:52:07.103 INFO:tasks.workunit.client.1.smithi161.stdout:5/488: fsync d3/d8/f77 0 2024-09-18T12:52:07.104 INFO:tasks.workunit.client.1.smithi161.stdout:7/491: truncate d3/d8/f29 3925311 0 2024-09-18T12:52:07.107 INFO:tasks.workunit.client.1.smithi161.stdout:9/457: symlink d0/l98 0 2024-09-18T12:52:07.108 INFO:tasks.workunit.client.1.smithi161.stdout:9/458: chown d0/d47/d48/l95 18426 1 2024-09-18T12:52:07.109 INFO:tasks.workunit.client.1.smithi161.stdout:2/555: symlink d0/d4/d78/lbf 0 2024-09-18T12:52:07.109 INFO:tasks.workunit.client.1.smithi161.stdout:2/556: stat d0/d5/d53/f81 0 2024-09-18T12:52:07.111 INFO:tasks.workunit.client.1.smithi161.stdout:4/553: mknod d5/d27/d44/d61/cbd 0 2024-09-18T12:52:07.112 INFO:tasks.workunit.client.1.smithi161.stdout:4/554: write d5/f21 [1370482,53610] 0 2024-09-18T12:52:07.113 INFO:tasks.workunit.client.1.smithi161.stdout:4/555: fsync d5/d32/d39/d4d/f96 0 2024-09-18T12:52:07.113 INFO:tasks.workunit.client.1.smithi161.stdout:0/534: rename df/d30/d71/d96/f9d to df/d29/fc0 0 2024-09-18T12:52:07.116 INFO:tasks.workunit.client.1.smithi161.stdout:1/423: getdents d1/da/d1f 0 2024-09-18T12:52:07.117 INFO:tasks.workunit.client.1.smithi161.stdout:5/489: dread d3/d9/f1c [4194304,4194304] 0 2024-09-18T12:52:07.117 INFO:tasks.workunit.client.1.smithi161.stdout:1/424: write d1/da/d1f/d45/f6d [1099572,95273] 0 2024-09-18T12:52:07.119 INFO:tasks.workunit.client.1.smithi161.stdout:6/542: truncate d4/d39/d26/f55 2492963 0 2024-09-18T12:52:07.120 INFO:tasks.workunit.client.1.smithi161.stdout:6/543: write d4/d39/d47/f7f [223507,48656] 0 2024-09-18T12:52:07.121 INFO:tasks.workunit.client.1.smithi161.stdout:6/544: write d4/d39/d26/d20/d28/f4b [55759,101220] 0 2024-09-18T12:52:07.124 INFO:tasks.workunit.client.1.smithi161.stdout:0/535: symlink df/d29/d46/d90/lc1 0 2024-09-18T12:52:07.130 INFO:tasks.workunit.client.1.smithi161.stdout:6/545: dwrite d4/d1a/d1c/d7c/f9f [0,4194304] 0 2024-09-18T12:52:07.131 INFO:tasks.workunit.client.1.smithi161.stdout:9/459: dwrite d0/d47/d48/d7f/f91 [0,4194304] 0 2024-09-18T12:52:07.133 INFO:tasks.workunit.client.1.smithi161.stdout:6/546: dread d4/d39/d48/f8b [0,4194304] 0 2024-09-18T12:52:07.133 INFO:tasks.workunit.client.1.smithi161.stdout:8/553: rename d0/d3/d1e/l8c to d0/d3/d10/d21/d4a/d52/d94/lbb 0 2024-09-18T12:52:07.138 INFO:tasks.workunit.client.1.smithi161.stdout:8/554: fdatasync d0/d3/d10/d21/f30 0 2024-09-18T12:52:07.140 INFO:tasks.workunit.client.1.smithi161.stdout:7/492: truncate d3/d8/d15/d38/f2f 2410351 0 2024-09-18T12:52:07.142 INFO:tasks.workunit.client.1.smithi161.stdout:1/425: chown d1/d1d/c54 55899 1 2024-09-18T12:52:07.142 INFO:tasks.workunit.client.1.smithi161.stdout:0/536: creat df/d84/db6/fc2 x:0 0 0 2024-09-18T12:52:07.142 INFO:tasks.workunit.client.1.smithi161.stdout:4/556: rename d5/d27/d3a/d47/f99 to d5/d32/fbe 0 2024-09-18T12:52:07.142 INFO:tasks.workunit.client.1.smithi161.stdout:2/557: link d0/d5/d53/l95 d0/d4/d78/lc0 0 2024-09-18T12:52:07.143 INFO:tasks.workunit.client.1.smithi161.stdout:3/532: sync 2024-09-18T12:52:07.144 INFO:tasks.workunit.client.1.smithi161.stdout:8/555: creat d0/d3/d10/fbc x:0 0 0 2024-09-18T12:52:07.145 INFO:tasks.workunit.client.1.smithi161.stdout:2/558: chown d0/d1/d4c/d67/l94 142 1 2024-09-18T12:52:07.145 INFO:tasks.workunit.client.1.smithi161.stdout:9/460: dwrite d0/f6e [0,4194304] 0 2024-09-18T12:52:07.146 INFO:tasks.workunit.client.1.smithi161.stdout:3/533: write d1/d2e/d24/f3a [5056160,63901] 0 2024-09-18T12:52:07.147 INFO:tasks.workunit.client.1.smithi161.stdout:6/547: mkdir d4/d61/d69/da0/dab 0 2024-09-18T12:52:07.148 INFO:tasks.workunit.client.1.smithi161.stdout:1/426: mknod d1/da/d1f/c8b 0 2024-09-18T12:52:07.150 INFO:tasks.workunit.client.1.smithi161.stdout:9/461: write d0/d16/d25/d28/f38 [4941322,50852] 0 2024-09-18T12:52:07.150 INFO:tasks.workunit.client.1.smithi161.stdout:3/534: dread - d1/d2e/d24/d1d/d89/db0/fa2 zero size 2024-09-18T12:52:07.151 INFO:tasks.workunit.client.1.smithi161.stdout:8/556: creat d0/d3/d10/d21/d4a/d52/d82/fbd x:0 0 0 2024-09-18T12:52:07.153 INFO:tasks.workunit.client.1.smithi161.stdout:3/535: chown d1/f5c 1043251351 1 2024-09-18T12:52:07.153 INFO:tasks.workunit.client.1.smithi161.stdout:5/490: rename d3/d14/c60 to d3/d9/c9e 0 2024-09-18T12:52:07.154 INFO:tasks.workunit.client.1.smithi161.stdout:6/548: dread d4/d39/d47/f7f [0,4194304] 0 2024-09-18T12:52:07.155 INFO:tasks.workunit.client.1.smithi161.stdout:3/536: readlink d1/d2e/d24/d1d/l3e 0 2024-09-18T12:52:07.155 INFO:tasks.workunit.client.1.smithi161.stdout:5/491: fsync d3/d3b/d7b/d82/f9d 0 2024-09-18T12:52:07.169 INFO:tasks.workunit.client.1.smithi161.stdout:6/549: dread d4/d39/d26/d31/f5b [0,4194304] 0 2024-09-18T12:52:07.240 INFO:tasks.workunit.client.1.smithi161.stdout:2/559: link d0/d1/df/d8a/fbb d0/d1/d4c/fc1 0 2024-09-18T12:52:07.240 INFO:tasks.workunit.client.1.smithi161.stdout:2/560: fdatasync d0/d4/f62 0 2024-09-18T12:52:07.244 INFO:tasks.workunit.client.1.smithi161.stdout:0/537: getdents df/d29/d36/d7a 0 2024-09-18T12:52:07.247 INFO:tasks.workunit.client.1.smithi161.stdout:3/537: creat d1/d2e/d14/d65/d76/fb4 x:0 0 0 2024-09-18T12:52:07.251 INFO:tasks.workunit.client.1.smithi161.stdout:0/538: symlink df/d84/d89/lc3 0 2024-09-18T12:52:07.252 INFO:tasks.workunit.client.1.smithi161.stdout:6/550: mknod d4/d61/d69/da0/dab/cac 0 2024-09-18T12:52:07.254 INFO:tasks.workunit.client.1.smithi161.stdout:1/427: rename d1/l86 to d1/da/l8c 0 2024-09-18T12:52:07.255 INFO:tasks.workunit.client.1.smithi161.stdout:4/557: truncate d5/d27/f46 1176137 0 2024-09-18T12:52:07.257 INFO:tasks.workunit.client.1.smithi161.stdout:9/462: link d0/d16/d25/d28/d45/f79 d0/d16/d25/d46/f99 0 2024-09-18T12:52:07.258 INFO:tasks.workunit.client.1.smithi161.stdout:0/539: mknod df/d29/d36/d7a/cc4 0 2024-09-18T12:52:07.259 INFO:tasks.workunit.client.1.smithi161.stdout:6/551: dwrite d4/d1a/d1c/d7c/f9f [0,4194304] 0 2024-09-18T12:52:07.261 INFO:tasks.workunit.client.1.smithi161.stdout:2/561: dwrite d0/d5/d43/d35/d98/fa6 [0,4194304] 0 2024-09-18T12:52:07.261 INFO:tasks.workunit.client.1.smithi161.stdout:1/428: unlink d1/d48/c6c 0 2024-09-18T12:52:07.262 INFO:tasks.workunit.client.1.smithi161.stdout:7/493: truncate d3/d8/d15/d38/f2f 569536 0 2024-09-18T12:52:07.264 INFO:tasks.workunit.client.1.smithi161.stdout:2/562: readlink d0/d5/l28 0 2024-09-18T12:52:07.265 INFO:tasks.workunit.client.1.smithi161.stdout:9/463: mkdir d0/d47/d48/d9a 0 2024-09-18T12:52:07.265 INFO:tasks.workunit.client.1.smithi161.stdout:1/429: fsync d1/da/d31/f78 0 2024-09-18T12:52:07.267 INFO:tasks.workunit.client.1.smithi161.stdout:4/558: dread d5/d27/d3a/d4c/f57 [0,4194304] 0 2024-09-18T12:52:07.269 INFO:tasks.workunit.client.1.smithi161.stdout:5/492: write d3/f66 [1534394,118136] 0 2024-09-18T12:52:07.270 INFO:tasks.workunit.client.1.smithi161.stdout:7/494: dread d3/d8/d15/d1a/f41 [0,4194304] 0 2024-09-18T12:52:07.270 INFO:tasks.workunit.client.1.smithi161.stdout:0/540: write df/d29/d46/d51/fa8 [234129,62248] 0 2024-09-18T12:52:07.273 INFO:tasks.workunit.client.1.smithi161.stdout:3/538: rename d1/d2e/caa to d1/cb5 0 2024-09-18T12:52:07.274 INFO:tasks.workunit.client.1.smithi161.stdout:9/464: write d0/d20/d49/f14 [4821538,128537] 0 2024-09-18T12:52:07.274 INFO:tasks.workunit.client.1.smithi161.stdout:4/559: chown d5/d32/d39/d4d/f52 29 1 2024-09-18T12:52:07.274 INFO:tasks.workunit.client.1.smithi161.stdout:2/563: mknod d0/d71/da9/d9f/cc2 0 2024-09-18T12:52:07.279 INFO:tasks.workunit.client.1.smithi161.stdout:8/557: dwrite d0/d3/d10/d21/d4a/d52/d66/d5b/fa0 [0,4194304] 0 2024-09-18T12:52:07.279 INFO:tasks.workunit.client.1.smithi161.stdout:4/560: fdatasync d5/d27/d44/f55 0 2024-09-18T12:52:07.281 INFO:tasks.workunit.client.1.smithi161.stdout:5/493: mkdir d3/d9/d4b/d8e/d46/d9f 0 2024-09-18T12:52:07.282 INFO:tasks.workunit.client.1.smithi161.stdout:6/552: getdents d4/d1a/d1c 0 2024-09-18T12:52:07.282 INFO:tasks.workunit.client.1.smithi161.stdout:8/558: fsync d0/d3/d10/f22 0 2024-09-18T12:52:07.284 INFO:tasks.workunit.client.1.smithi161.stdout:0/541: rename df/d84 to df/d30/d4d/d92/d95/dc5 0 2024-09-18T12:52:07.284 INFO:tasks.workunit.client.1.smithi161.stdout:9/465: mknod d0/d20/d74/c9b 0 2024-09-18T12:52:07.285 INFO:tasks.workunit.client.1.smithi161.stdout:9/466: chown d0/d16/l44 29828999 1 2024-09-18T12:52:07.286 INFO:tasks.workunit.client.1.smithi161.stdout:3/539: symlink d1/d2e/d68/d92/lb6 0 2024-09-18T12:52:07.286 INFO:tasks.workunit.client.1.smithi161.stdout:8/559: write d0/d3/d10/d21/d4a/d52/fa7 [631932,23973] 0 2024-09-18T12:52:07.287 INFO:tasks.workunit.client.1.smithi161.stdout:4/561: mkdir d5/d32/d39/dbf 0 2024-09-18T12:52:07.287 INFO:tasks.workunit.client.1.smithi161.stdout:9/467: chown d0/db/f57 5444 1 2024-09-18T12:52:07.288 INFO:tasks.workunit.client.1.smithi161.stdout:2/564: creat d0/d5/d43/d23/fc3 x:0 0 0 2024-09-18T12:52:07.288 INFO:tasks.workunit.client.1.smithi161.stdout:0/542: chown df/d30/d4d/d92/d95/dc5/d89/lc3 997960 1 2024-09-18T12:52:07.289 INFO:tasks.workunit.client.1.smithi161.stdout:6/553: mkdir d4/d1a/d1c/d3e/d83/dad 0 2024-09-18T12:52:07.292 INFO:tasks.workunit.client.1.smithi161.stdout:2/565: rmdir d0/d1/d3b 39 2024-09-18T12:52:07.294 INFO:tasks.workunit.client.1.smithi161.stdout:4/562: creat d5/d14/d5f/da1/fc0 x:0 0 0 2024-09-18T12:52:07.295 INFO:tasks.workunit.client.1.smithi161.stdout:9/468: rename d0/db/f3c to d0/d16/f9c 0 2024-09-18T12:52:07.296 INFO:tasks.workunit.client.1.smithi161.stdout:3/540: dwrite d1/d2e/d24/f47 [0,4194304] 0 2024-09-18T12:52:07.297 INFO:tasks.workunit.client.1.smithi161.stdout:7/495: getdents d3/d8 0 2024-09-18T12:52:07.298 INFO:tasks.workunit.client.1.smithi161.stdout:1/430: truncate d1/f15 752390 0 2024-09-18T12:52:07.298 INFO:tasks.workunit.client.1.smithi161.stdout:6/554: creat d4/d61/d69/fae x:0 0 0 2024-09-18T12:52:07.300 INFO:tasks.workunit.client.1.smithi161.stdout:8/560: rmdir d0/d3/d10/d21/d4a/d52/d70 39 2024-09-18T12:52:07.302 INFO:tasks.workunit.client.1.smithi161.stdout:7/496: fsync d3/d8/d15/d1a/d24/d31/f68 0 2024-09-18T12:52:07.302 INFO:tasks.workunit.client.1.smithi161.stdout:8/561: chown d0/d3/d10/d21/f86 745 1 2024-09-18T12:52:07.303 INFO:tasks.workunit.client.1.smithi161.stdout:3/541: rename d1/d2e/d14/d65/fad to d1/d2e/d14/d2c/fb7 0 2024-09-18T12:52:07.304 INFO:tasks.workunit.client.1.smithi161.stdout:5/494: getdents d3/d44 0 2024-09-18T12:52:07.305 INFO:tasks.workunit.client.1.smithi161.stdout:6/555: creat d4/d1a/d1c/d3e/d4d/faf x:0 0 0 2024-09-18T12:52:07.305 INFO:tasks.workunit.client.1.smithi161.stdout:8/562: write d0/d3/d10/d21/d4a/f4f [3985909,71718] 0 2024-09-18T12:52:07.306 INFO:tasks.workunit.client.1.smithi161.stdout:2/566: creat d0/d1/df/d8a/da8/fc4 x:0 0 0 2024-09-18T12:52:07.308 INFO:tasks.workunit.client.1.smithi161.stdout:7/497: creat d3/d8/d15/d1a/d24/d31/f8a x:0 0 0 2024-09-18T12:52:07.308 INFO:tasks.workunit.client.1.smithi161.stdout:8/563: write d0/d3/d10/fbc [34616,57824] 0 2024-09-18T12:52:07.309 INFO:tasks.workunit.client.1.smithi161.stdout:7/498: stat d3/d8/d15/d1a/d24/d31/f62 0 2024-09-18T12:52:07.310 INFO:tasks.workunit.client.1.smithi161.stdout:0/543: dread df/d30/d4d/f4f [0,4194304] 0 2024-09-18T12:52:07.311 INFO:tasks.workunit.client.1.smithi161.stdout:5/495: dread d3/d9/f6d [0,4194304] 0 2024-09-18T12:52:07.311 INFO:tasks.workunit.client.1.smithi161.stdout:0/544: chown df/d29/d46/d90/f88 36 1 2024-09-18T12:52:07.312 INFO:tasks.workunit.client.1.smithi161.stdout:5/496: readlink d3/l55 0 2024-09-18T12:52:07.312 INFO:tasks.workunit.client.1.smithi161.stdout:5/497: fdatasync d3/d3b/d54/f69 0 2024-09-18T12:52:07.314 INFO:tasks.workunit.client.1.smithi161.stdout:6/556: mkdir d4/d61/d69/da0/db0 0 2024-09-18T12:52:07.314 INFO:tasks.workunit.client.1.smithi161.stdout:2/567: rmdir d0/d71/da9/d9f 39 2024-09-18T12:52:07.314 INFO:tasks.workunit.client.1.smithi161.stdout:6/557: fdatasync d4/d61/d69/f90 0 2024-09-18T12:52:07.316 INFO:tasks.workunit.client.1.smithi161.stdout:2/568: write d0/d4/d52/f85 [1569312,39858] 0 2024-09-18T12:52:07.316 INFO:tasks.workunit.client.1.smithi161.stdout:7/499: creat d3/d36/f8b x:0 0 0 2024-09-18T12:52:07.316 INFO:tasks.workunit.client.1.smithi161.stdout:8/564: dread - d0/d3/d10/d21/d4a/d52/d82/d96/f61 zero size 2024-09-18T12:52:07.317 INFO:tasks.workunit.client.1.smithi161.stdout:0/545: rmdir df 39 2024-09-18T12:52:07.317 INFO:tasks.workunit.client.1.smithi161.stdout:7/500: chown d3/d8/d4b 406 1 2024-09-18T12:52:07.317 INFO:tasks.workunit.client.1.smithi161.stdout:4/563: link d5/d27/d3a/l9f d5/da9/db9/lc1 0 2024-09-18T12:52:07.319 INFO:tasks.workunit.client.0.smithi045.stdout:9/175: sync 2024-09-18T12:52:07.319 INFO:tasks.workunit.client.0.smithi045.stdout:6/209: sync 2024-09-18T12:52:07.323 INFO:tasks.workunit.client.0.smithi045.stdout:6/210: write d9/d1a/d2d/d38/f40 [169852,41751] 0 2024-09-18T12:52:07.324 INFO:tasks.workunit.client.0.smithi045.stdout:6/211: read - d9/d30/f33 zero size 2024-09-18T12:52:07.325 INFO:tasks.workunit.client.0.smithi045.stdout:9/176: creat d0/d3/d6/d10/d26/d2e/f3c x:0 0 0 2024-09-18T12:52:07.328 INFO:tasks.workunit.client.0.smithi045.stdout:6/212: mknod d9/d1a/d2d/d32/c43 0 2024-09-18T12:52:07.331 INFO:tasks.workunit.client.0.smithi045.stdout:6/213: creat d9/d1a/d2d/d38/f44 x:0 0 0 2024-09-18T12:52:07.332 INFO:tasks.workunit.client.0.smithi045.stdout:9/177: dwrite d0/d3/f7 [0,4194304] 0 2024-09-18T12:52:07.333 INFO:tasks.workunit.client.0.smithi045.stdout:6/214: creat d9/f45 x:0 0 0 2024-09-18T12:52:07.335 INFO:tasks.workunit.client.0.smithi045.stdout:9/178: truncate d0/d3/d6/d10/f2a 513259 0 2024-09-18T12:52:07.336 INFO:tasks.workunit.client.0.smithi045.stdout:6/215: mknod d9/d1a/c46 0 2024-09-18T12:52:07.336 INFO:tasks.workunit.client.0.smithi045.stdout:6/216: stat d9/d30/f35 0 2024-09-18T12:52:07.337 INFO:tasks.workunit.client.0.smithi045.stdout:9/179: creat d0/d3/d6/f3d x:0 0 0 2024-09-18T12:52:07.337 INFO:tasks.workunit.client.0.smithi045.stdout:6/217: rmdir d9/d1a 39 2024-09-18T12:52:07.344 INFO:tasks.workunit.client.0.smithi045.stdout:6/218: link d9/d1a/d2d/d38/c3f d9/c47 0 2024-09-18T12:52:07.345 INFO:tasks.workunit.client.0.smithi045.stdout:9/180: dwrite d0/d3/d6/d10/d26/d2e/f3c [0,4194304] 0 2024-09-18T12:52:07.349 INFO:tasks.workunit.client.0.smithi045.stdout:6/219: mkdir d9/d1a/d48 0 2024-09-18T12:52:07.351 INFO:tasks.workunit.client.0.smithi045.stdout:6/220: read - d9/f23 zero size 2024-09-18T12:52:07.352 INFO:tasks.workunit.client.0.smithi045.stdout:6/221: dread - d9/d1a/f37 zero size 2024-09-18T12:52:07.354 INFO:tasks.workunit.client.1.smithi161.stdout:0/546: stat df/d29/d36/fbb 0 2024-09-18T12:52:07.355 INFO:tasks.workunit.client.1.smithi161.stdout:6/558: rename d4/d39/d26/d20 to d4/d1a/d1c/d3e/d83/d9e/db1 0 2024-09-18T12:52:07.355 INFO:tasks.workunit.client.1.smithi161.stdout:1/431: dread d1/da/d1f/d45/f47 [0,4194304] 0 2024-09-18T12:52:07.356 INFO:tasks.workunit.client.1.smithi161.stdout:0/547: write df/f24 [2630758,65608] 0 2024-09-18T12:52:07.356 INFO:tasks.workunit.client.1.smithi161.stdout:3/542: getdents d1/d2e/d14/d65 0 2024-09-18T12:52:07.356 INFO:tasks.workunit.client.0.smithi045.stdout:6/222: creat d9/d1a/d2d/d38/f49 x:0 0 0 2024-09-18T12:52:07.357 INFO:tasks.workunit.client.1.smithi161.stdout:0/548: write df/d30/d4d/d92/d95/dc5/d86/f75 [2224601,91302] 0 2024-09-18T12:52:07.359 INFO:tasks.workunit.client.1.smithi161.stdout:2/569: symlink d0/d4/d52/d8b/lc5 0 2024-09-18T12:52:07.363 INFO:tasks.workunit.client.0.smithi045.stdout:6/223: creat d9/d1a/d2d/f4a x:0 0 0 2024-09-18T12:52:07.366 INFO:tasks.workunit.client.1.smithi161.stdout:6/559: creat d4/d39/d26/fb2 x:0 0 0 2024-09-18T12:52:07.367 INFO:tasks.workunit.client.1.smithi161.stdout:6/560: read d4/d39/d3a/f6d [1057494,83355] 0 2024-09-18T12:52:07.368 INFO:tasks.workunit.client.1.smithi161.stdout:3/543: mknod d1/d2e/d68/cb8 0 2024-09-18T12:52:07.368 INFO:tasks.workunit.client.0.smithi045.stdout:9/181: dwrite d0/d3/d6/d10/f1b [0,4194304] 0 2024-09-18T12:52:07.369 INFO:tasks.workunit.client.0.smithi045.stdout:9/182: fsync d0/d3/d6/f3d 0 2024-09-18T12:52:07.369 INFO:tasks.workunit.client.1.smithi161.stdout:1/432: creat d1/da/d31/f8d x:0 0 0 2024-09-18T12:52:07.369 INFO:tasks.workunit.client.1.smithi161.stdout:3/544: read - d1/d2e/d14/d65/d76/d8c/f8d zero size 2024-09-18T12:52:07.370 INFO:tasks.workunit.client.1.smithi161.stdout:4/564: dread d5/d32/d39/f4e [4194304,4194304] 0 2024-09-18T12:52:07.374 INFO:tasks.workunit.client.1.smithi161.stdout:0/549: creat df/d30/d4d/d92/d95/dc5/d8a/fc6 x:0 0 0 2024-09-18T12:52:07.375 INFO:tasks.workunit.client.0.smithi045.stdout:6/224: getdents d9/d1a/d1d 0 2024-09-18T12:52:07.376 INFO:tasks.workunit.client.1.smithi161.stdout:0/550: read - df/d29/d46/d90/d37/faf zero size 2024-09-18T12:52:07.376 INFO:tasks.workunit.client.0.smithi045.stdout:1/230: sync 2024-09-18T12:52:07.376 INFO:tasks.workunit.client.0.smithi045.stdout:7/193: sync 2024-09-18T12:52:07.377 INFO:tasks.workunit.client.0.smithi045.stdout:1/231: fdatasync d0/f23 0 2024-09-18T12:52:07.377 INFO:tasks.workunit.client.0.smithi045.stdout:9/183: getdents d0 0 2024-09-18T12:52:07.378 INFO:tasks.workunit.client.1.smithi161.stdout:8/565: getdents d0/d3/d10/d21/d4a/d52/db4 0 2024-09-18T12:52:07.379 INFO:tasks.workunit.client.0.smithi045.stdout:6/225: rmdir d9 39 2024-09-18T12:52:07.381 INFO:tasks.workunit.client.1.smithi161.stdout:0/551: dwrite df/d29/d36/f43 [0,4194304] 0 2024-09-18T12:52:07.383 INFO:tasks.workunit.client.1.smithi161.stdout:0/552: chown df/l2f 47543 1 2024-09-18T12:52:07.385 INFO:tasks.workunit.client.0.smithi045.stdout:1/232: creat d0/d2d/d2b/d30/f47 x:0 0 0 2024-09-18T12:52:07.385 INFO:tasks.workunit.client.1.smithi161.stdout:3/545: mknod d1/d2e/d14/d90/cb9 0 2024-09-18T12:52:07.385 INFO:tasks.workunit.client.0.smithi045.stdout:1/233: fdatasync d0/f7 0 2024-09-18T12:52:07.386 INFO:tasks.workunit.client.1.smithi161.stdout:0/553: dread - df/d30/d4d/d92/d95/dc5/d8a/fc6 zero size 2024-09-18T12:52:07.387 INFO:tasks.workunit.client.1.smithi161.stdout:8/566: dwrite d0/d3/d10/d21/d4a/d52/d82/d96/f72 [0,4194304] 0 2024-09-18T12:52:07.389 INFO:tasks.workunit.client.0.smithi045.stdout:7/194: creat d13/d31/d33/f42 x:0 0 0 2024-09-18T12:52:07.391 INFO:tasks.workunit.client.1.smithi161.stdout:9/469: getdents d0/d16/d25/d46 0 2024-09-18T12:52:07.392 INFO:tasks.workunit.client.1.smithi161.stdout:7/501: write d3/d8/d15/d38/f2f [262668,101353] 0 2024-09-18T12:52:07.393 INFO:tasks.workunit.client.0.smithi045.stdout:7/195: rename d13/d1a to d13/d1a/d28/d43 22 2024-09-18T12:52:07.396 INFO:tasks.workunit.client.0.smithi045.stdout:1/234: dwrite d0/d12/f3b [0,4194304] 0 2024-09-18T12:52:07.396 INFO:tasks.workunit.client.1.smithi161.stdout:0/554: dwrite df/d29/d36/f43 [0,4194304] 0 2024-09-18T12:52:07.396 INFO:tasks.workunit.client.1.smithi161.stdout:4/565: dwrite d5/d27/d44/f88 [0,4194304] 0 2024-09-18T12:52:07.396 INFO:tasks.workunit.client.1.smithi161.stdout:9/470: dread d0/d16/d25/d46/d53/f7c [0,4194304] 0 2024-09-18T12:52:07.398 INFO:tasks.workunit.client.1.smithi161.stdout:6/561: rename d4/d61/f98 to d4/d61/d69/da0/dab/fb3 0 2024-09-18T12:52:07.399 INFO:tasks.workunit.client.0.smithi045.stdout:9/184: dread d0/f2 [0,4194304] 0 2024-09-18T12:52:07.399 INFO:tasks.workunit.client.0.smithi045.stdout:1/235: write d0/d12/f15 [1711438,20731] 0 2024-09-18T12:52:07.400 INFO:tasks.workunit.client.1.smithi161.stdout:3/546: mkdir d1/d2e/d68/d92/dba 0 2024-09-18T12:52:07.404 INFO:tasks.workunit.client.0.smithi045.stdout:6/226: symlink d9/d1a/d48/l4b 0 2024-09-18T12:52:07.404 INFO:tasks.workunit.client.0.smithi045.stdout:7/196: rename d13/d1c to d13/d44 0 2024-09-18T12:52:07.410 INFO:tasks.workunit.client.0.smithi045.stdout:9/185: chown d0/la 296337494 1 2024-09-18T12:52:07.411 INFO:tasks.workunit.client.1.smithi161.stdout:2/570: mkdir d0/d1/d3b/d3d/d4f/d9b/dc6 0 2024-09-18T12:52:07.412 INFO:tasks.workunit.client.1.smithi161.stdout:2/571: fsync d0/d1/d3b/d93/fbd 0 2024-09-18T12:52:07.413 INFO:tasks.workunit.client.0.smithi045.stdout:1/236: rename d0/f3e to d0/d2d/d2b/d30/f48 0 2024-09-18T12:52:07.415 INFO:tasks.workunit.client.0.smithi045.stdout:9/186: chown d0/d3/d6/d10/d26/d2e/f3c 157 1 2024-09-18T12:52:07.417 INFO:tasks.workunit.client.0.smithi045.stdout:6/227: rmdir d9/d1a/d48 39 2024-09-18T12:52:07.419 INFO:tasks.workunit.client.1.smithi161.stdout:9/471: rename d0/f64 to d0/d47/d48/d9a/f9d 0 2024-09-18T12:52:07.424 INFO:tasks.workunit.client.0.smithi045.stdout:1/237: chown d0/fe 80959 1 2024-09-18T12:52:07.424 INFO:tasks.workunit.client.1.smithi161.stdout:3/547: rmdir d1/d2e/d24/d1d/d89 39 2024-09-18T12:52:07.429 INFO:tasks.workunit.client.1.smithi161.stdout:0/555: mkdir df/d29/dc7 0 2024-09-18T12:52:07.429 INFO:tasks.workunit.client.1.smithi161.stdout:1/433: dread d1/f5 [0,4194304] 0 2024-09-18T12:52:07.430 INFO:tasks.workunit.client.1.smithi161.stdout:2/572: rmdir d0/d1/df/d8a 39 2024-09-18T12:52:07.431 INFO:tasks.workunit.client.1.smithi161.stdout:1/434: dread d1/d26/f3f [0,4194304] 0 2024-09-18T12:52:07.431 INFO:tasks.workunit.client.1.smithi161.stdout:4/566: creat d5/d32/d39/db6/fc2 x:0 0 0 2024-09-18T12:52:07.435 INFO:tasks.workunit.client.1.smithi161.stdout:9/472: mkdir d0/d47/d48/d7f/d9e 0 2024-09-18T12:52:07.435 INFO:tasks.workunit.client.1.smithi161.stdout:7/502: write d3/f11 [757704,97493] 0 2024-09-18T12:52:07.436 INFO:tasks.workunit.client.1.smithi161.stdout:7/503: write d3/d8/d15/d1a/d24/d31/f8a [959378,51572] 0 2024-09-18T12:52:07.437 INFO:tasks.workunit.client.1.smithi161.stdout:6/562: mkdir d4/d1a/d1c/d3e/d83/da2/db4 0 2024-09-18T12:52:07.437 INFO:tasks.workunit.client.0.smithi045.stdout:1/238: dread d0/d12/f15 [0,4194304] 0 2024-09-18T12:52:07.438 INFO:tasks.workunit.client.0.smithi045.stdout:1/239: write d0/f3a [182393,54015] 0 2024-09-18T12:52:07.442 INFO:tasks.workunit.client.0.smithi045.stdout:7/197: write d13/f17 [168338,364] 0 2024-09-18T12:52:07.444 INFO:tasks.workunit.client.1.smithi161.stdout:7/504: dwrite d3/d8/d15/d1a/d4a/d64/f7b [0,4194304] 0 2024-09-18T12:52:07.446 INFO:tasks.workunit.client.1.smithi161.stdout:7/505: write d3/f7 [9629559,35453] 0 2024-09-18T12:52:07.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/567: creat d5/d27/d44/fc3 x:0 0 0 2024-09-18T12:52:07.446 INFO:tasks.workunit.client.0.smithi045.stdout:7/198: rmdir d13/d31 39 2024-09-18T12:52:07.448 INFO:tasks.workunit.client.0.smithi045.stdout:9/187: dwrite d0/d3/d6/f2d [0,4194304] 0 2024-09-18T12:52:07.448 INFO:tasks.workunit.client.1.smithi161.stdout:9/473: chown d0/d16/d25/d28/d45/f66 116528 1 2024-09-18T12:52:07.450 INFO:tasks.workunit.client.1.smithi161.stdout:3/548: creat d1/d2e/d14/d65/d76/d8c/d9d/fbb x:0 0 0 2024-09-18T12:52:07.450 INFO:tasks.workunit.client.1.smithi161.stdout:5/498: sync 2024-09-18T12:52:07.452 INFO:tasks.workunit.client.1.smithi161.stdout:6/563: rmdir d4/d39/d26 39 2024-09-18T12:52:07.454 INFO:tasks.workunit.client.0.smithi045.stdout:1/240: creat d0/f49 x:0 0 0 2024-09-18T12:52:07.454 INFO:tasks.workunit.client.0.smithi045.stdout:1/241: chown d0/f3c 324556043 1 2024-09-18T12:52:07.455 INFO:tasks.workunit.client.0.smithi045.stdout:1/242: chown d0/d12/d32 7 1 2024-09-18T12:52:07.461 INFO:tasks.workunit.client.0.smithi045.stdout:9/188: link d0/d3/d6/d10/d2c/f35 d0/f3e 0 2024-09-18T12:52:07.461 INFO:tasks.workunit.client.1.smithi161.stdout:2/573: getdents d0/d1/d4c/d67/db9 0 2024-09-18T12:52:07.462 INFO:tasks.workunit.client.0.smithi045.stdout:9/189: read d0/f2 [3713794,43858] 0 2024-09-18T12:52:07.462 INFO:tasks.workunit.client.1.smithi161.stdout:2/574: fsync d0/d4/d52/d8b/f97 0 2024-09-18T12:52:07.463 INFO:tasks.workunit.client.1.smithi161.stdout:1/435: mknod d1/da/d1f/d45/d89/c8e 0 2024-09-18T12:52:07.463 INFO:tasks.workunit.client.0.smithi045.stdout:9/190: dread - d0/d3/d6/f3d zero size 2024-09-18T12:52:07.464 INFO:tasks.workunit.client.0.smithi045.stdout:1/243: mknod d0/d2d/d2b/d30/d3d/c4a 0 2024-09-18T12:52:07.466 INFO:tasks.workunit.client.1.smithi161.stdout:2/575: dread d0/d1/f3f [0,4194304] 0 2024-09-18T12:52:07.466 INFO:tasks.workunit.client.0.smithi045.stdout:9/191: mknod d0/d3/d6/d10/d2c/c3f 0 2024-09-18T12:52:07.470 INFO:tasks.workunit.client.1.smithi161.stdout:5/499: unlink d3/d9/f34 0 2024-09-18T12:52:07.471 INFO:tasks.workunit.client.1.smithi161.stdout:5/500: stat d3/d9/f38 0 2024-09-18T12:52:07.471 INFO:tasks.workunit.client.0.smithi045.stdout:9/192: mknod d0/d3/d6/d10/d26/d2e/c40 0 2024-09-18T12:52:07.473 INFO:tasks.workunit.client.0.smithi045.stdout:9/193: read d0/d3/d6/d10/d26/d2e/f32 [166417,43293] 0 2024-09-18T12:52:07.473 INFO:tasks.workunit.client.0.smithi045.stdout:1/244: symlink d0/d2e/d46/l4b 0 2024-09-18T12:52:07.474 INFO:tasks.workunit.client.0.smithi045.stdout:1/245: truncate d0/f49 904116 0 2024-09-18T12:52:07.474 INFO:tasks.workunit.client.1.smithi161.stdout:6/564: symlink d4/d39/d47/d51/lb5 0 2024-09-18T12:52:07.477 INFO:tasks.workunit.client.0.smithi045.stdout:9/194: unlink d0/d3/d6/f33 0 2024-09-18T12:52:07.478 INFO:tasks.workunit.client.0.smithi045.stdout:1/246: fsync d0/d2d/d2b/d30/f48 0 2024-09-18T12:52:07.479 INFO:tasks.workunit.client.1.smithi161.stdout:6/565: dwrite d4/d39/d3a/f62 [0,4194304] 0 2024-09-18T12:52:07.485 INFO:tasks.workunit.client.0.smithi045.stdout:1/247: dwrite d0/f49 [0,4194304] 0 2024-09-18T12:52:07.488 INFO:tasks.workunit.client.0.smithi045.stdout:1/248: read d0/fa [1613234,28045] 0 2024-09-18T12:52:07.492 INFO:tasks.workunit.client.0.smithi045.stdout:7/199: dwrite d13/d31/f40 [0,4194304] 0 2024-09-18T12:52:07.496 INFO:tasks.workunit.client.1.smithi161.stdout:4/568: write d5/d27/d3a/f7a [947161,64064] 0 2024-09-18T12:52:07.497 INFO:tasks.workunit.client.1.smithi161.stdout:4/569: stat d5/d27/l41 0 2024-09-18T12:52:07.498 INFO:tasks.workunit.client.1.smithi161.stdout:4/570: chown d5/d14/d5f/f75 0 1 2024-09-18T12:52:07.499 INFO:tasks.workunit.client.1.smithi161.stdout:9/474: write d0/d16/d25/d28/f31 [18229,20852] 0 2024-09-18T12:52:07.501 INFO:tasks.workunit.client.1.smithi161.stdout:8/567: sync 2024-09-18T12:52:07.502 INFO:tasks.workunit.client.1.smithi161.stdout:8/568: chown d0/d3/d10/d21/d4a/d52/d82/d96/fa3 19 1 2024-09-18T12:52:07.503 INFO:tasks.workunit.client.1.smithi161.stdout:1/436: mknod d1/d26/d3a/d52/c8f 0 2024-09-18T12:52:07.508 INFO:tasks.workunit.client.0.smithi045.stdout:9/195: truncate d0/d3/d6/d10/d26/d2e/f32 1359559 0 2024-09-18T12:52:07.508 INFO:tasks.workunit.client.0.smithi045.stdout:7/200: truncate f2 8136 0 2024-09-18T12:52:07.509 INFO:tasks.workunit.client.1.smithi161.stdout:2/576: fdatasync d0/d5/d43/f37 0 2024-09-18T12:52:07.510 INFO:tasks.workunit.client.0.smithi045.stdout:9/196: mknod d0/d3/d6/d10/d26/c41 0 2024-09-18T12:52:07.512 INFO:tasks.workunit.client.0.smithi045.stdout:7/201: chown c12 146105163 1 2024-09-18T12:52:07.514 INFO:tasks.workunit.client.1.smithi161.stdout:0/556: getdents df/d98 0 2024-09-18T12:52:07.515 INFO:tasks.workunit.client.1.smithi161.stdout:6/566: creat d4/d39/d48/fb6 x:0 0 0 2024-09-18T12:52:07.517 INFO:tasks.workunit.client.1.smithi161.stdout:4/571: symlink d5/d27/d3a/d60/d8a/lc4 0 2024-09-18T12:52:07.518 INFO:tasks.workunit.client.0.smithi045.stdout:1/249: truncate d0/f3a 72563 0 2024-09-18T12:52:07.518 INFO:tasks.workunit.client.1.smithi161.stdout:4/572: dread d5/d32/f42 [4194304,4194304] 0 2024-09-18T12:52:07.518 INFO:tasks.workunit.client.0.smithi045.stdout:9/197: getdents d0/d3/d6/d10/d26/d2e 0 2024-09-18T12:52:07.519 INFO:tasks.workunit.client.1.smithi161.stdout:4/573: write d5/d32/d39/d4d/f96 [4182844,56825] 0 2024-09-18T12:52:07.519 INFO:tasks.workunit.client.1.smithi161.stdout:7/506: truncate d3/d36/f65 250813 0 2024-09-18T12:52:07.521 INFO:tasks.workunit.client.0.smithi045.stdout:1/250: chown d0/l14 170800 1 2024-09-18T12:52:07.522 INFO:tasks.workunit.client.1.smithi161.stdout:8/569: creat d0/d3/d10/d21/d4a/d52/d82/d96/d98/fbe x:0 0 0 2024-09-18T12:52:07.524 INFO:tasks.workunit.client.0.smithi045.stdout:9/198: unlink d0/d3/d6/d10/d26/d2e/c40 0 2024-09-18T12:52:07.527 INFO:tasks.workunit.client.0.smithi045.stdout:1/251: mkdir d0/d2d/d4c 0 2024-09-18T12:52:07.528 INFO:tasks.workunit.client.0.smithi045.stdout:1/252: chown d0/d2e/f22 97871942 1 2024-09-18T12:52:07.533 INFO:tasks.workunit.client.0.smithi045.stdout:1/253: fsync d0/fa 0 2024-09-18T12:52:07.534 INFO:tasks.workunit.client.1.smithi161.stdout:1/437: write d1/da/d1f/f51 [806515,58464] 0 2024-09-18T12:52:07.535 INFO:tasks.workunit.client.1.smithi161.stdout:0/557: creat df/d29/d46/d90/fc8 x:0 0 0 2024-09-18T12:52:07.535 INFO:tasks.workunit.client.1.smithi161.stdout:0/558: stat df/d29/cac 0 2024-09-18T12:52:07.536 INFO:tasks.workunit.client.1.smithi161.stdout:0/559: truncate df/d30/f80 461118 0 2024-09-18T12:52:07.537 INFO:tasks.workunit.client.1.smithi161.stdout:0/560: fdatasync df/d30/d4d/f9b 0 2024-09-18T12:52:07.540 INFO:tasks.workunit.client.1.smithi161.stdout:4/574: symlink d5/d27/d3a/d47/lc5 0 2024-09-18T12:52:07.540 INFO:tasks.workunit.client.0.smithi045.stdout:9/199: link d0/d3/d6/d10/d2c/f35 d0/d3/d6/d10/d26/f42 0 2024-09-18T12:52:07.542 INFO:tasks.workunit.client.1.smithi161.stdout:7/507: mkdir d3/d8/d15/d1a/d4a/d64/d8c 0 2024-09-18T12:52:07.542 INFO:tasks.workunit.client.0.smithi045.stdout:1/254: mknod d0/d2d/d4c/c4d 0 2024-09-18T12:52:07.543 INFO:tasks.workunit.client.1.smithi161.stdout:4/575: read d5/d27/d3a/f3d [1237078,107811] 0 2024-09-18T12:52:07.545 INFO:tasks.workunit.client.0.smithi045.stdout:9/200: symlink d0/d3/d6/d10/l43 0 2024-09-18T12:52:07.545 INFO:tasks.workunit.client.0.smithi045.stdout:9/201: chown d0/f2 1 1 2024-09-18T12:52:07.545 INFO:tasks.workunit.client.1.smithi161.stdout:2/577: write d0/d5/d43/f45 [1210021,109843] 0 2024-09-18T12:52:07.546 INFO:tasks.workunit.client.0.smithi045.stdout:9/202: write d0/f1a [2112442,109708] 0 2024-09-18T12:52:07.546 INFO:tasks.workunit.client.1.smithi161.stdout:9/475: dwrite d0/d16/f9c [4194304,4194304] 0 2024-09-18T12:52:07.546 INFO:tasks.workunit.client.1.smithi161.stdout:4/576: fsync d5/d27/d3a/d47/d49/f85 0 2024-09-18T12:52:07.547 INFO:tasks.workunit.client.1.smithi161.stdout:5/501: link d3/d14/d20/f3e d3/fa0 0 2024-09-18T12:52:07.547 INFO:tasks.workunit.client.0.smithi045.stdout:9/203: write d0/d3/f7 [4939661,105158] 0 2024-09-18T12:52:07.548 INFO:tasks.workunit.client.1.smithi161.stdout:4/577: stat d5/d27/d3a/d4c 0 2024-09-18T12:52:07.549 INFO:tasks.workunit.client.0.smithi045.stdout:1/255: creat d0/d2d/d2b/d30/d3d/f4e x:0 0 0 2024-09-18T12:52:07.549 INFO:tasks.workunit.client.1.smithi161.stdout:3/549: getdents d1/d2e/d68/d69 0 2024-09-18T12:52:07.550 INFO:tasks.workunit.client.1.smithi161.stdout:1/438: dread d1/f62 [0,4194304] 0 2024-09-18T12:52:07.550 INFO:tasks.workunit.client.0.smithi045.stdout:1/256: chown d0/d2e/c38 845952 1 2024-09-18T12:52:07.551 INFO:tasks.workunit.client.0.smithi045.stdout:1/257: truncate d0/d2d/f45 602565 0 2024-09-18T12:52:07.553 INFO:tasks.workunit.client.1.smithi161.stdout:1/439: chown d1/da/d31/f8d 207893 1 2024-09-18T12:52:07.554 INFO:tasks.workunit.client.1.smithi161.stdout:0/561: read df/d29/d36/f5b [2251560,72454] 0 2024-09-18T12:52:07.555 INFO:tasks.workunit.client.0.smithi045.stdout:1/258: creat d0/d2d/d2b/d30/f4f x:0 0 0 2024-09-18T12:52:07.555 INFO:tasks.workunit.client.1.smithi161.stdout:6/567: dread d4/d39/d26/d31/d76/f9c [0,4194304] 0 2024-09-18T12:52:07.556 INFO:tasks.workunit.client.0.smithi045.stdout:9/204: chown d0/f3e 864679373 1 2024-09-18T12:52:07.557 INFO:tasks.workunit.client.1.smithi161.stdout:7/508: rename d3/d8/d4b/f56 to d3/f8d 0 2024-09-18T12:52:07.558 INFO:tasks.workunit.client.1.smithi161.stdout:3/550: dwrite d1/d2e/d68/f6f [0,4194304] 0 2024-09-18T12:52:07.560 INFO:tasks.workunit.client.0.smithi045.stdout:9/205: creat d0/d3/d6/d10/d2c/f44 x:0 0 0 2024-09-18T12:52:07.560 INFO:tasks.workunit.client.1.smithi161.stdout:3/551: chown d1/d2e/d14/d65/f6c 104 1 2024-09-18T12:52:07.563 INFO:tasks.workunit.client.1.smithi161.stdout:3/552: write d1/d2e/d14/d90/f95 [945685,127550] 0 2024-09-18T12:52:07.563 INFO:tasks.workunit.client.1.smithi161.stdout:6/568: dread d4/d39/d47/d88/f8a [0,4194304] 0 2024-09-18T12:52:07.564 INFO:tasks.workunit.client.1.smithi161.stdout:1/440: rmdir d1/da 39 2024-09-18T12:52:07.566 INFO:tasks.workunit.client.0.smithi045.stdout:9/206: mknod d0/d3/d6/d10/d26/c45 0 2024-09-18T12:52:07.570 INFO:tasks.workunit.client.1.smithi161.stdout:0/562: mkdir df/d29/d46/d51/dc9 0 2024-09-18T12:52:07.572 INFO:tasks.workunit.client.1.smithi161.stdout:2/578: mknod d0/d71/da9/d9f/cc7 0 2024-09-18T12:52:07.574 INFO:tasks.workunit.client.1.smithi161.stdout:7/509: rename d3/c30 to d3/d8/d15/d38/d77/d89/c8e 0 2024-09-18T12:52:07.576 INFO:tasks.workunit.client.1.smithi161.stdout:4/578: mknod d5/d14/cc6 0 2024-09-18T12:52:07.579 INFO:tasks.workunit.client.0.smithi045.stdout:9/207: unlink d0/d3/c5 0 2024-09-18T12:52:07.579 INFO:tasks.workunit.client.0.smithi045.stdout:1/259: getdents d0/d2d/d2b/d30 0 2024-09-18T12:52:07.581 INFO:tasks.workunit.client.1.smithi161.stdout:1/441: symlink d1/d26/d3a/l90 0 2024-09-18T12:52:07.581 INFO:tasks.workunit.client.1.smithi161.stdout:4/579: dwrite d5/f22 [4194304,4194304] 0 2024-09-18T12:52:07.583 INFO:tasks.workunit.client.1.smithi161.stdout:2/579: creat d0/d1/d4c/d67/fc8 x:0 0 0 2024-09-18T12:52:07.584 INFO:tasks.workunit.client.0.smithi045.stdout:9/208: symlink d0/d3/d6/d10/d26/d2e/l46 0 2024-09-18T12:52:07.586 INFO:tasks.workunit.client.0.smithi045.stdout:1/260: unlink d0/l10 0 2024-09-18T12:52:07.588 INFO:tasks.workunit.client.0.smithi045.stdout:9/209: symlink d0/d3/d6/d10/d26/d2e/l47 0 2024-09-18T12:52:07.590 INFO:tasks.workunit.client.0.smithi045.stdout:9/210: rmdir d0 39 2024-09-18T12:52:07.591 INFO:tasks.workunit.client.1.smithi161.stdout:6/569: symlink d4/d1a/d1c/d3e/d83/d9e/db1/d28/d81/lb7 0 2024-09-18T12:52:07.593 INFO:tasks.workunit.client.0.smithi045.stdout:1/261: link d0/d2d/d2b/f36 d0/d2e/f50 0 2024-09-18T12:52:07.593 INFO:tasks.workunit.client.1.smithi161.stdout:1/442: readlink d1/da/d39/l27 0 2024-09-18T12:52:07.595 INFO:tasks.workunit.client.1.smithi161.stdout:5/502: getdents d3/d9/d4b/d8e/d24 0 2024-09-18T12:52:07.597 INFO:tasks.workunit.client.0.smithi045.stdout:1/262: dread d0/d12/f15 [0,4194304] 0 2024-09-18T12:52:07.597 INFO:tasks.workunit.client.1.smithi161.stdout:6/570: symlink d4/d61/d69/da0/dab/lb8 0 2024-09-18T12:52:07.598 INFO:tasks.workunit.client.0.smithi045.stdout:9/211: creat d0/d3/d6/d10/d26/d2e/f48 x:0 0 0 2024-09-18T12:52:07.599 INFO:tasks.workunit.client.1.smithi161.stdout:1/443: creat d1/da/d31/f91 x:0 0 0 2024-09-18T12:52:07.600 INFO:tasks.workunit.client.0.smithi045.stdout:3/220: sync 2024-09-18T12:52:07.600 INFO:tasks.workunit.client.0.smithi045.stdout:4/216: sync 2024-09-18T12:52:07.600 INFO:tasks.workunit.client.0.smithi045.stdout:2/279: sync 2024-09-18T12:52:07.600 INFO:tasks.workunit.client.0.smithi045.stdout:0/243: sync 2024-09-18T12:52:07.600 INFO:tasks.workunit.client.0.smithi045.stdout:5/313: sync 2024-09-18T12:52:07.600 INFO:tasks.workunit.client.0.smithi045.stdout:8/240: sync 2024-09-18T12:52:07.600 INFO:tasks.workunit.client.0.smithi045.stdout:1/263: creat d0/d2d/d4c/f51 x:0 0 0 2024-09-18T12:52:07.601 INFO:tasks.workunit.client.1.smithi161.stdout:5/503: dwrite d3/d44/f8c [0,4194304] 0 2024-09-18T12:52:07.602 INFO:tasks.workunit.client.0.smithi045.stdout:9/212: creat d0/d3/d6/d10/d2c/f49 x:0 0 0 2024-09-18T12:52:07.604 INFO:tasks.workunit.client.0.smithi045.stdout:5/314: mknod d6/d2a/c64 0 2024-09-18T12:52:07.605 INFO:tasks.workunit.client.1.smithi161.stdout:3/553: rename d1/d2e/d24/d1d/d89/db0/f8a to d1/d2e/d14/d78/fbc 0 2024-09-18T12:52:07.605 INFO:tasks.workunit.client.1.smithi161.stdout:6/571: dwrite d4/d39/d26/f40 [0,4194304] 0 2024-09-18T12:52:07.610 INFO:tasks.workunit.client.0.smithi045.stdout:5/315: dwrite d6/d2a/f60 [0,4194304] 0 2024-09-18T12:52:07.611 INFO:tasks.workunit.client.1.smithi161.stdout:1/444: write d1/da/d31/f53 [1749373,38033] 0 2024-09-18T12:52:07.612 INFO:tasks.workunit.client.0.smithi045.stdout:8/241: dread - d11/d14/f19 zero size 2024-09-18T12:52:07.613 INFO:tasks.workunit.client.0.smithi045.stdout:8/242: chown d11/f16 2273298 1 2024-09-18T12:52:07.618 INFO:tasks.workunit.client.0.smithi045.stdout:2/280: truncate d5/d46/f52 1948575 0 2024-09-18T12:52:07.619 INFO:tasks.workunit.client.0.smithi045.stdout:2/281: truncate d5/d3a/f4c 1567866 0 2024-09-18T12:52:07.621 INFO:tasks.workunit.client.0.smithi045.stdout:9/213: rename d0/d3/d6/f3d to d0/d3/d6/d10/d26/f4a 0 2024-09-18T12:52:07.622 INFO:tasks.workunit.client.1.smithi161.stdout:4/580: rename d5/d27/d3a to d5/d14/d67/dc7 0 2024-09-18T12:52:07.624 INFO:tasks.workunit.client.1.smithi161.stdout:6/572: mknod d4/d39/d48/cb9 0 2024-09-18T12:52:07.627 INFO:tasks.workunit.client.0.smithi045.stdout:9/214: dwrite d0/fc [0,4194304] 0 2024-09-18T12:52:07.627 INFO:tasks.workunit.client.1.smithi161.stdout:3/554: write d1/d2e/d14/f56 [1810580,62995] 0 2024-09-18T12:52:07.629 INFO:tasks.workunit.client.1.smithi161.stdout:4/581: dwrite d5/d14/d5f/da1/fc0 [0,4194304] 0 2024-09-18T12:52:07.630 INFO:tasks.workunit.client.1.smithi161.stdout:4/582: readlink d5/d14/l6b 0 2024-09-18T12:52:07.631 INFO:tasks.workunit.client.1.smithi161.stdout:2/580: getdents d0/d1/d4c 0 2024-09-18T12:52:07.632 INFO:tasks.workunit.client.1.smithi161.stdout:4/583: fdatasync d5/d14/d67/dc7/d4c/f64 0 2024-09-18T12:52:07.633 INFO:tasks.workunit.client.0.smithi045.stdout:0/244: mkdir d6/d7/d21/d45 0 2024-09-18T12:52:07.634 INFO:tasks.workunit.client.0.smithi045.stdout:5/316: write d6/db/f2c [4472842,5977] 0 2024-09-18T12:52:07.634 INFO:tasks.workunit.client.1.smithi161.stdout:5/504: truncate d3/d14/f1b 82657 0 2024-09-18T12:52:07.635 INFO:tasks.workunit.client.1.smithi161.stdout:8/570: sync 2024-09-18T12:52:07.636 INFO:tasks.workunit.client.1.smithi161.stdout:2/581: truncate d0/d1/d4c/d67/fc8 194650 0 2024-09-18T12:52:07.638 INFO:tasks.workunit.client.0.smithi045.stdout:2/282: chown d5/d3a/c44 9 1 2024-09-18T12:52:07.640 INFO:tasks.workunit.client.0.smithi045.stdout:1/264: dread d0/d2d/d2b/f3f [0,4194304] 0 2024-09-18T12:52:07.641 INFO:tasks.workunit.client.0.smithi045.stdout:4/217: link l1 db/d1b/l4a 0 2024-09-18T12:52:07.645 INFO:tasks.workunit.client.0.smithi045.stdout:8/243: symlink d11/d14/l3f 0 2024-09-18T12:52:07.645 INFO:tasks.workunit.client.1.smithi161.stdout:4/584: readlink d5/d14/d67/dc7/lb5 0 2024-09-18T12:52:07.646 INFO:tasks.workunit.client.1.smithi161.stdout:3/555: dwrite d1/d2e/d14/f56 [0,4194304] 0 2024-09-18T12:52:07.648 INFO:tasks.workunit.client.1.smithi161.stdout:6/573: dread d4/d1a/d1c/d3e/d83/f8d [0,4194304] 0 2024-09-18T12:52:07.651 INFO:tasks.workunit.client.1.smithi161.stdout:2/582: dread d0/d1/d4c/f55 [0,4194304] 0 2024-09-18T12:52:07.651 INFO:tasks.workunit.client.0.smithi045.stdout:2/283: creat d5/d2c/d4d/d33/f69 x:0 0 0 2024-09-18T12:52:07.653 INFO:tasks.workunit.client.1.smithi161.stdout:2/583: read d0/d4/d52/fb2 [362528,108532] 0 2024-09-18T12:52:07.654 INFO:tasks.workunit.client.1.smithi161.stdout:3/556: dread d1/d2e/d14/d90/f95 [0,4194304] 0 2024-09-18T12:52:07.654 INFO:tasks.workunit.client.1.smithi161.stdout:1/445: write d1/d26/f9 [4039988,81407] 0 2024-09-18T12:52:07.658 INFO:tasks.workunit.client.1.smithi161.stdout:4/585: symlink d5/d32/d39/lc8 0 2024-09-18T12:52:07.658 INFO:tasks.workunit.client.1.smithi161.stdout:2/584: truncate d0/d5/d43/d35/f44 288278 0 2024-09-18T12:52:07.658 INFO:tasks.workunit.client.1.smithi161.stdout:4/586: chown d5/da9/db9 0 1 2024-09-18T12:52:07.658 INFO:tasks.workunit.client.0.smithi045.stdout:1/265: fsync d0/fa 0 2024-09-18T12:52:07.659 INFO:tasks.workunit.client.1.smithi161.stdout:4/587: fsync d5/d14/d67/dc7/d47/fa7 0 2024-09-18T12:52:07.659 INFO:tasks.workunit.client.0.smithi045.stdout:1/266: fsync d0/d2e/f28 0 2024-09-18T12:52:07.659 INFO:tasks.workunit.client.0.smithi045.stdout:4/218: mknod db/d10/d2f/c4b 0 2024-09-18T12:52:07.660 INFO:tasks.workunit.client.1.smithi161.stdout:5/505: truncate d3/d8/f77 1753975 0 2024-09-18T12:52:07.661 INFO:tasks.workunit.client.1.smithi161.stdout:5/506: write d3/d3b/d54/f69 [175764,91001] 0 2024-09-18T12:52:07.661 INFO:tasks.workunit.client.0.smithi045.stdout:1/267: write d0/d2e/f22 [3714996,109662] 0 2024-09-18T12:52:07.662 INFO:tasks.workunit.client.1.smithi161.stdout:5/507: dread - d3/d14/f84 zero size 2024-09-18T12:52:07.663 INFO:tasks.workunit.client.1.smithi161.stdout:5/508: write d3/d9/f12 [3706052,19109] 0 2024-09-18T12:52:07.665 INFO:tasks.workunit.client.0.smithi045.stdout:5/317: creat d6/d2a/d61/f65 x:0 0 0 2024-09-18T12:52:07.665 INFO:tasks.workunit.client.0.smithi045.stdout:3/221: link d0/d7/cf d0/d1e/c50 0 2024-09-18T12:52:07.666 INFO:tasks.workunit.client.0.smithi045.stdout:9/215: link d0/d3/d6/d10/d26/d2e/l46 d0/d3/d6/l4b 0 2024-09-18T12:52:07.669 INFO:tasks.workunit.client.0.smithi045.stdout:0/245: rmdir d6/d7/d21/d45 0 2024-09-18T12:52:07.670 INFO:tasks.workunit.client.1.smithi161.stdout:4/588: fsync d5/f2c 0 2024-09-18T12:52:07.671 INFO:tasks.workunit.client.0.smithi045.stdout:8/244: symlink d11/d14/d2c/l40 0 2024-09-18T12:52:07.672 INFO:tasks.workunit.client.1.smithi161.stdout:4/589: write d5/d14/d67/fad [477187,59965] 0 2024-09-18T12:52:07.672 INFO:tasks.workunit.client.0.smithi045.stdout:0/246: read d6/d7/d21/d23/f28 [346256,23544] 0 2024-09-18T12:52:07.672 INFO:tasks.workunit.client.0.smithi045.stdout:8/245: dread - d11/d20/f3c zero size 2024-09-18T12:52:07.673 INFO:tasks.workunit.client.1.smithi161.stdout:4/590: write d5/d27/d44/d61/d6c/d8f/fa3 [286413,83536] 0 2024-09-18T12:52:07.673 INFO:tasks.workunit.client.0.smithi045.stdout:1/268: rename d0/f16 to d0/d2d/d2b/f52 0 2024-09-18T12:52:07.676 INFO:tasks.workunit.client.0.smithi045.stdout:5/318: mkdir d6/db/d19/d31/d66 0 2024-09-18T12:52:07.678 INFO:tasks.workunit.client.0.smithi045.stdout:3/222: write d0/d1e/d2c/d3a/f47 [896913,43181] 0 2024-09-18T12:52:07.678 INFO:tasks.workunit.client.1.smithi161.stdout:8/571: dwrite d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 [0,4194304] 0 2024-09-18T12:52:07.679 INFO:tasks.workunit.client.0.smithi045.stdout:0/247: dwrite d6/d35/f3e [0,4194304] 0 2024-09-18T12:52:07.680 INFO:tasks.workunit.client.1.smithi161.stdout:1/446: link d1/da/d1f/d45/f83 d1/da/d1f/d45/d73/f92 0 2024-09-18T12:52:07.681 INFO:tasks.workunit.client.1.smithi161.stdout:1/447: stat d1/da/d1f/d45/l6f 0 2024-09-18T12:52:07.681 INFO:tasks.workunit.client.1.smithi161.stdout:1/448: chown d1/d26/f9 651864 1 2024-09-18T12:52:07.683 INFO:tasks.workunit.client.1.smithi161.stdout:2/585: mknod d0/d1/d4c/d67/db9/cc9 0 2024-09-18T12:52:07.685 INFO:tasks.workunit.client.1.smithi161.stdout:9/476: sync 2024-09-18T12:52:07.685 INFO:tasks.workunit.client.1.smithi161.stdout:7/510: sync 2024-09-18T12:52:07.685 INFO:tasks.workunit.client.1.smithi161.stdout:0/563: sync 2024-09-18T12:52:07.685 INFO:tasks.workunit.client.1.smithi161.stdout:9/477: dread - d0/d47/d48/f75 zero size 2024-09-18T12:52:07.685 INFO:tasks.workunit.client.1.smithi161.stdout:0/564: chown df/d30/d71/d96 5 1 2024-09-18T12:52:07.686 INFO:tasks.workunit.client.1.smithi161.stdout:9/478: chown d0/d47/d48/d88/c8b 127236141 1 2024-09-18T12:52:07.689 INFO:tasks.workunit.client.0.smithi045.stdout:8/246: mkdir d11/d20/d39/d41 0 2024-09-18T12:52:07.691 INFO:tasks.workunit.client.1.smithi161.stdout:4/591: mkdir d5/d27/d44/dc9 0 2024-09-18T12:52:07.693 INFO:tasks.workunit.client.0.smithi045.stdout:1/269: creat d0/d2d/f53 x:0 0 0 2024-09-18T12:52:07.693 INFO:tasks.workunit.client.1.smithi161.stdout:0/565: dwrite df/d30/d71/faa [0,4194304] 0 2024-09-18T12:52:07.694 INFO:tasks.workunit.client.0.smithi045.stdout:4/219: dread db/d10/d13/f2b [0,4194304] 0 2024-09-18T12:52:07.697 INFO:tasks.workunit.client.1.smithi161.stdout:6/574: dwrite d4/d39/d48/f8b [0,4194304] 0 2024-09-18T12:52:07.698 INFO:tasks.workunit.client.1.smithi161.stdout:6/575: write d4/d1a/d1c/f2c [795362,23154] 0 2024-09-18T12:52:07.699 INFO:tasks.workunit.client.1.smithi161.stdout:1/449: symlink d1/da/d1f/d45/d73/l93 0 2024-09-18T12:52:07.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/576: fsync d4/d61/fa5 0 2024-09-18T12:52:07.700 INFO:tasks.workunit.client.1.smithi161.stdout:2/586: dread - d0/d1/df/d8a/fbb zero size 2024-09-18T12:52:07.702 INFO:tasks.workunit.client.1.smithi161.stdout:6/577: write d4/d1a/d1c/d7c/f9f [2638414,3427] 0 2024-09-18T12:52:07.702 INFO:tasks.workunit.client.0.smithi045.stdout:8/247: mknod d11/d14/d2c/c42 0 2024-09-18T12:52:07.703 INFO:tasks.workunit.client.1.smithi161.stdout:7/511: mkdir d3/d8/d15/d38/d77/d89/d8f 0 2024-09-18T12:52:07.704 INFO:tasks.workunit.client.0.smithi045.stdout:8/248: write d11/f12 [4031555,79997] 0 2024-09-18T12:52:07.704 INFO:tasks.workunit.client.0.smithi045.stdout:5/319: dread - d6/d28/d2b/d51/f52 zero size 2024-09-18T12:52:07.705 INFO:tasks.workunit.client.1.smithi161.stdout:5/509: creat d3/d9/d4b/d8e/fa1 x:0 0 0 2024-09-18T12:52:07.708 INFO:tasks.workunit.client.0.smithi045.stdout:0/248: creat d6/d7/d21/d23/d3c/f46 x:0 0 0 2024-09-18T12:52:07.709 INFO:tasks.workunit.client.1.smithi161.stdout:2/587: dwrite d0/d4/f62 [0,4194304] 0 2024-09-18T12:52:07.712 INFO:tasks.workunit.client.0.smithi045.stdout:4/220: dread db/d20/f44 [0,4194304] 0 2024-09-18T12:52:07.713 INFO:tasks.workunit.client.1.smithi161.stdout:3/557: getdents d1/d2e/d14/d65/d76/d88 0 2024-09-18T12:52:07.713 INFO:tasks.workunit.client.1.smithi161.stdout:4/592: mkdir d5/d14/d67/dc7/d47/d49/dca 0 2024-09-18T12:52:07.713 INFO:tasks.workunit.client.0.smithi045.stdout:0/249: chown d6/d35/f3f 5 1 2024-09-18T12:52:07.713 INFO:tasks.workunit.client.0.smithi045.stdout:4/221: chown db/d10/c29 10750 1 2024-09-18T12:52:07.714 INFO:tasks.workunit.client.0.smithi045.stdout:0/250: write d6/d7/f14 [2773147,95187] 0 2024-09-18T12:52:07.716 INFO:tasks.workunit.client.0.smithi045.stdout:1/270: symlink d0/d2d/d2b/d30/d40/l54 0 2024-09-18T12:52:07.718 INFO:tasks.workunit.client.1.smithi161.stdout:0/566: mkdir df/d30/d4d/d92/d95/dc5/dca 0 2024-09-18T12:52:07.719 INFO:tasks.workunit.client.1.smithi161.stdout:0/567: stat df/d30/d4d/d92/d95/dc5/cab 0 2024-09-18T12:52:07.719 INFO:tasks.workunit.client.0.smithi045.stdout:3/223: dread d0/d22/f2e [0,4194304] 0 2024-09-18T12:52:07.719 INFO:tasks.workunit.client.0.smithi045.stdout:5/320: mknod d6/db/d19/d31/d66/c67 0 2024-09-18T12:52:07.720 INFO:tasks.workunit.client.1.smithi161.stdout:8/572: mkdir d0/d3/dbf 0 2024-09-18T12:52:07.721 INFO:tasks.workunit.client.0.smithi045.stdout:4/222: creat db/d1b/d43/f4c x:0 0 0 2024-09-18T12:52:07.722 INFO:tasks.workunit.client.0.smithi045.stdout:4/223: chown db/d10 2636710 1 2024-09-18T12:52:07.723 INFO:tasks.workunit.client.0.smithi045.stdout:0/251: fdatasync d6/d7/f14 0 2024-09-18T12:52:07.724 INFO:tasks.workunit.client.0.smithi045.stdout:0/252: chown d6/d35/c3a 869577 1 2024-09-18T12:52:07.725 INFO:tasks.workunit.client.1.smithi161.stdout:0/568: dwrite df/d30/d71/d96/fb8 [0,4194304] 0 2024-09-18T12:52:07.726 INFO:tasks.workunit.client.0.smithi045.stdout:8/249: link fa d11/d14/d2c/f43 0 2024-09-18T12:52:07.727 INFO:tasks.workunit.client.0.smithi045.stdout:1/271: fdatasync d0/d2d/d2b/f3f 0 2024-09-18T12:52:07.728 INFO:tasks.workunit.client.0.smithi045.stdout:1/272: write d0/d2d/f53 [262607,21111] 0 2024-09-18T12:52:07.729 INFO:tasks.workunit.client.1.smithi161.stdout:1/450: creat d1/da/d1f/d45/d89/f94 x:0 0 0 2024-09-18T12:52:07.734 INFO:tasks.workunit.client.0.smithi045.stdout:5/321: unlink d6/d3e/c41 0 2024-09-18T12:52:07.735 INFO:tasks.workunit.client.1.smithi161.stdout:6/578: creat d4/d61/d69/d87/fba x:0 0 0 2024-09-18T12:52:07.736 INFO:tasks.workunit.client.1.smithi161.stdout:6/579: write d4/d39/f74 [924465,51512] 0 2024-09-18T12:52:07.738 INFO:tasks.workunit.client.1.smithi161.stdout:7/512: creat d3/d8/d15/d38/d77/f90 x:0 0 0 2024-09-18T12:52:07.740 INFO:tasks.workunit.client.0.smithi045.stdout:0/253: creat d6/d7/d21/d23/d3c/f47 x:0 0 0 2024-09-18T12:52:07.741 INFO:tasks.workunit.client.0.smithi045.stdout:5/322: dwrite d6/d2a/d61/f65 [0,4194304] 0 2024-09-18T12:52:07.743 INFO:tasks.workunit.client.0.smithi045.stdout:5/323: write d6/d3e/f3a [3789961,37413] 0 2024-09-18T12:52:07.743 INFO:tasks.workunit.client.0.smithi045.stdout:0/254: truncate d6/d7/d21/d23/f25 782553 0 2024-09-18T12:52:07.744 INFO:tasks.workunit.client.0.smithi045.stdout:0/255: read - d6/d35/f3f zero size 2024-09-18T12:52:07.750 INFO:tasks.workunit.client.1.smithi161.stdout:2/588: fsync d0/d5/d53/f81 0 2024-09-18T12:52:07.755 INFO:tasks.workunit.client.1.smithi161.stdout:4/593: mknod d5/d14/d6d/ccb 0 2024-09-18T12:52:07.755 INFO:tasks.workunit.client.1.smithi161.stdout:4/594: chown d5/d14/d67/dc7/d60 3033079 1 2024-09-18T12:52:07.757 INFO:tasks.workunit.client.1.smithi161.stdout:7/513: dread d3/d8/d15/d1a/d24/f51 [0,4194304] 0 2024-09-18T12:52:07.757 INFO:tasks.workunit.client.0.smithi045.stdout:5/324: truncate d6/d2a/f25 541058 0 2024-09-18T12:52:07.759 INFO:tasks.workunit.client.0.smithi045.stdout:3/224: write d0/fe [1898013,76385] 0 2024-09-18T12:52:07.762 INFO:tasks.workunit.client.1.smithi161.stdout:7/514: dwrite d3/d8/f80 [0,4194304] 0 2024-09-18T12:52:07.762 INFO:tasks.workunit.client.0.smithi045.stdout:0/256: chown d6/l31 175 1 2024-09-18T12:52:07.763 INFO:tasks.workunit.client.1.smithi161.stdout:7/515: write d3/f6d [1374302,34601] 0 2024-09-18T12:52:07.763 INFO:tasks.workunit.client.0.smithi045.stdout:0/257: stat d6/c26 0 2024-09-18T12:52:07.763 INFO:tasks.workunit.client.1.smithi161.stdout:1/451: mknod d1/da/d31/c95 0 2024-09-18T12:52:07.764 INFO:tasks.workunit.client.1.smithi161.stdout:7/516: write d3/d8/d15/d38/f5f [209113,36615] 0 2024-09-18T12:52:07.766 INFO:tasks.workunit.client.0.smithi045.stdout:4/224: creat db/f4d x:0 0 0 2024-09-18T12:52:07.769 INFO:tasks.workunit.client.1.smithi161.stdout:9/479: link d0/d16/d25/l3e d0/d47/d48/d88/l9f 0 2024-09-18T12:52:07.770 INFO:tasks.workunit.client.0.smithi045.stdout:4/225: dread f9 [0,4194304] 0 2024-09-18T12:52:07.772 INFO:tasks.workunit.client.1.smithi161.stdout:5/510: rename d3/d8/l5c to d3/d9/d4b/d8e/d46/la2 0 2024-09-18T12:52:07.775 INFO:tasks.workunit.client.0.smithi045.stdout:5/325: dwrite d6/db/fe [0,4194304] 0 2024-09-18T12:52:07.777 INFO:tasks.workunit.client.1.smithi161.stdout:3/558: mknod d1/d2e/d24/d1d/cbd 0 2024-09-18T12:52:07.778 INFO:tasks.workunit.client.0.smithi045.stdout:3/225: symlink d0/d22/l51 0 2024-09-18T12:52:07.779 INFO:tasks.workunit.client.0.smithi045.stdout:8/250: getdents d11/d23 0 2024-09-18T12:52:07.780 INFO:tasks.workunit.client.0.smithi045.stdout:8/251: chown d11/d20/d39/d41 7 1 2024-09-18T12:52:07.780 INFO:tasks.workunit.client.0.smithi045.stdout:4/226: unlink db/ld 0 2024-09-18T12:52:07.781 INFO:tasks.workunit.client.0.smithi045.stdout:1/273: getdents d0/d12/d32/d37 0 2024-09-18T12:52:07.784 INFO:tasks.workunit.client.0.smithi045.stdout:5/326: creat d6/db/d19/f68 x:0 0 0 2024-09-18T12:52:07.786 INFO:tasks.workunit.client.0.smithi045.stdout:0/258: mkdir d6/d48 0 2024-09-18T12:52:07.788 INFO:tasks.workunit.client.0.smithi045.stdout:8/252: dwrite d11/d20/d39/f3e [0,4194304] 0 2024-09-18T12:52:07.790 INFO:tasks.workunit.client.0.smithi045.stdout:3/226: mknod d0/d29/c52 0 2024-09-18T12:52:07.795 INFO:tasks.workunit.client.1.smithi161.stdout:4/595: rename d5/d27/d44/fc3 to d5/d14/d67/dc7/d47/dbc/fcc 0 2024-09-18T12:52:07.796 INFO:tasks.workunit.client.0.smithi045.stdout:1/274: symlink d0/d12/l55 0 2024-09-18T12:52:07.798 INFO:tasks.workunit.client.1.smithi161.stdout:5/511: creat d3/d9/d4b/d8e/d46/fa3 x:0 0 0 2024-09-18T12:52:07.801 INFO:tasks.workunit.client.0.smithi045.stdout:5/327: creat d6/db/d19/d31/d66/f69 x:0 0 0 2024-09-18T12:52:07.803 INFO:tasks.workunit.client.0.smithi045.stdout:0/259: unlink d6/d7/d32/l34 0 2024-09-18T12:52:07.805 INFO:tasks.workunit.client.0.smithi045.stdout:0/260: dread - d6/d7/d21/d23/d3c/f46 zero size 2024-09-18T12:52:07.808 INFO:tasks.workunit.client.0.smithi045.stdout:0/261: dread d6/f2d [0,4194304] 0 2024-09-18T12:52:07.810 INFO:tasks.workunit.client.1.smithi161.stdout:8/573: rmdir d0/d3/dbf 0 2024-09-18T12:52:07.810 INFO:tasks.workunit.client.0.smithi045.stdout:0/262: chown d6/d7/d21/d23/f28 0 1 2024-09-18T12:52:07.810 INFO:tasks.workunit.client.0.smithi045.stdout:1/275: dread d0/d12/f13 [0,4194304] 0 2024-09-18T12:52:07.811 INFO:tasks.workunit.client.1.smithi161.stdout:8/574: truncate d0/d3/d10/f22 4681832 0 2024-09-18T12:52:07.811 INFO:tasks.workunit.client.0.smithi045.stdout:3/227: mkdir d0/d29/d53 0 2024-09-18T12:52:07.811 INFO:tasks.workunit.client.1.smithi161.stdout:0/569: link df/d29/c5d df/d29/d46/d90/ccb 0 2024-09-18T12:52:07.812 INFO:tasks.workunit.client.1.smithi161.stdout:0/570: chown df/d30/d4d/d92/d95/dc5/d89/lc3 54689 1 2024-09-18T12:52:07.813 INFO:tasks.workunit.client.0.smithi045.stdout:4/227: getdents db/de/d1e/d49 0 2024-09-18T12:52:07.813 INFO:tasks.workunit.client.1.smithi161.stdout:6/580: link d4/d39/d26/d31/l7e d4/d1a/d1c/d3e/d83/lbb 0 2024-09-18T12:52:07.814 INFO:tasks.workunit.client.1.smithi161.stdout:6/581: chown d4/d39/d48/f8b 1 1 2024-09-18T12:52:07.816 INFO:tasks.workunit.client.1.smithi161.stdout:9/480: mkdir d0/d93/da0 0 2024-09-18T12:52:07.817 INFO:tasks.workunit.client.1.smithi161.stdout:3/559: write d1/d2e/f5b [404788,57920] 0 2024-09-18T12:52:07.817 INFO:tasks.workunit.client.0.smithi045.stdout:5/328: mkdir d6/db/d6a 0 2024-09-18T12:52:07.819 INFO:tasks.workunit.client.0.smithi045.stdout:8/253: mknod d11/d14/c44 0 2024-09-18T12:52:07.820 INFO:tasks.workunit.client.1.smithi161.stdout:7/517: rename d3/d8/d15/d38/f21 to d3/d8/f91 0 2024-09-18T12:52:07.821 INFO:tasks.workunit.client.1.smithi161.stdout:4/596: rmdir d5/d14 39 2024-09-18T12:52:07.822 INFO:tasks.workunit.client.0.smithi045.stdout:0/263: symlink d6/d7/d21/d23/d3c/l49 0 2024-09-18T12:52:07.823 INFO:tasks.workunit.client.1.smithi161.stdout:5/512: mkdir d3/d9/d4b/d8e/d46/da4 0 2024-09-18T12:52:07.824 INFO:tasks.workunit.client.0.smithi045.stdout:3/228: mknod d0/d1e/d2c/d3f/c54 0 2024-09-18T12:52:07.825 INFO:tasks.workunit.client.1.smithi161.stdout:2/589: rmdir d0/d1/d3b/d3d/d4f/d9b/dc6 0 2024-09-18T12:52:07.827 INFO:tasks.workunit.client.0.smithi045.stdout:4/228: write f9 [4707366,52087] 0 2024-09-18T12:52:07.827 INFO:tasks.workunit.client.0.smithi045.stdout:4/229: fdatasync db/f21 0 2024-09-18T12:52:07.828 INFO:tasks.workunit.client.1.smithi161.stdout:8/575: dread - d0/d3/d10/d21/d4a/d52/d66/f71 zero size 2024-09-18T12:52:07.828 INFO:tasks.workunit.client.0.smithi045.stdout:4/230: read db/f30 [528222,954] 0 2024-09-18T12:52:07.829 INFO:tasks.workunit.client.0.smithi045.stdout:5/329: creat d6/db/f6b x:0 0 0 2024-09-18T12:52:07.830 INFO:tasks.workunit.client.0.smithi045.stdout:4/231: dread - db/de/d1e/f42 zero size 2024-09-18T12:52:07.830 INFO:tasks.workunit.client.0.smithi045.stdout:5/330: chown d6/d2a/l5b 1 1 2024-09-18T12:52:07.831 INFO:tasks.workunit.client.0.smithi045.stdout:1/276: write d0/fe [138954,51752] 0 2024-09-18T12:52:07.833 INFO:tasks.workunit.client.1.smithi161.stdout:8/576: dread d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 [0,4194304] 0 2024-09-18T12:52:07.834 INFO:tasks.workunit.client.1.smithi161.stdout:9/481: rename d0/d16/d25/d28/d45/f79 to d0/d20/d49/fa1 0 2024-09-18T12:52:07.837 INFO:tasks.workunit.client.1.smithi161.stdout:2/590: creat d0/d5/d43/d35/d80/fca x:0 0 0 2024-09-18T12:52:07.838 INFO:tasks.workunit.client.0.smithi045.stdout:1/277: dwrite d0/f23 [0,4194304] 0 2024-09-18T12:52:07.839 INFO:tasks.workunit.client.0.smithi045.stdout:1/278: read - d0/d2e/f42 zero size 2024-09-18T12:52:07.840 INFO:tasks.workunit.client.1.smithi161.stdout:2/591: read d0/f13 [1787128,93773] 0 2024-09-18T12:52:07.841 INFO:tasks.workunit.client.1.smithi161.stdout:9/482: dwrite d0/d16/d25/d28/f7b [0,4194304] 0 2024-09-18T12:52:07.841 INFO:tasks.workunit.client.0.smithi045.stdout:5/331: mkdir d6/d28/d2b/d51/d6c 0 2024-09-18T12:52:07.842 INFO:tasks.workunit.client.0.smithi045.stdout:8/254: mkdir d11/d14/d45 0 2024-09-18T12:52:07.846 INFO:tasks.workunit.client.0.smithi045.stdout:3/229: getdents d0/d29/d53 0 2024-09-18T12:52:07.848 INFO:tasks.workunit.client.1.smithi161.stdout:4/597: symlink d5/d32/d39/dbf/lcd 0 2024-09-18T12:52:07.854 INFO:tasks.workunit.client.1.smithi161.stdout:8/577: dread d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f84 [0,4194304] 0 2024-09-18T12:52:07.855 INFO:tasks.workunit.client.0.smithi045.stdout:4/232: creat db/de/d1e/d49/f4e x:0 0 0 2024-09-18T12:52:07.855 INFO:tasks.workunit.client.1.smithi161.stdout:7/518: dwrite d3/d8/d15/d1a/d4a/d64/f7b [0,4194304] 0 2024-09-18T12:52:07.860 INFO:tasks.workunit.client.1.smithi161.stdout:9/483: dread d0/f3 [0,4194304] 0 2024-09-18T12:52:07.861 INFO:tasks.workunit.client.0.smithi045.stdout:8/255: rename d11/d14/d2c to d11/d20/d46 0 2024-09-18T12:52:07.862 INFO:tasks.workunit.client.1.smithi161.stdout:9/484: write d0/db/f55 [747722,64606] 0 2024-09-18T12:52:07.864 INFO:tasks.workunit.client.1.smithi161.stdout:5/513: write d3/d14/f1b [90748,66332] 0 2024-09-18T12:52:07.865 INFO:tasks.workunit.client.1.smithi161.stdout:5/514: chown d3/d9/f6e 319333 1 2024-09-18T12:52:07.868 INFO:tasks.workunit.client.0.smithi045.stdout:5/332: mkdir d6/db/d6a/d6d 0 2024-09-18T12:52:07.869 INFO:tasks.workunit.client.0.smithi045.stdout:0/264: getdents d6/d7/d21 0 2024-09-18T12:52:07.870 INFO:tasks.workunit.client.0.smithi045.stdout:3/230: mknod d0/d1e/c55 0 2024-09-18T12:52:07.871 INFO:tasks.workunit.client.0.smithi045.stdout:3/231: chown d0/f1a 3056 1 2024-09-18T12:52:07.871 INFO:tasks.workunit.client.0.smithi045.stdout:4/233: mknod db/de/d1a/d2e/c4f 0 2024-09-18T12:52:07.873 INFO:tasks.workunit.client.1.smithi161.stdout:0/571: link ce df/d30/d4d/d92/d95/dc5/dca/ccc 0 2024-09-18T12:52:07.878 INFO:tasks.workunit.client.0.smithi045.stdout:1/279: getdents d0/d2d/d2b/d30/d40 0 2024-09-18T12:52:07.878 INFO:tasks.workunit.client.0.smithi045.stdout:0/265: dread d6/d7/f14 [0,4194304] 0 2024-09-18T12:52:07.880 INFO:tasks.workunit.client.1.smithi161.stdout:3/560: getdents d1/d2e/d24 0 2024-09-18T12:52:07.883 INFO:tasks.workunit.client.0.smithi045.stdout:3/232: symlink d0/d1e/d2c/d3a/d45/l56 0 2024-09-18T12:52:07.885 INFO:tasks.workunit.client.0.smithi045.stdout:0/266: dwrite d6/d7/f42 [0,4194304] 0 2024-09-18T12:52:07.887 INFO:tasks.workunit.client.1.smithi161.stdout:1/452: sync 2024-09-18T12:52:07.888 INFO:tasks.workunit.client.1.smithi161.stdout:1/453: write d1/d26/d3a/f7b [732244,47732] 0 2024-09-18T12:52:07.889 INFO:tasks.workunit.client.0.smithi045.stdout:8/256: truncate d11/f12 3964541 0 2024-09-18T12:52:07.889 INFO:tasks.workunit.client.0.smithi045.stdout:8/257: stat f9 0 2024-09-18T12:52:07.890 INFO:tasks.workunit.client.1.smithi161.stdout:1/454: readlink d1/da/l34 0 2024-09-18T12:52:07.891 INFO:tasks.workunit.client.1.smithi161.stdout:5/515: write d3/f13 [4602117,102384] 0 2024-09-18T12:52:07.893 INFO:tasks.workunit.client.1.smithi161.stdout:0/572: unlink df/d29/fb3 0 2024-09-18T12:52:07.894 INFO:tasks.workunit.client.1.smithi161.stdout:2/592: dwrite d0/d1/d3b/d7e/f70 [0,4194304] 0 2024-09-18T12:52:07.896 INFO:tasks.workunit.client.0.smithi045.stdout:1/280: dwrite d0/fc [4194304,4194304] 0 2024-09-18T12:52:07.896 INFO:tasks.workunit.client.1.smithi161.stdout:2/593: write d0/d5/d43/d35/f3e [3070250,84802] 0 2024-09-18T12:52:07.897 INFO:tasks.workunit.client.1.smithi161.stdout:2/594: readlink d0/d4/d78/lbf 0 2024-09-18T12:52:07.898 INFO:tasks.workunit.client.1.smithi161.stdout:2/595: readlink d0/d1/d3b/d3d/d4f/l6f 0 2024-09-18T12:52:07.899 INFO:tasks.workunit.client.0.smithi045.stdout:3/233: mknod d0/d1e/d2c/d3a/c57 0 2024-09-18T12:52:07.902 INFO:tasks.workunit.client.0.smithi045.stdout:1/281: dread d0/d2d/d2b/f3f [0,4194304] 0 2024-09-18T12:52:07.903 INFO:tasks.workunit.client.1.smithi161.stdout:3/561: rename d1/d2e/d14/d2c/c41 to d1/d2e/d14/d90/cbe 0 2024-09-18T12:52:07.903 INFO:tasks.workunit.client.1.smithi161.stdout:0/573: rename df/d29/d46 to df/d29/d46/d90/d69/dcd 22 2024-09-18T12:52:07.904 INFO:tasks.workunit.client.0.smithi045.stdout:3/234: dread d0/d1e/d2c/d3a/f4a [0,4194304] 0 2024-09-18T12:52:07.905 INFO:tasks.workunit.client.0.smithi045.stdout:0/267: fsync d6/d7/ff 0 2024-09-18T12:52:07.906 INFO:tasks.workunit.client.1.smithi161.stdout:0/574: chown df/d30/f3f 50 1 2024-09-18T12:52:07.906 INFO:tasks.workunit.client.0.smithi045.stdout:3/235: chown d0/fe 209 1 2024-09-18T12:52:07.906 INFO:tasks.workunit.client.0.smithi045.stdout:4/234: truncate f9 3900460 0 2024-09-18T12:52:07.907 INFO:tasks.workunit.client.0.smithi045.stdout:5/333: link d6/d28/c37 d6/db/d19/d31/d66/c6e 0 2024-09-18T12:52:07.908 INFO:tasks.workunit.client.1.smithi161.stdout:4/598: link d5/d32/d39/dbf/lcd d5/d27/d44/d61/lce 0 2024-09-18T12:52:07.909 INFO:tasks.workunit.client.0.smithi045.stdout:8/258: symlink d11/l47 0 2024-09-18T12:52:07.910 INFO:tasks.workunit.client.1.smithi161.stdout:4/599: fdatasync d5/d32/d39/d4d/f96 0 2024-09-18T12:52:07.910 INFO:tasks.workunit.client.1.smithi161.stdout:1/455: rmdir d1/da 39 2024-09-18T12:52:07.912 INFO:tasks.workunit.client.1.smithi161.stdout:9/485: dwrite d0/d16/d25/d46/d53/f56 [0,4194304] 0 2024-09-18T12:52:07.915 INFO:tasks.workunit.client.1.smithi161.stdout:5/516: mknod d3/d14/ca5 0 2024-09-18T12:52:07.916 INFO:tasks.workunit.client.0.smithi045.stdout:3/236: rename d0/d1e/d2c/d3f/c54 to d0/d29/d53/c58 0 2024-09-18T12:52:07.920 INFO:tasks.workunit.client.0.smithi045.stdout:1/282: dwrite d0/f6 [0,4194304] 0 2024-09-18T12:52:07.920 INFO:tasks.workunit.client.0.smithi045.stdout:4/235: creat db/d10/d13/f50 x:0 0 0 2024-09-18T12:52:07.923 INFO:tasks.workunit.client.0.smithi045.stdout:4/236: truncate db/de/d1e/d49/f4e 403367 0 2024-09-18T12:52:07.924 INFO:tasks.workunit.client.1.smithi161.stdout:2/596: rename d0/d1/df to d0/d1/d4c/d67/db9/dcb 0 2024-09-18T12:52:07.924 INFO:tasks.workunit.client.0.smithi045.stdout:4/237: write db/d2c/d35/f3b [2523499,35995] 0 2024-09-18T12:52:07.925 INFO:tasks.workunit.client.1.smithi161.stdout:2/597: dread - d0/d5/d53/f4b zero size 2024-09-18T12:52:07.927 INFO:tasks.workunit.client.0.smithi045.stdout:4/238: truncate db/de/d1e/f42 457875 0 2024-09-18T12:52:07.927 INFO:tasks.workunit.client.1.smithi161.stdout:3/562: creat d1/d2e/d14/d90/fbf x:0 0 0 2024-09-18T12:52:07.928 INFO:tasks.workunit.client.0.smithi045.stdout:5/334: dread d6/d3e/f35 [0,4194304] 0 2024-09-18T12:52:07.929 INFO:tasks.workunit.client.0.smithi045.stdout:4/239: write db/d10/d13/f50 [187203,17411] 0 2024-09-18T12:52:07.929 INFO:tasks.workunit.client.1.smithi161.stdout:3/563: truncate d1/d2e/d14/d65/f8f 909182 0 2024-09-18T12:52:07.930 INFO:tasks.workunit.client.0.smithi045.stdout:4/240: stat db/d2c/d35/d40 0 2024-09-18T12:52:07.931 INFO:tasks.workunit.client.0.smithi045.stdout:0/268: mkdir d6/d48/d4a 0 2024-09-18T12:52:07.931 INFO:tasks.workunit.client.1.smithi161.stdout:8/578: getdents d0/d3/d10/d21/d4a/d52/d66/d5b/d6e 0 2024-09-18T12:52:07.932 INFO:tasks.workunit.client.0.smithi045.stdout:0/269: fsync d6/d7/d21/f24 0 2024-09-18T12:52:07.932 INFO:tasks.workunit.client.1.smithi161.stdout:4/600: mknod d5/d32/d39/db6/ccf 0 2024-09-18T12:52:07.934 INFO:tasks.workunit.client.0.smithi045.stdout:1/283: dread - d0/d12/f27 zero size 2024-09-18T12:52:07.935 INFO:tasks.workunit.client.1.smithi161.stdout:9/486: creat d0/d47/d48/d9a/fa2 x:0 0 0 2024-09-18T12:52:07.935 INFO:tasks.workunit.client.0.smithi045.stdout:1/284: truncate d0/f3c 783164 0 2024-09-18T12:52:07.936 INFO:tasks.workunit.client.1.smithi161.stdout:3/564: dread d1/d2e/d24/f47 [0,4194304] 0 2024-09-18T12:52:07.936 INFO:tasks.workunit.client.1.smithi161.stdout:5/517: mkdir d3/d3b/d7b/da6 0 2024-09-18T12:52:07.937 INFO:tasks.workunit.client.1.smithi161.stdout:3/565: chown d1/d2e/d14/d2c/fb7 157306335 1 2024-09-18T12:52:07.938 INFO:tasks.workunit.client.1.smithi161.stdout:8/579: dwrite d0/d3/d1e/f50 [0,4194304] 0 2024-09-18T12:52:07.939 INFO:tasks.workunit.client.1.smithi161.stdout:2/598: rmdir d0/d1/d4c/d67/db9/dcb/d8a 39 2024-09-18T12:52:07.940 INFO:tasks.workunit.client.1.smithi161.stdout:8/580: fsync d0/d3/d10/d21/d4a/f4f 0 2024-09-18T12:52:07.942 INFO:tasks.workunit.client.1.smithi161.stdout:8/581: write d0/d3/d10/d21/d4a/d52/f95 [1043325,66107] 0 2024-09-18T12:52:07.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/582: sync 2024-09-18T12:52:07.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/583: dread - d4/fa9 zero size 2024-09-18T12:52:07.944 INFO:tasks.workunit.client.1.smithi161.stdout:0/575: symlink df/lce 0 2024-09-18T12:52:07.945 INFO:tasks.workunit.client.1.smithi161.stdout:0/576: write df/d29/d46/d51/fa8 [475891,95010] 0 2024-09-18T12:52:07.947 INFO:tasks.workunit.client.0.smithi045.stdout:4/241: fdatasync db/f30 0 2024-09-18T12:52:07.949 INFO:tasks.workunit.client.1.smithi161.stdout:4/601: write d5/d32/f42 [4095760,116569] 0 2024-09-18T12:52:07.950 INFO:tasks.workunit.client.1.smithi161.stdout:4/602: readlink d5/d27/l31 0 2024-09-18T12:52:07.951 INFO:tasks.workunit.client.1.smithi161.stdout:0/577: dwrite df/d29/f62 [0,4194304] 0 2024-09-18T12:52:07.954 INFO:tasks.workunit.client.0.smithi045.stdout:1/285: mknod d0/d12/d32/c56 0 2024-09-18T12:52:07.954 INFO:tasks.workunit.client.0.smithi045.stdout:3/237: dread d0/f3e [0,4194304] 0 2024-09-18T12:52:07.955 INFO:tasks.workunit.client.0.smithi045.stdout:1/286: fdatasync d0/f2 0 2024-09-18T12:52:07.955 INFO:tasks.workunit.client.1.smithi161.stdout:5/518: symlink d3/d44/d6f/d86/la7 0 2024-09-18T12:52:07.956 INFO:tasks.workunit.client.0.smithi045.stdout:1/287: write d0/d2d/d2b/d30/f4f [391640,79840] 0 2024-09-18T12:52:07.957 INFO:tasks.workunit.client.1.smithi161.stdout:3/566: mknod d1/d2e/d3d/d49/cc0 0 2024-09-18T12:52:07.957 INFO:tasks.workunit.client.0.smithi045.stdout:8/259: write d11/d14/f1b [4582373,109582] 0 2024-09-18T12:52:07.960 INFO:tasks.workunit.client.1.smithi161.stdout:1/456: write d1/da/f18 [2129914,58928] 0 2024-09-18T12:52:07.961 INFO:tasks.workunit.client.0.smithi045.stdout:4/242: symlink db/de/d1a/d2e/l51 0 2024-09-18T12:52:07.963 INFO:tasks.workunit.client.0.smithi045.stdout:0/270: creat d6/d48/d4a/f4b x:0 0 0 2024-09-18T12:52:07.963 INFO:tasks.workunit.client.1.smithi161.stdout:2/599: read - d0/d1/d4c/d67/db9/dcb/d8a/fbb zero size 2024-09-18T12:52:07.964 INFO:tasks.workunit.client.1.smithi161.stdout:2/600: write d0/f9a [422893,72155] 0 2024-09-18T12:52:07.967 INFO:tasks.workunit.client.0.smithi045.stdout:1/288: write d0/d12/f15 [1637370,43490] 0 2024-09-18T12:52:07.970 INFO:tasks.workunit.client.0.smithi045.stdout:1/289: chown d0/d2d/d2b/d30/d40 118 1 2024-09-18T12:52:07.970 INFO:tasks.workunit.client.0.smithi045.stdout:8/260: rename d11/l15 to d11/d14/d45/l48 0 2024-09-18T12:52:07.971 INFO:tasks.workunit.client.1.smithi161.stdout:4/603: unlink d5/d32/d39/f8e 0 2024-09-18T12:52:07.972 INFO:tasks.workunit.client.0.smithi045.stdout:8/261: readlink d11/d14/l1d 0 2024-09-18T12:52:07.973 INFO:tasks.workunit.client.0.smithi045.stdout:3/238: dwrite d0/d7/f23 [4194304,4194304] 0 2024-09-18T12:52:07.973 INFO:tasks.workunit.client.0.smithi045.stdout:4/243: read db/d10/d2f/f36 [54823,84556] 0 2024-09-18T12:52:07.975 INFO:tasks.workunit.client.0.smithi045.stdout:0/271: creat d6/d48/d4a/f4c x:0 0 0 2024-09-18T12:52:07.976 INFO:tasks.workunit.client.0.smithi045.stdout:6/228: sync 2024-09-18T12:52:07.977 INFO:tasks.workunit.client.0.smithi045.stdout:7/202: sync 2024-09-18T12:52:07.977 INFO:tasks.workunit.client.0.smithi045.stdout:5/335: getdents d6/db/d19 0 2024-09-18T12:52:07.977 INFO:tasks.workunit.client.0.smithi045.stdout:7/203: chown d13 158 1 2024-09-18T12:52:07.981 INFO:tasks.workunit.client.1.smithi161.stdout:3/567: creat d1/d2e/d24/d84/fc1 x:0 0 0 2024-09-18T12:52:07.981 INFO:tasks.workunit.client.0.smithi045.stdout:1/290: rmdir d0/d2d 39 2024-09-18T12:52:07.983 INFO:tasks.workunit.client.0.smithi045.stdout:8/262: symlink d11/l49 0 2024-09-18T12:52:07.985 INFO:tasks.workunit.client.1.smithi161.stdout:6/584: symlink d4/d39/d47/lbc 0 2024-09-18T12:52:07.987 INFO:tasks.workunit.client.1.smithi161.stdout:6/585: dread d4/f95 [0,4194304] 0 2024-09-18T12:52:07.988 INFO:tasks.workunit.client.1.smithi161.stdout:5/519: write d3/d8/f73 [1066845,13003] 0 2024-09-18T12:52:07.989 INFO:tasks.workunit.client.1.smithi161.stdout:9/487: creat d0/d16/fa3 x:0 0 0 2024-09-18T12:52:07.991 INFO:tasks.workunit.client.1.smithi161.stdout:8/582: truncate d0/d3/d10/d21/f49 380163 0 2024-09-18T12:52:07.992 INFO:tasks.workunit.client.1.smithi161.stdout:8/583: truncate d0/d3/d10/d21/d4a/f4f 4202174 0 2024-09-18T12:52:07.992 INFO:tasks.workunit.client.1.smithi161.stdout:0/578: symlink df/d29/d46/lcf 0 2024-09-18T12:52:07.993 INFO:tasks.workunit.client.0.smithi045.stdout:0/272: creat d6/d48/f4d x:0 0 0 2024-09-18T12:52:07.993 INFO:tasks.workunit.client.1.smithi161.stdout:8/584: truncate d0/d3/d10/d21/fb8 4623511 0 2024-09-18T12:52:07.994 INFO:tasks.workunit.client.0.smithi045.stdout:0/273: fsync d6/d48/d4a/f4c 0 2024-09-18T12:52:07.996 INFO:tasks.workunit.client.0.smithi045.stdout:7/204: creat d13/d1a/f45 x:0 0 0 2024-09-18T12:52:07.997 INFO:tasks.workunit.client.0.smithi045.stdout:6/229: creat d9/d1a/d2d/d32/f4c x:0 0 0 2024-09-18T12:52:08.000 INFO:tasks.workunit.client.1.smithi161.stdout:4/604: read d5/d14/d67/dc7/f80 [31895,29578] 0 2024-09-18T12:52:08.001 INFO:tasks.workunit.client.0.smithi045.stdout:5/336: write d6/db/f50 [2836405,76646] 0 2024-09-18T12:52:08.002 INFO:tasks.workunit.client.0.smithi045.stdout:8/263: creat d11/d14/d45/f4a x:0 0 0 2024-09-18T12:52:08.002 INFO:tasks.workunit.client.0.smithi045.stdout:5/337: chown d6/d2a/c20 109589040 1 2024-09-18T12:52:08.003 INFO:tasks.workunit.client.0.smithi045.stdout:8/264: dread - d11/d14/f19 zero size 2024-09-18T12:52:08.003 INFO:tasks.workunit.client.0.smithi045.stdout:5/338: stat d6/d2a/c20 0 2024-09-18T12:52:08.004 INFO:tasks.workunit.client.0.smithi045.stdout:4/244: mknod db/c52 0 2024-09-18T12:52:08.009 INFO:tasks.workunit.client.1.smithi161.stdout:0/579: creat df/d30/d71/d96/fd0 x:0 0 0 2024-09-18T12:52:08.010 INFO:tasks.workunit.client.0.smithi045.stdout:5/339: dwrite d6/db/d19/f68 [0,4194304] 0 2024-09-18T12:52:08.010 INFO:tasks.workunit.client.1.smithi161.stdout:9/488: dwrite d0/d16/d25/d28/f38 [4194304,4194304] 0 2024-09-18T12:52:08.012 INFO:tasks.workunit.client.0.smithi045.stdout:0/274: rename d6/l38 to d6/d7/d21/d23/l4e 0 2024-09-18T12:52:08.013 INFO:tasks.workunit.client.0.smithi045.stdout:0/275: chown d6/d7/f42 0 1 2024-09-18T12:52:08.015 INFO:tasks.workunit.client.0.smithi045.stdout:7/205: creat d13/d1a/d28/f46 x:0 0 0 2024-09-18T12:52:08.016 INFO:tasks.workunit.client.1.smithi161.stdout:2/601: link d0/d5/d53/cb8 d0/d1/d4c/d67/db9/dcb/d8a/da8/ccc 0 2024-09-18T12:52:08.017 INFO:tasks.workunit.client.0.smithi045.stdout:6/230: unlink d9/f12 0 2024-09-18T12:52:08.018 INFO:tasks.workunit.client.0.smithi045.stdout:1/291: write d0/d2d/d2b/f52 [1334314,5602] 0 2024-09-18T12:52:08.020 INFO:tasks.workunit.client.1.smithi161.stdout:6/586: mkdir d4/d1a/d1c/d3e/d83/dad/dbd 0 2024-09-18T12:52:08.020 INFO:tasks.workunit.client.1.smithi161.stdout:6/587: readlink d4/d39/d48/l67 0 2024-09-18T12:52:08.022 INFO:tasks.workunit.client.1.smithi161.stdout:6/588: write d4/d1a/d1c/d3e/d83/faa [123889,3558] 0 2024-09-18T12:52:08.022 INFO:tasks.workunit.client.1.smithi161.stdout:5/520: creat d3/d3b/d7b/da6/fa8 x:0 0 0 2024-09-18T12:52:08.023 INFO:tasks.workunit.client.1.smithi161.stdout:5/521: read d3/d9/d4b/f51 [4608462,42237] 0 2024-09-18T12:52:08.026 INFO:tasks.workunit.client.1.smithi161.stdout:7/519: sync 2024-09-18T12:52:08.027 INFO:tasks.workunit.client.0.smithi045.stdout:6/231: dwrite d9/d1a/d2d/d38/f3d [0,4194304] 0 2024-09-18T12:52:08.027 INFO:tasks.workunit.client.1.smithi161.stdout:9/489: unlink d0/d20/d49/c2c 0 2024-09-18T12:52:08.027 INFO:tasks.workunit.client.1.smithi161.stdout:7/520: write d3/d50/f66 [272595,34053] 0 2024-09-18T12:52:08.027 INFO:tasks.workunit.client.1.smithi161.stdout:9/490: fsync d0/d16/d25/d28/f7b 0 2024-09-18T12:52:08.029 INFO:tasks.workunit.client.1.smithi161.stdout:0/580: mkdir df/d30/d4d/d92/d95/dc5/d8a/dd1 0 2024-09-18T12:52:08.033 INFO:tasks.workunit.client.1.smithi161.stdout:8/585: mknod d0/d3/cc0 0 2024-09-18T12:52:08.034 INFO:tasks.workunit.client.1.smithi161.stdout:8/586: dread - d0/d3/d10/d21/d4a/d52/d82/d96/f61 zero size 2024-09-18T12:52:08.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:07 smithi045 ceph-mon[28315]: pgmap v26: 65 pgs: 65 active+clean; 1.3 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 31 MiB/s rd, 197 MiB/s wr, 385 op/s 2024-09-18T12:52:08.035 INFO:tasks.workunit.client.0.smithi045.stdout:7/206: dread f11 [0,4194304] 0 2024-09-18T12:52:08.038 INFO:tasks.workunit.client.0.smithi045.stdout:3/239: getdents d0/d1e/d39 0 2024-09-18T12:52:08.040 INFO:tasks.workunit.client.1.smithi161.stdout:6/589: mknod d4/d61/d69/da0/cbe 0 2024-09-18T12:52:08.040 INFO:tasks.workunit.client.0.smithi045.stdout:3/240: chown d0/d1e/d2c/d3f/d44 1555935 1 2024-09-18T12:52:08.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:07 smithi161 ceph-mon[35784]: pgmap v26: 65 pgs: 65 active+clean; 1.3 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 31 MiB/s rd, 197 MiB/s wr, 385 op/s 2024-09-18T12:52:08.043 INFO:tasks.workunit.client.0.smithi045.stdout:5/340: getdents d6/db/d6a/d6d 0 2024-09-18T12:52:08.044 INFO:tasks.workunit.client.0.smithi045.stdout:1/292: dwrite d0/fb [0,4194304] 0 2024-09-18T12:52:08.045 INFO:tasks.workunit.client.0.smithi045.stdout:6/232: symlink d9/d1a/d1d/l4d 0 2024-09-18T12:52:08.047 INFO:tasks.workunit.client.0.smithi045.stdout:1/293: rename d0 to d0/d12/d32/d57 22 2024-09-18T12:52:08.047 INFO:tasks.workunit.client.0.smithi045.stdout:4/245: dwrite db/d20/f44 [0,4194304] 0 2024-09-18T12:52:08.050 INFO:tasks.workunit.client.0.smithi045.stdout:7/207: write f11 [4287771,64792] 0 2024-09-18T12:52:08.056 INFO:tasks.workunit.client.0.smithi045.stdout:3/241: mknod d0/d1e/d2c/d3f/d44/c59 0 2024-09-18T12:52:08.057 INFO:tasks.workunit.client.0.smithi045.stdout:8/265: getdents d11 0 2024-09-18T12:52:08.058 INFO:tasks.workunit.client.1.smithi161.stdout:5/522: getdents d3/d9/d4b/d8e/d46/d9f 0 2024-09-18T12:52:08.058 INFO:tasks.workunit.client.0.smithi045.stdout:5/341: dwrite d6/db/f6b [0,4194304] 0 2024-09-18T12:52:08.060 INFO:tasks.workunit.client.0.smithi045.stdout:3/242: write d0/f4d [784199,130280] 0 2024-09-18T12:52:08.062 INFO:tasks.workunit.client.0.smithi045.stdout:3/243: write d0/d7/f23 [8795244,120569] 0 2024-09-18T12:52:08.063 INFO:tasks.workunit.client.1.smithi161.stdout:6/590: creat d4/d1a/d1c/d3e/d83/d9e/db1/d28/d81/fbf x:0 0 0 2024-09-18T12:52:08.067 INFO:tasks.workunit.client.1.smithi161.stdout:2/602: truncate d0/d1/d3b/d7e/f70 2143811 0 2024-09-18T12:52:08.068 INFO:tasks.workunit.client.1.smithi161.stdout:9/491: truncate d0/db/d18/f69 216899 0 2024-09-18T12:52:08.070 INFO:tasks.workunit.client.0.smithi045.stdout:4/246: symlink db/de/d1a/d2e/l53 0 2024-09-18T12:52:08.072 INFO:tasks.workunit.client.1.smithi161.stdout:0/581: creat df/d29/d36/d94/fd2 x:0 0 0 2024-09-18T12:52:08.074 INFO:tasks.workunit.client.1.smithi161.stdout:8/587: mkdir d0/d3/d10/d21/d4a/d52/d82/d96/dc1 0 2024-09-18T12:52:08.075 INFO:tasks.workunit.client.1.smithi161.stdout:9/492: dwrite d0/d16/d25/d46/f68 [0,4194304] 0 2024-09-18T12:52:08.076 INFO:tasks.workunit.client.1.smithi161.stdout:6/591: symlink d4/d61/d69/d87/lc0 0 2024-09-18T12:52:08.077 INFO:tasks.workunit.client.0.smithi045.stdout:6/233: dwrite d9/d1a/d2d/f3b [0,4194304] 0 2024-09-18T12:52:08.078 INFO:tasks.workunit.client.1.smithi161.stdout:7/521: rename d3/f6b to d3/d8/d15/f92 0 2024-09-18T12:52:08.082 INFO:tasks.workunit.client.0.smithi045.stdout:4/247: dwrite db/d10/d13/f50 [0,4194304] 0 2024-09-18T12:52:08.082 INFO:tasks.workunit.client.1.smithi161.stdout:5/523: dwrite d3/d14/f80 [0,4194304] 0 2024-09-18T12:52:08.083 INFO:tasks.workunit.client.1.smithi161.stdout:5/524: fsync d3/d14/f1b 0 2024-09-18T12:52:08.085 INFO:tasks.workunit.client.1.smithi161.stdout:7/522: read d3/d8/d15/d1a/d4a/d59/f69 [929938,106788] 0 2024-09-18T12:52:08.088 INFO:tasks.workunit.client.0.smithi045.stdout:6/234: creat d9/d1a/d1d/f4e x:0 0 0 2024-09-18T12:52:08.092 INFO:tasks.workunit.client.1.smithi161.stdout:7/523: dwrite d3/d8/d15/d1a/d4a/d59/f69 [0,4194304] 0 2024-09-18T12:52:08.092 INFO:tasks.workunit.client.0.smithi045.stdout:8/266: creat d11/d14/f4b x:0 0 0 2024-09-18T12:52:08.092 INFO:tasks.workunit.client.0.smithi045.stdout:8/267: chown f9 206582 1 2024-09-18T12:52:08.092 INFO:tasks.workunit.client.0.smithi045.stdout:8/268: fsync f6 0 2024-09-18T12:52:08.093 INFO:tasks.workunit.client.1.smithi161.stdout:6/592: mknod d4/d1a/d1c/d3e/d83/d9e/db1/d28/d81/cc1 0 2024-09-18T12:52:08.093 INFO:tasks.workunit.client.1.smithi161.stdout:7/524: chown d3/d8/d15/d1a/d24/d31/l45 3078 1 2024-09-18T12:52:08.094 INFO:tasks.workunit.client.0.smithi045.stdout:4/248: rename db/de/c17 to db/d10/d2f/c54 0 2024-09-18T12:52:08.096 INFO:tasks.workunit.client.1.smithi161.stdout:3/568: sync 2024-09-18T12:52:08.096 INFO:tasks.workunit.client.1.smithi161.stdout:1/457: sync 2024-09-18T12:52:08.098 INFO:tasks.workunit.client.0.smithi045.stdout:7/208: link c8 d13/d31/d29/c47 0 2024-09-18T12:52:08.103 INFO:tasks.workunit.client.0.smithi045.stdout:6/235: mknod d9/d1a/d2d/c4f 0 2024-09-18T12:52:08.106 INFO:tasks.workunit.client.1.smithi161.stdout:7/525: dwrite d3/d8/d15/f3c [0,4194304] 0 2024-09-18T12:52:08.107 INFO:tasks.workunit.client.0.smithi045.stdout:3/244: getdents d0 0 2024-09-18T12:52:08.107 INFO:tasks.workunit.client.0.smithi045.stdout:3/245: stat d0/fe 0 2024-09-18T12:52:08.108 INFO:tasks.workunit.client.1.smithi161.stdout:0/582: dread df/d29/f3b [0,4194304] 0 2024-09-18T12:52:08.109 INFO:tasks.workunit.client.1.smithi161.stdout:9/493: mkdir d0/d47/d48/d7f/d9e/da4 0 2024-09-18T12:52:08.111 INFO:tasks.workunit.client.1.smithi161.stdout:3/569: dwrite d1/f8b [4194304,4194304] 0 2024-09-18T12:52:08.112 INFO:tasks.workunit.client.0.smithi045.stdout:7/209: dwrite d13/d31/f26 [4194304,4194304] 0 2024-09-18T12:52:08.113 INFO:tasks.workunit.client.1.smithi161.stdout:4/605: rename d5/ca6 to d5/d32/cd0 0 2024-09-18T12:52:08.114 INFO:tasks.workunit.client.1.smithi161.stdout:7/526: rename d3 to d3/d93 22 2024-09-18T12:52:08.115 INFO:tasks.workunit.client.0.smithi045.stdout:4/249: mknod db/d20/c55 0 2024-09-18T12:52:08.118 INFO:tasks.workunit.client.1.smithi161.stdout:2/603: link d0/d5/d53/f5b d0/d5/fcd 0 2024-09-18T12:52:08.122 INFO:tasks.workunit.client.0.smithi045.stdout:6/236: truncate d9/f23 677634 0 2024-09-18T12:52:08.127 INFO:tasks.workunit.client.0.smithi045.stdout:5/342: dread d6/db/d19/d31/f45 [0,4194304] 0 2024-09-18T12:52:08.129 INFO:tasks.workunit.client.0.smithi045.stdout:5/343: write d6/db/f6b [304497,28896] 0 2024-09-18T12:52:08.132 INFO:tasks.workunit.client.0.smithi045.stdout:8/269: creat d11/d14/f4c x:0 0 0 2024-09-18T12:52:08.134 INFO:tasks.workunit.client.1.smithi161.stdout:9/494: unlink d0/d16/d25/d28/c3d 0 2024-09-18T12:52:08.138 INFO:tasks.workunit.client.1.smithi161.stdout:3/570: creat d1/d2e/d24/d84/d9a/fc2 x:0 0 0 2024-09-18T12:52:08.138 INFO:tasks.workunit.client.1.smithi161.stdout:8/588: dwrite d0/d3/d10/d21/f49 [0,4194304] 0 2024-09-18T12:52:08.139 INFO:tasks.workunit.client.1.smithi161.stdout:0/583: dread df/d30/d4d/d92/d95/dc5/d86/f75 [0,4194304] 0 2024-09-18T12:52:08.140 INFO:tasks.workunit.client.0.smithi045.stdout:5/344: symlink d6/l6f 0 2024-09-18T12:52:08.143 INFO:tasks.workunit.client.1.smithi161.stdout:2/604: symlink d0/d4/d52/d8b/lce 0 2024-09-18T12:52:08.143 INFO:tasks.workunit.client.1.smithi161.stdout:4/606: chown d5/d27/l31 25959 1 2024-09-18T12:52:08.143 INFO:tasks.workunit.client.1.smithi161.stdout:1/458: dread d1/da/d39/f37 [0,4194304] 0 2024-09-18T12:52:08.145 INFO:tasks.workunit.client.0.smithi045.stdout:5/345: mkdir d6/db/d70 0 2024-09-18T12:52:08.148 INFO:tasks.workunit.client.0.smithi045.stdout:8/270: link d11/f13 d11/d20/d39/d41/f4d 0 2024-09-18T12:52:08.149 INFO:tasks.workunit.client.1.smithi161.stdout:7/527: dread d3/d8/d15/d38/f70 [0,4194304] 0 2024-09-18T12:52:08.150 INFO:tasks.workunit.client.1.smithi161.stdout:8/589: dwrite d0/d3/fa6 [0,4194304] 0 2024-09-18T12:52:08.151 INFO:tasks.workunit.client.1.smithi161.stdout:8/590: fdatasync d0/d3/d10/f57 0 2024-09-18T12:52:08.152 INFO:tasks.workunit.client.0.smithi045.stdout:4/250: dwrite db/d10/d13/f2b [0,4194304] 0 2024-09-18T12:52:08.153 INFO:tasks.workunit.client.0.smithi045.stdout:3/246: dread d0/fe [4194304,4194304] 0 2024-09-18T12:52:08.156 INFO:tasks.workunit.client.0.smithi045.stdout:3/247: read d0/fe [4161070,89826] 0 2024-09-18T12:52:08.156 INFO:tasks.workunit.client.0.smithi045.stdout:8/271: symlink d11/d20/d46/l4e 0 2024-09-18T12:52:08.159 INFO:tasks.workunit.client.0.smithi045.stdout:5/346: creat d6/d28/d2b/d51/d6c/f71 x:0 0 0 2024-09-18T12:52:08.160 INFO:tasks.workunit.client.0.smithi045.stdout:5/347: fdatasync d6/db/f50 0 2024-09-18T12:52:08.162 INFO:tasks.workunit.client.0.smithi045.stdout:8/272: dread d11/f12 [0,4194304] 0 2024-09-18T12:52:08.163 INFO:tasks.workunit.client.1.smithi161.stdout:6/593: truncate d4/d1a/d1c/f4a 3701032 0 2024-09-18T12:52:08.163 INFO:tasks.workunit.client.0.smithi045.stdout:4/251: rename db/f4d to db/d2c/d35/f56 0 2024-09-18T12:52:08.164 INFO:tasks.workunit.client.1.smithi161.stdout:2/605: creat d0/d71/fcf x:0 0 0 2024-09-18T12:52:08.169 INFO:tasks.workunit.client.1.smithi161.stdout:4/607: creat d5/d27/d44/d61/d6c/fd1 x:0 0 0 2024-09-18T12:52:08.172 INFO:tasks.workunit.client.0.smithi045.stdout:5/348: unlink d6/d2a/f18 0 2024-09-18T12:52:08.173 INFO:tasks.workunit.client.1.smithi161.stdout:1/459: dread d1/d26/f2e [0,4194304] 0 2024-09-18T12:52:08.175 INFO:tasks.workunit.client.0.smithi045.stdout:8/273: creat d11/d20/d39/f4f x:0 0 0 2024-09-18T12:52:08.177 INFO:tasks.workunit.client.0.smithi045.stdout:4/252: mknod db/d2c/d35/c57 0 2024-09-18T12:52:08.179 INFO:tasks.workunit.client.0.smithi045.stdout:3/248: symlink d0/d7/l5a 0 2024-09-18T12:52:08.180 INFO:tasks.workunit.client.1.smithi161.stdout:6/594: creat d4/d61/fc2 x:0 0 0 2024-09-18T12:52:08.181 INFO:tasks.workunit.client.1.smithi161.stdout:2/606: mkdir d0/d71/da9/d9f/dd0 0 2024-09-18T12:52:08.182 INFO:tasks.workunit.client.0.smithi045.stdout:5/349: creat d6/d2a/d61/f72 x:0 0 0 2024-09-18T12:52:08.182 INFO:tasks.workunit.client.1.smithi161.stdout:6/595: write d4/d1a/d1c/d3e/d4d/faf [1042961,36520] 0 2024-09-18T12:52:08.183 INFO:tasks.workunit.client.0.smithi045.stdout:5/350: write d6/db/f50 [3185749,12633] 0 2024-09-18T12:52:08.183 INFO:tasks.workunit.client.0.smithi045.stdout:8/274: symlink d11/d20/l50 0 2024-09-18T12:52:08.184 INFO:tasks.workunit.client.1.smithi161.stdout:0/584: dread df/d29/d46/d90/f4b [0,4194304] 0 2024-09-18T12:52:08.184 INFO:tasks.workunit.client.1.smithi161.stdout:2/607: write d0/d1/d3b/d3d/f88 [853982,105443] 0 2024-09-18T12:52:08.185 INFO:tasks.workunit.client.1.smithi161.stdout:0/585: chown df/d29/d46/d90/d37 6902370 1 2024-09-18T12:52:08.187 INFO:tasks.workunit.client.0.smithi045.stdout:3/249: write d0/f3e [4175819,99525] 0 2024-09-18T12:52:08.187 INFO:tasks.workunit.client.1.smithi161.stdout:1/460: symlink d1/d26/d3a/l96 0 2024-09-18T12:52:08.188 INFO:tasks.workunit.client.0.smithi045.stdout:3/250: write d0/d22/f28 [832346,51024] 0 2024-09-18T12:52:08.190 INFO:tasks.workunit.client.1.smithi161.stdout:7/528: creat d3/d8/d15/d38/d4d/f94 x:0 0 0 2024-09-18T12:52:08.192 INFO:tasks.workunit.client.0.smithi045.stdout:8/275: rename d11/d20/d46/f38 to d11/d20/d46/f51 0 2024-09-18T12:52:08.192 INFO:tasks.workunit.client.1.smithi161.stdout:2/608: dwrite d0/fa0 [0,4194304] 0 2024-09-18T12:52:08.194 INFO:tasks.workunit.client.1.smithi161.stdout:2/609: write d0/d5/d43/f45 [959686,115480] 0 2024-09-18T12:52:08.195 INFO:tasks.workunit.client.0.smithi045.stdout:3/251: dwrite d0/d22/f28 [0,4194304] 0 2024-09-18T12:52:08.196 INFO:tasks.workunit.client.1.smithi161.stdout:2/610: chown d0/d4/d52/f85 9 1 2024-09-18T12:52:08.196 INFO:tasks.workunit.client.1.smithi161.stdout:1/461: dwrite d1/da/f18 [0,4194304] 0 2024-09-18T12:52:08.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/462: truncate d1/da/d39/f61 1786583 0 2024-09-18T12:52:08.199 INFO:tasks.workunit.client.1.smithi161.stdout:3/571: truncate d1/d2e/d14/d65/f8f 417011 0 2024-09-18T12:52:08.199 INFO:tasks.workunit.client.1.smithi161.stdout:4/608: creat d5/d14/d6d/fd2 x:0 0 0 2024-09-18T12:52:08.200 INFO:tasks.workunit.client.0.smithi045.stdout:4/253: write db/f30 [1409192,99516] 0 2024-09-18T12:52:08.200 INFO:tasks.workunit.client.0.smithi045.stdout:2/284: sync 2024-09-18T12:52:08.200 INFO:tasks.workunit.client.0.smithi045.stdout:9/216: sync 2024-09-18T12:52:08.203 INFO:tasks.workunit.client.0.smithi045.stdout:9/217: write d0/d3/d6/f22 [3064981,127026] 0 2024-09-18T12:52:08.203 INFO:tasks.workunit.client.1.smithi161.stdout:6/596: unlink d4/d39/d3a/f29 0 2024-09-18T12:52:08.205 INFO:tasks.workunit.client.1.smithi161.stdout:6/597: readlink d4/d39/d48/l67 0 2024-09-18T12:52:08.205 INFO:tasks.workunit.client.0.smithi045.stdout:5/351: write d6/db/d19/d31/f45 [2259435,59475] 0 2024-09-18T12:52:08.206 INFO:tasks.workunit.client.0.smithi045.stdout:3/252: dwrite d0/d22/f26 [0,4194304] 0 2024-09-18T12:52:08.208 INFO:tasks.workunit.client.1.smithi161.stdout:3/572: dwrite d1/f8b [4194304,4194304] 0 2024-09-18T12:52:08.209 INFO:tasks.workunit.client.1.smithi161.stdout:0/586: rename df/d29/d46 to df/d30/d71/d96/dd3 0 2024-09-18T12:52:08.214 INFO:tasks.workunit.client.0.smithi045.stdout:3/253: dwrite d0/d1e/d2c/d3a/f47 [0,4194304] 0 2024-09-18T12:52:08.216 INFO:tasks.workunit.client.1.smithi161.stdout:7/529: fdatasync d3/d8/d15/d1a/d24/f4c 0 2024-09-18T12:52:08.219 INFO:tasks.workunit.client.1.smithi161.stdout:8/591: creat d0/d3/fc2 x:0 0 0 2024-09-18T12:52:08.226 INFO:tasks.workunit.client.0.smithi045.stdout:5/352: unlink d6/db/d19/d31/l34 0 2024-09-18T12:52:08.229 INFO:tasks.workunit.client.0.smithi045.stdout:4/254: truncate f9 4701144 0 2024-09-18T12:52:08.231 INFO:tasks.workunit.client.0.smithi045.stdout:3/254: symlink d0/d22/l5b 0 2024-09-18T12:52:08.233 INFO:tasks.workunit.client.1.smithi161.stdout:3/573: write d1/d2e/d14/d65/f79 [1772658,43934] 0 2024-09-18T12:52:08.234 INFO:tasks.workunit.client.1.smithi161.stdout:0/587: fsync df/d30/d4d/f4f 0 2024-09-18T12:52:08.234 INFO:tasks.workunit.client.0.smithi045.stdout:9/218: fdatasync d0/d3/fe 0 2024-09-18T12:52:08.235 INFO:tasks.workunit.client.1.smithi161.stdout:0/588: dread - df/d30/d4d/d92/d95/dc5/d8a/fc6 zero size 2024-09-18T12:52:08.237 INFO:tasks.workunit.client.0.smithi045.stdout:8/276: creat d11/d14/f52 x:0 0 0 2024-09-18T12:52:08.238 INFO:tasks.workunit.client.1.smithi161.stdout:3/574: dread d1/d2e/d24/d1d/f9f [0,4194304] 0 2024-09-18T12:52:08.239 INFO:tasks.workunit.client.1.smithi161.stdout:3/575: chown d1/d2e/d68/f6f 1 1 2024-09-18T12:52:08.239 INFO:tasks.workunit.client.1.smithi161.stdout:8/592: dread d0/d3/d91/f9b [0,4194304] 0 2024-09-18T12:52:08.241 INFO:tasks.workunit.client.1.smithi161.stdout:5/525: sync 2024-09-18T12:52:08.242 INFO:tasks.workunit.client.0.smithi045.stdout:9/219: dwrite d0/d3/d6/f2d [0,4194304] 0 2024-09-18T12:52:08.243 INFO:tasks.workunit.client.0.smithi045.stdout:4/255: mknod db/de/d1a/c58 0 2024-09-18T12:52:08.246 INFO:tasks.workunit.client.0.smithi045.stdout:3/255: mkdir d0/d1e/d2c/d5c 0 2024-09-18T12:52:08.247 INFO:tasks.workunit.client.1.smithi161.stdout:2/611: mkdir d0/d1/d3b/d3d/da5/dd1 0 2024-09-18T12:52:08.248 INFO:tasks.workunit.client.1.smithi161.stdout:4/609: symlink d5/d14/d67/dc7/d9b/ld3 0 2024-09-18T12:52:08.250 INFO:tasks.workunit.client.0.smithi045.stdout:5/353: mknod d6/db/d70/c73 0 2024-09-18T12:52:08.252 INFO:tasks.workunit.client.1.smithi161.stdout:9/495: sync 2024-09-18T12:52:08.253 INFO:tasks.workunit.client.1.smithi161.stdout:9/496: chown d0/d16/d25/d86 2 1 2024-09-18T12:52:08.254 INFO:tasks.workunit.client.1.smithi161.stdout:9/497: truncate d0/d16/d25/d46/d53/f72 501576 0 2024-09-18T12:52:08.254 INFO:tasks.workunit.client.0.smithi045.stdout:2/285: truncate d5/f9 1588065 0 2024-09-18T12:52:08.255 INFO:tasks.workunit.client.1.smithi161.stdout:6/598: truncate d4/d1a/d1c/d3e/d83/d9e/db1/d28/f3b 3543037 0 2024-09-18T12:52:08.257 INFO:tasks.workunit.client.0.smithi045.stdout:9/220: unlink d0/d3/d6/d10/d2c/l36 0 2024-09-18T12:52:08.259 INFO:tasks.workunit.client.0.smithi045.stdout:5/354: dwrite d6/d2a/d61/f65 [4194304,4194304] 0 2024-09-18T12:52:08.262 INFO:tasks.workunit.client.1.smithi161.stdout:2/612: dread d0/d1/d4c/d67/f6b [0,4194304] 0 2024-09-18T12:52:08.263 INFO:tasks.workunit.client.0.smithi045.stdout:9/221: truncate d0/d3/d6/d10/d2c/f44 115501 0 2024-09-18T12:52:08.264 INFO:tasks.workunit.client.0.smithi045.stdout:9/222: readlink d0/d3/d6/d10/l12 0 2024-09-18T12:52:08.266 INFO:tasks.workunit.client.1.smithi161.stdout:3/576: dread d1/d2e/d14/d90/f95 [0,4194304] 0 2024-09-18T12:52:08.268 INFO:tasks.workunit.client.1.smithi161.stdout:8/593: stat d0/d3/d1e/c6a 0 2024-09-18T12:52:08.271 INFO:tasks.workunit.client.0.smithi045.stdout:2/286: dread d5/d2c/d4d/f5a [0,4194304] 0 2024-09-18T12:52:08.272 INFO:tasks.workunit.client.1.smithi161.stdout:5/526: unlink d3/f66 0 2024-09-18T12:52:08.275 INFO:tasks.workunit.client.0.smithi045.stdout:8/277: rename d11/d20/d39 to d11/d14/d53 0 2024-09-18T12:52:08.277 INFO:tasks.workunit.client.1.smithi161.stdout:1/463: creat d1/f97 x:0 0 0 2024-09-18T12:52:08.278 INFO:tasks.workunit.client.1.smithi161.stdout:1/464: write d1/da/d1f/d45/d89/f94 [647925,68903] 0 2024-09-18T12:52:08.282 INFO:tasks.workunit.client.1.smithi161.stdout:7/530: write d3/d36/f65 [114506,69198] 0 2024-09-18T12:52:08.283 INFO:tasks.workunit.client.1.smithi161.stdout:4/610: write d5/f21 [2337968,53510] 0 2024-09-18T12:52:08.284 INFO:tasks.workunit.client.1.smithi161.stdout:7/531: chown d3/d8/d15/d1a/d4a/d64/f7b 8337048 1 2024-09-18T12:52:08.284 INFO:tasks.workunit.client.0.smithi045.stdout:2/287: chown d5/c48 3 1 2024-09-18T12:52:08.286 INFO:tasks.workunit.client.0.smithi045.stdout:4/256: rename db/d10 to db/de/d1e/d3e/d47/d59 0 2024-09-18T12:52:08.288 INFO:tasks.workunit.client.0.smithi045.stdout:3/256: link d0/d1e/l2d d0/d1e/d2c/d3f/d44/l5d 0 2024-09-18T12:52:08.289 INFO:tasks.workunit.client.1.smithi161.stdout:4/611: dwrite d5/d27/d44/f63 [0,4194304] 0 2024-09-18T12:52:08.293 INFO:tasks.workunit.client.1.smithi161.stdout:0/589: unlink df/d29/l40 0 2024-09-18T12:52:08.298 INFO:tasks.workunit.client.0.smithi045.stdout:8/278: rename f7 to d11/d14/d53/f54 0 2024-09-18T12:52:08.299 INFO:tasks.workunit.client.0.smithi045.stdout:3/257: mknod d0/d1e/d2c/d3f/c5e 0 2024-09-18T12:52:08.302 INFO:tasks.workunit.client.1.smithi161.stdout:8/594: dread - d0/f6b zero size 2024-09-18T12:52:08.303 INFO:tasks.workunit.client.1.smithi161.stdout:8/595: dread - d0/d3/d10/d21/d4a/d52/d82/f80 zero size 2024-09-18T12:52:08.304 INFO:tasks.workunit.client.1.smithi161.stdout:8/596: fsync d0/d3/fc2 0 2024-09-18T12:52:08.304 INFO:tasks.workunit.client.1.smithi161.stdout:5/527: write d3/d9/d4b/f51 [8161951,66009] 0 2024-09-18T12:52:08.305 INFO:tasks.workunit.client.0.smithi045.stdout:3/258: rmdir d0/d1e/d39 39 2024-09-18T12:52:08.305 INFO:tasks.workunit.client.1.smithi161.stdout:8/597: write d0/d3/fc2 [35115,1249] 0 2024-09-18T12:52:08.308 INFO:tasks.workunit.client.1.smithi161.stdout:1/465: write d1/f62 [558910,57169] 0 2024-09-18T12:52:08.309 INFO:tasks.workunit.client.0.smithi045.stdout:3/259: dread d0/d1e/d2c/d3a/f3c [4194304,4194304] 0 2024-09-18T12:52:08.311 INFO:tasks.workunit.client.1.smithi161.stdout:5/528: dwrite d3/d14/f19 [0,4194304] 0 2024-09-18T12:52:08.312 INFO:tasks.workunit.client.0.smithi045.stdout:4/257: write f9 [51247,32642] 0 2024-09-18T12:52:08.313 INFO:tasks.workunit.client.0.smithi045.stdout:8/279: symlink d11/d14/l55 0 2024-09-18T12:52:08.314 INFO:tasks.workunit.client.0.smithi045.stdout:4/258: chown db/d2c/d35/f56 102327 1 2024-09-18T12:52:08.315 INFO:tasks.workunit.client.0.smithi045.stdout:3/260: mkdir d0/d29/d5f 0 2024-09-18T12:52:08.316 INFO:tasks.workunit.client.0.smithi045.stdout:2/288: rename d5/d2c/d4d/d16/l50 to d5/l6a 0 2024-09-18T12:52:08.317 INFO:tasks.workunit.client.0.smithi045.stdout:8/280: rename d11/d14/d3d to d11/d14/d3d/d56 22 2024-09-18T12:52:08.318 INFO:tasks.workunit.client.1.smithi161.stdout:3/577: dread d1/d2e/d14/f30 [0,4194304] 0 2024-09-18T12:52:08.318 INFO:tasks.workunit.client.0.smithi045.stdout:4/259: symlink db/d1b/d43/l5a 0 2024-09-18T12:52:08.319 INFO:tasks.workunit.client.1.smithi161.stdout:9/498: read d0/d16/d25/d28/f7b [1379309,79698] 0 2024-09-18T12:52:08.319 INFO:tasks.workunit.client.0.smithi045.stdout:3/261: write d0/d22/f2e [5758598,116615] 0 2024-09-18T12:52:08.320 INFO:tasks.workunit.client.0.smithi045.stdout:4/260: fsync db/de/d1e/d3e/d47/d59/d13/f50 0 2024-09-18T12:52:08.320 INFO:tasks.workunit.client.1.smithi161.stdout:4/612: rename d5/d27/c2d to d5/d14/d67/dc7/d60/cd4 0 2024-09-18T12:52:08.321 INFO:tasks.workunit.client.1.smithi161.stdout:4/613: truncate d5/d14/d67/dc7/d47/d49/f85 974796 0 2024-09-18T12:52:08.323 INFO:tasks.workunit.client.1.smithi161.stdout:2/613: mknod d0/d5/d43/d35/cd2 0 2024-09-18T12:52:08.324 INFO:tasks.workunit.client.0.smithi045.stdout:2/289: mkdir d5/d3a/d6b 0 2024-09-18T12:52:08.325 INFO:tasks.workunit.client.0.smithi045.stdout:3/262: write d0/d1e/d2c/d3a/f3c [1291098,115748] 0 2024-09-18T12:52:08.326 INFO:tasks.workunit.client.0.smithi045.stdout:4/261: symlink db/d1b/d43/l5b 0 2024-09-18T12:52:08.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/466: dread d1/d26/f3f [0,4194304] 0 2024-09-18T12:52:08.329 INFO:tasks.workunit.client.1.smithi161.stdout:1/467: read d1/fc [2550027,124168] 0 2024-09-18T12:52:08.332 INFO:tasks.workunit.client.0.smithi045.stdout:3/263: dwrite d0/f4b [4194304,4194304] 0 2024-09-18T12:52:08.334 INFO:tasks.workunit.client.0.smithi045.stdout:3/264: readlink d0/d22/l30 0 2024-09-18T12:52:08.337 INFO:tasks.workunit.client.1.smithi161.stdout:6/599: truncate d4/d39/d48/f56 2370279 0 2024-09-18T12:52:08.340 INFO:tasks.workunit.client.1.smithi161.stdout:9/499: unlink d0/db/d18/l4f 0 2024-09-18T12:52:08.341 INFO:tasks.workunit.client.0.smithi045.stdout:2/290: unlink d5/fd 0 2024-09-18T12:52:08.341 INFO:tasks.workunit.client.1.smithi161.stdout:9/500: chown d0/d47/d48/f75 3 1 2024-09-18T12:52:08.342 INFO:tasks.workunit.client.0.smithi045.stdout:2/291: rename d5/d3a/d3e to d5/d3a/d3e/d6c 22 2024-09-18T12:52:08.343 INFO:tasks.workunit.client.0.smithi045.stdout:8/281: dread fd [0,4194304] 0 2024-09-18T12:52:08.343 INFO:tasks.workunit.client.1.smithi161.stdout:0/590: rename df/d30/d71/d96/dd3/d90/f4c to df/d30/d71/d96/dd3/d78/fd4 0 2024-09-18T12:52:08.344 INFO:tasks.workunit.client.0.smithi045.stdout:2/292: fsync d5/d2c/d4d/d33/f69 0 2024-09-18T12:52:08.344 INFO:tasks.workunit.client.1.smithi161.stdout:3/578: dwrite d1/d2e/f28 [4194304,4194304] 0 2024-09-18T12:52:08.345 INFO:tasks.workunit.client.0.smithi045.stdout:3/265: fsync d0/f1a 0 2024-09-18T12:52:08.345 INFO:tasks.workunit.client.1.smithi161.stdout:9/501: truncate d0/d47/d48/d9a/f9d 4555730 0 2024-09-18T12:52:08.346 INFO:tasks.workunit.client.0.smithi045.stdout:3/266: chown d0/d22/f2e 214 1 2024-09-18T12:52:08.348 INFO:tasks.workunit.client.1.smithi161.stdout:4/614: fsync d5/d32/f45 0 2024-09-18T12:52:08.352 INFO:tasks.workunit.client.1.smithi161.stdout:3/579: dwrite d1/d2e/d14/d90/fbf [0,4194304] 0 2024-09-18T12:52:08.352 INFO:tasks.workunit.client.0.smithi045.stdout:4/262: link db/d2c/d35/f3b db/de/d1e/d3e/d47/d59/d13/f5c 0 2024-09-18T12:52:08.365 INFO:tasks.workunit.client.1.smithi161.stdout:2/614: rename d0/l1a to d0/d4/d78/ld3 0 2024-09-18T12:52:08.365 INFO:tasks.workunit.client.0.smithi045.stdout:2/293: dread d5/d3a/f5b [0,4194304] 0 2024-09-18T12:52:08.366 INFO:tasks.workunit.client.0.smithi045.stdout:3/267: creat d0/d1e/d2c/d5c/f60 x:0 0 0 2024-09-18T12:52:08.370 INFO:tasks.workunit.client.1.smithi161.stdout:9/502: rmdir d0/d16 39 2024-09-18T12:52:08.371 INFO:tasks.workunit.client.0.smithi045.stdout:2/294: mknod d5/d2c/d4d/d16/c6d 0 2024-09-18T12:52:08.373 INFO:tasks.workunit.client.0.smithi045.stdout:2/295: truncate d5/d3a/d3e/f5d 551811 0 2024-09-18T12:52:08.376 INFO:tasks.workunit.client.0.smithi045.stdout:4/263: link db/de/d1e/d3e/d47/d59/l2a db/d2c/l5d 0 2024-09-18T12:52:08.377 INFO:tasks.workunit.client.0.smithi045.stdout:4/264: fsync db/d1b/d43/f4c 0 2024-09-18T12:52:08.377 INFO:tasks.workunit.client.1.smithi161.stdout:4/615: mknod d5/d14/d67/cd5 0 2024-09-18T12:52:08.378 INFO:tasks.workunit.client.1.smithi161.stdout:4/616: chown d5/d27/d44/f55 15099844 1 2024-09-18T12:52:08.379 INFO:tasks.workunit.client.1.smithi161.stdout:8/598: creat d0/d3/fc3 x:0 0 0 2024-09-18T12:52:08.384 INFO:tasks.workunit.client.0.smithi045.stdout:4/265: mknod db/de/d1e/d3e/d47/d59/d13/c5e 0 2024-09-18T12:52:08.384 INFO:tasks.workunit.client.0.smithi045.stdout:2/296: dread d5/d46/f52 [0,4194304] 0 2024-09-18T12:52:08.385 INFO:tasks.workunit.client.1.smithi161.stdout:7/532: link d3/d8/d4f/l57 d3/d8/d15/d1a/d24/d31/l95 0 2024-09-18T12:52:08.386 INFO:tasks.workunit.client.1.smithi161.stdout:7/533: chown d3/d36/f65 1534112412 1 2024-09-18T12:52:08.386 INFO:tasks.workunit.client.1.smithi161.stdout:6/600: mknod d4/d1a/d1c/d3e/d83/dad/dbd/cc3 0 2024-09-18T12:52:08.388 INFO:tasks.workunit.client.1.smithi161.stdout:2/615: mknod d0/d5/d53/cd4 0 2024-09-18T12:52:08.388 INFO:tasks.workunit.client.0.smithi045.stdout:4/266: truncate db/de/d1e/d49/f4e 865159 0 2024-09-18T12:52:08.389 INFO:tasks.workunit.client.1.smithi161.stdout:1/468: truncate d1/d26/d3a/f4f 316094 0 2024-09-18T12:52:08.390 INFO:tasks.workunit.client.1.smithi161.stdout:0/591: readlink df/d30/d71/d96/dd3/d90/d37/lb1 0 2024-09-18T12:52:08.390 INFO:tasks.workunit.client.0.smithi045.stdout:3/268: dwrite d0/d1e/d2c/d3a/f4a [0,4194304] 0 2024-09-18T12:52:08.391 INFO:tasks.workunit.client.1.smithi161.stdout:7/534: dread d3/d8/d15/d1a/d4a/d59/f60 [0,4194304] 0 2024-09-18T12:52:08.392 INFO:tasks.workunit.client.0.smithi045.stdout:3/269: fdatasync d0/f4d 0 2024-09-18T12:52:08.397 INFO:tasks.workunit.client.0.smithi045.stdout:3/270: mknod d0/d1e/d2c/d5c/c61 0 2024-09-18T12:52:08.397 INFO:tasks.workunit.client.0.smithi045.stdout:3/271: chown d0/f4b 2274546 1 2024-09-18T12:52:08.398 INFO:tasks.workunit.client.1.smithi161.stdout:5/529: sync 2024-09-18T12:52:08.398 INFO:tasks.workunit.client.0.smithi045.stdout:3/272: chown d0/f4b 22565785 1 2024-09-18T12:52:08.402 INFO:tasks.workunit.client.0.smithi045.stdout:2/297: dread d5/f5c [0,4194304] 0 2024-09-18T12:52:08.403 INFO:tasks.workunit.client.0.smithi045.stdout:3/273: truncate d0/f1a 2261182 0 2024-09-18T12:52:08.403 INFO:tasks.workunit.client.0.smithi045.stdout:2/298: fdatasync d5/d2c/d4d/d33/f3d 0 2024-09-18T12:52:08.404 INFO:tasks.workunit.client.0.smithi045.stdout:3/274: fsync d0/d1e/d2c/d3a/d45/f49 0 2024-09-18T12:52:08.404 INFO:tasks.workunit.client.0.smithi045.stdout:2/299: dread d5/d2c/d4d/d33/f37 [0,4194304] 0 2024-09-18T12:52:08.406 INFO:tasks.workunit.client.1.smithi161.stdout:6/601: creat d4/d61/d69/fc4 x:0 0 0 2024-09-18T12:52:08.408 INFO:tasks.workunit.client.1.smithi161.stdout:2/616: unlink d0/d4/l1e 0 2024-09-18T12:52:08.411 INFO:tasks.workunit.client.1.smithi161.stdout:1/469: creat d1/d26/f98 x:0 0 0 2024-09-18T12:52:08.413 INFO:tasks.workunit.client.0.smithi045.stdout:4/267: truncate db/de/d1e/d3e/d47/d59/d13/f2b 3625979 0 2024-09-18T12:52:08.414 INFO:tasks.workunit.client.1.smithi161.stdout:0/592: creat df/d30/d4d/d92/d95/dc5/d86/fd5 x:0 0 0 2024-09-18T12:52:08.414 INFO:tasks.workunit.client.0.smithi045.stdout:4/268: truncate db/d1b/d43/f4c 62508 0 2024-09-18T12:52:08.416 INFO:tasks.workunit.client.1.smithi161.stdout:7/535: symlink d3/d8/d15/d1a/d24/d31/l96 0 2024-09-18T12:52:08.417 INFO:tasks.workunit.client.1.smithi161.stdout:4/617: rmdir d5/da9 39 2024-09-18T12:52:08.419 INFO:tasks.workunit.client.1.smithi161.stdout:8/599: mkdir d0/dc4 0 2024-09-18T12:52:08.420 INFO:tasks.workunit.client.1.smithi161.stdout:8/600: stat d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 0 2024-09-18T12:52:08.420 INFO:tasks.workunit.client.1.smithi161.stdout:3/580: creat d1/d2e/d14/d78/fc3 x:0 0 0 2024-09-18T12:52:08.421 INFO:tasks.workunit.client.0.smithi045.stdout:2/300: getdents d5/d2c/d4d/d16/d61 0 2024-09-18T12:52:08.421 INFO:tasks.workunit.client.1.smithi161.stdout:8/601: dread - d0/d3/d10/d21/d4a/d52/d82/d96/fa3 zero size 2024-09-18T12:52:08.421 INFO:tasks.workunit.client.1.smithi161.stdout:3/581: readlink d1/d2e/d14/d65/l9e 0 2024-09-18T12:52:08.422 INFO:tasks.workunit.client.0.smithi045.stdout:4/269: dwrite db/de/d1e/f42 [0,4194304] 0 2024-09-18T12:52:08.423 INFO:tasks.workunit.client.1.smithi161.stdout:6/602: mknod d4/d39/d26/cc5 0 2024-09-18T12:52:08.423 INFO:tasks.workunit.client.0.smithi045.stdout:3/275: dread d0/f1f [0,4194304] 0 2024-09-18T12:52:08.425 INFO:tasks.workunit.client.1.smithi161.stdout:2/617: creat d0/d71/fd5 x:0 0 0 2024-09-18T12:52:08.428 INFO:tasks.workunit.client.1.smithi161.stdout:2/618: stat d0/d5/d43 0 2024-09-18T12:52:08.430 INFO:tasks.workunit.client.0.smithi045.stdout:4/270: dwrite f9 [4194304,4194304] 0 2024-09-18T12:52:08.432 INFO:tasks.workunit.client.0.smithi045.stdout:3/276: rmdir d0/d1e/d2c/d3f 39 2024-09-18T12:52:08.432 INFO:tasks.workunit.client.0.smithi045.stdout:3/277: fsync d0/f3e 0 2024-09-18T12:52:08.433 INFO:tasks.workunit.client.1.smithi161.stdout:2/619: readlink d0/d5/d53/l49 0 2024-09-18T12:52:08.433 INFO:tasks.workunit.client.0.smithi045.stdout:3/278: chown d0/d29/d53 457 1 2024-09-18T12:52:08.434 INFO:tasks.workunit.client.1.smithi161.stdout:3/582: dwrite d1/d2e/d14/d65/d76/d8c/d9d/fbb [0,4194304] 0 2024-09-18T12:52:08.434 INFO:tasks.workunit.client.1.smithi161.stdout:7/536: mknod d3/d8/d15/d1a/c97 0 2024-09-18T12:52:08.434 INFO:tasks.workunit.client.1.smithi161.stdout:8/602: dwrite d0/d3/d10/d21/d4a/d52/f58 [0,4194304] 0 2024-09-18T12:52:08.442 INFO:tasks.workunit.client.1.smithi161.stdout:6/603: dwrite d4/d39/d47/d51/f93 [0,4194304] 0 2024-09-18T12:52:08.442 INFO:tasks.workunit.client.1.smithi161.stdout:3/583: write d1/d2e/d24/d1d/d89/db0/fa2 [584527,123311] 0 2024-09-18T12:52:08.444 INFO:tasks.workunit.client.0.smithi045.stdout:0/276: sync 2024-09-18T12:52:08.450 INFO:tasks.workunit.client.0.smithi045.stdout:2/301: link d5/d46/f52 d5/d2c/d4d/d16/f6e 0 2024-09-18T12:52:08.452 INFO:tasks.workunit.client.0.smithi045.stdout:0/277: mknod d6/d7/d21/c4f 0 2024-09-18T12:52:08.454 INFO:tasks.workunit.client.1.smithi161.stdout:1/470: write d1/da/d1f/d45/f83 [129834,67135] 0 2024-09-18T12:52:08.455 INFO:tasks.workunit.client.1.smithi161.stdout:0/593: mknod df/d30/d71/d96/dd3/cd6 0 2024-09-18T12:52:08.456 INFO:tasks.workunit.client.1.smithi161.stdout:0/594: write df/f22 [419500,128222] 0 2024-09-18T12:52:08.462 INFO:tasks.workunit.client.0.smithi045.stdout:0/278: creat d6/d35/f50 x:0 0 0 2024-09-18T12:52:08.464 INFO:tasks.workunit.client.1.smithi161.stdout:4/618: creat d5/d14/d67/d84/dae/db8/fd6 x:0 0 0 2024-09-18T12:52:08.467 INFO:tasks.workunit.client.1.smithi161.stdout:7/537: creat d3/d8/d15/d38/d4d/f98 x:0 0 0 2024-09-18T12:52:08.471 INFO:tasks.workunit.client.1.smithi161.stdout:8/603: creat d0/d3/d10/d21/d4a/d52/d82/d96/d98/fc5 x:0 0 0 2024-09-18T12:52:08.475 INFO:tasks.workunit.client.0.smithi045.stdout:0/279: dread d6/d35/f37 [0,4194304] 0 2024-09-18T12:52:08.478 INFO:tasks.workunit.client.1.smithi161.stdout:6/604: mknod d4/d61/d69/d87/cc6 0 2024-09-18T12:52:08.479 INFO:tasks.workunit.client.0.smithi045.stdout:3/279: link d0/d22/l4e d0/d1e/d2c/l62 0 2024-09-18T12:52:08.481 INFO:tasks.workunit.client.1.smithi161.stdout:0/595: dread df/d30/d4d/d92/d95/dc5/d86/f72 [4194304,4194304] 0 2024-09-18T12:52:08.481 INFO:tasks.workunit.client.1.smithi161.stdout:3/584: mknod d1/d2e/d24/d84/d9a/cc4 0 2024-09-18T12:52:08.482 INFO:tasks.workunit.client.1.smithi161.stdout:0/596: write df/d30/d71/d96/dd3/d90/d37/f48 [234375,110387] 0 2024-09-18T12:52:08.485 INFO:tasks.workunit.client.1.smithi161.stdout:9/503: getdents d0/d16/d25 0 2024-09-18T12:52:08.485 INFO:tasks.workunit.client.1.smithi161.stdout:9/504: write d0/db/f57 [1851811,56307] 0 2024-09-18T12:52:08.486 INFO:tasks.workunit.client.0.smithi045.stdout:3/280: dwrite d0/d22/f2e [0,4194304] 0 2024-09-18T12:52:08.493 INFO:tasks.workunit.client.0.smithi045.stdout:2/302: truncate d5/d2c/d4d/f54 1708050 0 2024-09-18T12:52:08.495 INFO:tasks.workunit.client.0.smithi045.stdout:0/280: getdents d6/d7/d21/d23/d3b 0 2024-09-18T12:52:08.498 INFO:tasks.workunit.client.0.smithi045.stdout:3/281: creat d0/d1e/d2c/f63 x:0 0 0 2024-09-18T12:52:08.499 INFO:tasks.workunit.client.1.smithi161.stdout:1/471: write d1/da/f16 [2433367,77640] 0 2024-09-18T12:52:08.502 INFO:tasks.workunit.client.0.smithi045.stdout:3/282: dread d0/d22/f28 [0,4194304] 0 2024-09-18T12:52:08.502 INFO:tasks.workunit.client.0.smithi045.stdout:0/281: mknod d6/d7/d21/c51 0 2024-09-18T12:52:08.503 INFO:tasks.workunit.client.0.smithi045.stdout:2/303: dread d5/d2c/d4d/f4e [0,4194304] 0 2024-09-18T12:52:08.504 INFO:tasks.workunit.client.0.smithi045.stdout:3/283: chown d0/d1e/d2c/d3a/f4a 1807 1 2024-09-18T12:52:08.505 INFO:tasks.workunit.client.0.smithi045.stdout:0/282: stat d6/d7/d21/l2a 0 2024-09-18T12:52:08.507 INFO:tasks.workunit.client.0.smithi045.stdout:0/283: dread d6/d7/d32/f33 [0,4194304] 0 2024-09-18T12:52:08.510 INFO:tasks.workunit.client.0.smithi045.stdout:2/304: chown d5/d2c/c60 1901 1 2024-09-18T12:52:08.511 INFO:tasks.workunit.client.0.smithi045.stdout:2/305: readlink d5/d2c/d4d/d33/l2a 0 2024-09-18T12:52:08.513 INFO:tasks.workunit.client.1.smithi161.stdout:1/472: dread d1/d26/f9 [0,4194304] 0 2024-09-18T12:52:08.517 INFO:tasks.workunit.client.0.smithi045.stdout:2/306: dwrite d5/d2c/d4d/d16/f31 [0,4194304] 0 2024-09-18T12:52:08.525 INFO:tasks.workunit.client.0.smithi045.stdout:2/307: mkdir d5/d2c/d6f 0 2024-09-18T12:52:08.528 INFO:tasks.workunit.client.1.smithi161.stdout:2/620: mkdir d0/d71/da9/dd6 0 2024-09-18T12:52:08.529 INFO:tasks.workunit.client.0.smithi045.stdout:0/284: getdents d6/d48 0 2024-09-18T12:52:08.529 INFO:tasks.workunit.client.0.smithi045.stdout:2/308: creat d5/d46/f70 x:0 0 0 2024-09-18T12:52:08.531 INFO:tasks.workunit.client.1.smithi161.stdout:4/619: sync 2024-09-18T12:52:08.532 INFO:tasks.workunit.client.1.smithi161.stdout:5/530: getdents d3/d3b/d7b 0 2024-09-18T12:52:08.532 INFO:tasks.workunit.client.1.smithi161.stdout:6/605: mknod d4/d61/d69/d87/cc7 0 2024-09-18T12:52:08.534 INFO:tasks.workunit.client.0.smithi045.stdout:0/285: dwrite d6/d35/f50 [0,4194304] 0 2024-09-18T12:52:08.535 INFO:tasks.workunit.client.1.smithi161.stdout:3/585: write d1/d2e/d14/d65/f81 [5046060,68277] 0 2024-09-18T12:52:08.536 INFO:tasks.workunit.client.1.smithi161.stdout:8/604: dwrite d0/d3/d91/f9b [0,4194304] 0 2024-09-18T12:52:08.538 INFO:tasks.workunit.client.0.smithi045.stdout:2/309: dread d5/d2c/d4d/d16/f6e [0,4194304] 0 2024-09-18T12:52:08.539 INFO:tasks.workunit.client.0.smithi045.stdout:2/310: dread - d5/d46/f70 zero size 2024-09-18T12:52:08.541 INFO:tasks.workunit.client.0.smithi045.stdout:0/286: dread d6/d35/f50 [0,4194304] 0 2024-09-18T12:52:08.542 INFO:tasks.workunit.client.1.smithi161.stdout:9/505: write d0/d47/d48/d9a/f9d [3999423,4818] 0 2024-09-18T12:52:08.544 INFO:tasks.workunit.client.1.smithi161.stdout:1/473: write d1/fc [5396020,83478] 0 2024-09-18T12:52:08.548 INFO:tasks.workunit.client.1.smithi161.stdout:7/538: mkdir d3/d8/d15/d99 0 2024-09-18T12:52:08.549 INFO:tasks.workunit.client.0.smithi045.stdout:0/287: dwrite d6/d7/f1f [0,4194304] 0 2024-09-18T12:52:08.550 INFO:tasks.workunit.client.1.smithi161.stdout:4/620: creat d5/d32/d39/d4d/fd7 x:0 0 0 2024-09-18T12:52:08.551 INFO:tasks.workunit.client.1.smithi161.stdout:5/531: rename d3/fd to d3/d3b/d7b/d82/fa9 0 2024-09-18T12:52:08.553 INFO:tasks.workunit.client.1.smithi161.stdout:8/605: symlink d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/lc6 0 2024-09-18T12:52:08.554 INFO:tasks.workunit.client.1.smithi161.stdout:8/606: fsync d0/d3/d10/d21/f3a 0 2024-09-18T12:52:08.555 INFO:tasks.workunit.client.1.smithi161.stdout:0/597: mkdir df/dd7 0 2024-09-18T12:52:08.557 INFO:tasks.workunit.client.1.smithi161.stdout:9/506: creat d0/d47/d48/d7f/d9e/fa5 x:0 0 0 2024-09-18T12:52:08.558 INFO:tasks.workunit.client.1.smithi161.stdout:9/507: read - d0/d20/d74/f97 zero size 2024-09-18T12:52:08.559 INFO:tasks.workunit.client.1.smithi161.stdout:9/508: write d0/d16/d25/f27 [476046,8297] 0 2024-09-18T12:52:08.559 INFO:tasks.workunit.client.1.smithi161.stdout:9/509: dread - d0/d47/f77 zero size 2024-09-18T12:52:08.562 INFO:tasks.workunit.client.1.smithi161.stdout:1/474: write d1/d1d/f57 [2023273,49374] 0 2024-09-18T12:52:08.564 INFO:tasks.workunit.client.1.smithi161.stdout:4/621: mkdir d5/d32/dd8 0 2024-09-18T12:52:08.565 INFO:tasks.workunit.client.1.smithi161.stdout:4/622: truncate d5/d14/d67/dc7/d47/dbc/fcc 973144 0 2024-09-18T12:52:08.567 INFO:tasks.workunit.client.1.smithi161.stdout:4/623: read d5/d14/d67/dc7/d4c/f64 [290676,114551] 0 2024-09-18T12:52:08.567 INFO:tasks.workunit.client.1.smithi161.stdout:5/532: symlink d3/d9/d4b/laa 0 2024-09-18T12:52:08.568 INFO:tasks.workunit.client.1.smithi161.stdout:5/533: chown d3/d9/f6e 3195393 1 2024-09-18T12:52:08.568 INFO:tasks.workunit.client.1.smithi161.stdout:4/624: chown d5/d32/f53 2 1 2024-09-18T12:52:08.571 INFO:tasks.workunit.client.1.smithi161.stdout:2/621: dwrite d0/d5/d53/f5b [4194304,4194304] 0 2024-09-18T12:52:08.572 INFO:tasks.workunit.client.1.smithi161.stdout:8/607: creat d0/d3/d91/fc7 x:0 0 0 2024-09-18T12:52:08.573 INFO:tasks.workunit.client.1.smithi161.stdout:8/608: write d0/d3/d10/fbc [208009,65033] 0 2024-09-18T12:52:08.574 INFO:tasks.workunit.client.0.smithi045.stdout:2/311: dwrite d5/f9 [0,4194304] 0 2024-09-18T12:52:08.575 INFO:tasks.workunit.client.1.smithi161.stdout:8/609: write d0/d3/d10/f57 [719385,31837] 0 2024-09-18T12:52:08.577 INFO:tasks.workunit.client.1.smithi161.stdout:8/610: fsync d0/d3/d10/d21/d4a/d52/d82/d96/d98/f90 0 2024-09-18T12:52:08.581 INFO:tasks.workunit.client.1.smithi161.stdout:6/606: truncate d4/f10 2369196 0 2024-09-18T12:52:08.582 INFO:tasks.workunit.client.1.smithi161.stdout:6/607: chown d4/d1a/f1b 834637217 1 2024-09-18T12:52:08.587 INFO:tasks.workunit.client.1.smithi161.stdout:7/539: mknod d3/d8/d15/c9a 0 2024-09-18T12:52:08.588 INFO:tasks.workunit.client.1.smithi161.stdout:0/598: write df/d30/d4d/d92/d95/dc5/d86/f6c [387050,39728] 0 2024-09-18T12:52:08.596 INFO:tasks.workunit.client.1.smithi161.stdout:4/625: creat d5/d32/d39/db6/fd9 x:0 0 0 2024-09-18T12:52:08.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/611: creat d0/d3/d10/d21/d4a/d52/d82/fc8 x:0 0 0 2024-09-18T12:52:08.597 INFO:tasks.workunit.client.1.smithi161.stdout:6/608: symlink d4/d61/lc8 0 2024-09-18T12:52:08.597 INFO:tasks.workunit.client.1.smithi161.stdout:2/622: chown d0/d5/d43/l87 99458698 1 2024-09-18T12:52:08.598 INFO:tasks.workunit.client.1.smithi161.stdout:1/475: link d1/da/d39/f37 d1/d48/f99 0 2024-09-18T12:52:08.599 INFO:tasks.workunit.client.1.smithi161.stdout:2/623: truncate d0/d1/d3b/f61 670172 0 2024-09-18T12:52:08.599 INFO:tasks.workunit.client.1.smithi161.stdout:1/476: chown d1/d26/d3a/d52/c5e 24238 1 2024-09-18T12:52:08.600 INFO:tasks.workunit.client.1.smithi161.stdout:7/540: mkdir d3/d8/d15/d38/d4d/d9b 0 2024-09-18T12:52:08.601 INFO:tasks.workunit.client.1.smithi161.stdout:7/541: write d3/f23 [1907680,130300] 0 2024-09-18T12:52:08.602 INFO:tasks.workunit.client.1.smithi161.stdout:5/534: mkdir d3/d14/d8d/dab 0 2024-09-18T12:52:08.603 INFO:tasks.workunit.client.1.smithi161.stdout:9/510: dread d0/d16/d25/d28/f38 [0,4194304] 0 2024-09-18T12:52:08.604 INFO:tasks.workunit.client.1.smithi161.stdout:0/599: fdatasync df/d30/d71/d96/dd3/d51/fa8 0 2024-09-18T12:52:08.605 INFO:tasks.workunit.client.1.smithi161.stdout:0/600: readlink df/l5a 0 2024-09-18T12:52:08.605 INFO:tasks.workunit.client.1.smithi161.stdout:4/626: mkdir d5/d14/d67/dc7/d60/d95/dda 0 2024-09-18T12:52:08.606 INFO:tasks.workunit.client.1.smithi161.stdout:6/609: symlink d4/d61/d69/da0/dab/lc9 0 2024-09-18T12:52:08.608 INFO:tasks.workunit.client.0.smithi045.stdout:2/312: write d5/f34 [1791639,22213] 0 2024-09-18T12:52:08.609 INFO:tasks.workunit.client.1.smithi161.stdout:0/601: write df/d30/d71/d96/dd3/d90/d37/f42 [1857471,74080] 0 2024-09-18T12:52:08.609 INFO:tasks.workunit.client.1.smithi161.stdout:1/477: creat d1/da/d1f/d45/d73/f9a x:0 0 0 2024-09-18T12:52:08.612 INFO:tasks.workunit.client.1.smithi161.stdout:5/535: symlink d3/d44/lac 0 2024-09-18T12:52:08.612 INFO:tasks.workunit.client.1.smithi161.stdout:7/542: dwrite d3/d8/d15/d38/d77/f7f [0,4194304] 0 2024-09-18T12:52:08.614 INFO:tasks.workunit.client.1.smithi161.stdout:9/511: rmdir d0/d20 39 2024-09-18T12:52:08.614 INFO:tasks.workunit.client.1.smithi161.stdout:3/586: sync 2024-09-18T12:52:08.615 INFO:tasks.workunit.client.1.smithi161.stdout:3/587: chown d1/d2e/d14/d78 246050 1 2024-09-18T12:52:08.616 INFO:tasks.workunit.client.1.smithi161.stdout:3/588: write d1/d2e/d14/d65/d76/fb4 [28515,83543] 0 2024-09-18T12:52:08.619 INFO:tasks.workunit.client.1.smithi161.stdout:2/624: dread d0/d4/d52/f85 [0,4194304] 0 2024-09-18T12:52:08.619 INFO:tasks.workunit.client.1.smithi161.stdout:3/589: fsync d1/d2e/d24/f1f 0 2024-09-18T12:52:08.619 INFO:tasks.workunit.client.1.smithi161.stdout:8/612: creat d0/d3/d10/d21/d4a/d52/d82/d96/dba/fc9 x:0 0 0 2024-09-18T12:52:08.623 INFO:tasks.workunit.client.1.smithi161.stdout:8/613: dread d0/d3/f69 [0,4194304] 0 2024-09-18T12:52:08.623 INFO:tasks.workunit.client.1.smithi161.stdout:0/602: mknod df/d30/d4d/cd8 0 2024-09-18T12:52:08.624 INFO:tasks.workunit.client.1.smithi161.stdout:6/610: mknod d4/d1a/d1c/d3e/d83/d9e/db1/d28/cca 0 2024-09-18T12:52:08.626 INFO:tasks.workunit.client.1.smithi161.stdout:1/478: mknod d1/d26/d3a/c9b 0 2024-09-18T12:52:08.628 INFO:tasks.workunit.client.1.smithi161.stdout:7/543: fdatasync d3/d8/d15/d38/f70 0 2024-09-18T12:52:08.629 INFO:tasks.workunit.client.1.smithi161.stdout:9/512: chown d0/d16/l44 4139 1 2024-09-18T12:52:08.630 INFO:tasks.workunit.client.1.smithi161.stdout:9/513: dread - d0/d47/f8f zero size 2024-09-18T12:52:08.630 INFO:tasks.workunit.client.0.smithi045.stdout:2/313: write d5/d2c/d4d/f54 [116910,14271] 0 2024-09-18T12:52:08.635 INFO:tasks.workunit.client.0.smithi045.stdout:2/314: readlink d5/d2c/d4d/l21 0 2024-09-18T12:52:08.636 INFO:tasks.workunit.client.1.smithi161.stdout:0/603: symlink df/d30/d4d/d92/d95/dc5/db6/ld9 0 2024-09-18T12:52:08.637 INFO:tasks.workunit.client.1.smithi161.stdout:0/604: stat df/d30/d71/d96/dd3/d90/d37/d55/dba 0 2024-09-18T12:52:08.637 INFO:tasks.workunit.client.1.smithi161.stdout:6/611: unlink d4/d39/d26/d31/d76/l7d 0 2024-09-18T12:52:08.639 INFO:tasks.workunit.client.1.smithi161.stdout:6/612: truncate d4/d39/d26/fb2 109690 0 2024-09-18T12:52:08.640 INFO:tasks.workunit.client.1.smithi161.stdout:4/627: creat d5/d14/fdb x:0 0 0 2024-09-18T12:52:08.642 INFO:tasks.workunit.client.1.smithi161.stdout:6/613: write d4/d39/f74 [1713980,105150] 0 2024-09-18T12:52:08.642 INFO:tasks.workunit.client.1.smithi161.stdout:0/605: symlink df/d30/d4d/d92/d95/dc5/db6/lda 0 2024-09-18T12:52:08.642 INFO:tasks.workunit.client.1.smithi161.stdout:4/628: chown d5/d32/d39/d4d 4060 1 2024-09-18T12:52:08.643 INFO:tasks.workunit.client.1.smithi161.stdout:9/514: read d0/d16/d25/d28/f33 [1745774,14531] 0 2024-09-18T12:52:08.644 INFO:tasks.workunit.client.1.smithi161.stdout:7/544: creat d3/d8/d15/d38/d4d/d9b/f9c x:0 0 0 2024-09-18T12:52:08.644 INFO:tasks.workunit.client.1.smithi161.stdout:1/479: write d1/d26/f8 [3507122,105155] 0 2024-09-18T12:52:08.646 INFO:tasks.workunit.client.1.smithi161.stdout:2/625: rename d0/d1/f2e to d0/d71/da9/fd7 0 2024-09-18T12:52:08.646 INFO:tasks.workunit.client.1.smithi161.stdout:5/536: dwrite d3/f56 [0,4194304] 0 2024-09-18T12:52:08.647 INFO:tasks.workunit.client.1.smithi161.stdout:6/614: stat d4/d1a/d1c/d3e/d83/d9e/db1/d28/cca 0 2024-09-18T12:52:08.648 INFO:tasks.workunit.client.1.smithi161.stdout:9/515: fsync d0/d20/d49/f14 0 2024-09-18T12:52:08.649 INFO:tasks.workunit.client.1.smithi161.stdout:0/606: fsync df/d30/d71/d96/dd3/d51/f66 0 2024-09-18T12:52:08.650 INFO:tasks.workunit.client.1.smithi161.stdout:1/480: dread d1/da/d31/f3c [0,4194304] 0 2024-09-18T12:52:08.651 INFO:tasks.workunit.client.1.smithi161.stdout:3/590: rename d1/d2e/d24/f45 to d1/d2e/d24/d1d/d89/fc5 0 2024-09-18T12:52:08.653 INFO:tasks.workunit.client.1.smithi161.stdout:7/545: symlink d3/d8/d15/d1a/d44/l9d 0 2024-09-18T12:52:08.655 INFO:tasks.workunit.client.1.smithi161.stdout:5/537: chown d3/d8/l90 265865 1 2024-09-18T12:52:08.655 INFO:tasks.workunit.client.1.smithi161.stdout:4/629: truncate d5/d32/d39/d4d/f78 3059820 0 2024-09-18T12:52:08.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/615: mknod d4/d61/d69/da0/dab/ccb 0 2024-09-18T12:52:08.657 INFO:tasks.workunit.client.1.smithi161.stdout:9/516: dwrite d0/db/f50 [0,4194304] 0 2024-09-18T12:52:08.660 INFO:tasks.workunit.client.1.smithi161.stdout:0/607: creat df/d30/d4d/d92/d95/dc5/fdb x:0 0 0 2024-09-18T12:52:08.662 INFO:tasks.workunit.client.1.smithi161.stdout:8/614: rename d0/d3/d10/d21/d4a/d52/d66/l53 to d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/lca 0 2024-09-18T12:52:08.664 INFO:tasks.workunit.client.1.smithi161.stdout:3/591: creat d1/d2e/d14/d65/d76/d88/fc6 x:0 0 0 2024-09-18T12:52:08.665 INFO:tasks.workunit.client.1.smithi161.stdout:2/626: mknod d0/d1/d4c/d67/db9/dcb/cd8 0 2024-09-18T12:52:08.666 INFO:tasks.workunit.client.1.smithi161.stdout:6/616: dread d4/d39/d26/d31/f59 [0,4194304] 0 2024-09-18T12:52:08.667 INFO:tasks.workunit.client.1.smithi161.stdout:5/538: fsync d3/d14/d20/f3e 0 2024-09-18T12:52:08.668 INFO:tasks.workunit.client.1.smithi161.stdout:8/615: fdatasync d0/d3/d10/d21/d4a/d52/d66/d5b/fae 0 2024-09-18T12:52:08.669 INFO:tasks.workunit.client.1.smithi161.stdout:9/517: dwrite d0/d16/fa3 [0,4194304] 0 2024-09-18T12:52:08.670 INFO:tasks.workunit.client.1.smithi161.stdout:0/608: creat df/d30/d71/d96/fdc x:0 0 0 2024-09-18T12:52:08.674 INFO:tasks.workunit.client.1.smithi161.stdout:5/539: dread d3/d9/f6d [0,4194304] 0 2024-09-18T12:52:08.675 INFO:tasks.workunit.client.1.smithi161.stdout:7/546: dwrite d3/d8/d15/f92 [0,4194304] 0 2024-09-18T12:52:08.679 INFO:tasks.workunit.client.1.smithi161.stdout:2/627: creat d0/d5/d43/d35/d98/fd9 x:0 0 0 2024-09-18T12:52:08.683 INFO:tasks.workunit.client.1.smithi161.stdout:5/540: dread d3/d8/f59 [0,4194304] 0 2024-09-18T12:52:08.685 INFO:tasks.workunit.client.1.smithi161.stdout:0/609: fsync df/d29/f2c 0 2024-09-18T12:52:08.685 INFO:tasks.workunit.client.1.smithi161.stdout:4/630: write d5/d32/f53 [2250645,69590] 0 2024-09-18T12:52:08.688 INFO:tasks.workunit.client.1.smithi161.stdout:6/617: truncate d4/d1a/d1c/d3e/d83/d9e/db1/d28/f35 3881002 0 2024-09-18T12:52:08.688 INFO:tasks.workunit.client.1.smithi161.stdout:8/616: dwrite d0/d3/f69 [4194304,4194304] 0 2024-09-18T12:52:08.688 INFO:tasks.workunit.client.1.smithi161.stdout:1/481: write d1/d1d/f21 [180212,129751] 0 2024-09-18T12:52:08.690 INFO:tasks.workunit.client.1.smithi161.stdout:8/617: chown d0/l76 6585 1 2024-09-18T12:52:08.696 INFO:tasks.workunit.client.1.smithi161.stdout:7/547: creat d3/d8/d15/d1a/d24/d31/d7d/f9e x:0 0 0 2024-09-18T12:52:08.698 INFO:tasks.workunit.client.1.smithi161.stdout:1/482: mknod d1/d26/c9c 0 2024-09-18T12:52:08.699 INFO:tasks.workunit.client.1.smithi161.stdout:9/518: creat d0/d16/fa6 x:0 0 0 2024-09-18T12:52:08.699 INFO:tasks.workunit.client.1.smithi161.stdout:5/541: symlink d3/d14/d8d/dab/lad 0 2024-09-18T12:52:08.701 INFO:tasks.workunit.client.1.smithi161.stdout:8/618: unlink d0/d3/d91/cb0 0 2024-09-18T12:52:08.702 INFO:tasks.workunit.client.1.smithi161.stdout:7/548: dwrite d3/d8/d15/f1e [0,4194304] 0 2024-09-18T12:52:08.703 INFO:tasks.workunit.client.1.smithi161.stdout:0/610: unlink df/d29/d36/c60 0 2024-09-18T12:52:08.704 INFO:tasks.workunit.client.1.smithi161.stdout:0/611: stat df/d29/d36/d94 0 2024-09-18T12:52:08.707 INFO:tasks.workunit.client.1.smithi161.stdout:9/519: rmdir d0/d47/d48/d88 39 2024-09-18T12:52:08.709 INFO:tasks.workunit.client.1.smithi161.stdout:3/592: getdents d1/d2e/d24 0 2024-09-18T12:52:08.709 INFO:tasks.workunit.client.1.smithi161.stdout:5/542: creat d3/d44/d6f/d86/fae x:0 0 0 2024-09-18T12:52:08.710 INFO:tasks.workunit.client.1.smithi161.stdout:8/619: dwrite d0/d3/d10/d21/fb6 [0,4194304] 0 2024-09-18T12:52:08.712 INFO:tasks.workunit.client.1.smithi161.stdout:4/631: creat d5/d14/fdc x:0 0 0 2024-09-18T12:52:08.717 INFO:tasks.workunit.client.1.smithi161.stdout:1/483: rename d1/da/d1f/d45/d89 to d1/da/d9d 0 2024-09-18T12:52:08.718 INFO:tasks.workunit.client.1.smithi161.stdout:2/628: dwrite d0/d71/da9/fd7 [0,4194304] 0 2024-09-18T12:52:08.722 INFO:tasks.workunit.client.1.smithi161.stdout:4/632: dwrite d5/d32/d39/d4d/f96 [4194304,4194304] 0 2024-09-18T12:52:08.723 INFO:tasks.workunit.client.1.smithi161.stdout:4/633: chown d5/d27/d44/f88 515136230 1 2024-09-18T12:52:08.725 INFO:tasks.workunit.client.1.smithi161.stdout:7/549: rename d3/d8/d15/d38 to d3/d8/d15/d1a/d4a/d64/d8c/d9f 0 2024-09-18T12:52:08.726 INFO:tasks.workunit.client.1.smithi161.stdout:1/484: creat d1/d26/d3a/f9e x:0 0 0 2024-09-18T12:52:08.728 INFO:tasks.workunit.client.1.smithi161.stdout:6/618: write d4/d1a/d1c/d3e/d83/d9e/db1/d28/f3b [83226,63716] 0 2024-09-18T12:52:08.733 INFO:tasks.workunit.client.1.smithi161.stdout:0/612: dread df/d30/d71/d96/dd3/d90/d37/f42 [0,4194304] 0 2024-09-18T12:52:08.733 INFO:tasks.workunit.client.1.smithi161.stdout:3/593: rename d1/d2e/d14/d2c/fb7 to d1/d2e/d24/d1d/d89/fc7 0 2024-09-18T12:52:08.733 INFO:tasks.workunit.client.0.smithi045.stdout:1/294: sync 2024-09-18T12:52:08.734 INFO:tasks.workunit.client.1.smithi161.stdout:8/620: write d0/d3/d10/d21/d4a/d52/d66/f71 [717740,78869] 0 2024-09-18T12:52:08.734 INFO:tasks.workunit.client.1.smithi161.stdout:1/485: symlink d1/da/d39/l9f 0 2024-09-18T12:52:08.735 INFO:tasks.workunit.client.0.smithi045.stdout:1/295: creat d0/d2e/f58 x:0 0 0 2024-09-18T12:52:08.739 INFO:tasks.workunit.client.1.smithi161.stdout:2/629: rename d0/d1/l2b to d0/d4/lda 0 2024-09-18T12:52:08.741 INFO:tasks.workunit.client.1.smithi161.stdout:4/634: dwrite d5/d32/d39/d4d/f96 [8388608,4194304] 0 2024-09-18T12:52:08.742 INFO:tasks.workunit.client.0.smithi045.stdout:1/296: dwrite d0/d2d/d2b/d30/f4f [0,4194304] 0 2024-09-18T12:52:08.742 INFO:tasks.workunit.client.1.smithi161.stdout:1/486: creat d1/da/d39/fa0 x:0 0 0 2024-09-18T12:52:08.744 INFO:tasks.workunit.client.0.smithi045.stdout:1/297: write d0/d2d/d2b/d30/f47 [303448,95688] 0 2024-09-18T12:52:08.744 INFO:tasks.workunit.client.1.smithi161.stdout:0/613: rename lb to df/d30/d71/d96/dd3/d78/ldd 0 2024-09-18T12:52:08.746 INFO:tasks.workunit.client.0.smithi045.stdout:1/298: dread - d0/d2d/d4c/f51 zero size 2024-09-18T12:52:08.746 INFO:tasks.workunit.client.1.smithi161.stdout:2/630: rmdir d0/d5/d43/d35/d98 39 2024-09-18T12:52:08.746 INFO:tasks.workunit.client.1.smithi161.stdout:5/543: dread d3/fa0 [0,4194304] 0 2024-09-18T12:52:08.750 INFO:tasks.workunit.client.1.smithi161.stdout:3/594: dwrite d1/d2e/d24/d1d/f5d [0,4194304] 0 2024-09-18T12:52:08.751 INFO:tasks.workunit.client.1.smithi161.stdout:2/631: write d0/d5/d53/f81 [2426425,52704] 0 2024-09-18T12:52:08.755 INFO:tasks.workunit.client.0.smithi045.stdout:1/299: dwrite d0/d2d/f53 [0,4194304] 0 2024-09-18T12:52:08.756 INFO:tasks.workunit.client.1.smithi161.stdout:6/619: rename d4/d61/d69/da0/dab/ccb to d4/d1a/d1c/d3e/d83/d9e/db1/d45/ccc 0 2024-09-18T12:52:08.756 INFO:tasks.workunit.client.1.smithi161.stdout:1/487: dread d1/da/d39/f37 [4194304,4194304] 0 2024-09-18T12:52:08.758 INFO:tasks.workunit.client.1.smithi161.stdout:2/632: mkdir d0/d71/ddb 0 2024-09-18T12:52:08.760 INFO:tasks.workunit.client.0.smithi045.stdout:1/300: write d0/d12/d32/d37/f43 [923141,71283] 0 2024-09-18T12:52:08.760 INFO:tasks.workunit.client.1.smithi161.stdout:0/614: dwrite df/d30/d71/d96/dd3/d51/f66 [0,4194304] 0 2024-09-18T12:52:08.762 INFO:tasks.workunit.client.0.smithi045.stdout:1/301: mknod d0/d2d/d2b/d30/c59 0 2024-09-18T12:52:08.763 INFO:tasks.workunit.client.1.smithi161.stdout:6/620: creat d4/d1a/d1c/d3e/fcd x:0 0 0 2024-09-18T12:52:08.765 INFO:tasks.workunit.client.0.smithi045.stdout:1/302: mknod d0/d2d/d4c/c5a 0 2024-09-18T12:52:08.766 INFO:tasks.workunit.client.0.smithi045.stdout:1/303: truncate d0/d2d/f53 4460150 0 2024-09-18T12:52:08.767 INFO:tasks.workunit.client.1.smithi161.stdout:0/615: read df/d29/f3b [6663127,93598] 0 2024-09-18T12:52:08.767 INFO:tasks.workunit.client.1.smithi161.stdout:0/616: chown df/d29/f62 825 1 2024-09-18T12:52:08.770 INFO:tasks.workunit.client.1.smithi161.stdout:2/633: getdents d0/d71/ddb 0 2024-09-18T12:52:08.774 INFO:tasks.workunit.client.1.smithi161.stdout:5/544: dread d3/d3b/d7b/d82/fa9 [0,4194304] 0 2024-09-18T12:52:08.774 INFO:tasks.workunit.client.0.smithi045.stdout:1/304: dwrite d0/d2e/f58 [0,4194304] 0 2024-09-18T12:52:08.775 INFO:tasks.workunit.client.1.smithi161.stdout:4/635: write d5/d14/d67/dc7/f80 [324408,115085] 0 2024-09-18T12:52:08.775 INFO:tasks.workunit.client.1.smithi161.stdout:8/621: dread d0/d3/d10/d21/d4a/f4f [0,4194304] 0 2024-09-18T12:52:08.778 INFO:tasks.workunit.client.1.smithi161.stdout:6/621: dwrite d4/d61/d69/f9a [0,4194304] 0 2024-09-18T12:52:08.779 INFO:tasks.workunit.client.0.smithi045.stdout:1/305: mkdir d0/d2d/d2b/d30/d3d/d5b 0 2024-09-18T12:52:08.782 INFO:tasks.workunit.client.1.smithi161.stdout:0/617: write df/d30/d4d/d92/d95/dc5/d8a/fc6 [769181,15158] 0 2024-09-18T12:52:08.782 INFO:tasks.workunit.client.0.smithi045.stdout:1/306: mkdir d0/d2e/d5c 0 2024-09-18T12:52:08.784 INFO:tasks.workunit.client.1.smithi161.stdout:0/618: fsync df/d29/f8d 0 2024-09-18T12:52:08.785 INFO:tasks.workunit.client.1.smithi161.stdout:4/636: symlink d5/d32/dd8/ldd 0 2024-09-18T12:52:08.786 INFO:tasks.workunit.client.1.smithi161.stdout:2/634: dread d0/d4/f2a [0,4194304] 0 2024-09-18T12:52:08.786 INFO:tasks.workunit.client.1.smithi161.stdout:6/622: dread - d4/d1a/d1c/d3e/d83/d9e/db1/d28/f37 zero size 2024-09-18T12:52:08.788 INFO:tasks.workunit.client.1.smithi161.stdout:0/619: stat df/d30/d4d 0 2024-09-18T12:52:08.789 INFO:tasks.workunit.client.1.smithi161.stdout:5/545: getdents d3/d44/d6f 0 2024-09-18T12:52:08.792 INFO:tasks.workunit.client.1.smithi161.stdout:8/622: dwrite d0/f7a [0,4194304] 0 2024-09-18T12:52:08.793 INFO:tasks.workunit.client.1.smithi161.stdout:2/635: creat d0/d1/d3b/d3d/fdc x:0 0 0 2024-09-18T12:52:08.793 INFO:tasks.workunit.client.1.smithi161.stdout:3/595: dread d1/d2e/d3d/f38 [0,4194304] 0 2024-09-18T12:52:08.795 INFO:tasks.workunit.client.1.smithi161.stdout:6/623: creat d4/d61/d9d/da3/fce x:0 0 0 2024-09-18T12:52:08.796 INFO:tasks.workunit.client.1.smithi161.stdout:3/596: symlink d1/d2e/lc8 0 2024-09-18T12:52:08.796 INFO:tasks.workunit.client.1.smithi161.stdout:5/546: mkdir d3/d9/d4b/d8e/d46/da4/daf 0 2024-09-18T12:52:08.798 INFO:tasks.workunit.client.1.smithi161.stdout:5/547: write d3/d3b/f98 [541339,26456] 0 2024-09-18T12:52:08.799 INFO:tasks.workunit.client.0.smithi045.stdout:1/307: dread d0/d2d/d2b/d30/f48 [0,4194304] 0 2024-09-18T12:52:08.800 INFO:tasks.workunit.client.1.smithi161.stdout:8/623: creat d0/d3/d10/d21/d4a/d52/d82/d8b/fcb x:0 0 0 2024-09-18T12:52:08.803 INFO:tasks.workunit.client.1.smithi161.stdout:6/624: symlink d4/d1a/d1c/d3e/d83/d9e/db1/d28/lcf 0 2024-09-18T12:52:08.804 INFO:tasks.workunit.client.1.smithi161.stdout:8/624: creat d0/d3/d10/fcc x:0 0 0 2024-09-18T12:52:08.804 INFO:tasks.workunit.client.0.smithi045.stdout:1/308: symlink d0/d2d/d2b/d30/d3d/d5b/l5d 0 2024-09-18T12:52:08.805 INFO:tasks.workunit.client.0.smithi045.stdout:1/309: fdatasync d0/d2d/d2b/d30/f48 0 2024-09-18T12:52:08.806 INFO:tasks.workunit.client.1.smithi161.stdout:8/625: write d0/d3/d10/d21/d4a/d52/d82/d96/fa3 [572593,48246] 0 2024-09-18T12:52:08.807 INFO:tasks.workunit.client.1.smithi161.stdout:5/548: truncate d3/d14/d20/f3c 261135 0 2024-09-18T12:52:08.808 INFO:tasks.workunit.client.0.smithi045.stdout:1/310: rmdir d0 39 2024-09-18T12:52:08.813 INFO:tasks.workunit.client.0.smithi045.stdout:1/311: symlink d0/l5e 0 2024-09-18T12:52:08.813 INFO:tasks.workunit.client.1.smithi161.stdout:4/637: dread d5/d32/f42 [0,4194304] 0 2024-09-18T12:52:08.815 INFO:tasks.workunit.client.1.smithi161.stdout:8/626: getdents d0/d3/d10/d21/d4a/d52/d66 0 2024-09-18T12:52:08.815 INFO:tasks.workunit.client.1.smithi161.stdout:0/620: dread df/f15 [0,4194304] 0 2024-09-18T12:52:08.817 INFO:tasks.workunit.client.1.smithi161.stdout:4/638: symlink d5/lde 0 2024-09-18T12:52:08.818 INFO:tasks.workunit.client.1.smithi161.stdout:8/627: readlink d0/d3/d10/d21/l74 0 2024-09-18T12:52:08.818 INFO:tasks.workunit.client.1.smithi161.stdout:6/625: write d4/d61/d69/da0/dab/fb3 [501367,72651] 0 2024-09-18T12:52:08.819 INFO:tasks.workunit.client.1.smithi161.stdout:0/621: mkdir df/d29/d36/dde 0 2024-09-18T12:52:08.819 INFO:tasks.workunit.client.0.smithi045.stdout:1/312: dwrite d0/d12/f15 [4194304,4194304] 0 2024-09-18T12:52:08.821 INFO:tasks.workunit.client.1.smithi161.stdout:2/636: dwrite d0/d1/d4c/d67/db9/dcb/d8a/fbb [0,4194304] 0 2024-09-18T12:52:08.821 INFO:tasks.workunit.client.1.smithi161.stdout:8/628: chown d0/d3/d10/d21/d4a/d52/d94 89 1 2024-09-18T12:52:08.821 INFO:tasks.workunit.client.1.smithi161.stdout:6/626: chown d4/d39/d26/d31/d76/f9c 5 1 2024-09-18T12:52:08.826 INFO:tasks.workunit.client.1.smithi161.stdout:2/637: mkdir d0/d5/d43/d23/ddd 0 2024-09-18T12:52:08.828 INFO:tasks.workunit.client.0.smithi045.stdout:1/313: getdents d0/d12/d32 0 2024-09-18T12:52:08.828 INFO:tasks.workunit.client.1.smithi161.stdout:6/627: rmdir d4/d1a/d1c/d7c 39 2024-09-18T12:52:08.829 INFO:tasks.workunit.client.0.smithi045.stdout:1/314: dread - d0/d2d/d2b/d30/d3d/f4e zero size 2024-09-18T12:52:08.829 INFO:tasks.workunit.client.1.smithi161.stdout:4/639: write d5/d32/f45 [2314096,42775] 0 2024-09-18T12:52:08.831 INFO:tasks.workunit.client.1.smithi161.stdout:2/638: unlink d0/d5/d43/d35/l6c 0 2024-09-18T12:52:08.833 INFO:tasks.workunit.client.1.smithi161.stdout:0/622: dwrite df/f2b [0,4194304] 0 2024-09-18T12:52:08.833 INFO:tasks.workunit.client.1.smithi161.stdout:8/629: rename d0/d3/d10/d21/d4a/d52/d82/f80 to d0/d3/fcd 0 2024-09-18T12:52:08.834 INFO:tasks.workunit.client.1.smithi161.stdout:6/628: fdatasync d4/d1a/d1c/d3e/d83/d9e/db1/d28/f4b 0 2024-09-18T12:52:08.836 INFO:tasks.workunit.client.1.smithi161.stdout:4/640: creat d5/d14/d67/dc7/d47/d49/d7b/fdf x:0 0 0 2024-09-18T12:52:08.836 INFO:tasks.workunit.client.1.smithi161.stdout:0/623: chown df/d30/d71/d96/dd3/d78 118679376 1 2024-09-18T12:52:08.836 INFO:tasks.workunit.client.1.smithi161.stdout:2/639: mknod d0/d1/d3b/d3d/d4f/d9b/cde 0 2024-09-18T12:52:08.839 INFO:tasks.workunit.client.1.smithi161.stdout:6/629: truncate d4/f6b 4615340 0 2024-09-18T12:52:08.839 INFO:tasks.workunit.client.1.smithi161.stdout:2/640: rmdir d0/d71/da9 39 2024-09-18T12:52:08.839 INFO:tasks.workunit.client.1.smithi161.stdout:9/520: sync 2024-09-18T12:52:08.842 INFO:tasks.workunit.client.1.smithi161.stdout:4/641: write d5/d14/d67/dc7/d47/dbc/fcc [1655668,15919] 0 2024-09-18T12:52:08.842 INFO:tasks.workunit.client.1.smithi161.stdout:9/521: mknod d0/d47/ca7 0 2024-09-18T12:52:08.845 INFO:tasks.workunit.client.1.smithi161.stdout:7/550: sync 2024-09-18T12:52:08.846 INFO:tasks.workunit.client.1.smithi161.stdout:2/641: rename d0/d4/d52 to d0/d5/d43/d35/d98/ddf 0 2024-09-18T12:52:08.847 INFO:tasks.workunit.client.1.smithi161.stdout:0/624: dwrite df/f2b [0,4194304] 0 2024-09-18T12:52:08.847 INFO:tasks.workunit.client.1.smithi161.stdout:6/630: truncate d4/d1a/d1c/d3e/d83/d9e/db1/d28/d81/fbf 589406 0 2024-09-18T12:52:08.852 INFO:tasks.workunit.client.1.smithi161.stdout:0/625: symlink df/d30/d4d/d92/d95/dc5/d86/da5/ldf 0 2024-09-18T12:52:08.854 INFO:tasks.workunit.client.1.smithi161.stdout:0/626: chown df/d30/d4d/d92/d95/dc5/fdb 833379 1 2024-09-18T12:52:08.854 INFO:tasks.workunit.client.1.smithi161.stdout:9/522: dwrite d0/d16/d25/d46/d53/f72 [0,4194304] 0 2024-09-18T12:52:08.855 INFO:tasks.workunit.client.1.smithi161.stdout:9/523: read - d0/d20/d74/f97 zero size 2024-09-18T12:52:08.858 INFO:tasks.workunit.client.1.smithi161.stdout:9/524: unlink d0/d16/d25/d28/l3a 0 2024-09-18T12:52:08.883 INFO:tasks.workunit.client.1.smithi161.stdout:0/627: dread df/f50 [0,4194304] 0 2024-09-18T12:52:08.893 INFO:tasks.workunit.client.1.smithi161.stdout:4/642: read d5/d27/d44/f5a [686510,79316] 0 2024-09-18T12:52:08.897 INFO:tasks.workunit.client.1.smithi161.stdout:9/525: rename d0/d16/d25/d46/d53/d59/l90 to d0/d16/d25/d46/d53/la8 0 2024-09-18T12:52:08.904 INFO:tasks.workunit.client.1.smithi161.stdout:6/631: dread d4/d39/d3a/f3f [0,4194304] 0 2024-09-18T12:52:08.924 INFO:tasks.workunit.client.1.smithi161.stdout:1/488: sync 2024-09-18T12:52:08.924 INFO:tasks.workunit.client.1.smithi161.stdout:1/489: chown d1/d26/d3a/c65 18 1 2024-09-18T12:52:08.926 INFO:tasks.workunit.client.1.smithi161.stdout:1/490: dread d1/d26/f2e [0,4194304] 0 2024-09-18T12:52:08.926 INFO:tasks.workunit.client.1.smithi161.stdout:1/491: chown d1/da/f16 4 1 2024-09-18T12:52:08.936 INFO:tasks.workunit.client.0.smithi045.stdout:1/315: rename d0/d2d/d4c/c4d to d0/d2d/d4c/c5f 0 2024-09-18T12:52:08.944 INFO:tasks.workunit.client.1.smithi161.stdout:4/643: chown d5/fc 1887 1 2024-09-18T12:52:08.945 INFO:tasks.workunit.client.1.smithi161.stdout:8/630: write d0/d3/d10/d21/d4a/d52/d82/d96/f61 [696191,50184] 0 2024-09-18T12:52:08.945 INFO:tasks.workunit.client.1.smithi161.stdout:4/644: chown d5/d14/c65 3 1 2024-09-18T12:52:08.945 INFO:tasks.workunit.client.1.smithi161.stdout:4/645: stat d5/d27/d44/l6a 0 2024-09-18T12:52:08.946 INFO:tasks.workunit.client.1.smithi161.stdout:8/631: stat d0/d3/d10/d21/d4a/d52/d82/d8b 0 2024-09-18T12:52:08.946 INFO:tasks.workunit.client.1.smithi161.stdout:4/646: dread - d5/d27/f81 zero size 2024-09-18T12:52:08.948 INFO:tasks.workunit.client.1.smithi161.stdout:4/647: truncate d5/d14/d67/dc7/d47/dbc/fcc 2344356 0 2024-09-18T12:52:08.948 INFO:tasks.workunit.client.1.smithi161.stdout:9/526: symlink d0/d93/la9 0 2024-09-18T12:52:08.949 INFO:tasks.workunit.client.1.smithi161.stdout:4/648: fsync d5/d14/d67/dc7/d47/d49/d7b/fdf 0 2024-09-18T12:52:08.954 INFO:tasks.workunit.client.1.smithi161.stdout:1/492: symlink d1/da/d1f/d45/d73/la1 0 2024-09-18T12:52:08.955 INFO:tasks.workunit.client.1.smithi161.stdout:4/649: dwrite d5/d27/d44/d61/d6c/fd1 [0,4194304] 0 2024-09-18T12:52:08.956 INFO:tasks.workunit.client.1.smithi161.stdout:5/549: sync 2024-09-18T12:52:08.957 INFO:tasks.workunit.client.1.smithi161.stdout:7/551: sync 2024-09-18T12:52:08.957 INFO:tasks.workunit.client.1.smithi161.stdout:3/597: sync 2024-09-18T12:52:08.957 INFO:tasks.workunit.client.1.smithi161.stdout:1/493: truncate d1/da/f18 4280815 0 2024-09-18T12:52:08.959 INFO:tasks.workunit.client.1.smithi161.stdout:1/494: stat d1/da/d1f/f2c 0 2024-09-18T12:52:08.962 INFO:tasks.workunit.client.1.smithi161.stdout:2/642: dwrite d0/f75 [0,4194304] 0 2024-09-18T12:52:08.963 INFO:tasks.workunit.client.1.smithi161.stdout:7/552: truncate d3/d8/d15/d1a/d4a/d59/f69 4656350 0 2024-09-18T12:52:08.963 INFO:tasks.workunit.client.1.smithi161.stdout:2/643: fsync d0/d5/d43/f37 0 2024-09-18T12:52:08.965 INFO:tasks.workunit.client.1.smithi161.stdout:4/650: dwrite d5/d27/d44/f88 [0,4194304] 0 2024-09-18T12:52:08.974 INFO:tasks.workunit.client.1.smithi161.stdout:3/598: creat d1/d2e/d68/d69/fc9 x:0 0 0 2024-09-18T12:52:08.976 INFO:tasks.workunit.client.1.smithi161.stdout:7/553: symlink d3/d8/d15/d1a/d24/d31/d7d/la0 0 2024-09-18T12:52:08.978 INFO:tasks.workunit.client.1.smithi161.stdout:7/554: truncate d3/d8/d15/d1a/d4a/d64/d8c/d9f/d4d/f94 261904 0 2024-09-18T12:52:08.978 INFO:tasks.workunit.client.1.smithi161.stdout:4/651: truncate d5/d27/f37 1673056 0 2024-09-18T12:52:08.986 INFO:tasks.workunit.client.1.smithi161.stdout:5/550: dread d3/d14/f80 [0,4194304] 0 2024-09-18T12:52:08.991 INFO:tasks.workunit.client.1.smithi161.stdout:5/551: mkdir d3/d14/d8d/db0 0 2024-09-18T12:52:08.992 INFO:tasks.workunit.client.1.smithi161.stdout:5/552: chown d3/d14/d20 312 1 2024-09-18T12:52:08.992 INFO:tasks.workunit.client.1.smithi161.stdout:5/553: readlink d3/d9/d4b/laa 0 2024-09-18T12:52:08.994 INFO:tasks.workunit.client.1.smithi161.stdout:5/554: symlink d3/d44/lb1 0 2024-09-18T12:52:08.997 INFO:tasks.workunit.client.1.smithi161.stdout:5/555: dread - d3/d9/d4b/d8e/d24/f7d zero size 2024-09-18T12:52:08.999 INFO:tasks.workunit.client.1.smithi161.stdout:5/556: chown d3/d9/d4b/d8e/c31 63166547 1 2024-09-18T12:52:09.004 INFO:tasks.workunit.client.1.smithi161.stdout:5/557: dwrite d3/d3b/d7b/d82/f9d [0,4194304] 0 2024-09-18T12:52:09.020 INFO:tasks.workunit.client.1.smithi161.stdout:5/558: dread d3/f6a [0,4194304] 0 2024-09-18T12:52:09.027 INFO:tasks.workunit.client.1.smithi161.stdout:5/559: dwrite d3/d9/f6e [0,4194304] 0 2024-09-18T12:52:09.029 INFO:tasks.workunit.client.1.smithi161.stdout:5/560: write d3/f6a [4723141,127736] 0 2024-09-18T12:52:09.029 INFO:tasks.workunit.client.1.smithi161.stdout:5/561: write d3/d44/f8c [401752,116098] 0 2024-09-18T12:52:09.033 INFO:tasks.workunit.client.1.smithi161.stdout:5/562: creat d3/d9/d4b/d8e/d46/da4/daf/fb2 x:0 0 0 2024-09-18T12:52:09.044 INFO:tasks.workunit.client.1.smithi161.stdout:6/632: dwrite d4/d1a/f1b [0,4194304] 0 2024-09-18T12:52:09.045 INFO:tasks.workunit.client.1.smithi161.stdout:8/632: dwrite d0/d3/d10/f42 [0,4194304] 0 2024-09-18T12:52:09.047 INFO:tasks.workunit.client.1.smithi161.stdout:6/633: mknod d4/d1a/d1c/d3e/d4d/cd0 0 2024-09-18T12:52:09.049 INFO:tasks.workunit.client.1.smithi161.stdout:1/495: rmdir d1/da/d31 39 2024-09-18T12:52:09.049 INFO:tasks.workunit.client.1.smithi161.stdout:6/634: dread - d4/f71 zero size 2024-09-18T12:52:09.053 INFO:tasks.workunit.client.1.smithi161.stdout:1/496: creat d1/da/d9d/fa2 x:0 0 0 2024-09-18T12:52:09.054 INFO:tasks.workunit.client.1.smithi161.stdout:8/633: dwrite d0/d3/d10/d21/d4a/d52/d82/d96/d98/f90 [0,4194304] 0 2024-09-18T12:52:09.056 INFO:tasks.workunit.client.1.smithi161.stdout:1/497: write d1/d26/d3a/f7b [762537,37638] 0 2024-09-18T12:52:09.056 INFO:tasks.workunit.client.1.smithi161.stdout:2/644: truncate d0/d5/d43/d35/d98/ddf/d8b/f8c 2907267 0 2024-09-18T12:52:09.059 INFO:tasks.workunit.client.1.smithi161.stdout:2/645: dread - d0/d5/d43/fba zero size 2024-09-18T12:52:09.060 INFO:tasks.workunit.client.1.smithi161.stdout:6/635: dwrite d4/d39/d26/fb2 [0,4194304] 0 2024-09-18T12:52:09.063 INFO:tasks.workunit.client.1.smithi161.stdout:6/636: truncate d4/d39/f80 429101 0 2024-09-18T12:52:09.065 INFO:tasks.workunit.client.1.smithi161.stdout:8/634: creat d0/d3/d10/d21/fce x:0 0 0 2024-09-18T12:52:09.069 INFO:tasks.workunit.client.1.smithi161.stdout:2/646: creat d0/d1/fe0 x:0 0 0 2024-09-18T12:52:09.070 INFO:tasks.workunit.client.1.smithi161.stdout:1/498: dwrite d1/da/d1f/d45/d73/f87 [0,4194304] 0 2024-09-18T12:52:09.071 INFO:tasks.workunit.client.1.smithi161.stdout:6/637: mknod d4/d39/d47/cd1 0 2024-09-18T12:52:09.071 INFO:tasks.workunit.client.1.smithi161.stdout:2/647: write d0/d4/d78/fae [307857,13006] 0 2024-09-18T12:52:09.073 INFO:tasks.workunit.client.1.smithi161.stdout:6/638: chown d4/d1a/d1c/d3e/d83/d9e/db1/d28/c2f 13204148 1 2024-09-18T12:52:09.074 INFO:tasks.workunit.client.1.smithi161.stdout:1/499: creat d1/d26/d88/fa3 x:0 0 0 2024-09-18T12:52:09.075 INFO:tasks.workunit.client.1.smithi161.stdout:1/500: stat d1/da/d39/l4a 0 2024-09-18T12:52:09.077 INFO:tasks.workunit.client.1.smithi161.stdout:1/501: mknod d1/d26/d88/ca4 0 2024-09-18T12:52:09.082 INFO:tasks.workunit.client.0.smithi045.stdout:1/316: unlink d0/d12/f15 0 2024-09-18T12:52:09.083 INFO:tasks.workunit.client.1.smithi161.stdout:1/502: dwrite d1/d26/d3a/f7b [0,4194304] 0 2024-09-18T12:52:09.104 INFO:tasks.workunit.client.1.smithi161.stdout:6/639: dread d4/d39/d3a/f6d [0,4194304] 0 2024-09-18T12:52:09.172 INFO:tasks.workunit.client.1.smithi161.stdout:8/635: sync 2024-09-18T12:52:09.194 INFO:tasks.workunit.client.0.smithi045.stdout:1/317: mkdir d0/d2d/d2b/d30/d40/d60 0 2024-09-18T12:52:09.194 INFO:tasks.workunit.client.0.smithi045.stdout:1/318: fdatasync d0/f7 0 2024-09-18T12:52:09.195 INFO:tasks.workunit.client.1.smithi161.stdout:1/503: mknod d1/d48/ca5 0 2024-09-18T12:52:09.198 INFO:tasks.workunit.client.1.smithi161.stdout:1/504: mkdir d1/d26/da6 0 2024-09-18T12:52:09.198 INFO:tasks.workunit.client.1.smithi161.stdout:1/505: chown d1/d26/c11 45 1 2024-09-18T12:52:09.200 INFO:tasks.workunit.client.0.smithi045.stdout:1/319: rename d0/d2e/d46 to d0/d2d/d2b/d30/d40/d61 0 2024-09-18T12:52:09.202 INFO:tasks.workunit.client.1.smithi161.stdout:9/527: unlink d0/d16/d25/d46/f99 0 2024-09-18T12:52:09.203 INFO:tasks.workunit.client.0.smithi045.stdout:1/320: creat d0/d12/f62 x:0 0 0 2024-09-18T12:52:09.204 INFO:tasks.workunit.client.1.smithi161.stdout:0/628: rename df/dd7 to df/d30/d71/d96/dd3/d90/d37/de0 0 2024-09-18T12:52:09.206 INFO:tasks.workunit.client.0.smithi045.stdout:1/321: unlink d0/d2e/f50 0 2024-09-18T12:52:09.207 INFO:tasks.workunit.client.1.smithi161.stdout:1/506: mknod d1/d1d/ca7 0 2024-09-18T12:52:09.209 INFO:tasks.workunit.client.0.smithi045.stdout:1/322: write d0/d2d/f34 [1506886,13418] 0 2024-09-18T12:52:09.211 INFO:tasks.workunit.client.1.smithi161.stdout:3/599: rename d1/d2e/d14/d65/d76/d8c/d9d/fbb to d1/d2e/d68/d69/d7d/fca 0 2024-09-18T12:52:09.213 INFO:tasks.workunit.client.1.smithi161.stdout:0/629: unlink df/d30/d4d/f76 0 2024-09-18T12:52:09.214 INFO:tasks.workunit.client.1.smithi161.stdout:6/640: link d4/d1a/d1c/d3e/d83/d9e/db1/d45/d68/c79 d4/d1a/d1c/d3e/cd2 0 2024-09-18T12:52:09.215 INFO:tasks.workunit.client.1.smithi161.stdout:2/648: sync 2024-09-18T12:52:09.217 INFO:tasks.workunit.client.1.smithi161.stdout:3/600: dwrite d1/d2e/d14/d90/fbf [4194304,4194304] 0 2024-09-18T12:52:09.218 INFO:tasks.workunit.client.1.smithi161.stdout:6/641: dread d4/d39/d47/f7f [0,4194304] 0 2024-09-18T12:52:09.220 INFO:tasks.workunit.client.0.smithi045.stdout:1/323: link d0/d2d/d2b/d30/c59 d0/d12/d32/c63 0 2024-09-18T12:52:09.222 INFO:tasks.workunit.client.1.smithi161.stdout:4/652: rename d5/d14/fdb to d5/d14/d67/d84/dae/fe0 0 2024-09-18T12:52:09.224 INFO:tasks.workunit.client.1.smithi161.stdout:3/601: dwrite d1/d2e/d3d/f80 [0,4194304] 0 2024-09-18T12:52:09.224 INFO:tasks.workunit.client.0.smithi045.stdout:1/324: mknod d0/d2d/d2b/d30/c64 0 2024-09-18T12:52:09.225 INFO:tasks.workunit.client.0.smithi045.stdout:1/325: read d0/fb [2170437,37635] 0 2024-09-18T12:52:09.226 INFO:tasks.workunit.client.0.smithi045.stdout:1/326: chown d0/d12/d32/c56 215077416 1 2024-09-18T12:52:09.229 INFO:tasks.workunit.client.1.smithi161.stdout:2/649: mkdir d0/d5/d43/d35/d98/de1 0 2024-09-18T12:52:09.235 INFO:tasks.workunit.client.1.smithi161.stdout:6/642: creat d4/d61/fd3 x:0 0 0 2024-09-18T12:52:09.236 INFO:tasks.workunit.client.1.smithi161.stdout:2/650: dwrite d0/d1/d3b/f61 [0,4194304] 0 2024-09-18T12:52:09.238 INFO:tasks.workunit.client.1.smithi161.stdout:7/555: rename d3/d8/d15/d1a/d4a/d64/d8c/d9f/d4d/f98 to d3/d7e/fa1 0 2024-09-18T12:52:09.240 INFO:tasks.workunit.client.1.smithi161.stdout:4/653: rmdir d5/d14/d67/d84 39 2024-09-18T12:52:09.242 INFO:tasks.workunit.client.1.smithi161.stdout:4/654: chown d5/d32/d39/d4d/fd7 3672 1 2024-09-18T12:52:09.242 INFO:tasks.workunit.client.1.smithi161.stdout:9/528: link d0/f1f d0/d16/d25/d46/d53/faa 0 2024-09-18T12:52:09.246 INFO:tasks.workunit.client.1.smithi161.stdout:6/643: mkdir d4/d1a/d1c/d3e/d83/dad/dd4 0 2024-09-18T12:52:09.246 INFO:tasks.workunit.client.1.smithi161.stdout:4/655: dread - d5/d14/d67/dc7/d47/d49/d7b/fdf zero size 2024-09-18T12:52:09.247 INFO:tasks.workunit.client.1.smithi161.stdout:7/556: dwrite d3/d8/d15/f3c [0,4194304] 0 2024-09-18T12:52:09.248 INFO:tasks.workunit.client.1.smithi161.stdout:1/507: write d1/da/f43 [4982543,84807] 0 2024-09-18T12:52:09.251 INFO:tasks.workunit.client.1.smithi161.stdout:5/563: rename d3/d3b/d54/l78 to d3/d8/lb3 0 2024-09-18T12:52:09.252 INFO:tasks.workunit.client.1.smithi161.stdout:8/636: rmdir d0/d3/d10/d21/d4a/d52/db4 0 2024-09-18T12:52:09.252 INFO:tasks.workunit.client.1.smithi161.stdout:5/564: fsync d3/d3b/d54/f96 0 2024-09-18T12:52:09.254 INFO:tasks.workunit.client.1.smithi161.stdout:5/565: chown d3/d9/f6e 294 1 2024-09-18T12:52:09.254 INFO:tasks.workunit.client.1.smithi161.stdout:9/529: dwrite d0/d16/d25/d46/f68 [0,4194304] 0 2024-09-18T12:52:09.255 INFO:tasks.workunit.client.1.smithi161.stdout:8/637: truncate d0/d3/d10/d21/f37 1966878 0 2024-09-18T12:52:09.256 INFO:tasks.workunit.client.0.smithi045.stdout:7/210: sync 2024-09-18T12:52:09.257 INFO:tasks.workunit.client.0.smithi045.stdout:7/211: chown d13/d1a/d28/f3a 4918673 1 2024-09-18T12:52:09.259 INFO:tasks.workunit.client.1.smithi161.stdout:6/644: fsync d4/d39/d3a/f1f 0 2024-09-18T12:52:09.259 INFO:tasks.workunit.client.0.smithi045.stdout:7/212: write d13/d1a/d28/f39 [613174,11467] 0 2024-09-18T12:52:09.267 INFO:tasks.workunit.client.1.smithi161.stdout:1/508: mknod d1/d26/d3a/ca8 0 2024-09-18T12:52:09.269 INFO:tasks.workunit.client.0.smithi045.stdout:1/327: dread d0/fc [0,4194304] 0 2024-09-18T12:52:09.270 INFO:tasks.workunit.client.0.smithi045.stdout:1/328: write d0/d2d/d2b/d30/f4f [3764201,92883] 0 2024-09-18T12:52:09.272 INFO:tasks.workunit.client.0.smithi045.stdout:1/329: chown d0/d2d/d2b/d30/d40/l54 25570256 1 2024-09-18T12:52:09.272 INFO:tasks.workunit.client.1.smithi161.stdout:1/509: dwrite d1/da/d1f/d45/d73/f9a [0,4194304] 0 2024-09-18T12:52:09.274 INFO:tasks.workunit.client.1.smithi161.stdout:2/651: write d0/d5/d43/d35/d98/ddf/fb2 [77473,27111] 0 2024-09-18T12:52:09.276 INFO:tasks.workunit.client.1.smithi161.stdout:2/652: chown d0/d5/d43/d35/d98/fd9 1232459998 1 2024-09-18T12:52:09.278 INFO:tasks.workunit.client.1.smithi161.stdout:7/557: mknod d3/d8/ca2 0 2024-09-18T12:52:09.280 INFO:tasks.workunit.client.1.smithi161.stdout:6/645: creat d4/d1a/d1c/d3e/d83/da2/fd5 x:0 0 0 2024-09-18T12:52:09.282 INFO:tasks.workunit.client.1.smithi161.stdout:4/656: mkdir d5/d14/d67/dc7/d60/d95/dda/de1 0 2024-09-18T12:52:09.285 INFO:tasks.workunit.client.1.smithi161.stdout:5/566: write d3/d3b/d7b/d82/fa9 [613211,60978] 0 2024-09-18T12:52:09.286 INFO:tasks.workunit.client.1.smithi161.stdout:5/567: read d3/d9/d4b/d8e/d24/f36 [494621,61241] 0 2024-09-18T12:52:09.287 INFO:tasks.workunit.client.1.smithi161.stdout:3/602: link d1/d2e/d3d/c86 d1/d2e/d24/d1d/d89/db0/ccb 0 2024-09-18T12:52:09.287 INFO:tasks.workunit.client.1.smithi161.stdout:5/568: read d3/d9/d4b/d8e/d46/f65 [3265531,107207] 0 2024-09-18T12:52:09.288 INFO:tasks.workunit.client.0.smithi045.stdout:7/213: dwrite d13/f24 [4194304,4194304] 0 2024-09-18T12:52:09.288 INFO:tasks.workunit.client.1.smithi161.stdout:5/569: chown d3/d9/f1c 10179 1 2024-09-18T12:52:09.292 INFO:tasks.workunit.client.1.smithi161.stdout:6/646: mkdir d4/d1a/d1c/d3e/d83/d9e/db1/d45/dd6 0 2024-09-18T12:52:09.293 INFO:tasks.workunit.client.1.smithi161.stdout:3/603: dwrite d1/d2e/d14/d90/fbf [0,4194304] 0 2024-09-18T12:52:09.296 INFO:tasks.workunit.client.0.smithi045.stdout:1/330: dwrite d0/fb [4194304,4194304] 0 2024-09-18T12:52:09.297 INFO:tasks.workunit.client.1.smithi161.stdout:4/657: rename d5/d14/d67/dc7/d60/d8a to d5/d27/d44/de2 0 2024-09-18T12:52:09.299 INFO:tasks.workunit.client.1.smithi161.stdout:9/530: link d0/f24 d0/db/fab 0 2024-09-18T12:52:09.299 INFO:tasks.workunit.client.1.smithi161.stdout:4/658: fdatasync d5/d14/d67/dc7/d47/d49/f85 0 2024-09-18T12:52:09.300 INFO:tasks.workunit.client.0.smithi045.stdout:7/214: truncate d13/d44/f2b 53650 0 2024-09-18T12:52:09.301 INFO:tasks.workunit.client.0.smithi045.stdout:7/215: fdatasync d13/d1a/f45 0 2024-09-18T12:52:09.302 INFO:tasks.workunit.client.1.smithi161.stdout:5/570: dread d3/d14/d20/f32 [0,4194304] 0 2024-09-18T12:52:09.303 INFO:tasks.workunit.client.0.smithi045.stdout:1/331: unlink d0/d2d/d2b/f3f 0 2024-09-18T12:52:09.304 INFO:tasks.workunit.client.1.smithi161.stdout:5/571: write d3/d14/f84 [850511,29675] 0 2024-09-18T12:52:09.305 INFO:tasks.workunit.client.1.smithi161.stdout:8/638: creat d0/d3/d10/d21/d4a/d52/fcf x:0 0 0 2024-09-18T12:52:09.305 INFO:tasks.workunit.client.1.smithi161.stdout:5/572: dread - d3/d3b/d7b/da6/fa8 zero size 2024-09-18T12:52:09.307 INFO:tasks.workunit.client.1.smithi161.stdout:8/639: fsync d0/d3/d10/d21/d4a/d52/d82/d96/f72 0 2024-09-18T12:52:09.309 INFO:tasks.workunit.client.1.smithi161.stdout:8/640: write d0/d3/d10/d21/d4a/d52/f95 [1029665,67732] 0 2024-09-18T12:52:09.309 INFO:tasks.workunit.client.1.smithi161.stdout:2/653: link d0/d5/d53/f5b d0/d1/d3b/d7e/fe2 0 2024-09-18T12:52:09.310 INFO:tasks.workunit.client.0.smithi045.stdout:7/216: dwrite d13/d31/d33/f42 [0,4194304] 0 2024-09-18T12:52:09.311 INFO:tasks.workunit.client.1.smithi161.stdout:3/604: dread d1/d2e/d3d/f7 [0,4194304] 0 2024-09-18T12:52:09.312 INFO:tasks.workunit.client.1.smithi161.stdout:6/647: rmdir d4/d39/d47/d88 39 2024-09-18T12:52:09.313 INFO:tasks.workunit.client.1.smithi161.stdout:7/558: readlink d3/d8/d4b/l72 0 2024-09-18T12:52:09.313 INFO:tasks.workunit.client.1.smithi161.stdout:0/630: sync 2024-09-18T12:52:09.314 INFO:tasks.workunit.client.1.smithi161.stdout:6/648: fdatasync d4/d61/d69/f9a 0 2024-09-18T12:52:09.315 INFO:tasks.workunit.client.1.smithi161.stdout:4/659: mknod d5/d32/d39/d4d/ce3 0 2024-09-18T12:52:09.317 INFO:tasks.workunit.client.0.smithi045.stdout:7/217: symlink d13/l48 0 2024-09-18T12:52:09.321 INFO:tasks.workunit.client.1.smithi161.stdout:5/573: write d3/d14/d8d/f95 [718552,88441] 0 2024-09-18T12:52:09.322 INFO:tasks.workunit.client.1.smithi161.stdout:5/574: read d3/d3b/d54/f5a [4763763,112053] 0 2024-09-18T12:52:09.329 INFO:tasks.workunit.client.0.smithi045.stdout:7/218: link d13/d1a/f41 d13/d1a/f49 0 2024-09-18T12:52:09.330 INFO:tasks.workunit.client.1.smithi161.stdout:8/641: write d0/f2a [4837294,69871] 0 2024-09-18T12:52:09.331 INFO:tasks.workunit.client.1.smithi161.stdout:3/605: fdatasync d1/d2e/d24/f47 0 2024-09-18T12:52:09.335 INFO:tasks.workunit.client.0.smithi045.stdout:1/332: truncate d0/f49 2760311 0 2024-09-18T12:52:09.336 INFO:tasks.workunit.client.1.smithi161.stdout:7/559: rename d3/d8/d15/d1a/d24/d31/f8a to d3/fa3 0 2024-09-18T12:52:09.338 INFO:tasks.workunit.client.0.smithi045.stdout:6/237: sync 2024-09-18T12:52:09.339 INFO:tasks.workunit.client.0.smithi045.stdout:7/219: link d13/f24 d13/d44/d37/f4a 0 2024-09-18T12:52:09.339 INFO:tasks.workunit.client.0.smithi045.stdout:6/238: write d9/d1a/d2d/d38/f3d [1805096,14265] 0 2024-09-18T12:52:09.340 INFO:tasks.workunit.client.1.smithi161.stdout:6/649: symlink d4/d39/d47/d51/ld7 0 2024-09-18T12:52:09.342 INFO:tasks.workunit.client.0.smithi045.stdout:1/333: rename d0/d2d/d2b/d30/f47 to d0/d2d/d2b/d30/f65 0 2024-09-18T12:52:09.344 INFO:tasks.workunit.client.0.smithi045.stdout:7/220: dread d13/d44/d37/f4a [4194304,4194304] 0 2024-09-18T12:52:09.345 INFO:tasks.workunit.client.0.smithi045.stdout:7/221: write f11 [133095,38827] 0 2024-09-18T12:52:09.348 INFO:tasks.workunit.client.1.smithi161.stdout:4/660: creat d5/d32/d39/dbf/fe4 x:0 0 0 2024-09-18T12:52:09.348 INFO:tasks.workunit.client.1.smithi161.stdout:4/661: write d5/d32/f45 [1676579,4753] 0 2024-09-18T12:52:09.350 INFO:tasks.workunit.client.0.smithi045.stdout:6/239: rename d9/d1a/d1d/l1e to d9/d1a/d2d/d32/l50 0 2024-09-18T12:52:09.355 INFO:tasks.workunit.client.1.smithi161.stdout:8/642: mknod d0/d3/d91/cd0 0 2024-09-18T12:52:09.356 INFO:tasks.workunit.client.1.smithi161.stdout:1/510: sync 2024-09-18T12:52:09.358 INFO:tasks.workunit.client.1.smithi161.stdout:3/606: creat d1/d2e/d14/d65/d76/d88/fcc x:0 0 0 2024-09-18T12:52:09.360 INFO:tasks.workunit.client.0.smithi045.stdout:7/222: unlink d13/c21 0 2024-09-18T12:52:09.369 INFO:tasks.workunit.client.1.smithi161.stdout:6/650: rmdir d4/d39/d26/d31 39 2024-09-18T12:52:09.372 INFO:tasks.workunit.client.1.smithi161.stdout:7/560: dwrite d3/d8/f80 [0,4194304] 0 2024-09-18T12:52:09.372 INFO:tasks.workunit.client.1.smithi161.stdout:0/631: creat df/d30/d4d/d92/d95/dc5/d8a/dd1/fe1 x:0 0 0 2024-09-18T12:52:09.373 INFO:tasks.workunit.client.1.smithi161.stdout:3/607: dread d1/d2e/f5b [0,4194304] 0 2024-09-18T12:52:09.375 INFO:tasks.workunit.client.1.smithi161.stdout:3/608: write d1/d2e/d24/d1d/f2a [2501254,111340] 0 2024-09-18T12:52:09.375 INFO:tasks.workunit.client.1.smithi161.stdout:7/561: read d3/d8/d15/d1a/d24/d31/f34 [224151,102388] 0 2024-09-18T12:52:09.375 INFO:tasks.workunit.client.1.smithi161.stdout:4/662: creat d5/d14/d67/dc7/d60/fe5 x:0 0 0 2024-09-18T12:52:09.377 INFO:tasks.workunit.client.0.smithi045.stdout:1/334: rmdir d0/d2e/d5c 0 2024-09-18T12:52:09.379 INFO:tasks.workunit.client.0.smithi045.stdout:1/335: write d0/d2d/f45 [1542228,1981] 0 2024-09-18T12:52:09.381 INFO:tasks.workunit.client.0.smithi045.stdout:7/223: mknod d13/d44/d37/c4b 0 2024-09-18T12:52:09.382 INFO:tasks.workunit.client.1.smithi161.stdout:9/531: sync 2024-09-18T12:52:09.382 INFO:tasks.workunit.client.1.smithi161.stdout:9/532: chown d0/d20/d74/l8a 0 1 2024-09-18T12:52:09.384 INFO:tasks.workunit.client.0.smithi045.stdout:6/240: rename d9/f19 to d9/f51 0 2024-09-18T12:52:09.386 INFO:tasks.workunit.client.1.smithi161.stdout:1/511: mknod d1/d26/d88/ca9 0 2024-09-18T12:52:09.387 INFO:tasks.workunit.client.0.smithi045.stdout:1/336: symlink d0/d2d/d2b/l66 0 2024-09-18T12:52:09.389 INFO:tasks.workunit.client.1.smithi161.stdout:5/575: rename d3/d44/c45 to d3/d3b/d54/cb4 0 2024-09-18T12:52:09.391 INFO:tasks.workunit.client.0.smithi045.stdout:6/241: unlink d9/d1a/c46 0 2024-09-18T12:52:09.392 INFO:tasks.workunit.client.1.smithi161.stdout:6/651: creat d4/d1a/d1c/d3e/d83/fd8 x:0 0 0 2024-09-18T12:52:09.397 INFO:tasks.workunit.client.1.smithi161.stdout:6/652: dwrite d4/d39/d47/d51/f93 [0,4194304] 0 2024-09-18T12:52:09.399 INFO:tasks.workunit.client.0.smithi045.stdout:6/242: symlink d9/d30/l52 0 2024-09-18T12:52:09.400 INFO:tasks.workunit.client.1.smithi161.stdout:4/663: write d5/d32/fbe [1406822,68262] 0 2024-09-18T12:52:09.402 INFO:tasks.workunit.client.1.smithi161.stdout:4/664: chown d5/d32/d39/dbf/lcd 3 1 2024-09-18T12:52:09.402 INFO:tasks.workunit.client.1.smithi161.stdout:4/665: dread - d5/d14/d67/f90 zero size 2024-09-18T12:52:09.405 INFO:tasks.workunit.client.1.smithi161.stdout:2/654: getdents d0/d1/d3b/d3d/d4f/d9b 0 2024-09-18T12:52:09.407 INFO:tasks.workunit.client.1.smithi161.stdout:8/643: unlink d0/d3/d1e/l7f 0 2024-09-18T12:52:09.409 INFO:tasks.workunit.client.0.smithi045.stdout:6/243: creat d9/d1a/d48/f53 x:0 0 0 2024-09-18T12:52:09.411 INFO:tasks.workunit.client.0.smithi045.stdout:6/244: fsync f5 0 2024-09-18T12:52:09.412 INFO:tasks.workunit.client.1.smithi161.stdout:5/576: mknod d3/d44/d6f/cb5 0 2024-09-18T12:52:09.413 INFO:tasks.workunit.client.0.smithi045.stdout:1/337: write d0/fa [520065,19546] 0 2024-09-18T12:52:09.413 INFO:tasks.workunit.client.1.smithi161.stdout:5/577: write d3/d9/d4b/f51 [905502,14993] 0 2024-09-18T12:52:09.416 INFO:tasks.workunit.client.0.smithi045.stdout:7/224: truncate d13/f16 177764 0 2024-09-18T12:52:09.417 INFO:tasks.workunit.client.1.smithi161.stdout:3/609: dread d1/d2e/f6e [0,4194304] 0 2024-09-18T12:52:09.418 INFO:tasks.workunit.client.1.smithi161.stdout:3/610: chown d1/d2e/d14/f58 2605554 1 2024-09-18T12:52:09.418 INFO:tasks.workunit.client.0.smithi045.stdout:1/338: mkdir d0/d12/d32/d67 0 2024-09-18T12:52:09.420 INFO:tasks.workunit.client.0.smithi045.stdout:7/225: mkdir d13/d44/d4c 0 2024-09-18T12:52:09.421 INFO:tasks.workunit.client.0.smithi045.stdout:4/271: sync 2024-09-18T12:52:09.421 INFO:tasks.workunit.client.0.smithi045.stdout:3/284: sync 2024-09-18T12:52:09.421 INFO:tasks.workunit.client.0.smithi045.stdout:5/355: sync 2024-09-18T12:52:09.421 INFO:tasks.workunit.client.0.smithi045.stdout:8/282: sync 2024-09-18T12:52:09.421 INFO:tasks.workunit.client.0.smithi045.stdout:2/315: sync 2024-09-18T12:52:09.422 INFO:tasks.workunit.client.0.smithi045.stdout:9/223: sync 2024-09-18T12:52:09.422 INFO:tasks.workunit.client.0.smithi045.stdout:0/288: sync 2024-09-18T12:52:09.422 INFO:tasks.workunit.client.0.smithi045.stdout:6/245: link d9/l10 d9/d1a/d2d/d32/l54 0 2024-09-18T12:52:09.423 INFO:tasks.workunit.client.0.smithi045.stdout:4/272: write db/f21 [6021553,53985] 0 2024-09-18T12:52:09.424 INFO:tasks.workunit.client.0.smithi045.stdout:8/283: chown d11/d14/l1d 36523 1 2024-09-18T12:52:09.424 INFO:tasks.workunit.client.0.smithi045.stdout:1/339: rmdir d0/d2d/d2b/d30/d40 39 2024-09-18T12:52:09.424 INFO:tasks.workunit.client.1.smithi161.stdout:1/512: mkdir d1/daa 0 2024-09-18T12:52:09.426 INFO:tasks.workunit.client.1.smithi161.stdout:5/578: mknod d3/d3b/d54/cb6 0 2024-09-18T12:52:09.426 INFO:tasks.workunit.client.0.smithi045.stdout:6/246: chown d9/l20 50 1 2024-09-18T12:52:09.426 INFO:tasks.workunit.client.1.smithi161.stdout:6/653: getdents d4/d1a/d1c/d3e/d83/d9e/db1/d45/dd6 0 2024-09-18T12:52:09.427 INFO:tasks.workunit.client.1.smithi161.stdout:6/654: read d4/d39/f80 [150405,32178] 0 2024-09-18T12:52:09.427 INFO:tasks.workunit.client.1.smithi161.stdout:9/533: creat d0/fac x:0 0 0 2024-09-18T12:52:09.428 INFO:tasks.workunit.client.1.smithi161.stdout:9/534: write d0/d20/d49/f15 [1430920,122847] 0 2024-09-18T12:52:09.430 INFO:tasks.workunit.client.1.smithi161.stdout:2/655: link d0/d1/d4c/d67/db9/dcb/d8a/fbb d0/d1/d4c/d67/db9/fe3 0 2024-09-18T12:52:09.433 INFO:tasks.workunit.client.0.smithi045.stdout:0/289: dwrite d6/d7/d21/d23/d3c/f47 [0,4194304] 0 2024-09-18T12:52:09.434 INFO:tasks.workunit.client.0.smithi045.stdout:4/273: creat db/de/d1e/d3e/d47/d59/f5f x:0 0 0 2024-09-18T12:52:09.435 INFO:tasks.workunit.client.0.smithi045.stdout:4/274: fdatasync db/f21 0 2024-09-18T12:52:09.436 INFO:tasks.workunit.client.1.smithi161.stdout:0/632: rename df/d30/d4d/d92/d95 to df/de2 0 2024-09-18T12:52:09.441 INFO:tasks.workunit.client.0.smithi045.stdout:6/247: symlink d9/d1a/d2d/d38/l55 0 2024-09-18T12:52:09.444 INFO:tasks.workunit.client.0.smithi045.stdout:9/224: dwrite d0/d3/d6/d10/d2c/f30 [0,4194304] 0 2024-09-18T12:52:09.446 INFO:tasks.workunit.client.0.smithi045.stdout:7/226: rename d13/d31/d33/f42 to d13/d44/d37/f4d 0 2024-09-18T12:52:09.454 INFO:tasks.workunit.client.0.smithi045.stdout:2/316: chown d5/d3a/d3e/l4a 970635 1 2024-09-18T12:52:09.454 INFO:tasks.workunit.client.0.smithi045.stdout:9/225: dwrite d0/f1a [0,4194304] 0 2024-09-18T12:52:09.457 INFO:tasks.workunit.client.0.smithi045.stdout:3/285: truncate d0/d7/f1d 4190915 0 2024-09-18T12:52:09.461 INFO:tasks.workunit.client.0.smithi045.stdout:1/340: creat d0/d2d/f68 x:0 0 0 2024-09-18T12:52:09.462 INFO:tasks.workunit.client.1.smithi161.stdout:8/644: truncate d0/d3/d10/f57 464600 0 2024-09-18T12:52:09.463 INFO:tasks.workunit.client.1.smithi161.stdout:8/645: chown d0/d3/d10/d21/d4a/d52/d66/c83 0 1 2024-09-18T12:52:09.464 INFO:tasks.workunit.client.0.smithi045.stdout:5/356: creat d6/db/d19/d31/d66/f74 x:0 0 0 2024-09-18T12:52:09.467 INFO:tasks.workunit.client.1.smithi161.stdout:9/535: fdatasync d0/d16/d25/d46/d53/f7c 0 2024-09-18T12:52:09.473 INFO:tasks.workunit.client.1.smithi161.stdout:7/562: rename d3/d36/c76 to d3/d8/d15/d1a/d4a/d64/d8c/ca4 0 2024-09-18T12:52:09.473 INFO:tasks.workunit.client.1.smithi161.stdout:6/655: write d4/d1a/d1c/d3e/d4d/f78 [1173604,5631] 0 2024-09-18T12:52:09.474 INFO:tasks.workunit.client.1.smithi161.stdout:1/513: sync 2024-09-18T12:52:09.474 INFO:tasks.workunit.client.1.smithi161.stdout:8/646: dwrite d0/d3/d10/d21/d4a/d52/d82/fbd [0,4194304] 0 2024-09-18T12:52:09.476 INFO:tasks.workunit.client.1.smithi161.stdout:6/656: write d4/d39/d48/f8b [4528446,39887] 0 2024-09-18T12:52:09.477 INFO:tasks.workunit.client.1.smithi161.stdout:3/611: creat d1/d2e/d24/d1d/fcd x:0 0 0 2024-09-18T12:52:09.477 INFO:tasks.workunit.client.1.smithi161.stdout:1/514: write d1/da/d39/f67 [37856,78318] 0 2024-09-18T12:52:09.478 INFO:tasks.workunit.client.0.smithi045.stdout:8/284: rename d11/d14/d45 to d11/d14/d53/d41/d57 0 2024-09-18T12:52:09.482 INFO:tasks.workunit.client.0.smithi045.stdout:1/341: dread d0/f3a [0,4194304] 0 2024-09-18T12:52:09.484 INFO:tasks.workunit.client.1.smithi161.stdout:8/647: dwrite d0/f2a [0,4194304] 0 2024-09-18T12:52:09.485 INFO:tasks.workunit.client.0.smithi045.stdout:4/275: mknod db/d2c/d35/d40/c60 0 2024-09-18T12:52:09.486 INFO:tasks.workunit.client.1.smithi161.stdout:3/612: dwrite d1/d2e/d14/d65/d76/d8c/f8d [0,4194304] 0 2024-09-18T12:52:09.486 INFO:tasks.workunit.client.0.smithi045.stdout:6/248: mkdir d9/d56 0 2024-09-18T12:52:09.489 INFO:tasks.workunit.client.0.smithi045.stdout:7/227: rename d13/d1a/f45 to d13/d31/d33/f4e 0 2024-09-18T12:52:09.497 INFO:tasks.workunit.client.0.smithi045.stdout:5/357: symlink d6/db/d6a/d6d/l75 0 2024-09-18T12:52:09.498 INFO:tasks.workunit.client.0.smithi045.stdout:0/290: link d6/l31 d6/d35/l52 0 2024-09-18T12:52:09.499 INFO:tasks.workunit.client.0.smithi045.stdout:0/291: chown d6/f2d 132 1 2024-09-18T12:52:09.500 INFO:tasks.workunit.client.0.smithi045.stdout:4/276: unlink db/de/d1e/f42 0 2024-09-18T12:52:09.503 INFO:tasks.workunit.client.0.smithi045.stdout:6/249: rename f3 to d9/d56/f57 0 2024-09-18T12:52:09.505 INFO:tasks.workunit.client.0.smithi045.stdout:5/358: dwrite d6/db/d19/d31/d53/f63 [0,4194304] 0 2024-09-18T12:52:09.506 INFO:tasks.workunit.client.1.smithi161.stdout:2/656: creat d0/d4/dab/fe4 x:0 0 0 2024-09-18T12:52:09.507 INFO:tasks.workunit.client.1.smithi161.stdout:5/579: creat d3/d3b/fb7 x:0 0 0 2024-09-18T12:52:09.507 INFO:tasks.workunit.client.0.smithi045.stdout:2/317: link d5/d2c/c4b d5/d2c/d4d/d33/c71 0 2024-09-18T12:52:09.510 INFO:tasks.workunit.client.0.smithi045.stdout:0/292: fdatasync f4 0 2024-09-18T12:52:09.512 INFO:tasks.workunit.client.0.smithi045.stdout:0/293: write d6/d7/d21/d23/f25 [1288746,80208] 0 2024-09-18T12:52:09.512 INFO:tasks.workunit.client.1.smithi161.stdout:4/666: rename d5/d14/d67/fad to d5/da9/db9/fe6 0 2024-09-18T12:52:09.513 INFO:tasks.workunit.client.0.smithi045.stdout:0/294: chown d6/d7/d21/l2a 14955721 1 2024-09-18T12:52:09.513 INFO:tasks.workunit.client.1.smithi161.stdout:0/633: fdatasync df/d30/d71/d96/dd3/f5f 0 2024-09-18T12:52:09.514 INFO:tasks.workunit.client.0.smithi045.stdout:4/277: readlink db/de/d1e/d3e/d47/d59/l2a 0 2024-09-18T12:52:09.516 INFO:tasks.workunit.client.0.smithi045.stdout:4/278: chown db/de/d1e/d3e/d47/d59/d13/l1c 73064 1 2024-09-18T12:52:09.517 INFO:tasks.workunit.client.1.smithi161.stdout:7/563: creat d3/d8/d15/d1a/d4a/d64/d8c/d9f/d55/fa5 x:0 0 0 2024-09-18T12:52:09.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/564: chown d3/d8/d15/f1e 404940664 1 2024-09-18T12:52:09.519 INFO:tasks.workunit.client.0.smithi045.stdout:7/228: dread d13/d44/d37/f4a [0,4194304] 0 2024-09-18T12:52:09.520 INFO:tasks.workunit.client.0.smithi045.stdout:7/229: chown d13/d1a 848 1 2024-09-18T12:52:09.520 INFO:tasks.workunit.client.0.smithi045.stdout:7/230: chown d13/d1a/c36 50 1 2024-09-18T12:52:09.520 INFO:tasks.workunit.client.0.smithi045.stdout:5/359: rename d6/d28/d2b/d51/f52 to d6/d2a/f76 0 2024-09-18T12:52:09.521 INFO:tasks.workunit.client.1.smithi161.stdout:1/515: mkdir d1/da/d1f/dab 0 2024-09-18T12:52:09.522 INFO:tasks.workunit.client.1.smithi161.stdout:1/516: read d1/da/d1f/d45/d73/f9a [229671,114656] 0 2024-09-18T12:52:09.523 INFO:tasks.workunit.client.1.smithi161.stdout:1/517: write d1/da/f18 [1361488,57952] 0 2024-09-18T12:52:09.524 INFO:tasks.workunit.client.1.smithi161.stdout:1/518: readlink d1/da/d1f/l22 0 2024-09-18T12:52:09.524 INFO:tasks.workunit.client.1.smithi161.stdout:3/613: rmdir d1/d2e/d14/d65/d76 39 2024-09-18T12:52:09.525 INFO:tasks.workunit.client.1.smithi161.stdout:3/614: chown d1/d2e/d14/d2c/d72 6618 1 2024-09-18T12:52:09.526 INFO:tasks.workunit.client.1.smithi161.stdout:2/657: mkdir d0/d1/d4c/de5 0 2024-09-18T12:52:09.527 INFO:tasks.workunit.client.1.smithi161.stdout:2/658: chown d0/f13 1 1 2024-09-18T12:52:09.529 INFO:tasks.workunit.client.0.smithi045.stdout:7/231: dread f2 [0,4194304] 0 2024-09-18T12:52:09.529 INFO:tasks.workunit.client.0.smithi045.stdout:5/360: rename d6/db/d19/d31/d53 to d6/db/d6a/d77 0 2024-09-18T12:52:09.529 INFO:tasks.workunit.client.1.smithi161.stdout:2/659: write d0/d5/d43/f45 [345927,84714] 0 2024-09-18T12:52:09.530 INFO:tasks.workunit.client.1.smithi161.stdout:4/667: mkdir d5/da9/de7 0 2024-09-18T12:52:09.530 INFO:tasks.workunit.client.1.smithi161.stdout:9/536: dwrite d0/d16/d25/d28/d45/f37 [0,4194304] 0 2024-09-18T12:52:09.532 INFO:tasks.workunit.client.0.smithi045.stdout:5/361: truncate d6/d2a/d61/f72 940084 0 2024-09-18T12:52:09.533 INFO:tasks.workunit.client.1.smithi161.stdout:2/660: write d0/d1/d4c/d67/db9/dcb/d8a/da8/fc4 [880264,52726] 0 2024-09-18T12:52:09.533 INFO:tasks.workunit.client.1.smithi161.stdout:5/580: rename d3/d9/d4b/d8e/d46 to d3/d9/d4b/d8e/d24/db8 0 2024-09-18T12:52:09.538 INFO:tasks.workunit.client.1.smithi161.stdout:6/657: creat d4/d39/d26/d31/fd9 x:0 0 0 2024-09-18T12:52:09.540 INFO:tasks.workunit.client.0.smithi045.stdout:7/232: dwrite d13/d1a/d28/f39 [4194304,4194304] 0 2024-09-18T12:52:09.540 INFO:tasks.workunit.client.0.smithi045.stdout:4/279: dread db/de/d1e/d3e/d47/d59/d13/f5c [0,4194304] 0 2024-09-18T12:52:09.548 INFO:tasks.workunit.client.0.smithi045.stdout:0/295: link d6/lb d6/d7/d21/d39/l53 0 2024-09-18T12:52:09.548 INFO:tasks.workunit.client.0.smithi045.stdout:4/280: symlink db/de/d1e/d3e/d47/d59/d2f/l61 0 2024-09-18T12:52:09.549 INFO:tasks.workunit.client.0.smithi045.stdout:4/281: stat db/de/d1e 0 2024-09-18T12:52:09.549 INFO:tasks.workunit.client.0.smithi045.stdout:0/296: stat d6/d35 0 2024-09-18T12:52:09.549 INFO:tasks.workunit.client.1.smithi161.stdout:1/519: creat d1/d71/fac x:0 0 0 2024-09-18T12:52:09.549 INFO:tasks.workunit.client.1.smithi161.stdout:3/615: rmdir d1/d2e/d14/d90 39 2024-09-18T12:52:09.551 INFO:tasks.workunit.client.1.smithi161.stdout:4/668: mkdir d5/d14/d67/dc7/d60/d95/dda/de8 0 2024-09-18T12:52:09.552 INFO:tasks.workunit.client.0.smithi045.stdout:7/233: mknod d13/d44/d4c/c4f 0 2024-09-18T12:52:09.552 INFO:tasks.workunit.client.1.smithi161.stdout:0/634: dread df/d30/d4d/f7b [0,4194304] 0 2024-09-18T12:52:09.554 INFO:tasks.workunit.client.1.smithi161.stdout:5/581: rename d3/d3b/d7b/d82/c8b to d3/d9/d4b/d8e/d24/db8/da4/cb9 0 2024-09-18T12:52:09.555 INFO:tasks.workunit.client.0.smithi045.stdout:4/282: write db/d2c/d35/f56 [999288,47173] 0 2024-09-18T12:52:09.556 INFO:tasks.workunit.client.1.smithi161.stdout:7/565: unlink d3/d8/d79/f7a 0 2024-09-18T12:52:09.557 INFO:tasks.workunit.client.0.smithi045.stdout:4/283: read db/d2c/d35/f3b [1695986,97317] 0 2024-09-18T12:52:09.559 INFO:tasks.workunit.client.0.smithi045.stdout:7/234: symlink d13/d44/l50 0 2024-09-18T12:52:09.561 INFO:tasks.workunit.client.1.smithi161.stdout:6/658: creat d4/d39/d48/fda x:0 0 0 2024-09-18T12:52:09.565 INFO:tasks.workunit.client.0.smithi045.stdout:4/284: mkdir db/de/d1a/d2e/d62 0 2024-09-18T12:52:09.566 INFO:tasks.workunit.client.1.smithi161.stdout:0/635: dread df/d29/f53 [0,4194304] 0 2024-09-18T12:52:09.567 INFO:tasks.workunit.client.1.smithi161.stdout:0/636: write df/d29/f62 [288995,79001] 0 2024-09-18T12:52:09.568 INFO:tasks.workunit.client.0.smithi045.stdout:7/235: creat d13/d44/f51 x:0 0 0 2024-09-18T12:52:09.570 INFO:tasks.workunit.client.1.smithi161.stdout:1/520: rmdir d1/d1d 39 2024-09-18T12:52:09.571 INFO:tasks.workunit.client.0.smithi045.stdout:0/297: truncate d6/d7/ff 918781 0 2024-09-18T12:52:09.573 INFO:tasks.workunit.client.1.smithi161.stdout:3/616: mkdir d1/d2e/d3d/d49/dce 0 2024-09-18T12:52:09.573 INFO:tasks.workunit.client.0.smithi045.stdout:0/298: write d6/d7/f29 [1023544,46636] 0 2024-09-18T12:52:09.574 INFO:tasks.workunit.client.0.smithi045.stdout:4/285: dwrite db/d20/f44 [0,4194304] 0 2024-09-18T12:52:09.575 INFO:tasks.workunit.client.0.smithi045.stdout:0/299: readlink d6/d7/d21/d23/d3c/l49 0 2024-09-18T12:52:09.575 INFO:tasks.workunit.client.1.smithi161.stdout:2/661: symlink d0/d5/d43/d35/d98/de1/le6 0 2024-09-18T12:52:09.577 INFO:tasks.workunit.client.0.smithi045.stdout:4/286: write db/de/d1e/d3e/d47/d59/d13/f50 [3739764,39901] 0 2024-09-18T12:52:09.580 INFO:tasks.workunit.client.1.smithi161.stdout:4/669: mkdir d5/d14/d5f/da1/de9 0 2024-09-18T12:52:09.581 INFO:tasks.workunit.client.0.smithi045.stdout:7/236: mkdir d13/d31/d52 0 2024-09-18T12:52:09.585 INFO:tasks.workunit.client.0.smithi045.stdout:0/300: dwrite f4 [0,4194304] 0 2024-09-18T12:52:09.585 INFO:tasks.workunit.client.1.smithi161.stdout:5/582: creat d3/d14/d8d/fba x:0 0 0 2024-09-18T12:52:09.586 INFO:tasks.workunit.client.1.smithi161.stdout:4/670: dwrite d5/d14/d67/f90 [0,4194304] 0 2024-09-18T12:52:09.590 INFO:tasks.workunit.client.1.smithi161.stdout:7/566: rename d3/d8/d15/d1a/d24/f4c to d3/d8/d15/d1a/d4a/fa6 0 2024-09-18T12:52:09.591 INFO:tasks.workunit.client.0.smithi045.stdout:4/287: dwrite db/de/d1e/d3e/d47/d59/f5f [0,4194304] 0 2024-09-18T12:52:09.595 INFO:tasks.workunit.client.1.smithi161.stdout:6/659: write d4/d1a/d1c/d7c/f9f [245509,55700] 0 2024-09-18T12:52:09.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/648: getdents d0/d3/d10/d21/d4a/d52/d82/d96/dba 0 2024-09-18T12:52:09.598 INFO:tasks.workunit.client.1.smithi161.stdout:6/660: chown d4/d1a/d1c/d3e/d83/d9e/db1/d28/l58 126 1 2024-09-18T12:52:09.600 INFO:tasks.workunit.client.1.smithi161.stdout:7/567: dread d3/d8/d15/d1a/d4a/d64/d8c/d9f/d55/f6c [0,4194304] 0 2024-09-18T12:52:09.602 INFO:tasks.workunit.client.1.smithi161.stdout:7/568: chown d3/d8/d15/d1a/d24/d31/f68 13741909 1 2024-09-18T12:52:09.602 INFO:tasks.workunit.client.0.smithi045.stdout:9/226: write d0/d3/d6/d10/d2c/f35 [3961869,7497] 0 2024-09-18T12:52:09.602 INFO:tasks.workunit.client.1.smithi161.stdout:9/537: creat d0/d20/fad x:0 0 0 2024-09-18T12:52:09.605 INFO:tasks.workunit.client.1.smithi161.stdout:1/521: mkdir d1/d26/dad 0 2024-09-18T12:52:09.606 INFO:tasks.workunit.client.1.smithi161.stdout:1/522: chown d1/d48/f99 0 1 2024-09-18T12:52:09.609 INFO:tasks.workunit.client.0.smithi045.stdout:8/285: dwrite d11/d14/f1e [0,4194304] 0 2024-09-18T12:52:09.613 INFO:tasks.workunit.client.0.smithi045.stdout:9/227: rmdir d0/d3/d6 39 2024-09-18T12:52:09.616 INFO:tasks.workunit.client.0.smithi045.stdout:8/286: dwrite d11/f16 [0,4194304] 0 2024-09-18T12:52:09.616 INFO:tasks.workunit.client.0.smithi045.stdout:0/301: mknod d6/d7/d21/c54 0 2024-09-18T12:52:09.624 INFO:tasks.workunit.client.0.smithi045.stdout:0/302: write d6/d7/d21/f24 [518573,81787] 0 2024-09-18T12:52:09.625 INFO:tasks.workunit.client.1.smithi161.stdout:8/649: mknod d0/d3/d10/d21/d4a/d52/d94/cd1 0 2024-09-18T12:52:09.626 INFO:tasks.workunit.client.0.smithi045.stdout:0/303: truncate d6/d48/d4a/f4b 271225 0 2024-09-18T12:52:09.628 INFO:tasks.workunit.client.0.smithi045.stdout:4/288: link db/de/d1e/d49/f4e db/f63 0 2024-09-18T12:52:09.630 INFO:tasks.workunit.client.0.smithi045.stdout:9/228: symlink d0/d3/d6/d10/l4c 0 2024-09-18T12:52:09.635 INFO:tasks.workunit.client.1.smithi161.stdout:1/523: creat d1/da/d1f/fae x:0 0 0 2024-09-18T12:52:09.636 INFO:tasks.workunit.client.0.smithi045.stdout:8/287: link d11/c2f d11/d14/d53/d41/c58 0 2024-09-18T12:52:09.637 INFO:tasks.workunit.client.1.smithi161.stdout:3/617: mknod d1/d2e/d14/ccf 0 2024-09-18T12:52:09.638 INFO:tasks.workunit.client.0.smithi045.stdout:6/250: dwrite d9/fc [4194304,4194304] 0 2024-09-18T12:52:09.642 INFO:tasks.workunit.client.0.smithi045.stdout:8/288: mkdir d11/d20/d59 0 2024-09-18T12:52:09.645 INFO:tasks.workunit.client.0.smithi045.stdout:6/251: rmdir d9/d1a 39 2024-09-18T12:52:09.646 INFO:tasks.workunit.client.0.smithi045.stdout:2/318: dwrite d5/d2c/f58 [0,4194304] 0 2024-09-18T12:52:09.646 INFO:tasks.workunit.client.0.smithi045.stdout:8/289: write d11/d20/d46/f43 [5023189,71495] 0 2024-09-18T12:52:09.648 INFO:tasks.workunit.client.1.smithi161.stdout:6/661: creat d4/d39/d47/d88/fdb x:0 0 0 2024-09-18T12:52:09.650 INFO:tasks.workunit.client.1.smithi161.stdout:6/662: fdatasync d4/d1a/d1c/d3e/d83/d9e/db1/d28/f3b 0 2024-09-18T12:52:09.650 INFO:tasks.workunit.client.0.smithi045.stdout:5/362: rename d6/db/d19/d31 to d6/db/d5a/d78 0 2024-09-18T12:52:09.653 INFO:tasks.workunit.client.0.smithi045.stdout:4/289: dread db/de/d1a/f3d [0,4194304] 0 2024-09-18T12:52:09.653 INFO:tasks.workunit.client.1.smithi161.stdout:9/538: truncate d0/db/d18/f69 1204444 0 2024-09-18T12:52:09.654 INFO:tasks.workunit.client.0.smithi045.stdout:4/290: write db/de/d1e/f2d [1786009,27652] 0 2024-09-18T12:52:09.655 INFO:tasks.workunit.client.1.smithi161.stdout:1/524: dread d1/d26/f50 [0,4194304] 0 2024-09-18T12:52:09.657 INFO:tasks.workunit.client.1.smithi161.stdout:0/637: link df/d30/d71/d96/dd3/d51/la0 df/d29/d36/le3 0 2024-09-18T12:52:09.662 INFO:tasks.workunit.client.0.smithi045.stdout:0/304: rename d6/l1a to d6/d35/l55 0 2024-09-18T12:52:09.664 INFO:tasks.workunit.client.1.smithi161.stdout:4/671: rename d5/d14/d67/dc7/d47/fa7 to d5/fea 0 2024-09-18T12:52:09.664 INFO:tasks.workunit.client.0.smithi045.stdout:5/363: dread d6/d2a/f25 [0,4194304] 0 2024-09-18T12:52:09.666 INFO:tasks.workunit.client.1.smithi161.stdout:8/650: creat d0/d3/d10/d21/d4a/d52/d82/d96/dc1/fd2 x:0 0 0 2024-09-18T12:52:09.666 INFO:tasks.workunit.client.1.smithi161.stdout:8/651: stat d0 0 2024-09-18T12:52:09.666 INFO:tasks.workunit.client.1.smithi161.stdout:5/583: sync 2024-09-18T12:52:09.670 INFO:tasks.workunit.client.0.smithi045.stdout:8/290: mknod d11/d20/d59/c5a 0 2024-09-18T12:52:09.676 INFO:tasks.workunit.client.0.smithi045.stdout:5/364: creat d6/d2a/f79 x:0 0 0 2024-09-18T12:52:09.680 INFO:tasks.workunit.client.1.smithi161.stdout:4/672: mknod d5/d14/d67/dc7/d60/d95/ceb 0 2024-09-18T12:52:09.681 INFO:tasks.workunit.client.0.smithi045.stdout:8/291: mknod d11/d20/d46/c5b 0 2024-09-18T12:52:09.682 INFO:tasks.workunit.client.0.smithi045.stdout:8/292: chown d11/d14/f52 12299422 1 2024-09-18T12:52:09.684 INFO:tasks.workunit.client.1.smithi161.stdout:8/652: rename d0/d3/d10/d21/d4a/d52/d82/d96/d98/f39 to d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/fd3 0 2024-09-18T12:52:09.686 INFO:tasks.workunit.client.1.smithi161.stdout:7/569: rename d3/d8/d15/d1a to d3/d8/d15/da7 0 2024-09-18T12:52:09.687 INFO:tasks.workunit.client.1.smithi161.stdout:7/570: dread - d3/d36/f8b zero size 2024-09-18T12:52:09.688 INFO:tasks.workunit.client.1.smithi161.stdout:7/571: write d3/d8/d15/da7/d4a/d64/d8c/d9f/f5f [2256328,34752] 0 2024-09-18T12:52:09.689 INFO:tasks.workunit.client.1.smithi161.stdout:9/539: mkdir d0/d16/d25/d86/dae 0 2024-09-18T12:52:09.690 INFO:tasks.workunit.client.1.smithi161.stdout:7/572: read d3/d8/d15/f1e [472581,52176] 0 2024-09-18T12:52:09.692 INFO:tasks.workunit.client.1.smithi161.stdout:1/525: mkdir d1/da/d1f/dab/daf 0 2024-09-18T12:52:09.693 INFO:tasks.workunit.client.0.smithi045.stdout:8/293: creat d11/d14/d53/f5c x:0 0 0 2024-09-18T12:52:09.694 INFO:tasks.workunit.client.1.smithi161.stdout:0/638: mkdir df/de4 0 2024-09-18T12:52:09.694 INFO:tasks.workunit.client.1.smithi161.stdout:2/662: write d0/d5/d53/d7d/f89 [568512,54030] 0 2024-09-18T12:52:09.696 INFO:tasks.workunit.client.1.smithi161.stdout:4/673: creat d5/d14/d67/dc7/d9b/fec x:0 0 0 2024-09-18T12:52:09.698 INFO:tasks.workunit.client.0.smithi045.stdout:4/291: getdents db/de/d1e 0 2024-09-18T12:52:09.700 INFO:tasks.workunit.client.0.smithi045.stdout:6/252: getdents d9/d1a 0 2024-09-18T12:52:09.701 INFO:tasks.workunit.client.1.smithi161.stdout:8/653: mknod d0/d3/d10/d21/d4a/d52/d82/d96/d98/cd4 0 2024-09-18T12:52:09.701 INFO:tasks.workunit.client.1.smithi161.stdout:4/674: dwrite d5/d32/d39/db6/fc2 [0,4194304] 0 2024-09-18T12:52:09.702 INFO:tasks.workunit.client.0.smithi045.stdout:8/294: creat d11/d20/f5d x:0 0 0 2024-09-18T12:52:09.703 INFO:tasks.workunit.client.1.smithi161.stdout:8/654: truncate d0/d3/f81 505356 0 2024-09-18T12:52:09.703 INFO:tasks.workunit.client.1.smithi161.stdout:8/655: chown d0/d3/d10/d21/d4a/d52/d66/d5b/fac 866 1 2024-09-18T12:52:09.704 INFO:tasks.workunit.client.1.smithi161.stdout:8/656: write d0/d3/d91/f9b [1312888,84552] 0 2024-09-18T12:52:09.705 INFO:tasks.workunit.client.0.smithi045.stdout:0/305: getdents d6/d48/d4a 0 2024-09-18T12:52:09.709 INFO:tasks.workunit.client.0.smithi045.stdout:4/292: creat db/de/d1e/d49/f64 x:0 0 0 2024-09-18T12:52:09.710 INFO:tasks.workunit.client.1.smithi161.stdout:7/573: chown d3/d8/l5c 7554145 1 2024-09-18T12:52:09.711 INFO:tasks.workunit.client.1.smithi161.stdout:7/574: fdatasync d3/d8/d15/da7/d24/d31/f68 0 2024-09-18T12:52:09.711 INFO:tasks.workunit.client.1.smithi161.stdout:7/575: chown d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d 20039729 1 2024-09-18T12:52:09.712 INFO:tasks.workunit.client.1.smithi161.stdout:9/540: creat d0/db/d6f/faf x:0 0 0 2024-09-18T12:52:09.712 INFO:tasks.workunit.client.1.smithi161.stdout:7/576: chown d3/d8/d15/da7/d24/d31/c40 114 1 2024-09-18T12:52:09.713 INFO:tasks.workunit.client.0.smithi045.stdout:6/253: mknod d9/d56/c58 0 2024-09-18T12:52:09.715 INFO:tasks.workunit.client.1.smithi161.stdout:1/526: creat d1/d26/d88/fb0 x:0 0 0 2024-09-18T12:52:09.718 INFO:tasks.workunit.client.1.smithi161.stdout:3/618: link d1/d2e/d24/cb2 d1/d2e/d14/d78/cd0 0 2024-09-18T12:52:09.724 INFO:tasks.workunit.client.0.smithi045.stdout:8/295: mknod d11/d14/d3d/c5e 0 2024-09-18T12:52:09.725 INFO:tasks.workunit.client.1.smithi161.stdout:4/675: creat d5/d32/dd8/fed x:0 0 0 2024-09-18T12:52:09.727 INFO:tasks.workunit.client.0.smithi045.stdout:0/306: rename l3 to d6/d7/d21/d23/d3b/l56 0 2024-09-18T12:52:09.727 INFO:tasks.workunit.client.1.smithi161.stdout:6/663: dwrite d4/d39/d3a/f1f [0,4194304] 0 2024-09-18T12:52:09.728 INFO:tasks.workunit.client.1.smithi161.stdout:6/664: readlink d4/d39/l44 0 2024-09-18T12:52:09.730 INFO:tasks.workunit.client.1.smithi161.stdout:8/657: creat d0/d3/d10/d21/d4a/d52/d82/d96/d98/fd5 x:0 0 0 2024-09-18T12:52:09.735 INFO:tasks.workunit.client.0.smithi045.stdout:8/296: rename d11/d14/d53/f5c to d11/f5f 0 2024-09-18T12:52:09.735 INFO:tasks.workunit.client.1.smithi161.stdout:7/577: readlink d3/d8/l1f 0 2024-09-18T12:52:09.737 INFO:tasks.workunit.client.0.smithi045.stdout:0/307: mknod d6/d7/d32/c57 0 2024-09-18T12:52:09.739 INFO:tasks.workunit.client.0.smithi045.stdout:4/293: link db/d20/c27 db/de/d1e/d3e/c65 0 2024-09-18T12:52:09.741 INFO:tasks.workunit.client.1.smithi161.stdout:3/619: rmdir d1/d2e/d3d/d49 39 2024-09-18T12:52:09.742 INFO:tasks.workunit.client.0.smithi045.stdout:5/365: dwrite d6/d3e/f3f [0,4194304] 0 2024-09-18T12:52:09.744 INFO:tasks.workunit.client.0.smithi045.stdout:8/297: dwrite fa [4194304,4194304] 0 2024-09-18T12:52:09.746 INFO:tasks.workunit.client.0.smithi045.stdout:5/366: truncate d6/d2a/d5c/f62 138235 0 2024-09-18T12:52:09.747 INFO:tasks.workunit.client.1.smithi161.stdout:5/584: truncate d3/d3b/f98 58590 0 2024-09-18T12:52:09.747 INFO:tasks.workunit.client.0.smithi045.stdout:0/308: rmdir d6/d7 39 2024-09-18T12:52:09.748 INFO:tasks.workunit.client.1.smithi161.stdout:5/585: truncate d3/d9/d4b/d8e/d24/f7d 722331 0 2024-09-18T12:52:09.751 INFO:tasks.workunit.client.0.smithi045.stdout:4/294: fsync db/de/d1e/d49/f4e 0 2024-09-18T12:52:09.754 INFO:tasks.workunit.client.1.smithi161.stdout:8/658: creat d0/d3/d10/d21/d4a/d52/d82/d8b/fd6 x:0 0 0 2024-09-18T12:52:09.754 INFO:tasks.workunit.client.0.smithi045.stdout:4/295: dread db/d1b/d43/f4c [0,4194304] 0 2024-09-18T12:52:09.755 INFO:tasks.workunit.client.1.smithi161.stdout:8/659: chown d0/d3/d10/d21/d4a/d52/d82/d96/dc1/fd2 262 1 2024-09-18T12:52:09.756 INFO:tasks.workunit.client.0.smithi045.stdout:5/367: dwrite d6/db/d6a/d77/f63 [0,4194304] 0 2024-09-18T12:52:09.760 INFO:tasks.workunit.client.1.smithi161.stdout:9/541: mknod d0/d20/cb0 0 2024-09-18T12:52:09.761 INFO:tasks.workunit.client.1.smithi161.stdout:9/542: write d0/f6e [2106952,79532] 0 2024-09-18T12:52:09.763 INFO:tasks.workunit.client.1.smithi161.stdout:8/660: dread d0/d3/d10/d21/f37 [0,4194304] 0 2024-09-18T12:52:09.767 INFO:tasks.workunit.client.1.smithi161.stdout:3/620: mknod d1/d2e/d24/cd1 0 2024-09-18T12:52:09.767 INFO:tasks.workunit.client.0.smithi045.stdout:0/309: read d6/d7/d21/d23/f25 [878329,102727] 0 2024-09-18T12:52:09.767 INFO:tasks.workunit.client.0.smithi045.stdout:6/254: write d9/d1a/d1d/f25 [204717,50154] 0 2024-09-18T12:52:09.768 INFO:tasks.workunit.client.1.smithi161.stdout:3/621: readlink d1/d2e/d14/l55 0 2024-09-18T12:52:09.769 INFO:tasks.workunit.client.0.smithi045.stdout:8/298: rename d11/d14/d3d to d11/d20/d60 0 2024-09-18T12:52:09.771 INFO:tasks.workunit.client.1.smithi161.stdout:0/639: dwrite df/de2/dc5/d89/f8b [0,4194304] 0 2024-09-18T12:52:09.773 INFO:tasks.workunit.client.0.smithi045.stdout:5/368: mknod d6/d2a/d61/c7a 0 2024-09-18T12:52:09.773 INFO:tasks.workunit.client.1.smithi161.stdout:4/676: rename d5/cd to d5/d32/dd8/cee 0 2024-09-18T12:52:09.773 INFO:tasks.workunit.client.0.smithi045.stdout:5/369: stat d6/d3e/f3a 0 2024-09-18T12:52:09.780 INFO:tasks.workunit.client.1.smithi161.stdout:4/677: dwrite d5/d32/d39/db6/fd9 [0,4194304] 0 2024-09-18T12:52:09.787 INFO:tasks.workunit.client.0.smithi045.stdout:0/310: dwrite d6/d7/d21/f2e [0,4194304] 0 2024-09-18T12:52:09.787 INFO:tasks.workunit.client.1.smithi161.stdout:8/661: creat d0/d3/d10/d21/d4a/d52/d82/fd7 x:0 0 0 2024-09-18T12:52:09.790 INFO:tasks.workunit.client.0.smithi045.stdout:0/311: write d6/d35/f3e [589722,102605] 0 2024-09-18T12:52:09.790 INFO:tasks.workunit.client.1.smithi161.stdout:2/663: dwrite d0/d5/d43/d35/d98/ddf/d8b/f8c [0,4194304] 0 2024-09-18T12:52:09.791 INFO:tasks.workunit.client.1.smithi161.stdout:0/640: dread df/f32 [0,4194304] 0 2024-09-18T12:52:09.792 INFO:tasks.workunit.client.0.smithi045.stdout:4/296: dread db/f21 [4194304,4194304] 0 2024-09-18T12:52:09.794 INFO:tasks.workunit.client.0.smithi045.stdout:5/370: rename d6/db/f12 to d6/db/d5a/d78/d66/f7b 0 2024-09-18T12:52:09.799 INFO:tasks.workunit.client.1.smithi161.stdout:1/527: sync 2024-09-18T12:52:09.801 INFO:tasks.workunit.client.0.smithi045.stdout:6/255: unlink l8 0 2024-09-18T12:52:09.802 INFO:tasks.workunit.client.0.smithi045.stdout:5/371: dwrite d6/d28/d2b/f4e [0,4194304] 0 2024-09-18T12:52:09.803 INFO:tasks.workunit.client.1.smithi161.stdout:7/578: dwrite d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/f6c [0,4194304] 0 2024-09-18T12:52:09.811 INFO:tasks.workunit.client.1.smithi161.stdout:9/543: mknod d0/d47/d48/d7f/d84/cb1 0 2024-09-18T12:52:09.813 INFO:tasks.workunit.client.1.smithi161.stdout:4/678: creat d5/da9/fef x:0 0 0 2024-09-18T12:52:09.817 INFO:tasks.workunit.client.1.smithi161.stdout:8/662: creat d0/d3/d10/d21/d4a/d52/d82/d8b/fd8 x:0 0 0 2024-09-18T12:52:09.817 INFO:tasks.workunit.client.0.smithi045.stdout:4/297: rmdir db/de 39 2024-09-18T12:52:09.818 INFO:tasks.workunit.client.0.smithi045.stdout:0/312: dwrite d6/d35/f50 [0,4194304] 0 2024-09-18T12:52:09.819 INFO:tasks.workunit.client.1.smithi161.stdout:2/664: creat d0/d1/d4c/d67/fe7 x:0 0 0 2024-09-18T12:52:09.821 INFO:tasks.workunit.client.0.smithi045.stdout:4/298: read db/d1b/f23 [276501,42839] 0 2024-09-18T12:52:09.821 INFO:tasks.workunit.client.1.smithi161.stdout:0/641: creat df/de2/dc5/d86/da5/fe5 x:0 0 0 2024-09-18T12:52:09.823 INFO:tasks.workunit.client.1.smithi161.stdout:3/622: mknod d1/d2e/d14/d65/d76/d8c/d9d/cd2 0 2024-09-18T12:52:09.826 INFO:tasks.workunit.client.0.smithi045.stdout:4/299: dread db/d20/f44 [0,4194304] 0 2024-09-18T12:52:09.829 INFO:tasks.workunit.client.0.smithi045.stdout:0/313: rename d6/d7/d21/d23 to d6/d7/d21/d39/d58 0 2024-09-18T12:52:09.832 INFO:tasks.workunit.client.0.smithi045.stdout:6/256: mknod d9/c59 0 2024-09-18T12:52:09.833 INFO:tasks.workunit.client.0.smithi045.stdout:6/257: chown d9/d1a/d2d/d32/c43 34690360 1 2024-09-18T12:52:09.834 INFO:tasks.workunit.client.1.smithi161.stdout:6/665: sync 2024-09-18T12:52:09.834 INFO:tasks.workunit.client.0.smithi045.stdout:8/299: link d11/d14/d53/d41/d57/l48 d11/d14/d53/d41/l61 0 2024-09-18T12:52:09.835 INFO:tasks.workunit.client.0.smithi045.stdout:8/300: dread - d11/f5f zero size 2024-09-18T12:52:09.836 INFO:tasks.workunit.client.0.smithi045.stdout:8/301: chown d11/d20/d60 7868243 1 2024-09-18T12:52:09.836 INFO:tasks.workunit.client.1.smithi161.stdout:7/579: dwrite d3/d8/d15/da7/f39 [0,4194304] 0 2024-09-18T12:52:09.838 INFO:tasks.workunit.client.1.smithi161.stdout:4/679: unlink d5/d32/d39/f4e 0 2024-09-18T12:52:09.843 INFO:tasks.workunit.client.0.smithi045.stdout:0/314: creat d6/d7/d21/d39/d58/f59 x:0 0 0 2024-09-18T12:52:09.844 INFO:tasks.workunit.client.0.smithi045.stdout:0/315: write f4 [1280149,26689] 0 2024-09-18T12:52:09.849 INFO:tasks.workunit.client.0.smithi045.stdout:6/258: rename d9/f2b to d9/d1a/d1d/f5a 0 2024-09-18T12:52:09.850 INFO:tasks.workunit.client.1.smithi161.stdout:0/642: mknod df/d30/d4d/ce6 0 2024-09-18T12:52:09.851 INFO:tasks.workunit.client.0.smithi045.stdout:8/302: symlink d11/d23/l62 0 2024-09-18T12:52:09.851 INFO:tasks.workunit.client.1.smithi161.stdout:9/544: write d0/d16/d25/d46/d53/f8e [16955,63569] 0 2024-09-18T12:52:09.854 INFO:tasks.workunit.client.1.smithi161.stdout:5/586: rename d3/d44/c64 to d3/d9/cbb 0 2024-09-18T12:52:09.854 INFO:tasks.workunit.client.0.smithi045.stdout:0/316: chown d6/d7/d21/d39/d58/d3b/l56 41713707 1 2024-09-18T12:52:09.855 INFO:tasks.workunit.client.0.smithi045.stdout:6/259: unlink d9/d1a/c2c 0 2024-09-18T12:52:09.855 INFO:tasks.workunit.client.1.smithi161.stdout:5/587: chown d3/d44/d6f/l83 542 1 2024-09-18T12:52:09.856 INFO:tasks.workunit.client.1.smithi161.stdout:2/665: dread d0/d1/d3b/d7e/f70 [0,4194304] 0 2024-09-18T12:52:09.856 INFO:tasks.workunit.client.1.smithi161.stdout:6/666: creat d4/d1a/d1c/d7c/fdc x:0 0 0 2024-09-18T12:52:09.857 INFO:tasks.workunit.client.1.smithi161.stdout:0/643: dwrite df/d30/d4d/f9b [0,4194304] 0 2024-09-18T12:52:09.857 INFO:tasks.workunit.client.0.smithi045.stdout:8/303: unlink d11/d20/d59/c5a 0 2024-09-18T12:52:09.858 INFO:tasks.workunit.client.0.smithi045.stdout:8/304: write d11/d20/d46/f43 [2809194,116177] 0 2024-09-18T12:52:09.858 INFO:tasks.workunit.client.1.smithi161.stdout:6/667: chown d4/d61/d9d/da3 314 1 2024-09-18T12:52:09.858 INFO:tasks.workunit.client.1.smithi161.stdout:2/666: chown d0/d5/d43/d35/d80/fca 500 1 2024-09-18T12:52:09.860 INFO:tasks.workunit.client.1.smithi161.stdout:2/667: chown d0/d5/d53/d7d/f89 113 1 2024-09-18T12:52:09.860 INFO:tasks.workunit.client.0.smithi045.stdout:0/317: mknod d6/d48/c5a 0 2024-09-18T12:52:09.861 INFO:tasks.workunit.client.1.smithi161.stdout:8/663: truncate d0/d3/d10/d21/f30 1687368 0 2024-09-18T12:52:09.861 INFO:tasks.workunit.client.1.smithi161.stdout:2/668: chown d0/d5/d43/d35/d98/ddf/f60 1518110 1 2024-09-18T12:52:09.864 INFO:tasks.workunit.client.1.smithi161.stdout:2/669: read d0/d4/f62 [1251165,61465] 0 2024-09-18T12:52:09.866 INFO:tasks.workunit.client.0.smithi045.stdout:8/305: symlink d11/d20/l63 0 2024-09-18T12:52:09.870 INFO:tasks.workunit.client.1.smithi161.stdout:7/580: rename d3/d8/d15/da7/d4a/d64/l67 to d3/d8/d15/da7/d44/la8 0 2024-09-18T12:52:09.875 INFO:tasks.workunit.client.1.smithi161.stdout:6/668: rmdir d4/d61/d69 39 2024-09-18T12:52:09.876 INFO:tasks.workunit.client.1.smithi161.stdout:7/581: dwrite d3/d8/f80 [4194304,4194304] 0 2024-09-18T12:52:09.878 INFO:tasks.workunit.client.0.smithi045.stdout:8/306: dwrite d11/d14/d53/f54 [0,4194304] 0 2024-09-18T12:52:09.878 INFO:tasks.workunit.client.0.smithi045.stdout:4/300: truncate db/de/d1a/f3d 1985158 0 2024-09-18T12:52:09.883 INFO:tasks.workunit.client.0.smithi045.stdout:6/260: mkdir d9/d1a/d2d/d38/d5b 0 2024-09-18T12:52:09.885 INFO:tasks.workunit.client.0.smithi045.stdout:8/307: creat d11/d20/f64 x:0 0 0 2024-09-18T12:52:09.886 INFO:tasks.workunit.client.0.smithi045.stdout:8/308: chown d11/d14/f4b 1 1 2024-09-18T12:52:09.887 INFO:tasks.workunit.client.0.smithi045.stdout:8/309: write d11/d23/f2b [70075,69468] 0 2024-09-18T12:52:09.890 INFO:tasks.workunit.client.1.smithi161.stdout:3/623: symlink d1/d2e/d24/d1d/d89/db0/ld3 0 2024-09-18T12:52:09.894 INFO:tasks.workunit.client.0.smithi045.stdout:0/318: dwrite d6/d7/ff [0,4194304] 0 2024-09-18T12:52:09.896 INFO:tasks.workunit.client.0.smithi045.stdout:0/319: read - d6/d48/f4d zero size 2024-09-18T12:52:09.896 INFO:tasks.workunit.client.1.smithi161.stdout:1/528: getdents d1/da/d1f/dab 0 2024-09-18T12:52:09.896 INFO:tasks.workunit.client.1.smithi161.stdout:1/529: read - d1/f97 zero size 2024-09-18T12:52:09.897 INFO:tasks.workunit.client.0.smithi045.stdout:4/301: link db/f30 db/de/d1e/d3e/d47/d59/f66 0 2024-09-18T12:52:09.897 INFO:tasks.workunit.client.0.smithi045.stdout:8/310: mknod d11/d20/d46/c65 0 2024-09-18T12:52:09.899 INFO:tasks.workunit.client.0.smithi045.stdout:6/261: mknod d9/d1a/d48/c5c 0 2024-09-18T12:52:09.902 INFO:tasks.workunit.client.1.smithi161.stdout:6/669: rmdir d4/d39/d47/d88 39 2024-09-18T12:52:09.903 INFO:tasks.workunit.client.1.smithi161.stdout:7/582: mknod d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/ca9 0 2024-09-18T12:52:09.904 INFO:tasks.workunit.client.0.smithi045.stdout:4/302: read db/d20/f44 [2734092,129511] 0 2024-09-18T12:52:09.905 INFO:tasks.workunit.client.1.smithi161.stdout:0/644: mkdir df/d30/d71/d96/dd3/d90/d37/dad/de7 0 2024-09-18T12:52:09.909 INFO:tasks.workunit.client.0.smithi045.stdout:0/320: symlink d6/l5b 0 2024-09-18T12:52:09.910 INFO:tasks.workunit.client.1.smithi161.stdout:8/664: creat d0/d3/d10/d21/d4a/db7/fd9 x:0 0 0 2024-09-18T12:52:09.912 INFO:tasks.workunit.client.1.smithi161.stdout:8/665: write d0/d3/d10/d21/d4a/d52/d82/fd7 [225203,56324] 0 2024-09-18T12:52:09.912 INFO:tasks.workunit.client.0.smithi045.stdout:4/303: rename db/d1b/d43/l5b to db/de/d1e/d3e/d47/d59/d2f/l67 0 2024-09-18T12:52:09.914 INFO:tasks.workunit.client.1.smithi161.stdout:3/624: creat d1/d2e/d24/d1d/d89/fd4 x:0 0 0 2024-09-18T12:52:09.914 INFO:tasks.workunit.client.0.smithi045.stdout:6/262: read d9/d1a/d1d/f5a [208461,23611] 0 2024-09-18T12:52:09.915 INFO:tasks.workunit.client.0.smithi045.stdout:0/321: creat d6/d48/f5c x:0 0 0 2024-09-18T12:52:09.916 INFO:tasks.workunit.client.1.smithi161.stdout:1/530: chown d1/c12 63532 1 2024-09-18T12:52:09.917 INFO:tasks.workunit.client.1.smithi161.stdout:4/680: getdents d5/d14/d5f/da1 0 2024-09-18T12:52:09.917 INFO:tasks.workunit.client.1.smithi161.stdout:4/681: write d5/d32/f38 [5082080,89605] 0 2024-09-18T12:52:09.918 INFO:tasks.workunit.client.0.smithi045.stdout:0/322: mknod d6/d7/d32/c5d 0 2024-09-18T12:52:09.920 INFO:tasks.workunit.client.1.smithi161.stdout:4/682: write d5/d14/d5f/da1/fc0 [252778,77652] 0 2024-09-18T12:52:09.921 INFO:tasks.workunit.client.1.smithi161.stdout:7/583: symlink d3/d7e/laa 0 2024-09-18T12:52:09.922 INFO:tasks.workunit.client.0.smithi045.stdout:6/263: dwrite d9/d1a/d2d/d38/f44 [0,4194304] 0 2024-09-18T12:52:09.924 INFO:tasks.workunit.client.1.smithi161.stdout:1/531: dwrite d1/da/d39/fa0 [0,4194304] 0 2024-09-18T12:52:09.926 INFO:tasks.workunit.client.0.smithi045.stdout:0/323: rename d6/d7/d21 to d6/d48/d5e 0 2024-09-18T12:52:09.929 INFO:tasks.workunit.client.0.smithi045.stdout:6/264: dread d9/f23 [0,4194304] 0 2024-09-18T12:52:09.930 INFO:tasks.workunit.client.0.smithi045.stdout:6/265: readlink d9/d1a/d2d/d38/l55 0 2024-09-18T12:52:09.930 INFO:tasks.workunit.client.1.smithi161.stdout:3/625: mknod d1/d2e/d14/d2c/d72/cd5 0 2024-09-18T12:52:09.931 INFO:tasks.workunit.client.0.smithi045.stdout:4/304: truncate db/de/d1a/f3d 955181 0 2024-09-18T12:52:09.931 INFO:tasks.workunit.client.0.smithi045.stdout:4/305: write db/f21 [3653745,124940] 0 2024-09-18T12:52:09.932 INFO:tasks.workunit.client.1.smithi161.stdout:2/670: mkdir d0/d71/da9/dd6/de8 0 2024-09-18T12:52:09.934 INFO:tasks.workunit.client.1.smithi161.stdout:2/671: fdatasync d0/d1/d3b/d3d/fdc 0 2024-09-18T12:52:09.934 INFO:tasks.workunit.client.0.smithi045.stdout:0/324: creat d6/d35/f5f x:0 0 0 2024-09-18T12:52:09.935 INFO:tasks.workunit.client.1.smithi161.stdout:1/532: dwrite d1/da/f18 [0,4194304] 0 2024-09-18T12:52:09.936 INFO:tasks.workunit.client.0.smithi045.stdout:0/325: chown d6/d48/d5e/c4f 215813335 1 2024-09-18T12:52:09.937 INFO:tasks.workunit.client.0.smithi045.stdout:6/266: symlink d9/d1a/d2d/l5d 0 2024-09-18T12:52:09.939 INFO:tasks.workunit.client.0.smithi045.stdout:4/306: truncate db/de/d1e/d49/f4e 785252 0 2024-09-18T12:52:09.940 INFO:tasks.workunit.client.0.smithi045.stdout:4/307: chown db/d1b/d43/c46 179 1 2024-09-18T12:52:09.941 INFO:tasks.workunit.client.1.smithi161.stdout:0/645: dwrite df/d30/d4d/f7b [0,4194304] 0 2024-09-18T12:52:09.943 INFO:tasks.workunit.client.0.smithi045.stdout:6/267: creat d9/d1a/d2d/f5e x:0 0 0 2024-09-18T12:52:09.944 INFO:tasks.workunit.client.0.smithi045.stdout:0/326: unlink d6/ld 0 2024-09-18T12:52:09.946 INFO:tasks.workunit.client.0.smithi045.stdout:4/308: dread db/d2c/d35/f3b [0,4194304] 0 2024-09-18T12:52:09.947 INFO:tasks.workunit.client.1.smithi161.stdout:7/584: symlink d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/lab 0 2024-09-18T12:52:09.948 INFO:tasks.workunit.client.1.smithi161.stdout:1/533: dread d1/da/d1f/f51 [0,4194304] 0 2024-09-18T12:52:09.949 INFO:tasks.workunit.client.1.smithi161.stdout:1/534: stat d1/d26/d3a/c7d 0 2024-09-18T12:52:09.949 INFO:tasks.workunit.client.0.smithi045.stdout:6/268: unlink d9/d30/f35 0 2024-09-18T12:52:09.951 INFO:tasks.workunit.client.1.smithi161.stdout:9/545: sync 2024-09-18T12:52:09.952 INFO:tasks.workunit.client.1.smithi161.stdout:1/535: read d1/fc [8274773,42680] 0 2024-09-18T12:52:09.953 INFO:tasks.workunit.client.1.smithi161.stdout:1/536: readlink d1/da/d1f/l22 0 2024-09-18T12:52:09.953 INFO:tasks.workunit.client.1.smithi161.stdout:8/666: mkdir d0/d3/d1e/dda 0 2024-09-18T12:52:09.956 INFO:tasks.workunit.client.0.smithi045.stdout:4/309: fsync db/d1b/f23 0 2024-09-18T12:52:09.961 INFO:tasks.workunit.client.1.smithi161.stdout:6/670: dwrite d4/d1a/d1c/d3e/d83/d9e/db1/d28/f35 [0,4194304] 0 2024-09-18T12:52:09.962 INFO:tasks.workunit.client.1.smithi161.stdout:6/671: chown d4/c7a 219060543 1 2024-09-18T12:52:09.963 INFO:tasks.workunit.client.0.smithi045.stdout:0/327: unlink d6/d7/c2b 0 2024-09-18T12:52:09.965 INFO:tasks.workunit.client.1.smithi161.stdout:4/683: mkdir d5/d14/d5f/da1/de9/df0 0 2024-09-18T12:52:09.966 INFO:tasks.workunit.client.1.smithi161.stdout:4/684: read d5/d27/d44/f88 [269614,76510] 0 2024-09-18T12:52:09.967 INFO:tasks.workunit.client.1.smithi161.stdout:4/685: truncate d5/d27/d44/de2/fb7 896590 0 2024-09-18T12:52:09.968 INFO:tasks.workunit.client.1.smithi161.stdout:4/686: chown d5/d14/d67/dc7/lb5 14 1 2024-09-18T12:52:09.969 INFO:tasks.workunit.client.1.smithi161.stdout:4/687: write d5/d14/d67/dc7/f7a [1753600,122262] 0 2024-09-18T12:52:09.969 INFO:tasks.workunit.client.0.smithi045.stdout:6/269: symlink d9/l5f 0 2024-09-18T12:52:09.971 INFO:tasks.workunit.client.0.smithi045.stdout:6/270: write d9/d30/f33 [727447,44353] 0 2024-09-18T12:52:09.971 INFO:tasks.workunit.client.1.smithi161.stdout:4/688: write d5/d32/d39/db6/fd9 [1341536,9052] 0 2024-09-18T12:52:09.971 INFO:tasks.workunit.client.0.smithi045.stdout:6/271: fsync d9/fc 0 2024-09-18T12:52:09.972 INFO:tasks.workunit.client.1.smithi161.stdout:9/546: dread - d0/d16/f76 zero size 2024-09-18T12:52:09.972 INFO:tasks.workunit.client.0.smithi045.stdout:0/328: unlink d6/d48/d5e/c54 0 2024-09-18T12:52:09.973 INFO:tasks.workunit.client.0.smithi045.stdout:0/329: chown d6/d7/d32 7523548 1 2024-09-18T12:52:09.973 INFO:tasks.workunit.client.0.smithi045.stdout:6/272: chown d9/d1a/d2d/d32/f4c 1430181 1 2024-09-18T12:52:09.975 INFO:tasks.workunit.client.1.smithi161.stdout:1/537: write d1/d1d/f57 [2667602,71165] 0 2024-09-18T12:52:09.976 INFO:tasks.workunit.client.1.smithi161.stdout:3/626: dwrite d1/d2e/d68/f87 [0,4194304] 0 2024-09-18T12:52:09.976 INFO:tasks.workunit.client.0.smithi045.stdout:4/310: truncate db/f30 1943501 0 2024-09-18T12:52:09.977 INFO:tasks.workunit.client.1.smithi161.stdout:2/672: creat d0/d1/d4c/de5/fe9 x:0 0 0 2024-09-18T12:52:09.977 INFO:tasks.workunit.client.1.smithi161.stdout:1/538: write d1/da/f18 [1773839,68959] 0 2024-09-18T12:52:09.978 INFO:tasks.workunit.client.1.smithi161.stdout:3/627: fsync d1/d2e/d24/d1d/d89/db0/fa2 0 2024-09-18T12:52:09.980 INFO:tasks.workunit.client.1.smithi161.stdout:1/539: dread d1/d26/d3a/d52/f59 [0,4194304] 0 2024-09-18T12:52:09.981 INFO:tasks.workunit.client.0.smithi045.stdout:0/330: write d6/d48/f4d [2724,24269] 0 2024-09-18T12:52:09.981 INFO:tasks.workunit.client.1.smithi161.stdout:6/672: creat d4/d61/d9d/da3/fdd x:0 0 0 2024-09-18T12:52:09.981 INFO:tasks.workunit.client.1.smithi161.stdout:1/540: write d1/da/d1f/f7a [426099,20578] 0 2024-09-18T12:52:09.982 INFO:tasks.workunit.client.1.smithi161.stdout:1/541: dread - d1/f97 zero size 2024-09-18T12:52:09.985 INFO:tasks.workunit.client.1.smithi161.stdout:0/646: rename df/d30/d71/d96/dd3/f64 to df/d30/d71/d96/dd3/d51/dc9/fe8 0 2024-09-18T12:52:09.986 INFO:tasks.workunit.client.1.smithi161.stdout:0/647: write df/d29/f8d [885065,69603] 0 2024-09-18T12:52:09.986 INFO:tasks.workunit.client.0.smithi045.stdout:6/273: symlink d9/l60 0 2024-09-18T12:52:09.987 INFO:tasks.workunit.client.1.smithi161.stdout:0/648: write df/d29/d36/fbb [282442,101962] 0 2024-09-18T12:52:09.988 INFO:tasks.workunit.client.1.smithi161.stdout:0/649: stat df/d30/d71/d96/dd3/d78/fd4 0 2024-09-18T12:52:09.990 INFO:tasks.workunit.client.0.smithi045.stdout:0/331: creat d6/d48/d5e/d39/d58/d3c/f60 x:0 0 0 2024-09-18T12:52:09.992 INFO:tasks.workunit.client.0.smithi045.stdout:4/311: link db/d2c/d35/f56 db/d2c/d35/d40/f68 0 2024-09-18T12:52:09.993 INFO:tasks.workunit.client.0.smithi045.stdout:4/312: chown db/de 337174 1 2024-09-18T12:52:09.996 INFO:tasks.workunit.client.0.smithi045.stdout:6/274: rename d9/d1a/d2d/d38/f49 to d9/d1a/d2d/d38/d5b/f61 0 2024-09-18T12:52:09.999 INFO:tasks.workunit.client.1.smithi161.stdout:5/588: sync 2024-09-18T12:52:09.999 INFO:tasks.workunit.client.0.smithi045.stdout:0/332: read - d6/d48/d5e/f44 zero size 2024-09-18T12:52:10.000 INFO:tasks.workunit.client.1.smithi161.stdout:5/589: readlink d3/l1f 0 2024-09-18T12:52:10.001 INFO:tasks.workunit.client.1.smithi161.stdout:3/628: dread d1/d2e/d24/d1d/f64 [0,4194304] 0 2024-09-18T12:52:10.002 INFO:tasks.workunit.client.0.smithi045.stdout:4/313: symlink db/de/d1e/d49/l69 0 2024-09-18T12:52:10.003 INFO:tasks.workunit.client.1.smithi161.stdout:3/629: write d1/d2e/d14/d65/f81 [4406571,96316] 0 2024-09-18T12:52:10.004 INFO:tasks.workunit.client.1.smithi161.stdout:0/650: dread df/de2/dc5/d86/f75 [0,4194304] 0 2024-09-18T12:52:10.004 INFO:tasks.workunit.client.1.smithi161.stdout:3/630: chown d1/f19 209 1 2024-09-18T12:52:10.006 INFO:tasks.workunit.client.0.smithi045.stdout:6/275: rmdir d9/d1a/d1d 39 2024-09-18T12:52:10.008 INFO:tasks.workunit.client.1.smithi161.stdout:4/689: dread d5/d27/f37 [0,4194304] 0 2024-09-18T12:52:10.009 INFO:tasks.workunit.client.1.smithi161.stdout:2/673: creat d0/d5/d43/d35/d98/de1/fea x:0 0 0 2024-09-18T12:52:10.014 INFO:tasks.workunit.client.1.smithi161.stdout:1/542: mknod d1/da/d39/cb1 0 2024-09-18T12:52:10.016 INFO:tasks.workunit.client.1.smithi161.stdout:6/673: dwrite d4/d61/d69/d87/fba [0,4194304] 0 2024-09-18T12:52:10.016 INFO:tasks.workunit.client.1.smithi161.stdout:9/547: write d0/db/fab [3462421,52218] 0 2024-09-18T12:52:10.017 INFO:tasks.workunit.client.0.smithi045.stdout:0/333: rename d6/d7/d32/c5d to d6/d48/d5e/c61 0 2024-09-18T12:52:10.018 INFO:tasks.workunit.client.0.smithi045.stdout:0/334: chown d6/d48/d5e/d39/d58/c2c 338 1 2024-09-18T12:52:10.019 INFO:tasks.workunit.client.0.smithi045.stdout:6/276: creat d9/d1a/d2d/d32/f62 x:0 0 0 2024-09-18T12:52:10.020 INFO:tasks.workunit.client.0.smithi045.stdout:6/277: stat d9/ff 0 2024-09-18T12:52:10.023 INFO:tasks.workunit.client.1.smithi161.stdout:3/631: creat d1/d2e/d68/fd6 x:0 0 0 2024-09-18T12:52:10.024 INFO:tasks.workunit.client.0.smithi045.stdout:4/314: write db/d1b/f23 [521359,22522] 0 2024-09-18T12:52:10.024 INFO:tasks.workunit.client.0.smithi045.stdout:6/278: mkdir d9/d56/d63 0 2024-09-18T12:52:10.025 INFO:tasks.workunit.client.1.smithi161.stdout:0/651: creat df/d30/d71/fe9 x:0 0 0 2024-09-18T12:52:10.026 INFO:tasks.workunit.client.0.smithi045.stdout:0/335: mknod d6/c62 0 2024-09-18T12:52:10.027 INFO:tasks.workunit.client.0.smithi045.stdout:0/336: chown d6/d48/d5e/d39/d58 9261962 1 2024-09-18T12:52:10.031 INFO:tasks.workunit.client.0.smithi045.stdout:0/337: getdents d6/d48/d4a 0 2024-09-18T12:52:10.032 INFO:tasks.workunit.client.1.smithi161.stdout:9/548: symlink d0/d16/d25/d86/lb2 0 2024-09-18T12:52:10.033 INFO:tasks.workunit.client.1.smithi161.stdout:6/674: creat d4/d1a/d1c/d3e/d83/d9e/db1/d45/fde x:0 0 0 2024-09-18T12:52:10.033 INFO:tasks.workunit.client.1.smithi161.stdout:6/675: dread - d4/d61/d9d/da3/fce zero size 2024-09-18T12:52:10.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:09 smithi045 ceph-mon[28315]: pgmap v27: 65 pgs: 65 active+clean; 1.7 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 229 MiB/s wr, 368 op/s 2024-09-18T12:52:10.034 INFO:tasks.workunit.client.1.smithi161.stdout:7/585: rename d3/d8/c12 to d3/d50/cac 0 2024-09-18T12:52:10.035 INFO:tasks.workunit.client.0.smithi045.stdout:0/338: fdatasync d6/d48/d5e/d39/d58/f28 0 2024-09-18T12:52:10.037 INFO:tasks.workunit.client.1.smithi161.stdout:3/632: unlink d1/d2e/d24/d1d/d89/db0/ccb 0 2024-09-18T12:52:10.039 INFO:tasks.workunit.client.1.smithi161.stdout:0/652: creat df/d30/d71/d96/dd3/d90/d37/dad/fea x:0 0 0 2024-09-18T12:52:10.041 INFO:tasks.workunit.client.0.smithi045.stdout:0/339: rmdir d6 39 2024-09-18T12:52:10.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:09 smithi161 ceph-mon[35784]: pgmap v27: 65 pgs: 65 active+clean; 1.7 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 229 MiB/s wr, 368 op/s 2024-09-18T12:52:10.042 INFO:tasks.workunit.client.1.smithi161.stdout:4/690: symlink d5/d14/d67/d84/dae/db8/lf1 0 2024-09-18T12:52:10.042 INFO:tasks.workunit.client.1.smithi161.stdout:1/543: mkdir d1/daa/db2 0 2024-09-18T12:52:10.043 INFO:tasks.workunit.client.0.smithi045.stdout:6/279: dread d9/f13 [0,4194304] 0 2024-09-18T12:52:10.044 INFO:tasks.workunit.client.0.smithi045.stdout:6/280: write d9/d30/f3e [492550,108596] 0 2024-09-18T12:52:10.045 INFO:tasks.workunit.client.0.smithi045.stdout:4/315: write db/de/d1e/d3e/d47/d59/d13/f5c [2518950,80857] 0 2024-09-18T12:52:10.045 INFO:tasks.workunit.client.0.smithi045.stdout:0/340: read - d6/d48/d5e/d39/d58/d3c/f46 zero size 2024-09-18T12:52:10.047 INFO:tasks.workunit.client.0.smithi045.stdout:0/341: readlink d6/d48/d5e/d39/d58/d3c/l49 0 2024-09-18T12:52:10.048 INFO:tasks.workunit.client.0.smithi045.stdout:0/342: chown d6/d48/d5e/d39/d58/d3c/l49 605575965 1 2024-09-18T12:52:10.049 INFO:tasks.workunit.client.0.smithi045.stdout:4/316: dread db/f63 [0,4194304] 0 2024-09-18T12:52:10.050 INFO:tasks.workunit.client.0.smithi045.stdout:0/343: write d6/d7/f1f [4657861,78864] 0 2024-09-18T12:52:10.051 INFO:tasks.workunit.client.0.smithi045.stdout:0/344: chown d6/d48/d5e/c4f 23931303 1 2024-09-18T12:52:10.053 INFO:tasks.workunit.client.1.smithi161.stdout:7/586: dwrite d3/d8/d15/da7/d24/d31/f34 [0,4194304] 0 2024-09-18T12:52:10.053 INFO:tasks.workunit.client.1.smithi161.stdout:2/674: rename d0/d1/d3b to d0/d1/deb 0 2024-09-18T12:52:10.059 INFO:tasks.workunit.client.0.smithi045.stdout:0/345: dwrite d6/d48/d5e/d39/d58/d3c/f47 [0,4194304] 0 2024-09-18T12:52:10.060 INFO:tasks.workunit.client.0.smithi045.stdout:0/346: stat d6/d48/d5e 0 2024-09-18T12:52:10.060 INFO:tasks.workunit.client.0.smithi045.stdout:4/317: creat db/de/f6a x:0 0 0 2024-09-18T12:52:10.062 INFO:tasks.workunit.client.1.smithi161.stdout:2/675: dwrite d0/d5/d43/d35/d98/ddf/f59 [0,4194304] 0 2024-09-18T12:52:10.063 INFO:tasks.workunit.client.1.smithi161.stdout:2/676: write d0/d5/d43/d23/fc3 [404664,113571] 0 2024-09-18T12:52:10.064 INFO:tasks.workunit.client.1.smithi161.stdout:6/676: write d4/fa [2019732,68836] 0 2024-09-18T12:52:10.066 INFO:tasks.workunit.client.0.smithi045.stdout:6/281: link d9/f13 d9/f64 0 2024-09-18T12:52:10.067 INFO:tasks.workunit.client.1.smithi161.stdout:0/653: write df/d29/d36/f5b [951568,17897] 0 2024-09-18T12:52:10.069 INFO:tasks.workunit.client.0.smithi045.stdout:0/347: dwrite d6/d7/f14 [0,4194304] 0 2024-09-18T12:52:10.070 INFO:tasks.workunit.client.0.smithi045.stdout:4/318: mkdir db/d20/d6b 0 2024-09-18T12:52:10.070 INFO:tasks.workunit.client.1.smithi161.stdout:7/587: creat d3/d36/fad x:0 0 0 2024-09-18T12:52:10.074 INFO:tasks.workunit.client.1.smithi161.stdout:9/549: dwrite d0/d16/d25/d46/d53/f7c [0,4194304] 0 2024-09-18T12:52:10.075 INFO:tasks.workunit.client.1.smithi161.stdout:8/667: rename d0/d3/d10/d21/d4a/d52/d66/f71 to d0/d3/d10/d21/d4a/d52/d82/d96/fdb 0 2024-09-18T12:52:10.078 INFO:tasks.workunit.client.1.smithi161.stdout:6/677: rmdir d4/d1a/d1c/d3e/d83/d9e/db1/d28 39 2024-09-18T12:52:10.079 INFO:tasks.workunit.client.0.smithi045.stdout:4/319: dwrite db/f21 [4194304,4194304] 0 2024-09-18T12:52:10.080 INFO:tasks.workunit.client.1.smithi161.stdout:0/654: mkdir df/d29/d36/d7a/deb 0 2024-09-18T12:52:10.083 INFO:tasks.workunit.client.0.smithi045.stdout:0/348: creat d6/f63 x:0 0 0 2024-09-18T12:52:10.086 INFO:tasks.workunit.client.0.smithi045.stdout:4/320: creat db/de/d1e/d3e/d47/d59/d2f/f6c x:0 0 0 2024-09-18T12:52:10.086 INFO:tasks.workunit.client.0.smithi045.stdout:4/321: chown db/d2c/l31 7 1 2024-09-18T12:52:10.086 INFO:tasks.workunit.client.1.smithi161.stdout:7/588: dwrite d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f90 [0,4194304] 0 2024-09-18T12:52:10.088 INFO:tasks.workunit.client.1.smithi161.stdout:4/691: dwrite d5/d14/d67/dc7/f58 [0,4194304] 0 2024-09-18T12:52:10.089 INFO:tasks.workunit.client.0.smithi045.stdout:4/322: truncate db/f63 1461883 0 2024-09-18T12:52:10.095 INFO:tasks.workunit.client.1.smithi161.stdout:5/590: rename d3/d9/f2d to d3/d44/d6f/fbc 0 2024-09-18T12:52:10.095 INFO:tasks.workunit.client.0.smithi045.stdout:0/349: mknod d6/d48/d5e/c64 0 2024-09-18T12:52:10.096 INFO:tasks.workunit.client.1.smithi161.stdout:5/591: stat d3/d8/c53 0 2024-09-18T12:52:10.097 INFO:tasks.workunit.client.0.smithi045.stdout:0/350: write d6/d7/f29 [240951,79102] 0 2024-09-18T12:52:10.098 INFO:tasks.workunit.client.0.smithi045.stdout:4/323: dwrite db/de/d1e/d3e/d47/d59/d13/f50 [0,4194304] 0 2024-09-18T12:52:10.100 INFO:tasks.workunit.client.0.smithi045.stdout:4/324: chown db/de/d1a/c58 1 1 2024-09-18T12:52:10.101 INFO:tasks.workunit.client.0.smithi045.stdout:4/325: stat db/de/d1e/d49 0 2024-09-18T12:52:10.105 INFO:tasks.workunit.client.0.smithi045.stdout:0/351: rmdir d6/d7/d32 39 2024-09-18T12:52:10.111 INFO:tasks.workunit.client.1.smithi161.stdout:1/544: getdents d1/da 0 2024-09-18T12:52:10.112 INFO:tasks.workunit.client.0.smithi045.stdout:0/352: mkdir d6/d48/d5e/d39/d58/d3b/d65 0 2024-09-18T12:52:10.115 INFO:tasks.workunit.client.0.smithi045.stdout:4/326: chown db/de/d1e/d49/f4e 2604 1 2024-09-18T12:52:10.116 INFO:tasks.workunit.client.1.smithi161.stdout:7/589: rmdir d3/d8 39 2024-09-18T12:52:10.116 INFO:tasks.workunit.client.1.smithi161.stdout:7/590: readlink d3/d50/l78 0 2024-09-18T12:52:10.117 INFO:tasks.workunit.client.0.smithi045.stdout:0/353: mkdir d6/d48/d5e/d39/d58/d66 0 2024-09-18T12:52:10.117 INFO:tasks.workunit.client.1.smithi161.stdout:9/550: symlink d0/d20/lb3 0 2024-09-18T12:52:10.118 INFO:tasks.workunit.client.1.smithi161.stdout:4/692: rmdir d5/d14/d67/dc7/d47/d49/d7b 39 2024-09-18T12:52:10.119 INFO:tasks.workunit.client.0.smithi045.stdout:0/354: readlink d6/l31 0 2024-09-18T12:52:10.120 INFO:tasks.workunit.client.0.smithi045.stdout:0/355: write d6/d35/f3e [2945648,98989] 0 2024-09-18T12:52:10.121 INFO:tasks.workunit.client.0.smithi045.stdout:4/327: fsync db/de/d1e/d3e/d47/d59/d13/f2b 0 2024-09-18T12:52:10.121 INFO:tasks.workunit.client.1.smithi161.stdout:5/592: mkdir d3/d3b/d54/dbd 0 2024-09-18T12:52:10.122 INFO:tasks.workunit.client.0.smithi045.stdout:4/328: readlink db/l38 0 2024-09-18T12:52:10.122 INFO:tasks.workunit.client.1.smithi161.stdout:5/593: dread - d3/d9/d4b/f99 zero size 2024-09-18T12:52:10.123 INFO:tasks.workunit.client.1.smithi161.stdout:2/677: link d0/d5/d43/d35/d80/l8f d0/d71/da9/dd6/de8/lec 0 2024-09-18T12:52:10.124 INFO:tasks.workunit.client.0.smithi045.stdout:0/356: symlink d6/d48/l67 0 2024-09-18T12:52:10.124 INFO:tasks.workunit.client.1.smithi161.stdout:5/594: write d3/d9/d4b/f99 [195807,116136] 0 2024-09-18T12:52:10.124 INFO:tasks.workunit.client.1.smithi161.stdout:4/693: dwrite d5/d27/d44/d61/d6c/fd1 [0,4194304] 0 2024-09-18T12:52:10.125 INFO:tasks.workunit.client.0.smithi045.stdout:0/357: fsync d6/d48/d5e/d39/d58/f59 0 2024-09-18T12:52:10.125 INFO:tasks.workunit.client.1.smithi161.stdout:2/678: write d0/d5/d43/d35/fa3 [440673,100278] 0 2024-09-18T12:52:10.127 INFO:tasks.workunit.client.1.smithi161.stdout:0/655: unlink df/d30/d71/d96/dd3/d51/la0 0 2024-09-18T12:52:10.128 INFO:tasks.workunit.client.1.smithi161.stdout:1/545: fdatasync d1/da/d39/f37 0 2024-09-18T12:52:10.133 INFO:tasks.workunit.client.0.smithi045.stdout:6/282: dread d9/d56/f57 [0,4194304] 0 2024-09-18T12:52:10.135 INFO:tasks.workunit.client.1.smithi161.stdout:8/668: link d0/d3/d10/d21/d4a/d52/f95 d0/d3/d10/d21/d4a/d52/fdc 0 2024-09-18T12:52:10.137 INFO:tasks.workunit.client.0.smithi045.stdout:4/329: getdents db 0 2024-09-18T12:52:10.138 INFO:tasks.workunit.client.1.smithi161.stdout:5/595: creat d3/d3b/d7b/fbe x:0 0 0 2024-09-18T12:52:10.143 INFO:tasks.workunit.client.1.smithi161.stdout:2/679: mkdir d0/d5/d43/d23/ded 0 2024-09-18T12:52:10.144 INFO:tasks.workunit.client.0.smithi045.stdout:6/283: symlink d9/d1a/d48/l65 0 2024-09-18T12:52:10.145 INFO:tasks.workunit.client.1.smithi161.stdout:6/678: truncate d4/d39/d26/d31/f59 954783 0 2024-09-18T12:52:10.145 INFO:tasks.workunit.client.0.smithi045.stdout:0/358: write d6/d7/d32/f33 [497289,22] 0 2024-09-18T12:52:10.147 INFO:tasks.workunit.client.0.smithi045.stdout:6/284: mknod d9/d1a/d2d/d38/d5b/c66 0 2024-09-18T12:52:10.150 INFO:tasks.workunit.client.0.smithi045.stdout:0/359: creat d6/d48/d5e/d39/d58/f68 x:0 0 0 2024-09-18T12:52:10.151 INFO:tasks.workunit.client.0.smithi045.stdout:6/285: mkdir d9/d1a/d2d/d38/d5b/d67 0 2024-09-18T12:52:10.155 INFO:tasks.workunit.client.1.smithi161.stdout:1/546: creat d1/da/fb3 x:0 0 0 2024-09-18T12:52:10.155 INFO:tasks.workunit.client.1.smithi161.stdout:9/551: symlink d0/db/lb4 0 2024-09-18T12:52:10.155 INFO:tasks.workunit.client.0.smithi045.stdout:4/330: dwrite db/d1b/d43/f4c [0,4194304] 0 2024-09-18T12:52:10.156 INFO:tasks.workunit.client.1.smithi161.stdout:3/633: rename d1/d2e/d24/d1d/f64 to d1/fd7 0 2024-09-18T12:52:10.156 INFO:tasks.workunit.client.1.smithi161.stdout:1/547: chown d1/d26/dad 0 1 2024-09-18T12:52:10.156 INFO:tasks.workunit.client.1.smithi161.stdout:8/669: stat d0/c3c 0 2024-09-18T12:52:10.156 INFO:tasks.workunit.client.1.smithi161.stdout:4/694: truncate d5/d32/d39/d4d/f78 378738 0 2024-09-18T12:52:10.158 INFO:tasks.workunit.client.0.smithi045.stdout:6/286: creat d9/f68 x:0 0 0 2024-09-18T12:52:10.161 INFO:tasks.workunit.client.0.smithi045.stdout:4/331: mkdir db/d2c/d35/d40/d6d 0 2024-09-18T12:52:10.164 INFO:tasks.workunit.client.1.smithi161.stdout:6/679: mkdir d4/d1a/d1c/d3e/d83/d9e/db1/d45/ddf 0 2024-09-18T12:52:10.171 INFO:tasks.workunit.client.1.smithi161.stdout:9/552: creat d0/d20/d49/fb5 x:0 0 0 2024-09-18T12:52:10.172 INFO:tasks.workunit.client.1.smithi161.stdout:2/680: mkdir d0/d5/d43/d35/dee 0 2024-09-18T12:52:10.175 INFO:tasks.workunit.client.1.smithi161.stdout:1/548: truncate d1/d26/f2e 811547 0 2024-09-18T12:52:10.177 INFO:tasks.workunit.client.0.smithi045.stdout:6/287: dread d9/f51 [0,4194304] 0 2024-09-18T12:52:10.179 INFO:tasks.workunit.client.1.smithi161.stdout:5/596: dwrite d3/f6a [4194304,4194304] 0 2024-09-18T12:52:10.179 INFO:tasks.workunit.client.1.smithi161.stdout:5/597: write d3/d14/f84 [478769,93331] 0 2024-09-18T12:52:10.183 INFO:tasks.workunit.client.0.smithi045.stdout:6/288: mknod d9/d1a/d2d/d38/d5b/d67/c69 0 2024-09-18T12:52:10.184 INFO:tasks.workunit.client.0.smithi045.stdout:6/289: write d9/d1a/d2d/f4a [283392,106412] 0 2024-09-18T12:52:10.185 INFO:tasks.workunit.client.1.smithi161.stdout:7/591: truncate d3/d8/d15/da7/f39 1632095 0 2024-09-18T12:52:10.185 INFO:tasks.workunit.client.1.smithi161.stdout:7/592: chown d3/d8/d4b 702845867 1 2024-09-18T12:52:10.185 INFO:tasks.workunit.client.1.smithi161.stdout:3/634: creat d1/d2e/d14/d90/fd8 x:0 0 0 2024-09-18T12:52:10.186 INFO:tasks.workunit.client.1.smithi161.stdout:3/635: write d1/d2e/d14/d90/fbf [2828109,28000] 0 2024-09-18T12:52:10.187 INFO:tasks.workunit.client.1.smithi161.stdout:3/636: fdatasync d1/d2e/d3d/f9b 0 2024-09-18T12:52:10.187 INFO:tasks.workunit.client.1.smithi161.stdout:8/670: rename d0/l19 to d0/d3/d10/d21/d4a/d52/d82/ldd 0 2024-09-18T12:52:10.191 INFO:tasks.workunit.client.0.smithi045.stdout:4/332: dwrite db/de/d1e/d3e/d47/d59/d2f/f36 [0,4194304] 0 2024-09-18T12:52:10.191 INFO:tasks.workunit.client.1.smithi161.stdout:6/680: creat d4/d1a/d1c/d3e/d83/d9e/db1/d45/dd6/fe0 x:0 0 0 2024-09-18T12:52:10.191 INFO:tasks.workunit.client.1.smithi161.stdout:6/681: stat d4/l7 0 2024-09-18T12:52:10.192 INFO:tasks.workunit.client.1.smithi161.stdout:6/682: dread - d4/d1a/d1c/d3e/d83/fd8 zero size 2024-09-18T12:52:10.198 INFO:tasks.workunit.client.0.smithi045.stdout:4/333: readlink l1 0 2024-09-18T12:52:10.200 INFO:tasks.workunit.client.1.smithi161.stdout:2/681: mkdir d0/d71/da9/def 0 2024-09-18T12:52:10.202 INFO:tasks.workunit.client.0.smithi045.stdout:4/334: read db/de/d1e/d3e/d47/d59/f66 [1787137,114538] 0 2024-09-18T12:52:10.204 INFO:tasks.workunit.client.1.smithi161.stdout:1/549: write d1/da/d39/f61 [2281709,18650] 0 2024-09-18T12:52:10.205 INFO:tasks.workunit.client.1.smithi161.stdout:7/593: truncate d3/d8/d15/da7/d24/d31/f62 630579 0 2024-09-18T12:52:10.206 INFO:tasks.workunit.client.1.smithi161.stdout:7/594: chown d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f7f 14 1 2024-09-18T12:52:10.208 INFO:tasks.workunit.client.1.smithi161.stdout:3/637: unlink d1/d2e/d24/d1d/d89/fab 0 2024-09-18T12:52:10.210 INFO:tasks.workunit.client.1.smithi161.stdout:8/671: creat d0/d3/d10/d21/d4a/d52/d66/fde x:0 0 0 2024-09-18T12:52:10.210 INFO:tasks.workunit.client.1.smithi161.stdout:9/553: write d0/db/d18/f69 [904091,11592] 0 2024-09-18T12:52:10.210 INFO:tasks.workunit.client.1.smithi161.stdout:0/656: sync 2024-09-18T12:52:10.211 INFO:tasks.workunit.client.1.smithi161.stdout:0/657: write df/d30/d71/d96/fd0 [409687,10184] 0 2024-09-18T12:52:10.213 INFO:tasks.workunit.client.0.smithi045.stdout:4/335: getdents db/d1b 0 2024-09-18T12:52:10.216 INFO:tasks.workunit.client.0.smithi045.stdout:4/336: symlink db/de/d1e/l6e 0 2024-09-18T12:52:10.217 INFO:tasks.workunit.client.0.smithi045.stdout:4/337: chown db 335541306 1 2024-09-18T12:52:10.218 INFO:tasks.workunit.client.1.smithi161.stdout:1/550: mknod d1/d26/d88/cb4 0 2024-09-18T12:52:10.219 INFO:tasks.workunit.client.1.smithi161.stdout:7/595: creat d3/d8/d15/da7/d24/d31/fae x:0 0 0 2024-09-18T12:52:10.222 INFO:tasks.workunit.client.1.smithi161.stdout:4/695: link d5/d14/d67/d84/c7f d5/d14/d67/dc7/d47/d49/cf2 0 2024-09-18T12:52:10.224 INFO:tasks.workunit.client.1.smithi161.stdout:9/554: creat d0/d16/d25/d46/fb6 x:0 0 0 2024-09-18T12:52:10.228 INFO:tasks.workunit.client.1.smithi161.stdout:5/598: link d3/d8/l90 d3/d3b/d54/lbf 0 2024-09-18T12:52:10.232 INFO:tasks.workunit.client.1.smithi161.stdout:1/551: creat d1/d48/fb5 x:0 0 0 2024-09-18T12:52:10.233 INFO:tasks.workunit.client.1.smithi161.stdout:7/596: mkdir d3/d8/d15/da7/d24/daf 0 2024-09-18T12:52:10.234 INFO:tasks.workunit.client.1.smithi161.stdout:3/638: mkdir d1/d2e/d68/d92/dba/dd9 0 2024-09-18T12:52:10.235 INFO:tasks.workunit.client.1.smithi161.stdout:4/696: mkdir d5/d27/d44/df3 0 2024-09-18T12:52:10.238 INFO:tasks.workunit.client.1.smithi161.stdout:6/683: rename d4/d39/d47/d51/lb5 to d4/d39/d47/le1 0 2024-09-18T12:52:10.238 INFO:tasks.workunit.client.1.smithi161.stdout:6/684: write d4/d1a/f11 [348903,48577] 0 2024-09-18T12:52:10.239 INFO:tasks.workunit.client.1.smithi161.stdout:0/658: symlink df/de2/dc5/dca/lec 0 2024-09-18T12:52:10.239 INFO:tasks.workunit.client.1.smithi161.stdout:2/682: link d0/d1/deb/d3d/l65 d0/d1/d4c/d67/db9/lf0 0 2024-09-18T12:52:10.240 INFO:tasks.workunit.client.1.smithi161.stdout:2/683: fdatasync d0/d5/d43/d35/d98/ddf/f59 0 2024-09-18T12:52:10.241 INFO:tasks.workunit.client.1.smithi161.stdout:1/552: write d1/da/d31/f53 [1444735,23569] 0 2024-09-18T12:52:10.242 INFO:tasks.workunit.client.1.smithi161.stdout:7/597: fdatasync d3/d8/d15/da7/d4a/d59/f60 0 2024-09-18T12:52:10.245 INFO:tasks.workunit.client.0.smithi045.stdout:4/338: dwrite db/f30 [0,4194304] 0 2024-09-18T12:52:10.245 INFO:tasks.workunit.client.1.smithi161.stdout:3/639: creat d1/d2e/d68/d69/d7d/fda x:0 0 0 2024-09-18T12:52:10.245 INFO:tasks.workunit.client.0.smithi045.stdout:4/339: stat db/d1b/l4a 0 2024-09-18T12:52:10.246 INFO:tasks.workunit.client.1.smithi161.stdout:9/555: creat d0/d20/d49/d65/fb7 x:0 0 0 2024-09-18T12:52:10.246 INFO:tasks.workunit.client.0.smithi045.stdout:4/340: stat db/de/f6a 0 2024-09-18T12:52:10.247 INFO:tasks.workunit.client.1.smithi161.stdout:9/556: write d0/d20/d49/d65/fb7 [676313,115998] 0 2024-09-18T12:52:10.252 INFO:tasks.workunit.client.0.smithi045.stdout:4/341: mkdir db/d1b/d6f 0 2024-09-18T12:52:10.255 INFO:tasks.workunit.client.0.smithi045.stdout:4/342: creat db/d20/f70 x:0 0 0 2024-09-18T12:52:10.256 INFO:tasks.workunit.client.0.smithi045.stdout:4/343: chown db/de/d1a/c3c 260266886 1 2024-09-18T12:52:10.257 INFO:tasks.workunit.client.0.smithi045.stdout:4/344: write db/f30 [2956853,100056] 0 2024-09-18T12:52:10.257 INFO:tasks.workunit.client.1.smithi161.stdout:0/659: unlink df/d30/d4d/lb4 0 2024-09-18T12:52:10.262 INFO:tasks.workunit.client.0.smithi045.stdout:4/345: symlink db/de/d1e/d3e/d47/l71 0 2024-09-18T12:52:10.262 INFO:tasks.workunit.client.1.smithi161.stdout:2/684: stat d0/d71/da9/d9f/la7 0 2024-09-18T12:52:10.263 INFO:tasks.workunit.client.1.smithi161.stdout:2/685: dread - d0/d5/d43/d35/d80/fca zero size 2024-09-18T12:52:10.264 INFO:tasks.workunit.client.1.smithi161.stdout:1/553: fsync d1/da/d39/f37 0 2024-09-18T12:52:10.271 INFO:tasks.workunit.client.1.smithi161.stdout:3/640: creat d1/d2e/d14/d2c/d72/fdb x:0 0 0 2024-09-18T12:52:10.272 INFO:tasks.workunit.client.0.smithi045.stdout:4/346: link db/d2c/d35/c57 db/de/d1e/d49/c72 0 2024-09-18T12:52:10.273 INFO:tasks.workunit.client.1.smithi161.stdout:4/697: mknod d5/d14/d67/dc7/d47/d49/d7b/cf4 0 2024-09-18T12:52:10.274 INFO:tasks.workunit.client.1.smithi161.stdout:4/698: write d5/d27/d44/d61/d6c/d8f/fa3 [1030978,107175] 0 2024-09-18T12:52:10.275 INFO:tasks.workunit.client.1.smithi161.stdout:8/672: rename d0/d3/d10/d21/d4a/d52/d94/lbb to d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/ldf 0 2024-09-18T12:52:10.276 INFO:tasks.workunit.client.0.smithi045.stdout:4/347: dread db/de/d1e/f2d [0,4194304] 0 2024-09-18T12:52:10.276 INFO:tasks.workunit.client.1.smithi161.stdout:6/685: symlink d4/d1a/d1c/d3e/d83/d9e/db1/le2 0 2024-09-18T12:52:10.279 INFO:tasks.workunit.client.0.smithi045.stdout:4/348: mkdir db/de/d1e/d3e/d47/d59/d13/d73 0 2024-09-18T12:52:10.279 INFO:tasks.workunit.client.0.smithi045.stdout:4/349: stat db/f63 0 2024-09-18T12:52:10.281 INFO:tasks.workunit.client.0.smithi045.stdout:4/350: creat db/de/d1e/d3e/d47/d59/f74 x:0 0 0 2024-09-18T12:52:10.282 INFO:tasks.workunit.client.0.smithi045.stdout:4/351: readlink db/de/d1e/d49/l69 0 2024-09-18T12:52:10.284 INFO:tasks.workunit.client.0.smithi045.stdout:4/352: unlink db/d2c/l31 0 2024-09-18T12:52:10.285 INFO:tasks.workunit.client.0.smithi045.stdout:4/353: write f9 [2760797,21321] 0 2024-09-18T12:52:10.287 INFO:tasks.workunit.client.0.smithi045.stdout:4/354: write db/de/d1e/d3e/d47/d59/d13/f50 [489102,93860] 0 2024-09-18T12:52:10.293 INFO:tasks.workunit.client.0.smithi045.stdout:4/355: dwrite db/de/d1e/d49/f64 [0,4194304] 0 2024-09-18T12:52:10.313 INFO:tasks.workunit.client.1.smithi161.stdout:7/598: mkdir d3/d8/d15/d99/db0 0 2024-09-18T12:52:10.313 INFO:tasks.workunit.client.1.smithi161.stdout:9/557: mknod d0/d20/cb8 0 2024-09-18T12:52:10.314 INFO:tasks.workunit.client.1.smithi161.stdout:4/699: mkdir d5/d27/d44/d61/d6c/d8f/df5 0 2024-09-18T12:52:10.314 INFO:tasks.workunit.client.1.smithi161.stdout:8/673: mkdir d0/d3/d10/d21/d4a/d52/d66/d5b/de0 0 2024-09-18T12:52:10.315 INFO:tasks.workunit.client.1.smithi161.stdout:9/558: read - d0/d16/d25/d46/fb6 zero size 2024-09-18T12:52:10.318 INFO:tasks.workunit.client.1.smithi161.stdout:1/554: dwrite d1/da/f16 [0,4194304] 0 2024-09-18T12:52:10.335 INFO:tasks.workunit.client.1.smithi161.stdout:5/599: sync 2024-09-18T12:52:10.336 INFO:tasks.workunit.client.1.smithi161.stdout:5/600: readlink d3/d9/d4b/d8e/d24/d61/l7c 0 2024-09-18T12:52:10.376 INFO:tasks.workunit.client.1.smithi161.stdout:2/686: sync 2024-09-18T12:52:10.377 INFO:tasks.workunit.client.1.smithi161.stdout:2/687: read d0/d1/deb/d7e/f70 [2013711,16098] 0 2024-09-18T12:52:10.378 INFO:tasks.workunit.client.1.smithi161.stdout:2/688: stat d0/d1/l14 0 2024-09-18T12:52:10.379 INFO:tasks.workunit.client.1.smithi161.stdout:2/689: write d0/d5/d43/d35/d98/ddf/d8b/f8c [1250994,126786] 0 2024-09-18T12:52:10.401 INFO:tasks.workunit.client.1.smithi161.stdout:7/599: sync 2024-09-18T12:52:10.435 INFO:tasks.workunit.client.0.smithi045.stdout:4/356: mkdir db/de/d1e/d3e/d47/d59/d13/d73/d75 0 2024-09-18T12:52:10.440 INFO:tasks.workunit.client.0.smithi045.stdout:4/357: dread db/de/d1e/d3e/d47/d59/d13/f5c [0,4194304] 0 2024-09-18T12:52:10.441 INFO:tasks.workunit.client.0.smithi045.stdout:4/358: chown db/d20/c55 474272239 1 2024-09-18T12:52:10.442 INFO:tasks.workunit.client.1.smithi161.stdout:4/700: chown d5/l2b 7877 1 2024-09-18T12:52:10.443 INFO:tasks.workunit.client.1.smithi161.stdout:0/660: link df/d30/d71/d96/dd3/d90/d37/d55/l5e df/d30/d71/d96/dd3/d90/d69/led 0 2024-09-18T12:52:10.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/701: dwrite d5/d32/f53 [0,4194304] 0 2024-09-18T12:52:10.447 INFO:tasks.workunit.client.0.smithi045.stdout:4/359: rename db/d1b/d43 to db/d2c/d35/d40/d76 0 2024-09-18T12:52:10.448 INFO:tasks.workunit.client.0.smithi045.stdout:4/360: dread - db/de/d1e/d3e/d47/d59/f74 zero size 2024-09-18T12:52:10.449 INFO:tasks.workunit.client.0.smithi045.stdout:4/361: chown db/de/d1e/d3e/d47 1 1 2024-09-18T12:52:10.459 INFO:tasks.workunit.client.1.smithi161.stdout:7/600: rename d3/d8/d15/da7/d4a/d59/f60 to d3/d8/d15/da7/d4a/fb1 0 2024-09-18T12:52:10.460 INFO:tasks.workunit.client.1.smithi161.stdout:6/686: fsync d4/d1a/d1c/d3e/d83/d9e/db1/d28/f3d 0 2024-09-18T12:52:10.461 INFO:tasks.workunit.client.1.smithi161.stdout:7/601: dread d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/f94 [0,4194304] 0 2024-09-18T12:52:10.464 INFO:tasks.workunit.client.1.smithi161.stdout:8/674: link d0/d3/d10/f22 d0/d3/d1e/dda/fe1 0 2024-09-18T12:52:10.465 INFO:tasks.workunit.client.0.smithi045.stdout:4/362: rename db/d2c/d35/d40/d76 to db/d2c/d35/d40/d77 0 2024-09-18T12:52:10.467 INFO:tasks.workunit.client.1.smithi161.stdout:4/702: unlink d5/d14/d67/dc7/d47/d49/d7b/fdf 0 2024-09-18T12:52:10.468 INFO:tasks.workunit.client.0.smithi045.stdout:4/363: mkdir db/de/d1e/d3e/d78 0 2024-09-18T12:52:10.471 INFO:tasks.workunit.client.1.smithi161.stdout:1/555: fsync d1/da/d31/f3c 0 2024-09-18T12:52:10.471 INFO:tasks.workunit.client.1.smithi161.stdout:5/601: mknod d3/d9/cc0 0 2024-09-18T12:52:10.472 INFO:tasks.workunit.client.1.smithi161.stdout:4/703: read d5/d27/d44/d61/d6c/fd1 [1098421,33755] 0 2024-09-18T12:52:10.473 INFO:tasks.workunit.client.1.smithi161.stdout:0/661: rename df/d30/d4d/c4e to df/d30/d4d/d92/cee 0 2024-09-18T12:52:10.475 INFO:tasks.workunit.client.1.smithi161.stdout:2/690: dwrite d0/d5/f74 [0,4194304] 0 2024-09-18T12:52:10.476 INFO:tasks.workunit.client.0.smithi045.stdout:4/364: dwrite db/de/d1e/d3e/d47/d59/f74 [0,4194304] 0 2024-09-18T12:52:10.476 INFO:tasks.workunit.client.1.smithi161.stdout:6/687: write d4/d1a/d1c/f2c [554233,27505] 0 2024-09-18T12:52:10.478 INFO:tasks.workunit.client.0.smithi045.stdout:4/365: read db/d1b/f23 [194788,36366] 0 2024-09-18T12:52:10.484 INFO:tasks.workunit.client.1.smithi161.stdout:7/602: dwrite d3/f2e [0,4194304] 0 2024-09-18T12:52:10.486 INFO:tasks.workunit.client.0.smithi045.stdout:4/366: creat db/d2c/d35/d40/f79 x:0 0 0 2024-09-18T12:52:10.487 INFO:tasks.workunit.client.1.smithi161.stdout:7/603: dread - d3/d8/d15/da7/d24/d31/f71 zero size 2024-09-18T12:52:10.510 INFO:tasks.workunit.client.1.smithi161.stdout:9/559: link d0/d16/d25/d46/d53/d59/c96 d0/d93/cb9 0 2024-09-18T12:52:10.511 INFO:tasks.workunit.client.1.smithi161.stdout:9/560: readlink d0/db/d18/l34 0 2024-09-18T12:52:10.512 INFO:tasks.workunit.client.1.smithi161.stdout:5/602: rmdir d3/d14 39 2024-09-18T12:52:10.512 INFO:tasks.workunit.client.1.smithi161.stdout:1/556: write d1/d26/d3a/f5d [2472761,16509] 0 2024-09-18T12:52:10.513 INFO:tasks.workunit.client.1.smithi161.stdout:4/704: creat d5/d32/d39/db6/ff6 x:0 0 0 2024-09-18T12:52:10.515 INFO:tasks.workunit.client.1.smithi161.stdout:3/641: getdents d1/d2e/d24/d84/d9a 0 2024-09-18T12:52:10.516 INFO:tasks.workunit.client.1.smithi161.stdout:6/688: stat d4/d39/d47/le1 0 2024-09-18T12:52:10.517 INFO:tasks.workunit.client.1.smithi161.stdout:8/675: mkdir d0/d3/d10/d21/d4a/d52/de2 0 2024-09-18T12:52:10.517 INFO:tasks.workunit.client.1.smithi161.stdout:7/604: mknod d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/cb2 0 2024-09-18T12:52:10.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/605: readlink d3/d8/d15/da7/d4a/d64/l86 0 2024-09-18T12:52:10.521 INFO:tasks.workunit.client.1.smithi161.stdout:5/603: mknod d3/d9/d4b/d8e/d24/db8/cc1 0 2024-09-18T12:52:10.521 INFO:tasks.workunit.client.1.smithi161.stdout:5/604: stat d3/d3b 0 2024-09-18T12:52:10.522 INFO:tasks.workunit.client.1.smithi161.stdout:0/662: symlink df/d30/d71/d96/dd3/d90/d37/lef 0 2024-09-18T12:52:10.524 INFO:tasks.workunit.client.1.smithi161.stdout:7/606: fdatasync d3/d8/d15/da7/d24/f51 0 2024-09-18T12:52:10.526 INFO:tasks.workunit.client.1.smithi161.stdout:9/561: symlink d0/d16/d25/d28/lba 0 2024-09-18T12:52:10.526 INFO:tasks.workunit.client.1.smithi161.stdout:1/557: mkdir d1/d26/dad/db6 0 2024-09-18T12:52:10.527 INFO:tasks.workunit.client.1.smithi161.stdout:5/605: symlink d3/d9/d4b/d8e/d24/lc2 0 2024-09-18T12:52:10.528 INFO:tasks.workunit.client.1.smithi161.stdout:5/606: dread - d3/d9/d4b/d8e/f8a zero size 2024-09-18T12:52:10.528 INFO:tasks.workunit.client.1.smithi161.stdout:4/705: symlink d5/d14/d67/dc7/d4c/lf7 0 2024-09-18T12:52:10.532 INFO:tasks.workunit.client.1.smithi161.stdout:9/562: mknod d0/d93/da0/cbb 0 2024-09-18T12:52:10.533 INFO:tasks.workunit.client.1.smithi161.stdout:9/563: stat d0/d20/d49/f14 0 2024-09-18T12:52:10.535 INFO:tasks.workunit.client.1.smithi161.stdout:7/607: rename d3/f4 to d3/fb3 0 2024-09-18T12:52:10.536 INFO:tasks.workunit.client.1.smithi161.stdout:8/676: dread d0/d3/d10/d21/d4a/d52/d82/d96/d98/f25 [0,4194304] 0 2024-09-18T12:52:10.536 INFO:tasks.workunit.client.1.smithi161.stdout:1/558: rename d1/d48/l55 to d1/d1d/lb7 0 2024-09-18T12:52:10.537 INFO:tasks.workunit.client.1.smithi161.stdout:0/663: mkdir df/d29/d36/d7a/deb/df0 0 2024-09-18T12:52:10.540 INFO:tasks.workunit.client.1.smithi161.stdout:8/677: dread d0/f2a [0,4194304] 0 2024-09-18T12:52:10.541 INFO:tasks.workunit.client.1.smithi161.stdout:5/607: rename c1 to d3/d44/d6f/cc3 0 2024-09-18T12:52:10.542 INFO:tasks.workunit.client.1.smithi161.stdout:5/608: dread - d3/d3b/fb7 zero size 2024-09-18T12:52:10.542 INFO:tasks.workunit.client.1.smithi161.stdout:1/559: chown d1/da/d1f/d45/c68 7890842 1 2024-09-18T12:52:10.542 INFO:tasks.workunit.client.1.smithi161.stdout:4/706: getdents d5/d32 0 2024-09-18T12:52:10.544 INFO:tasks.workunit.client.1.smithi161.stdout:9/564: creat d0/db/fbc x:0 0 0 2024-09-18T12:52:10.546 INFO:tasks.workunit.client.1.smithi161.stdout:5/609: write d3/d9/d4b/f9c [1755918,78424] 0 2024-09-18T12:52:10.548 INFO:tasks.workunit.client.1.smithi161.stdout:9/565: readlink d0/d16/l58 0 2024-09-18T12:52:10.549 INFO:tasks.workunit.client.1.smithi161.stdout:6/689: dwrite d4/d61/f66 [0,4194304] 0 2024-09-18T12:52:10.554 INFO:tasks.workunit.client.1.smithi161.stdout:5/610: dwrite d3/d8/f73 [0,4194304] 0 2024-09-18T12:52:10.555 INFO:tasks.workunit.client.1.smithi161.stdout:0/664: rename df/d30/d71/d96/dd3/d90/ccb to df/d30/d71/d96/dd3/cf1 0 2024-09-18T12:52:10.556 INFO:tasks.workunit.client.1.smithi161.stdout:1/560: creat d1/fb8 x:0 0 0 2024-09-18T12:52:10.557 INFO:tasks.workunit.client.1.smithi161.stdout:9/566: symlink d0/d47/d48/d7f/lbd 0 2024-09-18T12:52:10.557 INFO:tasks.workunit.client.1.smithi161.stdout:1/561: chown d1/da/d39/c4d 2640 1 2024-09-18T12:52:10.558 INFO:tasks.workunit.client.1.smithi161.stdout:9/567: write d0/db/d18/f36 [1872734,121262] 0 2024-09-18T12:52:10.560 INFO:tasks.workunit.client.1.smithi161.stdout:7/608: truncate d3/d8/d15/da7/d24/d31/f34 398257 0 2024-09-18T12:52:10.561 INFO:tasks.workunit.client.1.smithi161.stdout:7/609: write d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/d9b/f9c [481233,3781] 0 2024-09-18T12:52:10.562 INFO:tasks.workunit.client.1.smithi161.stdout:6/690: symlink d4/d1a/d1c/d3e/d83/da2/db4/le3 0 2024-09-18T12:52:10.563 INFO:tasks.workunit.client.1.smithi161.stdout:8/678: truncate d0/f12 2679199 0 2024-09-18T12:52:10.565 INFO:tasks.workunit.client.1.smithi161.stdout:4/707: link d5/d14/d67/dc7/d47/d49/cf2 d5/da9/de7/cf8 0 2024-09-18T12:52:10.568 INFO:tasks.workunit.client.1.smithi161.stdout:0/665: unlink df/d29/d36/d94/fd2 0 2024-09-18T12:52:10.569 INFO:tasks.workunit.client.1.smithi161.stdout:6/691: mknod d4/d1a/d1c/d3e/d83/d9e/ce4 0 2024-09-18T12:52:10.570 INFO:tasks.workunit.client.1.smithi161.stdout:1/562: mknod d1/cb9 0 2024-09-18T12:52:10.574 INFO:tasks.workunit.client.1.smithi161.stdout:7/610: mknod d3/d8/d15/cb4 0 2024-09-18T12:52:10.581 INFO:tasks.workunit.client.1.smithi161.stdout:8/679: mkdir d0/d3/d1e/dda/de3 0 2024-09-18T12:52:10.583 INFO:tasks.workunit.client.1.smithi161.stdout:6/692: fsync d4/d1a/f13 0 2024-09-18T12:52:10.585 INFO:tasks.workunit.client.1.smithi161.stdout:6/693: write d4/d1a/d1c/d3e/fcd [657291,68560] 0 2024-09-18T12:52:10.586 INFO:tasks.workunit.client.1.smithi161.stdout:6/694: write d4/fa [1889533,35312] 0 2024-09-18T12:52:10.587 INFO:tasks.workunit.client.1.smithi161.stdout:0/666: dread df/f2b [0,4194304] 0 2024-09-18T12:52:10.587 INFO:tasks.workunit.client.1.smithi161.stdout:6/695: fdatasync d4/d39/d47/d51/f93 0 2024-09-18T12:52:10.588 INFO:tasks.workunit.client.1.smithi161.stdout:0/667: write df/d30/d71/d96/dd3/d90/f88 [2761230,54225] 0 2024-09-18T12:52:10.589 INFO:tasks.workunit.client.1.smithi161.stdout:0/668: stat df/d98 0 2024-09-18T12:52:10.589 INFO:tasks.workunit.client.1.smithi161.stdout:9/568: creat d0/d16/d25/d28/fbe x:0 0 0 2024-09-18T12:52:10.590 INFO:tasks.workunit.client.1.smithi161.stdout:7/611: readlink d3/d8/l87 0 2024-09-18T12:52:10.593 INFO:tasks.workunit.client.1.smithi161.stdout:6/696: creat d4/d39/d47/d51/fe5 x:0 0 0 2024-09-18T12:52:10.594 INFO:tasks.workunit.client.1.smithi161.stdout:7/612: dwrite d3/f75 [0,4194304] 0 2024-09-18T12:52:10.621 INFO:tasks.workunit.client.1.smithi161.stdout:0/669: read df/d29/d36/f5b [1396693,6338] 0 2024-09-18T12:52:10.621 INFO:tasks.workunit.client.1.smithi161.stdout:4/708: write d5/f2c [1992743,39933] 0 2024-09-18T12:52:10.621 INFO:tasks.workunit.client.1.smithi161.stdout:9/569: symlink d0/d20/lbf 0 2024-09-18T12:52:10.622 INFO:tasks.workunit.client.1.smithi161.stdout:8/680: truncate d0/d3/d10/d21/d4a/d52/d82/d96/d98/f90 4066677 0 2024-09-18T12:52:10.622 INFO:tasks.workunit.client.1.smithi161.stdout:0/670: chown df/d29/d36/d94 19 1 2024-09-18T12:52:10.623 INFO:tasks.workunit.client.1.smithi161.stdout:7/613: rmdir d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/d89 39 2024-09-18T12:52:10.624 INFO:tasks.workunit.client.1.smithi161.stdout:8/681: fdatasync d0/d3/fc3 0 2024-09-18T12:52:10.626 INFO:tasks.workunit.client.1.smithi161.stdout:0/671: dread df/d30/f80 [0,4194304] 0 2024-09-18T12:52:10.627 INFO:tasks.workunit.client.1.smithi161.stdout:4/709: link d5/d14/d6d/l94 d5/d32/d39/db6/lf9 0 2024-09-18T12:52:10.630 INFO:tasks.workunit.client.1.smithi161.stdout:7/614: link d3/c28 d3/d8/cb5 0 2024-09-18T12:52:10.631 INFO:tasks.workunit.client.1.smithi161.stdout:6/697: dwrite d4/d1a/d1c/d3e/d83/d9e/db1/d45/dd6/fe0 [0,4194304] 0 2024-09-18T12:52:10.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/710: chown d5/d14/d67/d84/d6e/f9d 25 1 2024-09-18T12:52:10.634 INFO:tasks.workunit.client.1.smithi161.stdout:9/570: dwrite d0/d16/f76 [0,4194304] 0 2024-09-18T12:52:10.635 INFO:tasks.workunit.client.1.smithi161.stdout:0/672: creat df/d30/d71/d96/dd3/d90/d37/de0/ff2 x:0 0 0 2024-09-18T12:52:10.637 INFO:tasks.workunit.client.1.smithi161.stdout:7/615: mkdir d3/d83/db6 0 2024-09-18T12:52:10.640 INFO:tasks.workunit.client.1.smithi161.stdout:0/673: chown df/d29/l5c 17 1 2024-09-18T12:52:10.640 INFO:tasks.workunit.client.1.smithi161.stdout:6/698: symlink d4/d39/d26/d31/d76/le6 0 2024-09-18T12:52:10.642 INFO:tasks.workunit.client.1.smithi161.stdout:4/711: mknod d5/d14/d67/dc7/d4c/cfa 0 2024-09-18T12:52:10.643 INFO:tasks.workunit.client.1.smithi161.stdout:7/616: mkdir d3/d8/d15/da7/d44/db7 0 2024-09-18T12:52:10.644 INFO:tasks.workunit.client.1.smithi161.stdout:8/682: dwrite d0/d3/d10/d21/d4a/d52/fa7 [0,4194304] 0 2024-09-18T12:52:10.645 INFO:tasks.workunit.client.1.smithi161.stdout:0/674: dread - df/d30/d71/d96/dd3/d90/d37/dad/fea zero size 2024-09-18T12:52:10.649 INFO:tasks.workunit.client.1.smithi161.stdout:7/617: mknod d3/d8/d15/da7/d44/db7/cb8 0 2024-09-18T12:52:10.651 INFO:tasks.workunit.client.1.smithi161.stdout:2/691: sync 2024-09-18T12:52:10.651 INFO:tasks.workunit.client.1.smithi161.stdout:3/642: sync 2024-09-18T12:52:10.651 INFO:tasks.workunit.client.1.smithi161.stdout:9/571: dwrite d0/fac [0,4194304] 0 2024-09-18T12:52:10.653 INFO:tasks.workunit.client.1.smithi161.stdout:8/683: write d0/d3/d10/d21/d4a/d52/d82/d96/f61 [801911,56268] 0 2024-09-18T12:52:10.656 INFO:tasks.workunit.client.1.smithi161.stdout:9/572: readlink d0/db/l40 0 2024-09-18T12:52:10.656 INFO:tasks.workunit.client.1.smithi161.stdout:2/692: write d0/d5/d43/f18 [4485355,27612] 0 2024-09-18T12:52:10.659 INFO:tasks.workunit.client.1.smithi161.stdout:4/712: dread d5/d32/d39/db6/fc2 [0,4194304] 0 2024-09-18T12:52:10.661 INFO:tasks.workunit.client.1.smithi161.stdout:3/643: creat d1/d2e/d68/d92/dba/fdc x:0 0 0 2024-09-18T12:52:10.665 INFO:tasks.workunit.client.1.smithi161.stdout:6/699: dwrite d4/d1a/d1c/d3e/f99 [0,4194304] 0 2024-09-18T12:52:10.665 INFO:tasks.workunit.client.1.smithi161.stdout:4/713: symlink d5/d32/d39/d4d/lfb 0 2024-09-18T12:52:10.665 INFO:tasks.workunit.client.1.smithi161.stdout:7/618: dread d3/fa3 [0,4194304] 0 2024-09-18T12:52:10.665 INFO:tasks.workunit.client.1.smithi161.stdout:8/684: dread - d0/d3/d10/d21/d4a/d52/d82/d96/dc1/fd2 zero size 2024-09-18T12:52:10.666 INFO:tasks.workunit.client.1.smithi161.stdout:2/693: link d0/d4/l4a d0/d1/d4c/d67/db9/lf1 0 2024-09-18T12:52:10.669 INFO:tasks.workunit.client.1.smithi161.stdout:6/700: fdatasync d4/d39/d3a/f1f 0 2024-09-18T12:52:10.671 INFO:tasks.workunit.client.1.smithi161.stdout:7/619: chown d3/d8/d15/da7/d4a/d64/d8c/d9f/d55 14209772 1 2024-09-18T12:52:10.671 INFO:tasks.workunit.client.1.smithi161.stdout:4/714: unlink d5/d14/d67/dc7/d47/l56 0 2024-09-18T12:52:10.672 INFO:tasks.workunit.client.1.smithi161.stdout:9/573: dwrite d0/db/fab [0,4194304] 0 2024-09-18T12:52:10.673 INFO:tasks.workunit.client.1.smithi161.stdout:8/685: mknod d0/d3/d10/d21/d4a/d52/d82/d8b/ce4 0 2024-09-18T12:52:10.673 INFO:tasks.workunit.client.1.smithi161.stdout:0/675: write df/d30/f3f [303789,118214] 0 2024-09-18T12:52:10.674 INFO:tasks.workunit.client.1.smithi161.stdout:9/574: chown d0/db/f57 586 1 2024-09-18T12:52:10.675 INFO:tasks.workunit.client.1.smithi161.stdout:2/694: rename d0/d4/f2a to d0/d1/d4c/d67/db9/dcb/d8a/ff2 0 2024-09-18T12:52:10.677 INFO:tasks.workunit.client.1.smithi161.stdout:6/701: creat d4/d61/d69/fe7 x:0 0 0 2024-09-18T12:52:10.677 INFO:tasks.workunit.client.1.smithi161.stdout:4/715: fsync d5/f22 0 2024-09-18T12:52:10.683 INFO:tasks.workunit.client.1.smithi161.stdout:2/695: rename d0/d1/deb/c54 to d0/d71/da9/dd6/cf3 0 2024-09-18T12:52:10.683 INFO:tasks.workunit.client.1.smithi161.stdout:4/716: write d5/d32/d39/d4d/fd7 [118942,22823] 0 2024-09-18T12:52:10.684 INFO:tasks.workunit.client.1.smithi161.stdout:5/611: sync 2024-09-18T12:52:10.686 INFO:tasks.workunit.client.1.smithi161.stdout:7/620: dwrite d3/d8/f80 [4194304,4194304] 0 2024-09-18T12:52:10.686 INFO:tasks.workunit.client.1.smithi161.stdout:5/612: dread - d3/d44/d6f/d86/fae zero size 2024-09-18T12:52:10.687 INFO:tasks.workunit.client.1.smithi161.stdout:9/575: dread d0/d16/f76 [0,4194304] 0 2024-09-18T12:52:10.687 INFO:tasks.workunit.client.0.smithi045.stdout:3/286: sync 2024-09-18T12:52:10.688 INFO:tasks.workunit.client.1.smithi161.stdout:7/621: chown d3/d8/d15/da7/d24/d31/l45 16 1 2024-09-18T12:52:10.690 INFO:tasks.workunit.client.1.smithi161.stdout:9/576: read d0/db/f50 [2633129,15129] 0 2024-09-18T12:52:10.691 INFO:tasks.workunit.client.1.smithi161.stdout:9/577: readlink d0/db/d18/l70 0 2024-09-18T12:52:10.692 INFO:tasks.workunit.client.1.smithi161.stdout:9/578: write d0/db/f57 [1742614,38347] 0 2024-09-18T12:52:10.693 INFO:tasks.workunit.client.0.smithi045.stdout:3/287: rename d0/f48 to d0/d1e/d2c/d3a/f64 0 2024-09-18T12:52:10.698 INFO:tasks.workunit.client.1.smithi161.stdout:7/622: creat d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/fb9 x:0 0 0 2024-09-18T12:52:10.699 INFO:tasks.workunit.client.1.smithi161.stdout:3/644: truncate d1/d2e/d68/f87 85178 0 2024-09-18T12:52:10.700 INFO:tasks.workunit.client.1.smithi161.stdout:9/579: creat d0/d16/d25/d46/fc0 x:0 0 0 2024-09-18T12:52:10.702 INFO:tasks.workunit.client.1.smithi161.stdout:9/580: write d0/d16/d25/d46/fb6 [662824,125530] 0 2024-09-18T12:52:10.703 INFO:tasks.workunit.client.1.smithi161.stdout:5/613: getdents d3/d44/d6f 0 2024-09-18T12:52:10.706 INFO:tasks.workunit.client.1.smithi161.stdout:7/623: link d3/d8/d15/da7/d4a/d59/f6e d3/d50/fba 0 2024-09-18T12:52:10.707 INFO:tasks.workunit.client.1.smithi161.stdout:9/581: fsync d0/d20/f6b 0 2024-09-18T12:52:10.709 INFO:tasks.workunit.client.1.smithi161.stdout:0/676: truncate df/f22 283729 0 2024-09-18T12:52:10.711 INFO:tasks.workunit.client.1.smithi161.stdout:6/702: write d4/d39/d48/f56 [3355660,118056] 0 2024-09-18T12:52:10.713 INFO:tasks.workunit.client.1.smithi161.stdout:5/614: link d3/d14/d8d/f95 d3/d3b/d54/fc4 0 2024-09-18T12:52:10.714 INFO:tasks.workunit.client.1.smithi161.stdout:4/717: write d5/d14/d67/dc7/d4c/f57 [180548,30982] 0 2024-09-18T12:52:10.715 INFO:tasks.workunit.client.1.smithi161.stdout:0/677: creat df/d30/d71/d96/dd3/d51/ff3 x:0 0 0 2024-09-18T12:52:10.717 INFO:tasks.workunit.client.1.smithi161.stdout:6/703: truncate d4/d39/d48/fb6 33372 0 2024-09-18T12:52:10.718 INFO:tasks.workunit.client.1.smithi161.stdout:9/582: dwrite d0/d20/d74/f97 [0,4194304] 0 2024-09-18T12:52:10.718 INFO:tasks.workunit.client.1.smithi161.stdout:5/615: write d3/d14/f97 [2425694,7814] 0 2024-09-18T12:52:10.720 INFO:tasks.workunit.client.1.smithi161.stdout:8/686: dwrite d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/fd3 [0,4194304] 0 2024-09-18T12:52:10.722 INFO:tasks.workunit.client.1.smithi161.stdout:7/624: link d3/d8/d15/f26 d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/fbb 0 2024-09-18T12:52:10.731 INFO:tasks.workunit.client.0.smithi045.stdout:3/288: dread d0/d1e/d2c/d3a/f3c [0,4194304] 0 2024-09-18T12:52:10.739 INFO:tasks.workunit.client.1.smithi161.stdout:0/678: symlink df/d29/dc7/lf4 0 2024-09-18T12:52:10.743 INFO:tasks.workunit.client.1.smithi161.stdout:6/704: link d4/d61/f66 d4/d1a/d1c/d3e/d83/d9e/db1/d45/fe8 0 2024-09-18T12:52:10.745 INFO:tasks.workunit.client.1.smithi161.stdout:4/718: creat d5/d14/d67/ffc x:0 0 0 2024-09-18T12:52:10.746 INFO:tasks.workunit.client.1.smithi161.stdout:9/583: link d0/d93/cb9 d0/d93/cc1 0 2024-09-18T12:52:10.748 INFO:tasks.workunit.client.0.smithi045.stdout:3/289: dread d0/d22/f2e [4194304,4194304] 0 2024-09-18T12:52:10.751 INFO:tasks.workunit.client.1.smithi161.stdout:5/616: dwrite d3/d14/d20/f2e [0,4194304] 0 2024-09-18T12:52:10.751 INFO:tasks.workunit.client.1.smithi161.stdout:4/719: unlink d5/d14/c1f 0 2024-09-18T12:52:10.753 INFO:tasks.workunit.client.1.smithi161.stdout:9/584: dread - d0/d20/d49/fa1 zero size 2024-09-18T12:52:10.753 INFO:tasks.workunit.client.1.smithi161.stdout:7/625: dwrite d3/d8/d15/da7/f41 [0,4194304] 0 2024-09-18T12:52:10.753 INFO:tasks.workunit.client.0.smithi045.stdout:3/290: unlink d0/f4d 0 2024-09-18T12:52:10.756 INFO:tasks.workunit.client.1.smithi161.stdout:0/679: link df/d29/cac df/de2/dc5/d8a/dd1/cf5 0 2024-09-18T12:52:10.758 INFO:tasks.workunit.client.0.smithi045.stdout:3/291: creat d0/d29/d5f/f65 x:0 0 0 2024-09-18T12:52:10.760 INFO:tasks.workunit.client.1.smithi161.stdout:9/585: mknod d0/d16/d25/d46/d53/d59/cc2 0 2024-09-18T12:52:10.762 INFO:tasks.workunit.client.1.smithi161.stdout:0/680: truncate df/d30/f3a 2102516 0 2024-09-18T12:52:10.763 INFO:tasks.workunit.client.1.smithi161.stdout:6/705: dread d4/fa [0,4194304] 0 2024-09-18T12:52:10.763 INFO:tasks.workunit.client.1.smithi161.stdout:6/706: stat d4/d39/d48/f82 0 2024-09-18T12:52:10.768 INFO:tasks.workunit.client.1.smithi161.stdout:4/720: rename d5/d32/dd8 to d5/d14/d67/dc7/d60/d95/dda/de8/dfd 0 2024-09-18T12:52:10.772 INFO:tasks.workunit.client.0.smithi045.stdout:3/292: symlink d0/d1e/d2c/l66 0 2024-09-18T12:52:10.773 INFO:tasks.workunit.client.1.smithi161.stdout:0/681: dread df/d30/d4d/d92/f9e [0,4194304] 0 2024-09-18T12:52:10.773 INFO:tasks.workunit.client.1.smithi161.stdout:5/617: link d3/d3b/d54/fc4 d3/d9/d4b/d8e/d24/d61/fc5 0 2024-09-18T12:52:10.773 INFO:tasks.workunit.client.1.smithi161.stdout:6/707: mkdir d4/d61/d69/da0/de9 0 2024-09-18T12:52:10.774 INFO:tasks.workunit.client.0.smithi045.stdout:3/293: rmdir d0/d1e/d2c 39 2024-09-18T12:52:10.776 INFO:tasks.workunit.client.1.smithi161.stdout:1/563: sync 2024-09-18T12:52:10.777 INFO:tasks.workunit.client.1.smithi161.stdout:1/564: dread - d1/d26/d88/fb0 zero size 2024-09-18T12:52:10.777 INFO:tasks.workunit.client.0.smithi045.stdout:3/294: chown d0/d7/c20 10098237 1 2024-09-18T12:52:10.778 INFO:tasks.workunit.client.1.smithi161.stdout:1/565: write d1/f97 [837141,100301] 0 2024-09-18T12:52:10.779 INFO:tasks.workunit.client.1.smithi161.stdout:5/618: read d3/d9/d4b/d8e/f52 [768952,54462] 0 2024-09-18T12:52:10.780 INFO:tasks.workunit.client.0.smithi045.stdout:3/295: read d0/f3e [1024318,35179] 0 2024-09-18T12:52:10.782 INFO:tasks.workunit.client.1.smithi161.stdout:4/721: dread d5/d27/f46 [0,4194304] 0 2024-09-18T12:52:10.784 INFO:tasks.workunit.client.1.smithi161.stdout:6/708: rename d4/fa to d4/d1a/d1c/fea 0 2024-09-18T12:52:10.784 INFO:tasks.workunit.client.1.smithi161.stdout:4/722: chown d5/d14/c1c 30 1 2024-09-18T12:52:10.787 INFO:tasks.workunit.client.1.smithi161.stdout:4/723: write d5/d32/d39/db6/ff6 [791390,31759] 0 2024-09-18T12:52:10.788 INFO:tasks.workunit.client.0.smithi045.stdout:3/296: dwrite d0/d29/d5f/f65 [0,4194304] 0 2024-09-18T12:52:10.788 INFO:tasks.workunit.client.1.smithi161.stdout:1/566: dwrite d1/d26/d3a/f9e [0,4194304] 0 2024-09-18T12:52:10.790 INFO:tasks.workunit.client.1.smithi161.stdout:0/682: dread df/f15 [0,4194304] 0 2024-09-18T12:52:10.792 INFO:tasks.workunit.client.1.smithi161.stdout:6/709: symlink d4/d1a/d1c/d3e/d83/da2/leb 0 2024-09-18T12:52:10.794 INFO:tasks.workunit.client.1.smithi161.stdout:0/683: write df/d30/d71/d96/dd3/d90/d37/d55/fa4 [1866523,47798] 0 2024-09-18T12:52:10.795 INFO:tasks.workunit.client.1.smithi161.stdout:9/586: dwrite d0/f3b [0,4194304] 0 2024-09-18T12:52:10.796 INFO:tasks.workunit.client.1.smithi161.stdout:9/587: stat d0/fd 0 2024-09-18T12:52:10.798 INFO:tasks.workunit.client.1.smithi161.stdout:6/710: unlink d4/d39/f80 0 2024-09-18T12:52:10.808 INFO:tasks.workunit.client.1.smithi161.stdout:6/711: creat d4/d39/d48/fec x:0 0 0 2024-09-18T12:52:10.809 INFO:tasks.workunit.client.1.smithi161.stdout:1/567: creat d1/fba x:0 0 0 2024-09-18T12:52:10.810 INFO:tasks.workunit.client.1.smithi161.stdout:9/588: mknod d0/d16/d25/d28/cc3 0 2024-09-18T12:52:10.811 INFO:tasks.workunit.client.1.smithi161.stdout:1/568: readlink d1/da/d31/l33 0 2024-09-18T12:52:10.811 INFO:tasks.workunit.client.1.smithi161.stdout:5/619: dread d3/d9/f38 [0,4194304] 0 2024-09-18T12:52:10.812 INFO:tasks.workunit.client.1.smithi161.stdout:5/620: chown d3/d3b/d54/cb6 107 1 2024-09-18T12:52:10.813 INFO:tasks.workunit.client.1.smithi161.stdout:9/589: mknod d0/d16/d25/d28/cc4 0 2024-09-18T12:52:10.816 INFO:tasks.workunit.client.0.smithi045.stdout:3/297: write d0/d1e/d2c/f42 [374196,53979] 0 2024-09-18T12:52:10.816 INFO:tasks.workunit.client.1.smithi161.stdout:1/569: getdents d1/da/d31 0 2024-09-18T12:52:10.818 INFO:tasks.workunit.client.1.smithi161.stdout:0/684: write df/f50 [2475748,99748] 0 2024-09-18T12:52:10.818 INFO:tasks.workunit.client.0.smithi045.stdout:3/298: creat d0/d29/f67 x:0 0 0 2024-09-18T12:52:10.819 INFO:tasks.workunit.client.1.smithi161.stdout:1/570: chown d1/da/f43 10496285 1 2024-09-18T12:52:10.822 INFO:tasks.workunit.client.0.smithi045.stdout:3/299: dread d0/d22/f2e [4194304,4194304] 0 2024-09-18T12:52:10.823 INFO:tasks.workunit.client.0.smithi045.stdout:3/300: fsync d0/d7/f23 0 2024-09-18T12:52:10.823 INFO:tasks.workunit.client.1.smithi161.stdout:1/571: creat d1/d26/d3a/d52/fbb x:0 0 0 2024-09-18T12:52:10.823 INFO:tasks.workunit.client.0.smithi045.stdout:3/301: chown d0/d1e/l21 4733338 1 2024-09-18T12:52:10.824 INFO:tasks.workunit.client.1.smithi161.stdout:4/724: dread d5/d14/d67/f76 [0,4194304] 0 2024-09-18T12:52:10.825 INFO:tasks.workunit.client.1.smithi161.stdout:4/725: chown d5/d27/l5c 1360248 1 2024-09-18T12:52:10.825 INFO:tasks.workunit.client.0.smithi045.stdout:3/302: symlink d0/d22/l68 0 2024-09-18T12:52:10.826 INFO:tasks.workunit.client.1.smithi161.stdout:1/572: mknod d1/da/d1f/d6b/cbc 0 2024-09-18T12:52:10.827 INFO:tasks.workunit.client.1.smithi161.stdout:4/726: readlink d5/d14/d6d/l92 0 2024-09-18T12:52:10.827 INFO:tasks.workunit.client.1.smithi161.stdout:0/685: dwrite df/d30/d71/d96/dd3/d90/d37/d55/fa4 [0,4194304] 0 2024-09-18T12:52:10.827 INFO:tasks.workunit.client.0.smithi045.stdout:3/303: fdatasync d0/d1e/d39/f43 0 2024-09-18T12:52:10.829 INFO:tasks.workunit.client.1.smithi161.stdout:5/621: dread d3/fa0 [0,4194304] 0 2024-09-18T12:52:10.829 INFO:tasks.workunit.client.1.smithi161.stdout:0/686: fdatasync df/d30/d71/d96/fb8 0 2024-09-18T12:52:10.830 INFO:tasks.workunit.client.1.smithi161.stdout:1/573: creat d1/da/d39/fbd x:0 0 0 2024-09-18T12:52:10.832 INFO:tasks.workunit.client.1.smithi161.stdout:4/727: mkdir d5/d27/d44/de2/dfe 0 2024-09-18T12:52:10.834 INFO:tasks.workunit.client.0.smithi045.stdout:3/304: dwrite d0/d1e/d2c/d3a/f47 [0,4194304] 0 2024-09-18T12:52:10.835 INFO:tasks.workunit.client.1.smithi161.stdout:0/687: mknod df/d30/d4d/cf6 0 2024-09-18T12:52:10.835 INFO:tasks.workunit.client.1.smithi161.stdout:9/590: dread d0/d16/d25/d28/f7b [0,4194304] 0 2024-09-18T12:52:10.837 INFO:tasks.workunit.client.1.smithi161.stdout:5/622: creat d3/d9/d4b/d8e/d24/d61/fc6 x:0 0 0 2024-09-18T12:52:10.839 INFO:tasks.workunit.client.1.smithi161.stdout:1/574: read d1/ff [129181,89314] 0 2024-09-18T12:52:10.842 INFO:tasks.workunit.client.0.smithi045.stdout:3/305: dwrite d0/f3e [0,4194304] 0 2024-09-18T12:52:10.842 INFO:tasks.workunit.client.1.smithi161.stdout:5/623: write d3/d9/f6d [83296,51633] 0 2024-09-18T12:52:10.845 INFO:tasks.workunit.client.1.smithi161.stdout:1/575: creat d1/d26/d88/fbe x:0 0 0 2024-09-18T12:52:10.847 INFO:tasks.workunit.client.0.smithi045.stdout:3/306: dread d0/d1e/d39/f43 [0,4194304] 0 2024-09-18T12:52:10.848 INFO:tasks.workunit.client.0.smithi045.stdout:3/307: read d0/d22/f3d [528453,61480] 0 2024-09-18T12:52:10.851 INFO:tasks.workunit.client.0.smithi045.stdout:7/237: sync 2024-09-18T12:52:10.851 INFO:tasks.workunit.client.0.smithi045.stdout:1/342: sync 2024-09-18T12:52:10.851 INFO:tasks.workunit.client.0.smithi045.stdout:9/229: sync 2024-09-18T12:52:10.855 INFO:tasks.workunit.client.1.smithi161.stdout:4/728: rename d5/d14/d67/dc7/d47/d49/cf2 to d5/d14/d67/dc7/d60/d95/dda/cff 0 2024-09-18T12:52:10.857 INFO:tasks.workunit.client.1.smithi161.stdout:9/591: write d0/d47/f4c [1601260,14410] 0 2024-09-18T12:52:10.857 INFO:tasks.workunit.client.0.smithi045.stdout:9/230: write d0/d3/d6/d10/d26/f42 [3129052,24778] 0 2024-09-18T12:52:10.859 INFO:tasks.workunit.client.0.smithi045.stdout:3/308: dwrite d0/d1e/d2c/f63 [0,4194304] 0 2024-09-18T12:52:10.860 INFO:tasks.workunit.client.1.smithi161.stdout:0/688: truncate df/d30/d71/d96/dd3/d90/f88 4160264 0 2024-09-18T12:52:10.861 INFO:tasks.workunit.client.1.smithi161.stdout:1/576: write d1/da/f18 [2007252,1017] 0 2024-09-18T12:52:10.862 INFO:tasks.workunit.client.1.smithi161.stdout:2/696: sync 2024-09-18T12:52:10.862 INFO:tasks.workunit.client.0.smithi045.stdout:1/343: dwrite d0/f23 [0,4194304] 0 2024-09-18T12:52:10.870 INFO:tasks.workunit.client.0.smithi045.stdout:9/231: dwrite d0/d3/d6/d10/d2c/f30 [0,4194304] 0 2024-09-18T12:52:10.881 INFO:tasks.workunit.client.0.smithi045.stdout:3/309: creat d0/d1e/d2c/d3a/d45/f69 x:0 0 0 2024-09-18T12:52:10.882 INFO:tasks.workunit.client.1.smithi161.stdout:2/697: chown d0/d1/deb/d3d/l65 409 1 2024-09-18T12:52:10.883 INFO:tasks.workunit.client.0.smithi045.stdout:9/232: creat d0/f4d x:0 0 0 2024-09-18T12:52:10.883 INFO:tasks.workunit.client.1.smithi161.stdout:5/624: link d3/d14/d20/f74 d3/d14/d8d/fc7 0 2024-09-18T12:52:10.884 INFO:tasks.workunit.client.1.smithi161.stdout:4/729: dread d5/d32/f38 [0,4194304] 0 2024-09-18T12:52:10.887 INFO:tasks.workunit.client.1.smithi161.stdout:1/577: mkdir d1/dbf 0 2024-09-18T12:52:10.888 INFO:tasks.workunit.client.0.smithi045.stdout:1/344: link d0/d2e/f42 d0/f69 0 2024-09-18T12:52:10.890 INFO:tasks.workunit.client.0.smithi045.stdout:3/310: dwrite d0/d1e/d2c/f63 [4194304,4194304] 0 2024-09-18T12:52:10.890 INFO:tasks.workunit.client.0.smithi045.stdout:9/233: mkdir d0/d3/d6/d10/d26/d2e/d4e 0 2024-09-18T12:52:10.892 INFO:tasks.workunit.client.0.smithi045.stdout:9/234: chown d0/d3/d6/d10/d2c/l37 49 1 2024-09-18T12:52:10.894 INFO:tasks.workunit.client.0.smithi045.stdout:9/235: dread - d0/f4d zero size 2024-09-18T12:52:10.895 INFO:tasks.workunit.client.1.smithi161.stdout:2/698: rename d0/d1/deb/d3d/f88 to d0/d1/deb/d3d/ff4 0 2024-09-18T12:52:10.899 INFO:tasks.workunit.client.1.smithi161.stdout:5/625: symlink d3/d44/d6f/d86/lc8 0 2024-09-18T12:52:10.899 INFO:tasks.workunit.client.0.smithi045.stdout:7/238: dwrite d13/d44/f2b [0,4194304] 0 2024-09-18T12:52:10.901 INFO:tasks.workunit.client.0.smithi045.stdout:7/239: readlink d13/d44/l50 0 2024-09-18T12:52:10.901 INFO:tasks.workunit.client.0.smithi045.stdout:7/240: chown fc 149642 1 2024-09-18T12:52:10.902 INFO:tasks.workunit.client.0.smithi045.stdout:1/345: rename d0/d2d/d4c to d0/d12/d32/d67/d6a 0 2024-09-18T12:52:10.904 INFO:tasks.workunit.client.1.smithi161.stdout:8/687: sync 2024-09-18T12:52:10.904 INFO:tasks.workunit.client.1.smithi161.stdout:3/645: sync 2024-09-18T12:52:10.904 INFO:tasks.workunit.client.0.smithi045.stdout:9/236: creat d0/d3/d6/f4f x:0 0 0 2024-09-18T12:52:10.906 INFO:tasks.workunit.client.1.smithi161.stdout:5/626: dwrite d3/d44/f8c [0,4194304] 0 2024-09-18T12:52:10.908 INFO:tasks.workunit.client.1.smithi161.stdout:8/688: write d0/d3/d10/d21/d4a/f77 [2920268,37175] 0 2024-09-18T12:52:10.908 INFO:tasks.workunit.client.1.smithi161.stdout:3/646: stat d1/d2e/d14/d65/d76/d88/f8e 0 2024-09-18T12:52:10.914 INFO:tasks.workunit.client.1.smithi161.stdout:4/730: mkdir d5/d14/d67/dc7/d47/d49/dca/d100 0 2024-09-18T12:52:10.914 INFO:tasks.workunit.client.1.smithi161.stdout:0/689: dwrite df/de2/dc5/d89/f91 [0,4194304] 0 2024-09-18T12:52:10.915 INFO:tasks.workunit.client.0.smithi045.stdout:3/311: dread d0/f1f [0,4194304] 0 2024-09-18T12:52:10.915 INFO:tasks.workunit.client.0.smithi045.stdout:1/346: dread d0/d12/d32/d37/f43 [0,4194304] 0 2024-09-18T12:52:10.915 INFO:tasks.workunit.client.1.smithi161.stdout:8/689: chown d0/d3/d10/l11 3 1 2024-09-18T12:52:10.915 INFO:tasks.workunit.client.1.smithi161.stdout:1/578: mkdir d1/daa/db2/dc0 0 2024-09-18T12:52:10.915 INFO:tasks.workunit.client.1.smithi161.stdout:2/699: read d0/f7b [561,65453] 0 2024-09-18T12:52:10.916 INFO:tasks.workunit.client.0.smithi045.stdout:7/241: getdents d13/d44/d37 0 2024-09-18T12:52:10.917 INFO:tasks.workunit.client.0.smithi045.stdout:7/242: readlink d13/d44/l35 0 2024-09-18T12:52:10.919 INFO:tasks.workunit.client.1.smithi161.stdout:9/592: getdents d0/d16/d25 0 2024-09-18T12:52:10.921 INFO:tasks.workunit.client.0.smithi045.stdout:1/347: chown d0/d2d/d2b/d30/d40/l54 20968 1 2024-09-18T12:52:10.921 INFO:tasks.workunit.client.1.smithi161.stdout:0/690: write df/de2/dc5/d8a/fc6 [1471836,42377] 0 2024-09-18T12:52:10.921 INFO:tasks.workunit.client.1.smithi161.stdout:4/731: truncate d5/d14/d67/dc7/d47/d49/f85 1880469 0 2024-09-18T12:52:10.921 INFO:tasks.workunit.client.1.smithi161.stdout:5/627: mknod d3/d3b/cc9 0 2024-09-18T12:52:10.925 INFO:tasks.workunit.client.1.smithi161.stdout:3/647: rename d1/d2e/d68/d92/dba/fdc to d1/d2e/d14/d65/d76/d88/fdd 0 2024-09-18T12:52:10.925 INFO:tasks.workunit.client.1.smithi161.stdout:1/579: dwrite d1/d26/f98 [0,4194304] 0 2024-09-18T12:52:10.926 INFO:tasks.workunit.client.0.smithi045.stdout:3/312: symlink d0/d1e/l6a 0 2024-09-18T12:52:10.932 INFO:tasks.workunit.client.1.smithi161.stdout:9/593: rmdir d0/d20 39 2024-09-18T12:52:10.932 INFO:tasks.workunit.client.1.smithi161.stdout:8/690: symlink d0/d3/d10/d21/d4a/le5 0 2024-09-18T12:52:10.932 INFO:tasks.workunit.client.1.smithi161.stdout:0/691: symlink df/d30/d71/lf7 0 2024-09-18T12:52:10.934 INFO:tasks.workunit.client.1.smithi161.stdout:5/628: rmdir d3/d9/d4b/d8e/d24/db8 39 2024-09-18T12:52:10.934 INFO:tasks.workunit.client.0.smithi045.stdout:9/237: dread d0/d3/d6/f22 [0,4194304] 0 2024-09-18T12:52:10.938 INFO:tasks.workunit.client.0.smithi045.stdout:1/348: dwrite d0/fc [8388608,4194304] 0 2024-09-18T12:52:10.938 INFO:tasks.workunit.client.1.smithi161.stdout:1/580: rename d1/da/d1f/d45/c84 to d1/da/d1f/dab/daf/cc1 0 2024-09-18T12:52:10.939 INFO:tasks.workunit.client.1.smithi161.stdout:1/581: dread - d1/d26/d88/fa3 zero size 2024-09-18T12:52:10.940 INFO:tasks.workunit.client.1.smithi161.stdout:9/594: symlink d0/d47/lc5 0 2024-09-18T12:52:10.941 INFO:tasks.workunit.client.0.smithi045.stdout:7/243: dread f11 [0,4194304] 0 2024-09-18T12:52:10.945 INFO:tasks.workunit.client.1.smithi161.stdout:8/691: mkdir d0/d3/d10/d21/d4a/d52/d82/de6 0 2024-09-18T12:52:10.946 INFO:tasks.workunit.client.1.smithi161.stdout:8/692: write d0/d3/d10/d21/f3a [628165,11843] 0 2024-09-18T12:52:10.949 INFO:tasks.workunit.client.1.smithi161.stdout:8/693: read d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 [7946062,57767] 0 2024-09-18T12:52:10.950 INFO:tasks.workunit.client.1.smithi161.stdout:5/629: mkdir d3/d44/d6f/dca 0 2024-09-18T12:52:10.953 INFO:tasks.workunit.client.0.smithi045.stdout:7/244: creat d13/d31/f53 x:0 0 0 2024-09-18T12:52:10.953 INFO:tasks.workunit.client.0.smithi045.stdout:9/238: dread d0/d3/d6/d10/d26/d2e/f32 [0,4194304] 0 2024-09-18T12:52:10.953 INFO:tasks.workunit.client.1.smithi161.stdout:3/648: unlink d1/d2e/d3d/d49/f5f 0 2024-09-18T12:52:10.955 INFO:tasks.workunit.client.0.smithi045.stdout:3/313: getdents d0/d29/d53 0 2024-09-18T12:52:10.955 INFO:tasks.workunit.client.1.smithi161.stdout:3/649: dread - d1/d2e/d24/d84/fc1 zero size 2024-09-18T12:52:10.956 INFO:tasks.workunit.client.1.smithi161.stdout:8/694: dwrite d0/d3/d10/d21/d4a/d52/d82/fc8 [0,4194304] 0 2024-09-18T12:52:10.957 INFO:tasks.workunit.client.1.smithi161.stdout:1/582: mknod d1/d26/d3a/d52/cc2 0 2024-09-18T12:52:10.959 INFO:tasks.workunit.client.0.smithi045.stdout:9/239: creat d0/f50 x:0 0 0 2024-09-18T12:52:10.960 INFO:tasks.workunit.client.1.smithi161.stdout:3/650: dread d1/d2e/d14/d65/d76/d88/f8e [0,4194304] 0 2024-09-18T12:52:10.960 INFO:tasks.workunit.client.1.smithi161.stdout:7/626: sync 2024-09-18T12:52:10.960 INFO:tasks.workunit.client.1.smithi161.stdout:6/712: sync 2024-09-18T12:52:10.961 INFO:tasks.workunit.client.1.smithi161.stdout:1/583: dread d1/da/d39/f67 [0,4194304] 0 2024-09-18T12:52:10.962 INFO:tasks.workunit.client.1.smithi161.stdout:4/732: link d5/d32/d39/d4d/f52 d5/d27/d44/f101 0 2024-09-18T12:52:10.963 INFO:tasks.workunit.client.1.smithi161.stdout:5/630: fsync d3/d9/d4b/d8e/f52 0 2024-09-18T12:52:10.965 INFO:tasks.workunit.client.0.smithi045.stdout:1/349: dwrite d0/d12/f13 [0,4194304] 0 2024-09-18T12:52:10.966 INFO:tasks.workunit.client.0.smithi045.stdout:9/240: write d0/d3/d6/d10/d26/f4a [564573,75312] 0 2024-09-18T12:52:10.967 INFO:tasks.workunit.client.0.smithi045.stdout:1/350: fdatasync d0/fb 0 2024-09-18T12:52:10.968 INFO:tasks.workunit.client.1.smithi161.stdout:2/700: getdents d0 0 2024-09-18T12:52:10.968 INFO:tasks.workunit.client.0.smithi045.stdout:3/314: dread d0/f4b [4194304,4194304] 0 2024-09-18T12:52:10.969 INFO:tasks.workunit.client.0.smithi045.stdout:9/241: write d0/d3/d6/d10/d2c/f44 [961417,67175] 0 2024-09-18T12:52:10.970 INFO:tasks.workunit.client.1.smithi161.stdout:8/695: mkdir d0/d3/d10/d21/d4a/d52/d82/d96/d98/de7 0 2024-09-18T12:52:10.972 INFO:tasks.workunit.client.0.smithi045.stdout:9/242: chown d0/d3/d6/l28 630817 1 2024-09-18T12:52:10.974 INFO:tasks.workunit.client.1.smithi161.stdout:9/595: mknod d0/d47/d48/cc6 0 2024-09-18T12:52:10.976 INFO:tasks.workunit.client.0.smithi045.stdout:8/311: sync 2024-09-18T12:52:10.976 INFO:tasks.workunit.client.0.smithi045.stdout:2/319: sync 2024-09-18T12:52:10.976 INFO:tasks.workunit.client.0.smithi045.stdout:5/372: sync 2024-09-18T12:52:10.978 INFO:tasks.workunit.client.0.smithi045.stdout:8/312: chown d11/d20/d46/c65 881059173 1 2024-09-18T12:52:10.978 INFO:tasks.workunit.client.0.smithi045.stdout:3/315: creat d0/d29/d5f/f6b x:0 0 0 2024-09-18T12:52:10.979 INFO:tasks.workunit.client.1.smithi161.stdout:3/651: creat d1/d2e/d3d/d49/fde x:0 0 0 2024-09-18T12:52:10.981 INFO:tasks.workunit.client.0.smithi045.stdout:8/313: chown d11/d23/f2b 15304 1 2024-09-18T12:52:10.981 INFO:tasks.workunit.client.0.smithi045.stdout:7/245: write d13/f16 [869994,61590] 0 2024-09-18T12:52:10.981 INFO:tasks.workunit.client.1.smithi161.stdout:6/713: creat d4/d39/d48/fed x:0 0 0 2024-09-18T12:52:10.981 INFO:tasks.workunit.client.1.smithi161.stdout:6/714: readlink d4/d39/d26/d31/l73 0 2024-09-18T12:52:10.982 INFO:tasks.workunit.client.0.smithi045.stdout:1/351: getdents d0/d2d/d2b/d30/d40/d60 0 2024-09-18T12:52:10.982 INFO:tasks.workunit.client.1.smithi161.stdout:6/715: readlink d4/d61/d69/d87/lc0 0 2024-09-18T12:52:10.983 INFO:tasks.workunit.client.0.smithi045.stdout:2/320: truncate d5/d2c/d4d/d33/f3c 4019071 0 2024-09-18T12:52:10.983 INFO:tasks.workunit.client.1.smithi161.stdout:7/627: creat d3/d8/d15/da7/d4a/fbc x:0 0 0 2024-09-18T12:52:10.984 INFO:tasks.workunit.client.1.smithi161.stdout:7/628: write d3/f2e [1703143,23096] 0 2024-09-18T12:52:10.986 INFO:tasks.workunit.client.0.smithi045.stdout:2/321: readlink d5/d2c/l47 0 2024-09-18T12:52:10.986 INFO:tasks.workunit.client.0.smithi045.stdout:9/243: mknod d0/d3/c51 0 2024-09-18T12:52:10.987 INFO:tasks.workunit.client.0.smithi045.stdout:3/316: creat d0/d1e/d2c/d3a/d45/f6c x:0 0 0 2024-09-18T12:52:10.989 INFO:tasks.workunit.client.0.smithi045.stdout:3/317: fsync d0/d29/f67 0 2024-09-18T12:52:10.990 INFO:tasks.workunit.client.1.smithi161.stdout:5/631: unlink d3/d3b/cc9 0 2024-09-18T12:52:10.990 INFO:tasks.workunit.client.0.smithi045.stdout:3/318: dread - d0/d29/d5f/f6b zero size 2024-09-18T12:52:10.990 INFO:tasks.workunit.client.0.smithi045.stdout:8/314: write d11/d20/d46/f51 [726099,94094] 0 2024-09-18T12:52:10.991 INFO:tasks.workunit.client.0.smithi045.stdout:5/373: dwrite d6/d2a/f60 [0,4194304] 0 2024-09-18T12:52:10.993 INFO:tasks.workunit.client.1.smithi161.stdout:2/701: write d0/d1/d4c/d67/db9/dcb/d8a/ff2 [2442067,27880] 0 2024-09-18T12:52:10.995 INFO:tasks.workunit.client.0.smithi045.stdout:3/319: chown d0/d29/d53/c58 7172 1 2024-09-18T12:52:10.995 INFO:tasks.workunit.client.0.smithi045.stdout:5/374: dread - d6/db/d5a/d78/d66/f69 zero size 2024-09-18T12:52:10.995 INFO:tasks.workunit.client.0.smithi045.stdout:2/322: mknod d5/c72 0 2024-09-18T12:52:10.996 INFO:tasks.workunit.client.0.smithi045.stdout:7/246: dread fc [0,4194304] 0 2024-09-18T12:52:10.998 INFO:tasks.workunit.client.1.smithi161.stdout:0/692: getdents df/de2 0 2024-09-18T12:52:10.999 INFO:tasks.workunit.client.1.smithi161.stdout:8/696: dwrite d0/f2a [0,4194304] 0 2024-09-18T12:52:10.999 INFO:tasks.workunit.client.0.smithi045.stdout:8/315: rmdir d11/d20/d60 39 2024-09-18T12:52:10.999 INFO:tasks.workunit.client.0.smithi045.stdout:2/323: readlink d5/d2c/d4d/l38 0 2024-09-18T12:52:11.002 INFO:tasks.workunit.client.1.smithi161.stdout:1/584: symlink d1/d26/da6/lc3 0 2024-09-18T12:52:11.002 INFO:tasks.workunit.client.1.smithi161.stdout:7/629: mknod d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/d9b/cbd 0 2024-09-18T12:52:11.003 INFO:tasks.workunit.client.1.smithi161.stdout:1/585: read d1/d26/d3a/f3b [162250,72753] 0 2024-09-18T12:52:11.004 INFO:tasks.workunit.client.1.smithi161.stdout:4/733: unlink d5/d14/d67/dc7/l9f 0 2024-09-18T12:52:11.004 INFO:tasks.workunit.client.1.smithi161.stdout:0/693: dread df/f50 [0,4194304] 0 2024-09-18T12:52:11.005 INFO:tasks.workunit.client.0.smithi045.stdout:8/316: read - d11/d14/d53/d41/d57/f4a zero size 2024-09-18T12:52:11.005 INFO:tasks.workunit.client.0.smithi045.stdout:9/244: dwrite d0/d3/f1f [0,4194304] 0 2024-09-18T12:52:11.006 INFO:tasks.workunit.client.0.smithi045.stdout:2/324: rename d5/d2c/f58 to d5/d46/f73 0 2024-09-18T12:52:11.010 INFO:tasks.workunit.client.0.smithi045.stdout:8/317: write d11/d14/d53/d41/d57/f4a [173389,122077] 0 2024-09-18T12:52:11.011 INFO:tasks.workunit.client.0.smithi045.stdout:2/325: dread d5/d3a/f4c [0,4194304] 0 2024-09-18T12:52:11.012 INFO:tasks.workunit.client.0.smithi045.stdout:8/318: write d11/d20/f27 [5701954,128736] 0 2024-09-18T12:52:11.020 INFO:tasks.workunit.client.0.smithi045.stdout:8/319: dwrite d11/d20/d46/f51 [0,4194304] 0 2024-09-18T12:52:11.025 INFO:tasks.workunit.client.1.smithi161.stdout:7/630: symlink d3/d8/d15/da7/d24/d31/lbe 0 2024-09-18T12:52:11.027 INFO:tasks.workunit.client.1.smithi161.stdout:1/586: symlink d1/da/d1f/dab/lc4 0 2024-09-18T12:52:11.028 INFO:tasks.workunit.client.0.smithi045.stdout:7/247: dwrite d13/d44/d37/f4a [0,4194304] 0 2024-09-18T12:52:11.029 INFO:tasks.workunit.client.1.smithi161.stdout:4/734: mkdir d5/d14/d67/dc7/d47/d49/dca/d102 0 2024-09-18T12:52:11.031 INFO:tasks.workunit.client.1.smithi161.stdout:0/694: creat df/de2/dc5/d8a/ff8 x:0 0 0 2024-09-18T12:52:11.033 INFO:tasks.workunit.client.1.smithi161.stdout:3/652: truncate d1/d2e/d14/d65/f79 856677 0 2024-09-18T12:52:11.033 INFO:tasks.workunit.client.0.smithi045.stdout:3/320: dread d0/d22/f26 [0,4194304] 0 2024-09-18T12:52:11.034 INFO:tasks.workunit.client.0.smithi045.stdout:3/321: write d0/d7/f23 [1181532,26230] 0 2024-09-18T12:52:11.035 INFO:tasks.workunit.client.1.smithi161.stdout:5/632: mknod d3/ccb 0 2024-09-18T12:52:11.035 INFO:tasks.workunit.client.0.smithi045.stdout:8/320: mknod d11/d14/d53/c66 0 2024-09-18T12:52:11.036 INFO:tasks.workunit.client.1.smithi161.stdout:5/633: readlink d3/d3b/d7b/l5b 0 2024-09-18T12:52:11.037 INFO:tasks.workunit.client.0.smithi045.stdout:8/321: write d11/d23/f2b [714852,77704] 0 2024-09-18T12:52:11.037 INFO:tasks.workunit.client.1.smithi161.stdout:8/697: symlink d0/d3/d10/d21/d4a/d52/d66/d5b/de0/le8 0 2024-09-18T12:52:11.038 INFO:tasks.workunit.client.0.smithi045.stdout:5/375: getdents d6/d28/d2b/d51/d6c 0 2024-09-18T12:52:11.045 INFO:tasks.workunit.client.0.smithi045.stdout:7/248: symlink d13/d31/d52/l54 0 2024-09-18T12:52:11.046 INFO:tasks.workunit.client.0.smithi045.stdout:5/376: dwrite d6/d28/d2b/d51/d6c/f71 [0,4194304] 0 2024-09-18T12:52:11.047 INFO:tasks.workunit.client.0.smithi045.stdout:8/322: symlink d11/d14/d53/d41/d57/l67 0 2024-09-18T12:52:11.049 INFO:tasks.workunit.client.0.smithi045.stdout:9/245: getdents d0/d3/d6 0 2024-09-18T12:52:11.049 INFO:tasks.workunit.client.0.smithi045.stdout:9/246: chown d0/f2 477507402 1 2024-09-18T12:52:11.050 INFO:tasks.workunit.client.0.smithi045.stdout:9/247: fdatasync d0/f3e 0 2024-09-18T12:52:11.052 INFO:tasks.workunit.client.0.smithi045.stdout:9/248: write d0/f4d [848859,72740] 0 2024-09-18T12:52:11.052 INFO:tasks.workunit.client.0.smithi045.stdout:9/249: stat d0/f3e 0 2024-09-18T12:52:11.054 INFO:tasks.workunit.client.0.smithi045.stdout:2/326: write d5/d2c/d4d/d33/f55 [1213560,21776] 0 2024-09-18T12:52:11.054 INFO:tasks.workunit.client.1.smithi161.stdout:6/716: rename d4/d1a/l33 to d4/d1a/d1c/d3e/d83/d9e/db1/lee 0 2024-09-18T12:52:11.055 INFO:tasks.workunit.client.1.smithi161.stdout:1/587: fsync d1/da/d39/f67 0 2024-09-18T12:52:11.055 INFO:tasks.workunit.client.0.smithi045.stdout:2/327: chown d5/d2c/d4d/l38 0 1 2024-09-18T12:52:11.056 INFO:tasks.workunit.client.0.smithi045.stdout:7/249: symlink d13/d31/l55 0 2024-09-18T12:52:11.056 INFO:tasks.workunit.client.1.smithi161.stdout:4/735: creat d5/d14/d5f/da1/de9/f103 x:0 0 0 2024-09-18T12:52:11.057 INFO:tasks.workunit.client.0.smithi045.stdout:7/250: readlink d13/d31/l3f 0 2024-09-18T12:52:11.057 INFO:tasks.workunit.client.1.smithi161.stdout:0/695: symlink df/d30/d71/d96/dd3/d90/d37/de0/lf9 0 2024-09-18T12:52:11.057 INFO:tasks.workunit.client.1.smithi161.stdout:9/596: getdents d0/d16/d25/d86 0 2024-09-18T12:52:11.058 INFO:tasks.workunit.client.1.smithi161.stdout:8/698: write d0/d3/fb [1502842,123062] 0 2024-09-18T12:52:11.058 INFO:tasks.workunit.client.1.smithi161.stdout:5/634: mknod d3/d3b/d54/ccc 0 2024-09-18T12:52:11.058 INFO:tasks.workunit.client.0.smithi045.stdout:8/323: symlink d11/d20/d46/l68 0 2024-09-18T12:52:11.059 INFO:tasks.workunit.client.1.smithi161.stdout:3/653: dwrite d1/d2e/d68/d69/f96 [0,4194304] 0 2024-09-18T12:52:11.059 INFO:tasks.workunit.client.1.smithi161.stdout:2/702: rename d0/d5/d43 to d0/d5/d43/df5 22 2024-09-18T12:52:11.061 INFO:tasks.workunit.client.1.smithi161.stdout:2/703: write d0/fa0 [4365580,93972] 0 2024-09-18T12:52:11.061 INFO:tasks.workunit.client.0.smithi045.stdout:8/324: read d11/d23/f2b [48017,47660] 0 2024-09-18T12:52:11.062 INFO:tasks.workunit.client.1.smithi161.stdout:2/704: fsync d0/d71/fcf 0 2024-09-18T12:52:11.063 INFO:tasks.workunit.client.1.smithi161.stdout:2/705: readlink d0/d5/d43/l87 0 2024-09-18T12:52:11.063 INFO:tasks.workunit.client.0.smithi045.stdout:8/325: write d11/d20/f27 [6266040,59447] 0 2024-09-18T12:52:11.064 INFO:tasks.workunit.client.0.smithi045.stdout:8/326: stat d11/d14/d53 0 2024-09-18T12:52:11.065 INFO:tasks.workunit.client.0.smithi045.stdout:9/250: mkdir d0/d3/d6/d52 0 2024-09-18T12:52:11.068 INFO:tasks.workunit.client.1.smithi161.stdout:9/597: fsync d0/d20/d49/d65/f92 0 2024-09-18T12:52:11.068 INFO:tasks.workunit.client.0.smithi045.stdout:3/322: link d0/fe d0/d1e/d2c/d3a/f6d 0 2024-09-18T12:52:11.069 INFO:tasks.workunit.client.1.smithi161.stdout:1/588: mknod d1/d26/d3a/cc5 0 2024-09-18T12:52:11.070 INFO:tasks.workunit.client.1.smithi161.stdout:8/699: dwrite d0/d3/d10/d21/d4a/d52/d82/d8b/fd6 [0,4194304] 0 2024-09-18T12:52:11.071 INFO:tasks.workunit.client.0.smithi045.stdout:2/328: creat d5/d3a/d3e/f74 x:0 0 0 2024-09-18T12:52:11.073 INFO:tasks.workunit.client.1.smithi161.stdout:4/736: symlink d5/d32/d39/db6/l104 0 2024-09-18T12:52:11.074 INFO:tasks.workunit.client.0.smithi045.stdout:7/251: mknod d13/d44/d4c/c56 0 2024-09-18T12:52:11.075 INFO:tasks.workunit.client.0.smithi045.stdout:7/252: write d13/d1a/f1b [838273,46045] 0 2024-09-18T12:52:11.079 INFO:tasks.workunit.client.1.smithi161.stdout:2/706: dread d0/d1/f3f [0,4194304] 0 2024-09-18T12:52:11.081 INFO:tasks.workunit.client.0.smithi045.stdout:8/327: rmdir d11/d14/d53/d41/d57 39 2024-09-18T12:52:11.082 INFO:tasks.workunit.client.1.smithi161.stdout:5/635: creat d3/d44/d6f/d86/fcd x:0 0 0 2024-09-18T12:52:11.083 INFO:tasks.workunit.client.1.smithi161.stdout:9/598: dread d0/d16/d25/d28/d45/f66 [0,4194304] 0 2024-09-18T12:52:11.083 INFO:tasks.workunit.client.0.smithi045.stdout:5/377: write d6/f7 [2603283,88092] 0 2024-09-18T12:52:11.090 INFO:tasks.workunit.client.1.smithi161.stdout:8/700: chown d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/lca 0 1 2024-09-18T12:52:11.090 INFO:tasks.workunit.client.1.smithi161.stdout:5/636: dwrite d3/d3b/d7b/fbe [0,4194304] 0 2024-09-18T12:52:11.090 INFO:tasks.workunit.client.0.smithi045.stdout:3/323: dwrite d0/d22/f26 [0,4194304] 0 2024-09-18T12:52:11.091 INFO:tasks.workunit.client.1.smithi161.stdout:8/701: chown d0/d3/d10/c8d 7 1 2024-09-18T12:52:11.092 INFO:tasks.workunit.client.0.smithi045.stdout:7/253: mknod d13/d31/d33/c57 0 2024-09-18T12:52:11.093 INFO:tasks.workunit.client.1.smithi161.stdout:6/717: mkdir d4/d1a/d1c/d3e/d83/d9e/db1/d45/ddf/def 0 2024-09-18T12:52:11.095 INFO:tasks.workunit.client.0.smithi045.stdout:9/251: symlink d0/d3/d6/d52/l53 0 2024-09-18T12:52:11.097 INFO:tasks.workunit.client.0.smithi045.stdout:5/378: creat d6/db/d5a/f7c x:0 0 0 2024-09-18T12:52:11.100 INFO:tasks.workunit.client.1.smithi161.stdout:9/599: rmdir d0/d47/d48/d7f 39 2024-09-18T12:52:11.103 INFO:tasks.workunit.client.1.smithi161.stdout:0/696: dwrite df/d30/d71/f87 [0,4194304] 0 2024-09-18T12:52:11.104 INFO:tasks.workunit.client.1.smithi161.stdout:9/600: truncate d0/db/fbc 469117 0 2024-09-18T12:52:11.109 INFO:tasks.workunit.client.1.smithi161.stdout:3/654: dwrite d1/d2e/f6e [0,4194304] 0 2024-09-18T12:52:11.110 INFO:tasks.workunit.client.1.smithi161.stdout:8/702: creat d0/d3/d10/d21/d4a/d52/d66/fe9 x:0 0 0 2024-09-18T12:52:11.111 INFO:tasks.workunit.client.0.smithi045.stdout:7/254: symlink d13/l58 0 2024-09-18T12:52:11.112 INFO:tasks.workunit.client.0.smithi045.stdout:8/328: link d11/d20/d46/c42 d11/d20/d46/c69 0 2024-09-18T12:52:11.114 INFO:tasks.workunit.client.1.smithi161.stdout:6/718: symlink d4/d1a/d1c/d3e/d83/d9e/db1/d45/d68/lf0 0 2024-09-18T12:52:11.114 INFO:tasks.workunit.client.1.smithi161.stdout:2/707: dread d0/fa0 [0,4194304] 0 2024-09-18T12:52:11.114 INFO:tasks.workunit.client.0.smithi045.stdout:9/252: symlink d0/d3/l54 0 2024-09-18T12:52:11.115 INFO:tasks.workunit.client.0.smithi045.stdout:5/379: dread d6/d3e/f3a [0,4194304] 0 2024-09-18T12:52:11.115 INFO:tasks.workunit.client.1.smithi161.stdout:1/589: dwrite d1/d26/f3f [0,4194304] 0 2024-09-18T12:52:11.116 INFO:tasks.workunit.client.0.smithi045.stdout:7/255: write d13/d44/f1f [3876214,96299] 0 2024-09-18T12:52:11.118 INFO:tasks.workunit.client.1.smithi161.stdout:4/737: rename d5/d32/d39/d4d/lfb to d5/d14/d67/dc7/d4c/l105 0 2024-09-18T12:52:11.119 INFO:tasks.workunit.client.0.smithi045.stdout:5/380: write d6/d28/d2b/f2d [1737557,101736] 0 2024-09-18T12:52:11.121 INFO:tasks.workunit.client.0.smithi045.stdout:9/253: unlink d0/d3/l8 0 2024-09-18T12:52:11.122 INFO:tasks.workunit.client.0.smithi045.stdout:9/254: fdatasync d0/f1a 0 2024-09-18T12:52:11.123 INFO:tasks.workunit.client.1.smithi161.stdout:8/703: rmdir d0/d3/d10/d21/d4a/d52/d82/d96/dc1 39 2024-09-18T12:52:11.125 INFO:tasks.workunit.client.1.smithi161.stdout:2/708: dwrite d0/d5/d43/d35/fa3 [0,4194304] 0 2024-09-18T12:52:11.126 INFO:tasks.workunit.client.1.smithi161.stdout:2/709: chown d0/d5/d43/d23 16072 1 2024-09-18T12:52:11.126 INFO:tasks.workunit.client.1.smithi161.stdout:0/697: symlink df/d30/d71/d96/dd3/d90/d37/d55/dba/lfa 0 2024-09-18T12:52:11.127 INFO:tasks.workunit.client.0.smithi045.stdout:7/256: creat d13/d1a/f59 x:0 0 0 2024-09-18T12:52:11.127 INFO:tasks.workunit.client.0.smithi045.stdout:8/329: rmdir d11/d14/d53/d41/d57 39 2024-09-18T12:52:11.128 INFO:tasks.workunit.client.1.smithi161.stdout:5/637: dread d3/d8/f77 [0,4194304] 0 2024-09-18T12:52:11.129 INFO:tasks.workunit.client.0.smithi045.stdout:5/381: dread d6/d28/d2b/d51/d6c/f71 [0,4194304] 0 2024-09-18T12:52:11.130 INFO:tasks.workunit.client.0.smithi045.stdout:5/382: chown d6/d28 4 1 2024-09-18T12:52:11.133 INFO:tasks.workunit.client.1.smithi161.stdout:6/719: symlink d4/d1a/d1c/d3e/d83/d9e/db1/d28/lf1 0 2024-09-18T12:52:11.134 INFO:tasks.workunit.client.1.smithi161.stdout:6/720: write d4/d1a/d1c/d3e/f42 [1325580,71055] 0 2024-09-18T12:52:11.136 INFO:tasks.workunit.client.1.smithi161.stdout:3/655: rename d1/d2e/d14/d65/fa1 to d1/d2e/d3d/d49/fdf 0 2024-09-18T12:52:11.136 INFO:tasks.workunit.client.1.smithi161.stdout:6/721: truncate d4/fa8 843366 0 2024-09-18T12:52:11.137 INFO:tasks.workunit.client.0.smithi045.stdout:7/257: mknod d13/d1a/c5a 0 2024-09-18T12:52:11.138 INFO:tasks.workunit.client.1.smithi161.stdout:4/738: creat d5/d27/d44/d61/f106 x:0 0 0 2024-09-18T12:52:11.139 INFO:tasks.workunit.client.0.smithi045.stdout:7/258: fsync d13/d1a/f2e 0 2024-09-18T12:52:11.141 INFO:tasks.workunit.client.1.smithi161.stdout:8/704: creat d0/d3/d91/fea x:0 0 0 2024-09-18T12:52:11.142 INFO:tasks.workunit.client.1.smithi161.stdout:2/710: symlink d0/d1/deb/d3d/d4f/d9b/lf6 0 2024-09-18T12:52:11.142 INFO:tasks.workunit.client.0.smithi045.stdout:6/290: sync 2024-09-18T12:52:11.142 INFO:tasks.workunit.client.0.smithi045.stdout:0/360: sync 2024-09-18T12:52:11.142 INFO:tasks.workunit.client.0.smithi045.stdout:4/367: sync 2024-09-18T12:52:11.144 INFO:tasks.workunit.client.0.smithi045.stdout:2/329: dwrite d5/f22 [0,4194304] 0 2024-09-18T12:52:11.144 INFO:tasks.workunit.client.1.smithi161.stdout:2/711: stat d0/d71/c91 0 2024-09-18T12:52:11.144 INFO:tasks.workunit.client.1.smithi161.stdout:0/698: symlink df/d30/d71/d96/dd3/d51/dc9/lfb 0 2024-09-18T12:52:11.145 INFO:tasks.workunit.client.0.smithi045.stdout:3/324: dwrite d0/fe [4194304,4194304] 0 2024-09-18T12:52:11.147 INFO:tasks.workunit.client.1.smithi161.stdout:3/656: dwrite d1/d2e/d14/f56 [0,4194304] 0 2024-09-18T12:52:11.147 INFO:tasks.workunit.client.1.smithi161.stdout:8/705: readlink d0/d3/d10/d21/d4a/d52/d82/d96/d98/l1f 0 2024-09-18T12:52:11.147 INFO:tasks.workunit.client.1.smithi161.stdout:9/601: dread d0/d16/d25/d28/f33 [0,4194304] 0 2024-09-18T12:52:11.148 INFO:tasks.workunit.client.1.smithi161.stdout:6/722: dwrite d4/d1a/d1c/d3e/d4d/f78 [0,4194304] 0 2024-09-18T12:52:11.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/590: mkdir d1/da/dc6 0 2024-09-18T12:52:11.157 INFO:tasks.workunit.client.0.smithi045.stdout:7/259: symlink d13/d1a/l5b 0 2024-09-18T12:52:11.160 INFO:tasks.workunit.client.0.smithi045.stdout:5/383: mknod d6/d28/d2b/c7d 0 2024-09-18T12:52:11.161 INFO:tasks.workunit.client.1.smithi161.stdout:7/631: sync 2024-09-18T12:52:11.161 INFO:tasks.workunit.client.0.smithi045.stdout:7/260: dread d13/d1a/d28/f3a [0,4194304] 0 2024-09-18T12:52:11.161 INFO:tasks.workunit.client.1.smithi161.stdout:3/657: write d1/d2e/f6e [2295833,19705] 0 2024-09-18T12:52:11.167 INFO:tasks.workunit.client.1.smithi161.stdout:0/699: rmdir df/d29 39 2024-09-18T12:52:11.167 INFO:tasks.workunit.client.1.smithi161.stdout:6/723: dread d4/d1a/d1c/d3e/d83/d9e/db1/d45/fe8 [0,4194304] 0 2024-09-18T12:52:11.167 INFO:tasks.workunit.client.1.smithi161.stdout:5/638: creat d3/d9/d4b/d8e/d24/db8/da4/fce x:0 0 0 2024-09-18T12:52:11.167 INFO:tasks.workunit.client.0.smithi045.stdout:6/291: chown d9/d1a/f2e 169700 1 2024-09-18T12:52:11.168 INFO:tasks.workunit.client.0.smithi045.stdout:7/261: dread d13/f17 [0,4194304] 0 2024-09-18T12:52:11.168 INFO:tasks.workunit.client.1.smithi161.stdout:5/639: readlink d3/d9/d4b/d8e/d24/d61/l7c 0 2024-09-18T12:52:11.168 INFO:tasks.workunit.client.1.smithi161.stdout:6/724: write d4/d39/d48/fed [527265,107186] 0 2024-09-18T12:52:11.172 INFO:tasks.workunit.client.1.smithi161.stdout:4/739: dread d5/d14/f23 [0,4194304] 0 2024-09-18T12:52:11.172 INFO:tasks.workunit.client.0.smithi045.stdout:9/255: truncate d0/d3/d6/f22 486186 0 2024-09-18T12:52:11.173 INFO:tasks.workunit.client.1.smithi161.stdout:4/740: read - d5/d27/f81 zero size 2024-09-18T12:52:11.175 INFO:tasks.workunit.client.1.smithi161.stdout:9/602: stat d0/d16/c1e 0 2024-09-18T12:52:11.175 INFO:tasks.workunit.client.1.smithi161.stdout:5/640: dwrite d3/d14/f1b [0,4194304] 0 2024-09-18T12:52:11.176 INFO:tasks.workunit.client.0.smithi045.stdout:2/330: dread - d5/d2c/d4d/d33/f4f zero size 2024-09-18T12:52:11.177 INFO:tasks.workunit.client.1.smithi161.stdout:9/603: write d0/d16/d25/d28/d45/f60 [572863,112884] 0 2024-09-18T12:52:11.180 INFO:tasks.workunit.client.1.smithi161.stdout:9/604: rename d0 to d0/d47/dc7 22 2024-09-18T12:52:11.180 INFO:tasks.workunit.client.0.smithi045.stdout:8/330: truncate d11/f16 2339696 0 2024-09-18T12:52:11.180 INFO:tasks.workunit.client.0.smithi045.stdout:2/331: write d5/d2c/d4d/f68 [396581,126852] 0 2024-09-18T12:52:11.181 INFO:tasks.workunit.client.1.smithi161.stdout:2/712: dread d0/d5/d43/d35/d98/ddf/f85 [0,4194304] 0 2024-09-18T12:52:11.182 INFO:tasks.workunit.client.1.smithi161.stdout:7/632: creat d3/d8/d4f/fbf x:0 0 0 2024-09-18T12:52:11.183 INFO:tasks.workunit.client.0.smithi045.stdout:9/256: dwrite d0/d3/f2b [0,4194304] 0 2024-09-18T12:52:11.183 INFO:tasks.workunit.client.0.smithi045.stdout:5/384: symlink d6/d2a/d5c/l7e 0 2024-09-18T12:52:11.183 INFO:tasks.workunit.client.0.smithi045.stdout:2/332: chown d5/d2c/d4d/d16 436 1 2024-09-18T12:52:11.183 INFO:tasks.workunit.client.1.smithi161.stdout:7/633: stat d3/f2e 0 2024-09-18T12:52:11.184 INFO:tasks.workunit.client.1.smithi161.stdout:2/713: truncate d0/d5/d43/d35/d98/ddf/d8b/f97 358758 0 2024-09-18T12:52:11.187 INFO:tasks.workunit.client.1.smithi161.stdout:0/700: dread df/d30/d71/d96/dd3/d90/f4b [0,4194304] 0 2024-09-18T12:52:11.188 INFO:tasks.workunit.client.0.smithi045.stdout:6/292: mknod d9/d1a/d2d/d32/c6a 0 2024-09-18T12:52:11.188 INFO:tasks.workunit.client.0.smithi045.stdout:2/333: chown d5/d2c/d4d/d16/c24 268278 1 2024-09-18T12:52:11.188 INFO:tasks.workunit.client.0.smithi045.stdout:6/293: chown d9/d1a/d2d/d32/c6a 386182 1 2024-09-18T12:52:11.188 INFO:tasks.workunit.client.0.smithi045.stdout:7/262: unlink d13/d31/f40 0 2024-09-18T12:52:11.189 INFO:tasks.workunit.client.1.smithi161.stdout:6/725: unlink d4/d39/d47/d51/c86 0 2024-09-18T12:52:11.193 INFO:tasks.workunit.client.1.smithi161.stdout:4/741: creat d5/d14/d5f/f107 x:0 0 0 2024-09-18T12:52:11.194 INFO:tasks.workunit.client.1.smithi161.stdout:5/641: creat d3/d8/fcf x:0 0 0 2024-09-18T12:52:11.197 INFO:tasks.workunit.client.1.smithi161.stdout:5/642: read d3/d9/d4b/f99 [127748,116874] 0 2024-09-18T12:52:11.198 INFO:tasks.workunit.client.0.smithi045.stdout:9/257: mknod d0/d3/d6/c55 0 2024-09-18T12:52:11.198 INFO:tasks.workunit.client.1.smithi161.stdout:5/643: write d3/d44/d6f/d86/f94 [978196,117068] 0 2024-09-18T12:52:11.199 INFO:tasks.workunit.client.0.smithi045.stdout:5/385: rmdir d6/d2a/d5c 39 2024-09-18T12:52:11.200 INFO:tasks.workunit.client.1.smithi161.stdout:8/706: creat d0/d3/d10/d21/d4a/d52/d82/d96/dc1/feb x:0 0 0 2024-09-18T12:52:11.200 INFO:tasks.workunit.client.1.smithi161.stdout:5/644: dread - d3/d9/d4b/d8e/fa1 zero size 2024-09-18T12:52:11.200 INFO:tasks.workunit.client.0.smithi045.stdout:5/386: chown d6/d28/c37 488 1 2024-09-18T12:52:11.202 INFO:tasks.workunit.client.0.smithi045.stdout:0/361: dread f4 [0,4194304] 0 2024-09-18T12:52:11.203 INFO:tasks.workunit.client.0.smithi045.stdout:2/334: mknod d5/d2c/d4d/d16/d61/c75 0 2024-09-18T12:52:11.204 INFO:tasks.workunit.client.0.smithi045.stdout:0/362: read - d6/d35/f5f zero size 2024-09-18T12:52:11.204 INFO:tasks.workunit.client.1.smithi161.stdout:2/714: mkdir d0/d71/da9/dd6/df7 0 2024-09-18T12:52:11.205 INFO:tasks.workunit.client.0.smithi045.stdout:6/294: mknod d9/d1a/d2d/d38/c6b 0 2024-09-18T12:52:11.208 INFO:tasks.workunit.client.1.smithi161.stdout:6/726: creat d4/d1a/d1c/d3e/d83/d9e/db1/d45/dd6/ff2 x:0 0 0 2024-09-18T12:52:11.210 INFO:tasks.workunit.client.1.smithi161.stdout:4/742: symlink d5/d14/d67/dc7/d60/l108 0 2024-09-18T12:52:11.213 INFO:tasks.workunit.client.1.smithi161.stdout:9/605: mknod d0/d47/d48/d88/cc8 0 2024-09-18T12:52:11.216 INFO:tasks.workunit.client.1.smithi161.stdout:5/645: symlink d3/d9/d4b/d8e/d24/db8/da4/daf/ld0 0 2024-09-18T12:52:11.217 INFO:tasks.workunit.client.1.smithi161.stdout:7/634: symlink d3/d8/d15/da7/d24/daf/lc0 0 2024-09-18T12:52:11.217 INFO:tasks.workunit.client.1.smithi161.stdout:5/646: chown d3/d9/d4b/d8e/d24/db8/da4/daf 209240446 1 2024-09-18T12:52:11.218 INFO:tasks.workunit.client.1.smithi161.stdout:5/647: readlink d3/d44/d6f/l83 0 2024-09-18T12:52:11.219 INFO:tasks.workunit.client.1.smithi161.stdout:2/715: rename d0/d5/d43/f45 to d0/d5/d43/d35/d98/de1/ff8 0 2024-09-18T12:52:11.219 INFO:tasks.workunit.client.1.smithi161.stdout:0/701: symlink df/lfc 0 2024-09-18T12:52:11.221 INFO:tasks.workunit.client.1.smithi161.stdout:6/727: read d4/f19 [4077234,130085] 0 2024-09-18T12:52:11.221 INFO:tasks.workunit.client.1.smithi161.stdout:4/743: symlink d5/d14/d67/dc7/d60/d95/dda/de8/l109 0 2024-09-18T12:52:11.221 INFO:tasks.workunit.client.1.smithi161.stdout:7/635: dread d3/d8/d15/da7/d4a/d59/f69 [0,4194304] 0 2024-09-18T12:52:11.222 INFO:tasks.workunit.client.1.smithi161.stdout:7/636: dread - d3/d8/d4b/f6f zero size 2024-09-18T12:52:11.223 INFO:tasks.workunit.client.1.smithi161.stdout:9/606: symlink d0/d16/d25/d28/d45/lc9 0 2024-09-18T12:52:11.224 INFO:tasks.workunit.client.1.smithi161.stdout:9/607: chown d0/db/lb4 3498212 1 2024-09-18T12:52:11.224 INFO:tasks.workunit.client.1.smithi161.stdout:8/707: mknod d0/d3/d1e/dda/de3/cec 0 2024-09-18T12:52:11.226 INFO:tasks.workunit.client.1.smithi161.stdout:8/708: read - d0/d3/d91/fc7 zero size 2024-09-18T12:52:11.228 INFO:tasks.workunit.client.1.smithi161.stdout:9/608: rmdir d0/d93/da0 39 2024-09-18T12:52:11.231 INFO:tasks.workunit.client.1.smithi161.stdout:0/702: write df/d29/f2c [2351961,41851] 0 2024-09-18T12:52:11.231 INFO:tasks.workunit.client.1.smithi161.stdout:5/648: fsync d3/d9/d4b/d8e/d24/f36 0 2024-09-18T12:52:11.235 INFO:tasks.workunit.client.1.smithi161.stdout:6/728: dwrite d4/d61/d69/d87/fba [4194304,4194304] 0 2024-09-18T12:52:11.237 INFO:tasks.workunit.client.1.smithi161.stdout:4/744: dwrite d5/d14/d67/dc7/d47/d49/d7b/faf [0,4194304] 0 2024-09-18T12:52:11.237 INFO:tasks.workunit.client.1.smithi161.stdout:9/609: truncate d0/d47/d48/f75 980753 0 2024-09-18T12:52:11.238 INFO:tasks.workunit.client.1.smithi161.stdout:5/649: symlink d3/d14/d8d/dab/ld1 0 2024-09-18T12:52:11.240 INFO:tasks.workunit.client.1.smithi161.stdout:8/709: getdents d0/d3/d10/d21/d4a 0 2024-09-18T12:52:11.241 INFO:tasks.workunit.client.1.smithi161.stdout:2/716: dread d0/d5/d43/d35/d98/ddf/f59 [0,4194304] 0 2024-09-18T12:52:11.244 INFO:tasks.workunit.client.1.smithi161.stdout:4/745: fdatasync d5/d32/d39/db6/fc2 0 2024-09-18T12:52:11.246 INFO:tasks.workunit.client.1.smithi161.stdout:3/658: dwrite d1/d2e/d3d/d49/fdf [0,4194304] 0 2024-09-18T12:52:11.248 INFO:tasks.workunit.client.1.smithi161.stdout:2/717: chown d0/d71/fd5 454 1 2024-09-18T12:52:11.253 INFO:tasks.workunit.client.1.smithi161.stdout:3/659: dread - d1/d2e/d68/d69/d7d/fda zero size 2024-09-18T12:52:11.257 INFO:tasks.workunit.client.1.smithi161.stdout:4/746: mknod d5/d27/d44/de2/c10a 0 2024-09-18T12:52:11.258 INFO:tasks.workunit.client.1.smithi161.stdout:0/703: dwrite df/d29/f3c [4194304,4194304] 0 2024-09-18T12:52:11.259 INFO:tasks.workunit.client.1.smithi161.stdout:2/718: write d0/d71/da9/fd7 [5073763,60410] 0 2024-09-18T12:52:11.260 INFO:tasks.workunit.client.1.smithi161.stdout:5/650: getdents d3/d3b 0 2024-09-18T12:52:11.261 INFO:tasks.workunit.client.1.smithi161.stdout:6/729: dwrite d4/d61/d69/fae [0,4194304] 0 2024-09-18T12:52:11.261 INFO:tasks.workunit.client.1.smithi161.stdout:9/610: dwrite d0/d16/d25/d46/f68 [0,4194304] 0 2024-09-18T12:52:11.266 INFO:tasks.workunit.client.1.smithi161.stdout:2/719: write d0/d1/deb/d93/fbc [68712,113524] 0 2024-09-18T12:52:11.270 INFO:tasks.workunit.client.1.smithi161.stdout:6/730: chown d4/d39/d47/d88/fdb 102936299 1 2024-09-18T12:52:11.270 INFO:tasks.workunit.client.1.smithi161.stdout:4/747: creat d5/d32/d39/f10b x:0 0 0 2024-09-18T12:52:11.272 INFO:tasks.workunit.client.1.smithi161.stdout:3/660: dread d1/d2e/d14/d65/f91 [0,4194304] 0 2024-09-18T12:52:11.272 INFO:tasks.workunit.client.1.smithi161.stdout:9/611: rename d0/d16/d25/d46/d53/d59/cc2 to d0/d47/d48/d9a/cca 0 2024-09-18T12:52:11.274 INFO:tasks.workunit.client.0.smithi045.stdout:1/352: sync 2024-09-18T12:52:11.277 INFO:tasks.workunit.client.1.smithi161.stdout:0/704: dwrite df/f26 [0,4194304] 0 2024-09-18T12:52:11.277 INFO:tasks.workunit.client.1.smithi161.stdout:4/748: mknod d5/d27/d44/d61/d6c/c10c 0 2024-09-18T12:52:11.277 INFO:tasks.workunit.client.1.smithi161.stdout:6/731: chown d4/d1a/d1c/f4a 89908 1 2024-09-18T12:52:11.279 INFO:tasks.workunit.client.1.smithi161.stdout:2/720: link d0/f24 d0/d5/d43/d35/ff9 0 2024-09-18T12:52:11.280 INFO:tasks.workunit.client.1.smithi161.stdout:3/661: mkdir d1/d2e/d14/d65/d76/d8c/de0 0 2024-09-18T12:52:11.282 INFO:tasks.workunit.client.1.smithi161.stdout:8/710: dwrite d0/d3/d10/d21/d4a/d52/d66/d5b/fac [0,4194304] 0 2024-09-18T12:52:11.286 INFO:tasks.workunit.client.1.smithi161.stdout:1/591: sync 2024-09-18T12:52:11.290 INFO:tasks.workunit.client.1.smithi161.stdout:9/612: dwrite d0/d47/d48/d9a/f9d [4194304,4194304] 0 2024-09-18T12:52:11.291 INFO:tasks.workunit.client.1.smithi161.stdout:4/749: rename d5/d14/d67/dc7/d60/d95/ceb to d5/da9/db9/c10d 0 2024-09-18T12:52:11.292 INFO:tasks.workunit.client.1.smithi161.stdout:3/662: mkdir d1/d2e/d14/d65/d76/d8c/de1 0 2024-09-18T12:52:11.298 INFO:tasks.workunit.client.0.smithi045.stdout:0/363: fdatasync d6/d35/f3e 0 2024-09-18T12:52:11.300 INFO:tasks.workunit.client.1.smithi161.stdout:1/592: dread d1/da/d1f/d45/d73/f92 [0,4194304] 0 2024-09-18T12:52:11.300 INFO:tasks.workunit.client.1.smithi161.stdout:9/613: dread d0/db/fbc [0,4194304] 0 2024-09-18T12:52:11.300 INFO:tasks.workunit.client.0.smithi045.stdout:9/258: symlink d0/d3/d6/d10/l56 0 2024-09-18T12:52:11.300 INFO:tasks.workunit.client.0.smithi045.stdout:2/335: truncate d5/d2c/f63 129600 0 2024-09-18T12:52:11.302 INFO:tasks.workunit.client.1.smithi161.stdout:6/732: dwrite d4/d1a/d1c/d3e/d83/f8d [8388608,4194304] 0 2024-09-18T12:52:11.302 INFO:tasks.workunit.client.1.smithi161.stdout:0/705: dwrite df/de2/dc5/db6/fc2 [0,4194304] 0 2024-09-18T12:52:11.304 INFO:tasks.workunit.client.0.smithi045.stdout:6/295: dread d9/f23 [0,4194304] 0 2024-09-18T12:52:11.304 INFO:tasks.workunit.client.0.smithi045.stdout:0/364: dread - d6/d48/d4a/f4c zero size 2024-09-18T12:52:11.306 INFO:tasks.workunit.client.1.smithi161.stdout:3/663: truncate d1/d2e/d24/d84/fc1 839220 0 2024-09-18T12:52:11.306 INFO:tasks.workunit.client.1.smithi161.stdout:8/711: link d0/d3/d10/d21/d4a/lb2 d0/d3/d10/d21/d4a/d52/de2/led 0 2024-09-18T12:52:11.306 INFO:tasks.workunit.client.0.smithi045.stdout:5/387: dwrite d6/db/d5a/d78/d66/f74 [0,4194304] 0 2024-09-18T12:52:11.307 INFO:tasks.workunit.client.0.smithi045.stdout:9/259: chown d0/d3/d6/d10/d2c/f30 824850 1 2024-09-18T12:52:11.312 INFO:tasks.workunit.client.1.smithi161.stdout:6/733: truncate d4/d39/d48/fb6 861279 0 2024-09-18T12:52:11.312 INFO:tasks.workunit.client.1.smithi161.stdout:5/651: dwrite d3/d14/d20/f3c [0,4194304] 0 2024-09-18T12:52:11.313 INFO:tasks.workunit.client.0.smithi045.stdout:8/331: truncate d11/d20/f27 4185046 0 2024-09-18T12:52:11.313 INFO:tasks.workunit.client.1.smithi161.stdout:4/750: rename d5/d14/d67/dc7/d60/fe5 to d5/d32/d39/dbf/f10e 0 2024-09-18T12:52:11.313 INFO:tasks.workunit.client.0.smithi045.stdout:4/368: dwrite db/d20/f44 [4194304,4194304] 0 2024-09-18T12:52:11.315 INFO:tasks.workunit.client.1.smithi161.stdout:4/751: truncate d5/da9/fef 681485 0 2024-09-18T12:52:11.315 INFO:tasks.workunit.client.1.smithi161.stdout:1/593: unlink d1/d26/c82 0 2024-09-18T12:52:11.316 INFO:tasks.workunit.client.0.smithi045.stdout:8/332: write d11/d20/d46/f51 [2010095,1726] 0 2024-09-18T12:52:11.318 INFO:tasks.workunit.client.1.smithi161.stdout:2/721: dwrite d0/d1/f3 [8388608,4194304] 0 2024-09-18T12:52:11.318 INFO:tasks.workunit.client.1.smithi161.stdout:1/594: fsync d1/da/d1f/f7a 0 2024-09-18T12:52:11.321 INFO:tasks.workunit.client.0.smithi045.stdout:6/296: chown d9/l14 57 1 2024-09-18T12:52:11.323 INFO:tasks.workunit.client.1.smithi161.stdout:9/614: readlink d0/d16/d25/d46/d53/la8 0 2024-09-18T12:52:11.326 INFO:tasks.workunit.client.1.smithi161.stdout:1/595: dwrite d1/f5 [0,4194304] 0 2024-09-18T12:52:11.327 INFO:tasks.workunit.client.1.smithi161.stdout:8/712: read - d0/d3/f68 zero size 2024-09-18T12:52:11.329 INFO:tasks.workunit.client.0.smithi045.stdout:0/365: rename d6/d48/d4a to d6/d48/d5e/d39/d58/d3c/d69 0 2024-09-18T12:52:11.329 INFO:tasks.workunit.client.1.smithi161.stdout:7/637: sync 2024-09-18T12:52:11.330 INFO:tasks.workunit.client.1.smithi161.stdout:8/713: write d0/d3/d10/d21/d4a/d52/d82/d96/dc1/fd2 [551859,122413] 0 2024-09-18T12:52:11.331 INFO:tasks.workunit.client.1.smithi161.stdout:0/706: symlink df/d30/d71/d96/dd3/d78/lfd 0 2024-09-18T12:52:11.333 INFO:tasks.workunit.client.1.smithi161.stdout:6/734: write d4/d61/f89 [1099370,87032] 0 2024-09-18T12:52:11.334 INFO:tasks.workunit.client.1.smithi161.stdout:5/652: readlink d3/d9/l17 0 2024-09-18T12:52:11.335 INFO:tasks.workunit.client.1.smithi161.stdout:5/653: chown d3/d9/cc0 39740539 1 2024-09-18T12:52:11.337 INFO:tasks.workunit.client.0.smithi045.stdout:3/325: link d0/d7/cf d0/d1e/d2c/c6e 0 2024-09-18T12:52:11.337 INFO:tasks.workunit.client.1.smithi161.stdout:5/654: write d3/d3b/d7b/da6/fa8 [926363,69725] 0 2024-09-18T12:52:11.339 INFO:tasks.workunit.client.1.smithi161.stdout:2/722: mkdir d0/d1/d4c/d67/db9/dcb/d8a/dfa 0 2024-09-18T12:52:11.340 INFO:tasks.workunit.client.0.smithi045.stdout:1/353: truncate d0/f2 2052019 0 2024-09-18T12:52:11.340 INFO:tasks.workunit.client.1.smithi161.stdout:9/615: rmdir d0/d16/d25/d46/d53 39 2024-09-18T12:52:11.342 INFO:tasks.workunit.client.0.smithi045.stdout:2/336: mkdir d5/d2c/d4d/d76 0 2024-09-18T12:52:11.345 INFO:tasks.workunit.client.1.smithi161.stdout:7/638: mkdir d3/d8/d4f/dc1 0 2024-09-18T12:52:11.346 INFO:tasks.workunit.client.1.smithi161.stdout:3/664: dread d1/fd7 [0,4194304] 0 2024-09-18T12:52:11.347 INFO:tasks.workunit.client.1.smithi161.stdout:3/665: chown d1/d2e/d68 448635279 1 2024-09-18T12:52:11.348 INFO:tasks.workunit.client.0.smithi045.stdout:4/369: mkdir db/de/d1e/d3e/d47/d59/d7a 0 2024-09-18T12:52:11.348 INFO:tasks.workunit.client.0.smithi045.stdout:9/260: write d0/d3/d6/d10/d26/d2e/f32 [1729303,10285] 0 2024-09-18T12:52:11.348 INFO:tasks.workunit.client.1.smithi161.stdout:8/714: mkdir d0/d3/d10/d21/d4a/d52/d66/d5b/de0/dee 0 2024-09-18T12:52:11.349 INFO:tasks.workunit.client.0.smithi045.stdout:5/388: mkdir d6/d28/d2b/d7f 0 2024-09-18T12:52:11.351 INFO:tasks.workunit.client.0.smithi045.stdout:8/333: dwrite d11/f17 [0,4194304] 0 2024-09-18T12:52:11.352 INFO:tasks.workunit.client.0.smithi045.stdout:8/334: write d11/d14/f4b [19212,82376] 0 2024-09-18T12:52:11.354 INFO:tasks.workunit.client.1.smithi161.stdout:4/752: rename d5/l6 to d5/da9/de7/l10f 0 2024-09-18T12:52:11.355 INFO:tasks.workunit.client.1.smithi161.stdout:4/753: chown d5/d14/f23 5516 1 2024-09-18T12:52:11.357 INFO:tasks.workunit.client.1.smithi161.stdout:9/616: rmdir d0/d16/d25/d28 39 2024-09-18T12:52:11.358 INFO:tasks.workunit.client.1.smithi161.stdout:8/715: dwrite d0/d3/d10/d21/d4a/d52/d66/fe9 [0,4194304] 0 2024-09-18T12:52:11.360 INFO:tasks.workunit.client.1.smithi161.stdout:1/596: link d1/d26/d3a/f7b d1/da/d1f/d45/d73/fc7 0 2024-09-18T12:52:11.361 INFO:tasks.workunit.client.0.smithi045.stdout:1/354: rename d0/d2d/d2b/d30/f65 to d0/d2d/d2b/d30/d3d/f6b 0 2024-09-18T12:52:11.364 INFO:tasks.workunit.client.1.smithi161.stdout:7/639: mknod d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/cc2 0 2024-09-18T12:52:11.366 INFO:tasks.workunit.client.0.smithi045.stdout:4/370: creat db/de/f7b x:0 0 0 2024-09-18T12:52:11.369 INFO:tasks.workunit.client.0.smithi045.stdout:9/261: unlink d0/d3/d6/fd 0 2024-09-18T12:52:11.371 INFO:tasks.workunit.client.0.smithi045.stdout:5/389: write d6/d28/d2b/d51/d6c/f71 [1347408,58717] 0 2024-09-18T12:52:11.375 INFO:tasks.workunit.client.1.smithi161.stdout:6/735: rename d4/d39/l6f to d4/d1a/d1c/d3e/d83/d9e/db1/d28/d81/lf3 0 2024-09-18T12:52:11.376 INFO:tasks.workunit.client.0.smithi045.stdout:0/366: dwrite d6/d48/d5e/d39/d58/f28 [0,4194304] 0 2024-09-18T12:52:11.377 INFO:tasks.workunit.client.1.smithi161.stdout:6/736: read - d4/d39/d26/d31/fd9 zero size 2024-09-18T12:52:11.383 INFO:tasks.workunit.client.0.smithi045.stdout:1/355: mkdir d0/d2d/d6c 0 2024-09-18T12:52:11.384 INFO:tasks.workunit.client.0.smithi045.stdout:1/356: chown d0/d2d/d2b 2 1 2024-09-18T12:52:11.385 INFO:tasks.workunit.client.1.smithi161.stdout:3/666: mknod d1/d2e/d24/ce2 0 2024-09-18T12:52:11.389 INFO:tasks.workunit.client.0.smithi045.stdout:2/337: creat d5/d2c/d4d/d76/f77 x:0 0 0 2024-09-18T12:52:11.389 INFO:tasks.workunit.client.0.smithi045.stdout:6/297: write d9/d1a/d1d/f5a [942341,91772] 0 2024-09-18T12:52:11.389 INFO:tasks.workunit.client.1.smithi161.stdout:7/640: unlink d3/d8/d15/da7/f41 0 2024-09-18T12:52:11.389 INFO:tasks.workunit.client.0.smithi045.stdout:4/371: creat db/de/d1e/d3e/d47/d59/d13/f7c x:0 0 0 2024-09-18T12:52:11.391 INFO:tasks.workunit.client.1.smithi161.stdout:0/707: rmdir df/d29/d36/d7a/deb/df0 0 2024-09-18T12:52:11.392 INFO:tasks.workunit.client.0.smithi045.stdout:9/262: creat d0/d3/d6/d10/d2c/f57 x:0 0 0 2024-09-18T12:52:11.394 INFO:tasks.workunit.client.0.smithi045.stdout:9/263: chown d0/d3/d6/d10/d26/d2e/f48 33483 1 2024-09-18T12:52:11.394 INFO:tasks.workunit.client.1.smithi161.stdout:4/754: rename d5/d32/d39/d4d/fd7 to d5/d27/d44/d61/f110 0 2024-09-18T12:52:11.396 INFO:tasks.workunit.client.1.smithi161.stdout:2/723: truncate d0/d5/d43/d35/d98/ddf/f85 2560182 0 2024-09-18T12:52:11.398 INFO:tasks.workunit.client.1.smithi161.stdout:6/737: mkdir d4/d1a/d1c/d3e/d83/d9e/db1/d28/d81/df4 0 2024-09-18T12:52:11.398 INFO:tasks.workunit.client.1.smithi161.stdout:5/655: dwrite d3/d14/d20/f74 [0,4194304] 0 2024-09-18T12:52:11.399 INFO:tasks.workunit.client.0.smithi045.stdout:5/390: symlink d6/db/d5a/d78/l80 0 2024-09-18T12:52:11.401 INFO:tasks.workunit.client.0.smithi045.stdout:0/367: unlink d6/c62 0 2024-09-18T12:52:11.402 INFO:tasks.workunit.client.0.smithi045.stdout:0/368: readlink d6/d7/l2f 0 2024-09-18T12:52:11.406 INFO:tasks.workunit.client.1.smithi161.stdout:0/708: dread df/f24 [0,4194304] 0 2024-09-18T12:52:11.407 INFO:tasks.workunit.client.1.smithi161.stdout:7/641: mknod d3/d8/d15/da7/d4a/d64/cc3 0 2024-09-18T12:52:11.408 INFO:tasks.workunit.client.1.smithi161.stdout:7/642: chown d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/ca9 0 1 2024-09-18T12:52:11.410 INFO:tasks.workunit.client.0.smithi045.stdout:0/369: dwrite d6/d48/f4d [0,4194304] 0 2024-09-18T12:52:11.412 INFO:tasks.workunit.client.0.smithi045.stdout:9/264: dread d0/d3/f7 [0,4194304] 0 2024-09-18T12:52:11.414 INFO:tasks.workunit.client.0.smithi045.stdout:9/265: write d0/d3/d6/d10/d26/d2e/f32 [1244687,33784] 0 2024-09-18T12:52:11.415 INFO:tasks.workunit.client.0.smithi045.stdout:9/266: fdatasync d0/d3/f2b 0 2024-09-18T12:52:11.423 INFO:tasks.workunit.client.0.smithi045.stdout:4/372: creat db/d2c/d35/d40/f7d x:0 0 0 2024-09-18T12:52:11.426 INFO:tasks.workunit.client.0.smithi045.stdout:8/335: link d11/d20/l30 d11/l6a 0 2024-09-18T12:52:11.429 INFO:tasks.workunit.client.1.smithi161.stdout:1/597: rename d1/d26/l64 to d1/dbf/lc8 0 2024-09-18T12:52:11.429 INFO:tasks.workunit.client.1.smithi161.stdout:2/724: creat d0/d4/d78/ffb x:0 0 0 2024-09-18T12:52:11.431 INFO:tasks.workunit.client.1.smithi161.stdout:9/617: creat d0/d16/fcb x:0 0 0 2024-09-18T12:52:11.431 INFO:tasks.workunit.client.1.smithi161.stdout:5/656: truncate d3/fa0 5332661 0 2024-09-18T12:52:11.431 INFO:tasks.workunit.client.1.smithi161.stdout:7/643: dwrite d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/fa5 [0,4194304] 0 2024-09-18T12:52:11.431 INFO:tasks.workunit.client.1.smithi161.stdout:3/667: symlink d1/d2e/d3d/d49/dce/le3 0 2024-09-18T12:52:11.431 INFO:tasks.workunit.client.0.smithi045.stdout:3/326: getdents d0/d1e/d2c/d5c 0 2024-09-18T12:52:11.434 INFO:tasks.workunit.client.0.smithi045.stdout:1/357: dwrite d0/f69 [0,4194304] 0 2024-09-18T12:52:11.435 INFO:tasks.workunit.client.0.smithi045.stdout:3/327: truncate d0/d1e/d2c/d3a/d45/f6c 132354 0 2024-09-18T12:52:11.436 INFO:tasks.workunit.client.0.smithi045.stdout:2/338: creat d5/d5f/f78 x:0 0 0 2024-09-18T12:52:11.437 INFO:tasks.workunit.client.1.smithi161.stdout:8/716: rename d0/d3/d10/d21/d4a/d52/d82/d96/d98/l1f to d0/d3/d10/d21/d4a/d52/d82/lef 0 2024-09-18T12:52:11.438 INFO:tasks.workunit.client.1.smithi161.stdout:5/657: dwrite d3/d9/d4b/d8e/d24/db8/da4/daf/fb2 [0,4194304] 0 2024-09-18T12:52:11.441 INFO:tasks.workunit.client.0.smithi045.stdout:9/267: symlink d0/d3/d6/d10/d26/d2e/l58 0 2024-09-18T12:52:11.443 INFO:tasks.workunit.client.1.smithi161.stdout:1/598: write d1/d26/fb [3388788,35178] 0 2024-09-18T12:52:11.444 INFO:tasks.workunit.client.0.smithi045.stdout:1/358: dwrite d0/fe [0,4194304] 0 2024-09-18T12:52:11.446 INFO:tasks.workunit.client.0.smithi045.stdout:1/359: write d0/d12/d32/d67/d6a/f51 [413810,79604] 0 2024-09-18T12:52:11.460 INFO:tasks.workunit.client.0.smithi045.stdout:8/336: write fd [4975454,85615] 0 2024-09-18T12:52:11.461 INFO:tasks.workunit.client.0.smithi045.stdout:4/373: dread db/d1b/f23 [0,4194304] 0 2024-09-18T12:52:11.462 INFO:tasks.workunit.client.1.smithi161.stdout:9/618: read d0/d16/f9c [2739147,16281] 0 2024-09-18T12:52:11.463 INFO:tasks.workunit.client.1.smithi161.stdout:9/619: stat d0/l98 0 2024-09-18T12:52:11.466 INFO:tasks.workunit.client.1.smithi161.stdout:3/668: mkdir d1/d2e/d24/d1d/d89/db0/de4 0 2024-09-18T12:52:11.466 INFO:tasks.workunit.client.1.smithi161.stdout:3/669: chown d1/d2e/d3d/d49/l62 111354143 1 2024-09-18T12:52:11.468 INFO:tasks.workunit.client.1.smithi161.stdout:4/755: creat d5/d27/f111 x:0 0 0 2024-09-18T12:52:11.469 INFO:tasks.workunit.client.1.smithi161.stdout:4/756: dread - d5/d14/d5f/f107 zero size 2024-09-18T12:52:11.469 INFO:tasks.workunit.client.0.smithi045.stdout:1/360: dread d0/d12/f3b [0,4194304] 0 2024-09-18T12:52:11.469 INFO:tasks.workunit.client.0.smithi045.stdout:8/337: dwrite d11/d20/d46/f51 [0,4194304] 0 2024-09-18T12:52:11.478 INFO:tasks.workunit.client.0.smithi045.stdout:9/268: creat d0/f59 x:0 0 0 2024-09-18T12:52:11.480 INFO:tasks.workunit.client.1.smithi161.stdout:6/738: sync 2024-09-18T12:52:11.482 INFO:tasks.workunit.client.1.smithi161.stdout:2/725: write d0/d4/d78/f9c [397341,76078] 0 2024-09-18T12:52:11.483 INFO:tasks.workunit.client.0.smithi045.stdout:2/339: dwrite d5/d2c/d4d/d16/f64 [0,4194304] 0 2024-09-18T12:52:11.483 INFO:tasks.workunit.client.1.smithi161.stdout:2/726: readlink d0/d1/l20 0 2024-09-18T12:52:11.484 INFO:tasks.workunit.client.0.smithi045.stdout:6/298: rmdir d9/d56/d63 0 2024-09-18T12:52:11.487 INFO:tasks.workunit.client.1.smithi161.stdout:6/739: dwrite d4/d1a/d1c/d3e/d83/d9e/db1/d28/f4b [0,4194304] 0 2024-09-18T12:52:11.491 INFO:tasks.workunit.client.0.smithi045.stdout:4/374: mknod db/de/d1a/d2e/c7e 0 2024-09-18T12:52:11.491 INFO:tasks.workunit.client.1.smithi161.stdout:0/709: write df/f23 [1588607,81764] 0 2024-09-18T12:52:11.492 INFO:tasks.workunit.client.1.smithi161.stdout:9/620: mknod d0/d47/d48/d88/ccc 0 2024-09-18T12:52:11.493 INFO:tasks.workunit.client.1.smithi161.stdout:9/621: readlink d0/db/d18/l34 0 2024-09-18T12:52:11.494 INFO:tasks.workunit.client.1.smithi161.stdout:0/710: chown df/d30/d71/d96/dd3/d90/d37/de0/ff2 2028 1 2024-09-18T12:52:11.495 INFO:tasks.workunit.client.0.smithi045.stdout:2/340: dwrite d5/d2c/d4d/d33/f69 [0,4194304] 0 2024-09-18T12:52:11.496 INFO:tasks.workunit.client.1.smithi161.stdout:3/670: mkdir d1/d2e/d14/d2c/de5 0 2024-09-18T12:52:11.496 INFO:tasks.workunit.client.0.smithi045.stdout:8/338: symlink d11/d20/d59/l6b 0 2024-09-18T12:52:11.498 INFO:tasks.workunit.client.1.smithi161.stdout:4/757: rmdir d5/d14/d67/dc7/d47/d49/dca 39 2024-09-18T12:52:11.499 INFO:tasks.workunit.client.0.smithi045.stdout:5/391: dwrite d6/d2a/f76 [0,4194304] 0 2024-09-18T12:52:11.500 INFO:tasks.workunit.client.0.smithi045.stdout:5/392: read d6/d2a/d61/f72 [107596,50641] 0 2024-09-18T12:52:11.500 INFO:tasks.workunit.client.0.smithi045.stdout:1/361: mkdir d0/d12/d32/d67/d6d 0 2024-09-18T12:52:11.501 INFO:tasks.workunit.client.0.smithi045.stdout:1/362: readlink d0/d12/l1e 0 2024-09-18T12:52:11.502 INFO:tasks.workunit.client.0.smithi045.stdout:5/393: fsync d6/db/fe 0 2024-09-18T12:52:11.506 INFO:tasks.workunit.client.1.smithi161.stdout:4/758: dwrite d5/f2c [0,4194304] 0 2024-09-18T12:52:11.508 INFO:tasks.workunit.client.0.smithi045.stdout:6/299: mkdir d9/d30/d6c 0 2024-09-18T12:52:11.511 INFO:tasks.workunit.client.0.smithi045.stdout:5/394: dwrite d6/db/f6b [0,4194304] 0 2024-09-18T12:52:11.512 INFO:tasks.workunit.client.0.smithi045.stdout:5/395: stat d6 0 2024-09-18T12:52:11.516 INFO:tasks.workunit.client.0.smithi045.stdout:0/370: getdents d6/d48/d5e/d39/d58/d3c 0 2024-09-18T12:52:11.516 INFO:tasks.workunit.client.1.smithi161.stdout:7/644: dwrite d3/d50/fba [0,4194304] 0 2024-09-18T12:52:11.518 INFO:tasks.workunit.client.0.smithi045.stdout:0/371: truncate d6/d7/fa 1118755 0 2024-09-18T12:52:11.521 INFO:tasks.workunit.client.0.smithi045.stdout:4/375: creat db/de/d1a/d2e/f7f x:0 0 0 2024-09-18T12:52:11.525 INFO:tasks.workunit.client.0.smithi045.stdout:2/341: symlink d5/d46/l79 0 2024-09-18T12:52:11.525 INFO:tasks.workunit.client.0.smithi045.stdout:4/376: write db/f21 [2772547,5570] 0 2024-09-18T12:52:11.527 INFO:tasks.workunit.client.1.smithi161.stdout:7/645: dwrite d3/d8/d4b/f6f [0,4194304] 0 2024-09-18T12:52:11.529 INFO:tasks.workunit.client.0.smithi045.stdout:1/363: symlink d0/d2d/d2b/l6e 0 2024-09-18T12:52:11.531 INFO:tasks.workunit.client.0.smithi045.stdout:9/269: creat d0/d3/d6/d10/d26/d2e/d4e/f5a x:0 0 0 2024-09-18T12:52:11.532 INFO:tasks.workunit.client.0.smithi045.stdout:4/377: dread - db/d2c/d35/d40/f7d zero size 2024-09-18T12:52:11.532 INFO:tasks.workunit.client.1.smithi161.stdout:7/646: dwrite d3/d36/f65 [0,4194304] 0 2024-09-18T12:52:11.535 INFO:tasks.workunit.client.0.smithi045.stdout:0/372: dread d6/d48/d5e/d39/d58/f28 [0,4194304] 0 2024-09-18T12:52:11.538 INFO:tasks.workunit.client.0.smithi045.stdout:0/373: dread - d6/d48/d5e/d39/d58/f68 zero size 2024-09-18T12:52:11.541 INFO:tasks.workunit.client.0.smithi045.stdout:5/396: rename d6/la to d6/d28/d2b/d7f/l81 0 2024-09-18T12:52:11.545 INFO:tasks.workunit.client.0.smithi045.stdout:6/300: dwrite d9/d1a/d2d/d38/d5b/f61 [0,4194304] 0 2024-09-18T12:52:11.552 INFO:tasks.workunit.client.0.smithi045.stdout:2/342: creat d5/d46/f7a x:0 0 0 2024-09-18T12:52:11.556 INFO:tasks.workunit.client.0.smithi045.stdout:3/328: getdents d0/d1e/d2c/d3a/d45 0 2024-09-18T12:52:11.559 INFO:tasks.workunit.client.0.smithi045.stdout:1/364: mkdir d0/d12/d6f 0 2024-09-18T12:52:11.559 INFO:tasks.workunit.client.0.smithi045.stdout:3/329: fsync d0/d29/d5f/f6b 0 2024-09-18T12:52:11.562 INFO:tasks.workunit.client.1.smithi161.stdout:0/711: mkdir df/d30/d71/dfe 0 2024-09-18T12:52:11.563 INFO:tasks.workunit.client.0.smithi045.stdout:2/343: dwrite d5/d2c/d4d/d16/f64 [0,4194304] 0 2024-09-18T12:52:11.564 INFO:tasks.workunit.client.0.smithi045.stdout:8/339: dwrite d11/d14/f19 [0,4194304] 0 2024-09-18T12:52:11.566 INFO:tasks.workunit.client.0.smithi045.stdout:2/344: write d5/d2c/d4d/d16/d61/f66 [678855,130398] 0 2024-09-18T12:52:11.567 INFO:tasks.workunit.client.1.smithi161.stdout:3/671: rename d1/d2e/d14/d65/d76/d8c/d9d/cd2 to d1/d2e/d14/d65/d76/d8c/de0/ce6 0 2024-09-18T12:52:11.568 INFO:tasks.workunit.client.0.smithi045.stdout:6/301: rmdir d9/d30 39 2024-09-18T12:52:11.569 INFO:tasks.workunit.client.0.smithi045.stdout:8/340: dread - d11/d20/f64 zero size 2024-09-18T12:52:11.569 INFO:tasks.workunit.client.0.smithi045.stdout:8/341: fdatasync d11/d14/f4c 0 2024-09-18T12:52:11.571 INFO:tasks.workunit.client.0.smithi045.stdout:4/378: rename db/d2c/d35/f3b to db/f80 0 2024-09-18T12:52:11.572 INFO:tasks.workunit.client.0.smithi045.stdout:4/379: truncate db/de/f6a 19684 0 2024-09-18T12:52:11.576 INFO:tasks.workunit.client.1.smithi161.stdout:8/717: write d0/f12 [3489853,16401] 0 2024-09-18T12:52:11.577 INFO:tasks.workunit.client.0.smithi045.stdout:9/270: symlink d0/d3/l5b 0 2024-09-18T12:52:11.579 INFO:tasks.workunit.client.0.smithi045.stdout:9/271: write d0/d3/d6/d10/d2c/f57 [802285,95951] 0 2024-09-18T12:52:11.581 INFO:tasks.workunit.client.1.smithi161.stdout:7/647: mknod d3/d8/d15/da7/d24/d31/d7d/cc4 0 2024-09-18T12:52:11.583 INFO:tasks.workunit.client.1.smithi161.stdout:5/658: dwrite d3/d14/d20/f3e [4194304,4194304] 0 2024-09-18T12:52:11.584 INFO:tasks.workunit.client.1.smithi161.stdout:5/659: truncate d3/d3b/d54/f96 387835 0 2024-09-18T12:52:11.586 INFO:tasks.workunit.client.0.smithi045.stdout:1/365: creat d0/d12/d32/d37/f70 x:0 0 0 2024-09-18T12:52:11.587 INFO:tasks.workunit.client.0.smithi045.stdout:2/345: dread d5/d2c/d4d/d33/f43 [0,4194304] 0 2024-09-18T12:52:11.588 INFO:tasks.workunit.client.1.smithi161.stdout:4/759: dread d5/d27/d44/d61/d6c/fd1 [0,4194304] 0 2024-09-18T12:52:11.589 INFO:tasks.workunit.client.0.smithi045.stdout:6/302: rmdir d9/d56 39 2024-09-18T12:52:11.589 INFO:tasks.workunit.client.1.smithi161.stdout:1/599: link d1/da/d1f/f2c d1/d26/d3a/fc9 0 2024-09-18T12:52:11.592 INFO:tasks.workunit.client.1.smithi161.stdout:2/727: mknod d0/d1/cfc 0 2024-09-18T12:52:11.593 INFO:tasks.workunit.client.1.smithi161.stdout:9/622: symlink d0/d47/d48/lcd 0 2024-09-18T12:52:11.593 INFO:tasks.workunit.client.0.smithi045.stdout:9/272: dwrite d0/d3/d6/d10/d2c/f44 [0,4194304] 0 2024-09-18T12:52:11.595 INFO:tasks.workunit.client.1.smithi161.stdout:0/712: creat df/d30/d71/d96/dd3/d90/d37/d55/fff x:0 0 0 2024-09-18T12:52:11.601 INFO:tasks.workunit.client.1.smithi161.stdout:3/672: creat d1/d2e/d68/d92/dba/fe7 x:0 0 0 2024-09-18T12:52:11.602 INFO:tasks.workunit.client.1.smithi161.stdout:3/673: chown d1/d2e/d3d/d49/fde 8364942 1 2024-09-18T12:52:11.604 INFO:tasks.workunit.client.1.smithi161.stdout:7/648: creat d3/d50/fc5 x:0 0 0 2024-09-18T12:52:11.605 INFO:tasks.workunit.client.1.smithi161.stdout:5/660: chown d3/d9/c9e 17109 1 2024-09-18T12:52:11.606 INFO:tasks.workunit.client.1.smithi161.stdout:6/740: creat d4/d61/ff5 x:0 0 0 2024-09-18T12:52:11.607 INFO:tasks.workunit.client.1.smithi161.stdout:6/741: chown d4/d39/d47/le1 518973 1 2024-09-18T12:52:11.610 INFO:tasks.workunit.client.1.smithi161.stdout:3/674: mkdir d1/d2e/d68/de8 0 2024-09-18T12:52:11.612 INFO:tasks.workunit.client.1.smithi161.stdout:7/649: symlink d3/d8/d4b/lc6 0 2024-09-18T12:52:11.614 INFO:tasks.workunit.client.1.smithi161.stdout:4/760: mknod d5/d27/d44/df3/c112 0 2024-09-18T12:52:11.615 INFO:tasks.workunit.client.1.smithi161.stdout:2/728: creat d0/d71/da9/d9f/dd0/ffd x:0 0 0 2024-09-18T12:52:11.616 INFO:tasks.workunit.client.1.smithi161.stdout:2/729: write d0/f41 [958166,42814] 0 2024-09-18T12:52:11.617 INFO:tasks.workunit.client.0.smithi045.stdout:3/330: symlink d0/d1e/d2c/d3f/d44/l6f 0 2024-09-18T12:52:11.618 INFO:tasks.workunit.client.0.smithi045.stdout:3/331: chown d0/d29/d5f 7397550 1 2024-09-18T12:52:11.620 INFO:tasks.workunit.client.0.smithi045.stdout:8/342: mknod d11/d20/c6c 0 2024-09-18T12:52:11.620 INFO:tasks.workunit.client.1.smithi161.stdout:2/730: truncate d0/d5/d43/d35/d80/fca 953324 0 2024-09-18T12:52:11.621 INFO:tasks.workunit.client.1.smithi161.stdout:6/742: creat d4/d1a/d1c/d3e/d83/d9e/db1/d45/ddf/ff6 x:0 0 0 2024-09-18T12:52:11.621 INFO:tasks.workunit.client.1.smithi161.stdout:8/718: dwrite d0/d3/d10/f18 [0,4194304] 0 2024-09-18T12:52:11.621 INFO:tasks.workunit.client.0.smithi045.stdout:6/303: creat d9/d1a/d48/f6d x:0 0 0 2024-09-18T12:52:11.622 INFO:tasks.workunit.client.1.smithi161.stdout:4/761: fsync d5/d27/f46 0 2024-09-18T12:52:11.623 INFO:tasks.workunit.client.0.smithi045.stdout:2/346: symlink d5/d2c/d4d/d16/d61/l7b 0 2024-09-18T12:52:11.626 INFO:tasks.workunit.client.0.smithi045.stdout:5/397: rename d6/db/l48 to d6/db/d5a/d78/d66/l82 0 2024-09-18T12:52:11.627 INFO:tasks.workunit.client.0.smithi045.stdout:5/398: chown d6/db/f6b 0 1 2024-09-18T12:52:11.628 INFO:tasks.workunit.client.1.smithi161.stdout:6/743: dwrite d4/d39/d3a/f3f [0,4194304] 0 2024-09-18T12:52:11.628 INFO:tasks.workunit.client.0.smithi045.stdout:4/380: unlink db/de/d1e/d49/c72 0 2024-09-18T12:52:11.630 INFO:tasks.workunit.client.1.smithi161.stdout:0/713: rmdir df/d30/d71/d96/dd3/d90/d37/dad/de7 0 2024-09-18T12:52:11.631 INFO:tasks.workunit.client.0.smithi045.stdout:9/273: truncate d0/d3/f7 4511039 0 2024-09-18T12:52:11.631 INFO:tasks.workunit.client.1.smithi161.stdout:2/731: readlink d0/d4/d78/lc0 0 2024-09-18T12:52:11.637 INFO:tasks.workunit.client.0.smithi045.stdout:8/343: creat d11/d14/d53/f6d x:0 0 0 2024-09-18T12:52:11.638 INFO:tasks.workunit.client.1.smithi161.stdout:4/762: mkdir d5/d14/d67/d84/d113 0 2024-09-18T12:52:11.641 INFO:tasks.workunit.client.0.smithi045.stdout:2/347: rmdir d5/d3a/d3e 39 2024-09-18T12:52:11.645 INFO:tasks.workunit.client.1.smithi161.stdout:2/732: truncate d0/f13 3930697 0 2024-09-18T12:52:11.647 INFO:tasks.workunit.client.1.smithi161.stdout:2/733: readlink d0/d5/d43/d35/d98/de1/le6 0 2024-09-18T12:52:11.648 INFO:tasks.workunit.client.0.smithi045.stdout:1/366: dwrite d0/d12/f27 [0,4194304] 0 2024-09-18T12:52:11.649 INFO:tasks.workunit.client.1.smithi161.stdout:0/714: dwrite df/d29/fc0 [0,4194304] 0 2024-09-18T12:52:11.650 INFO:tasks.workunit.client.1.smithi161.stdout:9/623: link d0/f29 d0/d47/d48/d7f/d84/fce 0 2024-09-18T12:52:11.651 INFO:tasks.workunit.client.0.smithi045.stdout:6/304: rename d9/d1a/d48/c5c to d9/d30/c6e 0 2024-09-18T12:52:11.655 INFO:tasks.workunit.client.0.smithi045.stdout:3/332: write d0/d22/f3d [213703,105445] 0 2024-09-18T12:52:11.656 INFO:tasks.workunit.client.1.smithi161.stdout:8/719: creat d0/d3/d1e/ff0 x:0 0 0 2024-09-18T12:52:11.656 INFO:tasks.workunit.client.0.smithi045.stdout:3/333: fdatasync d0/d1e/d2c/d3a/d45/f49 0 2024-09-18T12:52:11.658 INFO:tasks.workunit.client.1.smithi161.stdout:4/763: creat d5/d14/d67/d84/d113/f114 x:0 0 0 2024-09-18T12:52:11.660 INFO:tasks.workunit.client.1.smithi161.stdout:2/734: mkdir d0/d71/da9/d9f/dfe 0 2024-09-18T12:52:11.661 INFO:tasks.workunit.client.1.smithi161.stdout:2/735: stat d0/d1/deb/d3d/l65 0 2024-09-18T12:52:11.661 INFO:tasks.workunit.client.1.smithi161.stdout:2/736: readlink d0/d5/d43/d35/d98/ddf/lac 0 2024-09-18T12:52:11.666 INFO:tasks.workunit.client.1.smithi161.stdout:4/764: truncate d5/d27/d44/d61/d6c/faa 5666447 0 2024-09-18T12:52:11.666 INFO:tasks.workunit.client.1.smithi161.stdout:4/765: chown d5/d32/f42 81 1 2024-09-18T12:52:11.666 INFO:tasks.workunit.client.0.smithi045.stdout:6/305: creat d9/d30/f6f x:0 0 0 2024-09-18T12:52:11.667 INFO:tasks.workunit.client.0.smithi045.stdout:2/348: rename d5/d3a/d3e/f5d to d5/d46/f7c 0 2024-09-18T12:52:11.668 INFO:tasks.workunit.client.0.smithi045.stdout:6/306: read d9/d1a/d1d/f25 [284107,20804] 0 2024-09-18T12:52:11.671 INFO:tasks.workunit.client.1.smithi161.stdout:2/737: unlink d0/d1/d4c/d67/db9/dcb/cd8 0 2024-09-18T12:52:11.672 INFO:tasks.workunit.client.0.smithi045.stdout:5/399: link d6/db/d5a/d78/d66/c67 d6/db/c83 0 2024-09-18T12:52:11.673 INFO:tasks.workunit.client.0.smithi045.stdout:5/400: write d6/db/f50 [2356555,39848] 0 2024-09-18T12:52:11.675 INFO:tasks.workunit.client.0.smithi045.stdout:5/401: write d6/d28/d2b/f2d [2656218,11898] 0 2024-09-18T12:52:11.677 INFO:tasks.workunit.client.1.smithi161.stdout:0/715: creat df/d30/d71/d96/dd3/f100 x:0 0 0 2024-09-18T12:52:11.679 INFO:tasks.workunit.client.1.smithi161.stdout:4/766: symlink d5/d32/d39/dbf/l115 0 2024-09-18T12:52:11.681 INFO:tasks.workunit.client.1.smithi161.stdout:9/624: creat d0/db/fcf x:0 0 0 2024-09-18T12:52:11.682 INFO:tasks.workunit.client.0.smithi045.stdout:9/274: dread d0/d3/d6/d10/d2c/f57 [0,4194304] 0 2024-09-18T12:52:11.685 INFO:tasks.workunit.client.1.smithi161.stdout:8/720: creat d0/d3/d10/d21/d4a/d52/d82/d96/ff1 x:0 0 0 2024-09-18T12:52:11.686 INFO:tasks.workunit.client.0.smithi045.stdout:3/334: fsync d0/d1e/d2c/d3a/f64 0 2024-09-18T12:52:11.689 INFO:tasks.workunit.client.0.smithi045.stdout:2/349: truncate d5/d2c/d4d/d16/f3b 1853782 0 2024-09-18T12:52:11.693 INFO:tasks.workunit.client.0.smithi045.stdout:4/381: dwrite db/de/d1a/f3d [0,4194304] 0 2024-09-18T12:52:11.697 INFO:tasks.workunit.client.0.smithi045.stdout:5/402: creat d6/d28/d2b/d51/d6c/f84 x:0 0 0 2024-09-18T12:52:11.700 INFO:tasks.workunit.client.0.smithi045.stdout:2/350: truncate d5/d3a/d3e/f74 157023 0 2024-09-18T12:52:11.701 INFO:tasks.workunit.client.1.smithi161.stdout:1/600: sync 2024-09-18T12:52:11.701 INFO:tasks.workunit.client.1.smithi161.stdout:9/625: symlink d0/db/d6f/ld0 0 2024-09-18T12:52:11.702 INFO:tasks.workunit.client.0.smithi045.stdout:9/275: dwrite d0/f50 [0,4194304] 0 2024-09-18T12:52:11.702 INFO:tasks.workunit.client.1.smithi161.stdout:2/738: symlink d0/d71/ddb/lff 0 2024-09-18T12:52:11.702 INFO:tasks.workunit.client.1.smithi161.stdout:8/721: creat d0/d3/d10/d21/d4a/d52/d82/d96/dba/ff2 x:0 0 0 2024-09-18T12:52:11.704 INFO:tasks.workunit.client.0.smithi045.stdout:1/367: dwrite d0/d2d/d2b/f2f [0,4194304] 0 2024-09-18T12:52:11.705 INFO:tasks.workunit.client.0.smithi045.stdout:8/344: dwrite d11/d14/d53/d41/f4d [0,4194304] 0 2024-09-18T12:52:11.708 INFO:tasks.workunit.client.0.smithi045.stdout:2/351: write d5/d2c/d4d/d16/f31 [2421329,49168] 0 2024-09-18T12:52:11.711 INFO:tasks.workunit.client.0.smithi045.stdout:2/352: dread - d5/d46/f70 zero size 2024-09-18T12:52:11.711 INFO:tasks.workunit.client.0.smithi045.stdout:9/276: chown d0/d3/d6/d10/l43 10058 1 2024-09-18T12:52:11.712 INFO:tasks.workunit.client.1.smithi161.stdout:1/601: symlink d1/da/d1f/lca 0 2024-09-18T12:52:11.713 INFO:tasks.workunit.client.0.smithi045.stdout:4/382: dwrite db/de/d1a/f3d [0,4194304] 0 2024-09-18T12:52:11.715 INFO:tasks.workunit.client.0.smithi045.stdout:9/277: read d0/d3/d6/d10/f2a [147319,126454] 0 2024-09-18T12:52:11.721 INFO:tasks.workunit.client.0.smithi045.stdout:5/403: symlink d6/db/d70/l85 0 2024-09-18T12:52:11.723 INFO:tasks.workunit.client.1.smithi161.stdout:8/722: creat d0/d3/d10/d21/d4a/ff3 x:0 0 0 2024-09-18T12:52:11.726 INFO:tasks.workunit.client.0.smithi045.stdout:1/368: chown d0/d2d/d2b/d30/c59 13 1 2024-09-18T12:52:11.727 INFO:tasks.workunit.client.0.smithi045.stdout:8/345: unlink d11/d14/c24 0 2024-09-18T12:52:11.733 INFO:tasks.workunit.client.0.smithi045.stdout:9/278: creat d0/f5c x:0 0 0 2024-09-18T12:52:11.733 INFO:tasks.workunit.client.0.smithi045.stdout:5/404: creat d6/d28/d2b/d51/d6c/f86 x:0 0 0 2024-09-18T12:52:11.734 INFO:tasks.workunit.client.0.smithi045.stdout:6/307: getdents d9/d1a/d2d/d38 0 2024-09-18T12:52:11.735 INFO:tasks.workunit.client.0.smithi045.stdout:3/335: rename d0/d1e/c4f to d0/d7/c70 0 2024-09-18T12:52:11.736 INFO:tasks.workunit.client.0.smithi045.stdout:3/336: write d0/d1e/d2c/d3a/f3c [4523429,76146] 0 2024-09-18T12:52:11.737 INFO:tasks.workunit.client.0.smithi045.stdout:9/279: mknod d0/c5d 0 2024-09-18T12:52:11.746 INFO:tasks.workunit.client.1.smithi161.stdout:0/716: getdents df/de2/dc5/d86/da5 0 2024-09-18T12:52:11.747 INFO:tasks.workunit.client.1.smithi161.stdout:4/767: link d5/f1a d5/d27/d44/d61/f116 0 2024-09-18T12:52:11.747 INFO:tasks.workunit.client.1.smithi161.stdout:1/602: readlink d1/da/l8c 0 2024-09-18T12:52:11.747 INFO:tasks.workunit.client.1.smithi161.stdout:2/739: mknod d0/d5/d43/d35/dee/c100 0 2024-09-18T12:52:11.747 INFO:tasks.workunit.client.1.smithi161.stdout:9/626: write d0/db/f17 [3240034,56811] 0 2024-09-18T12:52:11.750 INFO:tasks.workunit.client.1.smithi161.stdout:2/740: write d0/f75 [2206665,8229] 0 2024-09-18T12:52:11.750 INFO:tasks.workunit.client.1.smithi161.stdout:4/768: chown d5/la 14252991 1 2024-09-18T12:52:11.750 INFO:tasks.workunit.client.1.smithi161.stdout:0/717: creat df/d30/d71/d96/dd3/d51/f101 x:0 0 0 2024-09-18T12:52:11.752 INFO:tasks.workunit.client.1.smithi161.stdout:8/723: dread d0/d3/d10/d21/d4a/d52/d66/d5b/f5e [0,4194304] 0 2024-09-18T12:52:11.753 INFO:tasks.workunit.client.1.smithi161.stdout:9/627: creat d0/fd1 x:0 0 0 2024-09-18T12:52:11.754 INFO:tasks.workunit.client.1.smithi161.stdout:0/718: dread - df/de2/dc5/d8a/ff8 zero size 2024-09-18T12:52:11.754 INFO:tasks.workunit.client.1.smithi161.stdout:4/769: creat d5/d14/d67/d84/dae/f117 x:0 0 0 2024-09-18T12:52:11.755 INFO:tasks.workunit.client.1.smithi161.stdout:2/741: creat d0/d1/deb/d3d/d4f/f101 x:0 0 0 2024-09-18T12:52:11.755 INFO:tasks.workunit.client.1.smithi161.stdout:9/628: rmdir d0/db/d18 39 2024-09-18T12:52:11.759 INFO:tasks.workunit.client.1.smithi161.stdout:4/770: dread d5/d27/f46 [0,4194304] 0 2024-09-18T12:52:11.759 INFO:tasks.workunit.client.1.smithi161.stdout:0/719: dread df/de2/dc5/d86/f79 [0,4194304] 0 2024-09-18T12:52:11.762 INFO:tasks.workunit.client.1.smithi161.stdout:4/771: write d5/d32/d39/d4d/f96 [4347516,83293] 0 2024-09-18T12:52:11.764 INFO:tasks.workunit.client.1.smithi161.stdout:4/772: dread - d5/d32/d39/dbf/f10e zero size 2024-09-18T12:52:11.764 INFO:tasks.workunit.client.1.smithi161.stdout:9/629: dwrite d0/d16/d25/d46/fc0 [0,4194304] 0 2024-09-18T12:52:11.765 INFO:tasks.workunit.client.1.smithi161.stdout:1/603: dread d1/f28 [0,4194304] 0 2024-09-18T12:52:11.771 INFO:tasks.workunit.client.1.smithi161.stdout:1/604: dwrite d1/da/f18 [0,4194304] 0 2024-09-18T12:52:11.776 INFO:tasks.workunit.client.1.smithi161.stdout:1/605: read d1/d26/fb [2317134,62751] 0 2024-09-18T12:52:11.787 INFO:tasks.workunit.client.1.smithi161.stdout:5/661: sync 2024-09-18T12:52:11.808 INFO:tasks.workunit.client.1.smithi161.stdout:7/650: sync 2024-09-18T12:52:11.808 INFO:tasks.workunit.client.1.smithi161.stdout:6/744: sync 2024-09-18T12:52:11.808 INFO:tasks.workunit.client.1.smithi161.stdout:3/675: sync 2024-09-18T12:52:11.813 INFO:tasks.workunit.client.1.smithi161.stdout:7/651: dwrite d3/d8/d15/da7/d4a/d64/d8c/d9f/f70 [0,4194304] 0 2024-09-18T12:52:11.815 INFO:tasks.workunit.client.1.smithi161.stdout:7/652: write d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f90 [3599232,7132] 0 2024-09-18T12:52:11.817 INFO:tasks.workunit.client.1.smithi161.stdout:7/653: chown d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/fa5 37946 1 2024-09-18T12:52:11.828 INFO:tasks.workunit.client.0.smithi045.stdout:5/405: mknod d6/db/d19/c87 0 2024-09-18T12:52:11.828 INFO:tasks.workunit.client.1.smithi161.stdout:8/724: mkdir d0/d3/d1e/dda/de3/df4 0 2024-09-18T12:52:11.830 INFO:tasks.workunit.client.0.smithi045.stdout:2/353: creat d5/f7d x:0 0 0 2024-09-18T12:52:11.830 INFO:tasks.workunit.client.0.smithi045.stdout:6/308: mknod d9/d1a/d2d/d38/c70 0 2024-09-18T12:52:11.830 INFO:tasks.workunit.client.0.smithi045.stdout:4/383: rename db/d1b/f23 to db/de/d1a/d2e/f81 0 2024-09-18T12:52:11.830 INFO:tasks.workunit.client.0.smithi045.stdout:6/309: stat d9/f13 0 2024-09-18T12:52:11.831 INFO:tasks.workunit.client.0.smithi045.stdout:3/337: creat d0/d22/f71 x:0 0 0 2024-09-18T12:52:11.832 INFO:tasks.workunit.client.0.smithi045.stdout:6/310: chown d9/f45 66947501 1 2024-09-18T12:52:11.833 INFO:tasks.workunit.client.1.smithi161.stdout:2/742: creat d0/d71/da9/dd6/f102 x:0 0 0 2024-09-18T12:52:11.833 INFO:tasks.workunit.client.0.smithi045.stdout:3/338: chown d0/d29/c32 139 1 2024-09-18T12:52:11.836 INFO:tasks.workunit.client.1.smithi161.stdout:2/743: dread d0/d5/d43/f18 [4194304,4194304] 0 2024-09-18T12:52:11.837 INFO:tasks.workunit.client.1.smithi161.stdout:2/744: chown d0/d1/d4c/d67/l94 2306064 1 2024-09-18T12:52:11.838 INFO:tasks.workunit.client.1.smithi161.stdout:2/745: write d0/d1/f3 [7007801,63372] 0 2024-09-18T12:52:11.838 INFO:tasks.workunit.client.1.smithi161.stdout:2/746: chown d0/d1/d4c/d67 759113 1 2024-09-18T12:52:11.839 INFO:tasks.workunit.client.1.smithi161.stdout:2/747: chown d0/d5/d43/fba 0 1 2024-09-18T12:52:11.843 INFO:tasks.workunit.client.1.smithi161.stdout:4/773: mknod d5/d27/d44/de2/c118 0 2024-09-18T12:52:11.844 INFO:tasks.workunit.client.1.smithi161.stdout:4/774: write d5/d27/f111 [332990,95748] 0 2024-09-18T12:52:11.846 INFO:tasks.workunit.client.1.smithi161.stdout:9/630: dwrite d0/d16/d25/d28/d45/f60 [0,4194304] 0 2024-09-18T12:52:11.847 INFO:tasks.workunit.client.1.smithi161.stdout:6/745: mknod d4/d1a/d1c/d7c/cf7 0 2024-09-18T12:52:11.850 INFO:tasks.workunit.client.1.smithi161.stdout:6/746: chown d4/d61/d9d/da3/fce 19421967 1 2024-09-18T12:52:11.852 INFO:tasks.workunit.client.0.smithi045.stdout:4/384: truncate db/de/d1a/f3d 5139467 0 2024-09-18T12:52:11.853 INFO:tasks.workunit.client.1.smithi161.stdout:6/747: chown d4/d1a/d1c/d3e/d83/d9e/ce4 0 1 2024-09-18T12:52:11.853 INFO:tasks.workunit.client.1.smithi161.stdout:0/720: dwrite df/d30/d4d/d92/f9e [0,4194304] 0 2024-09-18T12:52:11.853 INFO:tasks.workunit.client.0.smithi045.stdout:6/311: write d9/d1a/d2d/f4a [1153128,63832] 0 2024-09-18T12:52:11.853 INFO:tasks.workunit.client.0.smithi045.stdout:2/354: creat d5/d46/f7e x:0 0 0 2024-09-18T12:52:11.854 INFO:tasks.workunit.client.0.smithi045.stdout:1/369: rename d0/d2d/d2b/l66 to d0/d2d/l71 0 2024-09-18T12:52:11.856 INFO:tasks.workunit.client.1.smithi161.stdout:6/748: truncate d4/d1a/d1c/d3e/d83/d9e/db1/d28/f35 4994071 0 2024-09-18T12:52:11.856 INFO:tasks.workunit.client.0.smithi045.stdout:4/385: truncate db/de/d1e/d3e/d47/d59/f66 4535787 0 2024-09-18T12:52:11.859 INFO:tasks.workunit.client.0.smithi045.stdout:3/339: creat d0/d22/f72 x:0 0 0 2024-09-18T12:52:11.859 INFO:tasks.workunit.client.1.smithi161.stdout:1/606: mknod d1/daa/db2/dc0/ccb 0 2024-09-18T12:52:11.860 INFO:tasks.workunit.client.0.smithi045.stdout:3/340: chown d0/d1e/d2c/d3a/d45/f49 245618589 1 2024-09-18T12:52:11.860 INFO:tasks.workunit.client.1.smithi161.stdout:5/662: mknod d3/d14/d8d/db0/cd2 0 2024-09-18T12:52:11.861 INFO:tasks.workunit.client.1.smithi161.stdout:5/663: write d3/d14/f84 [1790960,54770] 0 2024-09-18T12:52:11.862 INFO:tasks.workunit.client.0.smithi045.stdout:2/355: mkdir d5/d2c/d4d/d76/d7f 0 2024-09-18T12:52:11.862 INFO:tasks.workunit.client.1.smithi161.stdout:4/775: rmdir d5/d14/d67/d84/d6e 39 2024-09-18T12:52:11.863 INFO:tasks.workunit.client.1.smithi161.stdout:5/664: truncate d3/d9/d4b/d8e/d24/db8/f49 1385021 0 2024-09-18T12:52:11.863 INFO:tasks.workunit.client.1.smithi161.stdout:4/776: chown d5/d14/c1c 440919 1 2024-09-18T12:52:11.864 INFO:tasks.workunit.client.1.smithi161.stdout:3/676: symlink d1/d2e/d3d/le9 0 2024-09-18T12:52:11.865 INFO:tasks.workunit.client.0.smithi045.stdout:4/386: symlink db/de/d1e/d3e/d47/l82 0 2024-09-18T12:52:11.866 INFO:tasks.workunit.client.1.smithi161.stdout:9/631: chown d0/db/d18/f21 3 1 2024-09-18T12:52:11.866 INFO:tasks.workunit.client.0.smithi045.stdout:6/312: symlink d9/d1a/l71 0 2024-09-18T12:52:11.867 INFO:tasks.workunit.client.1.smithi161.stdout:9/632: truncate d0/d20/d49/f8c 1824868 0 2024-09-18T12:52:11.870 INFO:tasks.workunit.client.0.smithi045.stdout:2/356: rename d5/f7d to d5/d2c/d4d/d33/f80 0 2024-09-18T12:52:11.871 INFO:tasks.workunit.client.0.smithi045.stdout:9/280: getdents d0/d3/d6/d10/d26/d2e 0 2024-09-18T12:52:11.872 INFO:tasks.workunit.client.1.smithi161.stdout:9/633: dwrite d0/d20/d49/f15 [0,4194304] 0 2024-09-18T12:52:11.877 INFO:tasks.workunit.client.1.smithi161.stdout:2/748: fsync d0/d5/d43/d35/d98/ddf/f85 0 2024-09-18T12:52:11.880 INFO:tasks.workunit.client.1.smithi161.stdout:6/749: rmdir d4/d1a/d1c/d7c 39 2024-09-18T12:52:11.881 INFO:tasks.workunit.client.1.smithi161.stdout:6/750: truncate d4/d39/d48/fb6 1403817 0 2024-09-18T12:52:11.883 INFO:tasks.workunit.client.1.smithi161.stdout:8/725: truncate d0/d3/d10/f42 3246690 0 2024-09-18T12:52:11.884 INFO:tasks.workunit.client.1.smithi161.stdout:8/726: write d0/d3/d10/d21/d4a/d52/d66/d5b/fa0 [1773261,2202] 0 2024-09-18T12:52:11.884 INFO:tasks.workunit.client.0.smithi045.stdout:5/406: dread d6/db/d19/f4f [0,4194304] 0 2024-09-18T12:52:11.885 INFO:tasks.workunit.client.0.smithi045.stdout:5/407: write d6/db/f6b [3972005,124491] 0 2024-09-18T12:52:11.885 INFO:tasks.workunit.client.1.smithi161.stdout:4/777: readlink d5/d32/d39/db6/lf9 0 2024-09-18T12:52:11.886 INFO:tasks.workunit.client.0.smithi045.stdout:6/313: write d9/f23 [435454,60145] 0 2024-09-18T12:52:11.887 INFO:tasks.workunit.client.0.smithi045.stdout:9/281: creat d0/d3/d6/d10/d26/d2e/f5e x:0 0 0 2024-09-18T12:52:11.887 INFO:tasks.workunit.client.0.smithi045.stdout:6/314: write d9/d1a/d2d/f5e [764777,2714] 0 2024-09-18T12:52:11.888 INFO:tasks.workunit.client.0.smithi045.stdout:4/387: mknod db/de/d1e/d3e/d47/d59/d7a/c83 0 2024-09-18T12:52:11.888 INFO:tasks.workunit.client.0.smithi045.stdout:5/408: read d6/db/f2c [2425550,50595] 0 2024-09-18T12:52:11.889 INFO:tasks.workunit.client.1.smithi161.stdout:3/677: truncate d1/d2e/d3d/f7 2585499 0 2024-09-18T12:52:11.890 INFO:tasks.workunit.client.0.smithi045.stdout:3/341: truncate d0/d22/f26 3800470 0 2024-09-18T12:52:11.890 INFO:tasks.workunit.client.1.smithi161.stdout:3/678: chown d1/d2e/d14/d65/d76/d8c/d9d 3382240 1 2024-09-18T12:52:11.895 INFO:tasks.workunit.client.0.smithi045.stdout:9/282: symlink d0/d3/d6/d10/d2c/l5f 0 2024-09-18T12:52:11.895 INFO:tasks.workunit.client.1.smithi161.stdout:1/607: mknod d1/d26/dad/db6/ccc 0 2024-09-18T12:52:11.896 INFO:tasks.workunit.client.1.smithi161.stdout:1/608: truncate d1/da/d1f/f7a 740061 0 2024-09-18T12:52:11.897 INFO:tasks.workunit.client.0.smithi045.stdout:5/409: unlink d6/d3e/c27 0 2024-09-18T12:52:11.898 INFO:tasks.workunit.client.0.smithi045.stdout:3/342: unlink d0/d1e/d2c/d3a/f64 0 2024-09-18T12:52:11.900 INFO:tasks.workunit.client.0.smithi045.stdout:4/388: dwrite db/f80 [4194304,4194304] 0 2024-09-18T12:52:11.900 INFO:tasks.workunit.client.0.smithi045.stdout:3/343: readlink d0/d1e/l6a 0 2024-09-18T12:52:11.902 INFO:tasks.workunit.client.0.smithi045.stdout:5/410: write d6/db/d5a/d78/d66/f74 [2829106,17570] 0 2024-09-18T12:52:11.903 INFO:tasks.workunit.client.0.smithi045.stdout:5/411: chown d6/db/d6a/d77 7 1 2024-09-18T12:52:11.907 INFO:tasks.workunit.client.1.smithi161.stdout:5/665: mkdir d3/d9/d85/dd3 0 2024-09-18T12:52:11.908 INFO:tasks.workunit.client.1.smithi161.stdout:5/666: chown d3/d14/d8d 653 1 2024-09-18T12:52:11.910 INFO:tasks.workunit.client.1.smithi161.stdout:8/727: rename d0/d3/d10/d21/d4a/c51 to d0/d3/d10/d21/d4a/db7/cf5 0 2024-09-18T12:52:11.912 INFO:tasks.workunit.client.0.smithi045.stdout:9/283: creat d0/d3/d6/d10/d26/f60 x:0 0 0 2024-09-18T12:52:11.913 INFO:tasks.workunit.client.0.smithi045.stdout:2/357: write d5/d2c/d4d/f1b [2913978,36852] 0 2024-09-18T12:52:11.913 INFO:tasks.workunit.client.1.smithi161.stdout:7/654: getdents d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d 0 2024-09-18T12:52:11.919 INFO:tasks.workunit.client.0.smithi045.stdout:4/389: dread db/f21 [0,4194304] 0 2024-09-18T12:52:11.921 INFO:tasks.workunit.client.1.smithi161.stdout:0/721: creat df/d30/d71/d96/dd3/f102 x:0 0 0 2024-09-18T12:52:11.921 INFO:tasks.workunit.client.0.smithi045.stdout:4/390: rename db/de to db/de/d1a/d84 22 2024-09-18T12:52:11.921 INFO:tasks.workunit.client.0.smithi045.stdout:2/358: dwrite d5/d46/f7e [0,4194304] 0 2024-09-18T12:52:11.922 INFO:tasks.workunit.client.0.smithi045.stdout:4/391: stat db/de/d1a/d2e/c7e 0 2024-09-18T12:52:11.923 INFO:tasks.workunit.client.0.smithi045.stdout:2/359: write d5/d46/f7e [3106217,95202] 0 2024-09-18T12:52:11.923 INFO:tasks.workunit.client.0.smithi045.stdout:3/344: mkdir d0/d29/d5f/d73 0 2024-09-18T12:52:11.924 INFO:tasks.workunit.client.0.smithi045.stdout:4/392: fdatasync db/de/d1a/d2e/f7f 0 2024-09-18T12:52:11.925 INFO:tasks.workunit.client.0.smithi045.stdout:3/345: fsync d0/d1e/d2c/d3a/d45/f69 0 2024-09-18T12:52:11.926 INFO:tasks.workunit.client.0.smithi045.stdout:4/393: chown db/d20/f44 972 1 2024-09-18T12:52:11.928 INFO:tasks.workunit.client.0.smithi045.stdout:5/412: creat d6/d28/f88 x:0 0 0 2024-09-18T12:52:11.931 INFO:tasks.workunit.client.0.smithi045.stdout:9/284: unlink d0/d3/d6/d10/d2c/f35 0 2024-09-18T12:52:11.932 INFO:tasks.workunit.client.0.smithi045.stdout:2/360: dwrite d5/f22 [4194304,4194304] 0 2024-09-18T12:52:11.932 INFO:tasks.workunit.client.1.smithi161.stdout:6/751: link d4/d39/d47/d88/f8a d4/d1a/d1c/d3e/d4d/ff8 0 2024-09-18T12:52:11.933 INFO:tasks.workunit.client.1.smithi161.stdout:4/778: dwrite d5/d27/f37 [0,4194304] 0 2024-09-18T12:52:11.934 INFO:tasks.workunit.client.1.smithi161.stdout:6/752: dread - d4/d39/d47/d51/fe5 zero size 2024-09-18T12:52:11.934 INFO:tasks.workunit.client.0.smithi045.stdout:2/361: write d5/d46/f73 [1235443,105922] 0 2024-09-18T12:52:11.935 INFO:tasks.workunit.client.1.smithi161.stdout:6/753: write d4/d61/d69/d87/fba [5513802,130600] 0 2024-09-18T12:52:11.940 INFO:tasks.workunit.client.1.smithi161.stdout:5/667: mkdir d3/d14/d8d/db0/dd4 0 2024-09-18T12:52:11.942 INFO:tasks.workunit.client.1.smithi161.stdout:9/634: truncate d0/f24 3733822 0 2024-09-18T12:52:11.944 INFO:tasks.workunit.client.1.smithi161.stdout:3/679: rename d1/d2e/d14/f58 to d1/d2e/d14/d78/d83/fea 0 2024-09-18T12:52:11.945 INFO:tasks.workunit.client.0.smithi045.stdout:6/315: link d9/d1a/c31 d9/d1a/d2d/d38/c72 0 2024-09-18T12:52:11.945 INFO:tasks.workunit.client.0.smithi045.stdout:6/316: readlink d9/d1a/d1d/l24 0 2024-09-18T12:52:11.946 INFO:tasks.workunit.client.1.smithi161.stdout:8/728: unlink d0/d3/d10/d21/d4a/ff3 0 2024-09-18T12:52:11.947 INFO:tasks.workunit.client.1.smithi161.stdout:3/680: write d1/d2e/d24/d1d/d89/db0/fa2 [1053843,39619] 0 2024-09-18T12:52:11.948 INFO:tasks.workunit.client.1.smithi161.stdout:9/635: dwrite d0/d47/f4c [4194304,4194304] 0 2024-09-18T12:52:11.950 INFO:tasks.workunit.client.0.smithi045.stdout:5/413: unlink d6/db/d70/c73 0 2024-09-18T12:52:11.951 INFO:tasks.workunit.client.0.smithi045.stdout:5/414: write d6/d2a/d61/f65 [4883720,122948] 0 2024-09-18T12:52:11.952 INFO:tasks.workunit.client.0.smithi045.stdout:9/285: creat d0/f61 x:0 0 0 2024-09-18T12:52:11.953 INFO:tasks.workunit.client.1.smithi161.stdout:2/749: truncate d0/d5/d43/d23/fc3 485102 0 2024-09-18T12:52:11.953 INFO:tasks.workunit.client.0.smithi045.stdout:5/415: chown d6/db/d5a/d78/d66/c6e 46 1 2024-09-18T12:52:11.954 INFO:tasks.workunit.client.0.smithi045.stdout:5/416: read d6/d3e/f3a [3507988,343] 0 2024-09-18T12:52:11.962 INFO:tasks.workunit.client.1.smithi161.stdout:4/779: dread - d5/d14/d67/d84/d6e/f9d zero size 2024-09-18T12:52:11.963 INFO:tasks.workunit.client.1.smithi161.stdout:4/780: read d5/f21 [65673,63443] 0 2024-09-18T12:52:11.964 INFO:tasks.workunit.client.1.smithi161.stdout:4/781: chown d5/d14/d67 1886080396 1 2024-09-18T12:52:11.965 INFO:tasks.workunit.client.1.smithi161.stdout:4/782: fsync d5/d14/d67/dc7/d9b/fec 0 2024-09-18T12:52:11.965 INFO:tasks.workunit.client.1.smithi161.stdout:4/783: chown d5/d32/d39/db6/lf9 119 1 2024-09-18T12:52:11.969 INFO:tasks.workunit.client.0.smithi045.stdout:9/286: creat d0/d3/d6/d10/d26/f62 x:0 0 0 2024-09-18T12:52:11.972 INFO:tasks.workunit.client.0.smithi045.stdout:2/362: rename d5/d46/f53 to d5/d2c/d6f/f81 0 2024-09-18T12:52:11.975 INFO:tasks.workunit.client.0.smithi045.stdout:6/317: symlink d9/d1a/l73 0 2024-09-18T12:52:11.979 INFO:tasks.workunit.client.0.smithi045.stdout:2/363: dwrite d5/d2c/d4d/d16/f64 [0,4194304] 0 2024-09-18T12:52:11.980 INFO:tasks.workunit.client.1.smithi161.stdout:7/655: link d3/d8/f80 d3/d8/d4f/dc1/fc7 0 2024-09-18T12:52:11.981 INFO:tasks.workunit.client.1.smithi161.stdout:7/656: chown d3/d8/d15/da7/d24/d31/d7d/la0 875018 1 2024-09-18T12:52:11.984 INFO:tasks.workunit.client.1.smithi161.stdout:0/722: link df/d29/f2c df/d29/dc7/f103 0 2024-09-18T12:52:11.986 INFO:tasks.workunit.client.0.smithi045.stdout:6/318: write d9/d1a/f37 [362011,30156] 0 2024-09-18T12:52:11.989 INFO:tasks.workunit.client.0.smithi045.stdout:6/319: fdatasync d9/d1a/d2d/d38/f3d 0 2024-09-18T12:52:11.991 INFO:tasks.workunit.client.0.smithi045.stdout:5/417: dwrite d6/db/f43 [4194304,4194304] 0 2024-09-18T12:52:11.992 INFO:tasks.workunit.client.0.smithi045.stdout:2/364: symlink d5/d3a/l82 0 2024-09-18T12:52:11.993 INFO:tasks.workunit.client.1.smithi161.stdout:6/754: mknod d4/d1a/d1c/d7c/cf9 0 2024-09-18T12:52:11.994 INFO:tasks.workunit.client.1.smithi161.stdout:6/755: write d4/d1a/d1c/d3e/d83/d9e/fa4 [305587,79455] 0 2024-09-18T12:52:11.995 INFO:tasks.workunit.client.1.smithi161.stdout:4/784: creat d5/d32/d39/dbf/f119 x:0 0 0 2024-09-18T12:52:11.996 INFO:tasks.workunit.client.1.smithi161.stdout:6/756: readlink d4/d1a/d1c/d3e/d83/d9e/db1/l43 0 2024-09-18T12:52:11.997 INFO:tasks.workunit.client.0.smithi045.stdout:6/320: chown d9/d1a/l2a 3 1 2024-09-18T12:52:12.000 INFO:tasks.workunit.client.1.smithi161.stdout:6/757: fdatasync d4/d39/d48/fed 0 2024-09-18T12:52:12.001 INFO:tasks.workunit.client.0.smithi045.stdout:2/365: chown d5/d2c/d4d/d16/f3b 8 1 2024-09-18T12:52:12.002 INFO:tasks.workunit.client.1.smithi161.stdout:8/729: dwrite d0/d3/f92 [0,4194304] 0 2024-09-18T12:52:12.002 INFO:tasks.workunit.client.0.smithi045.stdout:9/287: unlink d0/d3/d6/d10/d26/d2e/l25 0 2024-09-18T12:52:12.003 INFO:tasks.workunit.client.0.smithi045.stdout:9/288: dread - d0/f61 zero size 2024-09-18T12:52:12.003 INFO:tasks.workunit.client.1.smithi161.stdout:9/636: dread d0/f29 [0,4194304] 0 2024-09-18T12:52:12.004 INFO:tasks.workunit.client.0.smithi045.stdout:6/321: fsync d9/f13 0 2024-09-18T12:52:12.008 INFO:tasks.workunit.client.1.smithi161.stdout:1/609: getdents d1/da/d39 0 2024-09-18T12:52:12.009 INFO:tasks.workunit.client.1.smithi161.stdout:1/610: readlink d1/d26/l1e 0 2024-09-18T12:52:12.009 INFO:tasks.workunit.client.0.smithi045.stdout:2/366: creat d5/d5f/f83 x:0 0 0 2024-09-18T12:52:12.009 INFO:tasks.workunit.client.1.smithi161.stdout:1/611: read - d1/fb8 zero size 2024-09-18T12:52:12.011 INFO:tasks.workunit.client.1.smithi161.stdout:9/637: dwrite d0/d47/f4c [0,4194304] 0 2024-09-18T12:52:12.017 INFO:tasks.workunit.client.0.smithi045.stdout:2/367: rename d5/c48 to d5/d2c/d4d/d76/d7f/c84 0 2024-09-18T12:52:12.019 INFO:tasks.workunit.client.0.smithi045.stdout:9/289: write d0/d3/d6/d10/f2a [1036455,24377] 0 2024-09-18T12:52:12.020 INFO:tasks.workunit.client.0.smithi045.stdout:6/322: mkdir d9/d74 0 2024-09-18T12:52:12.022 INFO:tasks.workunit.client.1.smithi161.stdout:2/750: creat d0/d1/d4c/d67/db9/dcb/f103 x:0 0 0 2024-09-18T12:52:12.022 INFO:tasks.workunit.client.1.smithi161.stdout:2/751: write d0/d1/f7 [515010,72713] 0 2024-09-18T12:52:12.024 INFO:tasks.workunit.client.0.smithi045.stdout:5/418: getdents d6/db 0 2024-09-18T12:52:12.024 INFO:tasks.workunit.client.1.smithi161.stdout:6/758: mknod d4/d1a/d1c/d3e/d83/da2/db4/cfa 0 2024-09-18T12:52:12.025 INFO:tasks.workunit.client.0.smithi045.stdout:5/419: chown d6/db/d19/l49 65653 1 2024-09-18T12:52:12.026 INFO:tasks.workunit.client.1.smithi161.stdout:6/759: readlink d4/d1a/d1c/d3e/d83/d9e/db1/d28/l58 0 2024-09-18T12:52:12.026 INFO:tasks.workunit.client.0.smithi045.stdout:2/368: creat d5/d2c/d4d/d76/d7f/f85 x:0 0 0 2024-09-18T12:52:12.028 INFO:tasks.workunit.client.0.smithi045.stdout:6/323: mkdir d9/d1a/d48/d75 0 2024-09-18T12:52:12.029 INFO:tasks.workunit.client.0.smithi045.stdout:9/290: dwrite d0/d3/d6/d10/d26/d2e/d4e/f5a [0,4194304] 0 2024-09-18T12:52:12.029 INFO:tasks.workunit.client.1.smithi161.stdout:1/612: mknod d1/d48/ccd 0 2024-09-18T12:52:12.030 INFO:tasks.workunit.client.0.smithi045.stdout:6/324: fsync d9/d1a/d2d/f4a 0 2024-09-18T12:52:12.031 INFO:tasks.workunit.client.1.smithi161.stdout:9/638: mknod d0/d20/d49/d65/cd2 0 2024-09-18T12:52:12.031 INFO:tasks.workunit.client.0.smithi045.stdout:6/325: stat d9/d1a/d2d/d38/c3c 0 2024-09-18T12:52:12.033 INFO:tasks.workunit.client.1.smithi161.stdout:5/668: getdents d3/d44/d6f/d86 0 2024-09-18T12:52:12.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:11 smithi045 ceph-mon[28315]: pgmap v28: 65 pgs: 65 active+clean; 1.7 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 224 MiB/s wr, 344 op/s 2024-09-18T12:52:12.034 INFO:tasks.workunit.client.0.smithi045.stdout:9/291: mkdir d0/d3/d6/d10/d2c/d63 0 2024-09-18T12:52:12.035 INFO:tasks.workunit.client.0.smithi045.stdout:6/326: fsync d9/d30/f36 0 2024-09-18T12:52:12.041 INFO:tasks.workunit.client.1.smithi161.stdout:6/760: symlink d4/d1a/d1c/d3e/d83/d9e/lfb 0 2024-09-18T12:52:12.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:11 smithi161 ceph-mon[35784]: pgmap v28: 65 pgs: 65 active+clean; 1.7 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 224 MiB/s wr, 344 op/s 2024-09-18T12:52:12.042 INFO:tasks.workunit.client.1.smithi161.stdout:1/613: creat d1/daa/fce x:0 0 0 2024-09-18T12:52:12.043 INFO:tasks.workunit.client.0.smithi045.stdout:9/292: rmdir d0/d3/d6/d10/d26/d2e 39 2024-09-18T12:52:12.044 INFO:tasks.workunit.client.1.smithi161.stdout:9/639: read - d0/d16/d25/d28/f73 zero size 2024-09-18T12:52:12.044 INFO:tasks.workunit.client.0.smithi045.stdout:2/369: link d5/d2c/d4d/d33/f4f d5/d46/f86 0 2024-09-18T12:52:12.045 INFO:tasks.workunit.client.1.smithi161.stdout:2/752: dread d0/f41 [0,4194304] 0 2024-09-18T12:52:12.047 INFO:tasks.workunit.client.1.smithi161.stdout:7/657: getdents d3/d8/d15/da7/d4a/d64/d8c/d9f 0 2024-09-18T12:52:12.048 INFO:tasks.workunit.client.1.smithi161.stdout:3/681: sync 2024-09-18T12:52:12.048 INFO:tasks.workunit.client.1.smithi161.stdout:7/658: chown d3/d8/d15/da7/d24/d31/lbe 0 1 2024-09-18T12:52:12.049 INFO:tasks.workunit.client.0.smithi045.stdout:9/293: mkdir d0/d3/d6/d64 0 2024-09-18T12:52:12.049 INFO:tasks.workunit.client.0.smithi045.stdout:7/263: sync 2024-09-18T12:52:12.051 INFO:tasks.workunit.client.1.smithi161.stdout:0/723: getdents df/d29 0 2024-09-18T12:52:12.051 INFO:tasks.workunit.client.0.smithi045.stdout:5/420: dwrite d6/d3e/f36 [0,4194304] 0 2024-09-18T12:52:12.052 INFO:tasks.workunit.client.0.smithi045.stdout:9/294: dread - d0/d3/d6/d10/d2c/f49 zero size 2024-09-18T12:52:12.054 INFO:tasks.workunit.client.1.smithi161.stdout:5/669: rename d3/d9/d4b/d8e/d24/d61/f6b to d3/d14/d8d/fd5 0 2024-09-18T12:52:12.058 INFO:tasks.workunit.client.1.smithi161.stdout:8/730: creat d0/ff6 x:0 0 0 2024-09-18T12:52:12.059 INFO:tasks.workunit.client.1.smithi161.stdout:1/614: dread d1/d1d/f57 [0,4194304] 0 2024-09-18T12:52:12.060 INFO:tasks.workunit.client.0.smithi045.stdout:5/421: dwrite d6/d28/d2b/f4e [4194304,4194304] 0 2024-09-18T12:52:12.060 INFO:tasks.workunit.client.1.smithi161.stdout:8/731: chown d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 244349449 1 2024-09-18T12:52:12.066 INFO:tasks.workunit.client.0.smithi045.stdout:2/370: write d5/d2c/d4d/d16/f6e [1458911,120637] 0 2024-09-18T12:52:12.067 INFO:tasks.workunit.client.1.smithi161.stdout:4/785: link d5/f1a d5/d14/d6d/f11a 0 2024-09-18T12:52:12.068 INFO:tasks.workunit.client.0.smithi045.stdout:6/327: getdents d9/d30 0 2024-09-18T12:52:12.069 INFO:tasks.workunit.client.0.smithi045.stdout:9/295: dread d0/d3/f7 [0,4194304] 0 2024-09-18T12:52:12.069 INFO:tasks.workunit.client.1.smithi161.stdout:2/753: creat d0/d71/da9/d9f/f104 x:0 0 0 2024-09-18T12:52:12.070 INFO:tasks.workunit.client.0.smithi045.stdout:6/328: chown d9/d30/l39 462294 1 2024-09-18T12:52:12.070 INFO:tasks.workunit.client.0.smithi045.stdout:9/296: chown d0/d3/l54 186876 1 2024-09-18T12:52:12.070 INFO:tasks.workunit.client.1.smithi161.stdout:7/659: rmdir d3/d8/d15/da7/d44/db7 39 2024-09-18T12:52:12.071 INFO:tasks.workunit.client.1.smithi161.stdout:2/754: write d0/d5/d43/d35/d98/ddf/d8b/f8c [248508,130649] 0 2024-09-18T12:52:12.071 INFO:tasks.workunit.client.1.smithi161.stdout:0/724: mknod df/d98/c104 0 2024-09-18T12:52:12.072 INFO:tasks.workunit.client.0.smithi045.stdout:2/371: fsync d5/d2c/d4d/f32 0 2024-09-18T12:52:12.075 INFO:tasks.workunit.client.0.smithi045.stdout:2/372: truncate d5/d2c/d4d/d16/f31 5145621 0 2024-09-18T12:52:12.076 INFO:tasks.workunit.client.0.smithi045.stdout:5/422: mknod d6/db/d54/c89 0 2024-09-18T12:52:12.080 INFO:tasks.workunit.client.1.smithi161.stdout:5/670: dread d3/d9/d4b/f51 [4194304,4194304] 0 2024-09-18T12:52:12.083 INFO:tasks.workunit.client.0.smithi045.stdout:7/264: rename f11 to d13/d31/d29/f5c 0 2024-09-18T12:52:12.084 INFO:tasks.workunit.client.0.smithi045.stdout:7/265: readlink d13/d31/l3f 0 2024-09-18T12:52:12.084 INFO:tasks.workunit.client.1.smithi161.stdout:9/640: dwrite d0/d47/d48/f61 [0,4194304] 0 2024-09-18T12:52:12.084 INFO:tasks.workunit.client.1.smithi161.stdout:6/761: dread d4/d1a/d1c/f24 [0,4194304] 0 2024-09-18T12:52:12.085 INFO:tasks.workunit.client.1.smithi161.stdout:9/641: chown d0/d47/d48/d9a/f9d 351537233 1 2024-09-18T12:52:12.086 INFO:tasks.workunit.client.1.smithi161.stdout:6/762: dread - d4/d1a/d1c/d3e/d83/fd8 zero size 2024-09-18T12:52:12.086 INFO:tasks.workunit.client.0.smithi045.stdout:5/423: mknod d6/db/d5a/c8a 0 2024-09-18T12:52:12.087 INFO:tasks.workunit.client.1.smithi161.stdout:1/615: write d1/da/d31/f3e [7895471,56018] 0 2024-09-18T12:52:12.088 INFO:tasks.workunit.client.0.smithi045.stdout:9/297: fdatasync d0/d3/d6/d10/d26/d2e/d4e/f5a 0 2024-09-18T12:52:12.088 INFO:tasks.workunit.client.1.smithi161.stdout:2/755: fsync d0/d1/d4c/d67/f6b 0 2024-09-18T12:52:12.090 INFO:tasks.workunit.client.0.smithi045.stdout:9/298: fsync d0/d3/d6/f2d 0 2024-09-18T12:52:12.093 INFO:tasks.workunit.client.0.smithi045.stdout:7/266: rename d13/l22 to d13/d31/d52/l5d 0 2024-09-18T12:52:12.094 INFO:tasks.workunit.client.1.smithi161.stdout:0/725: unlink df/d30/d71/d96/dd3/d90/d37/de0/lf9 0 2024-09-18T12:52:12.095 INFO:tasks.workunit.client.0.smithi045.stdout:5/424: mknod d6/db/d70/c8b 0 2024-09-18T12:52:12.095 INFO:tasks.workunit.client.0.smithi045.stdout:5/425: stat d6/d28/c37 0 2024-09-18T12:52:12.096 INFO:tasks.workunit.client.0.smithi045.stdout:5/426: fdatasync d6/db/d5a/d78/f45 0 2024-09-18T12:52:12.098 INFO:tasks.workunit.client.1.smithi161.stdout:5/671: creat d3/d9/d85/fd6 x:0 0 0 2024-09-18T12:52:12.099 INFO:tasks.workunit.client.0.smithi045.stdout:6/329: link d9/d1a/d2d/d38/c3c d9/d1a/d2d/d32/c76 0 2024-09-18T12:52:12.101 INFO:tasks.workunit.client.1.smithi161.stdout:8/732: mkdir d0/d3/d10/d21/d4a/d52/d82/de6/df7 0 2024-09-18T12:52:12.102 INFO:tasks.workunit.client.0.smithi045.stdout:6/330: dread d9/d1a/d2d/d38/f40 [0,4194304] 0 2024-09-18T12:52:12.103 INFO:tasks.workunit.client.1.smithi161.stdout:7/660: dwrite d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/fbb [4194304,4194304] 0 2024-09-18T12:52:12.103 INFO:tasks.workunit.client.0.smithi045.stdout:9/299: symlink d0/d3/d6/d10/l65 0 2024-09-18T12:52:12.104 INFO:tasks.workunit.client.0.smithi045.stdout:9/300: chown d0/c5d 1634838376 1 2024-09-18T12:52:12.104 INFO:tasks.workunit.client.1.smithi161.stdout:7/661: chown d3/d8/d4f/c63 650586540 1 2024-09-18T12:52:12.105 INFO:tasks.workunit.client.0.smithi045.stdout:7/267: symlink d13/d1a/l5e 0 2024-09-18T12:52:12.108 INFO:tasks.workunit.client.0.smithi045.stdout:5/427: creat d6/db/d6a/d77/f8c x:0 0 0 2024-09-18T12:52:12.112 INFO:tasks.workunit.client.1.smithi161.stdout:3/682: rename d1/d2e/d14/d78/d83/fea to d1/d2e/d24/feb 0 2024-09-18T12:52:12.112 INFO:tasks.workunit.client.0.smithi045.stdout:2/373: getdents d5/d2c/d4d/d16/d61 0 2024-09-18T12:52:12.115 INFO:tasks.workunit.client.1.smithi161.stdout:0/726: creat df/d30/d71/d96/dd3/d90/d37/d55/dba/f105 x:0 0 0 2024-09-18T12:52:12.116 INFO:tasks.workunit.client.0.smithi045.stdout:9/301: truncate d0/f2 5760428 0 2024-09-18T12:52:12.118 INFO:tasks.workunit.client.0.smithi045.stdout:7/268: mkdir d13/d31/d5f 0 2024-09-18T12:52:12.118 INFO:tasks.workunit.client.0.smithi045.stdout:7/269: readlink d13/l48 0 2024-09-18T12:52:12.119 INFO:tasks.workunit.client.1.smithi161.stdout:9/642: write d0/f3 [2782018,115896] 0 2024-09-18T12:52:12.119 INFO:tasks.workunit.client.1.smithi161.stdout:8/733: mknod d0/d3/d10/d21/d4a/d52/d82/cf8 0 2024-09-18T12:52:12.119 INFO:tasks.workunit.client.0.smithi045.stdout:7/270: write d13/d31/f26 [1604686,101705] 0 2024-09-18T12:52:12.121 INFO:tasks.workunit.client.0.smithi045.stdout:5/428: creat d6/d28/d2b/d51/d6c/f8d x:0 0 0 2024-09-18T12:52:12.123 INFO:tasks.workunit.client.1.smithi161.stdout:1/616: write d1/da/d1f/d45/d73/fc7 [2066532,71770] 0 2024-09-18T12:52:12.125 INFO:tasks.workunit.client.0.smithi045.stdout:6/331: symlink d9/d56/l77 0 2024-09-18T12:52:12.125 INFO:tasks.workunit.client.0.smithi045.stdout:6/332: stat d9/d30/l39 0 2024-09-18T12:52:12.126 INFO:tasks.workunit.client.1.smithi161.stdout:6/763: mknod d4/d39/d47/cfc 0 2024-09-18T12:52:12.127 INFO:tasks.workunit.client.0.smithi045.stdout:9/302: write d0/d3/d6/d10/d2c/f57 [1250851,71280] 0 2024-09-18T12:52:12.129 INFO:tasks.workunit.client.0.smithi045.stdout:9/303: chown d0/d3/c20 15527532 1 2024-09-18T12:52:12.132 INFO:tasks.workunit.client.0.smithi045.stdout:9/304: chown d0/d3/d6/d10/f29 57 1 2024-09-18T12:52:12.133 INFO:tasks.workunit.client.0.smithi045.stdout:6/333: dwrite d9/d1a/d48/f6d [0,4194304] 0 2024-09-18T12:52:12.134 INFO:tasks.workunit.client.1.smithi161.stdout:4/786: rename d5/d27/l5c to d5/d14/d67/dc7/d47/d49/dca/d100/l11b 0 2024-09-18T12:52:12.136 INFO:tasks.workunit.client.0.smithi045.stdout:5/429: fsync d6/d2a/f25 0 2024-09-18T12:52:12.138 INFO:tasks.workunit.client.1.smithi161.stdout:3/683: write d1/d2e/d24/f3a [5256979,79116] 0 2024-09-18T12:52:12.141 INFO:tasks.workunit.client.1.smithi161.stdout:3/684: dread - d1/d2e/d68/d92/dba/fe7 zero size 2024-09-18T12:52:12.141 INFO:tasks.workunit.client.0.smithi045.stdout:9/305: dwrite d0/d3/d6/d10/d2c/f49 [0,4194304] 0 2024-09-18T12:52:12.143 INFO:tasks.workunit.client.0.smithi045.stdout:9/306: fdatasync d0/d3/d6/d10/f29 0 2024-09-18T12:52:12.143 INFO:tasks.workunit.client.0.smithi045.stdout:6/334: rename d9/d1a/d2d/f3b to d9/d1a/d2d/f78 0 2024-09-18T12:52:12.144 INFO:tasks.workunit.client.1.smithi161.stdout:7/662: dwrite d3/d8/f80 [0,4194304] 0 2024-09-18T12:52:12.144 INFO:tasks.workunit.client.0.smithi045.stdout:6/335: fsync f5 0 2024-09-18T12:52:12.144 INFO:tasks.workunit.client.1.smithi161.stdout:7/663: dread - d3/d8/d4f/fbf zero size 2024-09-18T12:52:12.145 INFO:tasks.workunit.client.0.smithi045.stdout:9/307: fdatasync d0/f61 0 2024-09-18T12:52:12.148 INFO:tasks.workunit.client.1.smithi161.stdout:3/685: dwrite d1/d2e/d24/d1d/f5d [0,4194304] 0 2024-09-18T12:52:12.150 INFO:tasks.workunit.client.1.smithi161.stdout:9/643: truncate d0/d16/d25/d28/f31 770334 0 2024-09-18T12:52:12.152 INFO:tasks.workunit.client.0.smithi045.stdout:5/430: mknod d6/db/d6a/d6d/c8e 0 2024-09-18T12:52:12.153 INFO:tasks.workunit.client.1.smithi161.stdout:8/734: creat d0/d3/d10/d21/d4a/d52/d66/d5b/ff9 x:0 0 0 2024-09-18T12:52:12.153 INFO:tasks.workunit.client.0.smithi045.stdout:5/431: readlink d6/db/d70/l85 0 2024-09-18T12:52:12.155 INFO:tasks.workunit.client.1.smithi161.stdout:1/617: mknod d1/d26/da6/ccf 0 2024-09-18T12:52:12.156 INFO:tasks.workunit.client.0.smithi045.stdout:6/336: dwrite d9/d1a/d2d/d32/f62 [0,4194304] 0 2024-09-18T12:52:12.157 INFO:tasks.workunit.client.1.smithi161.stdout:9/644: dwrite d0/db/d18/f21 [0,4194304] 0 2024-09-18T12:52:12.158 INFO:tasks.workunit.client.0.smithi045.stdout:9/308: creat d0/f66 x:0 0 0 2024-09-18T12:52:12.161 INFO:tasks.workunit.client.1.smithi161.stdout:5/672: truncate d3/d14/d20/f3e 5985034 0 2024-09-18T12:52:12.164 INFO:tasks.workunit.client.0.smithi045.stdout:5/432: creat d6/d28/f8f x:0 0 0 2024-09-18T12:52:12.165 INFO:tasks.workunit.client.1.smithi161.stdout:8/735: dwrite d0/d3/d10/d21/d4a/db7/fd9 [0,4194304] 0 2024-09-18T12:52:12.166 INFO:tasks.workunit.client.0.smithi045.stdout:6/337: creat d9/d1a/d2d/d38/d5b/d67/f79 x:0 0 0 2024-09-18T12:52:12.168 INFO:tasks.workunit.client.1.smithi161.stdout:8/736: chown d0/d3/d10/d21/d4a/d52/d66/f5c 8081 1 2024-09-18T12:52:12.168 INFO:tasks.workunit.client.1.smithi161.stdout:6/764: dwrite d4/d39/d26/f40 [4194304,4194304] 0 2024-09-18T12:52:12.169 INFO:tasks.workunit.client.0.smithi045.stdout:9/309: creat d0/d3/d6/d10/d26/d2e/d4e/f67 x:0 0 0 2024-09-18T12:52:12.172 INFO:tasks.workunit.client.0.smithi045.stdout:6/338: symlink d9/d1a/d2d/d38/d5b/l7a 0 2024-09-18T12:52:12.172 INFO:tasks.workunit.client.1.smithi161.stdout:3/686: chown d1/d2e/d3d/l23 31 1 2024-09-18T12:52:12.174 INFO:tasks.workunit.client.0.smithi045.stdout:5/433: dwrite d6/db/d6a/d77/f63 [0,4194304] 0 2024-09-18T12:52:12.175 INFO:tasks.workunit.client.0.smithi045.stdout:6/339: write d9/d1a/d2d/f4a [1051869,96290] 0 2024-09-18T12:52:12.176 INFO:tasks.workunit.client.1.smithi161.stdout:2/756: sync 2024-09-18T12:52:12.176 INFO:tasks.workunit.client.0.smithi045.stdout:9/310: creat d0/d3/d6/d10/d26/d2e/d4e/f68 x:0 0 0 2024-09-18T12:52:12.176 INFO:tasks.workunit.client.1.smithi161.stdout:3/687: fsync d1/d2e/d14/d65/d76/d88/fcc 0 2024-09-18T12:52:12.178 INFO:tasks.workunit.client.1.smithi161.stdout:9/645: chown d0/f2f 10450773 1 2024-09-18T12:52:12.180 INFO:tasks.workunit.client.0.smithi045.stdout:5/434: creat d6/d28/d4c/f90 x:0 0 0 2024-09-18T12:52:12.184 INFO:tasks.workunit.client.1.smithi161.stdout:8/737: creat d0/d3/d1e/dda/ffa x:0 0 0 2024-09-18T12:52:12.185 INFO:tasks.workunit.client.0.smithi045.stdout:9/311: dread d0/d3/f7 [0,4194304] 0 2024-09-18T12:52:12.186 INFO:tasks.workunit.client.1.smithi161.stdout:8/738: chown d0/d3/d10/d21/d4a/d52/d82/d96/d98/fbe 13261549 1 2024-09-18T12:52:12.188 INFO:tasks.workunit.client.0.smithi045.stdout:6/340: rename d9/f51 to d9/d1a/d48/f7b 0 2024-09-18T12:52:12.189 INFO:tasks.workunit.client.0.smithi045.stdout:5/435: chown d6/db/d5a/d78/d66/l82 370716 1 2024-09-18T12:52:12.190 INFO:tasks.workunit.client.1.smithi161.stdout:5/673: mkdir d3/d9/dd7 0 2024-09-18T12:52:12.190 INFO:tasks.workunit.client.1.smithi161.stdout:5/674: chown d3/d3b/f98 4 1 2024-09-18T12:52:12.191 INFO:tasks.workunit.client.1.smithi161.stdout:5/675: truncate d3/f6a 9072129 0 2024-09-18T12:52:12.192 INFO:tasks.workunit.client.0.smithi045.stdout:6/341: mknod d9/d30/c7c 0 2024-09-18T12:52:12.192 INFO:tasks.workunit.client.1.smithi161.stdout:0/727: link df/d30/d71/d96/dd3/d51/c73 df/d30/d71/dfe/c106 0 2024-09-18T12:52:12.193 INFO:tasks.workunit.client.0.smithi045.stdout:5/436: symlink d6/db/d70/l91 0 2024-09-18T12:52:12.193 INFO:tasks.workunit.client.1.smithi161.stdout:5/676: dread d3/d44/d6f/fbc [0,4194304] 0 2024-09-18T12:52:12.193 INFO:tasks.workunit.client.0.smithi045.stdout:5/437: fdatasync d6/d28/f8f 0 2024-09-18T12:52:12.194 INFO:tasks.workunit.client.1.smithi161.stdout:7/664: link d3/d8/d4b/l54 d3/d50/lc8 0 2024-09-18T12:52:12.194 INFO:tasks.workunit.client.0.smithi045.stdout:6/342: rmdir d9/d1a/d2d/d32 39 2024-09-18T12:52:12.196 INFO:tasks.workunit.client.0.smithi045.stdout:9/312: creat d0/d3/d6/d10/d26/f69 x:0 0 0 2024-09-18T12:52:12.198 INFO:tasks.workunit.client.1.smithi161.stdout:6/765: rename d4/d1a/d1c/c8c to d4/d39/d48/cfd 0 2024-09-18T12:52:12.199 INFO:tasks.workunit.client.1.smithi161.stdout:3/688: symlink d1/d2e/d24/lec 0 2024-09-18T12:52:12.200 INFO:tasks.workunit.client.0.smithi045.stdout:9/313: unlink d0/d3/d6/l3b 0 2024-09-18T12:52:12.200 INFO:tasks.workunit.client.1.smithi161.stdout:0/728: fdatasync df/d30/d71/d96/dd3/d90/f4b 0 2024-09-18T12:52:12.201 INFO:tasks.workunit.client.0.smithi045.stdout:9/314: fdatasync d0/d3/d6/d10/d26/d2e/f5e 0 2024-09-18T12:52:12.201 INFO:tasks.workunit.client.1.smithi161.stdout:0/729: write df/d29/fc0 [4806072,110344] 0 2024-09-18T12:52:12.202 INFO:tasks.workunit.client.1.smithi161.stdout:9/646: truncate d0/d20/d49/f14 4125592 0 2024-09-18T12:52:12.203 INFO:tasks.workunit.client.1.smithi161.stdout:0/730: chown df/d30/d71/d96/dd3/d90/d37/d55/dba 11029692 1 2024-09-18T12:52:12.203 INFO:tasks.workunit.client.1.smithi161.stdout:5/677: creat d3/d14/d8d/dab/fd8 x:0 0 0 2024-09-18T12:52:12.205 INFO:tasks.workunit.client.0.smithi045.stdout:9/315: write d0/d3/d6/d10/d26/f4a [1427848,51940] 0 2024-09-18T12:52:12.207 INFO:tasks.workunit.client.1.smithi161.stdout:3/689: rename d1/d2e/d3d to d1/d2e/d68/d92/ded 0 2024-09-18T12:52:12.207 INFO:tasks.workunit.client.1.smithi161.stdout:8/739: dread d0/d3/d10/d21/d4a/d52/f95 [0,4194304] 0 2024-09-18T12:52:12.209 INFO:tasks.workunit.client.1.smithi161.stdout:8/740: write d0/d3/d10/fbc [895492,101239] 0 2024-09-18T12:52:12.209 INFO:tasks.workunit.client.1.smithi161.stdout:7/665: mkdir d3/d8/d15/dc9 0 2024-09-18T12:52:12.210 INFO:tasks.workunit.client.1.smithi161.stdout:5/678: mkdir d3/d8/dd9 0 2024-09-18T12:52:12.211 INFO:tasks.workunit.client.1.smithi161.stdout:0/731: symlink df/d30/d71/d96/dd3/d51/l107 0 2024-09-18T12:52:12.211 INFO:tasks.workunit.client.0.smithi045.stdout:8/346: sync 2024-09-18T12:52:12.211 INFO:tasks.workunit.client.0.smithi045.stdout:0/374: sync 2024-09-18T12:52:12.212 INFO:tasks.workunit.client.1.smithi161.stdout:3/690: creat d1/d2e/d68/d92/dba/fee x:0 0 0 2024-09-18T12:52:12.213 INFO:tasks.workunit.client.0.smithi045.stdout:0/375: rmdir d6/d7 39 2024-09-18T12:52:12.215 INFO:tasks.workunit.client.0.smithi045.stdout:0/376: write d6/d48/d5e/d39/d58/d3c/f46 [1015078,125364] 0 2024-09-18T12:52:12.215 INFO:tasks.workunit.client.0.smithi045.stdout:8/347: symlink d11/d14/d53/d41/l6e 0 2024-09-18T12:52:12.216 INFO:tasks.workunit.client.0.smithi045.stdout:0/377: stat d6/d48/d5e/d39/d58/d3b/l56 0 2024-09-18T12:52:12.219 INFO:tasks.workunit.client.0.smithi045.stdout:9/316: fsync d0/d3/d6/d10/d26/f4a 0 2024-09-18T12:52:12.219 INFO:tasks.workunit.client.0.smithi045.stdout:0/378: write d6/d7/d32/f33 [105523,69274] 0 2024-09-18T12:52:12.220 INFO:tasks.workunit.client.0.smithi045.stdout:8/348: mknod d11/d20/d60/c6f 0 2024-09-18T12:52:12.221 INFO:tasks.workunit.client.0.smithi045.stdout:9/317: write d0/d3/d6/f2d [1693909,62732] 0 2024-09-18T12:52:12.221 INFO:tasks.workunit.client.0.smithi045.stdout:0/379: chown d6/d48/d5e/f44 42878 1 2024-09-18T12:52:12.223 INFO:tasks.workunit.client.0.smithi045.stdout:9/318: chown d0/d3/d6/d10/d26/d2e/f5e 320 1 2024-09-18T12:52:12.227 INFO:tasks.workunit.client.0.smithi045.stdout:0/380: dwrite d6/d48/d5e/f24 [4194304,4194304] 0 2024-09-18T12:52:12.229 INFO:tasks.workunit.client.0.smithi045.stdout:0/381: read d6/d7/f1f [2993329,31370] 0 2024-09-18T12:52:12.234 INFO:tasks.workunit.client.0.smithi045.stdout:0/382: dwrite d6/d35/f5f [0,4194304] 0 2024-09-18T12:52:12.235 INFO:tasks.workunit.client.0.smithi045.stdout:0/383: truncate d6/d7/f42 4583184 0 2024-09-18T12:52:12.295 INFO:tasks.workunit.client.1.smithi161.stdout:1/618: sync 2024-09-18T12:52:12.316 INFO:tasks.workunit.client.1.smithi161.stdout:9/647: sync 2024-09-18T12:52:12.346 INFO:tasks.workunit.client.1.smithi161.stdout:8/741: rename d0/d3/d10/d21/d4a/d52/d82/d96/d98/fc5 to d0/d3/d1e/ffb 0 2024-09-18T12:52:12.355 INFO:tasks.workunit.client.1.smithi161.stdout:1/619: creat d1/d26/fd0 x:0 0 0 2024-09-18T12:52:12.356 INFO:tasks.workunit.client.0.smithi045.stdout:0/384: symlink d6/d48/l6a 0 2024-09-18T12:52:12.357 INFO:tasks.workunit.client.1.smithi161.stdout:9/648: symlink d0/d47/d48/d9a/ld3 0 2024-09-18T12:52:12.358 INFO:tasks.workunit.client.0.smithi045.stdout:0/385: fdatasync d6/d48/d5e/d39/d58/f68 0 2024-09-18T12:52:12.358 INFO:tasks.workunit.client.1.smithi161.stdout:4/787: truncate d5/d32/f45 3083059 0 2024-09-18T12:52:12.362 INFO:tasks.workunit.client.0.smithi045.stdout:8/349: dread d11/d20/d46/f43 [0,4194304] 0 2024-09-18T12:52:12.362 INFO:tasks.workunit.client.1.smithi161.stdout:8/742: creat d0/d3/d10/d21/d4a/d52/d82/d96/d98/ffc x:0 0 0 2024-09-18T12:52:12.363 INFO:tasks.workunit.client.0.smithi045.stdout:8/350: write d11/f17 [7989915,41609] 0 2024-09-18T12:52:12.364 INFO:tasks.workunit.client.1.smithi161.stdout:7/666: getdents d3/d8/d15/da7/d4a/d64/d8c/d9f/d55 0 2024-09-18T12:52:12.365 INFO:tasks.workunit.client.1.smithi161.stdout:4/788: dwrite d5/d32/d39/d4d/f68 [0,4194304] 0 2024-09-18T12:52:12.366 INFO:tasks.workunit.client.0.smithi045.stdout:0/386: mkdir d6/d48/d5e/d39/d58/d3b/d6b 0 2024-09-18T12:52:12.368 INFO:tasks.workunit.client.1.smithi161.stdout:5/679: getdents d3/d9/d4b/d8e/d24/d61 0 2024-09-18T12:52:12.368 INFO:tasks.workunit.client.1.smithi161.stdout:2/757: write d0/d1/f5e [682461,82057] 0 2024-09-18T12:52:12.370 INFO:tasks.workunit.client.1.smithi161.stdout:0/732: getdents df/d30/d71/d96/dd3/d90/d37/de0 0 2024-09-18T12:52:12.370 INFO:tasks.workunit.client.0.smithi045.stdout:9/319: getdents d0/d3 0 2024-09-18T12:52:12.371 INFO:tasks.workunit.client.0.smithi045.stdout:9/320: chown d0/d3/l1c 1570 1 2024-09-18T12:52:12.372 INFO:tasks.workunit.client.1.smithi161.stdout:2/758: fdatasync d0/d1/deb/f61 0 2024-09-18T12:52:12.372 INFO:tasks.workunit.client.1.smithi161.stdout:8/743: dread d0/d3/d10/d21/d4a/d52/d82/fd7 [0,4194304] 0 2024-09-18T12:52:12.372 INFO:tasks.workunit.client.0.smithi045.stdout:6/343: write d9/f28 [1306157,67863] 0 2024-09-18T12:52:12.373 INFO:tasks.workunit.client.0.smithi045.stdout:6/344: stat d9/d1a/d1d/f25 0 2024-09-18T12:52:12.374 INFO:tasks.workunit.client.0.smithi045.stdout:6/345: write d9/f23 [1396915,66234] 0 2024-09-18T12:52:12.376 INFO:tasks.workunit.client.0.smithi045.stdout:8/351: link d11/f13 d11/d20/d60/f70 0 2024-09-18T12:52:12.376 INFO:tasks.workunit.client.0.smithi045.stdout:8/352: stat d11/d20/d60 0 2024-09-18T12:52:12.377 INFO:tasks.workunit.client.1.smithi161.stdout:2/759: read - d0/d1/deb/d3d/d4f/f101 zero size 2024-09-18T12:52:12.377 INFO:tasks.workunit.client.1.smithi161.stdout:7/667: dwrite d3/d8/d15/da7/d24/f51 [0,4194304] 0 2024-09-18T12:52:12.381 INFO:tasks.workunit.client.1.smithi161.stdout:4/789: creat d5/d14/d67/dc7/d47/d49/d7b/f11c x:0 0 0 2024-09-18T12:52:12.381 INFO:tasks.workunit.client.1.smithi161.stdout:5/680: dwrite d3/d14/f84 [0,4194304] 0 2024-09-18T12:52:12.383 INFO:tasks.workunit.client.1.smithi161.stdout:5/681: write d3/d8/fcf [353787,78461] 0 2024-09-18T12:52:12.383 INFO:tasks.workunit.client.1.smithi161.stdout:6/766: write d4/d1a/d1c/d3e/d83/d9e/db1/d28/f94 [499517,124342] 0 2024-09-18T12:52:12.384 INFO:tasks.workunit.client.1.smithi161.stdout:6/767: dread - d4/d39/d47/d51/fe5 zero size 2024-09-18T12:52:12.385 INFO:tasks.workunit.client.1.smithi161.stdout:6/768: truncate d4/d61/d9d/da3/fce 844366 0 2024-09-18T12:52:12.386 INFO:tasks.workunit.client.1.smithi161.stdout:6/769: chown d4/d1a/d1c/f2c 48353 1 2024-09-18T12:52:12.388 INFO:tasks.workunit.client.1.smithi161.stdout:6/770: dread d4/d61/d9d/da3/fce [0,4194304] 0 2024-09-18T12:52:12.390 INFO:tasks.workunit.client.1.smithi161.stdout:9/649: mkdir d0/dd4 0 2024-09-18T12:52:12.393 INFO:tasks.workunit.client.0.smithi045.stdout:0/387: creat d6/d7/f6c x:0 0 0 2024-09-18T12:52:12.396 INFO:tasks.workunit.client.0.smithi045.stdout:9/321: link d0/d3/d6/d10/d26/d2e/f48 d0/d3/d6/d10/d26/d2e/f6a 0 2024-09-18T12:52:12.397 INFO:tasks.workunit.client.1.smithi161.stdout:8/744: readlink d0/d3/d10/d21/d4a/d52/d82/ldd 0 2024-09-18T12:52:12.399 INFO:tasks.workunit.client.1.smithi161.stdout:7/668: symlink d3/d8/d15/da7/d24/d31/lca 0 2024-09-18T12:52:12.400 INFO:tasks.workunit.client.0.smithi045.stdout:0/388: rmdir d6/d48/d5e/d39 39 2024-09-18T12:52:12.401 INFO:tasks.workunit.client.1.smithi161.stdout:2/760: rename d0/d1/deb/f5a to d0/d1/d4c/d67/db9/dcb/d8a/f105 0 2024-09-18T12:52:12.402 INFO:tasks.workunit.client.1.smithi161.stdout:2/761: readlink d0/d5/d43/l87 0 2024-09-18T12:52:12.403 INFO:tasks.workunit.client.1.smithi161.stdout:3/691: dwrite d1/d2e/d24/d1d/fa9 [0,4194304] 0 2024-09-18T12:52:12.404 INFO:tasks.workunit.client.1.smithi161.stdout:4/790: symlink d5/d27/d44/l11d 0 2024-09-18T12:52:12.406 INFO:tasks.workunit.client.1.smithi161.stdout:5/682: readlink d3/d9/d4b/d8e/l5e 0 2024-09-18T12:52:12.408 INFO:tasks.workunit.client.1.smithi161.stdout:5/683: dread - d3/f7e zero size 2024-09-18T12:52:12.410 INFO:tasks.workunit.client.1.smithi161.stdout:5/684: write d3/d3b/d54/f69 [674845,57156] 0 2024-09-18T12:52:12.411 INFO:tasks.workunit.client.1.smithi161.stdout:3/692: dwrite d1/d2e/d68/d92/ded/f38 [4194304,4194304] 0 2024-09-18T12:52:12.413 INFO:tasks.workunit.client.0.smithi045.stdout:0/389: link d6/d7/f29 d6/d48/d5e/d39/f6d 0 2024-09-18T12:52:12.414 INFO:tasks.workunit.client.1.smithi161.stdout:9/650: mkdir d0/d16/d25/d28/d45/dd5 0 2024-09-18T12:52:12.419 INFO:tasks.workunit.client.1.smithi161.stdout:8/745: fsync d0/d3/d10/d21/f48 0 2024-09-18T12:52:12.420 INFO:tasks.workunit.client.1.smithi161.stdout:8/746: chown d0/d3/d10/d21/d4a/d52 171 1 2024-09-18T12:52:12.420 INFO:tasks.workunit.client.0.smithi045.stdout:0/390: dwrite d6/d7/fa [0,4194304] 0 2024-09-18T12:52:12.422 INFO:tasks.workunit.client.1.smithi161.stdout:1/620: dwrite d1/f15 [0,4194304] 0 2024-09-18T12:52:12.424 INFO:tasks.workunit.client.0.smithi045.stdout:0/391: write d6/d35/f3f [601656,75658] 0 2024-09-18T12:52:12.426 INFO:tasks.workunit.client.1.smithi161.stdout:7/669: creat d3/d8/d15/da7/d4a/d64/d8c/fcb x:0 0 0 2024-09-18T12:52:12.426 INFO:tasks.workunit.client.0.smithi045.stdout:0/392: fdatasync d6/d48/d5e/d39/d58/d3c/d69/f4c 0 2024-09-18T12:52:12.427 INFO:tasks.workunit.client.1.smithi161.stdout:2/762: creat d0/d71/da9/d9f/dd0/f106 x:0 0 0 2024-09-18T12:52:12.430 INFO:tasks.workunit.client.1.smithi161.stdout:4/791: rename d5/d27/d44/d61/d6c/c7d to d5/d14/d67/d84/dae/db8/c11e 0 2024-09-18T12:52:12.432 INFO:tasks.workunit.client.0.smithi045.stdout:0/393: unlink d6/d48/d5e/d39/d58/f28 0 2024-09-18T12:52:12.434 INFO:tasks.workunit.client.0.smithi045.stdout:8/353: write d11/d20/f27 [728262,1882] 0 2024-09-18T12:52:12.435 INFO:tasks.workunit.client.1.smithi161.stdout:6/771: symlink d4/lfe 0 2024-09-18T12:52:12.436 INFO:tasks.workunit.client.1.smithi161.stdout:6/772: chown d4/d1a/d1c/d3e/d83/f8d 6645416 1 2024-09-18T12:52:12.436 INFO:tasks.workunit.client.0.smithi045.stdout:8/354: readlink d11/d14/l3b 0 2024-09-18T12:52:12.437 INFO:tasks.workunit.client.1.smithi161.stdout:6/773: write d4/d1a/d1c/d3e/d4d/faf [1321948,4390] 0 2024-09-18T12:52:12.438 INFO:tasks.workunit.client.0.smithi045.stdout:8/355: stat d11/d20/d60/c5e 0 2024-09-18T12:52:12.439 INFO:tasks.workunit.client.1.smithi161.stdout:3/693: creat d1/d2e/d14/d65/d76/d88/fef x:0 0 0 2024-09-18T12:52:12.439 INFO:tasks.workunit.client.0.smithi045.stdout:6/346: dwrite d9/f13 [0,4194304] 0 2024-09-18T12:52:12.441 INFO:tasks.workunit.client.0.smithi045.stdout:8/356: readlink d11/d20/d46/l68 0 2024-09-18T12:52:12.443 INFO:tasks.workunit.client.0.smithi045.stdout:0/394: dwrite d6/d7/f42 [4194304,4194304] 0 2024-09-18T12:52:12.446 INFO:tasks.workunit.client.0.smithi045.stdout:6/347: mkdir d9/d1a/d48/d7d 0 2024-09-18T12:52:12.448 INFO:tasks.workunit.client.1.smithi161.stdout:1/621: creat d1/d26/dad/fd1 x:0 0 0 2024-09-18T12:52:12.449 INFO:tasks.workunit.client.0.smithi045.stdout:8/357: rmdir d11/d14 39 2024-09-18T12:52:12.451 INFO:tasks.workunit.client.0.smithi045.stdout:0/395: chown d6/d35/l55 117452 1 2024-09-18T12:52:12.453 INFO:tasks.workunit.client.0.smithi045.stdout:0/396: fdatasync d6/d48/f5c 0 2024-09-18T12:52:12.453 INFO:tasks.workunit.client.1.smithi161.stdout:7/670: creat d3/d8/d79/fcc x:0 0 0 2024-09-18T12:52:12.454 INFO:tasks.workunit.client.0.smithi045.stdout:6/348: unlink d9/d1a/l71 0 2024-09-18T12:52:12.455 INFO:tasks.workunit.client.0.smithi045.stdout:9/322: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:52:12.456 INFO:tasks.workunit.client.0.smithi045.stdout:0/397: fsync d6/d48/d5e/d39/d58/d3c/f46 0 2024-09-18T12:52:12.456 INFO:tasks.workunit.client.1.smithi161.stdout:2/763: rmdir d0/d71/da9/d9f 39 2024-09-18T12:52:12.457 INFO:tasks.workunit.client.0.smithi045.stdout:9/323: readlink d0/d3/d6/d10/l12 0 2024-09-18T12:52:12.457 INFO:tasks.workunit.client.0.smithi045.stdout:0/398: chown d6/c18 160285 1 2024-09-18T12:52:12.457 INFO:tasks.workunit.client.0.smithi045.stdout:6/349: read d9/f23 [1301862,85327] 0 2024-09-18T12:52:12.459 INFO:tasks.workunit.client.0.smithi045.stdout:0/399: write d6/d35/f5f [2185973,102457] 0 2024-09-18T12:52:12.460 INFO:tasks.workunit.client.0.smithi045.stdout:0/400: fsync d6/d7/d32/f33 0 2024-09-18T12:52:12.460 INFO:tasks.workunit.client.1.smithi161.stdout:0/733: truncate df/f26 3983073 0 2024-09-18T12:52:12.461 INFO:tasks.workunit.client.0.smithi045.stdout:0/401: stat d6/d48/d5e/d39/d58/d3c/d69 0 2024-09-18T12:52:12.462 INFO:tasks.workunit.client.1.smithi161.stdout:6/774: mknod d4/d1a/d1c/d3e/d4d/cff 0 2024-09-18T12:52:12.462 INFO:tasks.workunit.client.0.smithi045.stdout:9/324: dread d0/d3/d6/d10/d26/d2e/d4e/f5a [0,4194304] 0 2024-09-18T12:52:12.463 INFO:tasks.workunit.client.1.smithi161.stdout:6/775: fsync d4/d1a/d1c/d3e/d83/da2/fd5 0 2024-09-18T12:52:12.464 INFO:tasks.workunit.client.0.smithi045.stdout:9/325: fdatasync d0/d3/d6/d10/d26/f62 0 2024-09-18T12:52:12.464 INFO:tasks.workunit.client.1.smithi161.stdout:6/776: stat d4/d39/d47/d51/f70 0 2024-09-18T12:52:12.465 INFO:tasks.workunit.client.0.smithi045.stdout:9/326: write d0/d3/d6/d10/f29 [3286824,23347] 0 2024-09-18T12:52:12.466 INFO:tasks.workunit.client.0.smithi045.stdout:9/327: write d0/d3/f1f [358137,34118] 0 2024-09-18T12:52:12.466 INFO:tasks.workunit.client.1.smithi161.stdout:3/694: symlink d1/d2e/d14/d65/d76/d8c/d9d/lf0 0 2024-09-18T12:52:12.472 INFO:tasks.workunit.client.0.smithi045.stdout:6/350: mkdir d9/d30/d7e 0 2024-09-18T12:52:12.474 INFO:tasks.workunit.client.1.smithi161.stdout:1/622: mkdir d1/da/d1f/d6b/dd2 0 2024-09-18T12:52:12.476 INFO:tasks.workunit.client.1.smithi161.stdout:1/623: write d1/d26/d3a/d52/fbb [575197,107165] 0 2024-09-18T12:52:12.479 INFO:tasks.workunit.client.0.smithi045.stdout:0/402: readlink d6/d48/d5e/d39/d58/l4e 0 2024-09-18T12:52:12.481 INFO:tasks.workunit.client.1.smithi161.stdout:8/747: link d0/d3/d10/d21/d4a/d52/d66/d5b/fae d0/d3/d10/d21/d4a/d52/d66/d5b/de0/dee/ffd 0 2024-09-18T12:52:12.482 INFO:tasks.workunit.client.1.smithi161.stdout:9/651: write d0/db/f26 [1646143,20986] 0 2024-09-18T12:52:12.483 INFO:tasks.workunit.client.0.smithi045.stdout:0/403: dread d6/d48/d5e/d39/d58/d3c/f46 [0,4194304] 0 2024-09-18T12:52:12.486 INFO:tasks.workunit.client.1.smithi161.stdout:0/734: creat df/de2/dc5/f108 x:0 0 0 2024-09-18T12:52:12.487 INFO:tasks.workunit.client.0.smithi045.stdout:9/328: unlink d0/d3/d6/l28 0 2024-09-18T12:52:12.488 INFO:tasks.workunit.client.1.smithi161.stdout:6/777: rmdir d4/d1a/d1c/d3e/d83/d9e/db1/d45/ddf 39 2024-09-18T12:52:12.489 INFO:tasks.workunit.client.1.smithi161.stdout:6/778: fsync d4/fa9 0 2024-09-18T12:52:12.490 INFO:tasks.workunit.client.0.smithi045.stdout:8/358: rename d11/d20/f64 to d11/d20/f71 0 2024-09-18T12:52:12.494 INFO:tasks.workunit.client.0.smithi045.stdout:9/329: dwrite d0/f2 [4194304,4194304] 0 2024-09-18T12:52:12.497 INFO:tasks.workunit.client.0.smithi045.stdout:9/330: stat d0/d3/d6/d10/d26/d2e/l58 0 2024-09-18T12:52:12.498 INFO:tasks.workunit.client.0.smithi045.stdout:9/331: readlink d0/d3/l1c 0 2024-09-18T12:52:12.498 INFO:tasks.workunit.client.1.smithi161.stdout:4/792: sync 2024-09-18T12:52:12.499 INFO:tasks.workunit.client.0.smithi045.stdout:0/404: mknod d6/d48/d5e/d39/d58/c6e 0 2024-09-18T12:52:12.500 INFO:tasks.workunit.client.1.smithi161.stdout:4/793: chown d5/d14/d67/d84/d113 836 1 2024-09-18T12:52:12.502 INFO:tasks.workunit.client.1.smithi161.stdout:5/685: truncate d3/d9/d4b/f51 2857920 0 2024-09-18T12:52:12.503 INFO:tasks.workunit.client.1.smithi161.stdout:5/686: chown d3/d3b/d54/dbd 6 1 2024-09-18T12:52:12.507 INFO:tasks.workunit.client.0.smithi045.stdout:9/332: dwrite d0/d3/d6/d10/d26/f69 [0,4194304] 0 2024-09-18T12:52:12.509 INFO:tasks.workunit.client.0.smithi045.stdout:8/359: write d11/d14/f52 [718007,42075] 0 2024-09-18T12:52:12.511 INFO:tasks.workunit.client.1.smithi161.stdout:5/687: dread d3/d3b/d54/fc4 [0,4194304] 0 2024-09-18T12:52:12.511 INFO:tasks.workunit.client.0.smithi045.stdout:0/405: rename d6/d48/f4d to d6/d48/f6f 0 2024-09-18T12:52:12.521 INFO:tasks.workunit.client.0.smithi045.stdout:9/333: symlink d0/d3/d6/d10/d26/l6b 0 2024-09-18T12:52:12.525 INFO:tasks.workunit.client.0.smithi045.stdout:0/406: truncate d6/d48/d5e/f30 768737 0 2024-09-18T12:52:12.526 INFO:tasks.workunit.client.0.smithi045.stdout:6/351: write d9/ff [469028,67869] 0 2024-09-18T12:52:12.527 INFO:tasks.workunit.client.0.smithi045.stdout:9/334: creat d0/d3/d6/f6c x:0 0 0 2024-09-18T12:52:12.536 INFO:tasks.workunit.client.0.smithi045.stdout:0/407: rename d6/c12 to d6/d48/d5e/d39/d58/d3c/d69/c70 0 2024-09-18T12:52:12.538 INFO:tasks.workunit.client.0.smithi045.stdout:9/335: dread d0/d3/d6/d10/f29 [0,4194304] 0 2024-09-18T12:52:12.539 INFO:tasks.workunit.client.0.smithi045.stdout:9/336: readlink d0/d3/d6/d10/d26/d2e/l47 0 2024-09-18T12:52:12.544 INFO:tasks.workunit.client.0.smithi045.stdout:6/352: rename d9/d30/f36 to d9/d1a/d2d/f7f 0 2024-09-18T12:52:12.545 INFO:tasks.workunit.client.0.smithi045.stdout:9/337: dwrite d0/d3/f2b [0,4194304] 0 2024-09-18T12:52:12.546 INFO:tasks.workunit.client.0.smithi045.stdout:9/338: chown d0/d3/d6/d10/d26/d2e/l47 65 1 2024-09-18T12:52:12.547 INFO:tasks.workunit.client.0.smithi045.stdout:8/360: truncate d11/d14/d53/f54 4180400 0 2024-09-18T12:52:12.551 INFO:tasks.workunit.client.0.smithi045.stdout:9/339: symlink d0/d3/d6/d52/l6d 0 2024-09-18T12:52:12.551 INFO:tasks.workunit.client.0.smithi045.stdout:9/340: fdatasync d0/f59 0 2024-09-18T12:52:12.554 INFO:tasks.workunit.client.0.smithi045.stdout:8/361: chown d11/c31 31 1 2024-09-18T12:52:12.556 INFO:tasks.workunit.client.0.smithi045.stdout:1/370: sync 2024-09-18T12:52:12.556 INFO:tasks.workunit.client.0.smithi045.stdout:3/346: sync 2024-09-18T12:52:12.560 INFO:tasks.workunit.client.0.smithi045.stdout:9/341: dwrite d0/d3/d6/d10/f2a [0,4194304] 0 2024-09-18T12:52:12.563 INFO:tasks.workunit.client.0.smithi045.stdout:6/353: creat d9/d1a/f80 x:0 0 0 2024-09-18T12:52:12.564 INFO:tasks.workunit.client.0.smithi045.stdout:0/408: write d6/d48/d5e/d39/f6d [1764889,51557] 0 2024-09-18T12:52:12.566 INFO:tasks.workunit.client.0.smithi045.stdout:3/347: truncate d0/d1e/f2a 1006832 0 2024-09-18T12:52:12.568 INFO:tasks.workunit.client.0.smithi045.stdout:8/362: mkdir d11/d14/d72 0 2024-09-18T12:52:12.572 INFO:tasks.workunit.client.1.smithi161.stdout:7/671: rmdir d3/d8/d15/da7/d44/db7 39 2024-09-18T12:52:12.574 INFO:tasks.workunit.client.0.smithi045.stdout:6/354: mkdir d9/d1a/d48/d75/d81 0 2024-09-18T12:52:12.576 INFO:tasks.workunit.client.0.smithi045.stdout:0/409: dwrite d6/d7/f6c [0,4194304] 0 2024-09-18T12:52:12.576 INFO:tasks.workunit.client.1.smithi161.stdout:9/652: write d0/d16/d25/d46/d53/f56 [182880,21244] 0 2024-09-18T12:52:12.576 INFO:tasks.workunit.client.0.smithi045.stdout:9/342: link d0/la d0/d3/d6/d10/l6e 0 2024-09-18T12:52:12.579 INFO:tasks.workunit.client.1.smithi161.stdout:2/764: symlink d0/d5/d43/d23/ded/l107 0 2024-09-18T12:52:12.580 INFO:tasks.workunit.client.1.smithi161.stdout:7/672: dwrite d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/d9b/f9c [0,4194304] 0 2024-09-18T12:52:12.581 INFO:tasks.workunit.client.1.smithi161.stdout:7/673: write d3/d36/f65 [3275964,5574] 0 2024-09-18T12:52:12.583 INFO:tasks.workunit.client.1.smithi161.stdout:0/735: creat df/d30/d71/d96/dd3/d51/dc9/f109 x:0 0 0 2024-09-18T12:52:12.584 INFO:tasks.workunit.client.0.smithi045.stdout:3/348: mknod d0/d1e/d2c/c74 0 2024-09-18T12:52:12.584 INFO:tasks.workunit.client.0.smithi045.stdout:8/363: creat d11/d14/d72/f73 x:0 0 0 2024-09-18T12:52:12.586 INFO:tasks.workunit.client.0.smithi045.stdout:1/371: dread d0/f7 [0,4194304] 0 2024-09-18T12:52:12.586 INFO:tasks.workunit.client.0.smithi045.stdout:8/364: stat d11/d14/d53/f3e 0 2024-09-18T12:52:12.587 INFO:tasks.workunit.client.1.smithi161.stdout:4/794: creat d5/d14/d67/dc7/d60/d95/dda/f11f x:0 0 0 2024-09-18T12:52:12.589 INFO:tasks.workunit.client.1.smithi161.stdout:4/795: fsync d5/d14/d67/d84/dae/db8/fd6 0 2024-09-18T12:52:12.589 INFO:tasks.workunit.client.0.smithi045.stdout:1/372: write d0/d2d/f45 [2247812,74350] 0 2024-09-18T12:52:12.590 INFO:tasks.workunit.client.1.smithi161.stdout:5/688: mknod d3/d14/d8d/cda 0 2024-09-18T12:52:12.590 INFO:tasks.workunit.client.0.smithi045.stdout:9/343: readlink d0/d3/d6/l4b 0 2024-09-18T12:52:12.593 INFO:tasks.workunit.client.0.smithi045.stdout:0/410: unlink d6/d48/d5e/l2a 0 2024-09-18T12:52:12.597 INFO:tasks.workunit.client.0.smithi045.stdout:3/349: rmdir d0/d1e/d2c/d5c 39 2024-09-18T12:52:12.599 INFO:tasks.workunit.client.0.smithi045.stdout:1/373: dwrite d0/f7 [0,4194304] 0 2024-09-18T12:52:12.599 INFO:tasks.workunit.client.0.smithi045.stdout:0/411: write d6/d48/d5e/d39/d58/d3c/d69/f4b [936235,126422] 0 2024-09-18T12:52:12.603 INFO:tasks.workunit.client.1.smithi161.stdout:7/674: dread d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f7f [0,4194304] 0 2024-09-18T12:52:12.605 INFO:tasks.workunit.client.0.smithi045.stdout:0/412: chown d6/d48/d5e/d39/d58/d3b 8433036 1 2024-09-18T12:52:12.607 INFO:tasks.workunit.client.0.smithi045.stdout:9/344: dwrite d0/d3/d6/d10/d26/d2e/d4e/f68 [0,4194304] 0 2024-09-18T12:52:12.610 INFO:tasks.workunit.client.0.smithi045.stdout:8/365: dread d11/d14/d53/d41/d57/f4a [0,4194304] 0 2024-09-18T12:52:12.611 INFO:tasks.workunit.client.1.smithi161.stdout:2/765: symlink d0/d4/dab/l108 0 2024-09-18T12:52:12.612 INFO:tasks.workunit.client.0.smithi045.stdout:3/350: write d0/d22/f2e [1687062,39847] 0 2024-09-18T12:52:12.612 INFO:tasks.workunit.client.0.smithi045.stdout:8/366: chown d11/d20/d60/c6f 13436437 1 2024-09-18T12:52:12.616 INFO:tasks.workunit.client.1.smithi161.stdout:2/766: dread d0/d5/d43/d35/d80/fca [0,4194304] 0 2024-09-18T12:52:12.621 INFO:tasks.workunit.client.1.smithi161.stdout:6/779: symlink d4/d61/l100 0 2024-09-18T12:52:12.622 INFO:tasks.workunit.client.1.smithi161.stdout:2/767: dwrite d0/f75 [0,4194304] 0 2024-09-18T12:52:12.623 INFO:tasks.workunit.client.1.smithi161.stdout:7/675: dread d3/f6d [0,4194304] 0 2024-09-18T12:52:12.623 INFO:tasks.workunit.client.1.smithi161.stdout:0/736: mkdir df/d30/d71/d96/dd3/d78/d10a 0 2024-09-18T12:52:12.625 INFO:tasks.workunit.client.1.smithi161.stdout:3/695: rmdir d1/d2e/d14/d65/d76/d8c/de1 0 2024-09-18T12:52:12.625 INFO:tasks.workunit.client.1.smithi161.stdout:0/737: fdatasync df/d30/d71/d96/dd3/d51/f66 0 2024-09-18T12:52:12.627 INFO:tasks.workunit.client.0.smithi045.stdout:6/355: write d9/f23 [431409,24344] 0 2024-09-18T12:52:12.629 INFO:tasks.workunit.client.0.smithi045.stdout:6/356: chown d9/d1a/d2d/d38/f40 57 1 2024-09-18T12:52:12.629 INFO:tasks.workunit.client.1.smithi161.stdout:4/796: rmdir d5/d14/d67/dc7/d47/dbc 39 2024-09-18T12:52:12.631 INFO:tasks.workunit.client.0.smithi045.stdout:3/351: mkdir d0/d1e/d2c/d3f/d44/d75 0 2024-09-18T12:52:12.632 INFO:tasks.workunit.client.1.smithi161.stdout:2/768: dread d0/d5/d43/f37 [0,4194304] 0 2024-09-18T12:52:12.634 INFO:tasks.workunit.client.1.smithi161.stdout:5/689: mkdir d3/d14/d8d/ddb 0 2024-09-18T12:52:12.635 INFO:tasks.workunit.client.0.smithi045.stdout:1/374: dread d0/d2d/f53 [0,4194304] 0 2024-09-18T12:52:12.636 INFO:tasks.workunit.client.0.smithi045.stdout:3/352: dread d0/d1e/d2c/f42 [0,4194304] 0 2024-09-18T12:52:12.637 INFO:tasks.workunit.client.0.smithi045.stdout:0/413: mknod d6/d48/d5e/d39/d58/d3b/d65/c71 0 2024-09-18T12:52:12.638 INFO:tasks.workunit.client.0.smithi045.stdout:5/438: sync 2024-09-18T12:52:12.638 INFO:tasks.workunit.client.0.smithi045.stdout:4/394: sync 2024-09-18T12:52:12.638 INFO:tasks.workunit.client.0.smithi045.stdout:7/271: sync 2024-09-18T12:52:12.638 INFO:tasks.workunit.client.0.smithi045.stdout:2/374: sync 2024-09-18T12:52:12.639 INFO:tasks.workunit.client.1.smithi161.stdout:9/653: mknod d0/d16/d25/d28/cd6 0 2024-09-18T12:52:12.639 INFO:tasks.workunit.client.1.smithi161.stdout:9/654: stat d0/d20/d49/d65/cd2 0 2024-09-18T12:52:12.641 INFO:tasks.workunit.client.0.smithi045.stdout:4/395: dread - db/de/d1e/d3e/d47/d59/d13/f7c zero size 2024-09-18T12:52:12.644 INFO:tasks.workunit.client.0.smithi045.stdout:6/357: creat d9/d1a/d2d/d38/f82 x:0 0 0 2024-09-18T12:52:12.645 INFO:tasks.workunit.client.0.smithi045.stdout:6/358: write d9/d1a/d2d/d38/d5b/f61 [3762709,32849] 0 2024-09-18T12:52:12.649 INFO:tasks.workunit.client.0.smithi045.stdout:3/353: fsync d0/f1f 0 2024-09-18T12:52:12.652 INFO:tasks.workunit.client.1.smithi161.stdout:0/738: rename df/f24 to df/d30/d71/dfe/f10b 0 2024-09-18T12:52:12.652 INFO:tasks.workunit.client.0.smithi045.stdout:6/359: dwrite d9/d1a/f80 [0,4194304] 0 2024-09-18T12:52:12.653 INFO:tasks.workunit.client.1.smithi161.stdout:0/739: chown df/d30/d71/d96/dd3/d78/d10a 646 1 2024-09-18T12:52:12.655 INFO:tasks.workunit.client.1.smithi161.stdout:1/624: getdents d1/daa/db2/dc0 0 2024-09-18T12:52:12.655 INFO:tasks.workunit.client.1.smithi161.stdout:1/625: dread - d1/fba zero size 2024-09-18T12:52:12.656 INFO:tasks.workunit.client.1.smithi161.stdout:1/626: truncate d1/fc 8915597 0 2024-09-18T12:52:12.657 INFO:tasks.workunit.client.0.smithi045.stdout:7/272: dread - d13/f32 zero size 2024-09-18T12:52:12.660 INFO:tasks.workunit.client.0.smithi045.stdout:3/354: dwrite d0/d29/d5f/f6b [0,4194304] 0 2024-09-18T12:52:12.660 INFO:tasks.workunit.client.0.smithi045.stdout:1/375: dread d0/d2d/d2b/f52 [0,4194304] 0 2024-09-18T12:52:12.663 INFO:tasks.workunit.client.1.smithi161.stdout:1/627: dwrite d1/d48/f99 [4194304,4194304] 0 2024-09-18T12:52:12.666 INFO:tasks.workunit.client.1.smithi161.stdout:2/769: unlink d0/d5/d43/d35/d98/ddf/d8b/lc5 0 2024-09-18T12:52:12.667 INFO:tasks.workunit.client.1.smithi161.stdout:2/770: write d0/d1/d4c/d67/fe7 [627308,7564] 0 2024-09-18T12:52:12.668 INFO:tasks.workunit.client.0.smithi045.stdout:5/439: rename d6/d2a to d6/db/d19/d92 0 2024-09-18T12:52:12.669 INFO:tasks.workunit.client.1.smithi161.stdout:2/771: stat d0/d5/d43/d35/d98/ddf/f59 0 2024-09-18T12:52:12.669 INFO:tasks.workunit.client.0.smithi045.stdout:8/367: creat d11/d14/d53/d41/f74 x:0 0 0 2024-09-18T12:52:12.669 INFO:tasks.workunit.client.1.smithi161.stdout:5/690: mkdir d3/d44/ddc 0 2024-09-18T12:52:12.670 INFO:tasks.workunit.client.0.smithi045.stdout:7/273: dwrite fc [4194304,4194304] 0 2024-09-18T12:52:12.672 INFO:tasks.workunit.client.0.smithi045.stdout:9/345: truncate d0/d3/d6/d10/f29 2125825 0 2024-09-18T12:52:12.673 INFO:tasks.workunit.client.1.smithi161.stdout:8/748: getdents d0/d3/d10/d21/d4a/d52/d66/d5b/d6e 0 2024-09-18T12:52:12.673 INFO:tasks.workunit.client.0.smithi045.stdout:4/396: symlink db/d1b/l85 0 2024-09-18T12:52:12.682 INFO:tasks.workunit.client.1.smithi161.stdout:6/780: truncate d4/d61/d69/f9a 2474146 0 2024-09-18T12:52:12.683 INFO:tasks.workunit.client.1.smithi161.stdout:3/696: write d1/d2e/d68/d92/ded/f22 [2279679,116333] 0 2024-09-18T12:52:12.687 INFO:tasks.workunit.client.0.smithi045.stdout:0/414: dwrite d6/d48/d5e/d39/d58/f25 [0,4194304] 0 2024-09-18T12:52:12.688 INFO:tasks.workunit.client.1.smithi161.stdout:4/797: dwrite d5/d14/d67/dc7/d47/fa2 [0,4194304] 0 2024-09-18T12:52:12.690 INFO:tasks.workunit.client.0.smithi045.stdout:0/415: chown d6/d48/d5e/d39/d58/d3c/d69/f4b 10970769 1 2024-09-18T12:52:12.695 INFO:tasks.workunit.client.0.smithi045.stdout:2/375: symlink d5/d3a/d6b/l87 0 2024-09-18T12:52:12.696 INFO:tasks.workunit.client.0.smithi045.stdout:1/376: readlink d0/l19 0 2024-09-18T12:52:12.697 INFO:tasks.workunit.client.1.smithi161.stdout:9/655: dread d0/d20/f6c [0,4194304] 0 2024-09-18T12:52:12.698 INFO:tasks.workunit.client.1.smithi161.stdout:1/628: rename d1/da/d1f/d45/d73/f9a to d1/da/d31/fd3 0 2024-09-18T12:52:12.700 INFO:tasks.workunit.client.0.smithi045.stdout:3/355: rename d0/d1e/d2c/d3a/f47 to d0/d1e/d2c/d3f/d44/f76 0 2024-09-18T12:52:12.704 INFO:tasks.workunit.client.1.smithi161.stdout:5/691: mknod d3/d9/d4b/d8e/d24/db8/da4/cdd 0 2024-09-18T12:52:12.706 INFO:tasks.workunit.client.0.smithi045.stdout:7/274: fdatasync d13/d1a/f27 0 2024-09-18T12:52:12.710 INFO:tasks.workunit.client.0.smithi045.stdout:9/346: mkdir d0/d3/d6/d10/d26/d2e/d6f 0 2024-09-18T12:52:12.714 INFO:tasks.workunit.client.0.smithi045.stdout:9/347: dread d0/d3/f2b [0,4194304] 0 2024-09-18T12:52:12.715 INFO:tasks.workunit.client.0.smithi045.stdout:2/376: creat d5/d2c/f88 x:0 0 0 2024-09-18T12:52:12.721 INFO:tasks.workunit.client.1.smithi161.stdout:2/772: dwrite d0/d1/d4c/fc1 [0,4194304] 0 2024-09-18T12:52:12.721 INFO:tasks.workunit.client.1.smithi161.stdout:9/656: unlink d0/d20/f6b 0 2024-09-18T12:52:12.722 INFO:tasks.workunit.client.0.smithi045.stdout:6/360: rename d9/d1a/d2d/d32/c43 to d9/d1a/d2d/d38/c83 0 2024-09-18T12:52:12.723 INFO:tasks.workunit.client.0.smithi045.stdout:6/361: chown d9/d74 0 1 2024-09-18T12:52:12.724 INFO:tasks.workunit.client.1.smithi161.stdout:3/697: rename d1/d2e/d14/d78/d83/ca4 to d1/d2e/d14/d2c/cf1 0 2024-09-18T12:52:12.725 INFO:tasks.workunit.client.0.smithi045.stdout:3/356: fsync d0/d22/f28 0 2024-09-18T12:52:12.730 INFO:tasks.workunit.client.1.smithi161.stdout:8/749: mknod d0/d3/d10/d21/d4a/d52/cfe 0 2024-09-18T12:52:12.731 INFO:tasks.workunit.client.1.smithi161.stdout:0/740: dwrite df/d30/d71/d96/dd3/f49 [0,4194304] 0 2024-09-18T12:52:12.732 INFO:tasks.workunit.client.1.smithi161.stdout:6/781: mkdir d4/d39/d26/d101 0 2024-09-18T12:52:12.733 INFO:tasks.workunit.client.0.smithi045.stdout:4/397: symlink db/d1b/d6f/l86 0 2024-09-18T12:52:12.733 INFO:tasks.workunit.client.1.smithi161.stdout:7/676: getdents d3/d8/d15/da7/d4a/d64 0 2024-09-18T12:52:12.734 INFO:tasks.workunit.client.0.smithi045.stdout:7/275: fsync d13/d44/d37/f4d 0 2024-09-18T12:52:12.736 INFO:tasks.workunit.client.1.smithi161.stdout:4/798: mkdir d5/d14/d67/d84/d120 0 2024-09-18T12:52:12.736 INFO:tasks.workunit.client.0.smithi045.stdout:1/377: dwrite d0/f3a [0,4194304] 0 2024-09-18T12:52:12.739 INFO:tasks.workunit.client.0.smithi045.stdout:9/348: symlink d0/d3/d6/l70 0 2024-09-18T12:52:12.740 INFO:tasks.workunit.client.1.smithi161.stdout:6/782: dwrite d4/fa8 [0,4194304] 0 2024-09-18T12:52:12.742 INFO:tasks.workunit.client.0.smithi045.stdout:8/368: write d11/f16 [2633561,10700] 0 2024-09-18T12:52:12.743 INFO:tasks.workunit.client.1.smithi161.stdout:3/698: creat d1/d2e/d68/d69/ff2 x:0 0 0 2024-09-18T12:52:12.745 INFO:tasks.workunit.client.0.smithi045.stdout:6/362: creat d9/d1a/d1d/f84 x:0 0 0 2024-09-18T12:52:12.746 INFO:tasks.workunit.client.0.smithi045.stdout:3/357: rmdir d0/d29 39 2024-09-18T12:52:12.747 INFO:tasks.workunit.client.1.smithi161.stdout:8/750: mknod d0/d3/d10/d21/d4a/cff 0 2024-09-18T12:52:12.748 INFO:tasks.workunit.client.1.smithi161.stdout:8/751: chown d0/d3/d10 28451 1 2024-09-18T12:52:12.748 INFO:tasks.workunit.client.0.smithi045.stdout:5/440: link d6/db/d19/d92/f79 d6/d28/d2b/f93 0 2024-09-18T12:52:12.749 INFO:tasks.workunit.client.0.smithi045.stdout:5/441: stat d6/db/d5a/d78/f45 0 2024-09-18T12:52:12.749 INFO:tasks.workunit.client.1.smithi161.stdout:5/692: dwrite d3/d14/d8d/f95 [0,4194304] 0 2024-09-18T12:52:12.749 INFO:tasks.workunit.client.0.smithi045.stdout:5/442: fdatasync d6/db/f43 0 2024-09-18T12:52:12.753 INFO:tasks.workunit.client.0.smithi045.stdout:7/276: chown d13/d31/d29 32737 1 2024-09-18T12:52:12.755 INFO:tasks.workunit.client.0.smithi045.stdout:4/398: creat db/de/d1e/d3e/d47/d59/f87 x:0 0 0 2024-09-18T12:52:12.757 INFO:tasks.workunit.client.1.smithi161.stdout:0/741: mknod df/d30/d71/d96/dd3/c10c 0 2024-09-18T12:52:12.759 INFO:tasks.workunit.client.1.smithi161.stdout:7/677: dwrite d3/fa3 [0,4194304] 0 2024-09-18T12:52:12.761 INFO:tasks.workunit.client.1.smithi161.stdout:8/752: dwrite d0/d3/d10/d21/d4a/d52/d82/d96/dc1/feb [0,4194304] 0 2024-09-18T12:52:12.762 INFO:tasks.workunit.client.0.smithi045.stdout:9/349: creat d0/d3/d6/f71 x:0 0 0 2024-09-18T12:52:12.762 INFO:tasks.workunit.client.0.smithi045.stdout:7/277: dwrite d13/d44/f51 [0,4194304] 0 2024-09-18T12:52:12.768 INFO:tasks.workunit.client.1.smithi161.stdout:2/773: dread d0/d1/deb/d3d/f5d [0,4194304] 0 2024-09-18T12:52:12.774 INFO:tasks.workunit.client.0.smithi045.stdout:3/358: creat d0/d22/f77 x:0 0 0 2024-09-18T12:52:12.774 INFO:tasks.workunit.client.0.smithi045.stdout:7/278: dwrite d13/d31/f26 [0,4194304] 0 2024-09-18T12:52:12.776 INFO:tasks.workunit.client.1.smithi161.stdout:5/693: mkdir d3/d8/dd9/dde 0 2024-09-18T12:52:12.779 INFO:tasks.workunit.client.0.smithi045.stdout:0/416: dwrite d6/d48/d5e/f30 [0,4194304] 0 2024-09-18T12:52:12.783 INFO:tasks.workunit.client.0.smithi045.stdout:5/443: mknod d6/d3e/c94 0 2024-09-18T12:52:12.784 INFO:tasks.workunit.client.0.smithi045.stdout:5/444: chown d6/db/d5a/d78 420125 1 2024-09-18T12:52:12.785 INFO:tasks.workunit.client.0.smithi045.stdout:5/445: dread - d6/d28/f88 zero size 2024-09-18T12:52:12.786 INFO:tasks.workunit.client.0.smithi045.stdout:5/446: fdatasync d6/db/f50 0 2024-09-18T12:52:12.787 INFO:tasks.workunit.client.1.smithi161.stdout:8/753: rmdir d0/d3/d10/d21/d4a/d52/d82/d96/dba 39 2024-09-18T12:52:12.790 INFO:tasks.workunit.client.0.smithi045.stdout:5/447: readlink d6/db/d19/d92/l57 0 2024-09-18T12:52:12.790 INFO:tasks.workunit.client.0.smithi045.stdout:1/378: creat d0/d12/d32/d67/d6d/f72 x:0 0 0 2024-09-18T12:52:12.790 INFO:tasks.workunit.client.1.smithi161.stdout:3/699: creat d1/d2e/d14/d78/ff3 x:0 0 0 2024-09-18T12:52:12.791 INFO:tasks.workunit.client.1.smithi161.stdout:8/754: read d0/d3/d10/d21/d4a/d52/fa7 [428106,18408] 0 2024-09-18T12:52:12.792 INFO:tasks.workunit.client.1.smithi161.stdout:2/774: mkdir d0/d5/d43/d35/dee/d109 0 2024-09-18T12:52:12.793 INFO:tasks.workunit.client.0.smithi045.stdout:1/379: write d0/fe [437393,107880] 0 2024-09-18T12:52:12.794 INFO:tasks.workunit.client.0.smithi045.stdout:0/417: dwrite d6/d7/f29 [0,4194304] 0 2024-09-18T12:52:12.797 INFO:tasks.workunit.client.0.smithi045.stdout:9/350: mknod d0/d3/d6/d52/c72 0 2024-09-18T12:52:12.800 INFO:tasks.workunit.client.0.smithi045.stdout:2/377: link d5/d2c/d4d/f28 d5/d2c/d4d/d16/d61/f89 0 2024-09-18T12:52:12.801 INFO:tasks.workunit.client.1.smithi161.stdout:0/742: write df/de2/dc5/d86/f79 [1174240,104060] 0 2024-09-18T12:52:12.802 INFO:tasks.workunit.client.0.smithi045.stdout:8/369: mkdir d11/d14/d53/d41/d75 0 2024-09-18T12:52:12.803 INFO:tasks.workunit.client.1.smithi161.stdout:0/743: write df/d30/d4d/f7b [3070409,69674] 0 2024-09-18T12:52:12.803 INFO:tasks.workunit.client.0.smithi045.stdout:2/378: truncate d5/d2c/d4d/f1b 4450358 0 2024-09-18T12:52:12.804 INFO:tasks.workunit.client.1.smithi161.stdout:7/678: write d3/d8/d15/da7/d4a/d59/f69 [3901612,39148] 0 2024-09-18T12:52:12.806 INFO:tasks.workunit.client.1.smithi161.stdout:6/783: dread d4/d39/d3a/f62 [0,4194304] 0 2024-09-18T12:52:12.807 INFO:tasks.workunit.client.0.smithi045.stdout:3/359: readlink d0/d1e/l2d 0 2024-09-18T12:52:12.807 INFO:tasks.workunit.client.1.smithi161.stdout:7/679: fsync d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/fbb 0 2024-09-18T12:52:12.807 INFO:tasks.workunit.client.1.smithi161.stdout:2/775: mkdir d0/d1/d4c/d67/db9/d10a 0 2024-09-18T12:52:12.809 INFO:tasks.workunit.client.1.smithi161.stdout:5/694: symlink d3/d9/d4b/d8e/d24/ldf 0 2024-09-18T12:52:12.814 INFO:tasks.workunit.client.0.smithi045.stdout:4/399: symlink db/d2c/d35/d40/d6d/l88 0 2024-09-18T12:52:12.814 INFO:tasks.workunit.client.1.smithi161.stdout:3/700: fdatasync d1/d2e/d24/d84/fa8 0 2024-09-18T12:52:12.815 INFO:tasks.workunit.client.0.smithi045.stdout:3/360: dwrite d0/d1e/d2c/d3a/f3c [4194304,4194304] 0 2024-09-18T12:52:12.817 INFO:tasks.workunit.client.1.smithi161.stdout:8/755: symlink d0/d3/d10/d21/l100 0 2024-09-18T12:52:12.817 INFO:tasks.workunit.client.0.smithi045.stdout:3/361: write d0/d22/f3d [90909,87386] 0 2024-09-18T12:52:12.818 INFO:tasks.workunit.client.0.smithi045.stdout:9/351: dread d0/d3/d6/d10/d2c/f30 [0,4194304] 0 2024-09-18T12:52:12.819 INFO:tasks.workunit.client.1.smithi161.stdout:8/756: dread - d0/d3/d10/d21/d4a/d52/d82/d96/d98/fbe zero size 2024-09-18T12:52:12.819 INFO:tasks.workunit.client.0.smithi045.stdout:4/400: chown db/de/c22 43911736 1 2024-09-18T12:52:12.820 INFO:tasks.workunit.client.0.smithi045.stdout:5/448: rename d6/db/d5a/d78/d66/l82 to d6/db/d19/d92/d61/l95 0 2024-09-18T12:52:12.823 INFO:tasks.workunit.client.0.smithi045.stdout:0/418: creat d6/d35/f72 x:0 0 0 2024-09-18T12:52:12.829 INFO:tasks.workunit.client.0.smithi045.stdout:6/363: truncate d9/f13 3823571 0 2024-09-18T12:52:12.836 INFO:tasks.workunit.client.0.smithi045.stdout:3/362: chown d0/c13 6443230 1 2024-09-18T12:52:12.836 INFO:tasks.workunit.client.0.smithi045.stdout:3/363: stat d0/d1e 0 2024-09-18T12:52:12.838 INFO:tasks.workunit.client.0.smithi045.stdout:5/449: symlink d6/db/l96 0 2024-09-18T12:52:12.838 INFO:tasks.workunit.client.0.smithi045.stdout:3/364: write d0/d22/f72 [563659,44632] 0 2024-09-18T12:52:12.839 INFO:tasks.workunit.client.0.smithi045.stdout:0/419: mkdir d6/d48/d5e/d39/d58/d3c/d73 0 2024-09-18T12:52:12.843 INFO:tasks.workunit.client.0.smithi045.stdout:8/370: mkdir d11/d76 0 2024-09-18T12:52:12.846 INFO:tasks.workunit.client.0.smithi045.stdout:9/352: symlink d0/d3/d6/d10/d26/d2e/d6f/l73 0 2024-09-18T12:52:12.846 INFO:tasks.workunit.client.0.smithi045.stdout:7/279: creat d13/d31/d29/f60 x:0 0 0 2024-09-18T12:52:12.846 INFO:tasks.workunit.client.0.smithi045.stdout:5/450: dwrite d6/d28/d2b/d51/d6c/f8d [0,4194304] 0 2024-09-18T12:52:12.849 INFO:tasks.workunit.client.0.smithi045.stdout:0/420: mknod d6/d35/c74 0 2024-09-18T12:52:12.850 INFO:tasks.workunit.client.0.smithi045.stdout:0/421: read f4 [3630199,115618] 0 2024-09-18T12:52:12.850 INFO:tasks.workunit.client.0.smithi045.stdout:1/380: link d0/d12/l55 d0/d2d/d2b/d30/d40/l73 0 2024-09-18T12:52:12.853 INFO:tasks.workunit.client.0.smithi045.stdout:2/379: link d5/d46/f70 d5/d2c/d4d/f8a 0 2024-09-18T12:52:12.854 INFO:tasks.workunit.client.1.smithi161.stdout:5/695: readlink d3/d8/lb3 0 2024-09-18T12:52:12.854 INFO:tasks.workunit.client.1.smithi161.stdout:3/701: symlink d1/d2e/d68/d69/d7d/lf4 0 2024-09-18T12:52:12.856 INFO:tasks.workunit.client.0.smithi045.stdout:5/451: mkdir d6/d28/d2b/d51/d97 0 2024-09-18T12:52:12.858 INFO:tasks.workunit.client.1.smithi161.stdout:8/757: mkdir d0/d3/d10/d21/d4a/d52/d101 0 2024-09-18T12:52:12.859 INFO:tasks.workunit.client.0.smithi045.stdout:6/364: write d9/d30/f33 [1310097,53239] 0 2024-09-18T12:52:12.861 INFO:tasks.workunit.client.1.smithi161.stdout:0/744: dwrite df/d29/f53 [0,4194304] 0 2024-09-18T12:52:12.861 INFO:tasks.workunit.client.1.smithi161.stdout:2/776: dwrite d0/d5/d43/f18 [0,4194304] 0 2024-09-18T12:52:12.861 INFO:tasks.workunit.client.1.smithi161.stdout:7/680: dread d3/d8/d4f/f61 [0,4194304] 0 2024-09-18T12:52:12.865 INFO:tasks.workunit.client.0.smithi045.stdout:6/365: dwrite d9/d1a/d2d/f4a [0,4194304] 0 2024-09-18T12:52:12.891 INFO:tasks.workunit.client.1.smithi161.stdout:1/629: sync 2024-09-18T12:52:12.952 INFO:tasks.workunit.client.1.smithi161.stdout:4/799: sync 2024-09-18T12:52:12.952 INFO:tasks.workunit.client.1.smithi161.stdout:9/657: sync 2024-09-18T12:52:12.953 INFO:tasks.workunit.client.0.smithi045.stdout:3/365: link d0/d22/f28 d0/d1e/d2c/d3f/d44/f78 0 2024-09-18T12:52:12.954 INFO:tasks.workunit.client.1.smithi161.stdout:5/696: fdatasync d3/d3b/f42 0 2024-09-18T12:52:12.957 INFO:tasks.workunit.client.1.smithi161.stdout:8/758: creat d0/d3/d10/d21/d4a/d52/d82/d8b/f102 x:0 0 0 2024-09-18T12:52:12.958 INFO:tasks.workunit.client.1.smithi161.stdout:8/759: write d0/d3/d10/d21/d4a/d52/d82/d96/dc1/feb [4988082,82978] 0 2024-09-18T12:52:12.958 INFO:tasks.workunit.client.1.smithi161.stdout:7/681: fdatasync d3/d7e/fa1 0 2024-09-18T12:52:12.959 INFO:tasks.workunit.client.1.smithi161.stdout:8/760: fdatasync d0/d3/fa6 0 2024-09-18T12:52:12.960 INFO:tasks.workunit.client.1.smithi161.stdout:0/745: symlink df/d30/d71/d96/dd3/d90/d37/d55/dba/l10d 0 2024-09-18T12:52:12.962 INFO:tasks.workunit.client.1.smithi161.stdout:2/777: rename d0/d5/d43/d35/f3e to d0/d71/da9/dd6/df7/f10b 0 2024-09-18T12:52:12.964 INFO:tasks.workunit.client.1.smithi161.stdout:7/682: dread d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/fbb [8388608,4194304] 0 2024-09-18T12:52:12.966 INFO:tasks.workunit.client.1.smithi161.stdout:9/658: unlink d0/d47/d48/d7f/f91 0 2024-09-18T12:52:12.967 INFO:tasks.workunit.client.0.smithi045.stdout:7/280: truncate d13/d44/d37/f4d 697264 0 2024-09-18T12:52:12.975 INFO:tasks.workunit.client.1.smithi161.stdout:3/702: sync 2024-09-18T12:52:12.975 INFO:tasks.workunit.client.1.smithi161.stdout:6/784: sync 2024-09-18T12:52:12.978 INFO:tasks.workunit.client.0.smithi045.stdout:1/381: creat d0/d2d/d2b/d30/d40/d60/f74 x:0 0 0 2024-09-18T12:52:12.979 INFO:tasks.workunit.client.0.smithi045.stdout:1/382: dread - d0/d12/d32/d37/f70 zero size 2024-09-18T12:52:12.982 INFO:tasks.workunit.client.0.smithi045.stdout:7/281: dread d13/d44/f1f [0,4194304] 0 2024-09-18T12:52:12.985 INFO:tasks.workunit.client.1.smithi161.stdout:4/800: rename d5/fc to d5/d27/d44/de2/dfe/f121 0 2024-09-18T12:52:12.989 INFO:tasks.workunit.client.0.smithi045.stdout:5/452: creat d6/db/d19/d92/d5c/f98 x:0 0 0 2024-09-18T12:52:12.993 INFO:tasks.workunit.client.1.smithi161.stdout:0/746: dwrite df/de2/dc5/d89/f91 [0,4194304] 0 2024-09-18T12:52:12.993 INFO:tasks.workunit.client.1.smithi161.stdout:1/630: truncate d1/f5 1377865 0 2024-09-18T12:52:12.994 INFO:tasks.workunit.client.1.smithi161.stdout:7/683: creat d3/d8/d15/da7/d24/daf/fcd x:0 0 0 2024-09-18T12:52:12.994 INFO:tasks.workunit.client.0.smithi045.stdout:6/366: mknod d9/c85 0 2024-09-18T12:52:12.994 INFO:tasks.workunit.client.0.smithi045.stdout:2/380: dwrite d5/d2c/d6f/f81 [0,4194304] 0 2024-09-18T12:52:12.995 INFO:tasks.workunit.client.1.smithi161.stdout:0/747: fdatasync df/d30/d71/d96/fd0 0 2024-09-18T12:52:12.995 INFO:tasks.workunit.client.1.smithi161.stdout:9/659: mknod d0/d47/d48/d9a/cd7 0 2024-09-18T12:52:12.995 INFO:tasks.workunit.client.1.smithi161.stdout:2/778: dwrite d0/d1/d4c/f55 [0,4194304] 0 2024-09-18T12:52:12.998 INFO:tasks.workunit.client.0.smithi045.stdout:0/422: creat d6/d48/d5e/f75 x:0 0 0 2024-09-18T12:52:12.999 INFO:tasks.workunit.client.1.smithi161.stdout:3/703: symlink d1/d2e/d68/lf5 0 2024-09-18T12:52:13.001 INFO:tasks.workunit.client.1.smithi161.stdout:6/785: mkdir d4/d1a/d1c/d3e/d83/d9e/d102 0 2024-09-18T12:52:13.003 INFO:tasks.workunit.client.0.smithi045.stdout:6/367: dwrite d9/d1a/d48/f6d [0,4194304] 0 2024-09-18T12:52:13.005 INFO:tasks.workunit.client.1.smithi161.stdout:8/761: symlink d0/d3/d10/d21/d4a/d52/de2/l103 0 2024-09-18T12:52:13.008 INFO:tasks.workunit.client.1.smithi161.stdout:8/762: truncate d0/d3/d10/d21/d4a/d52/d82/d96/d98/fbe 844484 0 2024-09-18T12:52:13.009 INFO:tasks.workunit.client.0.smithi045.stdout:8/371: getdents d11/d14/d53/d41/d57 0 2024-09-18T12:52:13.010 INFO:tasks.workunit.client.1.smithi161.stdout:5/697: truncate d3/f6a 4643642 0 2024-09-18T12:52:13.012 INFO:tasks.workunit.client.1.smithi161.stdout:8/763: dread d0/d3/d10/d21/d4a/db7/fd9 [0,4194304] 0 2024-09-18T12:52:13.013 INFO:tasks.workunit.client.1.smithi161.stdout:4/801: mkdir d5/d27/d44/de2/d122 0 2024-09-18T12:52:13.018 INFO:tasks.workunit.client.1.smithi161.stdout:7/684: symlink d3/d8/d15/da7/d24/d31/d7d/lce 0 2024-09-18T12:52:13.020 INFO:tasks.workunit.client.1.smithi161.stdout:7/685: write d3/d8/d15/f3c [1471274,69636] 0 2024-09-18T12:52:13.020 INFO:tasks.workunit.client.1.smithi161.stdout:0/748: read df/f15 [2237427,122071] 0 2024-09-18T12:52:13.020 INFO:tasks.workunit.client.0.smithi045.stdout:1/383: rename d0/d2d/l71 to d0/d12/l75 0 2024-09-18T12:52:13.021 INFO:tasks.workunit.client.1.smithi161.stdout:0/749: fdatasync df/d30/d4d/d92/f9e 0 2024-09-18T12:52:13.026 INFO:tasks.workunit.client.1.smithi161.stdout:6/786: symlink d4/d1a/d1c/d3e/d83/l103 0 2024-09-18T12:52:13.027 INFO:tasks.workunit.client.1.smithi161.stdout:0/750: dwrite df/d30/d71/d96/dd3/d90/d37/f48 [0,4194304] 0 2024-09-18T12:52:13.027 INFO:tasks.workunit.client.0.smithi045.stdout:6/368: readlink d9/d1a/d2d/d32/l54 0 2024-09-18T12:52:13.029 INFO:tasks.workunit.client.0.smithi045.stdout:5/453: write d6/d3e/f35 [2371195,27417] 0 2024-09-18T12:52:13.030 INFO:tasks.workunit.client.0.smithi045.stdout:8/372: mknod d11/d14/d53/d41/d57/c77 0 2024-09-18T12:52:13.031 INFO:tasks.workunit.client.0.smithi045.stdout:8/373: stat d11 0 2024-09-18T12:52:13.033 INFO:tasks.workunit.client.1.smithi161.stdout:5/698: creat d3/d44/d6f/fe0 x:0 0 0 2024-09-18T12:52:13.034 INFO:tasks.workunit.client.1.smithi161.stdout:8/764: symlink d0/d3/d10/d21/d4a/l104 0 2024-09-18T12:52:13.039 INFO:tasks.workunit.client.1.smithi161.stdout:9/660: symlink d0/d93/ld8 0 2024-09-18T12:52:13.041 INFO:tasks.workunit.client.1.smithi161.stdout:3/704: write d1/d2e/d14/d2c/f33 [521125,62326] 0 2024-09-18T12:52:13.043 INFO:tasks.workunit.client.0.smithi045.stdout:0/423: creat d6/d48/d5e/d39/d58/d3b/d6b/f76 x:0 0 0 2024-09-18T12:52:13.044 INFO:tasks.workunit.client.0.smithi045.stdout:0/424: fsync d6/d48/d5e/f44 0 2024-09-18T12:52:13.044 INFO:tasks.workunit.client.1.smithi161.stdout:7/686: dread - d3/f8d zero size 2024-09-18T12:52:13.045 INFO:tasks.workunit.client.0.smithi045.stdout:7/282: creat d13/f61 x:0 0 0 2024-09-18T12:52:13.045 INFO:tasks.workunit.client.0.smithi045.stdout:7/283: readlink d13/l58 0 2024-09-18T12:52:13.045 INFO:tasks.workunit.client.1.smithi161.stdout:2/779: mkdir d0/d71/da9/d9f/dd0/d10c 0 2024-09-18T12:52:13.047 INFO:tasks.workunit.client.0.smithi045.stdout:5/454: symlink d6/d3e/l99 0 2024-09-18T12:52:13.049 INFO:tasks.workunit.client.1.smithi161.stdout:3/705: dwrite d1/d2e/d24/d1d/fcd [0,4194304] 0 2024-09-18T12:52:13.050 INFO:tasks.workunit.client.0.smithi045.stdout:1/384: dread d0/f69 [0,4194304] 0 2024-09-18T12:52:13.052 INFO:tasks.workunit.client.0.smithi045.stdout:2/381: truncate d5/d2c/d4d/f68 424612 0 2024-09-18T12:52:13.052 INFO:tasks.workunit.client.0.smithi045.stdout:3/366: link d0/f1a d0/d29/d5f/f79 0 2024-09-18T12:52:13.054 INFO:tasks.workunit.client.0.smithi045.stdout:3/367: read d0/d29/d5f/f65 [3295330,111939] 0 2024-09-18T12:52:13.055 INFO:tasks.workunit.client.1.smithi161.stdout:0/751: chown df/c10 1008544 1 2024-09-18T12:52:13.055 INFO:tasks.workunit.client.0.smithi045.stdout:7/284: rmdir d13/d31/d52 39 2024-09-18T12:52:13.056 INFO:tasks.workunit.client.1.smithi161.stdout:0/752: write df/de2/dc5/db6/fc2 [3388111,59310] 0 2024-09-18T12:52:13.057 INFO:tasks.workunit.client.1.smithi161.stdout:6/787: creat d4/d39/d47/d51/f104 x:0 0 0 2024-09-18T12:52:13.059 INFO:tasks.workunit.client.1.smithi161.stdout:8/765: dread d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/fd3 [0,4194304] 0 2024-09-18T12:52:13.062 INFO:tasks.workunit.client.0.smithi045.stdout:8/374: write d11/d23/f2b [294359,74637] 0 2024-09-18T12:52:13.064 INFO:tasks.workunit.client.0.smithi045.stdout:2/382: creat d5/d5f/f8b x:0 0 0 2024-09-18T12:52:13.064 INFO:tasks.workunit.client.1.smithi161.stdout:4/802: mknod d5/d27/d44/d61/d6c/d8f/df5/c123 0 2024-09-18T12:52:13.065 INFO:tasks.workunit.client.1.smithi161.stdout:4/803: chown d5/d27/d44/d61/d6c/d8f/df5 1 1 2024-09-18T12:52:13.066 INFO:tasks.workunit.client.1.smithi161.stdout:1/631: creat d1/d1d/fd4 x:0 0 0 2024-09-18T12:52:13.067 INFO:tasks.workunit.client.1.smithi161.stdout:1/632: write d1/da/f43 [3374866,103637] 0 2024-09-18T12:52:13.068 INFO:tasks.workunit.client.1.smithi161.stdout:9/661: unlink d0/d47/d48/d7f/d84/cb1 0 2024-09-18T12:52:13.068 INFO:tasks.workunit.client.1.smithi161.stdout:1/633: stat d1/da/d1f/d6b 0 2024-09-18T12:52:13.068 INFO:tasks.workunit.client.0.smithi045.stdout:3/368: dread d0/fe [0,4194304] 0 2024-09-18T12:52:13.069 INFO:tasks.workunit.client.1.smithi161.stdout:9/662: truncate d0/d47/d48/f75 1104397 0 2024-09-18T12:52:13.070 INFO:tasks.workunit.client.0.smithi045.stdout:7/285: creat d13/d44/d4c/f62 x:0 0 0 2024-09-18T12:52:13.070 INFO:tasks.workunit.client.0.smithi045.stdout:7/286: stat d13/d1a/l5e 0 2024-09-18T12:52:13.072 INFO:tasks.workunit.client.1.smithi161.stdout:7/687: creat d3/d8/d15/da7/fcf x:0 0 0 2024-09-18T12:52:13.074 INFO:tasks.workunit.client.1.smithi161.stdout:2/780: unlink d0/d5/d43/d35/f5f 0 2024-09-18T12:52:13.075 INFO:tasks.workunit.client.0.smithi045.stdout:8/375: creat d11/d20/d46/f78 x:0 0 0 2024-09-18T12:52:13.077 INFO:tasks.workunit.client.0.smithi045.stdout:2/383: symlink d5/d2c/d4d/d76/d7f/l8c 0 2024-09-18T12:52:13.081 INFO:tasks.workunit.client.1.smithi161.stdout:0/753: mkdir df/d30/d71/d96/dd3/d51/dc9/d10e 0 2024-09-18T12:52:13.081 INFO:tasks.workunit.client.1.smithi161.stdout:0/754: chown df/d30/d4d/ce6 1958 1 2024-09-18T12:52:13.082 INFO:tasks.workunit.client.0.smithi045.stdout:3/369: rename d0/d22/f77 to d0/d29/d5f/d73/f7a 0 2024-09-18T12:52:13.083 INFO:tasks.workunit.client.1.smithi161.stdout:6/788: mkdir d4/d39/d26/d31/d105 0 2024-09-18T12:52:13.085 INFO:tasks.workunit.client.1.smithi161.stdout:8/766: creat d0/d3/d10/d21/d4a/f105 x:0 0 0 2024-09-18T12:52:13.085 INFO:tasks.workunit.client.0.smithi045.stdout:6/369: getdents d9/d1a/d48/d75 0 2024-09-18T12:52:13.087 INFO:tasks.workunit.client.1.smithi161.stdout:5/699: rename d3/f6a to d3/d9/dd7/fe1 0 2024-09-18T12:52:13.089 INFO:tasks.workunit.client.1.smithi161.stdout:5/700: write d3/d9/d4b/d8e/d24/db8/f49 [1002206,91563] 0 2024-09-18T12:52:13.089 INFO:tasks.workunit.client.0.smithi045.stdout:8/376: mkdir d11/d20/d46/d79 0 2024-09-18T12:52:13.090 INFO:tasks.workunit.client.1.smithi161.stdout:5/701: write d3/d8/fcf [1305467,101285] 0 2024-09-18T12:52:13.090 INFO:tasks.workunit.client.0.smithi045.stdout:2/384: mknod d5/d2c/c8d 0 2024-09-18T12:52:13.091 INFO:tasks.workunit.client.1.smithi161.stdout:7/688: rmdir d3/d8/d15/da7/d4a/d64/d8c/d9f/d55 39 2024-09-18T12:52:13.092 INFO:tasks.workunit.client.1.smithi161.stdout:2/781: truncate d0/d5/d43/d35/d98/ddf/f85 1513472 0 2024-09-18T12:52:13.093 INFO:tasks.workunit.client.1.smithi161.stdout:3/706: mkdir d1/d2e/d68/de8/df6 0 2024-09-18T12:52:13.093 INFO:tasks.workunit.client.1.smithi161.stdout:0/755: symlink df/d30/d71/d96/dd3/d90/d37/d55/dba/l10f 0 2024-09-18T12:52:13.094 INFO:tasks.workunit.client.1.smithi161.stdout:0/756: write df/f50 [380311,60904] 0 2024-09-18T12:52:13.094 INFO:tasks.workunit.client.1.smithi161.stdout:6/789: mknod d4/d1a/d1c/d3e/d83/dad/c106 0 2024-09-18T12:52:13.095 INFO:tasks.workunit.client.0.smithi045.stdout:7/287: mkdir d13/d31/d63 0 2024-09-18T12:52:13.095 INFO:tasks.workunit.client.1.smithi161.stdout:6/790: readlink d4/d1a/l38 0 2024-09-18T12:52:13.096 INFO:tasks.workunit.client.0.smithi045.stdout:6/370: creat d9/d1a/d2d/d38/d5b/f86 x:0 0 0 2024-09-18T12:52:13.097 INFO:tasks.workunit.client.0.smithi045.stdout:5/455: getdents d6/db 0 2024-09-18T12:52:13.099 INFO:tasks.workunit.client.1.smithi161.stdout:1/634: rename d1/da/d31/f3c to d1/d26/dad/db6/fd5 0 2024-09-18T12:52:13.099 INFO:tasks.workunit.client.1.smithi161.stdout:1/635: fsync d1/da/d1f/fae 0 2024-09-18T12:52:13.100 INFO:tasks.workunit.client.0.smithi045.stdout:2/385: creat d5/d46/f8e x:0 0 0 2024-09-18T12:52:13.102 INFO:tasks.workunit.client.0.smithi045.stdout:7/288: fdatasync d13/d1a/f1b 0 2024-09-18T12:52:13.103 INFO:tasks.workunit.client.1.smithi161.stdout:7/689: symlink d3/d50/ld0 0 2024-09-18T12:52:13.104 INFO:tasks.workunit.client.1.smithi161.stdout:2/782: symlink d0/d5/d43/d23/ded/l10d 0 2024-09-18T12:52:13.105 INFO:tasks.workunit.client.0.smithi045.stdout:5/456: dread d6/db/d19/d92/d61/f72 [0,4194304] 0 2024-09-18T12:52:13.105 INFO:tasks.workunit.client.0.smithi045.stdout:8/377: symlink d11/d20/l7a 0 2024-09-18T12:52:13.108 INFO:tasks.workunit.client.1.smithi161.stdout:0/757: truncate df/f26 1711613 0 2024-09-18T12:52:13.108 INFO:tasks.workunit.client.0.smithi045.stdout:3/370: link d0/d29/d53/c58 d0/d1e/d2c/d3f/d44/c7b 0 2024-09-18T12:52:13.109 INFO:tasks.workunit.client.1.smithi161.stdout:0/758: chown df/d30/d4d/cd8 18 1 2024-09-18T12:52:13.111 INFO:tasks.workunit.client.1.smithi161.stdout:5/702: dread d3/d14/f4e [0,4194304] 0 2024-09-18T12:52:13.112 INFO:tasks.workunit.client.0.smithi045.stdout:7/289: truncate d13/d31/f2d 3908708 0 2024-09-18T12:52:13.113 INFO:tasks.workunit.client.1.smithi161.stdout:5/703: read d3/d14/f1b [2432318,53238] 0 2024-09-18T12:52:13.113 INFO:tasks.workunit.client.0.smithi045.stdout:7/290: chown d13/d44/d4c/f62 13709 1 2024-09-18T12:52:13.116 INFO:tasks.workunit.client.0.smithi045.stdout:5/457: symlink d6/d28/d2b/d51/l9a 0 2024-09-18T12:52:13.118 INFO:tasks.workunit.client.0.smithi045.stdout:5/458: read d6/db/fe [39950,84908] 0 2024-09-18T12:52:13.123 INFO:tasks.workunit.client.0.smithi045.stdout:8/378: mkdir d11/d7b 0 2024-09-18T12:52:13.125 INFO:tasks.workunit.client.1.smithi161.stdout:0/759: creat df/de2/dc5/d8a/f110 x:0 0 0 2024-09-18T12:52:13.125 INFO:tasks.workunit.client.0.smithi045.stdout:8/379: write d11/d14/f4b [314932,88828] 0 2024-09-18T12:52:13.126 INFO:tasks.workunit.client.0.smithi045.stdout:7/291: mkdir d13/d31/d33/d64 0 2024-09-18T12:52:13.127 INFO:tasks.workunit.client.0.smithi045.stdout:3/371: dwrite d0/d1e/d2c/d3f/d44/f4c [0,4194304] 0 2024-09-18T12:52:13.128 INFO:tasks.workunit.client.0.smithi045.stdout:8/380: write d11/d14/d53/f6d [747536,93598] 0 2024-09-18T12:52:13.138 INFO:tasks.workunit.client.1.smithi161.stdout:6/791: truncate d4/d1a/d1c/d3e/d83/d9e/db1/d28/f3b 1663356 0 2024-09-18T12:52:13.141 INFO:tasks.workunit.client.1.smithi161.stdout:4/804: sync 2024-09-18T12:52:13.142 INFO:tasks.workunit.client.1.smithi161.stdout:9/663: rename d0/d16/l52 to d0/d16/d25/d46/d53/ld9 0 2024-09-18T12:52:13.143 INFO:tasks.workunit.client.1.smithi161.stdout:9/664: chown d0/d93/ld8 612409 1 2024-09-18T12:52:13.143 INFO:tasks.workunit.client.0.smithi045.stdout:2/386: getdents d5 0 2024-09-18T12:52:13.144 INFO:tasks.workunit.client.1.smithi161.stdout:9/665: truncate d0/d20/d49/f15 4755341 0 2024-09-18T12:52:13.144 INFO:tasks.workunit.client.0.smithi045.stdout:3/372: symlink d0/d1e/d2c/d3f/l7c 0 2024-09-18T12:52:13.145 INFO:tasks.workunit.client.1.smithi161.stdout:3/707: creat d1/d2e/d14/ff7 x:0 0 0 2024-09-18T12:52:13.147 INFO:tasks.workunit.client.1.smithi161.stdout:0/760: rmdir df/d30/d71/d96/dd3/d78 39 2024-09-18T12:52:13.147 INFO:tasks.workunit.client.1.smithi161.stdout:3/708: write d1/d2e/d68/d92/ded/f80 [3903630,90662] 0 2024-09-18T12:52:13.148 INFO:tasks.workunit.client.0.smithi045.stdout:5/459: link d6/db/f50 d6/d3e/f9b 0 2024-09-18T12:52:13.149 INFO:tasks.workunit.client.0.smithi045.stdout:5/460: stat d6/d28/d2b/d51/d6c 0 2024-09-18T12:52:13.149 INFO:tasks.workunit.client.1.smithi161.stdout:1/636: dwrite d1/d26/f24 [0,4194304] 0 2024-09-18T12:52:13.149 INFO:tasks.workunit.client.1.smithi161.stdout:8/767: link d0/d3/d10/d21/f30 d0/d3/d10/d21/d4a/d52/d82/d96/dc1/f106 0 2024-09-18T12:52:13.152 INFO:tasks.workunit.client.1.smithi161.stdout:8/768: write d0/d3/d10/d21/d4a/d52/d82/d8b/f102 [774116,52170] 0 2024-09-18T12:52:13.153 INFO:tasks.workunit.client.0.smithi045.stdout:2/387: rename d5/d2c/c60 to d5/d2c/c8f 0 2024-09-18T12:52:13.154 INFO:tasks.workunit.client.0.smithi045.stdout:3/373: fdatasync d0/d1e/d2c/d3f/d44/f76 0 2024-09-18T12:52:13.155 INFO:tasks.workunit.client.0.smithi045.stdout:2/388: write d5/d2c/d4d/d16/d61/f66 [541094,12056] 0 2024-09-18T12:52:13.157 INFO:tasks.workunit.client.1.smithi161.stdout:5/704: dwrite d3/d3b/f42 [0,4194304] 0 2024-09-18T12:52:13.160 INFO:tasks.workunit.client.0.smithi045.stdout:7/292: mknod d13/d31/d29/c65 0 2024-09-18T12:52:13.165 INFO:tasks.workunit.client.1.smithi161.stdout:9/666: rmdir d0/d16/d25/d46/d53/d59 39 2024-09-18T12:52:13.168 INFO:tasks.workunit.client.0.smithi045.stdout:8/381: creat d11/d14/d53/d41/f7c x:0 0 0 2024-09-18T12:52:13.170 INFO:tasks.workunit.client.1.smithi161.stdout:0/761: creat df/d30/d71/d96/f111 x:0 0 0 2024-09-18T12:52:13.172 INFO:tasks.workunit.client.1.smithi161.stdout:3/709: mknod d1/d2e/cf8 0 2024-09-18T12:52:13.175 INFO:tasks.workunit.client.0.smithi045.stdout:5/461: rename d6/db/d5a/d78/d66/c67 to d6/db/d19/d92/d5c/c9c 0 2024-09-18T12:52:13.176 INFO:tasks.workunit.client.1.smithi161.stdout:1/637: read d1/d1d/f57 [958537,10754] 0 2024-09-18T12:52:13.176 INFO:tasks.workunit.client.1.smithi161.stdout:1/638: chown d1/da/d31/f3e 3644 1 2024-09-18T12:52:13.182 INFO:tasks.workunit.client.1.smithi161.stdout:5/705: mknod d3/d44/d6f/ce2 0 2024-09-18T12:52:13.183 INFO:tasks.workunit.client.0.smithi045.stdout:7/293: mknod d13/d31/d52/c66 0 2024-09-18T12:52:13.187 INFO:tasks.workunit.client.1.smithi161.stdout:5/706: dwrite d3/d14/d20/f3c [4194304,4194304] 0 2024-09-18T12:52:13.187 INFO:tasks.workunit.client.1.smithi161.stdout:2/783: rename d0/d5/d43/d23/fc3 to d0/d4/dab/f10e 0 2024-09-18T12:52:13.197 INFO:tasks.workunit.client.1.smithi161.stdout:7/690: rename d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/fa5 to d3/d8/d15/da7/d4a/fd1 0 2024-09-18T12:52:13.197 INFO:tasks.workunit.client.1.smithi161.stdout:5/707: mkdir d3/d3b/d7b/de3 0 2024-09-18T12:52:13.198 INFO:tasks.workunit.client.1.smithi161.stdout:2/784: unlink d0/d1/deb/d7e/c72 0 2024-09-18T12:52:13.198 INFO:tasks.workunit.client.1.smithi161.stdout:4/805: link d5/d14/d67/d84/dae/fb0 d5/d27/d44/de2/dfe/f124 0 2024-09-18T12:52:13.199 INFO:tasks.workunit.client.1.smithi161.stdout:5/708: write d3/d14/d8d/fc7 [4759495,84864] 0 2024-09-18T12:52:13.200 INFO:tasks.workunit.client.1.smithi161.stdout:2/785: chown d0/d71/da9/d9f/f104 10397 1 2024-09-18T12:52:13.201 INFO:tasks.workunit.client.1.smithi161.stdout:5/709: chown d3/d44/d6f/d86/fcd 0 1 2024-09-18T12:52:13.201 INFO:tasks.workunit.client.1.smithi161.stdout:6/792: link d4/d39/l44 d4/d1a/l107 0 2024-09-18T12:52:13.201 INFO:tasks.workunit.client.1.smithi161.stdout:5/710: readlink d3/d14/d8d/dab/lad 0 2024-09-18T12:52:13.203 INFO:tasks.workunit.client.1.smithi161.stdout:0/762: rename df/de2/dc5/d89/lc3 to df/d29/dc7/l112 0 2024-09-18T12:52:13.207 INFO:tasks.workunit.client.1.smithi161.stdout:7/691: unlink d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/d9b/f9c 0 2024-09-18T12:52:13.208 INFO:tasks.workunit.client.1.smithi161.stdout:1/639: link d1/da/d1f/d6b/c6e d1/d26/d88/cd6 0 2024-09-18T12:52:13.208 INFO:tasks.workunit.client.0.smithi045.stdout:5/462: mknod d6/db/d6a/d6d/c9d 0 2024-09-18T12:52:13.209 INFO:tasks.workunit.client.0.smithi045.stdout:7/294: write d13/d31/f26 [7867401,53651] 0 2024-09-18T12:52:13.210 INFO:tasks.workunit.client.0.smithi045.stdout:8/382: mknod d11/d14/d53/d41/d75/c7d 0 2024-09-18T12:52:13.211 INFO:tasks.workunit.client.1.smithi161.stdout:4/806: mknod d5/d14/d67/dc7/d60/d95/dda/c125 0 2024-09-18T12:52:13.211 INFO:tasks.workunit.client.1.smithi161.stdout:3/710: dwrite d1/d2e/d14/d2c/f31 [0,4194304] 0 2024-09-18T12:52:13.215 INFO:tasks.workunit.client.0.smithi045.stdout:8/383: readlink d11/d14/l1d 0 2024-09-18T12:52:13.215 INFO:tasks.workunit.client.0.smithi045.stdout:2/389: dwrite d5/d2c/d4d/f8a [0,4194304] 0 2024-09-18T12:52:13.218 INFO:tasks.workunit.client.1.smithi161.stdout:6/793: creat d4/d1a/d1c/d3e/d83/dad/dbd/f108 x:0 0 0 2024-09-18T12:52:13.220 INFO:tasks.workunit.client.0.smithi045.stdout:3/374: dwrite d0/d7/f1d [0,4194304] 0 2024-09-18T12:52:13.224 INFO:tasks.workunit.client.1.smithi161.stdout:9/667: rename d0/d16/d25/l3e to d0/d93/da0/lda 0 2024-09-18T12:52:13.229 INFO:tasks.workunit.client.1.smithi161.stdout:0/763: creat df/de2/dc5/d8a/f113 x:0 0 0 2024-09-18T12:52:13.229 INFO:tasks.workunit.client.1.smithi161.stdout:1/640: dread d1/da/d31/f3e [0,4194304] 0 2024-09-18T12:52:13.231 INFO:tasks.workunit.client.0.smithi045.stdout:3/375: symlink d0/d29/d5f/d73/l7d 0 2024-09-18T12:52:13.233 INFO:tasks.workunit.client.0.smithi045.stdout:3/376: write d0/d1e/d2c/d3a/d45/f49 [421189,23617] 0 2024-09-18T12:52:13.235 INFO:tasks.workunit.client.0.smithi045.stdout:3/377: write d0/d1e/d2c/d3f/d44/f76 [4487592,95] 0 2024-09-18T12:52:13.235 INFO:tasks.workunit.client.0.smithi045.stdout:7/295: truncate d13/d44/d37/f4d 1288528 0 2024-09-18T12:52:13.238 INFO:tasks.workunit.client.1.smithi161.stdout:0/764: dread df/de2/dc5/d8a/fc6 [0,4194304] 0 2024-09-18T12:52:13.240 INFO:tasks.workunit.client.1.smithi161.stdout:7/692: dwrite d3/d8/d15/da7/d4a/fd1 [0,4194304] 0 2024-09-18T12:52:13.242 INFO:tasks.workunit.client.0.smithi045.stdout:3/378: dwrite d0/f1f [0,4194304] 0 2024-09-18T12:52:13.243 INFO:tasks.workunit.client.1.smithi161.stdout:0/765: dread df/d30/d4d/f4f [0,4194304] 0 2024-09-18T12:52:13.244 INFO:tasks.workunit.client.1.smithi161.stdout:0/766: stat df/d29/d36/f5b 0 2024-09-18T12:52:13.245 INFO:tasks.workunit.client.1.smithi161.stdout:8/769: sync 2024-09-18T12:52:13.245 INFO:tasks.workunit.client.1.smithi161.stdout:3/711: creat d1/d2e/d68/d69/ff9 x:0 0 0 2024-09-18T12:52:13.246 INFO:tasks.workunit.client.1.smithi161.stdout:2/786: fdatasync d0/d5/d43/d35/d98/ddf/f85 0 2024-09-18T12:52:13.250 INFO:tasks.workunit.client.0.smithi045.stdout:2/390: dwrite d5/f42 [0,4194304] 0 2024-09-18T12:52:13.255 INFO:tasks.workunit.client.1.smithi161.stdout:6/794: dread d4/d61/d69/fae [0,4194304] 0 2024-09-18T12:52:13.256 INFO:tasks.workunit.client.1.smithi161.stdout:5/711: rename d3/d14 to d3/d8/de4 0 2024-09-18T12:52:13.260 INFO:tasks.workunit.client.0.smithi045.stdout:5/463: link d6/db/f50 d6/db/d6a/d77/f9e 0 2024-09-18T12:52:13.261 INFO:tasks.workunit.client.1.smithi161.stdout:5/712: read d3/d3b/d7b/d82/f9d [1188431,122964] 0 2024-09-18T12:52:13.261 INFO:tasks.workunit.client.1.smithi161.stdout:4/807: write d5/d14/d67/f76 [1037889,56455] 0 2024-09-18T12:52:13.264 INFO:tasks.workunit.client.1.smithi161.stdout:5/713: write d3/d9/d4b/d8e/d24/f70 [1112992,38023] 0 2024-09-18T12:52:13.265 INFO:tasks.workunit.client.1.smithi161.stdout:4/808: read d5/d32/d39/db6/fd9 [1488658,4992] 0 2024-09-18T12:52:13.267 INFO:tasks.workunit.client.1.smithi161.stdout:1/641: creat d1/d71/fd7 x:0 0 0 2024-09-18T12:52:13.268 INFO:tasks.workunit.client.1.smithi161.stdout:4/809: read d5/f21 [376913,85582] 0 2024-09-18T12:52:13.269 INFO:tasks.workunit.client.1.smithi161.stdout:7/693: dread d3/d8/d15/f92 [0,4194304] 0 2024-09-18T12:52:13.269 INFO:tasks.workunit.client.1.smithi161.stdout:1/642: truncate d1/da/d31/f91 104934 0 2024-09-18T12:52:13.271 INFO:tasks.workunit.client.0.smithi045.stdout:8/384: truncate d11/d20/d46/f43 1143678 0 2024-09-18T12:52:13.272 INFO:tasks.workunit.client.0.smithi045.stdout:2/391: creat d5/d2c/d4d/d76/d7f/f90 x:0 0 0 2024-09-18T12:52:13.274 INFO:tasks.workunit.client.0.smithi045.stdout:7/296: dwrite fd [0,4194304] 0 2024-09-18T12:52:13.275 INFO:tasks.workunit.client.1.smithi161.stdout:3/712: dread d1/d2e/d14/d65/d76/d8c/f8d [0,4194304] 0 2024-09-18T12:52:13.279 INFO:tasks.workunit.client.0.smithi045.stdout:8/385: rename d11/l47 to d11/d20/d46/l7e 0 2024-09-18T12:52:13.287 INFO:tasks.workunit.client.0.smithi045.stdout:8/386: unlink d11/d14/l3f 0 2024-09-18T12:52:13.289 INFO:tasks.workunit.client.0.smithi045.stdout:8/387: chown d11/d20/d46/f51 94212493 1 2024-09-18T12:52:13.293 INFO:tasks.workunit.client.0.smithi045.stdout:2/392: rename d5/d2c/d4d/d76/d7f to d5/d2c/d4d/d16/d91 0 2024-09-18T12:52:13.296 INFO:tasks.workunit.client.0.smithi045.stdout:3/379: dwrite d0/d1e/d2c/f42 [0,4194304] 0 2024-09-18T12:52:13.296 INFO:tasks.workunit.client.0.smithi045.stdout:5/464: dread d6/d28/d2b/f4e [0,4194304] 0 2024-09-18T12:52:13.296 INFO:tasks.workunit.client.1.smithi161.stdout:9/668: mkdir d0/d16/d25/d46/d53/d59/ddb 0 2024-09-18T12:52:13.299 INFO:tasks.workunit.client.1.smithi161.stdout:8/770: write d0/d3/d10/d21/f30 [1848278,49950] 0 2024-09-18T12:52:13.301 INFO:tasks.workunit.client.1.smithi161.stdout:0/767: dwrite df/d98/fb5 [0,4194304] 0 2024-09-18T12:52:13.301 INFO:tasks.workunit.client.0.smithi045.stdout:8/388: unlink d11/d20/f2e 0 2024-09-18T12:52:13.303 INFO:tasks.workunit.client.0.smithi045.stdout:8/389: write f6 [3716282,96930] 0 2024-09-18T12:52:13.305 INFO:tasks.workunit.client.1.smithi161.stdout:6/795: write d4/d39/d26/d31/d76/f9c [3510310,85269] 0 2024-09-18T12:52:13.306 INFO:tasks.workunit.client.0.smithi045.stdout:8/390: write d11/d14/f4c [607202,103060] 0 2024-09-18T12:52:13.309 INFO:tasks.workunit.client.0.smithi045.stdout:2/393: unlink d5/d46/f7a 0 2024-09-18T12:52:13.311 INFO:tasks.workunit.client.1.smithi161.stdout:5/714: creat d3/d9/d4b/d8e/d24/d61/fe5 x:0 0 0 2024-09-18T12:52:13.311 INFO:tasks.workunit.client.0.smithi045.stdout:5/465: dwrite d6/d3e/f3f [4194304,4194304] 0 2024-09-18T12:52:13.312 INFO:tasks.workunit.client.0.smithi045.stdout:2/394: dread - d5/d2c/d4d/d33/f80 zero size 2024-09-18T12:52:13.314 INFO:tasks.workunit.client.0.smithi045.stdout:5/466: truncate d6/d28/f88 710420 0 2024-09-18T12:52:13.314 INFO:tasks.workunit.client.1.smithi161.stdout:7/694: symlink d3/d8/d4b/ld2 0 2024-09-18T12:52:13.315 INFO:tasks.workunit.client.0.smithi045.stdout:2/395: write d5/d46/f52 [1738666,43346] 0 2024-09-18T12:52:13.315 INFO:tasks.workunit.client.1.smithi161.stdout:7/695: chown d3/d8/d4b/lc6 536 1 2024-09-18T12:52:13.315 INFO:tasks.workunit.client.1.smithi161.stdout:7/696: dread - d3/d8/d4f/fbf zero size 2024-09-18T12:52:13.315 INFO:tasks.workunit.client.0.smithi045.stdout:8/391: symlink d11/d20/d60/l7f 0 2024-09-18T12:52:13.316 INFO:tasks.workunit.client.1.smithi161.stdout:1/643: creat d1/d26/d3a/fd8 x:0 0 0 2024-09-18T12:52:13.320 INFO:tasks.workunit.client.0.smithi045.stdout:8/392: unlink d11/d14/d53/d41/d57/c77 0 2024-09-18T12:52:13.322 INFO:tasks.workunit.client.0.smithi045.stdout:2/396: fsync d5/d2c/d4d/d16/f2e 0 2024-09-18T12:52:13.322 INFO:tasks.workunit.client.0.smithi045.stdout:7/297: dread d13/d31/d29/f5c [0,4194304] 0 2024-09-18T12:52:13.324 INFO:tasks.workunit.client.0.smithi045.stdout:8/393: rmdir d11/d14/d72 39 2024-09-18T12:52:13.327 INFO:tasks.workunit.client.0.smithi045.stdout:8/394: fdatasync d11/f13 0 2024-09-18T12:52:13.330 INFO:tasks.workunit.client.0.smithi045.stdout:3/380: dread d0/d1e/d39/f43 [0,4194304] 0 2024-09-18T12:52:13.331 INFO:tasks.workunit.client.1.smithi161.stdout:8/771: creat d0/d3/d1e/dda/de3/f107 x:0 0 0 2024-09-18T12:52:13.331 INFO:tasks.workunit.client.1.smithi161.stdout:8/772: readlink d0/d3/d10/d21/d4a/d52/de2/l103 0 2024-09-18T12:52:13.335 INFO:tasks.workunit.client.1.smithi161.stdout:5/715: mkdir d3/d9/d4b/d8e/d24/d61/de6 0 2024-09-18T12:52:13.340 INFO:tasks.workunit.client.1.smithi161.stdout:3/713: creat d1/d2e/d68/de8/df6/ffa x:0 0 0 2024-09-18T12:52:13.341 INFO:tasks.workunit.client.1.smithi161.stdout:3/714: chown d1/d2e/d68/d92/ded 0 1 2024-09-18T12:52:13.341 INFO:tasks.workunit.client.1.smithi161.stdout:3/715: chown d1/d2e/d14/d78/fbc 148 1 2024-09-18T12:52:13.342 INFO:tasks.workunit.client.0.smithi045.stdout:3/381: dwrite d0/d1e/d2c/d5c/f60 [0,4194304] 0 2024-09-18T12:52:13.342 INFO:tasks.workunit.client.1.smithi161.stdout:3/716: write d1/d2e/d68/d92/ded/d49/fdf [3428680,114582] 0 2024-09-18T12:52:13.344 INFO:tasks.workunit.client.1.smithi161.stdout:8/773: rmdir d0 39 2024-09-18T12:52:13.344 INFO:tasks.workunit.client.0.smithi045.stdout:5/467: dread d6/d28/d2b/f2d [0,4194304] 0 2024-09-18T12:52:13.346 INFO:tasks.workunit.client.0.smithi045.stdout:3/382: unlink d0/d7/c37 0 2024-09-18T12:52:13.347 INFO:tasks.workunit.client.0.smithi045.stdout:7/298: dread d13/d1a/d28/f39 [0,4194304] 0 2024-09-18T12:52:13.347 INFO:tasks.workunit.client.1.smithi161.stdout:6/796: mknod d4/d1a/c109 0 2024-09-18T12:52:13.349 INFO:tasks.workunit.client.1.smithi161.stdout:6/797: truncate d4/d1a/d1c/d3e/d83/fd8 717208 0 2024-09-18T12:52:13.349 INFO:tasks.workunit.client.0.smithi045.stdout:7/299: write d13/d1a/f59 [737894,95663] 0 2024-09-18T12:52:13.350 INFO:tasks.workunit.client.0.smithi045.stdout:7/300: chown d13/d31/d33/d64 67663059 1 2024-09-18T12:52:13.350 INFO:tasks.workunit.client.1.smithi161.stdout:6/798: truncate d4/d39/d3a/f1f 5593669 0 2024-09-18T12:52:13.351 INFO:tasks.workunit.client.0.smithi045.stdout:3/383: write d0/d29/d5f/f65 [1019201,29392] 0 2024-09-18T12:52:13.352 INFO:tasks.workunit.client.1.smithi161.stdout:4/810: link d5/d14/d6d/ccb d5/d14/d67/dc7/d60/c126 0 2024-09-18T12:52:13.354 INFO:tasks.workunit.client.0.smithi045.stdout:5/468: mknod d6/d28/d2b/c9f 0 2024-09-18T12:52:13.354 INFO:tasks.workunit.client.0.smithi045.stdout:5/469: chown d6/db/d70 103547 1 2024-09-18T12:52:13.356 INFO:tasks.workunit.client.0.smithi045.stdout:5/470: write d6/db/d5a/d78/d66/f69 [779711,20935] 0 2024-09-18T12:52:13.357 INFO:tasks.workunit.client.0.smithi045.stdout:8/395: truncate d11/f12 134675 0 2024-09-18T12:52:13.358 INFO:tasks.workunit.client.1.smithi161.stdout:1/644: fdatasync d1/da/d31/fd3 0 2024-09-18T12:52:13.359 INFO:tasks.workunit.client.1.smithi161.stdout:0/768: dwrite df/d30/f80 [0,4194304] 0 2024-09-18T12:52:13.361 INFO:tasks.workunit.client.1.smithi161.stdout:2/787: getdents d0/d1/d4c/d67/db9/dcb/d8a 0 2024-09-18T12:52:13.366 INFO:tasks.workunit.client.0.smithi045.stdout:5/471: creat d6/d3e/fa0 x:0 0 0 2024-09-18T12:52:13.366 INFO:tasks.workunit.client.1.smithi161.stdout:0/769: dread df/d30/f80 [0,4194304] 0 2024-09-18T12:52:13.369 INFO:tasks.workunit.client.1.smithi161.stdout:9/669: rename d0/d47/d48/d7f/d9e/fa5 to d0/d16/fdc 0 2024-09-18T12:52:13.371 INFO:tasks.workunit.client.0.smithi045.stdout:8/396: rename l1 to d11/d20/d59/l80 0 2024-09-18T12:52:13.372 INFO:tasks.workunit.client.0.smithi045.stdout:7/301: write d13/d1a/f27 [759097,85311] 0 2024-09-18T12:52:13.373 INFO:tasks.workunit.client.0.smithi045.stdout:7/302: chown d13/f61 2572005 1 2024-09-18T12:52:13.377 INFO:tasks.workunit.client.1.smithi161.stdout:6/799: symlink d4/d1a/d1c/d3e/d83/da2/db4/l10a 0 2024-09-18T12:52:13.377 INFO:tasks.workunit.client.1.smithi161.stdout:6/800: stat d4/d61/d69/da0/dab 0 2024-09-18T12:52:13.377 INFO:tasks.workunit.client.0.smithi045.stdout:8/397: chown d11/d20/d46/c69 22613 1 2024-09-18T12:52:13.378 INFO:tasks.workunit.client.1.smithi161.stdout:6/801: truncate d4/d39/d48/f8b 5329670 0 2024-09-18T12:52:13.378 INFO:tasks.workunit.client.1.smithi161.stdout:4/811: stat d5/d27/d44/f101 0 2024-09-18T12:52:13.379 INFO:tasks.workunit.client.0.smithi045.stdout:8/398: dread - d11/d14/d53/d41/f7c zero size 2024-09-18T12:52:13.379 INFO:tasks.workunit.client.1.smithi161.stdout:6/802: chown d4/d1a/d1c/d3e/d83/l103 220410 1 2024-09-18T12:52:13.380 INFO:tasks.workunit.client.1.smithi161.stdout:4/812: dread d5/d27/d44/de2/fb7 [0,4194304] 0 2024-09-18T12:52:13.381 INFO:tasks.workunit.client.1.smithi161.stdout:7/697: link d3/d36/f8b d3/d8/fd3 0 2024-09-18T12:52:13.381 INFO:tasks.workunit.client.0.smithi045.stdout:3/384: dread d0/d1e/d2c/d3f/d44/f76 [0,4194304] 0 2024-09-18T12:52:13.384 INFO:tasks.workunit.client.0.smithi045.stdout:7/303: getdents d13/d31/d5f 0 2024-09-18T12:52:13.385 INFO:tasks.workunit.client.0.smithi045.stdout:7/304: stat d13/d1a/d28/f3e 0 2024-09-18T12:52:13.385 INFO:tasks.workunit.client.0.smithi045.stdout:3/385: creat d0/d29/d53/f7e x:0 0 0 2024-09-18T12:52:13.386 INFO:tasks.workunit.client.1.smithi161.stdout:1/645: mkdir d1/da/d1f/dab/dd9 0 2024-09-18T12:52:13.386 INFO:tasks.workunit.client.0.smithi045.stdout:7/305: write d13/d1a/d28/f46 [78135,76908] 0 2024-09-18T12:52:13.387 INFO:tasks.workunit.client.0.smithi045.stdout:5/472: rename d6/db/d70/c8b to d6/db/d19/d92/ca1 0 2024-09-18T12:52:13.391 INFO:tasks.workunit.client.0.smithi045.stdout:3/386: chown d0/d7/c1c 55361188 1 2024-09-18T12:52:13.391 INFO:tasks.workunit.client.1.smithi161.stdout:2/788: read d0/f13 [1704944,103801] 0 2024-09-18T12:52:13.392 INFO:tasks.workunit.client.1.smithi161.stdout:2/789: write d0/d1/fe0 [888607,125898] 0 2024-09-18T12:52:13.404 INFO:tasks.workunit.client.1.smithi161.stdout:5/716: rename d3/d8/dd9 to d3/d9/dd7/de7 0 2024-09-18T12:52:13.405 INFO:tasks.workunit.client.1.smithi161.stdout:0/770: write df/de2/dc5/d86/f7e [5224295,47362] 0 2024-09-18T12:52:13.405 INFO:tasks.workunit.client.0.smithi045.stdout:5/473: dread d6/db/fe [0,4194304] 0 2024-09-18T12:52:13.407 INFO:tasks.workunit.client.1.smithi161.stdout:9/670: creat d0/d47/fdd x:0 0 0 2024-09-18T12:52:13.407 INFO:tasks.workunit.client.0.smithi045.stdout:5/474: write d6/db/d5a/d78/d66/f69 [1606131,49541] 0 2024-09-18T12:52:13.408 INFO:tasks.workunit.client.1.smithi161.stdout:9/671: truncate d0/fd1 386193 0 2024-09-18T12:52:13.411 INFO:tasks.workunit.client.1.smithi161.stdout:5/717: dwrite d3/d9/d4b/d8e/fa1 [0,4194304] 0 2024-09-18T12:52:13.433 INFO:tasks.workunit.client.0.smithi045.stdout:7/306: mknod d13/d31/c67 0 2024-09-18T12:52:13.436 INFO:tasks.workunit.client.0.smithi045.stdout:8/399: rename d11/d14/d53/d41/d57/l48 to d11/d23/l81 0 2024-09-18T12:52:13.440 INFO:tasks.workunit.client.0.smithi045.stdout:3/387: dwrite d0/d22/f28 [0,4194304] 0 2024-09-18T12:52:13.443 INFO:tasks.workunit.client.1.smithi161.stdout:1/646: dread - d1/d26/d3a/d52/f74 zero size 2024-09-18T12:52:13.443 INFO:tasks.workunit.client.0.smithi045.stdout:3/388: truncate d0/d1e/d2c/d3a/d45/f69 65060 0 2024-09-18T12:52:13.444 INFO:tasks.workunit.client.1.smithi161.stdout:6/803: dwrite d4/d61/d69/fae [4194304,4194304] 0 2024-09-18T12:52:13.445 INFO:tasks.workunit.client.1.smithi161.stdout:6/804: readlink d4/d39/d47/lbc 0 2024-09-18T12:52:13.445 INFO:tasks.workunit.client.1.smithi161.stdout:6/805: fsync d4/d39/f74 0 2024-09-18T12:52:13.448 INFO:tasks.workunit.client.0.smithi045.stdout:3/389: mknod d0/d1e/d39/c7f 0 2024-09-18T12:52:13.456 INFO:tasks.workunit.client.1.smithi161.stdout:5/718: creat d3/d3b/fe8 x:0 0 0 2024-09-18T12:52:13.457 INFO:tasks.workunit.client.0.smithi045.stdout:5/475: dwrite d6/db/f2c [4194304,4194304] 0 2024-09-18T12:52:13.458 INFO:tasks.workunit.client.1.smithi161.stdout:3/717: link d1/d2e/d24/d1d/cbd d1/d2e/d24/d1d/d89/cfb 0 2024-09-18T12:52:13.460 INFO:tasks.workunit.client.0.smithi045.stdout:7/307: dread d13/d1a/f2e [0,4194304] 0 2024-09-18T12:52:13.462 INFO:tasks.workunit.client.0.smithi045.stdout:8/400: dwrite d11/d14/f1e [0,4194304] 0 2024-09-18T12:52:13.465 INFO:tasks.workunit.client.1.smithi161.stdout:4/813: mkdir d5/d14/d67/dc7/d47/dbc/d127 0 2024-09-18T12:52:13.465 INFO:tasks.workunit.client.0.smithi045.stdout:3/390: rename d0/f1f to d0/d7/f80 0 2024-09-18T12:52:13.474 INFO:tasks.workunit.client.0.smithi045.stdout:5/476: rename d6/db/lc to d6/d28/d2b/d7f/la2 0 2024-09-18T12:52:13.478 INFO:tasks.workunit.client.0.smithi045.stdout:3/391: dwrite d0/d1e/d2c/d3a/d45/f49 [0,4194304] 0 2024-09-18T12:52:13.481 INFO:tasks.workunit.client.0.smithi045.stdout:8/401: dwrite d11/d20/f71 [0,4194304] 0 2024-09-18T12:52:13.484 INFO:tasks.workunit.client.1.smithi161.stdout:2/790: sync 2024-09-18T12:52:13.488 INFO:tasks.workunit.client.0.smithi045.stdout:7/308: write f2 [1019269,111579] 0 2024-09-18T12:52:13.489 INFO:tasks.workunit.client.1.smithi161.stdout:2/791: chown d0/f41 1327764386 1 2024-09-18T12:52:13.491 INFO:tasks.workunit.client.0.smithi045.stdout:8/402: mkdir d11/d14/d53/d41/d57/d82 0 2024-09-18T12:52:13.491 INFO:tasks.workunit.client.0.smithi045.stdout:3/392: dwrite d0/d29/f67 [0,4194304] 0 2024-09-18T12:52:13.491 INFO:tasks.workunit.client.0.smithi045.stdout:7/309: write d13/d31/f26 [5393943,21329] 0 2024-09-18T12:52:13.493 INFO:tasks.workunit.client.1.smithi161.stdout:8/774: dwrite d0/d3/d10/f42 [0,4194304] 0 2024-09-18T12:52:13.494 INFO:tasks.workunit.client.0.smithi045.stdout:5/477: rename d6/db/d6a/d77/f9e to d6/db/d19/fa3 0 2024-09-18T12:52:13.496 INFO:tasks.workunit.client.1.smithi161.stdout:4/814: creat d5/d32/f128 x:0 0 0 2024-09-18T12:52:13.504 INFO:tasks.workunit.client.1.smithi161.stdout:6/806: mknod d4/d1a/d1c/d3e/d83/dad/dd4/c10b 0 2024-09-18T12:52:13.505 INFO:tasks.workunit.client.0.smithi045.stdout:7/310: dwrite d13/f16 [0,4194304] 0 2024-09-18T12:52:13.507 INFO:tasks.workunit.client.1.smithi161.stdout:6/807: dread d4/d1a/d1c/d3e/d83/fd8 [0,4194304] 0 2024-09-18T12:52:13.507 INFO:tasks.workunit.client.0.smithi045.stdout:7/311: readlink d13/l48 0 2024-09-18T12:52:13.507 INFO:tasks.workunit.client.0.smithi045.stdout:5/478: dwrite d6/db/d5a/d78/f45 [4194304,4194304] 0 2024-09-18T12:52:13.507 INFO:tasks.workunit.client.1.smithi161.stdout:0/771: creat df/d30/d71/d96/dd3/f114 x:0 0 0 2024-09-18T12:52:13.510 INFO:tasks.workunit.client.0.smithi045.stdout:3/393: rmdir d0/d29/d5f/d73 39 2024-09-18T12:52:13.510 INFO:tasks.workunit.client.0.smithi045.stdout:8/403: symlink d11/d14/d53/d41/l83 0 2024-09-18T12:52:13.515 INFO:tasks.workunit.client.0.smithi045.stdout:5/479: mknod d6/db/d6a/ca4 0 2024-09-18T12:52:13.519 INFO:tasks.workunit.client.0.smithi045.stdout:7/312: mknod d13/d31/d63/c68 0 2024-09-18T12:52:13.519 INFO:tasks.workunit.client.0.smithi045.stdout:8/404: read d11/f16 [919052,12935] 0 2024-09-18T12:52:13.520 INFO:tasks.workunit.client.0.smithi045.stdout:7/313: stat d13/f61 0 2024-09-18T12:52:13.521 INFO:tasks.workunit.client.0.smithi045.stdout:5/480: rename d6/d28/d4c to d6/db/d19/d92/d61/da5 0 2024-09-18T12:52:13.528 INFO:tasks.workunit.client.0.smithi045.stdout:5/481: rename d6/db/l39 to d6/db/la6 0 2024-09-18T12:52:13.528 INFO:tasks.workunit.client.1.smithi161.stdout:3/718: write d1/d2e/d14/f44 [1629615,29144] 0 2024-09-18T12:52:13.529 INFO:tasks.workunit.client.0.smithi045.stdout:3/394: dread d0/f41 [0,4194304] 0 2024-09-18T12:52:13.534 INFO:tasks.workunit.client.0.smithi045.stdout:5/482: rmdir d6/db/d19 39 2024-09-18T12:52:13.537 INFO:tasks.workunit.client.0.smithi045.stdout:5/483: creat d6/d28/d2b/d51/fa7 x:0 0 0 2024-09-18T12:52:13.538 INFO:tasks.workunit.client.0.smithi045.stdout:5/484: fsync d6/d3e/f3f 0 2024-09-18T12:52:13.542 INFO:tasks.workunit.client.0.smithi045.stdout:3/395: rename d0/d7/l5a to d0/d7/l81 0 2024-09-18T12:52:13.543 INFO:tasks.workunit.client.0.smithi045.stdout:3/396: write d0/d22/f3d [48584,125336] 0 2024-09-18T12:52:13.544 INFO:tasks.workunit.client.0.smithi045.stdout:5/485: write d6/db/d5a/d78/d66/f7b [2897774,127527] 0 2024-09-18T12:52:13.544 INFO:tasks.workunit.client.0.smithi045.stdout:3/397: readlink d0/d1e/d2c/l66 0 2024-09-18T12:52:13.553 INFO:tasks.workunit.client.0.smithi045.stdout:5/486: unlink c4 0 2024-09-18T12:52:13.555 INFO:tasks.workunit.client.0.smithi045.stdout:5/487: write d6/d28/d2b/f4e [8463597,70126] 0 2024-09-18T12:52:13.557 INFO:tasks.workunit.client.0.smithi045.stdout:3/398: creat d0/d1e/d2c/f82 x:0 0 0 2024-09-18T12:52:13.559 INFO:tasks.workunit.client.0.smithi045.stdout:5/488: truncate d6/db/d19/d92/f79 284894 0 2024-09-18T12:52:13.559 INFO:tasks.workunit.client.1.smithi161.stdout:9/672: rmdir d0/d16/d25/d28/d45/dd5 0 2024-09-18T12:52:13.562 INFO:tasks.workunit.client.0.smithi045.stdout:5/489: creat d6/d3e/fa8 x:0 0 0 2024-09-18T12:52:13.566 INFO:tasks.workunit.client.0.smithi045.stdout:8/405: truncate d11/f16 1617462 0 2024-09-18T12:52:13.567 INFO:tasks.workunit.client.0.smithi045.stdout:7/314: dwrite d13/f32 [0,4194304] 0 2024-09-18T12:52:13.569 INFO:tasks.workunit.client.1.smithi161.stdout:7/698: link d3/d8/d15/da7/d24/d31/f34 d3/d50/fd4 0 2024-09-18T12:52:13.571 INFO:tasks.workunit.client.0.smithi045.stdout:5/490: creat d6/db/d19/d92/d61/da5/fa9 x:0 0 0 2024-09-18T12:52:13.571 INFO:tasks.workunit.client.1.smithi161.stdout:1/647: link d1/d26/d3a/d52/c8f d1/da/d1f/d45/d73/cda 0 2024-09-18T12:52:13.572 INFO:tasks.workunit.client.0.smithi045.stdout:5/491: readlink d6/d28/d2b/l58 0 2024-09-18T12:52:13.572 INFO:tasks.workunit.client.0.smithi045.stdout:5/492: dread - d6/db/d5a/f7c zero size 2024-09-18T12:52:13.573 INFO:tasks.workunit.client.0.smithi045.stdout:5/493: chown d6/c4a 368 1 2024-09-18T12:52:13.575 INFO:tasks.workunit.client.1.smithi161.stdout:6/808: symlink d4/d61/d9d/l10c 0 2024-09-18T12:52:13.578 INFO:tasks.workunit.client.1.smithi161.stdout:0/772: creat df/d30/d71/d96/dd3/d90/d37/de0/f115 x:0 0 0 2024-09-18T12:52:13.579 INFO:tasks.workunit.client.0.smithi045.stdout:7/315: creat d13/d31/d5f/f69 x:0 0 0 2024-09-18T12:52:13.580 INFO:tasks.workunit.client.1.smithi161.stdout:3/719: unlink d1/d2e/d68/d92/ded/d49/dce/le3 0 2024-09-18T12:52:13.585 INFO:tasks.workunit.client.0.smithi045.stdout:5/494: unlink d6/db/d19/d92/d61/da5/f90 0 2024-09-18T12:52:13.587 INFO:tasks.workunit.client.0.smithi045.stdout:5/495: write d6/d28/d2b/d51/d6c/f8d [2519290,43319] 0 2024-09-18T12:52:13.589 INFO:tasks.workunit.client.0.smithi045.stdout:7/316: dwrite d13/d1a/f2e [0,4194304] 0 2024-09-18T12:52:13.591 INFO:tasks.workunit.client.0.smithi045.stdout:8/406: dread d11/f17 [4194304,4194304] 0 2024-09-18T12:52:13.594 INFO:tasks.workunit.client.1.smithi161.stdout:6/809: dread d4/d1a/d1c/fea [0,4194304] 0 2024-09-18T12:52:13.626 INFO:tasks.workunit.client.1.smithi161.stdout:4/815: mknod d5/d14/c129 0 2024-09-18T12:52:13.634 INFO:tasks.workunit.client.1.smithi161.stdout:7/699: sync 2024-09-18T12:52:13.634 INFO:tasks.workunit.client.1.smithi161.stdout:9/673: sync 2024-09-18T12:52:13.635 INFO:tasks.workunit.client.1.smithi161.stdout:9/674: write d0/d47/f4c [6819820,83233] 0 2024-09-18T12:52:13.637 INFO:tasks.workunit.client.1.smithi161.stdout:4/816: dread d5/d27/d44/f101 [0,4194304] 0 2024-09-18T12:52:13.638 INFO:tasks.workunit.client.1.smithi161.stdout:4/817: write d5/d14/d67/dc7/f58 [946696,100200] 0 2024-09-18T12:52:13.709 INFO:tasks.workunit.client.1.smithi161.stdout:7/700: sync 2024-09-18T12:52:13.780 INFO:tasks.workunit.client.0.smithi045.stdout:3/399: write d0/d22/f26 [2415193,23403] 0 2024-09-18T12:52:13.781 INFO:tasks.workunit.client.0.smithi045.stdout:3/400: fdatasync d0/d22/f28 0 2024-09-18T12:52:13.786 INFO:tasks.workunit.client.1.smithi161.stdout:0/773: creat df/d29/d36/d94/f116 x:0 0 0 2024-09-18T12:52:13.788 INFO:tasks.workunit.client.1.smithi161.stdout:3/720: symlink d1/d2e/d68/d92/ded/d49/dce/lfc 0 2024-09-18T12:52:13.791 INFO:tasks.workunit.client.1.smithi161.stdout:2/792: truncate d0/d1/f3 942805 0 2024-09-18T12:52:13.792 INFO:tasks.workunit.client.1.smithi161.stdout:6/810: creat d4/d61/d69/d87/f10d x:0 0 0 2024-09-18T12:52:13.795 INFO:tasks.workunit.client.1.smithi161.stdout:9/675: rmdir d0/d20 39 2024-09-18T12:52:13.795 INFO:tasks.workunit.client.1.smithi161.stdout:8/775: truncate d0/d3/d10/d21/d4a/d52/d82/fbd 3098945 0 2024-09-18T12:52:13.796 INFO:tasks.workunit.client.1.smithi161.stdout:9/676: truncate d0/d16/d25/d28/fbe 189327 0 2024-09-18T12:52:13.799 INFO:tasks.workunit.client.1.smithi161.stdout:4/818: mkdir d5/d14/d67/dc7/d60/d95/d12a 0 2024-09-18T12:52:13.801 INFO:tasks.workunit.client.1.smithi161.stdout:3/721: dread d1/d2e/d24/d1d/d89/fc5 [0,4194304] 0 2024-09-18T12:52:13.802 INFO:tasks.workunit.client.1.smithi161.stdout:1/648: creat d1/da/d1f/d6b/dd2/fdb x:0 0 0 2024-09-18T12:52:13.803 INFO:tasks.workunit.client.1.smithi161.stdout:0/774: creat df/de2/dc5/d86/da5/f117 x:0 0 0 2024-09-18T12:52:13.805 INFO:tasks.workunit.client.0.smithi045.stdout:5/496: mkdir d6/d3e/daa 0 2024-09-18T12:52:13.808 INFO:tasks.workunit.client.0.smithi045.stdout:7/317: mkdir d13/d44/d37/d6a 0 2024-09-18T12:52:13.810 INFO:tasks.workunit.client.1.smithi161.stdout:6/811: unlink d4/d61/d69/f90 0 2024-09-18T12:52:13.812 INFO:tasks.workunit.client.0.smithi045.stdout:7/318: dread d13/d1a/f1b [0,4194304] 0 2024-09-18T12:52:13.814 INFO:tasks.workunit.client.1.smithi161.stdout:9/677: rmdir d0/d93/da0 39 2024-09-18T12:52:13.815 INFO:tasks.workunit.client.1.smithi161.stdout:4/819: creat d5/d14/d67/d84/d113/f12b x:0 0 0 2024-09-18T12:52:13.818 INFO:tasks.workunit.client.1.smithi161.stdout:3/722: symlink d1/d2e/d14/d2c/d72/lfd 0 2024-09-18T12:52:13.818 INFO:tasks.workunit.client.1.smithi161.stdout:7/701: write d3/d8/d15/da7/f22 [2510274,47977] 0 2024-09-18T12:52:13.818 INFO:tasks.workunit.client.0.smithi045.stdout:8/407: mkdir d11/d7b/d84 0 2024-09-18T12:52:13.819 INFO:tasks.workunit.client.0.smithi045.stdout:8/408: stat d11/d20/d46/c65 0 2024-09-18T12:52:13.820 INFO:tasks.workunit.client.1.smithi161.stdout:1/649: creat d1/da/d39/fdc x:0 0 0 2024-09-18T12:52:13.821 INFO:tasks.workunit.client.0.smithi045.stdout:7/319: creat d13/d44/d4c/f6b x:0 0 0 2024-09-18T12:52:13.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/775: mknod df/de2/c118 0 2024-09-18T12:52:13.824 INFO:tasks.workunit.client.1.smithi161.stdout:5/719: getdents d3/d3b/d7b 0 2024-09-18T12:52:13.824 INFO:tasks.workunit.client.0.smithi045.stdout:5/497: mkdir d6/d28/d2b/d51/d97/dab 0 2024-09-18T12:52:13.825 INFO:tasks.workunit.client.1.smithi161.stdout:7/702: dwrite d3/d8/d15/f3c [0,4194304] 0 2024-09-18T12:52:13.825 INFO:tasks.workunit.client.1.smithi161.stdout:0/776: write df/d30/d71/d96/dd3/d90/d37/de0/f115 [189594,94169] 0 2024-09-18T12:52:13.826 INFO:tasks.workunit.client.0.smithi045.stdout:8/409: symlink d11/d23/l85 0 2024-09-18T12:52:13.833 INFO:tasks.workunit.client.1.smithi161.stdout:9/678: creat d0/d16/d25/d28/d45/fde x:0 0 0 2024-09-18T12:52:13.833 INFO:tasks.workunit.client.1.smithi161.stdout:3/723: dread d1/d2e/d14/f30 [0,4194304] 0 2024-09-18T12:52:13.834 INFO:tasks.workunit.client.0.smithi045.stdout:5/498: mknod d6/db/d19/d92/cac 0 2024-09-18T12:52:13.834 INFO:tasks.workunit.client.1.smithi161.stdout:0/777: dwrite df/d30/d71/d96/dd3/d90/d37/de0/f115 [0,4194304] 0 2024-09-18T12:52:13.836 INFO:tasks.workunit.client.1.smithi161.stdout:4/820: chown d5/d14/d6d/l83 0 1 2024-09-18T12:52:13.836 INFO:tasks.workunit.client.1.smithi161.stdout:3/724: dread - d1/d2e/d68/de8/df6/ffa zero size 2024-09-18T12:52:13.837 INFO:tasks.workunit.client.0.smithi045.stdout:7/320: creat d13/f6c x:0 0 0 2024-09-18T12:52:13.839 INFO:tasks.workunit.client.0.smithi045.stdout:3/401: truncate d0/d1e/d2c/d3a/f3c 1506296 0 2024-09-18T12:52:13.840 INFO:tasks.workunit.client.1.smithi161.stdout:5/720: stat d3/d3b/d54 0 2024-09-18T12:52:13.841 INFO:tasks.workunit.client.0.smithi045.stdout:5/499: dwrite d6/d3e/f3f [4194304,4194304] 0 2024-09-18T12:52:13.841 INFO:tasks.workunit.client.1.smithi161.stdout:5/721: chown d3/d8/f77 6131 1 2024-09-18T12:52:13.841 INFO:tasks.workunit.client.1.smithi161.stdout:5/722: dread - d3/d44/d6f/fe0 zero size 2024-09-18T12:52:13.842 INFO:tasks.workunit.client.1.smithi161.stdout:5/723: chown d3/d44/d6f/d86/f94 157816 1 2024-09-18T12:52:13.843 INFO:tasks.workunit.client.1.smithi161.stdout:2/793: truncate d0/d1/f7 3360022 0 2024-09-18T12:52:13.846 INFO:tasks.workunit.client.0.smithi045.stdout:5/500: creat d6/db/d19/d92/d61/fad x:0 0 0 2024-09-18T12:52:13.847 INFO:tasks.workunit.client.0.smithi045.stdout:5/501: fsync d6/d3e/f35 0 2024-09-18T12:52:13.848 INFO:tasks.workunit.client.1.smithi161.stdout:5/724: read d3/d8/de4/d20/f2e [1362431,25773] 0 2024-09-18T12:52:13.849 INFO:tasks.workunit.client.1.smithi161.stdout:8/776: creat d0/f108 x:0 0 0 2024-09-18T12:52:13.849 INFO:tasks.workunit.client.1.smithi161.stdout:9/679: truncate d0/f29 1623124 0 2024-09-18T12:52:13.850 INFO:tasks.workunit.client.1.smithi161.stdout:4/821: dread - d5/d14/d6d/fd2 zero size 2024-09-18T12:52:13.850 INFO:tasks.workunit.client.0.smithi045.stdout:3/402: getdents d0/d29/d53 0 2024-09-18T12:52:13.852 INFO:tasks.workunit.client.0.smithi045.stdout:5/502: mkdir d6/db/d19/d92/d5c/dae 0 2024-09-18T12:52:13.852 INFO:tasks.workunit.client.1.smithi161.stdout:0/778: creat df/d30/d71/d96/dd3/d51/dc9/f119 x:0 0 0 2024-09-18T12:52:13.854 INFO:tasks.workunit.client.1.smithi161.stdout:3/725: creat d1/d2e/d68/ffe x:0 0 0 2024-09-18T12:52:13.855 INFO:tasks.workunit.client.1.smithi161.stdout:1/650: mkdir d1/ddd 0 2024-09-18T12:52:13.855 INFO:tasks.workunit.client.0.smithi045.stdout:5/503: symlink d6/d28/d2b/d7f/laf 0 2024-09-18T12:52:13.856 INFO:tasks.workunit.client.1.smithi161.stdout:7/703: mknod d3/d8/d15/d99/db0/cd5 0 2024-09-18T12:52:13.857 INFO:tasks.workunit.client.1.smithi161.stdout:8/777: dwrite d0/d3/d10/d21/d4a/d52/d82/d96/f72 [0,4194304] 0 2024-09-18T12:52:13.857 INFO:tasks.workunit.client.1.smithi161.stdout:2/794: rmdir d0/d1/deb/d3d 39 2024-09-18T12:52:13.858 INFO:tasks.workunit.client.0.smithi045.stdout:3/403: creat d0/f83 x:0 0 0 2024-09-18T12:52:13.860 INFO:tasks.workunit.client.0.smithi045.stdout:5/504: mknod d6/db/cb0 0 2024-09-18T12:52:13.861 INFO:tasks.workunit.client.1.smithi161.stdout:5/725: unlink d3/d8/de4/f84 0 2024-09-18T12:52:13.861 INFO:tasks.workunit.client.1.smithi161.stdout:9/680: chown d0/d16/d25/d28/f3f 1652140 1 2024-09-18T12:52:13.862 INFO:tasks.workunit.client.1.smithi161.stdout:0/779: stat df/d30/d71/d96/dd3/d78/la3 0 2024-09-18T12:52:13.863 INFO:tasks.workunit.client.1.smithi161.stdout:1/651: creat d1/daa/fde x:0 0 0 2024-09-18T12:52:13.864 INFO:tasks.workunit.client.1.smithi161.stdout:7/704: dwrite d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f90 [0,4194304] 0 2024-09-18T12:52:13.864 INFO:tasks.workunit.client.1.smithi161.stdout:0/780: dread - df/d30/d71/d96/dd3/f5f zero size 2024-09-18T12:52:13.865 INFO:tasks.workunit.client.1.smithi161.stdout:2/795: stat d0/d1/deb/d3d/f99 0 2024-09-18T12:52:13.865 INFO:tasks.workunit.client.1.smithi161.stdout:0/781: chown df/l2a 59 1 2024-09-18T12:52:13.866 INFO:tasks.workunit.client.1.smithi161.stdout:6/812: link d4/d39/d26/f2b d4/d61/f10e 0 2024-09-18T12:52:13.866 INFO:tasks.workunit.client.0.smithi045.stdout:5/505: dwrite d6/d3e/f3a [0,4194304] 0 2024-09-18T12:52:13.868 INFO:tasks.workunit.client.1.smithi161.stdout:5/726: unlink d3/d44/lb1 0 2024-09-18T12:52:13.870 INFO:tasks.workunit.client.1.smithi161.stdout:3/726: symlink d1/d2e/d14/d78/lff 0 2024-09-18T12:52:13.871 INFO:tasks.workunit.client.0.smithi045.stdout:5/506: dread d6/db/d19/d92/f25 [0,4194304] 0 2024-09-18T12:52:13.872 INFO:tasks.workunit.client.1.smithi161.stdout:1/652: rmdir d1/da/d1f/d45/d73 39 2024-09-18T12:52:13.873 INFO:tasks.workunit.client.1.smithi161.stdout:0/782: creat df/d30/d71/f11a x:0 0 0 2024-09-18T12:52:13.874 INFO:tasks.workunit.client.0.smithi045.stdout:5/507: chown d6/db/f50 3035254 1 2024-09-18T12:52:13.874 INFO:tasks.workunit.client.1.smithi161.stdout:9/681: symlink d0/ldf 0 2024-09-18T12:52:13.875 INFO:tasks.workunit.client.0.smithi045.stdout:5/508: chown d6/db/d19/d92/f60 1020774686 1 2024-09-18T12:52:13.875 INFO:tasks.workunit.client.1.smithi161.stdout:5/727: creat d3/d8/de4/d8d/db0/fe9 x:0 0 0 2024-09-18T12:52:13.875 INFO:tasks.workunit.client.1.smithi161.stdout:4/822: link d5/d27/d44/l11d d5/d27/d44/de2/d122/l12c 0 2024-09-18T12:52:13.876 INFO:tasks.workunit.client.1.smithi161.stdout:9/682: read d0/d16/d25/f27 [4091958,84603] 0 2024-09-18T12:52:13.876 INFO:tasks.workunit.client.0.smithi045.stdout:5/509: rmdir d6/db/d19 39 2024-09-18T12:52:13.877 INFO:tasks.workunit.client.1.smithi161.stdout:9/683: fdatasync d0/d16/d25/d46/f68 0 2024-09-18T12:52:13.878 INFO:tasks.workunit.client.1.smithi161.stdout:1/653: symlink d1/dbf/ldf 0 2024-09-18T12:52:13.878 INFO:tasks.workunit.client.0.smithi045.stdout:5/510: rmdir d6/d28/d2b/d51/d6c 39 2024-09-18T12:52:13.880 INFO:tasks.workunit.client.1.smithi161.stdout:5/728: mkdir d3/d8/de4/dea 0 2024-09-18T12:52:13.881 INFO:tasks.workunit.client.1.smithi161.stdout:3/727: symlink d1/d2e/d14/d78/l100 0 2024-09-18T12:52:13.882 INFO:tasks.workunit.client.1.smithi161.stdout:4/823: dread - d5/d14/d67/d84/dae/fb0 zero size 2024-09-18T12:52:13.882 INFO:tasks.workunit.client.0.smithi045.stdout:5/511: getdents d6/d28/d2b/d51/d97/dab 0 2024-09-18T12:52:13.884 INFO:tasks.workunit.client.0.smithi045.stdout:5/512: unlink d6/d28/d2b/d51/fa7 0 2024-09-18T12:52:13.885 INFO:tasks.workunit.client.0.smithi045.stdout:5/513: fdatasync d6/d3e/f35 0 2024-09-18T12:52:13.885 INFO:tasks.workunit.client.0.smithi045.stdout:5/514: chown d6/d3e/f33 4 1 2024-09-18T12:52:13.886 INFO:tasks.workunit.client.1.smithi161.stdout:5/729: stat d3/fa0 0 2024-09-18T12:52:13.886 INFO:tasks.workunit.client.1.smithi161.stdout:3/728: creat d1/d2e/d14/d78/d83/f101 x:0 0 0 2024-09-18T12:52:13.888 INFO:tasks.workunit.client.0.smithi045.stdout:5/515: chown d6/db/d19/d92/d5c/dae 28868 1 2024-09-18T12:52:13.888 INFO:tasks.workunit.client.1.smithi161.stdout:9/684: fsync d0/f1f 0 2024-09-18T12:52:13.890 INFO:tasks.workunit.client.1.smithi161.stdout:5/730: fdatasync d3/d9/f38 0 2024-09-18T12:52:13.891 INFO:tasks.workunit.client.1.smithi161.stdout:4/824: creat d5/d14/f12d x:0 0 0 2024-09-18T12:52:13.892 INFO:tasks.workunit.client.1.smithi161.stdout:9/685: rmdir d0/d16/d25/d46/d53 39 2024-09-18T12:52:13.893 INFO:tasks.workunit.client.0.smithi045.stdout:5/516: getdents d6/d28/d2b/d51/d6c 0 2024-09-18T12:52:13.894 INFO:tasks.workunit.client.1.smithi161.stdout:3/729: dwrite d1/d2e/d68/d69/fc9 [0,4194304] 0 2024-09-18T12:52:13.895 INFO:tasks.workunit.client.1.smithi161.stdout:9/686: mknod d0/d47/d48/d88/ce0 0 2024-09-18T12:52:13.895 INFO:tasks.workunit.client.0.smithi045.stdout:5/517: symlink d6/db/d19/d92/d5c/lb1 0 2024-09-18T12:52:13.897 INFO:tasks.workunit.client.1.smithi161.stdout:4/825: creat d5/d27/d44/d61/d6c/d8f/f12e x:0 0 0 2024-09-18T12:52:13.924 INFO:tasks.workunit.client.0.smithi045.stdout:5/518: symlink d6/d3e/lb2 0 2024-09-18T12:52:13.925 INFO:tasks.workunit.client.1.smithi161.stdout:3/730: rmdir d1/d2e/d14/d78/d83 39 2024-09-18T12:52:13.925 INFO:tasks.workunit.client.0.smithi045.stdout:5/519: chown d6/db/d19/f4f 8 1 2024-09-18T12:52:13.926 INFO:tasks.workunit.client.1.smithi161.stdout:3/731: readlink d1/d2e/d68/d92/ded/l23 0 2024-09-18T12:52:13.927 INFO:tasks.workunit.client.0.smithi045.stdout:4/401: sync 2024-09-18T12:52:13.929 INFO:tasks.workunit.client.0.smithi045.stdout:5/520: symlink d6/d3e/lb3 0 2024-09-18T12:52:13.931 INFO:tasks.workunit.client.1.smithi161.stdout:9/687: truncate d0/d20/d49/f7e 2906192 0 2024-09-18T12:52:13.936 INFO:tasks.workunit.client.1.smithi161.stdout:3/732: link d1/d2e/d24/cd1 d1/d2e/d24/d1d/d89/db0/c102 0 2024-09-18T12:52:13.936 INFO:tasks.workunit.client.1.smithi161.stdout:3/733: stat d1/d2e/d14/d90/fbf 0 2024-09-18T12:52:13.940 INFO:tasks.workunit.client.1.smithi161.stdout:3/734: dread d1/d2e/d14/d65/f8f [0,4194304] 0 2024-09-18T12:52:13.942 INFO:tasks.workunit.client.1.smithi161.stdout:2/796: stat d0/d1/f3 0 2024-09-18T12:52:13.945 INFO:tasks.workunit.client.1.smithi161.stdout:3/735: fdatasync d1/fd7 0 2024-09-18T12:52:13.951 INFO:tasks.workunit.client.1.smithi161.stdout:2/797: truncate d0/d1/deb/f61 2684360 0 2024-09-18T12:52:13.955 INFO:tasks.workunit.client.1.smithi161.stdout:2/798: write d0/d1/d4c/d67/fa4 [2389926,59577] 0 2024-09-18T12:52:13.957 INFO:tasks.workunit.client.1.smithi161.stdout:3/736: mknod d1/d2e/d14/d78/c103 0 2024-09-18T12:52:13.957 INFO:tasks.workunit.client.1.smithi161.stdout:3/737: fsync d1/d2e/d68/fd6 0 2024-09-18T12:52:13.960 INFO:tasks.workunit.client.1.smithi161.stdout:2/799: fdatasync d0/d1/f3f 0 2024-09-18T12:52:13.962 INFO:tasks.workunit.client.1.smithi161.stdout:8/778: link d0/d3/d10/d21/d4a/d52/d82/fbd d0/d3/d10/d21/d4a/f109 0 2024-09-18T12:52:13.963 INFO:tasks.workunit.client.1.smithi161.stdout:8/779: stat d0/d3/d10/d21/d4a/d52/d82/de6/df7 0 2024-09-18T12:52:13.964 INFO:tasks.workunit.client.1.smithi161.stdout:8/780: fdatasync d0/d3/d10/d21/d4a/d52/d82/d96/ff1 0 2024-09-18T12:52:13.966 INFO:tasks.workunit.client.1.smithi161.stdout:6/813: sync 2024-09-18T12:52:13.974 INFO:tasks.workunit.client.1.smithi161.stdout:6/814: mknod d4/d61/d69/d87/c10f 0 2024-09-18T12:52:13.978 INFO:tasks.workunit.client.1.smithi161.stdout:6/815: write d4/d39/d47/d88/fdb [501682,64972] 0 2024-09-18T12:52:13.979 INFO:tasks.workunit.client.1.smithi161.stdout:8/781: dwrite d0/d3/d1e/ffb [0,4194304] 0 2024-09-18T12:52:13.981 INFO:tasks.workunit.client.1.smithi161.stdout:8/782: dread - d0/d3/d10/d21/d4a/d52/fcf zero size 2024-09-18T12:52:13.982 INFO:tasks.workunit.client.1.smithi161.stdout:2/800: dread d0/d5/d43/d35/fa3 [0,4194304] 0 2024-09-18T12:52:13.984 INFO:tasks.workunit.client.1.smithi161.stdout:7/705: write d3/d8/d15/da7/f39 [741908,43010] 0 2024-09-18T12:52:13.985 INFO:tasks.workunit.client.1.smithi161.stdout:0/783: write df/d30/d4d/f4f [1488512,100205] 0 2024-09-18T12:52:13.986 INFO:tasks.workunit.client.1.smithi161.stdout:6/816: creat d4/d39/d47/f110 x:0 0 0 2024-09-18T12:52:13.990 INFO:tasks.workunit.client.1.smithi161.stdout:6/817: chown d4/d1a/d1c/d3e/d83/d9e/db1/d45/d68 13780001 1 2024-09-18T12:52:13.991 INFO:tasks.workunit.client.1.smithi161.stdout:2/801: symlink d0/d71/da9/d9f/dd0/d10c/l10f 0 2024-09-18T12:52:13.992 INFO:tasks.workunit.client.1.smithi161.stdout:8/783: dwrite d0/d3/d10/d21/d4a/d52/d82/fc8 [0,4194304] 0 2024-09-18T12:52:13.993 INFO:tasks.workunit.client.1.smithi161.stdout:8/784: dread - d0/d3/d10/d21/d4a/d52/d82/d96/d98/ffc zero size 2024-09-18T12:52:13.994 INFO:tasks.workunit.client.1.smithi161.stdout:0/784: creat df/d30/d71/d96/dd3/d90/d37/dad/f11b x:0 0 0 2024-09-18T12:52:13.994 INFO:tasks.workunit.client.1.smithi161.stdout:4/826: sync 2024-09-18T12:52:13.997 INFO:tasks.workunit.client.1.smithi161.stdout:2/802: write d0/f41 [4156033,22607] 0 2024-09-18T12:52:13.998 INFO:tasks.workunit.client.1.smithi161.stdout:1/654: truncate d1/d26/f24 4136977 0 2024-09-18T12:52:14.000 INFO:tasks.workunit.client.1.smithi161.stdout:8/785: write d0/d3/d10/d21/d4a/d52/d82/d8b/fd6 [4274147,57352] 0 2024-09-18T12:52:14.002 INFO:tasks.workunit.client.1.smithi161.stdout:1/655: fsync d1/da/d1f/d6b/dd2/fdb 0 2024-09-18T12:52:14.005 INFO:tasks.workunit.client.1.smithi161.stdout:4/827: getdents d5/d14/d67/dc7/d47/dbc/d127 0 2024-09-18T12:52:14.010 INFO:tasks.workunit.client.1.smithi161.stdout:5/731: dwrite d3/d8/de4/d20/f2c [0,4194304] 0 2024-09-18T12:52:14.012 INFO:tasks.workunit.client.1.smithi161.stdout:6/818: dread d4/d1a/f11 [0,4194304] 0 2024-09-18T12:52:14.015 INFO:tasks.workunit.client.1.smithi161.stdout:1/656: link d1/da/d31/f8d d1/d1d/fe0 0 2024-09-18T12:52:14.017 INFO:tasks.workunit.client.1.smithi161.stdout:6/819: mkdir d4/d39/d3a/d111 0 2024-09-18T12:52:14.018 INFO:tasks.workunit.client.1.smithi161.stdout:1/657: unlink d1/da/fb3 0 2024-09-18T12:52:14.020 INFO:tasks.workunit.client.1.smithi161.stdout:8/786: link d0/d3/d10/d21/d4a/d52/d66/d5b/fac d0/d3/d10/d21/d4a/d52/d82/d96/dba/f10a 0 2024-09-18T12:52:14.023 INFO:tasks.workunit.client.1.smithi161.stdout:8/787: read d0/d3/d10/d21/d4a/f77 [3275036,60760] 0 2024-09-18T12:52:14.025 INFO:tasks.workunit.client.1.smithi161.stdout:6/820: link d4/d39/d26/d31/d76/f9c d4/d1a/d1c/d3e/d83/d9e/d102/f112 0 2024-09-18T12:52:14.026 INFO:tasks.workunit.client.1.smithi161.stdout:6/821: dread - d4/d39/d47/d51/fe5 zero size 2024-09-18T12:52:14.028 INFO:tasks.workunit.client.1.smithi161.stdout:6/822: mknod d4/d39/d26/d31/d76/c113 0 2024-09-18T12:52:14.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:13 smithi045 ceph-mon[28315]: pgmap v29: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 88 MiB/s rd, 334 MiB/s wr, 557 op/s 2024-09-18T12:52:14.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:13 smithi161 ceph-mon[35784]: pgmap v29: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 88 MiB/s rd, 334 MiB/s wr, 557 op/s 2024-09-18T12:52:14.072 INFO:tasks.workunit.client.1.smithi161.stdout:7/706: write d3/d8/f91 [2765300,93813] 0 2024-09-18T12:52:14.075 INFO:tasks.workunit.client.1.smithi161.stdout:7/707: unlink d3/d8/d15/cb4 0 2024-09-18T12:52:14.082 INFO:tasks.workunit.client.1.smithi161.stdout:0/785: dwrite df/d29/d36/d7a/f81 [0,4194304] 0 2024-09-18T12:52:14.083 INFO:tasks.workunit.client.0.smithi045.stdout:5/521: link d6/db/d19/d92/c64 d6/db/d19/d92/cb4 0 2024-09-18T12:52:14.083 INFO:tasks.workunit.client.0.smithi045.stdout:5/522: chown d6/d3e/lb2 549 1 2024-09-18T12:52:14.085 INFO:tasks.workunit.client.1.smithi161.stdout:0/786: symlink df/de2/dc5/d89/l11c 0 2024-09-18T12:52:14.087 INFO:tasks.workunit.client.0.smithi045.stdout:5/523: unlink d6/db/d19/d92/l5b 0 2024-09-18T12:52:14.090 INFO:tasks.workunit.client.1.smithi161.stdout:7/708: dread d3/d36/f65 [0,4194304] 0 2024-09-18T12:52:14.090 INFO:tasks.workunit.client.1.smithi161.stdout:7/709: dread - d3/d8/d4f/fbf zero size 2024-09-18T12:52:14.097 INFO:tasks.workunit.client.1.smithi161.stdout:8/788: creat d0/d3/d10/f10b x:0 0 0 2024-09-18T12:52:14.099 INFO:tasks.workunit.client.1.smithi161.stdout:8/789: creat d0/d3/d10/d21/d4a/d52/d82/d96/dba/f10c x:0 0 0 2024-09-18T12:52:14.100 INFO:tasks.workunit.client.1.smithi161.stdout:0/787: symlink df/de2/dc5/l11d 0 2024-09-18T12:52:14.102 INFO:tasks.workunit.client.1.smithi161.stdout:0/788: write df/d30/d71/d96/dd3/d90/d37/f48 [365983,52192] 0 2024-09-18T12:52:14.102 INFO:tasks.workunit.client.1.smithi161.stdout:8/790: mkdir d0/d3/d10/d21/d4a/d52/d82/d96/dba/d10d 0 2024-09-18T12:52:14.103 INFO:tasks.workunit.client.0.smithi045.stdout:4/402: rename db/d1b/l41 to db/d2c/l89 0 2024-09-18T12:52:14.104 INFO:tasks.workunit.client.0.smithi045.stdout:4/403: read db/de/d1e/d49/f4e [425830,70782] 0 2024-09-18T12:52:14.111 INFO:tasks.workunit.client.1.smithi161.stdout:3/738: link d1/d2e/d14/l3c d1/d2e/d24/d1d/l104 0 2024-09-18T12:52:14.112 INFO:tasks.workunit.client.1.smithi161.stdout:3/739: read - d1/d2e/d68/ffe zero size 2024-09-18T12:52:14.112 INFO:tasks.workunit.client.0.smithi045.stdout:4/404: dwrite db/f21 [4194304,4194304] 0 2024-09-18T12:52:14.115 INFO:tasks.workunit.client.1.smithi161.stdout:3/740: truncate d1/f8b 3742999 0 2024-09-18T12:52:14.118 INFO:tasks.workunit.client.0.smithi045.stdout:9/353: sync 2024-09-18T12:52:14.118 INFO:tasks.workunit.client.0.smithi045.stdout:0/425: sync 2024-09-18T12:52:14.118 INFO:tasks.workunit.client.1.smithi161.stdout:3/741: mknod d1/d2e/d68/d92/dba/dd9/c105 0 2024-09-18T12:52:14.118 INFO:tasks.workunit.client.1.smithi161.stdout:3/742: readlink d1/d2e/d14/d78/l100 0 2024-09-18T12:52:14.120 INFO:tasks.workunit.client.0.smithi045.stdout:9/354: stat d0/d3/d6/d10/d26/d2e 0 2024-09-18T12:52:14.121 INFO:tasks.workunit.client.0.smithi045.stdout:0/426: readlink d6/d48/d5e/d39/d58/l4e 0 2024-09-18T12:52:14.121 INFO:tasks.workunit.client.0.smithi045.stdout:4/405: dwrite db/de/f7b [0,4194304] 0 2024-09-18T12:52:14.122 INFO:tasks.workunit.client.1.smithi161.stdout:3/743: creat d1/d2e/d14/d2c/d72/f106 x:0 0 0 2024-09-18T12:52:14.124 INFO:tasks.workunit.client.0.smithi045.stdout:0/427: chown d6/d48/d5e/d39/d58/d3c/d69/f4b 2721274 1 2024-09-18T12:52:14.128 INFO:tasks.workunit.client.0.smithi045.stdout:9/355: rename d0/c5d to d0/d3/d6/d64/c74 0 2024-09-18T12:52:14.130 INFO:tasks.workunit.client.1.smithi161.stdout:3/744: unlink d1/d2e/d24/f47 0 2024-09-18T12:52:14.130 INFO:tasks.workunit.client.1.smithi161.stdout:3/745: chown d1/c7c 281 1 2024-09-18T12:52:14.131 INFO:tasks.workunit.client.0.smithi045.stdout:4/406: unlink db/d2c/d35/f56 0 2024-09-18T12:52:14.134 INFO:tasks.workunit.client.0.smithi045.stdout:0/428: readlink d6/d48/d5e/d39/l53 0 2024-09-18T12:52:14.138 INFO:tasks.workunit.client.1.smithi161.stdout:9/688: rename d0/d20/lbf to d0/le1 0 2024-09-18T12:52:14.139 INFO:tasks.workunit.client.0.smithi045.stdout:9/356: mknod d0/d3/d6/d10/c75 0 2024-09-18T12:52:14.142 INFO:tasks.workunit.client.1.smithi161.stdout:2/803: rename d0/d5/d53/l26 to d0/d5/d43/d35/d98/ddf/d8b/l110 0 2024-09-18T12:52:14.145 INFO:tasks.workunit.client.1.smithi161.stdout:9/689: mkdir d0/d20/d49/de2 0 2024-09-18T12:52:14.146 INFO:tasks.workunit.client.1.smithi161.stdout:9/690: write d0/d20/d74/f97 [2982795,22249] 0 2024-09-18T12:52:14.149 INFO:tasks.workunit.client.1.smithi161.stdout:2/804: creat d0/d1/d4c/f111 x:0 0 0 2024-09-18T12:52:14.150 INFO:tasks.workunit.client.0.smithi045.stdout:0/429: dread d6/d48/d5e/f24 [0,4194304] 0 2024-09-18T12:52:14.153 INFO:tasks.workunit.client.1.smithi161.stdout:7/710: dwrite d3/d50/f66 [0,4194304] 0 2024-09-18T12:52:14.154 INFO:tasks.workunit.client.0.smithi045.stdout:4/407: getdents db/de/d1e/d3e/d47/d59/d13 0 2024-09-18T12:52:14.155 INFO:tasks.workunit.client.0.smithi045.stdout:4/408: fdatasync db/de/f6a 0 2024-09-18T12:52:14.159 INFO:tasks.workunit.client.0.smithi045.stdout:0/430: dwrite d6/d35/f3f [0,4194304] 0 2024-09-18T12:52:14.160 INFO:tasks.workunit.client.0.smithi045.stdout:0/431: chown d6/d48/l67 1047216 1 2024-09-18T12:52:14.160 INFO:tasks.workunit.client.1.smithi161.stdout:5/732: rename d3/d8/l16 to d3/d44/d6f/d86/leb 0 2024-09-18T12:52:14.161 INFO:tasks.workunit.client.1.smithi161.stdout:2/805: write d0/d4/d78/fbe [254298,110688] 0 2024-09-18T12:52:14.161 INFO:tasks.workunit.client.1.smithi161.stdout:5/733: readlink d3/d9/l17 0 2024-09-18T12:52:14.162 INFO:tasks.workunit.client.1.smithi161.stdout:9/691: dread d0/d20/f39 [0,4194304] 0 2024-09-18T12:52:14.166 INFO:tasks.workunit.client.1.smithi161.stdout:0/789: write df/d30/d71/d96/dd3/d90/f6e [1752236,7277] 0 2024-09-18T12:52:14.167 INFO:tasks.workunit.client.1.smithi161.stdout:0/790: chown df/de2/dc5/d86/c8e 162 1 2024-09-18T12:52:14.169 INFO:tasks.workunit.client.1.smithi161.stdout:1/658: rename d1/da/d31/f53 to d1/ddd/fe1 0 2024-09-18T12:52:14.171 INFO:tasks.workunit.client.1.smithi161.stdout:4/828: sync 2024-09-18T12:52:14.171 INFO:tasks.workunit.client.0.smithi045.stdout:0/432: creat d6/d48/d5e/d39/d58/d3b/d65/f77 x:0 0 0 2024-09-18T12:52:14.178 INFO:tasks.workunit.client.0.smithi045.stdout:4/409: link db/de/d1a/c26 db/c8a 0 2024-09-18T12:52:14.180 INFO:tasks.workunit.client.1.smithi161.stdout:7/711: link d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/fbb d3/d83/db6/fd6 0 2024-09-18T12:52:14.184 INFO:tasks.workunit.client.0.smithi045.stdout:4/410: creat db/de/d1e/d3e/d47/d59/d7a/f8b x:0 0 0 2024-09-18T12:52:14.185 INFO:tasks.workunit.client.1.smithi161.stdout:0/791: dread df/d30/d71/f87 [0,4194304] 0 2024-09-18T12:52:14.186 INFO:tasks.workunit.client.0.smithi045.stdout:0/433: creat d6/d48/d5e/f78 x:0 0 0 2024-09-18T12:52:14.189 INFO:tasks.workunit.client.1.smithi161.stdout:8/791: rename d0/d3/d10/d21/d4a/d52/d66/fde to d0/d3/d10/d21/d4a/f10e 0 2024-09-18T12:52:14.190 INFO:tasks.workunit.client.0.smithi045.stdout:4/411: creat db/de/d1e/d3e/f8c x:0 0 0 2024-09-18T12:52:14.191 INFO:tasks.workunit.client.1.smithi161.stdout:4/829: dread d5/f2c [0,4194304] 0 2024-09-18T12:52:14.192 INFO:tasks.workunit.client.0.smithi045.stdout:4/412: fdatasync db/de/d1e/d3e/d47/d59/f87 0 2024-09-18T12:52:14.192 INFO:tasks.workunit.client.1.smithi161.stdout:3/746: dwrite d1/d2e/d14/d78/fc3 [0,4194304] 0 2024-09-18T12:52:14.192 INFO:tasks.workunit.client.0.smithi045.stdout:4/413: fdatasync db/de/d1e/d3e/f8c 0 2024-09-18T12:52:14.194 INFO:tasks.workunit.client.1.smithi161.stdout:5/734: mknod d3/d3b/cec 0 2024-09-18T12:52:14.194 INFO:tasks.workunit.client.0.smithi045.stdout:4/414: chown db/de/d1e/d3e/d47/d59/f5f 517452 1 2024-09-18T12:52:14.198 INFO:tasks.workunit.client.1.smithi161.stdout:7/712: rmdir d3/d8/d15/da7/d44 39 2024-09-18T12:52:14.199 INFO:tasks.workunit.client.1.smithi161.stdout:7/713: fdatasync d3/d8/d15/da7/d24/daf/fcd 0 2024-09-18T12:52:14.200 INFO:tasks.workunit.client.1.smithi161.stdout:7/714: write d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f90 [1815640,19752] 0 2024-09-18T12:52:14.202 INFO:tasks.workunit.client.0.smithi045.stdout:4/415: dwrite f9 [0,4194304] 0 2024-09-18T12:52:14.204 INFO:tasks.workunit.client.0.smithi045.stdout:0/434: rename d6/d48/d5e/d39/d58/d3c/f60 to d6/d7/f79 0 2024-09-18T12:52:14.205 INFO:tasks.workunit.client.1.smithi161.stdout:7/715: dread d3/d8/d15/da7/d4a/fd1 [0,4194304] 0 2024-09-18T12:52:14.209 INFO:tasks.workunit.client.1.smithi161.stdout:2/806: rename d0/d5/d53/f4b to d0/d1/deb/d3d/da5/dd1/f112 0 2024-09-18T12:52:14.211 INFO:tasks.workunit.client.0.smithi045.stdout:4/416: mknod db/de/d1e/d3e/c8d 0 2024-09-18T12:52:14.212 INFO:tasks.workunit.client.1.smithi161.stdout:5/735: dread d3/d8/f77 [0,4194304] 0 2024-09-18T12:52:14.214 INFO:tasks.workunit.client.0.smithi045.stdout:0/435: creat d6/d48/d5e/d39/d58/d3b/d65/f7a x:0 0 0 2024-09-18T12:52:14.218 INFO:tasks.workunit.client.0.smithi045.stdout:4/417: rename db/de/d1a/d2e/d62 to db/de/d1e/d3e/d47/d59/d13/d73/d8e 0 2024-09-18T12:52:14.218 INFO:tasks.workunit.client.0.smithi045.stdout:4/418: dread - db/de/d1e/d3e/f8c zero size 2024-09-18T12:52:14.220 INFO:tasks.workunit.client.0.smithi045.stdout:4/419: read - db/de/d1e/d3e/d47/d59/f87 zero size 2024-09-18T12:52:14.220 INFO:tasks.workunit.client.0.smithi045.stdout:0/436: symlink d6/d48/d5e/d39/d58/d3c/d69/l7b 0 2024-09-18T12:52:14.221 INFO:tasks.workunit.client.0.smithi045.stdout:4/420: chown db/de/d1e/d3e/d47/d59/d13/f2b 142955 1 2024-09-18T12:52:14.224 INFO:tasks.workunit.client.0.smithi045.stdout:0/437: mknod d6/d48/d5e/d39/d58/d3c/d69/c7c 0 2024-09-18T12:52:14.230 INFO:tasks.workunit.client.1.smithi161.stdout:9/692: rename d0/fd1 to d0/d16/d25/d46/d53/d59/ddb/fe3 0 2024-09-18T12:52:14.232 INFO:tasks.workunit.client.1.smithi161.stdout:2/807: dread - d0/d1/deb/d3d/da5/dd1/f112 zero size 2024-09-18T12:52:14.235 INFO:tasks.workunit.client.0.smithi045.stdout:0/438: creat d6/f7d x:0 0 0 2024-09-18T12:52:14.237 INFO:tasks.workunit.client.0.smithi045.stdout:4/421: dread db/de/d1e/d3e/d47/d59/f74 [0,4194304] 0 2024-09-18T12:52:14.238 INFO:tasks.workunit.client.1.smithi161.stdout:3/747: mknod d1/d2e/d14/d78/c107 0 2024-09-18T12:52:14.238 INFO:tasks.workunit.client.1.smithi161.stdout:2/808: dwrite d0/d4/d78/fae [0,4194304] 0 2024-09-18T12:52:14.238 INFO:tasks.workunit.client.0.smithi045.stdout:4/422: chown db/de/d1e/d3e/d47/d59/f5f 206 1 2024-09-18T12:52:14.240 INFO:tasks.workunit.client.0.smithi045.stdout:0/439: mknod d6/c7e 0 2024-09-18T12:52:14.246 INFO:tasks.workunit.client.1.smithi161.stdout:7/716: mkdir d3/d8/d15/da7/d4a/d64/d8c/d9f/dd7 0 2024-09-18T12:52:14.246 INFO:tasks.workunit.client.1.smithi161.stdout:4/830: dwrite d5/d27/d44/f101 [0,4194304] 0 2024-09-18T12:52:14.248 INFO:tasks.workunit.client.1.smithi161.stdout:5/736: link d3/d9/d4b/d8e/d24/db8/da4/daf/fb2 d3/d9/dd7/fed 0 2024-09-18T12:52:14.248 INFO:tasks.workunit.client.1.smithi161.stdout:3/748: fdatasync d1/d2e/f5b 0 2024-09-18T12:52:14.249 INFO:tasks.workunit.client.1.smithi161.stdout:2/809: write d0/d1/deb/d93/fbc [359840,67413] 0 2024-09-18T12:52:14.250 INFO:tasks.workunit.client.1.smithi161.stdout:0/792: rename df/de2/dc5/d8a/lae to df/de2/dc5/d8a/dd1/l11e 0 2024-09-18T12:52:14.250 INFO:tasks.workunit.client.0.smithi045.stdout:1/385: sync 2024-09-18T12:52:14.253 INFO:tasks.workunit.client.1.smithi161.stdout:3/749: stat d1/d2e/d14/ff7 0 2024-09-18T12:52:14.257 INFO:tasks.workunit.client.0.smithi045.stdout:1/386: symlink d0/d12/d32/d67/d6d/l76 0 2024-09-18T12:52:14.257 INFO:tasks.workunit.client.0.smithi045.stdout:4/423: dwrite db/de/d1a/d2e/f81 [0,4194304] 0 2024-09-18T12:52:14.258 INFO:tasks.workunit.client.1.smithi161.stdout:7/717: creat d3/d8/d15/da7/d4a/d64/d8c/fd8 x:0 0 0 2024-09-18T12:52:14.258 INFO:tasks.workunit.client.1.smithi161.stdout:2/810: dwrite d0/d4/d78/f9c [0,4194304] 0 2024-09-18T12:52:14.260 INFO:tasks.workunit.client.1.smithi161.stdout:2/811: fdatasync d0/d5/d43/d35/d98/ddf/f59 0 2024-09-18T12:52:14.261 INFO:tasks.workunit.client.1.smithi161.stdout:4/831: mkdir d5/d27/d44/d61/d6c/d8f/d12f 0 2024-09-18T12:52:14.261 INFO:tasks.workunit.client.1.smithi161.stdout:5/737: mknod d3/cee 0 2024-09-18T12:52:14.261 INFO:tasks.workunit.client.1.smithi161.stdout:2/812: read - d0/d71/da9/dd6/f102 zero size 2024-09-18T12:52:14.262 INFO:tasks.workunit.client.1.smithi161.stdout:0/793: mknod df/d30/d71/d96/dd3/d78/c11f 0 2024-09-18T12:52:14.264 INFO:tasks.workunit.client.1.smithi161.stdout:2/813: truncate d0/d71/fcf 695776 0 2024-09-18T12:52:14.265 INFO:tasks.workunit.client.0.smithi045.stdout:1/387: rename d0/l5 to d0/d2d/d2b/d30/d40/d60/l77 0 2024-09-18T12:52:14.265 INFO:tasks.workunit.client.1.smithi161.stdout:0/794: write df/d30/d4d/f4f [933408,31523] 0 2024-09-18T12:52:14.267 INFO:tasks.workunit.client.1.smithi161.stdout:7/718: symlink d3/d8/d15/da7/d4a/ld9 0 2024-09-18T12:52:14.268 INFO:tasks.workunit.client.0.smithi045.stdout:4/424: mknod db/de/d1e/d3e/d47/d59/d7a/c8f 0 2024-09-18T12:52:14.268 INFO:tasks.workunit.client.1.smithi161.stdout:7/719: chown d3/d8/d15/da7/f22 0 1 2024-09-18T12:52:14.269 INFO:tasks.workunit.client.1.smithi161.stdout:5/738: rmdir d3/d44/d6f 39 2024-09-18T12:52:14.269 INFO:tasks.workunit.client.0.smithi045.stdout:4/425: chown db/de/d1e/d3e/d47/d59/d13/f50 6539 1 2024-09-18T12:52:14.270 INFO:tasks.workunit.client.0.smithi045.stdout:4/426: write db/f80 [5480656,35861] 0 2024-09-18T12:52:14.271 INFO:tasks.workunit.client.1.smithi161.stdout:3/750: mknod d1/d2e/d14/c108 0 2024-09-18T12:52:14.274 INFO:tasks.workunit.client.0.smithi045.stdout:4/427: creat db/de/f90 x:0 0 0 2024-09-18T12:52:14.275 INFO:tasks.workunit.client.1.smithi161.stdout:4/832: write d5/d14/d67/d84/dae/fe0 [30034,33516] 0 2024-09-18T12:52:14.276 INFO:tasks.workunit.client.1.smithi161.stdout:0/795: symlink df/d30/d71/dfe/l120 0 2024-09-18T12:52:14.277 INFO:tasks.workunit.client.1.smithi161.stdout:7/720: dwrite d3/d50/fba [0,4194304] 0 2024-09-18T12:52:14.278 INFO:tasks.workunit.client.1.smithi161.stdout:0/796: read df/d29/f53 [833381,130859] 0 2024-09-18T12:52:14.278 INFO:tasks.workunit.client.1.smithi161.stdout:8/792: rename d0/d3/d10/d21/d4a/d52/d82/lef to d0/l10f 0 2024-09-18T12:52:14.278 INFO:tasks.workunit.client.0.smithi045.stdout:4/428: stat db/d2c/d35/d40/d77/f4c 0 2024-09-18T12:52:14.280 INFO:tasks.workunit.client.0.smithi045.stdout:4/429: write db/de/d1a/d2e/f7f [538187,30727] 0 2024-09-18T12:52:14.280 INFO:tasks.workunit.client.1.smithi161.stdout:8/793: write d0/d3/d91/fea [806787,70077] 0 2024-09-18T12:52:14.280 INFO:tasks.workunit.client.1.smithi161.stdout:4/833: symlink d5/d14/d5f/l130 0 2024-09-18T12:52:14.284 INFO:tasks.workunit.client.0.smithi045.stdout:4/430: rename db/f80 to db/d2c/d35/f91 0 2024-09-18T12:52:14.285 INFO:tasks.workunit.client.1.smithi161.stdout:6/823: sync 2024-09-18T12:52:14.286 INFO:tasks.workunit.client.0.smithi045.stdout:4/431: write db/de/d1e/d3e/d47/d59/d2f/f36 [1936979,120071] 0 2024-09-18T12:52:14.288 INFO:tasks.workunit.client.1.smithi161.stdout:7/721: dwrite d3/d8/d15/da7/d24/f51 [0,4194304] 0 2024-09-18T12:52:14.289 INFO:tasks.workunit.client.1.smithi161.stdout:4/834: rename d5/d14/l6b to d5/d14/d6d/l131 0 2024-09-18T12:52:14.291 INFO:tasks.workunit.client.0.smithi045.stdout:4/432: unlink db/de/d1e/d3e/d47/d59/d13/f50 0 2024-09-18T12:52:14.298 INFO:tasks.workunit.client.0.smithi045.stdout:4/433: creat db/de/d1a/d2e/f92 x:0 0 0 2024-09-18T12:52:14.298 INFO:tasks.workunit.client.1.smithi161.stdout:5/739: dread d3/d9/f38 [0,4194304] 0 2024-09-18T12:52:14.300 INFO:tasks.workunit.client.1.smithi161.stdout:7/722: dwrite d3/d8/d15/da7/d4a/d59/f6e [4194304,4194304] 0 2024-09-18T12:52:14.301 INFO:tasks.workunit.client.1.smithi161.stdout:3/751: dread d1/d2e/d24/d1d/d89/fc7 [0,4194304] 0 2024-09-18T12:52:14.302 INFO:tasks.workunit.client.0.smithi045.stdout:4/434: symlink db/de/d1e/d3e/d47/d59/d13/l93 0 2024-09-18T12:52:14.302 INFO:tasks.workunit.client.1.smithi161.stdout:7/723: write d3/d8/d4b/f6f [925288,115660] 0 2024-09-18T12:52:14.307 INFO:tasks.workunit.client.1.smithi161.stdout:4/835: link d5/d32/f128 d5/da9/de7/f132 0 2024-09-18T12:52:14.308 INFO:tasks.workunit.client.1.smithi161.stdout:3/752: symlink d1/d2e/d14/d2c/l109 0 2024-09-18T12:52:14.309 INFO:tasks.workunit.client.0.smithi045.stdout:4/435: mknod db/d2c/d35/d40/d6d/c94 0 2024-09-18T12:52:14.312 INFO:tasks.workunit.client.0.smithi045.stdout:4/436: dread db/de/d1e/d49/f4e [0,4194304] 0 2024-09-18T12:52:14.312 INFO:tasks.workunit.client.1.smithi161.stdout:4/836: write d5/d32/d39/d4d/f68 [3836345,52804] 0 2024-09-18T12:52:14.313 INFO:tasks.workunit.client.1.smithi161.stdout:0/797: dread df/d30/d71/d96/dd3/d90/d37/d55/fa4 [0,4194304] 0 2024-09-18T12:52:14.315 INFO:tasks.workunit.client.1.smithi161.stdout:5/740: dwrite d3/d44/d6f/d86/fcd [0,4194304] 0 2024-09-18T12:52:14.317 INFO:tasks.workunit.client.1.smithi161.stdout:0/798: mknod df/d98/c121 0 2024-09-18T12:52:14.317 INFO:tasks.workunit.client.0.smithi045.stdout:4/437: dwrite f9 [0,4194304] 0 2024-09-18T12:52:14.318 INFO:tasks.workunit.client.1.smithi161.stdout:4/837: creat d5/d14/d67/dc7/d9b/f133 x:0 0 0 2024-09-18T12:52:14.320 INFO:tasks.workunit.client.1.smithi161.stdout:8/794: truncate d0/d3/d10/f18 3229677 0 2024-09-18T12:52:14.320 INFO:tasks.workunit.client.1.smithi161.stdout:3/753: dwrite d1/d2e/d68/d69/f96 [0,4194304] 0 2024-09-18T12:52:14.320 INFO:tasks.workunit.client.1.smithi161.stdout:4/838: readlink d5/d27/d44/l6a 0 2024-09-18T12:52:14.321 INFO:tasks.workunit.client.1.smithi161.stdout:0/799: write df/d30/d71/d96/dd3/d51/f101 [500339,65703] 0 2024-09-18T12:52:14.324 INFO:tasks.workunit.client.1.smithi161.stdout:3/754: write d1/d2e/d14/d65/f81 [2857378,73714] 0 2024-09-18T12:52:14.324 INFO:tasks.workunit.client.1.smithi161.stdout:8/795: stat d0/d3/d10/d21/d4a/d52/d66/d5b/de0/dee 0 2024-09-18T12:52:14.330 INFO:tasks.workunit.client.1.smithi161.stdout:6/824: dread d4/f6b [0,4194304] 0 2024-09-18T12:52:14.337 INFO:tasks.workunit.client.0.smithi045.stdout:4/438: rmdir db/de/d1e/d3e/d47/d59/d13/d73/d8e 0 2024-09-18T12:52:14.337 INFO:tasks.workunit.client.0.smithi045.stdout:4/439: chown db/c52 168663 1 2024-09-18T12:52:14.337 INFO:tasks.workunit.client.0.smithi045.stdout:4/440: mknod db/de/d1a/d2e/c95 0 2024-09-18T12:52:14.337 INFO:tasks.workunit.client.1.smithi161.stdout:5/741: rename d3/d8/de4/d20 to d3/def 0 2024-09-18T12:52:14.338 INFO:tasks.workunit.client.1.smithi161.stdout:0/800: symlink df/d30/d71/d96/dd3/d90/d37/d55/dba/l122 0 2024-09-18T12:52:14.338 INFO:tasks.workunit.client.1.smithi161.stdout:7/724: dread d3/d8/f91 [0,4194304] 0 2024-09-18T12:52:14.338 INFO:tasks.workunit.client.1.smithi161.stdout:6/825: creat d4/d1a/d1c/d3e/d83/d9e/f114 x:0 0 0 2024-09-18T12:52:14.338 INFO:tasks.workunit.client.1.smithi161.stdout:6/826: fsync d4/d39/f74 0 2024-09-18T12:52:14.339 INFO:tasks.workunit.client.1.smithi161.stdout:8/796: link d0/d3/d10/d21/d4a/d52/d82/d96/dc1/fd2 d0/d3/d1e/dda/f110 0 2024-09-18T12:52:14.340 INFO:tasks.workunit.client.1.smithi161.stdout:0/801: mkdir df/d30/d71/d96/dd3/d90/d37/d55/d123 0 2024-09-18T12:52:14.341 INFO:tasks.workunit.client.1.smithi161.stdout:4/839: rename d5/d14/d67/dc7/d47/d49/dca/d100/l11b to d5/d32/l134 0 2024-09-18T12:52:14.342 INFO:tasks.workunit.client.0.smithi045.stdout:4/441: symlink db/d20/d6b/l96 0 2024-09-18T12:52:14.342 INFO:tasks.workunit.client.1.smithi161.stdout:5/742: dwrite d3/d9/d4b/f9c [0,4194304] 0 2024-09-18T12:52:14.343 INFO:tasks.workunit.client.1.smithi161.stdout:6/827: dread - d4/d61/fa5 zero size 2024-09-18T12:52:14.343 INFO:tasks.workunit.client.1.smithi161.stdout:0/802: readlink df/d30/d71/d96/dd3/d78/la3 0 2024-09-18T12:52:14.343 INFO:tasks.workunit.client.0.smithi045.stdout:4/442: write db/de/d1e/d3e/d47/d59/d2f/f36 [244089,99121] 0 2024-09-18T12:52:14.344 INFO:tasks.workunit.client.1.smithi161.stdout:4/840: fsync d5/d32/d39/dbf/fe4 0 2024-09-18T12:52:14.345 INFO:tasks.workunit.client.1.smithi161.stdout:3/755: rename d1/d2e/d14/d65/f8f to d1/d2e/d68/d92/ded/d49/dce/f10a 0 2024-09-18T12:52:14.346 INFO:tasks.workunit.client.1.smithi161.stdout:7/725: dread d3/d8/d15/da7/d24/f51 [0,4194304] 0 2024-09-18T12:52:14.346 INFO:tasks.workunit.client.0.smithi045.stdout:4/443: symlink db/de/d1e/d3e/l97 0 2024-09-18T12:52:14.347 INFO:tasks.workunit.client.1.smithi161.stdout:4/841: stat d5/f20 0 2024-09-18T12:52:14.348 INFO:tasks.workunit.client.0.smithi045.stdout:4/444: chown db/de/d1e/d3e/d47/d59/d13/l1c 212413 1 2024-09-18T12:52:14.348 INFO:tasks.workunit.client.1.smithi161.stdout:8/797: creat d0/d3/d10/d21/d4a/d52/d82/d96/f111 x:0 0 0 2024-09-18T12:52:14.349 INFO:tasks.workunit.client.0.smithi045.stdout:4/445: write db/d20/f70 [22538,82457] 0 2024-09-18T12:52:14.349 INFO:tasks.workunit.client.1.smithi161.stdout:0/803: rmdir df/d30/d71/d96/dd3/d78 39 2024-09-18T12:52:14.351 INFO:tasks.workunit.client.1.smithi161.stdout:8/798: write d0/d3/d10/d21/d4a/d52/d82/d96/dba/fc9 [412912,36711] 0 2024-09-18T12:52:14.351 INFO:tasks.workunit.client.1.smithi161.stdout:1/659: sync 2024-09-18T12:52:14.351 INFO:tasks.workunit.client.1.smithi161.stdout:6/828: rename d4/d39/d26/l1d to d4/d61/d9d/da3/l115 0 2024-09-18T12:52:14.352 INFO:tasks.workunit.client.1.smithi161.stdout:3/756: dread d1/d2e/d14/d65/f91 [0,4194304] 0 2024-09-18T12:52:14.353 INFO:tasks.workunit.client.0.smithi045.stdout:4/446: write db/de/d1e/d3e/d47/d59/f74 [4703529,23254] 0 2024-09-18T12:52:14.354 INFO:tasks.workunit.client.1.smithi161.stdout:7/726: symlink d3/d8/d15/d99/db0/lda 0 2024-09-18T12:52:14.354 INFO:tasks.workunit.client.1.smithi161.stdout:5/743: getdents d3/d3b/d54/dbd 0 2024-09-18T12:52:14.357 INFO:tasks.workunit.client.0.smithi045.stdout:4/447: creat db/d2c/d35/d40/d77/f98 x:0 0 0 2024-09-18T12:52:14.357 INFO:tasks.workunit.client.1.smithi161.stdout:0/804: chown df/de2/dc5/d8a/dd1/l11e 192 1 2024-09-18T12:52:14.358 INFO:tasks.workunit.client.1.smithi161.stdout:6/829: unlink d4/d1a/l38 0 2024-09-18T12:52:14.360 INFO:tasks.workunit.client.1.smithi161.stdout:6/830: stat d4/d61/d69/da0/de9 0 2024-09-18T12:52:14.364 INFO:tasks.workunit.client.1.smithi161.stdout:4/842: dwrite d5/d32/f38 [4194304,4194304] 0 2024-09-18T12:52:14.366 INFO:tasks.workunit.client.1.smithi161.stdout:5/744: dwrite d3/d3b/d54/f96 [0,4194304] 0 2024-09-18T12:52:14.368 INFO:tasks.workunit.client.1.smithi161.stdout:2/814: sync 2024-09-18T12:52:14.369 INFO:tasks.workunit.client.1.smithi161.stdout:9/693: sync 2024-09-18T12:52:14.369 INFO:tasks.workunit.client.0.smithi045.stdout:4/448: dread db/de/d1e/d49/f64 [0,4194304] 0 2024-09-18T12:52:14.369 INFO:tasks.workunit.client.1.smithi161.stdout:8/799: rename d0/d3/d10/f3f to d0/d3/d10/d21/d4a/d52/d70/f112 0 2024-09-18T12:52:14.370 INFO:tasks.workunit.client.1.smithi161.stdout:9/694: chown d0/d16/d25/d28 670881 1 2024-09-18T12:52:14.375 INFO:tasks.workunit.client.1.smithi161.stdout:7/727: truncate d3/d8/d15/da7/d24/d31/f62 137341 0 2024-09-18T12:52:14.381 INFO:tasks.workunit.client.1.smithi161.stdout:4/843: rename d5/f1a to d5/d14/d67/dc7/d47/d49/d7b/f135 0 2024-09-18T12:52:14.383 INFO:tasks.workunit.client.1.smithi161.stdout:2/815: symlink d0/d5/d43/d35/d98/ddf/d8b/l113 0 2024-09-18T12:52:14.384 INFO:tasks.workunit.client.1.smithi161.stdout:3/757: link d1/d2e/d24/d84/fa8 d1/d2e/d68/d92/f10b 0 2024-09-18T12:52:14.385 INFO:tasks.workunit.client.1.smithi161.stdout:3/758: chown d1/d2e/d14/l55 15732 1 2024-09-18T12:52:14.386 INFO:tasks.workunit.client.1.smithi161.stdout:3/759: stat d1/d2e/d14/d2c/l32 0 2024-09-18T12:52:14.386 INFO:tasks.workunit.client.1.smithi161.stdout:1/660: write d1/da/d1f/f51 [1443575,18375] 0 2024-09-18T12:52:14.387 INFO:tasks.workunit.client.1.smithi161.stdout:5/745: symlink d3/d9/d85/dd3/lf0 0 2024-09-18T12:52:14.388 INFO:tasks.workunit.client.1.smithi161.stdout:0/805: rename df/d30/d71/d96/dd3/d78/d10a to df/d29/d36/dde/d124 0 2024-09-18T12:52:14.388 INFO:tasks.workunit.client.1.smithi161.stdout:4/844: dread - d5/d14/f86 zero size 2024-09-18T12:52:14.389 INFO:tasks.workunit.client.1.smithi161.stdout:9/695: symlink d0/d16/le4 0 2024-09-18T12:52:14.390 INFO:tasks.workunit.client.1.smithi161.stdout:7/728: creat d3/d8/d15/da7/d4a/d64/d8c/d9f/dd7/fdb x:0 0 0 2024-09-18T12:52:14.390 INFO:tasks.workunit.client.1.smithi161.stdout:0/806: dread - df/d30/d71/d96/dd3/d90/d37/dad/f11b zero size 2024-09-18T12:52:14.390 INFO:tasks.workunit.client.1.smithi161.stdout:3/760: rmdir d1/d2e/d14/d65 39 2024-09-18T12:52:14.391 INFO:tasks.workunit.client.1.smithi161.stdout:5/746: truncate d3/f13 5596255 0 2024-09-18T12:52:14.392 INFO:tasks.workunit.client.1.smithi161.stdout:5/747: chown d3/d9/dd7/de7 4270 1 2024-09-18T12:52:14.392 INFO:tasks.workunit.client.1.smithi161.stdout:4/845: mkdir d5/d14/d67/d84/dae/d136 0 2024-09-18T12:52:14.394 INFO:tasks.workunit.client.1.smithi161.stdout:5/748: write d3/d8/de4/d8d/f95 [1214627,63195] 0 2024-09-18T12:52:14.395 INFO:tasks.workunit.client.1.smithi161.stdout:7/729: fsync d3/f11 0 2024-09-18T12:52:14.395 INFO:tasks.workunit.client.1.smithi161.stdout:0/807: symlink df/de2/dc5/d86/l125 0 2024-09-18T12:52:14.399 INFO:tasks.workunit.client.1.smithi161.stdout:5/749: unlink d3/d9/cc0 0 2024-09-18T12:52:14.399 INFO:tasks.workunit.client.1.smithi161.stdout:1/661: link d1/da/d39/l27 d1/da/d1f/d6b/dd2/le2 0 2024-09-18T12:52:14.399 INFO:tasks.workunit.client.1.smithi161.stdout:2/816: getdents d0/d1/d4c/de5 0 2024-09-18T12:52:14.400 INFO:tasks.workunit.client.1.smithi161.stdout:3/761: fdatasync d1/d2e/d68/d92/ded/d49/dce/f10a 0 2024-09-18T12:52:14.401 INFO:tasks.workunit.client.1.smithi161.stdout:7/730: fdatasync d3/d8/d15/da7/d24/f51 0 2024-09-18T12:52:14.402 INFO:tasks.workunit.client.1.smithi161.stdout:5/750: mkdir d3/d8/df1 0 2024-09-18T12:52:14.403 INFO:tasks.workunit.client.1.smithi161.stdout:2/817: mkdir d0/d4/dab/d114 0 2024-09-18T12:52:14.405 INFO:tasks.workunit.client.1.smithi161.stdout:7/731: fdatasync d3/d8/fd3 0 2024-09-18T12:52:14.407 INFO:tasks.workunit.client.1.smithi161.stdout:0/808: creat df/d30/d71/d96/dd3/f126 x:0 0 0 2024-09-18T12:52:14.407 INFO:tasks.workunit.client.1.smithi161.stdout:4/846: dread d5/d32/d39/db6/fc2 [0,4194304] 0 2024-09-18T12:52:14.410 INFO:tasks.workunit.client.1.smithi161.stdout:3/762: mknod d1/d2e/d68/d92/ded/c10c 0 2024-09-18T12:52:14.410 INFO:tasks.workunit.client.1.smithi161.stdout:5/751: getdents d3/d8/de4/d8d/db0/dd4 0 2024-09-18T12:52:14.413 INFO:tasks.workunit.client.1.smithi161.stdout:5/752: dread d3/d9/d4b/d8e/d24/f7d [0,4194304] 0 2024-09-18T12:52:14.413 INFO:tasks.workunit.client.1.smithi161.stdout:6/831: write d4/d1a/d1c/d3e/d83/d9e/db1/d45/fe8 [93051,7261] 0 2024-09-18T12:52:14.415 INFO:tasks.workunit.client.1.smithi161.stdout:3/763: stat d1/d2e/d24/d1d/f4f 0 2024-09-18T12:52:14.416 INFO:tasks.workunit.client.0.smithi045.stdout:4/449: truncate db/f30 3454824 0 2024-09-18T12:52:14.416 INFO:tasks.workunit.client.1.smithi161.stdout:7/732: stat d3/d8/d15/da7/d44/la8 0 2024-09-18T12:52:14.417 INFO:tasks.workunit.client.1.smithi161.stdout:3/764: write d1/d2e/d14/ff7 [159872,20433] 0 2024-09-18T12:52:14.418 INFO:tasks.workunit.client.1.smithi161.stdout:7/733: chown d3/d8/l87 1485634 1 2024-09-18T12:52:14.418 INFO:tasks.workunit.client.1.smithi161.stdout:2/818: creat d0/d1/deb/f115 x:0 0 0 2024-09-18T12:52:14.421 INFO:tasks.workunit.client.1.smithi161.stdout:0/809: dread df/d30/d71/d96/dd3/d90/f4b [0,4194304] 0 2024-09-18T12:52:14.422 INFO:tasks.workunit.client.1.smithi161.stdout:0/810: write df/d30/d71/d96/dd3/f102 [750115,110482] 0 2024-09-18T12:52:14.426 INFO:tasks.workunit.client.0.smithi045.stdout:4/450: getdents db/d20 0 2024-09-18T12:52:14.426 INFO:tasks.workunit.client.1.smithi161.stdout:3/765: chown d1/d2e/d14/d65/d76/d8c/d9d/lf0 858 1 2024-09-18T12:52:14.427 INFO:tasks.workunit.client.1.smithi161.stdout:7/734: symlink d3/d8/d15/da7/d4a/ldc 0 2024-09-18T12:52:14.428 INFO:tasks.workunit.client.1.smithi161.stdout:2/819: symlink d0/d5/d53/d7d/l116 0 2024-09-18T12:52:14.428 INFO:tasks.workunit.client.1.smithi161.stdout:9/696: dwrite d0/f2f [4194304,4194304] 0 2024-09-18T12:52:14.431 INFO:tasks.workunit.client.0.smithi045.stdout:4/451: dwrite db/d20/f44 [0,4194304] 0 2024-09-18T12:52:14.435 INFO:tasks.workunit.client.1.smithi161.stdout:0/811: write df/de2/dc5/d86/f75 [2106075,34163] 0 2024-09-18T12:52:14.436 INFO:tasks.workunit.client.1.smithi161.stdout:7/735: mkdir d3/d8/d15/da7/d24/ddd 0 2024-09-18T12:52:14.438 INFO:tasks.workunit.client.1.smithi161.stdout:9/697: dread d0/d16/d25/d28/f31 [0,4194304] 0 2024-09-18T12:52:14.439 INFO:tasks.workunit.client.1.smithi161.stdout:3/766: read d1/d2e/d24/d1d/f9f [695519,113914] 0 2024-09-18T12:52:14.441 INFO:tasks.workunit.client.1.smithi161.stdout:5/753: creat d3/d9/ff2 x:0 0 0 2024-09-18T12:52:14.443 INFO:tasks.workunit.client.1.smithi161.stdout:6/832: rename d4/d1a/d1c/d3e/d4d/ff8 to d4/d1a/d1c/d3e/d83/d9e/db1/f116 0 2024-09-18T12:52:14.445 INFO:tasks.workunit.client.1.smithi161.stdout:2/820: dwrite d0/d71/da9/dd6/f102 [0,4194304] 0 2024-09-18T12:52:14.446 INFO:tasks.workunit.client.1.smithi161.stdout:1/662: dwrite d1/da/d31/f78 [0,4194304] 0 2024-09-18T12:52:14.447 INFO:tasks.workunit.client.1.smithi161.stdout:4/847: truncate d5/d32/f38 8160346 0 2024-09-18T12:52:14.451 INFO:tasks.workunit.client.1.smithi161.stdout:6/833: chown d4/d39/d47/d51/f93 27666 1 2024-09-18T12:52:14.454 INFO:tasks.workunit.client.1.smithi161.stdout:3/767: mkdir d1/d2e/d14/d90/d10d 0 2024-09-18T12:52:14.456 INFO:tasks.workunit.client.1.smithi161.stdout:7/736: rename d3/d8/d15/da7/d24/d31/f34 to d3/d8/d15/da7/d24/ddd/fde 0 2024-09-18T12:52:14.457 INFO:tasks.workunit.client.1.smithi161.stdout:2/821: rmdir d0/d4/d78 39 2024-09-18T12:52:14.458 INFO:tasks.workunit.client.1.smithi161.stdout:4/848: chown d5/da9/de7/cf8 188600401 1 2024-09-18T12:52:14.459 INFO:tasks.workunit.client.1.smithi161.stdout:4/849: read d5/d27/d44/f101 [977130,87414] 0 2024-09-18T12:52:14.460 INFO:tasks.workunit.client.1.smithi161.stdout:1/663: mkdir d1/da/d1f/dab/daf/de3 0 2024-09-18T12:52:14.463 INFO:tasks.workunit.client.0.smithi045.stdout:4/452: write db/de/d1e/d3e/d47/d59/f66 [792247,56916] 0 2024-09-18T12:52:14.469 INFO:tasks.workunit.client.1.smithi161.stdout:2/822: unlink d0/d1/deb/f115 0 2024-09-18T12:52:14.471 INFO:tasks.workunit.client.1.smithi161.stdout:2/823: readlink d0/d1/deb/d3d/d4f/l6f 0 2024-09-18T12:52:14.473 INFO:tasks.workunit.client.1.smithi161.stdout:4/850: mknod d5/da9/c137 0 2024-09-18T12:52:14.475 INFO:tasks.workunit.client.1.smithi161.stdout:2/824: write d0/d5/f74 [653778,38216] 0 2024-09-18T12:52:14.476 INFO:tasks.workunit.client.1.smithi161.stdout:0/812: dwrite df/de2/dc5/d86/f72 [4194304,4194304] 0 2024-09-18T12:52:14.477 INFO:tasks.workunit.client.0.smithi045.stdout:4/453: dread db/f30 [0,4194304] 0 2024-09-18T12:52:14.479 INFO:tasks.workunit.client.1.smithi161.stdout:3/768: symlink d1/d2e/d14/d78/d83/l10e 0 2024-09-18T12:52:14.482 INFO:tasks.workunit.client.1.smithi161.stdout:9/698: dread d0/db/f50 [0,4194304] 0 2024-09-18T12:52:14.485 INFO:tasks.workunit.client.1.smithi161.stdout:5/754: dwrite d3/d8/f91 [0,4194304] 0 2024-09-18T12:52:14.485 INFO:tasks.workunit.client.1.smithi161.stdout:8/800: sync 2024-09-18T12:52:14.488 INFO:tasks.workunit.client.1.smithi161.stdout:2/825: chown d0/d71/da9/d9f/dd0/d10c/l10f 2 1 2024-09-18T12:52:14.488 INFO:tasks.workunit.client.1.smithi161.stdout:0/813: read df/d30/d4d/d92/f9e [2300822,46577] 0 2024-09-18T12:52:14.490 INFO:tasks.workunit.client.0.smithi045.stdout:4/454: getdents db/de/d1e/d3e 0 2024-09-18T12:52:14.493 INFO:tasks.workunit.client.0.smithi045.stdout:4/455: dread - db/d2c/d35/d40/f7d zero size 2024-09-18T12:52:14.497 INFO:tasks.workunit.client.1.smithi161.stdout:3/769: truncate d1/d2e/d14/f56 4645473 0 2024-09-18T12:52:14.498 INFO:tasks.workunit.client.0.smithi045.stdout:4/456: mknod db/de/d1e/d3e/d47/d59/d2f/c99 0 2024-09-18T12:52:14.498 INFO:tasks.workunit.client.1.smithi161.stdout:6/834: write d4/d1a/d1c/d3e/d83/d9e/db1/d28/f3b [1268671,964] 0 2024-09-18T12:52:14.502 INFO:tasks.workunit.client.1.smithi161.stdout:7/737: dwrite d3/f6d [0,4194304] 0 2024-09-18T12:52:14.503 INFO:tasks.workunit.client.1.smithi161.stdout:3/770: dread - d1/d2e/d14/d78/d83/f101 zero size 2024-09-18T12:52:14.509 INFO:tasks.workunit.client.1.smithi161.stdout:5/755: dwrite d3/d8/de4/d8d/fc7 [0,4194304] 0 2024-09-18T12:52:14.510 INFO:tasks.workunit.client.1.smithi161.stdout:7/738: write d3/d8/d15/da7/d4a/d64/d8c/d9f/f5f [3362629,63752] 0 2024-09-18T12:52:14.510 INFO:tasks.workunit.client.0.smithi045.stdout:4/457: write db/f63 [1306346,108370] 0 2024-09-18T12:52:14.511 INFO:tasks.workunit.client.1.smithi161.stdout:9/699: dwrite d0/f22 [0,4194304] 0 2024-09-18T12:52:14.513 INFO:tasks.workunit.client.0.smithi045.stdout:6/371: sync 2024-09-18T12:52:14.514 INFO:tasks.workunit.client.0.smithi045.stdout:6/372: chown d9/d1a/d2d/d38/d5b/d67/f79 58845 1 2024-09-18T12:52:14.515 INFO:tasks.workunit.client.0.smithi045.stdout:6/373: write d9/ff [52227,128936] 0 2024-09-18T12:52:14.516 INFO:tasks.workunit.client.1.smithi161.stdout:1/664: dread d1/da/d1f/d45/d73/f87 [0,4194304] 0 2024-09-18T12:52:14.517 INFO:tasks.workunit.client.0.smithi045.stdout:4/458: rename db/de/d1e/d3e/d47/d59/d13 to db/de/d1e/d3e/d9a 0 2024-09-18T12:52:14.517 INFO:tasks.workunit.client.0.smithi045.stdout:6/374: write d9/d1a/d2d/d38/d5b/d67/f79 [802868,60922] 0 2024-09-18T12:52:14.519 INFO:tasks.workunit.client.0.smithi045.stdout:4/459: truncate db/de/f90 837893 0 2024-09-18T12:52:14.527 INFO:tasks.workunit.client.0.smithi045.stdout:6/375: rename d9/d30/l39 to d9/d30/d6c/l87 0 2024-09-18T12:52:14.528 INFO:tasks.workunit.client.0.smithi045.stdout:6/376: write d9/f23 [716790,92221] 0 2024-09-18T12:52:14.530 INFO:tasks.workunit.client.0.smithi045.stdout:6/377: read d9/d1a/d1d/f5a [34142,22335] 0 2024-09-18T12:52:14.532 INFO:tasks.workunit.client.1.smithi161.stdout:4/851: symlink d5/d27/d44/dc9/l138 0 2024-09-18T12:52:14.533 INFO:tasks.workunit.client.0.smithi045.stdout:6/378: creat d9/d30/f88 x:0 0 0 2024-09-18T12:52:14.534 INFO:tasks.workunit.client.1.smithi161.stdout:4/852: dread - d5/d14/d67/d84/d113/f114 zero size 2024-09-18T12:52:14.535 INFO:tasks.workunit.client.1.smithi161.stdout:4/853: chown d5/d14/d5f/l130 1098 1 2024-09-18T12:52:14.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/826: fsync d0/d5/d43/d35/d98/ddf/f85 0 2024-09-18T12:52:14.537 INFO:tasks.workunit.client.1.smithi161.stdout:8/801: unlink d0/d3/d10/d21/fb8 0 2024-09-18T12:52:14.538 INFO:tasks.workunit.client.1.smithi161.stdout:0/814: rmdir df/d30/d71/dfe 39 2024-09-18T12:52:14.539 INFO:tasks.workunit.client.1.smithi161.stdout:8/802: stat d0/d3/d10/d21/d4a/d52/d94/l9f 0 2024-09-18T12:52:14.540 INFO:tasks.workunit.client.0.smithi045.stdout:6/379: truncate d9/fc 3249958 0 2024-09-18T12:52:14.541 INFO:tasks.workunit.client.1.smithi161.stdout:6/835: rmdir d4/d39/d47/d51 39 2024-09-18T12:52:14.542 INFO:tasks.workunit.client.1.smithi161.stdout:3/771: unlink d1/d2e/d68/d92/dba/fe7 0 2024-09-18T12:52:14.544 INFO:tasks.workunit.client.0.smithi045.stdout:6/380: mknod d9/d74/c89 0 2024-09-18T12:52:14.546 INFO:tasks.workunit.client.1.smithi161.stdout:5/756: chown d3/def/l37 698 1 2024-09-18T12:52:14.549 INFO:tasks.workunit.client.1.smithi161.stdout:7/739: dread d3/d8/d15/da7/d24/d31/f62 [0,4194304] 0 2024-09-18T12:52:14.551 INFO:tasks.workunit.client.1.smithi161.stdout:1/665: creat d1/d26/dad/db6/fe4 x:0 0 0 2024-09-18T12:52:14.551 INFO:tasks.workunit.client.0.smithi045.stdout:6/381: dwrite d9/d1a/d2d/d32/f62 [0,4194304] 0 2024-09-18T12:52:14.553 INFO:tasks.workunit.client.1.smithi161.stdout:2/827: write d0/d1/deb/d3d/ff4 [3584744,102055] 0 2024-09-18T12:52:14.557 INFO:tasks.workunit.client.1.smithi161.stdout:4/854: truncate d5/d14/d67/d84/f77 632577 0 2024-09-18T12:52:14.558 INFO:tasks.workunit.client.1.smithi161.stdout:0/815: dread df/d30/d71/d96/dd3/f49 [0,4194304] 0 2024-09-18T12:52:14.559 INFO:tasks.workunit.client.1.smithi161.stdout:4/855: write d5/d32/d39/d4d/f96 [10666238,110117] 0 2024-09-18T12:52:14.561 INFO:tasks.workunit.client.1.smithi161.stdout:3/772: mkdir d1/d2e/d24/d1d/d89/d10f 0 2024-09-18T12:52:14.563 INFO:tasks.workunit.client.1.smithi161.stdout:3/773: write d1/d2e/d68/d69/d7d/fda [243721,104728] 0 2024-09-18T12:52:14.565 INFO:tasks.workunit.client.1.smithi161.stdout:3/774: write d1/d2e/d14/d78/d83/f101 [1010699,59189] 0 2024-09-18T12:52:14.565 INFO:tasks.workunit.client.1.smithi161.stdout:9/700: mkdir d0/d93/da0/de5 0 2024-09-18T12:52:14.566 INFO:tasks.workunit.client.1.smithi161.stdout:3/775: chown d1/d2e 1325 1 2024-09-18T12:52:14.566 INFO:tasks.workunit.client.1.smithi161.stdout:7/740: rename d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/f94 to d3/d7e/fdf 0 2024-09-18T12:52:14.567 INFO:tasks.workunit.client.1.smithi161.stdout:1/666: fsync d1/ddd/fe1 0 2024-09-18T12:52:14.568 INFO:tasks.workunit.client.1.smithi161.stdout:2/828: truncate d0/d1/deb/d7e/fe2 845312 0 2024-09-18T12:52:14.569 INFO:tasks.workunit.client.0.smithi045.stdout:4/460: truncate db/de/d1e/d3e/d47/d59/d2f/f36 4161289 0 2024-09-18T12:52:14.570 INFO:tasks.workunit.client.1.smithi161.stdout:8/803: creat d0/d3/d10/d21/d4a/d52/d82/de6/df7/f113 x:0 0 0 2024-09-18T12:52:14.570 INFO:tasks.workunit.client.1.smithi161.stdout:8/804: chown d0/f7a 192 1 2024-09-18T12:52:14.571 INFO:tasks.workunit.client.1.smithi161.stdout:6/836: symlink d4/d39/l117 0 2024-09-18T12:52:14.574 INFO:tasks.workunit.client.1.smithi161.stdout:4/856: mkdir d5/d14/d67/dc7/d47/dbc/d139 0 2024-09-18T12:52:14.575 INFO:tasks.workunit.client.1.smithi161.stdout:4/857: chown d5/d27/d44/d61/d6c/d8f/d12f 333225 1 2024-09-18T12:52:14.575 INFO:tasks.workunit.client.0.smithi045.stdout:4/461: dwrite db/de/f90 [0,4194304] 0 2024-09-18T12:52:14.577 INFO:tasks.workunit.client.1.smithi161.stdout:9/701: mkdir d0/d20/d49/de6 0 2024-09-18T12:52:14.577 INFO:tasks.workunit.client.1.smithi161.stdout:3/776: write d1/d2e/d24/d1d/d89/fc5 [2907503,81548] 0 2024-09-18T12:52:14.579 INFO:tasks.workunit.client.0.smithi045.stdout:4/462: creat db/de/f9b x:0 0 0 2024-09-18T12:52:14.583 INFO:tasks.workunit.client.1.smithi161.stdout:7/741: rmdir d3/d8/d15/da7/d4a/d59 39 2024-09-18T12:52:14.584 INFO:tasks.workunit.client.1.smithi161.stdout:9/702: dwrite d0/d16/d25/d28/d45/f66 [0,4194304] 0 2024-09-18T12:52:14.587 INFO:tasks.workunit.client.1.smithi161.stdout:8/805: fdatasync d0/d3/d10/d21/d4a/db7/fd9 0 2024-09-18T12:52:14.589 INFO:tasks.workunit.client.1.smithi161.stdout:8/806: chown d0/d3/d10/d21/d4a/d52/d66/l88 5723538 1 2024-09-18T12:52:14.596 INFO:tasks.workunit.client.1.smithi161.stdout:5/757: write d3/d8/de4/f4e [2348539,72503] 0 2024-09-18T12:52:14.597 INFO:tasks.workunit.client.0.smithi045.stdout:6/382: dwrite d9/d1a/d2d/d38/f40 [0,4194304] 0 2024-09-18T12:52:14.605 INFO:tasks.workunit.client.1.smithi161.stdout:8/807: read d0/f45 [1938184,1463] 0 2024-09-18T12:52:14.607 INFO:tasks.workunit.client.1.smithi161.stdout:9/703: mkdir d0/d47/d48/de7 0 2024-09-18T12:52:14.607 INFO:tasks.workunit.client.1.smithi161.stdout:9/704: chown d0/db/f57 1 1 2024-09-18T12:52:14.608 INFO:tasks.workunit.client.1.smithi161.stdout:5/758: chown d3/d8/de4/d8d/fd5 39849 1 2024-09-18T12:52:14.609 INFO:tasks.workunit.client.1.smithi161.stdout:8/808: mknod d0/d3/d1e/dda/de3/c114 0 2024-09-18T12:52:14.613 INFO:tasks.workunit.client.1.smithi161.stdout:8/809: dread - d0/d3/d10/d21/d4a/d52/d82/d96/d98/ffc zero size 2024-09-18T12:52:14.613 INFO:tasks.workunit.client.1.smithi161.stdout:1/667: write d1/da/d31/f77 [109579,1949] 0 2024-09-18T12:52:14.614 INFO:tasks.workunit.client.1.smithi161.stdout:9/705: symlink d0/d47/d48/d7f/d9e/da4/le8 0 2024-09-18T12:52:14.614 INFO:tasks.workunit.client.1.smithi161.stdout:0/816: dwrite df/de2/dc5/d86/f6c [0,4194304] 0 2024-09-18T12:52:14.617 INFO:tasks.workunit.client.0.smithi045.stdout:6/383: rmdir d9/d56 39 2024-09-18T12:52:14.617 INFO:tasks.workunit.client.1.smithi161.stdout:6/837: write d4/f97 [1163795,112606] 0 2024-09-18T12:52:14.618 INFO:tasks.workunit.client.1.smithi161.stdout:5/759: symlink d3/d8/de4/d8d/db0/dd4/lf3 0 2024-09-18T12:52:14.619 INFO:tasks.workunit.client.1.smithi161.stdout:8/810: chown d0/d3/cb3 704 1 2024-09-18T12:52:14.622 INFO:tasks.workunit.client.1.smithi161.stdout:0/817: dread - df/d30/d71/d96/dd3/d51/dc9/f109 zero size 2024-09-18T12:52:14.622 INFO:tasks.workunit.client.1.smithi161.stdout:6/838: stat d4/d1a/d1c/d7c/fdc 0 2024-09-18T12:52:14.624 INFO:tasks.workunit.client.1.smithi161.stdout:2/829: dwrite d0/d1/deb/f83 [0,4194304] 0 2024-09-18T12:52:14.625 INFO:tasks.workunit.client.0.smithi045.stdout:4/463: truncate db/f21 8317433 0 2024-09-18T12:52:14.626 INFO:tasks.workunit.client.0.smithi045.stdout:4/464: write db/de/d1e/d49/f4e [1310028,21367] 0 2024-09-18T12:52:14.627 INFO:tasks.workunit.client.1.smithi161.stdout:2/830: chown d0/d5/d43/d23 10 1 2024-09-18T12:52:14.633 INFO:tasks.workunit.client.1.smithi161.stdout:0/818: symlink df/d30/d71/d96/dd3/d51/dc9/l127 0 2024-09-18T12:52:14.634 INFO:tasks.workunit.client.1.smithi161.stdout:1/668: link d1/da/d1f/d6b/cbc d1/daa/db2/dc0/ce5 0 2024-09-18T12:52:14.639 INFO:tasks.workunit.client.1.smithi161.stdout:5/760: dwrite d3/d8/de4/f1b [0,4194304] 0 2024-09-18T12:52:14.641 INFO:tasks.workunit.client.1.smithi161.stdout:1/669: chown d1/d26/da6/lc3 10343 1 2024-09-18T12:52:14.641 INFO:tasks.workunit.client.1.smithi161.stdout:6/839: dwrite d4/d39/d48/fed [0,4194304] 0 2024-09-18T12:52:14.641 INFO:tasks.workunit.client.1.smithi161.stdout:2/831: truncate d0/d5/d43/d35/fa3 4401508 0 2024-09-18T12:52:14.642 INFO:tasks.workunit.client.1.smithi161.stdout:5/761: dread - d3/d44/d6f/fe0 zero size 2024-09-18T12:52:14.650 INFO:tasks.workunit.client.0.smithi045.stdout:4/465: dread db/de/d1e/d49/f4e [0,4194304] 0 2024-09-18T12:52:14.650 INFO:tasks.workunit.client.1.smithi161.stdout:0/819: rename df/d30/d71/d96/dd3/d90/d37/d55 to df/d98/d128 0 2024-09-18T12:52:14.657 INFO:tasks.workunit.client.0.smithi045.stdout:4/466: symlink db/de/d1e/d49/l9c 0 2024-09-18T12:52:14.657 INFO:tasks.workunit.client.1.smithi161.stdout:9/706: dwrite d0/db/d18/f80 [0,4194304] 0 2024-09-18T12:52:14.662 INFO:tasks.workunit.client.0.smithi045.stdout:4/467: dwrite db/d2c/d35/d40/d77/f98 [0,4194304] 0 2024-09-18T12:52:14.663 INFO:tasks.workunit.client.1.smithi161.stdout:9/707: chown d0/d16/d25/d28/d45/f66 0 1 2024-09-18T12:52:14.666 INFO:tasks.workunit.client.0.smithi045.stdout:4/468: rename db/de/d1a/c58 to db/d1b/d6f/c9d 0 2024-09-18T12:52:14.667 INFO:tasks.workunit.client.0.smithi045.stdout:4/469: readlink db/d1b/l4a 0 2024-09-18T12:52:14.668 INFO:tasks.workunit.client.1.smithi161.stdout:8/811: dwrite d0/d3/d10/d21/d4a/d52/d82/d96/f78 [0,4194304] 0 2024-09-18T12:52:14.668 INFO:tasks.workunit.client.1.smithi161.stdout:2/832: dwrite d0/d4/d78/fae [0,4194304] 0 2024-09-18T12:52:14.669 INFO:tasks.workunit.client.1.smithi161.stdout:9/708: read - d0/d16/d25/d28/d45/fde zero size 2024-09-18T12:52:14.671 INFO:tasks.workunit.client.1.smithi161.stdout:5/762: dwrite d3/d3b/d7b/d82/fa9 [0,4194304] 0 2024-09-18T12:52:14.673 INFO:tasks.workunit.client.1.smithi161.stdout:6/840: dread d4/d39/f74 [0,4194304] 0 2024-09-18T12:52:14.675 INFO:tasks.workunit.client.1.smithi161.stdout:0/820: rename df/d30/d71/d96/dd3/cd6 to df/d30/d71/dfe/c129 0 2024-09-18T12:52:14.680 INFO:tasks.workunit.client.1.smithi161.stdout:8/812: fdatasync d0/d3/d10/d21/d4a/d52/d82/d96/f72 0 2024-09-18T12:52:14.685 INFO:tasks.workunit.client.1.smithi161.stdout:6/841: dread d4/d1a/d1c/d3e/d83/fd8 [0,4194304] 0 2024-09-18T12:52:14.688 INFO:tasks.workunit.client.1.smithi161.stdout:5/763: rename d3/d9/d4b/d8e/d24/db8/da4/cdd to d3/d9/d4b/d8e/d24/db8/cf4 0 2024-09-18T12:52:14.688 INFO:tasks.workunit.client.1.smithi161.stdout:4/858: sync 2024-09-18T12:52:14.689 INFO:tasks.workunit.client.1.smithi161.stdout:8/813: readlink d0/d3/d10/d21/d4a/d52/d82/d96/d98/l1c 0 2024-09-18T12:52:14.689 INFO:tasks.workunit.client.1.smithi161.stdout:2/833: creat d0/d71/da9/dd6/de8/f117 x:0 0 0 2024-09-18T12:52:14.690 INFO:tasks.workunit.client.1.smithi161.stdout:9/709: dwrite d0/d20/d49/f15 [4194304,4194304] 0 2024-09-18T12:52:14.692 INFO:tasks.workunit.client.0.smithi045.stdout:4/470: dwrite db/de/d1e/d3e/d9a/f2b [4194304,4194304] 0 2024-09-18T12:52:14.693 INFO:tasks.workunit.client.1.smithi161.stdout:0/821: getdents df/d29/d36/dde 0 2024-09-18T12:52:14.694 INFO:tasks.workunit.client.1.smithi161.stdout:1/670: dread d1/da/f16 [0,4194304] 0 2024-09-18T12:52:14.695 INFO:tasks.workunit.client.1.smithi161.stdout:4/859: chown d5/d14/d67/dc7/d60/d95/dda 186 1 2024-09-18T12:52:14.696 INFO:tasks.workunit.client.0.smithi045.stdout:4/471: mkdir db/de/d1e/d3e/d9a/d73/d75/d9e 0 2024-09-18T12:52:14.698 INFO:tasks.workunit.client.1.smithi161.stdout:1/671: fsync d1/f97 0 2024-09-18T12:52:14.699 INFO:tasks.workunit.client.0.smithi045.stdout:4/472: unlink db/d2c/l34 0 2024-09-18T12:52:14.701 INFO:tasks.workunit.client.1.smithi161.stdout:9/710: symlink d0/dd4/le9 0 2024-09-18T12:52:14.702 INFO:tasks.workunit.client.1.smithi161.stdout:0/822: chown df/d29/cac 9 1 2024-09-18T12:52:14.705 INFO:tasks.workunit.client.0.smithi045.stdout:4/473: fsync db/d2c/d35/d40/f68 0 2024-09-18T12:52:14.706 INFO:tasks.workunit.client.1.smithi161.stdout:6/842: dwrite d4/d39/d48/fda [0,4194304] 0 2024-09-18T12:52:14.706 INFO:tasks.workunit.client.1.smithi161.stdout:1/672: unlink d1/d71/fd7 0 2024-09-18T12:52:14.706 INFO:tasks.workunit.client.1.smithi161.stdout:5/764: dwrite d3/d9/d4b/d8e/f8a [0,4194304] 0 2024-09-18T12:52:14.707 INFO:tasks.workunit.client.0.smithi045.stdout:4/474: read db/d2c/d35/d40/d77/f4c [983102,15907] 0 2024-09-18T12:52:14.708 INFO:tasks.workunit.client.1.smithi161.stdout:1/673: chown d1/cb9 0 1 2024-09-18T12:52:14.708 INFO:tasks.workunit.client.1.smithi161.stdout:8/814: symlink d0/d3/d10/d21/d4a/d52/d82/de6/l115 0 2024-09-18T12:52:14.709 INFO:tasks.workunit.client.1.smithi161.stdout:4/860: creat d5/d14/d67/d84/d120/f13a x:0 0 0 2024-09-18T12:52:14.710 INFO:tasks.workunit.client.0.smithi045.stdout:4/475: rmdir db/d1b 39 2024-09-18T12:52:14.711 INFO:tasks.workunit.client.1.smithi161.stdout:9/711: rmdir d0/d20 39 2024-09-18T12:52:14.712 INFO:tasks.workunit.client.1.smithi161.stdout:4/861: chown d5/da9/de7/f132 0 1 2024-09-18T12:52:14.715 INFO:tasks.workunit.client.0.smithi045.stdout:4/476: creat db/d20/f9f x:0 0 0 2024-09-18T12:52:14.716 INFO:tasks.workunit.client.0.smithi045.stdout:4/477: read db/d20/f44 [3180561,118764] 0 2024-09-18T12:52:14.718 INFO:tasks.workunit.client.1.smithi161.stdout:6/843: symlink d4/d61/d9d/da3/l118 0 2024-09-18T12:52:14.719 INFO:tasks.workunit.client.1.smithi161.stdout:1/674: rename d1/d26/d3a/l63 to d1/d71/le6 0 2024-09-18T12:52:14.722 INFO:tasks.workunit.client.1.smithi161.stdout:8/815: unlink d0/d3/d10/d21/d4a/d52/d94/cd1 0 2024-09-18T12:52:14.723 INFO:tasks.workunit.client.1.smithi161.stdout:8/816: read - d0/ff6 zero size 2024-09-18T12:52:14.724 INFO:tasks.workunit.client.0.smithi045.stdout:4/478: write db/d2c/d35/f91 [6163789,124592] 0 2024-09-18T12:52:14.724 INFO:tasks.workunit.client.1.smithi161.stdout:2/834: dread d0/d1/deb/d3d/f5d [0,4194304] 0 2024-09-18T12:52:14.726 INFO:tasks.workunit.client.1.smithi161.stdout:0/823: unlink df/d98/d128/l5e 0 2024-09-18T12:52:14.728 INFO:tasks.workunit.client.0.smithi045.stdout:4/479: dread f9 [0,4194304] 0 2024-09-18T12:52:14.728 INFO:tasks.workunit.client.1.smithi161.stdout:8/817: dread d0/d3/d10/d21/d4a/d52/d82/d96/dba/f10a [4194304,4194304] 0 2024-09-18T12:52:14.729 INFO:tasks.workunit.client.0.smithi045.stdout:2/397: sync 2024-09-18T12:52:14.730 INFO:tasks.workunit.client.0.smithi045.stdout:2/398: write d5/d5f/f8b [46831,10261] 0 2024-09-18T12:52:14.730 INFO:tasks.workunit.client.1.smithi161.stdout:8/818: fdatasync d0/d3/d10/d21/d4a/d52/d82/d96/d98/fbe 0 2024-09-18T12:52:14.733 INFO:tasks.workunit.client.1.smithi161.stdout:4/862: symlink d5/d14/d67/d84/dae/l13b 0 2024-09-18T12:52:14.735 INFO:tasks.workunit.client.0.smithi045.stdout:2/399: dread d5/d2c/d4d/d16/d61/f66 [0,4194304] 0 2024-09-18T12:52:14.736 INFO:tasks.workunit.client.0.smithi045.stdout:2/400: chown d5/d2c/d4d/d76 1627 1 2024-09-18T12:52:14.736 INFO:tasks.workunit.client.0.smithi045.stdout:2/401: chown d5/c72 66 1 2024-09-18T12:52:14.737 INFO:tasks.workunit.client.1.smithi161.stdout:5/765: dread d3/d9/f1c [0,4194304] 0 2024-09-18T12:52:14.738 INFO:tasks.workunit.client.1.smithi161.stdout:6/844: dread d4/d1a/d1c/d3e/d83/d9e/db1/d28/f3d [0,4194304] 0 2024-09-18T12:52:14.738 INFO:tasks.workunit.client.1.smithi161.stdout:1/675: rename d1/d1d/fd4 to d1/da/d1f/dab/daf/fe7 0 2024-09-18T12:52:14.741 INFO:tasks.workunit.client.1.smithi161.stdout:2/835: rmdir d0/d5/d43/d35/d98/de1 39 2024-09-18T12:52:14.741 INFO:tasks.workunit.client.1.smithi161.stdout:1/676: read d1/da/d1f/d45/d73/f87 [3014372,38772] 0 2024-09-18T12:52:14.742 INFO:tasks.workunit.client.1.smithi161.stdout:4/863: dwrite d5/d14/f12d [0,4194304] 0 2024-09-18T12:52:14.742 INFO:tasks.workunit.client.0.smithi045.stdout:2/402: chown d5/d2c/c5e 18 1 2024-09-18T12:52:14.742 INFO:tasks.workunit.client.1.smithi161.stdout:0/824: rmdir df/de2/dc5/dca 39 2024-09-18T12:52:14.748 INFO:tasks.workunit.client.1.smithi161.stdout:8/819: mknod d0/d3/d1e/dda/c116 0 2024-09-18T12:52:14.751 INFO:tasks.workunit.client.1.smithi161.stdout:7/742: sync 2024-09-18T12:52:14.751 INFO:tasks.workunit.client.1.smithi161.stdout:3/777: sync 2024-09-18T12:52:14.755 INFO:tasks.workunit.client.1.smithi161.stdout:5/766: rename d3/def/l37 to d3/d9/d4b/d8e/d24/d61/lf5 0 2024-09-18T12:52:14.758 INFO:tasks.workunit.client.1.smithi161.stdout:0/825: rmdir df/de2/dc5/d8a 39 2024-09-18T12:52:14.762 INFO:tasks.workunit.client.1.smithi161.stdout:4/864: mknod d5/d14/d5f/da1/c13c 0 2024-09-18T12:52:14.764 INFO:tasks.workunit.client.1.smithi161.stdout:7/743: symlink d3/d8/d15/da7/d4a/d64/d8c/le0 0 2024-09-18T12:52:14.765 INFO:tasks.workunit.client.1.smithi161.stdout:6/845: dread d4/d1a/f13 [4194304,4194304] 0 2024-09-18T12:52:14.767 INFO:tasks.workunit.client.0.smithi045.stdout:4/480: dwrite db/de/d1e/d3e/d47/d59/d2f/f36 [0,4194304] 0 2024-09-18T12:52:14.768 INFO:tasks.workunit.client.0.smithi045.stdout:2/403: truncate d5/d2c/d4d/f1b 990476 0 2024-09-18T12:52:14.772 INFO:tasks.workunit.client.1.smithi161.stdout:9/712: getdents d0/d16/d25/d46/d53/d59/ddb 0 2024-09-18T12:52:14.772 INFO:tasks.workunit.client.1.smithi161.stdout:0/826: rmdir df/de2/dc5/db6 39 2024-09-18T12:52:14.773 INFO:tasks.workunit.client.1.smithi161.stdout:6/846: readlink d4/d39/d47/lbc 0 2024-09-18T12:52:14.773 INFO:tasks.workunit.client.0.smithi045.stdout:4/481: mknod db/de/d1e/d3e/d47/d59/ca0 0 2024-09-18T12:52:14.774 INFO:tasks.workunit.client.1.smithi161.stdout:2/836: mknod d0/d5/d43/d23/ddd/c118 0 2024-09-18T12:52:14.775 INFO:tasks.workunit.client.1.smithi161.stdout:2/837: readlink d0/d1/deb/d3d/l8e 0 2024-09-18T12:52:14.776 INFO:tasks.workunit.client.1.smithi161.stdout:4/865: creat d5/d14/d67/dc7/d60/d95/f13d x:0 0 0 2024-09-18T12:52:14.777 INFO:tasks.workunit.client.1.smithi161.stdout:2/838: write d0/d1/d4c/d67/fa4 [2739838,2438] 0 2024-09-18T12:52:14.779 INFO:tasks.workunit.client.0.smithi045.stdout:4/482: write db/d2c/d35/d40/f79 [637787,18014] 0 2024-09-18T12:52:14.781 INFO:tasks.workunit.client.1.smithi161.stdout:4/866: dread d5/d27/d44/d61/f110 [0,4194304] 0 2024-09-18T12:52:14.782 INFO:tasks.workunit.client.0.smithi045.stdout:2/404: dwrite d5/d2c/d4d/d33/f80 [0,4194304] 0 2024-09-18T12:52:14.782 INFO:tasks.workunit.client.0.smithi045.stdout:4/483: readlink db/d2c/d35/d40/d77/l5a 0 2024-09-18T12:52:14.784 INFO:tasks.workunit.client.0.smithi045.stdout:4/484: chown db/d2c/d35/d40/d6d/l88 279943 1 2024-09-18T12:52:14.786 INFO:tasks.workunit.client.0.smithi045.stdout:4/485: write db/de/d1e/d3e/d47/d59/d2f/f36 [847670,72900] 0 2024-09-18T12:52:14.787 INFO:tasks.workunit.client.1.smithi161.stdout:5/767: creat d3/d44/ddc/ff6 x:0 0 0 2024-09-18T12:52:14.791 INFO:tasks.workunit.client.1.smithi161.stdout:0/827: rename df/de2/dc5/d89/c8f to df/de2/c12a 0 2024-09-18T12:52:14.795 INFO:tasks.workunit.client.0.smithi045.stdout:4/486: rename db/de/d1e/d3e/d47/d59/f66 to db/d2c/d35/fa1 0 2024-09-18T12:52:14.795 INFO:tasks.workunit.client.1.smithi161.stdout:7/744: dread d3/d8/d15/f26 [4194304,4194304] 0 2024-09-18T12:52:14.796 INFO:tasks.workunit.client.0.smithi045.stdout:4/487: write db/de/d1e/d3e/d9a/f7c [958231,38320] 0 2024-09-18T12:52:14.797 INFO:tasks.workunit.client.1.smithi161.stdout:1/677: getdents d1/ddd 0 2024-09-18T12:52:14.797 INFO:tasks.workunit.client.1.smithi161.stdout:5/768: dwrite d3/d9/d4b/f9c [0,4194304] 0 2024-09-18T12:52:14.798 INFO:tasks.workunit.client.0.smithi045.stdout:2/405: creat d5/d2c/d4d/f92 x:0 0 0 2024-09-18T12:52:14.799 INFO:tasks.workunit.client.0.smithi045.stdout:2/406: dread - d5/d5f/f78 zero size 2024-09-18T12:52:14.799 INFO:tasks.workunit.client.1.smithi161.stdout:1/678: truncate d1/d48/fb5 713067 0 2024-09-18T12:52:14.800 INFO:tasks.workunit.client.1.smithi161.stdout:4/867: creat d5/d27/d44/de2/dfe/f13e x:0 0 0 2024-09-18T12:52:14.801 INFO:tasks.workunit.client.0.smithi045.stdout:4/488: write db/de/d1e/d49/f4e [1688615,8821] 0 2024-09-18T12:52:14.801 INFO:tasks.workunit.client.1.smithi161.stdout:1/679: stat d1/da/d31/c95 0 2024-09-18T12:52:14.802 INFO:tasks.workunit.client.0.smithi045.stdout:4/489: write db/de/f9b [308180,49724] 0 2024-09-18T12:52:14.803 INFO:tasks.workunit.client.1.smithi161.stdout:1/680: chown d1/daa 7487879 1 2024-09-18T12:52:14.803 INFO:tasks.workunit.client.0.smithi045.stdout:2/407: fdatasync d5/d2c/d4d/d33/f3d 0 2024-09-18T12:52:14.803 INFO:tasks.workunit.client.0.smithi045.stdout:4/490: stat db/de/d1e/d3e/c8d 0 2024-09-18T12:52:14.805 INFO:tasks.workunit.client.0.smithi045.stdout:2/408: write d5/d2c/d4d/d76/f77 [87939,94258] 0 2024-09-18T12:52:14.805 INFO:tasks.workunit.client.1.smithi161.stdout:9/713: creat d0/d20/d74/fea x:0 0 0 2024-09-18T12:52:14.807 INFO:tasks.workunit.client.0.smithi045.stdout:2/409: write d5/d2c/d4d/d33/f3c [2901534,119823] 0 2024-09-18T12:52:14.807 INFO:tasks.workunit.client.1.smithi161.stdout:6/847: rename d4/d1a/d1c/d3e/d83/da2/db4/cfa to d4/d61/d69/c119 0 2024-09-18T12:52:14.809 INFO:tasks.workunit.client.0.smithi045.stdout:4/491: mkdir db/de/d1e/d3e/d9a/da2 0 2024-09-18T12:52:14.809 INFO:tasks.workunit.client.1.smithi161.stdout:8/820: getdents d0/d3/d10 0 2024-09-18T12:52:14.809 INFO:tasks.workunit.client.1.smithi161.stdout:6/848: chown d4/d39/d26/d31/c54 69 1 2024-09-18T12:52:14.810 INFO:tasks.workunit.client.1.smithi161.stdout:8/821: dread - d0/d3/fc3 zero size 2024-09-18T12:52:14.810 INFO:tasks.workunit.client.0.smithi045.stdout:4/492: write db/de/d1e/d3e/d9a/f2b [1095987,67256] 0 2024-09-18T12:52:14.812 INFO:tasks.workunit.client.1.smithi161.stdout:2/839: dread d0/d5/f74 [0,4194304] 0 2024-09-18T12:52:14.812 INFO:tasks.workunit.client.1.smithi161.stdout:0/828: mkdir df/de2/dc5/d86/da5/d12b 0 2024-09-18T12:52:14.814 INFO:tasks.workunit.client.1.smithi161.stdout:0/829: write df/de2/dc5/d86/f72 [8995532,2663] 0 2024-09-18T12:52:14.814 INFO:tasks.workunit.client.0.smithi045.stdout:4/493: dread db/de/d1a/d2e/f7f [0,4194304] 0 2024-09-18T12:52:14.817 INFO:tasks.workunit.client.1.smithi161.stdout:5/769: mknod d3/d8/de4/d8d/db0/cf7 0 2024-09-18T12:52:14.819 INFO:tasks.workunit.client.1.smithi161.stdout:1/681: mkdir d1/da/d1f/dab/daf/de8 0 2024-09-18T12:52:14.820 INFO:tasks.workunit.client.1.smithi161.stdout:9/714: creat d0/dd4/feb x:0 0 0 2024-09-18T12:52:14.827 INFO:tasks.workunit.client.1.smithi161.stdout:0/830: creat df/de2/dc5/d86/da5/f12c x:0 0 0 2024-09-18T12:52:14.828 INFO:tasks.workunit.client.1.smithi161.stdout:5/770: truncate d3/d8/de4/d8d/fd5 1839566 0 2024-09-18T12:52:14.830 INFO:tasks.workunit.client.0.smithi045.stdout:2/410: write d5/d2c/d4d/d33/f4f [802022,100102] 0 2024-09-18T12:52:14.831 INFO:tasks.workunit.client.1.smithi161.stdout:1/682: creat d1/daa/fe9 x:0 0 0 2024-09-18T12:52:14.831 INFO:tasks.workunit.client.0.smithi045.stdout:4/494: dread db/d20/f44 [4194304,4194304] 0 2024-09-18T12:52:14.832 INFO:tasks.workunit.client.1.smithi161.stdout:7/745: dwrite d3/d8/d15/da7/d24/d31/d7d/f9e [0,4194304] 0 2024-09-18T12:52:14.833 INFO:tasks.workunit.client.1.smithi161.stdout:8/822: mknod d0/d3/d10/d21/d4a/d52/d82/d96/dba/d10d/c117 0 2024-09-18T12:52:14.833 INFO:tasks.workunit.client.1.smithi161.stdout:9/715: dread d0/db/fbc [0,4194304] 0 2024-09-18T12:52:14.834 INFO:tasks.workunit.client.1.smithi161.stdout:1/683: dread - d1/daa/fce zero size 2024-09-18T12:52:14.834 INFO:tasks.workunit.client.1.smithi161.stdout:2/840: dread d0/f75 [0,4194304] 0 2024-09-18T12:52:14.835 INFO:tasks.workunit.client.1.smithi161.stdout:6/849: write d4/d61/d69/fc4 [803261,26324] 0 2024-09-18T12:52:14.836 INFO:tasks.workunit.client.1.smithi161.stdout:0/831: creat df/d29/d36/dde/f12d x:0 0 0 2024-09-18T12:52:14.838 INFO:tasks.workunit.client.1.smithi161.stdout:5/771: write d3/d9/d4b/d8e/d24/d61/fe5 [510312,88346] 0 2024-09-18T12:52:14.841 INFO:tasks.workunit.client.1.smithi161.stdout:4/868: dwrite d5/d27/d44/f101 [0,4194304] 0 2024-09-18T12:52:14.841 INFO:tasks.workunit.client.1.smithi161.stdout:8/823: creat d0/d3/d10/f118 x:0 0 0 2024-09-18T12:52:14.842 INFO:tasks.workunit.client.1.smithi161.stdout:1/684: write d1/d26/d88/fb0 [295019,78464] 0 2024-09-18T12:52:14.842 INFO:tasks.workunit.client.1.smithi161.stdout:0/832: fsync df/d30/d71/d96/dd3/d90/d37/dad/fea 0 2024-09-18T12:52:14.843 INFO:tasks.workunit.client.1.smithi161.stdout:0/833: dread - df/d29/d36/dde/f12d zero size 2024-09-18T12:52:14.844 INFO:tasks.workunit.client.1.smithi161.stdout:7/746: rename d3/d8/d4b/lc6 to d3/d8/d4b/le1 0 2024-09-18T12:52:14.845 INFO:tasks.workunit.client.1.smithi161.stdout:6/850: mknod d4/d61/d9d/c11a 0 2024-09-18T12:52:14.846 INFO:tasks.workunit.client.0.smithi045.stdout:4/495: truncate db/de/d1e/d3e/d47/d59/d2f/f36 2843361 0 2024-09-18T12:52:14.847 INFO:tasks.workunit.client.0.smithi045.stdout:2/411: dwrite d5/d2c/d4d/d33/f37 [0,4194304] 0 2024-09-18T12:52:14.848 INFO:tasks.workunit.client.0.smithi045.stdout:4/496: chown db/de/d1a/d2e/c4f 90932565 1 2024-09-18T12:52:14.849 INFO:tasks.workunit.client.1.smithi161.stdout:2/841: read d0/d5/d43/d35/f7a [657050,116943] 0 2024-09-18T12:52:14.851 INFO:tasks.workunit.client.1.smithi161.stdout:1/685: mknod d1/d26/d3a/d52/cea 0 2024-09-18T12:52:14.852 INFO:tasks.workunit.client.1.smithi161.stdout:7/747: unlink d3/f75 0 2024-09-18T12:52:14.853 INFO:tasks.workunit.client.0.smithi045.stdout:2/412: mkdir d5/d2c/d4d/d76/d93 0 2024-09-18T12:52:14.854 INFO:tasks.workunit.client.0.smithi045.stdout:4/497: dread db/de/d1e/d49/f64 [0,4194304] 0 2024-09-18T12:52:14.856 INFO:tasks.workunit.client.1.smithi161.stdout:9/716: rename d0/d20/cb8 to d0/d20/cec 0 2024-09-18T12:52:14.857 INFO:tasks.workunit.client.0.smithi045.stdout:2/413: mknod d5/d2c/d4d/d33/c94 0 2024-09-18T12:52:14.857 INFO:tasks.workunit.client.0.smithi045.stdout:4/498: dread db/f63 [0,4194304] 0 2024-09-18T12:52:14.861 INFO:tasks.workunit.client.1.smithi161.stdout:1/686: dwrite d1/ddd/fe1 [0,4194304] 0 2024-09-18T12:52:14.861 INFO:tasks.workunit.client.1.smithi161.stdout:7/748: truncate d3/d8/d15/da7/d4a/d64/d8c/fd8 953573 0 2024-09-18T12:52:14.862 INFO:tasks.workunit.client.1.smithi161.stdout:2/842: read d0/d1/f7 [2697882,91843] 0 2024-09-18T12:52:14.863 INFO:tasks.workunit.client.0.smithi045.stdout:4/499: symlink db/d2c/la3 0 2024-09-18T12:52:14.864 INFO:tasks.workunit.client.0.smithi045.stdout:2/414: dwrite d5/d2c/d6f/f81 [0,4194304] 0 2024-09-18T12:52:14.865 INFO:tasks.workunit.client.0.smithi045.stdout:4/500: write db/de/f6a [325764,51670] 0 2024-09-18T12:52:14.867 INFO:tasks.workunit.client.1.smithi161.stdout:1/687: write d1/d71/fac [819207,108877] 0 2024-09-18T12:52:14.869 INFO:tasks.workunit.client.1.smithi161.stdout:7/749: mkdir d3/d8/d15/de2 0 2024-09-18T12:52:14.869 INFO:tasks.workunit.client.1.smithi161.stdout:0/834: dwrite df/f32 [8388608,4194304] 0 2024-09-18T12:52:14.870 INFO:tasks.workunit.client.0.smithi045.stdout:2/415: truncate d5/d2c/d4d/f5a 923194 0 2024-09-18T12:52:14.873 INFO:tasks.workunit.client.1.smithi161.stdout:5/772: truncate d3/d8/f91 806080 0 2024-09-18T12:52:14.874 INFO:tasks.workunit.client.0.smithi045.stdout:4/501: dwrite db/d2c/d35/d40/f79 [0,4194304] 0 2024-09-18T12:52:14.874 INFO:tasks.workunit.client.1.smithi161.stdout:2/843: creat d0/d71/da9/d9f/dd0/f119 x:0 0 0 2024-09-18T12:52:14.875 INFO:tasks.workunit.client.1.smithi161.stdout:6/851: link d4/d39/d47/le1 d4/d1a/l11b 0 2024-09-18T12:52:14.875 INFO:tasks.workunit.client.1.smithi161.stdout:2/844: stat d0/d5/d43/fba 0 2024-09-18T12:52:14.878 INFO:tasks.workunit.client.1.smithi161.stdout:6/852: write d4/d1a/d1c/d3e/d83/dad/dbd/f108 [435952,21540] 0 2024-09-18T12:52:14.878 INFO:tasks.workunit.client.0.smithi045.stdout:2/416: rename d5/d46/l79 to d5/d2c/d6f/l95 0 2024-09-18T12:52:14.879 INFO:tasks.workunit.client.0.smithi045.stdout:2/417: readlink d5/d2c/d4d/d16/d61/l7b 0 2024-09-18T12:52:14.880 INFO:tasks.workunit.client.1.smithi161.stdout:1/688: symlink d1/d71/leb 0 2024-09-18T12:52:14.883 INFO:tasks.workunit.client.1.smithi161.stdout:7/750: symlink d3/d7e/le3 0 2024-09-18T12:52:14.884 INFO:tasks.workunit.client.1.smithi161.stdout:0/835: dread - df/d98/d128/fbd zero size 2024-09-18T12:52:14.885 INFO:tasks.workunit.client.0.smithi045.stdout:4/502: symlink db/la4 0 2024-09-18T12:52:14.886 INFO:tasks.workunit.client.1.smithi161.stdout:9/717: getdents d0/d16/d25/d86/dae 0 2024-09-18T12:52:14.887 INFO:tasks.workunit.client.1.smithi161.stdout:9/718: stat d0/db/c1d 0 2024-09-18T12:52:14.888 INFO:tasks.workunit.client.0.smithi045.stdout:4/503: symlink db/de/la5 0 2024-09-18T12:52:14.889 INFO:tasks.workunit.client.1.smithi161.stdout:2/845: creat d0/d5/d43/d23/ded/f11a x:0 0 0 2024-09-18T12:52:14.890 INFO:tasks.workunit.client.1.smithi161.stdout:2/846: stat d0/d4/d78/ffb 0 2024-09-18T12:52:14.892 INFO:tasks.workunit.client.1.smithi161.stdout:1/689: creat d1/d71/fec x:0 0 0 2024-09-18T12:52:14.894 INFO:tasks.workunit.client.1.smithi161.stdout:0/836: fdatasync df/f50 0 2024-09-18T12:52:14.895 INFO:tasks.workunit.client.0.smithi045.stdout:4/504: dwrite db/de/f7b [0,4194304] 0 2024-09-18T12:52:14.896 INFO:tasks.workunit.client.0.smithi045.stdout:4/505: readlink db/de/la5 0 2024-09-18T12:52:14.896 INFO:tasks.workunit.client.1.smithi161.stdout:5/773: dwrite d3/d3b/d7b/d82/f9d [0,4194304] 0 2024-09-18T12:52:14.897 INFO:tasks.workunit.client.1.smithi161.stdout:1/690: write d1/f15 [61488,5559] 0 2024-09-18T12:52:14.898 INFO:tasks.workunit.client.1.smithi161.stdout:6/853: link d4/d1a/d1c/d3e/d83/dad/dbd/cc3 d4/d39/d47/d88/c11c 0 2024-09-18T12:52:14.899 INFO:tasks.workunit.client.1.smithi161.stdout:1/691: chown d1/cb9 2 1 2024-09-18T12:52:14.899 INFO:tasks.workunit.client.1.smithi161.stdout:0/837: creat df/d29/f12e x:0 0 0 2024-09-18T12:52:14.900 INFO:tasks.workunit.client.0.smithi045.stdout:4/506: rename db/d2c/la3 to db/d2c/la6 0 2024-09-18T12:52:14.901 INFO:tasks.workunit.client.0.smithi045.stdout:4/507: readlink db/l15 0 2024-09-18T12:52:14.901 INFO:tasks.workunit.client.1.smithi161.stdout:6/854: chown d4/d39/d48/fec 2749 1 2024-09-18T12:52:14.902 INFO:tasks.workunit.client.1.smithi161.stdout:2/847: creat d0/d1/d4c/d67/db9/dcb/d8a/dfa/f11b x:0 0 0 2024-09-18T12:52:14.902 INFO:tasks.workunit.client.1.smithi161.stdout:5/774: truncate d3/d8/de4/d8d/dab/fd8 405383 0 2024-09-18T12:52:14.907 INFO:tasks.workunit.client.1.smithi161.stdout:9/719: dwrite d0/d16/f76 [0,4194304] 0 2024-09-18T12:52:14.908 INFO:tasks.workunit.client.1.smithi161.stdout:0/838: fdatasync df/d30/d71/d96/dd3/d78/fbc 0 2024-09-18T12:52:14.909 INFO:tasks.workunit.client.1.smithi161.stdout:1/692: truncate d1/da/d39/f37 9247404 0 2024-09-18T12:52:14.911 INFO:tasks.workunit.client.1.smithi161.stdout:5/775: mkdir d3/d8/df8 0 2024-09-18T12:52:14.912 INFO:tasks.workunit.client.0.smithi045.stdout:4/508: dwrite db/de/d1e/d3e/d47/d59/d7a/f8b [0,4194304] 0 2024-09-18T12:52:14.915 INFO:tasks.workunit.client.0.smithi045.stdout:8/410: sync 2024-09-18T12:52:14.917 INFO:tasks.workunit.client.1.smithi161.stdout:7/751: dread d3/d8/d15/f1e [0,4194304] 0 2024-09-18T12:52:14.917 INFO:tasks.workunit.client.0.smithi045.stdout:2/418: truncate d5/d2c/d4d/d33/f55 538003 0 2024-09-18T12:52:14.918 INFO:tasks.workunit.client.1.smithi161.stdout:2/848: dread d0/d5/d43/d35/f44 [0,4194304] 0 2024-09-18T12:52:14.919 INFO:tasks.workunit.client.1.smithi161.stdout:3/778: sync 2024-09-18T12:52:14.920 INFO:tasks.workunit.client.0.smithi045.stdout:4/509: creat db/d2c/d35/d40/d77/fa7 x:0 0 0 2024-09-18T12:52:14.920 INFO:tasks.workunit.client.1.smithi161.stdout:3/779: truncate d1/d2e/d14/d90/fd8 617136 0 2024-09-18T12:52:14.921 INFO:tasks.workunit.client.0.smithi045.stdout:4/510: stat db/de/d1e/d3e/d47/d59/l2a 0 2024-09-18T12:52:14.922 INFO:tasks.workunit.client.0.smithi045.stdout:4/511: write db/d20/f70 [98810,41447] 0 2024-09-18T12:52:14.924 INFO:tasks.workunit.client.1.smithi161.stdout:9/720: mkdir d0/d20/d74/ded 0 2024-09-18T12:52:14.925 INFO:tasks.workunit.client.0.smithi045.stdout:2/419: creat d5/d2c/d4d/d16/d61/f96 x:0 0 0 2024-09-18T12:52:14.928 INFO:tasks.workunit.client.1.smithi161.stdout:0/839: creat df/d30/d71/d96/dd3/d51/dc9/f12f x:0 0 0 2024-09-18T12:52:14.931 INFO:tasks.workunit.client.1.smithi161.stdout:5/776: symlink d3/d9/d85/dd3/lf9 0 2024-09-18T12:52:14.934 INFO:tasks.workunit.client.1.smithi161.stdout:5/777: write d3/d3b/d7b/da6/fa8 [1078087,28732] 0 2024-09-18T12:52:14.935 INFO:tasks.workunit.client.0.smithi045.stdout:2/420: mknod d5/d2c/d4d/c97 0 2024-09-18T12:52:14.936 INFO:tasks.workunit.client.1.smithi161.stdout:2/849: write d0/fa0 [4624282,15151] 0 2024-09-18T12:52:14.938 INFO:tasks.workunit.client.1.smithi161.stdout:0/840: dwrite df/d30/d71/d96/dd3/d90/d37/dad/fea [0,4194304] 0 2024-09-18T12:52:14.938 INFO:tasks.workunit.client.0.smithi045.stdout:4/512: link db/d1b/d6f/l86 db/de/d1e/d3e/d9a/d73/la8 0 2024-09-18T12:52:14.940 INFO:tasks.workunit.client.0.smithi045.stdout:2/421: creat d5/d2c/d4d/d76/d93/f98 x:0 0 0 2024-09-18T12:52:14.940 INFO:tasks.workunit.client.1.smithi161.stdout:3/780: dread d1/d2e/d24/d1d/f5d [0,4194304] 0 2024-09-18T12:52:14.941 INFO:tasks.workunit.client.1.smithi161.stdout:6/855: link d4/d1a/d1c/f24 d4/f11d 0 2024-09-18T12:52:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:9/721: dread d0/d16/d25/d28/f3f [0,4194304] 0 2024-09-18T12:52:14.943 INFO:tasks.workunit.client.0.smithi045.stdout:4/513: mkdir db/d2c/d35/d40/d6d/da9 0 2024-09-18T12:52:14.947 INFO:tasks.workunit.client.0.smithi045.stdout:2/422: creat d5/d5f/f99 x:0 0 0 2024-09-18T12:52:14.949 INFO:tasks.workunit.client.1.smithi161.stdout:7/752: symlink d3/d8/d15/le4 0 2024-09-18T12:52:14.949 INFO:tasks.workunit.client.0.smithi045.stdout:4/514: dread db/de/f6a [0,4194304] 0 2024-09-18T12:52:14.949 INFO:tasks.workunit.client.0.smithi045.stdout:8/411: dread d11/d14/f3a [0,4194304] 0 2024-09-18T12:52:14.950 INFO:tasks.workunit.client.0.smithi045.stdout:8/412: write d11/d23/f2b [1378157,43805] 0 2024-09-18T12:52:14.951 INFO:tasks.workunit.client.0.smithi045.stdout:4/515: chown db/de/d1e/d3e/d47/d59/f5f 254222 1 2024-09-18T12:52:14.952 INFO:tasks.workunit.client.0.smithi045.stdout:8/413: read d11/d20/f71 [3232528,91589] 0 2024-09-18T12:52:14.952 INFO:tasks.workunit.client.0.smithi045.stdout:4/516: chown db/d1b/d6f 893 1 2024-09-18T12:52:14.954 INFO:tasks.workunit.client.1.smithi161.stdout:5/778: mkdir d3/d44/d6f/d86/dfa 0 2024-09-18T12:52:14.957 INFO:tasks.workunit.client.1.smithi161.stdout:1/693: write d1/da/d9d/fa2 [797917,15533] 0 2024-09-18T12:52:14.958 INFO:tasks.workunit.client.1.smithi161.stdout:0/841: dread - df/d30/d71/fa9 zero size 2024-09-18T12:52:14.961 INFO:tasks.workunit.client.1.smithi161.stdout:3/781: write d1/d2e/d24/feb [2591597,62702] 0 2024-09-18T12:52:14.963 INFO:tasks.workunit.client.1.smithi161.stdout:3/782: truncate d1/d2e/d68/d69/ff9 217938 0 2024-09-18T12:52:14.964 INFO:tasks.workunit.client.1.smithi161.stdout:3/783: write d1/d2e/d68/d92/ded/f9b [119425,3667] 0 2024-09-18T12:52:14.965 INFO:tasks.workunit.client.0.smithi045.stdout:8/414: mknod d11/d14/c86 0 2024-09-18T12:52:14.966 INFO:tasks.workunit.client.0.smithi045.stdout:2/423: dread d5/d2c/d4d/d16/f64 [0,4194304] 0 2024-09-18T12:52:14.969 INFO:tasks.workunit.client.0.smithi045.stdout:3/404: sync 2024-09-18T12:52:14.969 INFO:tasks.workunit.client.0.smithi045.stdout:6/384: sync 2024-09-18T12:52:14.969 INFO:tasks.workunit.client.0.smithi045.stdout:7/321: sync 2024-09-18T12:52:14.969 INFO:tasks.workunit.client.0.smithi045.stdout:0/440: sync 2024-09-18T12:52:14.969 INFO:tasks.workunit.client.0.smithi045.stdout:5/524: sync 2024-09-18T12:52:14.969 INFO:tasks.workunit.client.0.smithi045.stdout:9/357: sync 2024-09-18T12:52:14.969 INFO:tasks.workunit.client.0.smithi045.stdout:1/388: sync 2024-09-18T12:52:14.971 INFO:tasks.workunit.client.0.smithi045.stdout:7/322: readlink d13/d1a/l5b 0 2024-09-18T12:52:14.972 INFO:tasks.workunit.client.1.smithi161.stdout:1/694: read d1/d26/f50 [1643970,63610] 0 2024-09-18T12:52:14.973 INFO:tasks.workunit.client.0.smithi045.stdout:9/358: truncate d0/d3/d6/f4f 612591 0 2024-09-18T12:52:14.974 INFO:tasks.workunit.client.0.smithi045.stdout:8/415: read d11/f12 [74791,25199] 0 2024-09-18T12:52:14.974 INFO:tasks.workunit.client.0.smithi045.stdout:9/359: readlink d0/d3/l1c 0 2024-09-18T12:52:14.975 INFO:tasks.workunit.client.0.smithi045.stdout:4/517: truncate db/de/f90 1519777 0 2024-09-18T12:52:14.976 INFO:tasks.workunit.client.0.smithi045.stdout:0/441: chown d6/d48/d5e/l41 20290 1 2024-09-18T12:52:14.976 INFO:tasks.workunit.client.0.smithi045.stdout:0/442: stat d6/d48/f6f 0 2024-09-18T12:52:14.977 INFO:tasks.workunit.client.1.smithi161.stdout:2/850: truncate d0/d1/d4c/d67/fa4 4029602 0 2024-09-18T12:52:14.977 INFO:tasks.workunit.client.0.smithi045.stdout:5/525: symlink d6/d28/d2b/d51/d97/lb5 0 2024-09-18T12:52:14.978 INFO:tasks.workunit.client.1.smithi161.stdout:7/753: dwrite d3/f23 [0,4194304] 0 2024-09-18T12:52:14.978 INFO:tasks.workunit.client.1.smithi161.stdout:6/856: symlink d4/d61/d69/da0/db0/l11e 0 2024-09-18T12:52:14.978 INFO:tasks.workunit.client.0.smithi045.stdout:1/389: readlink d0/d2d/d2b/d30/d40/l73 0 2024-09-18T12:52:14.980 INFO:tasks.workunit.client.1.smithi161.stdout:9/722: symlink d0/d16/d25/d46/d53/lee 0 2024-09-18T12:52:14.980 INFO:tasks.workunit.client.0.smithi045.stdout:3/405: mknod d0/d1e/d2c/d3a/d45/c84 0 2024-09-18T12:52:14.982 INFO:tasks.workunit.client.1.smithi161.stdout:7/754: readlink d3/d8/d15/da7/d24/d31/l45 0 2024-09-18T12:52:14.982 INFO:tasks.workunit.client.1.smithi161.stdout:3/784: symlink d1/d2e/d24/d1d/d89/db0/l110 0 2024-09-18T12:52:14.984 INFO:tasks.workunit.client.1.smithi161.stdout:5/779: creat d3/d8/df8/ffb x:0 0 0 2024-09-18T12:52:14.984 INFO:tasks.workunit.client.0.smithi045.stdout:9/360: mkdir d0/d3/d6/d10/d26/d2e/d4e/d76 0 2024-09-18T12:52:14.986 INFO:tasks.workunit.client.1.smithi161.stdout:0/842: dwrite df/d30/d71/d96/dd3/d90/d37/de0/f115 [4194304,4194304] 0 2024-09-18T12:52:14.987 INFO:tasks.workunit.client.1.smithi161.stdout:9/723: write d0/d20/d49/d65/fb7 [1763636,99545] 0 2024-09-18T12:52:14.990 INFO:tasks.workunit.client.0.smithi045.stdout:5/526: rename d6/d3e/f3a to d6/db/d54/fb6 0 2024-09-18T12:52:14.992 INFO:tasks.workunit.client.0.smithi045.stdout:4/518: dwrite f9 [4194304,4194304] 0 2024-09-18T12:52:14.993 INFO:tasks.workunit.client.1.smithi161.stdout:2/851: creat d0/d71/da9/d9f/dfe/f11c x:0 0 0 2024-09-18T12:52:14.999 INFO:tasks.workunit.client.0.smithi045.stdout:7/323: mkdir d13/d31/d29/d6d 0 2024-09-18T12:52:15.000 INFO:tasks.workunit.client.0.smithi045.stdout:7/324: chown d13/d31/d29/f60 64850394 1 2024-09-18T12:52:15.003 INFO:tasks.workunit.client.0.smithi045.stdout:2/424: truncate d5/d3a/f45 912765 0 2024-09-18T12:52:15.004 INFO:tasks.workunit.client.0.smithi045.stdout:8/416: getdents d11/d7b/d84 0 2024-09-18T12:52:15.004 INFO:tasks.workunit.client.0.smithi045.stdout:2/425: stat d5/c20 0 2024-09-18T12:52:15.005 INFO:tasks.workunit.client.0.smithi045.stdout:2/426: readlink d5/d2c/l47 0 2024-09-18T12:52:15.005 INFO:tasks.workunit.client.1.smithi161.stdout:3/785: symlink d1/d2e/d68/de8/l111 0 2024-09-18T12:52:15.007 INFO:tasks.workunit.client.0.smithi045.stdout:9/361: mkdir d0/d3/d6/d64/d77 0 2024-09-18T12:52:15.008 INFO:tasks.workunit.client.0.smithi045.stdout:7/325: dwrite d13/d31/f26 [4194304,4194304] 0 2024-09-18T12:52:15.010 INFO:tasks.workunit.client.1.smithi161.stdout:6/857: dread d4/d39/d48/f56 [0,4194304] 0 2024-09-18T12:52:15.011 INFO:tasks.workunit.client.1.smithi161.stdout:9/724: dread d0/db/f57 [0,4194304] 0 2024-09-18T12:52:15.014 INFO:tasks.workunit.client.1.smithi161.stdout:3/786: dwrite d1/d2e/d24/d1d/d89/fd4 [0,4194304] 0 2024-09-18T12:52:15.015 INFO:tasks.workunit.client.1.smithi161.stdout:7/755: fsync d3/d8/d15/da7/d4a/d64/f7b 0 2024-09-18T12:52:15.016 INFO:tasks.workunit.client.0.smithi045.stdout:4/519: write db/f30 [3469860,83557] 0 2024-09-18T12:52:15.018 INFO:tasks.workunit.client.0.smithi045.stdout:4/520: rename db/de to db/de/d1e/d3e/d9a/d73/d75/daa 22 2024-09-18T12:52:15.019 INFO:tasks.workunit.client.1.smithi161.stdout:2/852: creat d0/d71/da9/dd6/de8/f11d x:0 0 0 2024-09-18T12:52:15.019 INFO:tasks.workunit.client.1.smithi161.stdout:1/695: getdents d1/daa 0 2024-09-18T12:52:15.025 INFO:tasks.workunit.client.1.smithi161.stdout:9/725: rmdir d0/d20 39 2024-09-18T12:52:15.027 INFO:tasks.workunit.client.0.smithi045.stdout:7/326: chown d13/d44/d37/f4d 252503347 1 2024-09-18T12:52:15.028 INFO:tasks.workunit.client.1.smithi161.stdout:5/780: write d3/d9/f1c [1095979,10632] 0 2024-09-18T12:52:15.029 INFO:tasks.workunit.client.0.smithi045.stdout:7/327: truncate d13/d1a/f59 1069691 0 2024-09-18T12:52:15.031 INFO:tasks.workunit.client.0.smithi045.stdout:7/328: chown d13/d44/d4c/f62 517609367 1 2024-09-18T12:52:15.031 INFO:tasks.workunit.client.1.smithi161.stdout:7/756: mkdir d3/d8/d15/da7/d24/ddd/de5 0 2024-09-18T12:52:15.033 INFO:tasks.workunit.client.1.smithi161.stdout:2/853: creat d0/d1/deb/d3d/da5/f11e x:0 0 0 2024-09-18T12:52:15.034 INFO:tasks.workunit.client.1.smithi161.stdout:2/854: chown d0/d5/d43/d23/c3a 535 1 2024-09-18T12:52:15.034 INFO:tasks.workunit.client.1.smithi161.stdout:1/696: mkdir d1/d71/ded 0 2024-09-18T12:52:15.035 INFO:tasks.workunit.client.1.smithi161.stdout:1/697: chown d1/da/d39/c4d 178094 1 2024-09-18T12:52:15.035 INFO:tasks.workunit.client.0.smithi045.stdout:3/406: truncate d0/d1e/d2c/f42 1146748 0 2024-09-18T12:52:15.037 INFO:tasks.workunit.client.0.smithi045.stdout:8/417: symlink d11/d14/d53/d41/l87 0 2024-09-18T12:52:15.039 INFO:tasks.workunit.client.1.smithi161.stdout:9/726: dread d0/d16/d25/d46/d53/f7c [0,4194304] 0 2024-09-18T12:52:15.040 INFO:tasks.workunit.client.1.smithi161.stdout:9/727: fdatasync d0/dd4/feb 0 2024-09-18T12:52:15.041 INFO:tasks.workunit.client.1.smithi161.stdout:5/781: mknod d3/d9/d4b/d8e/d24/d61/cfc 0 2024-09-18T12:52:15.041 INFO:tasks.workunit.client.1.smithi161.stdout:5/782: chown d3/d8/de4/d8d/fba 1030 1 2024-09-18T12:52:15.041 INFO:tasks.workunit.client.1.smithi161.stdout:2/855: fsync d0/d1/deb/d7e/f70 0 2024-09-18T12:52:15.041 INFO:tasks.workunit.client.0.smithi045.stdout:8/418: dread d11/d14/f1e [0,4194304] 0 2024-09-18T12:52:15.042 INFO:tasks.workunit.client.0.smithi045.stdout:8/419: chown d11/d20/l7a 28809 1 2024-09-18T12:52:15.043 INFO:tasks.workunit.client.0.smithi045.stdout:8/420: dread - d11/f5f zero size 2024-09-18T12:52:15.043 INFO:tasks.workunit.client.0.smithi045.stdout:1/390: getdents d0/d12/d32 0 2024-09-18T12:52:15.045 INFO:tasks.workunit.client.1.smithi161.stdout:6/858: creat d4/d39/d47/f11f x:0 0 0 2024-09-18T12:52:15.045 INFO:tasks.workunit.client.0.smithi045.stdout:4/521: truncate db/f21 7486973 0 2024-09-18T12:52:15.049 INFO:tasks.workunit.client.1.smithi161.stdout:5/783: dwrite d3/d3b/fe8 [0,4194304] 0 2024-09-18T12:52:15.051 INFO:tasks.workunit.client.0.smithi045.stdout:8/421: dwrite d11/d14/d53/d41/f74 [0,4194304] 0 2024-09-18T12:52:15.051 INFO:tasks.workunit.client.1.smithi161.stdout:3/787: creat d1/d2e/d24/f112 x:0 0 0 2024-09-18T12:52:15.052 INFO:tasks.workunit.client.0.smithi045.stdout:8/422: write d11/d20/d46/f78 [506550,8576] 0 2024-09-18T12:52:15.053 INFO:tasks.workunit.client.0.smithi045.stdout:3/407: creat d0/d22/f85 x:0 0 0 2024-09-18T12:52:15.053 INFO:tasks.workunit.client.1.smithi161.stdout:1/698: dread d1/da/d31/f3e [0,4194304] 0 2024-09-18T12:52:15.054 INFO:tasks.workunit.client.1.smithi161.stdout:3/788: write d1/d2e/d14/d65/d76/d88/fcc [401051,126488] 0 2024-09-18T12:52:15.055 INFO:tasks.workunit.client.1.smithi161.stdout:9/728: symlink d0/d16/d25/d46/d53/d59/lef 0 2024-09-18T12:52:15.056 INFO:tasks.workunit.client.1.smithi161.stdout:1/699: write d1/da/d39/fa0 [1172988,121176] 0 2024-09-18T12:52:15.061 INFO:tasks.workunit.client.1.smithi161.stdout:2/856: creat d0/d1/deb/d3d/d4f/f11f x:0 0 0 2024-09-18T12:52:15.061 INFO:tasks.workunit.client.0.smithi045.stdout:3/408: dread d0/d1e/d39/f43 [0,4194304] 0 2024-09-18T12:52:15.062 INFO:tasks.workunit.client.0.smithi045.stdout:2/427: dwrite d5/d2c/d4d/f1b [0,4194304] 0 2024-09-18T12:52:15.066 INFO:tasks.workunit.client.0.smithi045.stdout:5/527: getdents d6/d28/d2b 0 2024-09-18T12:52:15.068 INFO:tasks.workunit.client.0.smithi045.stdout:2/428: chown d5/d2c/d4d/f8a 333 1 2024-09-18T12:52:15.068 INFO:tasks.workunit.client.0.smithi045.stdout:7/329: dread d13/d44/f1f [0,4194304] 0 2024-09-18T12:52:15.068 INFO:tasks.workunit.client.0.smithi045.stdout:5/528: dread - d6/db/d19/d92/d5c/f98 zero size 2024-09-18T12:52:15.070 INFO:tasks.workunit.client.1.smithi161.stdout:5/784: creat d3/d8/de4/d8d/db0/dd4/ffd x:0 0 0 2024-09-18T12:52:15.071 INFO:tasks.workunit.client.1.smithi161.stdout:5/785: read - d3/d8/de4/d8d/fba zero size 2024-09-18T12:52:15.072 INFO:tasks.workunit.client.0.smithi045.stdout:4/522: rename db/d1b/d6f to db/d2c/d35/d40/d77/dab 0 2024-09-18T12:52:15.072 INFO:tasks.workunit.client.0.smithi045.stdout:4/523: chown db/c28 215227828 1 2024-09-18T12:52:15.073 INFO:tasks.workunit.client.1.smithi161.stdout:5/786: fdatasync d3/d9/d4b/f51 0 2024-09-18T12:52:15.077 INFO:tasks.workunit.client.0.smithi045.stdout:9/362: getdents d0/d3/d6/d10/d26/d2e/d4e 0 2024-09-18T12:52:15.078 INFO:tasks.workunit.client.0.smithi045.stdout:3/409: mknod d0/d1e/d2c/d3a/c86 0 2024-09-18T12:52:15.079 INFO:tasks.workunit.client.1.smithi161.stdout:1/700: dread d1/d26/dad/db6/fd5 [0,4194304] 0 2024-09-18T12:52:15.081 INFO:tasks.workunit.client.1.smithi161.stdout:5/787: mknod d3/d44/d6f/cfe 0 2024-09-18T12:52:15.082 INFO:tasks.workunit.client.1.smithi161.stdout:2/857: dread d0/d5/d53/f5b [0,4194304] 0 2024-09-18T12:52:15.085 INFO:tasks.workunit.client.0.smithi045.stdout:8/423: creat d11/d76/f88 x:0 0 0 2024-09-18T12:52:15.086 INFO:tasks.workunit.client.0.smithi045.stdout:8/424: write d11/d14/f19 [3846755,51017] 0 2024-09-18T12:52:15.091 INFO:tasks.workunit.client.1.smithi161.stdout:6/859: getdents d4/d39/d3a 0 2024-09-18T12:52:15.093 INFO:tasks.workunit.client.1.smithi161.stdout:1/701: symlink d1/da/d1f/dab/daf/de8/lee 0 2024-09-18T12:52:15.098 INFO:tasks.workunit.client.1.smithi161.stdout:1/702: creat d1/d71/fef x:0 0 0 2024-09-18T12:52:15.098 INFO:tasks.workunit.client.0.smithi045.stdout:8/425: creat d11/d20/d59/f89 x:0 0 0 2024-09-18T12:52:15.100 INFO:tasks.workunit.client.0.smithi045.stdout:8/426: dread - d11/d20/d59/f89 zero size 2024-09-18T12:52:15.101 INFO:tasks.workunit.client.1.smithi161.stdout:3/789: dread d1/f12 [0,4194304] 0 2024-09-18T12:52:15.102 INFO:tasks.workunit.client.1.smithi161.stdout:1/703: chown d1/da/l29 37 1 2024-09-18T12:52:15.103 INFO:tasks.workunit.client.0.smithi045.stdout:5/529: creat d6/d28/d2b/d51/fb7 x:0 0 0 2024-09-18T12:52:15.104 INFO:tasks.workunit.client.1.smithi161.stdout:5/788: link d3/d9/cbb d3/d9/d4b/d8e/d24/d61/de6/cff 0 2024-09-18T12:52:15.104 INFO:tasks.workunit.client.1.smithi161.stdout:4/869: sync 2024-09-18T12:52:15.106 INFO:tasks.workunit.client.0.smithi045.stdout:7/330: link d13/d1a/f41 d13/d31/d33/f6e 0 2024-09-18T12:52:15.106 INFO:tasks.workunit.client.1.smithi161.stdout:9/729: dread d0/d20/d49/f7e [0,4194304] 0 2024-09-18T12:52:15.107 INFO:tasks.workunit.client.0.smithi045.stdout:4/524: write db/de/f90 [638809,84540] 0 2024-09-18T12:52:15.107 INFO:tasks.workunit.client.1.smithi161.stdout:9/730: fdatasync d0/db/fcf 0 2024-09-18T12:52:15.107 INFO:tasks.workunit.client.1.smithi161.stdout:6/860: write d4/f71 [933528,66797] 0 2024-09-18T12:52:15.108 INFO:tasks.workunit.client.1.smithi161.stdout:6/861: chown d4/d39/d26/d31 195144668 1 2024-09-18T12:52:15.108 INFO:tasks.workunit.client.1.smithi161.stdout:5/789: rmdir d3/d9/d4b/d8e 39 2024-09-18T12:52:15.109 INFO:tasks.workunit.client.0.smithi045.stdout:8/427: dread d11/d23/f2b [0,4194304] 0 2024-09-18T12:52:15.109 INFO:tasks.workunit.client.0.smithi045.stdout:7/331: stat d13/d31/d5f 0 2024-09-18T12:52:15.112 INFO:tasks.workunit.client.0.smithi045.stdout:2/429: dread d5/d46/f70 [0,4194304] 0 2024-09-18T12:52:15.114 INFO:tasks.workunit.client.0.smithi045.stdout:5/530: dwrite d6/d3e/f36 [0,4194304] 0 2024-09-18T12:52:15.114 INFO:tasks.workunit.client.0.smithi045.stdout:8/428: read f6 [207077,104424] 0 2024-09-18T12:52:15.114 INFO:tasks.workunit.client.0.smithi045.stdout:9/363: truncate d0/d3/d6/d10/d26/d2e/d4e/f68 3949287 0 2024-09-18T12:52:15.114 INFO:tasks.workunit.client.1.smithi161.stdout:3/790: creat d1/d2e/d24/d1d/d89/db0/de4/f113 x:0 0 0 2024-09-18T12:52:15.116 INFO:tasks.workunit.client.0.smithi045.stdout:4/525: creat db/d20/fac x:0 0 0 2024-09-18T12:52:15.116 INFO:tasks.workunit.client.0.smithi045.stdout:9/364: stat d0/d3/d6/d10/d26/d2e/l58 0 2024-09-18T12:52:15.117 INFO:tasks.workunit.client.1.smithi161.stdout:3/791: truncate d1/d2e/d68/d92/dba/fee 776910 0 2024-09-18T12:52:15.122 INFO:tasks.workunit.client.0.smithi045.stdout:4/526: dread db/de/d1e/d49/f64 [0,4194304] 0 2024-09-18T12:52:15.122 INFO:tasks.workunit.client.1.smithi161.stdout:5/790: creat d3/d8/de4/d8d/dab/f100 x:0 0 0 2024-09-18T12:52:15.122 INFO:tasks.workunit.client.1.smithi161.stdout:4/870: getdents d5/d14/d67/dc7/d60/d95/dda/de1 0 2024-09-18T12:52:15.123 INFO:tasks.workunit.client.1.smithi161.stdout:5/791: chown d3/d9/ff2 965 1 2024-09-18T12:52:15.123 INFO:tasks.workunit.client.0.smithi045.stdout:2/430: mkdir d5/d3a/d3e/d9a 0 2024-09-18T12:52:15.124 INFO:tasks.workunit.client.1.smithi161.stdout:3/792: rmdir d1/d2e/d14/d78 39 2024-09-18T12:52:15.125 INFO:tasks.workunit.client.1.smithi161.stdout:3/793: readlink d1/d2e/d14/d65/d76/l7e 0 2024-09-18T12:52:15.126 INFO:tasks.workunit.client.0.smithi045.stdout:5/531: rename d6/d3e/fa8 to d6/d3e/fb8 0 2024-09-18T12:52:15.126 INFO:tasks.workunit.client.1.smithi161.stdout:9/731: dread d0/f6e [0,4194304] 0 2024-09-18T12:52:15.129 INFO:tasks.workunit.client.1.smithi161.stdout:4/871: dread d5/d27/d44/de2/fb7 [0,4194304] 0 2024-09-18T12:52:15.129 INFO:tasks.workunit.client.0.smithi045.stdout:9/365: dread d0/d3/d6/d10/f2a [0,4194304] 0 2024-09-18T12:52:15.131 INFO:tasks.workunit.client.1.smithi161.stdout:3/794: creat d1/d2e/d68/f114 x:0 0 0 2024-09-18T12:52:15.132 INFO:tasks.workunit.client.1.smithi161.stdout:6/862: dread d4/d1a/d1c/d7c/f9f [0,4194304] 0 2024-09-18T12:52:15.133 INFO:tasks.workunit.client.1.smithi161.stdout:9/732: mknod d0/d47/d48/d7f/d84/cf0 0 2024-09-18T12:52:15.133 INFO:tasks.workunit.client.1.smithi161.stdout:3/795: rename d1 to d1/d2e/d68/d92/ded/d49/dce/d115 22 2024-09-18T12:52:15.136 INFO:tasks.workunit.client.1.smithi161.stdout:6/863: truncate d4/d1a/d1c/d3e/d83/dad/dbd/f108 523563 0 2024-09-18T12:52:15.136 INFO:tasks.workunit.client.1.smithi161.stdout:5/792: link d3/d9/d4b/f9c d3/d3b/d54/f101 0 2024-09-18T12:52:15.139 INFO:tasks.workunit.client.1.smithi161.stdout:4/872: mknod d5/d14/d67/dc7/d4c/c13f 0 2024-09-18T12:52:15.139 INFO:tasks.workunit.client.1.smithi161.stdout:2/858: dread d0/d5/d43/d35/fa3 [0,4194304] 0 2024-09-18T12:52:15.140 INFO:tasks.workunit.client.0.smithi045.stdout:5/532: truncate d6/d3e/f9b 1907458 0 2024-09-18T12:52:15.142 INFO:tasks.workunit.client.1.smithi161.stdout:3/796: dwrite d1/d2e/d24/d1d/d89/fd4 [0,4194304] 0 2024-09-18T12:52:15.143 INFO:tasks.workunit.client.0.smithi045.stdout:7/332: dread d13/d31/d29/f3c [0,4194304] 0 2024-09-18T12:52:15.151 INFO:tasks.workunit.client.1.smithi161.stdout:6/864: dread d4/fa8 [0,4194304] 0 2024-09-18T12:52:15.158 INFO:tasks.workunit.client.1.smithi161.stdout:3/797: dread d1/d2e/f6e [0,4194304] 0 2024-09-18T12:52:15.159 INFO:tasks.workunit.client.1.smithi161.stdout:5/793: dread d3/d9/dd7/fed [0,4194304] 0 2024-09-18T12:52:15.162 INFO:tasks.workunit.client.1.smithi161.stdout:9/733: rename d0/d16/d25/d46/d53 to d0/d47/df1 0 2024-09-18T12:52:15.163 INFO:tasks.workunit.client.0.smithi045.stdout:9/366: fdatasync d0/d3/f2b 0 2024-09-18T12:52:15.164 INFO:tasks.workunit.client.0.smithi045.stdout:9/367: dread - d0/d3/d6/d10/d26/d2e/f6a zero size 2024-09-18T12:52:15.168 INFO:tasks.workunit.client.0.smithi045.stdout:8/429: rmdir d11/d14/d53/d41/d57/d82 0 2024-09-18T12:52:15.170 INFO:tasks.workunit.client.1.smithi161.stdout:4/873: creat d5/d27/d44/de2/dfe/f140 x:0 0 0 2024-09-18T12:52:15.171 INFO:tasks.workunit.client.0.smithi045.stdout:2/431: write d5/d2c/d4d/d16/f3b [777346,22170] 0 2024-09-18T12:52:15.173 INFO:tasks.workunit.client.0.smithi045.stdout:7/333: symlink d13/d44/l6f 0 2024-09-18T12:52:15.174 INFO:tasks.workunit.client.0.smithi045.stdout:7/334: chown d13/d31/d29/c65 1 1 2024-09-18T12:52:15.175 INFO:tasks.workunit.client.1.smithi161.stdout:6/865: mkdir d4/d61/d9d/d120 0 2024-09-18T12:52:15.175 INFO:tasks.workunit.client.1.smithi161.stdout:6/866: truncate d4/d61/d69/fe7 320385 0 2024-09-18T12:52:15.176 INFO:tasks.workunit.client.1.smithi161.stdout:3/798: symlink d1/d2e/d68/d92/dba/dd9/l116 0 2024-09-18T12:52:15.177 INFO:tasks.workunit.client.1.smithi161.stdout:8/824: sync 2024-09-18T12:52:15.179 INFO:tasks.workunit.client.0.smithi045.stdout:7/335: dwrite d13/f32 [0,4194304] 0 2024-09-18T12:52:15.181 INFO:tasks.workunit.client.1.smithi161.stdout:5/794: symlink d3/d3b/d7b/l102 0 2024-09-18T12:52:15.182 INFO:tasks.workunit.client.1.smithi161.stdout:5/795: chown d3/d9/d85/dd3 1 1 2024-09-18T12:52:15.182 INFO:tasks.workunit.client.1.smithi161.stdout:6/867: dwrite d4/d1a/d1c/d3e/d83/dad/dbd/f108 [0,4194304] 0 2024-09-18T12:52:15.183 INFO:tasks.workunit.client.0.smithi045.stdout:9/368: mknod d0/d3/d6/d10/d2c/c78 0 2024-09-18T12:52:15.184 INFO:tasks.workunit.client.0.smithi045.stdout:7/336: dread d13/d44/f1f [0,4194304] 0 2024-09-18T12:52:15.186 INFO:tasks.workunit.client.1.smithi161.stdout:2/859: creat d0/d5/d43/d35/d98/de1/f120 x:0 0 0 2024-09-18T12:52:15.193 INFO:tasks.workunit.client.0.smithi045.stdout:4/527: dwrite db/de/d1e/d3e/d47/d59/d2f/f36 [0,4194304] 0 2024-09-18T12:52:15.193 INFO:tasks.workunit.client.0.smithi045.stdout:2/432: symlink d5/d2c/d4d/d16/d61/l9b 0 2024-09-18T12:52:15.197 INFO:tasks.workunit.client.1.smithi161.stdout:8/825: read - d0/d3/d10/d21/d4a/d52/d82/d8b/fcb zero size 2024-09-18T12:52:15.198 INFO:tasks.workunit.client.0.smithi045.stdout:7/337: dwrite d13/d31/d5f/f69 [0,4194304] 0 2024-09-18T12:52:15.200 INFO:tasks.workunit.client.1.smithi161.stdout:5/796: symlink d3/d3b/d54/l103 0 2024-09-18T12:52:15.203 INFO:tasks.workunit.client.1.smithi161.stdout:6/868: truncate d4/d1a/d1c/d3e/d83/fd8 560974 0 2024-09-18T12:52:15.203 INFO:tasks.workunit.client.1.smithi161.stdout:6/869: chown d4/d61/d9d/d120 196408 1 2024-09-18T12:52:15.204 INFO:tasks.workunit.client.1.smithi161.stdout:2/860: creat d0/d1/deb/d3d/d4f/d9b/f121 x:0 0 0 2024-09-18T12:52:15.205 INFO:tasks.workunit.client.1.smithi161.stdout:6/870: stat d4/d1a/d1c/d3e/d83/d9e/db1/d45/dd6/ff2 0 2024-09-18T12:52:15.209 INFO:tasks.workunit.client.1.smithi161.stdout:8/826: fdatasync d0/f5a 0 2024-09-18T12:52:15.209 INFO:tasks.workunit.client.0.smithi045.stdout:4/528: dwrite db/d2c/d35/fa1 [0,4194304] 0 2024-09-18T12:52:15.211 INFO:tasks.workunit.client.0.smithi045.stdout:2/433: dwrite d5/d2c/d4d/d16/f31 [0,4194304] 0 2024-09-18T12:52:15.213 INFO:tasks.workunit.client.0.smithi045.stdout:4/529: chown db/de/d1e/d3e/d9a/d73 297 1 2024-09-18T12:52:15.214 INFO:tasks.workunit.client.1.smithi161.stdout:6/871: creat d4/d39/d48/f121 x:0 0 0 2024-09-18T12:52:15.215 INFO:tasks.workunit.client.1.smithi161.stdout:6/872: stat d4/d1a/d1c/d3e/d83/da2/fd5 0 2024-09-18T12:52:15.216 INFO:tasks.workunit.client.0.smithi045.stdout:4/530: dread - db/de/d1e/d3e/d47/d59/f87 zero size 2024-09-18T12:52:15.218 INFO:tasks.workunit.client.0.smithi045.stdout:4/531: write db/d2c/d35/d40/d77/fa7 [458259,87579] 0 2024-09-18T12:52:15.219 INFO:tasks.workunit.client.1.smithi161.stdout:2/861: rename d0/d5/d43/d23/c63 to d0/d5/d43/d35/dee/d109/c122 0 2024-09-18T12:52:15.222 INFO:tasks.workunit.client.0.smithi045.stdout:7/338: mkdir d13/d44/d37/d70 0 2024-09-18T12:52:15.223 INFO:tasks.workunit.client.0.smithi045.stdout:5/533: getdents d6/d28/d2b 0 2024-09-18T12:52:15.224 INFO:tasks.workunit.client.0.smithi045.stdout:2/434: symlink d5/d5f/l9c 0 2024-09-18T12:52:15.229 INFO:tasks.workunit.client.0.smithi045.stdout:8/430: dwrite d11/d14/d53/f4f [0,4194304] 0 2024-09-18T12:52:15.229 INFO:tasks.workunit.client.1.smithi161.stdout:6/873: unlink d4/d1a/d1c/d3e/d83/dad/c106 0 2024-09-18T12:52:15.230 INFO:tasks.workunit.client.1.smithi161.stdout:6/874: write d4/d39/d47/f11f [311283,103944] 0 2024-09-18T12:52:15.231 INFO:tasks.workunit.client.0.smithi045.stdout:2/435: mkdir d5/d2c/d6f/d9d 0 2024-09-18T12:52:15.231 INFO:tasks.workunit.client.1.smithi161.stdout:3/799: write d1/f8b [3463201,36051] 0 2024-09-18T12:52:15.234 INFO:tasks.workunit.client.1.smithi161.stdout:8/827: rename d0/f2a to d0/d3/d91/f119 0 2024-09-18T12:52:15.234 INFO:tasks.workunit.client.0.smithi045.stdout:7/339: fsync d13/d44/f1f 0 2024-09-18T12:52:15.236 INFO:tasks.workunit.client.0.smithi045.stdout:7/340: write d13/f24 [2702155,91142] 0 2024-09-18T12:52:15.237 INFO:tasks.workunit.client.1.smithi161.stdout:8/828: dread - d0/d3/d10/d21/d4a/d52/fcf zero size 2024-09-18T12:52:15.240 INFO:tasks.workunit.client.1.smithi161.stdout:3/800: dread d1/d2e/d68/f87 [0,4194304] 0 2024-09-18T12:52:15.241 INFO:tasks.workunit.client.1.smithi161.stdout:6/875: dread d4/f97 [0,4194304] 0 2024-09-18T12:52:15.242 INFO:tasks.workunit.client.0.smithi045.stdout:9/369: dread d0/d3/d6/d10/f1b [0,4194304] 0 2024-09-18T12:52:15.246 INFO:tasks.workunit.client.1.smithi161.stdout:3/801: dwrite d1/d2e/d14/d65/f81 [0,4194304] 0 2024-09-18T12:52:15.247 INFO:tasks.workunit.client.1.smithi161.stdout:6/876: mknod d4/d1a/d1c/d3e/d83/dad/dbd/c122 0 2024-09-18T12:52:15.249 INFO:tasks.workunit.client.0.smithi045.stdout:7/341: symlink d13/d44/d37/d70/l71 0 2024-09-18T12:52:15.251 INFO:tasks.workunit.client.1.smithi161.stdout:5/797: dwrite d3/d9/d4b/d8e/d24/db8/da4/daf/fb2 [0,4194304] 0 2024-09-18T12:52:15.252 INFO:tasks.workunit.client.1.smithi161.stdout:3/802: mknod d1/d2e/d14/d2c/d72/c117 0 2024-09-18T12:52:15.253 INFO:tasks.workunit.client.0.smithi045.stdout:4/532: truncate db/de/d1e/d3e/d9a/f2b 5970892 0 2024-09-18T12:52:15.255 INFO:tasks.workunit.client.0.smithi045.stdout:7/342: mkdir d13/d44/d37/d72 0 2024-09-18T12:52:15.256 INFO:tasks.workunit.client.1.smithi161.stdout:8/829: getdents d0/d3/d1e 0 2024-09-18T12:52:15.258 INFO:tasks.workunit.client.0.smithi045.stdout:2/436: getdents d5/d2c/d4d/d33 0 2024-09-18T12:52:15.258 INFO:tasks.workunit.client.1.smithi161.stdout:6/877: rmdir d4/d1a/d1c/d3e/d83/d9e/db1/d28 39 2024-09-18T12:52:15.258 INFO:tasks.workunit.client.0.smithi045.stdout:8/431: write d11/d14/f1b [487481,125901] 0 2024-09-18T12:52:15.259 INFO:tasks.workunit.client.1.smithi161.stdout:6/878: chown d4/d61/fd3 2510688 1 2024-09-18T12:52:15.260 INFO:tasks.workunit.client.0.smithi045.stdout:7/343: creat d13/d31/d5f/f73 x:0 0 0 2024-09-18T12:52:15.260 INFO:tasks.workunit.client.0.smithi045.stdout:4/533: dread db/de/d1e/f2d [0,4194304] 0 2024-09-18T12:52:15.261 INFO:tasks.workunit.client.1.smithi161.stdout:5/798: creat d3/d8/de4/f104 x:0 0 0 2024-09-18T12:52:15.261 INFO:tasks.workunit.client.0.smithi045.stdout:4/534: chown db/d2c/d35/d40/d77/f4c 11508 1 2024-09-18T12:52:15.262 INFO:tasks.workunit.client.1.smithi161.stdout:3/803: dwrite d1/d2e/d24/d1d/d89/db0/fa2 [0,4194304] 0 2024-09-18T12:52:15.268 INFO:tasks.workunit.client.1.smithi161.stdout:6/879: mknod d4/d39/d26/c123 0 2024-09-18T12:52:15.269 INFO:tasks.workunit.client.0.smithi045.stdout:4/535: rename db/de/d1a/d2e/c4f to db/d20/d6b/cad 0 2024-09-18T12:52:15.269 INFO:tasks.workunit.client.0.smithi045.stdout:4/536: fsync db/de/d1a/d2e/f92 0 2024-09-18T12:52:15.270 INFO:tasks.workunit.client.1.smithi161.stdout:3/804: mknod d1/d2e/d14/d65/c118 0 2024-09-18T12:52:15.272 INFO:tasks.workunit.client.0.smithi045.stdout:4/537: dread db/de/d1a/f3d [4194304,4194304] 0 2024-09-18T12:52:15.272 INFO:tasks.workunit.client.0.smithi045.stdout:8/432: rmdir d11/d7b/d84 0 2024-09-18T12:52:15.272 INFO:tasks.workunit.client.1.smithi161.stdout:8/830: getdents d0/d3/d1e 0 2024-09-18T12:52:15.273 INFO:tasks.workunit.client.1.smithi161.stdout:6/880: fsync d4/d1a/f13 0 2024-09-18T12:52:15.274 INFO:tasks.workunit.client.0.smithi045.stdout:7/344: link d13/d44/d37/c4b d13/d31/d33/c74 0 2024-09-18T12:52:15.274 INFO:tasks.workunit.client.0.smithi045.stdout:7/345: chown c12 1 1 2024-09-18T12:52:15.275 INFO:tasks.workunit.client.1.smithi161.stdout:3/805: symlink d1/d2e/d68/d92/l119 0 2024-09-18T12:52:15.277 INFO:tasks.workunit.client.0.smithi045.stdout:4/538: creat db/de/fae x:0 0 0 2024-09-18T12:52:15.277 INFO:tasks.workunit.client.1.smithi161.stdout:8/831: mknod d0/d3/d10/d21/d4a/d52/d82/d96/dba/d10d/c11a 0 2024-09-18T12:52:15.278 INFO:tasks.workunit.client.0.smithi045.stdout:2/437: getdents d5/d3a/d6b 0 2024-09-18T12:52:15.279 INFO:tasks.workunit.client.0.smithi045.stdout:2/438: dread - d5/d5f/f83 zero size 2024-09-18T12:52:15.280 INFO:tasks.workunit.client.0.smithi045.stdout:8/433: mknod d11/d7b/c8a 0 2024-09-18T12:52:15.280 INFO:tasks.workunit.client.1.smithi161.stdout:5/799: link d3/d44/d6f/d86/leb d3/d8/de4/d8d/l105 0 2024-09-18T12:52:15.280 INFO:tasks.workunit.client.0.smithi045.stdout:7/346: dwrite d13/f32 [0,4194304] 0 2024-09-18T12:52:15.282 INFO:tasks.workunit.client.1.smithi161.stdout:3/806: creat d1/d2e/d68/de8/df6/f11a x:0 0 0 2024-09-18T12:52:15.285 INFO:tasks.workunit.client.0.smithi045.stdout:2/439: dread d5/d46/f86 [0,4194304] 0 2024-09-18T12:52:15.288 INFO:tasks.workunit.client.1.smithi161.stdout:3/807: fdatasync d1/d2e/d14/d78/d83/f101 0 2024-09-18T12:52:15.289 INFO:tasks.workunit.client.1.smithi161.stdout:3/808: chown d1/d2e/d68/d92/ded/f80 418 1 2024-09-18T12:52:15.290 INFO:tasks.workunit.client.0.smithi045.stdout:2/440: stat d5/d2c/d4d/c18 0 2024-09-18T12:52:15.291 INFO:tasks.workunit.client.0.smithi045.stdout:4/539: dwrite db/de/d1a/f3d [0,4194304] 0 2024-09-18T12:52:15.292 INFO:tasks.workunit.client.1.smithi161.stdout:6/881: rename d4/d1a/d1c/d3e/d83/d9e/db1/d28/d81/lf3 to d4/d1a/d1c/d3e/d83/dad/dbd/l124 0 2024-09-18T12:52:15.294 INFO:tasks.workunit.client.1.smithi161.stdout:5/800: mknod d3/d9/c106 0 2024-09-18T12:52:15.299 INFO:tasks.workunit.client.1.smithi161.stdout:3/809: rmdir d1/d2e/d14/d78/d83 39 2024-09-18T12:52:15.300 INFO:tasks.workunit.client.1.smithi161.stdout:3/810: chown d1/d2e/d14/d65/d76/d8c/f8d 16144483 1 2024-09-18T12:52:15.301 INFO:tasks.workunit.client.0.smithi045.stdout:2/441: mkdir d5/d3a/d3e/d9e 0 2024-09-18T12:52:15.302 INFO:tasks.workunit.client.1.smithi161.stdout:6/882: mkdir d4/d1a/d1c/d3e/d4d/d125 0 2024-09-18T12:52:15.304 INFO:tasks.workunit.client.0.smithi045.stdout:2/442: rmdir d5/d5f 39 2024-09-18T12:52:15.309 INFO:tasks.workunit.client.1.smithi161.stdout:5/801: dwrite d3/d3b/f42 [4194304,4194304] 0 2024-09-18T12:52:15.311 INFO:tasks.workunit.client.0.smithi045.stdout:4/540: creat db/d2c/d35/d40/faf x:0 0 0 2024-09-18T12:52:15.314 INFO:tasks.workunit.client.1.smithi161.stdout:6/883: creat d4/d1a/d1c/d3e/d83/d9e/d102/f126 x:0 0 0 2024-09-18T12:52:15.315 INFO:tasks.workunit.client.1.smithi161.stdout:6/884: stat d4/d39/d47/cd1 0 2024-09-18T12:52:15.318 INFO:tasks.workunit.client.1.smithi161.stdout:8/832: write d0/d3/d10/d21/fb6 [3536098,64976] 0 2024-09-18T12:52:15.319 INFO:tasks.workunit.client.1.smithi161.stdout:5/802: creat d3/d9/f107 x:0 0 0 2024-09-18T12:52:15.321 INFO:tasks.workunit.client.1.smithi161.stdout:6/885: link d4/d1a/d1c/d3e/d83/da2/fd5 d4/d1a/d1c/d3e/d83/da2/f127 0 2024-09-18T12:52:15.322 INFO:tasks.workunit.client.1.smithi161.stdout:5/803: creat d3/d3b/d7b/da6/f108 x:0 0 0 2024-09-18T12:52:15.323 INFO:tasks.workunit.client.1.smithi161.stdout:6/886: creat d4/d1a/d1c/d3e/d83/da2/f128 x:0 0 0 2024-09-18T12:52:15.329 INFO:tasks.workunit.client.1.smithi161.stdout:0/843: sync 2024-09-18T12:52:15.331 INFO:tasks.workunit.client.1.smithi161.stdout:5/804: write d3/d9/d4b/f99 [1279609,66548] 0 2024-09-18T12:52:15.331 INFO:tasks.workunit.client.1.smithi161.stdout:6/887: dwrite d4/d1a/d1c/d3e/d83/d9e/db1/d45/dd6/fe0 [0,4194304] 0 2024-09-18T12:52:15.333 INFO:tasks.workunit.client.1.smithi161.stdout:5/805: stat d3/d3b/fe8 0 2024-09-18T12:52:15.335 INFO:tasks.workunit.client.1.smithi161.stdout:3/811: dwrite d1/d2e/d24/d1d/d89/db0/fa6 [0,4194304] 0 2024-09-18T12:52:15.339 INFO:tasks.workunit.client.1.smithi161.stdout:6/888: read - d4/d1a/d1c/d3e/d83/d9e/db1/d28/f37 zero size 2024-09-18T12:52:15.339 INFO:tasks.workunit.client.1.smithi161.stdout:0/844: write df/d30/d71/d96/dd3/d90/d37/faf [814824,100563] 0 2024-09-18T12:52:15.340 INFO:tasks.workunit.client.1.smithi161.stdout:8/833: dwrite d0/d3/d10/d21/d4a/d52/f58 [0,4194304] 0 2024-09-18T12:52:15.342 INFO:tasks.workunit.client.1.smithi161.stdout:6/889: dread - d4/d61/ff5 zero size 2024-09-18T12:52:15.344 INFO:tasks.workunit.client.1.smithi161.stdout:8/834: chown d0/d3/d10/d21/d4a/l104 31141274 1 2024-09-18T12:52:15.348 INFO:tasks.workunit.client.1.smithi161.stdout:5/806: dwrite d3/d9/f12 [0,4194304] 0 2024-09-18T12:52:15.351 INFO:tasks.workunit.client.1.smithi161.stdout:3/812: rename d1/d2e/d14/d78/cd0 to d1/d2e/d68/de8/df6/c11b 0 2024-09-18T12:52:15.352 INFO:tasks.workunit.client.1.smithi161.stdout:8/835: creat d0/d3/d1e/dda/de3/df4/f11b x:0 0 0 2024-09-18T12:52:15.353 INFO:tasks.workunit.client.1.smithi161.stdout:0/845: dwrite df/d30/d71/d96/dd3/f102 [0,4194304] 0 2024-09-18T12:52:15.354 INFO:tasks.workunit.client.1.smithi161.stdout:6/890: truncate d4/d61/f10e 2745357 0 2024-09-18T12:52:15.355 INFO:tasks.workunit.client.1.smithi161.stdout:8/836: fsync d0/d3/d10/f10b 0 2024-09-18T12:52:15.355 INFO:tasks.workunit.client.1.smithi161.stdout:5/807: rename d3/def/f2c to d3/d8/df8/f109 0 2024-09-18T12:52:15.356 INFO:tasks.workunit.client.1.smithi161.stdout:0/846: readlink df/d30/d71/d96/dd3/d90/d37/l6d 0 2024-09-18T12:52:15.359 INFO:tasks.workunit.client.1.smithi161.stdout:5/808: mkdir d3/d44/d6f/d86/d10a 0 2024-09-18T12:52:15.359 INFO:tasks.workunit.client.1.smithi161.stdout:0/847: write df/d30/d71/d96/dd3/d90/d37/faf [1650269,78781] 0 2024-09-18T12:52:15.361 INFO:tasks.workunit.client.1.smithi161.stdout:8/837: creat d0/d3/d10/d21/d4a/d52/d82/d8b/f11c x:0 0 0 2024-09-18T12:52:15.362 INFO:tasks.workunit.client.1.smithi161.stdout:6/891: symlink d4/d1a/d1c/d3e/d83/d9e/d102/l129 0 2024-09-18T12:52:15.364 INFO:tasks.workunit.client.1.smithi161.stdout:0/848: chown df/de2/dc5/d8a/dd1/l11e 1 1 2024-09-18T12:52:15.365 INFO:tasks.workunit.client.0.smithi045.stdout:6/385: sync 2024-09-18T12:52:15.366 INFO:tasks.workunit.client.0.smithi045.stdout:8/434: write f6 [1884865,48945] 0 2024-09-18T12:52:15.375 INFO:tasks.workunit.client.0.smithi045.stdout:8/435: dread d11/d14/d53/d41/d57/f4a [0,4194304] 0 2024-09-18T12:52:15.375 INFO:tasks.workunit.client.0.smithi045.stdout:2/443: dwrite d5/d2c/d4d/f1b [4194304,4194304] 0 2024-09-18T12:52:15.376 INFO:tasks.workunit.client.1.smithi161.stdout:3/813: dread d1/d2e/f5b [0,4194304] 0 2024-09-18T12:52:15.377 INFO:tasks.workunit.client.0.smithi045.stdout:7/347: dwrite d13/d1a/d28/f3a [0,4194304] 0 2024-09-18T12:52:15.378 INFO:tasks.workunit.client.0.smithi045.stdout:8/436: chown d11/f13 16942687 1 2024-09-18T12:52:15.378 INFO:tasks.workunit.client.1.smithi161.stdout:8/838: rename d0/d3/d10/d21/d4a/d52/d66/d5b/de0/dee to d0/d3/d11d 0 2024-09-18T12:52:15.379 INFO:tasks.workunit.client.0.smithi045.stdout:7/348: chown d13/d1a/c5a 9882005 1 2024-09-18T12:52:15.383 INFO:tasks.workunit.client.1.smithi161.stdout:5/809: truncate d3/d3b/fe8 3155469 0 2024-09-18T12:52:15.384 INFO:tasks.workunit.client.0.smithi045.stdout:8/437: dread d11/d14/f1e [0,4194304] 0 2024-09-18T12:52:15.385 INFO:tasks.workunit.client.1.smithi161.stdout:0/849: dread df/d98/d128/fa4 [0,4194304] 0 2024-09-18T12:52:15.386 INFO:tasks.workunit.client.0.smithi045.stdout:7/349: dwrite d13/d44/f2b [0,4194304] 0 2024-09-18T12:52:15.388 INFO:tasks.workunit.client.0.smithi045.stdout:4/541: truncate db/de/d1e/d3e/d47/d59/f74 4248550 0 2024-09-18T12:52:15.388 INFO:tasks.workunit.client.1.smithi161.stdout:6/892: rename d4/d61/d69/da0/cbe to d4/d1a/d1c/d3e/d83/d9e/db1/d45/dd6/c12a 0 2024-09-18T12:52:15.388 INFO:tasks.workunit.client.1.smithi161.stdout:0/850: chown df/d30/c34 18 1 2024-09-18T12:52:15.393 INFO:tasks.workunit.client.0.smithi045.stdout:4/542: dread db/d20/f44 [4194304,4194304] 0 2024-09-18T12:52:15.393 INFO:tasks.workunit.client.0.smithi045.stdout:4/543: chown db/de/d1e/d3e 2473 1 2024-09-18T12:52:15.394 INFO:tasks.workunit.client.0.smithi045.stdout:4/544: write db/d2c/d35/d40/f79 [2500202,106402] 0 2024-09-18T12:52:15.394 INFO:tasks.workunit.client.1.smithi161.stdout:0/851: creat df/d30/d71/d96/dd3/d90/f130 x:0 0 0 2024-09-18T12:52:15.394 INFO:tasks.workunit.client.1.smithi161.stdout:5/810: dwrite d3/d3b/d7b/d82/f9d [0,4194304] 0 2024-09-18T12:52:15.395 INFO:tasks.workunit.client.0.smithi045.stdout:8/438: symlink d11/d23/l8b 0 2024-09-18T12:52:15.395 INFO:tasks.workunit.client.0.smithi045.stdout:4/545: readlink db/l15 0 2024-09-18T12:52:15.395 INFO:tasks.workunit.client.0.smithi045.stdout:8/439: stat d11/d7b 0 2024-09-18T12:52:15.398 INFO:tasks.workunit.client.0.smithi045.stdout:2/444: unlink d5/d2c/c4b 0 2024-09-18T12:52:15.400 INFO:tasks.workunit.client.1.smithi161.stdout:3/814: dread d1/fd7 [0,4194304] 0 2024-09-18T12:52:15.400 INFO:tasks.workunit.client.1.smithi161.stdout:5/811: creat d3/d3b/d54/f10b x:0 0 0 2024-09-18T12:52:15.406 INFO:tasks.workunit.client.0.smithi045.stdout:8/440: fsync d11/f13 0 2024-09-18T12:52:15.407 INFO:tasks.workunit.client.0.smithi045.stdout:8/441: truncate d11/d76/f88 1041363 0 2024-09-18T12:52:15.408 INFO:tasks.workunit.client.0.smithi045.stdout:6/386: write d9/d1a/d48/f53 [992454,116268] 0 2024-09-18T12:52:15.414 INFO:tasks.workunit.client.0.smithi045.stdout:8/442: fdatasync d11/f17 0 2024-09-18T12:52:15.416 INFO:tasks.workunit.client.0.smithi045.stdout:7/350: getdents d13/d44/d37 0 2024-09-18T12:52:15.420 INFO:tasks.workunit.client.0.smithi045.stdout:8/443: mkdir d11/d8c 0 2024-09-18T12:52:15.421 INFO:tasks.workunit.client.0.smithi045.stdout:8/444: fsync d11/d20/d59/f89 0 2024-09-18T12:52:15.425 INFO:tasks.workunit.client.0.smithi045.stdout:8/445: rmdir d11/d20/d46 39 2024-09-18T12:52:15.425 INFO:tasks.workunit.client.0.smithi045.stdout:4/546: write db/de/d1e/f2d [3610375,53323] 0 2024-09-18T12:52:15.428 INFO:tasks.workunit.client.0.smithi045.stdout:4/547: rmdir db/de/d1e/d49 39 2024-09-18T12:52:15.429 INFO:tasks.workunit.client.0.smithi045.stdout:7/351: dread d13/d44/d37/f4d [0,4194304] 0 2024-09-18T12:52:15.430 INFO:tasks.workunit.client.0.smithi045.stdout:6/387: truncate d9/d1a/d1d/f25 563745 0 2024-09-18T12:52:15.435 INFO:tasks.workunit.client.0.smithi045.stdout:7/352: mknod d13/d31/d29/c75 0 2024-09-18T12:52:15.436 INFO:tasks.workunit.client.0.smithi045.stdout:2/445: dwrite d5/d2c/d4d/f32 [4194304,4194304] 0 2024-09-18T12:52:15.436 INFO:tasks.workunit.client.0.smithi045.stdout:8/446: dwrite d11/f17 [0,4194304] 0 2024-09-18T12:52:15.436 INFO:tasks.workunit.client.1.smithi161.stdout:7/757: sync 2024-09-18T12:52:15.439 INFO:tasks.workunit.client.0.smithi045.stdout:6/388: creat d9/d1a/d2d/f8a x:0 0 0 2024-09-18T12:52:15.441 INFO:tasks.workunit.client.0.smithi045.stdout:8/447: rmdir d11/d14/d53/d41/d75 39 2024-09-18T12:52:15.442 INFO:tasks.workunit.client.1.smithi161.stdout:8/839: rename d0/d3/d10/d21/d4a/d52/d101 to d0/d3/d10/d21/d11e 0 2024-09-18T12:52:15.444 INFO:tasks.workunit.client.0.smithi045.stdout:6/389: creat d9/d56/f8b x:0 0 0 2024-09-18T12:52:15.446 INFO:tasks.workunit.client.1.smithi161.stdout:7/758: chown d3/d8/d4f/f61 867 1 2024-09-18T12:52:15.447 INFO:tasks.workunit.client.1.smithi161.stdout:5/812: truncate d3/d44/d6f/d86/fae 629126 0 2024-09-18T12:52:15.447 INFO:tasks.workunit.client.0.smithi045.stdout:8/448: creat d11/d14/d72/f8d x:0 0 0 2024-09-18T12:52:15.452 INFO:tasks.workunit.client.1.smithi161.stdout:5/813: write d3/d9/d4b/d8e/f8a [4960167,93365] 0 2024-09-18T12:52:15.453 INFO:tasks.workunit.client.1.smithi161.stdout:6/893: dwrite d4/d1a/d1c/d3e/d83/d9e/db1/d28/d81/fbf [0,4194304] 0 2024-09-18T12:52:15.455 INFO:tasks.workunit.client.0.smithi045.stdout:7/353: write d13/d1a/f41 [312017,9013] 0 2024-09-18T12:52:15.456 INFO:tasks.workunit.client.1.smithi161.stdout:7/759: symlink d3/d8/d15/da7/d24/le6 0 2024-09-18T12:52:15.456 INFO:tasks.workunit.client.0.smithi045.stdout:7/354: write d13/d31/d29/f60 [96616,43568] 0 2024-09-18T12:52:15.463 INFO:tasks.workunit.client.1.smithi161.stdout:5/814: dwrite d3/d9/d4b/f99 [0,4194304] 0 2024-09-18T12:52:15.465 INFO:tasks.workunit.client.1.smithi161.stdout:0/852: write df/d30/d71/d96/dd3/d90/d69/f77 [164779,3297] 0 2024-09-18T12:52:15.466 INFO:tasks.workunit.client.1.smithi161.stdout:5/815: chown d3/d8/de4/d8d/db0/dd4 2397049 1 2024-09-18T12:52:15.469 INFO:tasks.workunit.client.1.smithi161.stdout:6/894: truncate d4/d39/d47/d51/f93 1798848 0 2024-09-18T12:52:15.470 INFO:tasks.workunit.client.0.smithi045.stdout:6/390: write d9/d1a/d1d/f5a [1609227,4387] 0 2024-09-18T12:52:15.470 INFO:tasks.workunit.client.0.smithi045.stdout:6/391: fdatasync d9/d1a/d48/f53 0 2024-09-18T12:52:15.472 INFO:tasks.workunit.client.0.smithi045.stdout:8/449: truncate d11/d14/d53/f4f 3374562 0 2024-09-18T12:52:15.472 INFO:tasks.workunit.client.0.smithi045.stdout:8/450: stat d11/d14/d53/d41/l83 0 2024-09-18T12:52:15.474 INFO:tasks.workunit.client.1.smithi161.stdout:8/840: dread d0/d3/fb [0,4194304] 0 2024-09-18T12:52:15.478 INFO:tasks.workunit.client.1.smithi161.stdout:6/895: creat d4/d61/d9d/d120/f12b x:0 0 0 2024-09-18T12:52:15.478 INFO:tasks.workunit.client.0.smithi045.stdout:4/548: dread db/de/d1e/d3e/d9a/f5c [0,4194304] 0 2024-09-18T12:52:15.480 INFO:tasks.workunit.client.1.smithi161.stdout:0/853: dwrite df/d30/d71/d96/dd3/d90/d37/faf [0,4194304] 0 2024-09-18T12:52:15.480 INFO:tasks.workunit.client.1.smithi161.stdout:8/841: readlink d0/d3/d10/d21/d4a/d52/d82/d96/d98/l97 0 2024-09-18T12:52:15.480 INFO:tasks.workunit.client.1.smithi161.stdout:6/896: fsync d4/d61/f66 0 2024-09-18T12:52:15.482 INFO:tasks.workunit.client.0.smithi045.stdout:8/451: dwrite d11/d20/d46/f51 [0,4194304] 0 2024-09-18T12:52:15.483 INFO:tasks.workunit.client.0.smithi045.stdout:4/549: dread db/de/f90 [0,4194304] 0 2024-09-18T12:52:15.483 INFO:tasks.workunit.client.1.smithi161.stdout:3/815: dread d1/d2e/d14/d65/d76/d8c/f8d [0,4194304] 0 2024-09-18T12:52:15.485 INFO:tasks.workunit.client.1.smithi161.stdout:8/842: read - d0/d3/d10/d21/d4a/d52/d82/d96/f111 zero size 2024-09-18T12:52:15.485 INFO:tasks.workunit.client.1.smithi161.stdout:0/854: truncate df/d30/d71/d96/dd3/f114 737807 0 2024-09-18T12:52:15.486 INFO:tasks.workunit.client.1.smithi161.stdout:5/816: link d3/d44/d6f/l83 d3/d3b/l10c 0 2024-09-18T12:52:15.487 INFO:tasks.workunit.client.0.smithi045.stdout:4/550: read db/d2c/d35/d40/d77/fa7 [134405,9076] 0 2024-09-18T12:52:15.487 INFO:tasks.workunit.client.1.smithi161.stdout:5/817: fdatasync d3/d9/f107 0 2024-09-18T12:52:15.488 INFO:tasks.workunit.client.1.smithi161.stdout:3/816: mkdir d1/d2e/d68/d11c 0 2024-09-18T12:52:15.488 INFO:tasks.workunit.client.1.smithi161.stdout:8/843: write d0/d3/d10/d21/d4a/d52/d66/fe9 [439594,106105] 0 2024-09-18T12:52:15.490 INFO:tasks.workunit.client.1.smithi161.stdout:3/817: stat d1/d2e/l3f 0 2024-09-18T12:52:15.495 INFO:tasks.workunit.client.0.smithi045.stdout:7/355: dwrite d13/d31/f2d [0,4194304] 0 2024-09-18T12:52:15.497 INFO:tasks.workunit.client.0.smithi045.stdout:7/356: stat d13/d31/d33/f6e 0 2024-09-18T12:52:15.500 INFO:tasks.workunit.client.1.smithi161.stdout:0/855: mkdir df/de2/dc5/d89/d131 0 2024-09-18T12:52:15.501 INFO:tasks.workunit.client.1.smithi161.stdout:6/897: link d4/d61/d69/fc4 d4/d1a/d1c/d3e/d83/d9e/db1/d28/d81/f12c 0 2024-09-18T12:52:15.501 INFO:tasks.workunit.client.1.smithi161.stdout:5/818: rename d3/d9 to d3/d44/d6f/dca/d10d 0 2024-09-18T12:52:15.505 INFO:tasks.workunit.client.0.smithi045.stdout:4/551: symlink db/d2c/d35/d40/d6d/da9/lb0 0 2024-09-18T12:52:15.505 INFO:tasks.workunit.client.1.smithi161.stdout:0/856: read df/f23 [1225352,8468] 0 2024-09-18T12:52:15.505 INFO:tasks.workunit.client.1.smithi161.stdout:7/760: dread d3/fa3 [0,4194304] 0 2024-09-18T12:52:15.505 INFO:tasks.workunit.client.1.smithi161.stdout:0/857: readlink df/d29/l35 0 2024-09-18T12:52:15.508 INFO:tasks.workunit.client.0.smithi045.stdout:4/552: creat db/de/fb1 x:0 0 0 2024-09-18T12:52:15.509 INFO:tasks.workunit.client.0.smithi045.stdout:7/357: link d13/d31/d52/c66 d13/d44/d37/c76 0 2024-09-18T12:52:15.513 INFO:tasks.workunit.client.0.smithi045.stdout:7/358: dread d13/d31/d29/f3c [0,4194304] 0 2024-09-18T12:52:15.517 INFO:tasks.workunit.client.1.smithi161.stdout:1/704: sync 2024-09-18T12:52:15.517 INFO:tasks.workunit.client.1.smithi161.stdout:9/734: sync 2024-09-18T12:52:15.517 INFO:tasks.workunit.client.1.smithi161.stdout:1/705: stat d1/da/d39 0 2024-09-18T12:52:15.518 INFO:tasks.workunit.client.1.smithi161.stdout:9/735: read - d0/d20/d49/fa1 zero size 2024-09-18T12:52:15.537 INFO:tasks.workunit.client.0.smithi045.stdout:8/452: truncate f6 3213056 0 2024-09-18T12:52:15.541 INFO:tasks.workunit.client.1.smithi161.stdout:8/844: write d0/d3/d10/d21/f86 [955505,103194] 0 2024-09-18T12:52:15.542 INFO:tasks.workunit.client.1.smithi161.stdout:6/898: chown d4/d1a/d1c/d3e/d83/d9e/db1/lee 837357 1 2024-09-18T12:52:15.543 INFO:tasks.workunit.client.0.smithi045.stdout:8/453: dwrite fd [0,4194304] 0 2024-09-18T12:52:15.550 INFO:tasks.workunit.client.1.smithi161.stdout:1/706: creat d1/da/d1f/d45/d73/ff0 x:0 0 0 2024-09-18T12:52:15.550 INFO:tasks.workunit.client.0.smithi045.stdout:8/454: dwrite fd [0,4194304] 0 2024-09-18T12:52:15.553 INFO:tasks.workunit.client.0.smithi045.stdout:4/553: write db/de/d1a/d2e/f7f [1529985,4667] 0 2024-09-18T12:52:15.555 INFO:tasks.workunit.client.1.smithi161.stdout:6/899: write d4/d1a/d1c/fea [383105,15442] 0 2024-09-18T12:52:15.556 INFO:tasks.workunit.client.1.smithi161.stdout:0/858: creat df/de2/dc5/db6/f132 x:0 0 0 2024-09-18T12:52:15.557 INFO:tasks.workunit.client.1.smithi161.stdout:1/707: dread d1/da/d31/f3e [0,4194304] 0 2024-09-18T12:52:15.558 INFO:tasks.workunit.client.1.smithi161.stdout:6/900: stat d4/d61/d9d/da3 0 2024-09-18T12:52:15.560 INFO:tasks.workunit.client.0.smithi045.stdout:8/455: link d11/d14/d53/f6d d11/d20/d59/f8e 0 2024-09-18T12:52:15.561 INFO:tasks.workunit.client.1.smithi161.stdout:1/708: read - d1/da/d39/fdc zero size 2024-09-18T12:52:15.564 INFO:tasks.workunit.client.1.smithi161.stdout:8/845: dwrite d0/d3/fcd [0,4194304] 0 2024-09-18T12:52:15.564 INFO:tasks.workunit.client.0.smithi045.stdout:8/456: write d11/d14/d53/f6d [958489,121055] 0 2024-09-18T12:52:15.566 INFO:tasks.workunit.client.1.smithi161.stdout:7/761: dread d3/d8/d15/da7/d4a/fd1 [0,4194304] 0 2024-09-18T12:52:15.568 INFO:tasks.workunit.client.0.smithi045.stdout:8/457: dread d11/d14/f52 [0,4194304] 0 2024-09-18T12:52:15.570 INFO:tasks.workunit.client.1.smithi161.stdout:1/709: dread d1/da/d39/f37 [4194304,4194304] 0 2024-09-18T12:52:15.571 INFO:tasks.workunit.client.1.smithi161.stdout:1/710: truncate d1/da/d9d/fa2 869178 0 2024-09-18T12:52:15.573 INFO:tasks.workunit.client.0.smithi045.stdout:8/458: rmdir d11/d20 39 2024-09-18T12:52:15.577 INFO:tasks.workunit.client.0.smithi045.stdout:0/443: sync 2024-09-18T12:52:15.578 INFO:tasks.workunit.client.0.smithi045.stdout:1/391: sync 2024-09-18T12:52:15.578 INFO:tasks.workunit.client.0.smithi045.stdout:3/410: sync 2024-09-18T12:52:15.578 INFO:tasks.workunit.client.0.smithi045.stdout:8/459: write d11/d20/d46/f51 [3511142,107523] 0 2024-09-18T12:52:15.578 INFO:tasks.workunit.client.1.smithi161.stdout:1/711: dwrite d1/d48/fb5 [0,4194304] 0 2024-09-18T12:52:15.579 INFO:tasks.workunit.client.1.smithi161.stdout:6/901: link d4/d39/d26/c123 d4/d61/d69/da0/c12d 0 2024-09-18T12:52:15.579 INFO:tasks.workunit.client.1.smithi161.stdout:1/712: stat d1/d26/f3f 0 2024-09-18T12:52:15.579 INFO:tasks.workunit.client.0.smithi045.stdout:0/444: write d6/d48/d5e/d39/d58/d3c/f46 [1188459,77611] 0 2024-09-18T12:52:15.581 INFO:tasks.workunit.client.0.smithi045.stdout:0/445: write d6/d7/f14 [4539956,75640] 0 2024-09-18T12:52:15.582 INFO:tasks.workunit.client.0.smithi045.stdout:8/460: write fa [890382,104243] 0 2024-09-18T12:52:15.583 INFO:tasks.workunit.client.0.smithi045.stdout:8/461: fdatasync d11/d20/f5d 0 2024-09-18T12:52:15.584 INFO:tasks.workunit.client.1.smithi161.stdout:7/762: dread d3/d50/f66 [0,4194304] 0 2024-09-18T12:52:15.586 INFO:tasks.workunit.client.1.smithi161.stdout:7/763: fdatasync d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/fb9 0 2024-09-18T12:52:15.587 INFO:tasks.workunit.client.1.smithi161.stdout:1/713: rename d1/da/d39/fa0 to d1/da/d1f/dab/ff1 0 2024-09-18T12:52:15.614 INFO:tasks.workunit.client.1.smithi161.stdout:4/874: sync 2024-09-18T12:52:15.614 INFO:tasks.workunit.client.1.smithi161.stdout:2/862: sync 2024-09-18T12:52:15.615 INFO:tasks.workunit.client.1.smithi161.stdout:2/863: dread - d0/d71/da9/d9f/dd0/f106 zero size 2024-09-18T12:52:15.682 INFO:tasks.workunit.client.0.smithi045.stdout:3/411: mkdir d0/d29/d5f/d73/d87 0 2024-09-18T12:52:15.684 INFO:tasks.workunit.client.1.smithi161.stdout:3/818: write d1/d2e/d68/d92/ded/f7 [3351601,91896] 0 2024-09-18T12:52:15.686 INFO:tasks.workunit.client.0.smithi045.stdout:3/412: write d0/d22/f72 [440408,27833] 0 2024-09-18T12:52:15.686 INFO:tasks.workunit.client.1.smithi161.stdout:7/764: symlink d3/d8/d15/d99/db0/le7 0 2024-09-18T12:52:15.686 INFO:tasks.workunit.client.1.smithi161.stdout:7/765: chown d3/d8/d15/da7/d4a/d64/d8c/d9f/d55 7188 1 2024-09-18T12:52:15.691 INFO:tasks.workunit.client.1.smithi161.stdout:9/736: truncate d0/d20/d49/f15 3781208 0 2024-09-18T12:52:15.692 INFO:tasks.workunit.client.1.smithi161.stdout:5/819: sync 2024-09-18T12:52:15.693 INFO:tasks.workunit.client.0.smithi045.stdout:4/554: dwrite db/d2c/d35/d40/d77/f4c [4194304,4194304] 0 2024-09-18T12:52:15.695 INFO:tasks.workunit.client.1.smithi161.stdout:8/846: write d0/f6b [690754,64765] 0 2024-09-18T12:52:15.698 INFO:tasks.workunit.client.1.smithi161.stdout:1/714: link d1/d26/fd0 d1/daa/ff2 0 2024-09-18T12:52:15.698 INFO:tasks.workunit.client.1.smithi161.stdout:1/715: readlink d1/dbf/lc8 0 2024-09-18T12:52:15.700 INFO:tasks.workunit.client.1.smithi161.stdout:4/875: symlink d5/d14/d67/dc7/d60/d95/dda/de1/l141 0 2024-09-18T12:52:15.705 INFO:tasks.workunit.client.1.smithi161.stdout:6/902: getdents d4/d1a/d1c/d7c 0 2024-09-18T12:52:15.706 INFO:tasks.workunit.client.1.smithi161.stdout:0/859: dwrite df/d29/d36/fbb [0,4194304] 0 2024-09-18T12:52:15.707 INFO:tasks.workunit.client.0.smithi045.stdout:0/446: creat d6/d48/d5e/d39/d58/d3c/d73/f7f x:0 0 0 2024-09-18T12:52:15.708 INFO:tasks.workunit.client.1.smithi161.stdout:3/819: mknod d1/d2e/d14/d2c/de5/c11d 0 2024-09-18T12:52:15.708 INFO:tasks.workunit.client.1.smithi161.stdout:8/847: symlink d0/d3/d1e/l11f 0 2024-09-18T12:52:15.709 INFO:tasks.workunit.client.0.smithi045.stdout:0/447: write d6/d48/d5e/d39/d58/d3c/d69/f4c [99175,85667] 0 2024-09-18T12:52:15.710 INFO:tasks.workunit.client.0.smithi045.stdout:3/413: rename d0/d1e/d2c/d3a/d45/f69 to d0/d1e/d39/f88 0 2024-09-18T12:52:15.710 INFO:tasks.workunit.client.1.smithi161.stdout:8/848: chown d0/d3/d10/d21/d4a/d52/d66/d5b/d6e 9761768 1 2024-09-18T12:52:15.711 INFO:tasks.workunit.client.0.smithi045.stdout:0/448: write d6/d48/d5e/d39/d58/d3c/d69/f4b [546015,63504] 0 2024-09-18T12:52:15.712 INFO:tasks.workunit.client.1.smithi161.stdout:1/716: creat d1/d26/d88/ff3 x:0 0 0 2024-09-18T12:52:15.712 INFO:tasks.workunit.client.1.smithi161.stdout:2/864: link d0/d5/d43/d35/d98/ddf/f85 d0/d71/da9/d9f/f123 0 2024-09-18T12:52:15.714 INFO:tasks.workunit.client.1.smithi161.stdout:6/903: stat d4/f10 0 2024-09-18T12:52:15.715 INFO:tasks.workunit.client.1.smithi161.stdout:5/820: creat d3/d8/de4/d8d/ddb/f10e x:0 0 0 2024-09-18T12:52:15.716 INFO:tasks.workunit.client.0.smithi045.stdout:0/449: chown d6/d48/d5e/c61 572 1 2024-09-18T12:52:15.718 INFO:tasks.workunit.client.1.smithi161.stdout:1/717: symlink d1/da/d1f/lf4 0 2024-09-18T12:52:15.718 INFO:tasks.workunit.client.0.smithi045.stdout:3/414: mkdir d0/d7/d89 0 2024-09-18T12:52:15.719 INFO:tasks.workunit.client.0.smithi045.stdout:0/450: read d6/d7/f42 [7643233,130518] 0 2024-09-18T12:52:15.719 INFO:tasks.workunit.client.0.smithi045.stdout:3/415: fsync d0/d22/f28 0 2024-09-18T12:52:15.720 INFO:tasks.workunit.client.1.smithi161.stdout:9/737: rename d0/d16/le4 to d0/d20/lf2 0 2024-09-18T12:52:15.721 INFO:tasks.workunit.client.0.smithi045.stdout:4/555: creat db/de/d1e/fb2 x:0 0 0 2024-09-18T12:52:15.722 INFO:tasks.workunit.client.0.smithi045.stdout:4/556: write db/de/d1a/f3d [4632867,47680] 0 2024-09-18T12:52:15.722 INFO:tasks.workunit.client.1.smithi161.stdout:8/849: mkdir d0/d3/d10/d21/d4a/d52/d82/d8b/d120 0 2024-09-18T12:52:15.722 INFO:tasks.workunit.client.1.smithi161.stdout:6/904: dwrite d4/d39/d47/d88/fdb [0,4194304] 0 2024-09-18T12:52:15.725 INFO:tasks.workunit.client.1.smithi161.stdout:6/905: fsync d4/d61/f66 0 2024-09-18T12:52:15.726 INFO:tasks.workunit.client.0.smithi045.stdout:9/370: sync 2024-09-18T12:52:15.726 INFO:tasks.workunit.client.0.smithi045.stdout:5/534: sync 2024-09-18T12:52:15.727 INFO:tasks.workunit.client.1.smithi161.stdout:2/865: creat d0/d1/d4c/d67/db9/dcb/d8a/f124 x:0 0 0 2024-09-18T12:52:15.727 INFO:tasks.workunit.client.0.smithi045.stdout:3/416: mkdir d0/d1e/d2c/d3a/d8a 0 2024-09-18T12:52:15.728 INFO:tasks.workunit.client.0.smithi045.stdout:0/451: truncate d6/d35/f50 4775566 0 2024-09-18T12:52:15.730 INFO:tasks.workunit.client.0.smithi045.stdout:4/557: dwrite db/d20/f9f [0,4194304] 0 2024-09-18T12:52:15.731 INFO:tasks.workunit.client.1.smithi161.stdout:1/718: dwrite d1/da/d1f/f51 [0,4194304] 0 2024-09-18T12:52:15.734 INFO:tasks.workunit.client.1.smithi161.stdout:5/821: symlink d3/d44/d6f/dca/d10d/d4b/d8e/d24/d61/l10f 0 2024-09-18T12:52:15.737 INFO:tasks.workunit.client.1.smithi161.stdout:0/860: dread df/d29/fc0 [0,4194304] 0 2024-09-18T12:52:15.740 INFO:tasks.workunit.client.0.smithi045.stdout:4/558: dwrite db/de/d1e/d3e/d9a/f7c [0,4194304] 0 2024-09-18T12:52:15.743 INFO:tasks.workunit.client.0.smithi045.stdout:9/371: symlink d0/d3/d6/d10/d26/d2e/l79 0 2024-09-18T12:52:15.744 INFO:tasks.workunit.client.1.smithi161.stdout:3/820: dread d1/d2e/d68/d92/ded/f38 [4194304,4194304] 0 2024-09-18T12:52:15.745 INFO:tasks.workunit.client.1.smithi161.stdout:6/906: mkdir d4/d1a/d1c/d3e/d83/d9e/d102/d12e 0 2024-09-18T12:52:15.751 INFO:tasks.workunit.client.1.smithi161.stdout:1/719: mknod d1/da/d1f/dab/daf/de8/cf5 0 2024-09-18T12:52:15.753 INFO:tasks.workunit.client.1.smithi161.stdout:6/907: dwrite d4/d39/d47/d51/f70 [0,4194304] 0 2024-09-18T12:52:15.753 INFO:tasks.workunit.client.1.smithi161.stdout:3/821: dwrite d1/d2e/d14/d65/d76/d88/fef [0,4194304] 0 2024-09-18T12:52:15.754 INFO:tasks.workunit.client.0.smithi045.stdout:3/417: dread d0/d1e/f38 [0,4194304] 0 2024-09-18T12:52:15.758 INFO:tasks.workunit.client.0.smithi045.stdout:4/559: dread db/de/f90 [0,4194304] 0 2024-09-18T12:52:15.759 INFO:tasks.workunit.client.0.smithi045.stdout:9/372: chown d0/d3/d6/f2d 5333 1 2024-09-18T12:52:15.765 INFO:tasks.workunit.client.1.smithi161.stdout:2/866: rename d0/d5/d43/c76 to d0/d71/da9/dd6/df7/c125 0 2024-09-18T12:52:15.767 INFO:tasks.workunit.client.0.smithi045.stdout:4/560: creat db/d2c/d35/d40/d77/fb3 x:0 0 0 2024-09-18T12:52:15.770 INFO:tasks.workunit.client.0.smithi045.stdout:9/373: symlink d0/d3/d6/l7a 0 2024-09-18T12:52:15.771 INFO:tasks.workunit.client.0.smithi045.stdout:9/374: write d0/f2 [7142439,30617] 0 2024-09-18T12:52:15.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/720: fsync d1/f62 0 2024-09-18T12:52:15.774 INFO:tasks.workunit.client.0.smithi045.stdout:3/418: unlink d0/l35 0 2024-09-18T12:52:15.775 INFO:tasks.workunit.client.1.smithi161.stdout:1/721: write d1/da/d31/f91 [344708,85108] 0 2024-09-18T12:52:15.775 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:15 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:15.775 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:15 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:15.775 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:15 smithi161 ceph-mon[35784]: Reconfiguring ceph-exporter.smithi161 (dependencies changed)... 2024-09-18T12:52:15.775 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:15 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:52:15.776 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:15 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:52:15.776 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:15 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:15.776 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:15 smithi161 ceph-mon[35784]: Deploying daemon ceph-exporter.smithi161 on smithi161 2024-09-18T12:52:15.776 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:15 smithi161 ceph-mon[35784]: pgmap v30: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 77 MiB/s rd, 231 MiB/s wr, 414 op/s 2024-09-18T12:52:15.779 INFO:tasks.workunit.client.1.smithi161.stdout:5/822: dread d3/d3b/d54/fc4 [0,4194304] 0 2024-09-18T12:52:15.782 INFO:tasks.workunit.client.1.smithi161.stdout:8/850: creat d0/f121 x:0 0 0 2024-09-18T12:52:15.783 INFO:tasks.workunit.client.1.smithi161.stdout:6/908: dwrite d4/d39/d48/f56 [0,4194304] 0 2024-09-18T12:52:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:15 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:15 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:15 smithi045 ceph-mon[28315]: Reconfiguring ceph-exporter.smithi161 (dependencies changed)... 2024-09-18T12:52:15.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:15 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:52:15.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:15 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-18T12:52:15.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:15 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:15.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:15 smithi045 ceph-mon[28315]: Deploying daemon ceph-exporter.smithi161 on smithi161 2024-09-18T12:52:15.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:15 smithi045 ceph-mon[28315]: pgmap v30: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 77 MiB/s rd, 231 MiB/s wr, 414 op/s 2024-09-18T12:52:15.785 INFO:tasks.workunit.client.0.smithi045.stdout:3/419: dwrite d0/d1e/d2c/d3f/d44/f76 [0,4194304] 0 2024-09-18T12:52:15.789 INFO:tasks.workunit.client.0.smithi045.stdout:5/535: fsync d6/d28/d2b/f93 0 2024-09-18T12:52:15.790 INFO:tasks.workunit.client.0.smithi045.stdout:5/536: write d6/f7 [2001389,80246] 0 2024-09-18T12:52:15.790 INFO:tasks.workunit.client.1.smithi161.stdout:5/823: symlink d3/d8/de4/d8d/db0/dd4/l110 0 2024-09-18T12:52:15.793 INFO:tasks.workunit.client.1.smithi161.stdout:9/738: getdents d0/d93 0 2024-09-18T12:52:15.794 INFO:tasks.workunit.client.1.smithi161.stdout:2/867: symlink d0/d5/l126 0 2024-09-18T12:52:15.795 INFO:tasks.workunit.client.1.smithi161.stdout:8/851: creat d0/d3/d10/d21/d4a/d52/d82/d96/dba/d10d/f122 x:0 0 0 2024-09-18T12:52:15.795 INFO:tasks.workunit.client.1.smithi161.stdout:1/722: dwrite d1/d26/f2e [0,4194304] 0 2024-09-18T12:52:15.797 INFO:tasks.workunit.client.1.smithi161.stdout:2/868: stat d0/d5/d43/d23/c6d 0 2024-09-18T12:52:15.798 INFO:tasks.workunit.client.1.smithi161.stdout:6/909: rename d4/d39/d26/cc5 to d4/d39/d26/d31/d76/c12f 0 2024-09-18T12:52:15.798 INFO:tasks.workunit.client.1.smithi161.stdout:8/852: write d0/d3/d10/d21/d4a/d52/d82/d96/dba/ff2 [973637,122802] 0 2024-09-18T12:52:15.799 INFO:tasks.workunit.client.0.smithi045.stdout:5/537: creat d6/d3e/daa/fb9 x:0 0 0 2024-09-18T12:52:15.801 INFO:tasks.workunit.client.1.smithi161.stdout:0/861: getdents df/d29/d36/d94 0 2024-09-18T12:52:15.802 INFO:tasks.workunit.client.1.smithi161.stdout:3/822: link d1/d2e/d24/d1d/d89/db0/c6d d1/d2e/d14/d65/d76/d8c/d9d/c11e 0 2024-09-18T12:52:15.805 INFO:tasks.workunit.client.0.smithi045.stdout:0/452: write d6/d35/f50 [1033115,70613] 0 2024-09-18T12:52:15.809 INFO:tasks.workunit.client.0.smithi045.stdout:4/561: dwrite db/de/d1e/d3e/d47/d59/d2f/f6c [0,4194304] 0 2024-09-18T12:52:15.810 INFO:tasks.workunit.client.1.smithi161.stdout:9/739: symlink d0/d20/d49/d65/lf3 0 2024-09-18T12:52:15.814 INFO:tasks.workunit.client.1.smithi161.stdout:2/869: fdatasync d0/d5/d53/d7d/f89 0 2024-09-18T12:52:15.814 INFO:tasks.workunit.client.0.smithi045.stdout:0/453: mknod d6/d48/c80 0 2024-09-18T12:52:15.815 INFO:tasks.workunit.client.1.smithi161.stdout:7/766: sync 2024-09-18T12:52:15.815 INFO:tasks.workunit.client.1.smithi161.stdout:4/876: sync 2024-09-18T12:52:15.817 INFO:tasks.workunit.client.0.smithi045.stdout:0/454: write d6/d48/d5e/d39/d58/d3c/d73/f7f [1028251,37695] 0 2024-09-18T12:52:15.817 INFO:tasks.workunit.client.0.smithi045.stdout:4/562: symlink db/de/d1e/d3e/d9a/d73/d75/d9e/lb4 0 2024-09-18T12:52:15.817 INFO:tasks.workunit.client.0.smithi045.stdout:0/455: readlink d6/l31 0 2024-09-18T12:52:15.823 INFO:tasks.workunit.client.1.smithi161.stdout:9/740: mkdir d0/d16/d25/d86/df4 0 2024-09-18T12:52:15.825 INFO:tasks.workunit.client.0.smithi045.stdout:4/563: mknod db/cb5 0 2024-09-18T12:52:15.827 INFO:tasks.workunit.client.1.smithi161.stdout:6/910: creat d4/d61/d69/da0/de9/f130 x:0 0 0 2024-09-18T12:52:15.830 INFO:tasks.workunit.client.1.smithi161.stdout:4/877: fdatasync d5/d14/d67/d84/d6e/f9d 0 2024-09-18T12:52:15.832 INFO:tasks.workunit.client.1.smithi161.stdout:1/723: dread d1/da/d31/fd3 [0,4194304] 0 2024-09-18T12:52:15.834 INFO:tasks.workunit.client.1.smithi161.stdout:9/741: mknod d0/d47/cf5 0 2024-09-18T12:52:15.835 INFO:tasks.workunit.client.0.smithi045.stdout:5/538: dwrite d6/db/d19/d92/d61/f72 [0,4194304] 0 2024-09-18T12:52:15.835 INFO:tasks.workunit.client.1.smithi161.stdout:6/911: mkdir d4/d1a/d1c/d3e/d83/dad/dd4/d131 0 2024-09-18T12:52:15.836 INFO:tasks.workunit.client.0.smithi045.stdout:5/539: stat d6/l6f 0 2024-09-18T12:52:15.837 INFO:tasks.workunit.client.1.smithi161.stdout:8/853: dwrite d0/d3/d10/d21/d4a/d52/d82/d8b/fcb [0,4194304] 0 2024-09-18T12:52:15.838 INFO:tasks.workunit.client.0.smithi045.stdout:0/456: write d6/d7/ff [4822947,58164] 0 2024-09-18T12:52:15.841 INFO:tasks.workunit.client.1.smithi161.stdout:3/823: creat d1/d2e/d24/f11f x:0 0 0 2024-09-18T12:52:15.843 INFO:tasks.workunit.client.1.smithi161.stdout:3/824: chown d1/d2e/d14/d2c/de5/c11d 465 1 2024-09-18T12:52:15.844 INFO:tasks.workunit.client.1.smithi161.stdout:0/862: dwrite df/d98/d128/fbd [0,4194304] 0 2024-09-18T12:52:15.844 INFO:tasks.workunit.client.1.smithi161.stdout:5/824: getdents d3/d8/de4/d8d/dab 0 2024-09-18T12:52:15.844 INFO:tasks.workunit.client.1.smithi161.stdout:4/878: read d5/d14/d67/d84/f77 [462147,63033] 0 2024-09-18T12:52:15.847 INFO:tasks.workunit.client.0.smithi045.stdout:5/540: dwrite d6/db/d5a/f7c [0,4194304] 0 2024-09-18T12:52:15.850 INFO:tasks.workunit.client.1.smithi161.stdout:1/724: mkdir d1/d26/dad/db6/df6 0 2024-09-18T12:52:15.851 INFO:tasks.workunit.client.1.smithi161.stdout:3/825: dread d1/d2e/d24/d1d/d89/db0/fa2 [0,4194304] 0 2024-09-18T12:52:15.852 INFO:tasks.workunit.client.1.smithi161.stdout:2/870: write d0/d5/fcd [733941,59573] 0 2024-09-18T12:52:15.856 INFO:tasks.workunit.client.0.smithi045.stdout:5/541: symlink d6/db/d54/lba 0 2024-09-18T12:52:15.857 INFO:tasks.workunit.client.0.smithi045.stdout:5/542: chown d6/d3e/l99 7 1 2024-09-18T12:52:15.859 INFO:tasks.workunit.client.1.smithi161.stdout:8/854: rename d0/ff6 to d0/dc4/f123 0 2024-09-18T12:52:15.861 INFO:tasks.workunit.client.1.smithi161.stdout:6/912: dread d4/d1a/d1c/d3e/d83/f8d [0,4194304] 0 2024-09-18T12:52:15.862 INFO:tasks.workunit.client.0.smithi045.stdout:4/564: dwrite db/d2c/d35/d40/f68 [0,4194304] 0 2024-09-18T12:52:15.862 INFO:tasks.workunit.client.0.smithi045.stdout:0/457: link d6/d48/d5e/d39/d58/d3b/d65/c71 d6/d48/c81 0 2024-09-18T12:52:15.863 INFO:tasks.workunit.client.0.smithi045.stdout:0/458: chown d6/c26 27869114 1 2024-09-18T12:52:15.865 INFO:tasks.workunit.client.1.smithi161.stdout:5/825: creat d3/d8/de4/d8d/db0/f111 x:0 0 0 2024-09-18T12:52:15.866 INFO:tasks.workunit.client.1.smithi161.stdout:8/855: read d0/d3/d10/d21/d4a/d52/d82/d96/dc1/fd2 [544190,42475] 0 2024-09-18T12:52:15.866 INFO:tasks.workunit.client.1.smithi161.stdout:4/879: fdatasync d5/d32/d39/db6/fd9 0 2024-09-18T12:52:15.866 INFO:tasks.workunit.client.0.smithi045.stdout:4/565: fdatasync db/d2c/d35/f91 0 2024-09-18T12:52:15.869 INFO:tasks.workunit.client.0.smithi045.stdout:0/459: write d6/d48/f6f [4594516,78438] 0 2024-09-18T12:52:15.872 INFO:tasks.workunit.client.1.smithi161.stdout:3/826: unlink d1/d2e/d14/ff7 0 2024-09-18T12:52:15.873 INFO:tasks.workunit.client.1.smithi161.stdout:8/856: write d0/d3/d10/d21/d4a/d52/d82/fc8 [4855163,41039] 0 2024-09-18T12:52:15.873 INFO:tasks.workunit.client.1.smithi161.stdout:6/913: dwrite d4/d61/ff5 [0,4194304] 0 2024-09-18T12:52:15.874 INFO:tasks.workunit.client.0.smithi045.stdout:4/566: rename db/cc to db/d20/d6b/cb6 0 2024-09-18T12:52:15.874 INFO:tasks.workunit.client.1.smithi161.stdout:3/827: readlink d1/d2e/d24/d1d/d89/db0/l63 0 2024-09-18T12:52:15.875 INFO:tasks.workunit.client.1.smithi161.stdout:2/871: mknod d0/d1/d4c/d67/db9/dcb/d8a/c127 0 2024-09-18T12:52:15.881 INFO:tasks.workunit.client.0.smithi045.stdout:4/567: read db/d2c/d35/d40/d77/f98 [1792093,124018] 0 2024-09-18T12:52:15.881 INFO:tasks.workunit.client.0.smithi045.stdout:0/460: link d6/d48/d5e/d39/d58/d3b/l56 d6/d48/d5e/d39/d58/d3b/l82 0 2024-09-18T12:52:15.882 INFO:tasks.workunit.client.1.smithi161.stdout:3/828: chown d1/d2e/d24/f11f 476173788 1 2024-09-18T12:52:15.882 INFO:tasks.workunit.client.1.smithi161.stdout:2/872: chown d0/d5/d43/d35 92445 1 2024-09-18T12:52:15.882 INFO:tasks.workunit.client.1.smithi161.stdout:8/857: dread d0/d3/d10/d21/f49 [0,4194304] 0 2024-09-18T12:52:15.887 INFO:tasks.workunit.client.0.smithi045.stdout:4/568: dread db/de/d1e/d3e/d47/d59/f5f [0,4194304] 0 2024-09-18T12:52:15.893 INFO:tasks.workunit.client.0.smithi045.stdout:5/543: dread d6/d3e/f3f [0,4194304] 0 2024-09-18T12:52:15.894 INFO:tasks.workunit.client.0.smithi045.stdout:0/461: creat d6/f83 x:0 0 0 2024-09-18T12:52:15.896 INFO:tasks.workunit.client.0.smithi045.stdout:5/544: truncate d6/db/d6a/d77/f8c 290727 0 2024-09-18T12:52:15.901 INFO:tasks.workunit.client.1.smithi161.stdout:8/858: unlink d0/d3/d10/d21/d4a/d52/d82/d96/d98/fbe 0 2024-09-18T12:52:15.903 INFO:tasks.workunit.client.0.smithi045.stdout:4/569: getdents db/d1b 0 2024-09-18T12:52:15.905 INFO:tasks.workunit.client.1.smithi161.stdout:9/742: write d0/d16/d25/d28/f73 [169245,5774] 0 2024-09-18T12:52:15.905 INFO:tasks.workunit.client.0.smithi045.stdout:5/545: creat d6/db/fbb x:0 0 0 2024-09-18T12:52:15.908 INFO:tasks.workunit.client.0.smithi045.stdout:4/570: mkdir db/de/d1e/d3e/d47/db7 0 2024-09-18T12:52:15.911 INFO:tasks.workunit.client.1.smithi161.stdout:8/859: unlink d0/d3/d10/d21/d4a/d52/d66/d5b/ff9 0 2024-09-18T12:52:15.911 INFO:tasks.workunit.client.1.smithi161.stdout:6/914: link d4/d1a/d1c/d3e/d83/d9e/db1/d28/lf1 d4/d1a/d1c/d3e/d83/dad/dd4/l132 0 2024-09-18T12:52:15.912 INFO:tasks.workunit.client.0.smithi045.stdout:0/462: dread d6/d48/d5e/f2e [0,4194304] 0 2024-09-18T12:52:15.912 INFO:tasks.workunit.client.0.smithi045.stdout:0/463: chown d6/d35 732100 1 2024-09-18T12:52:15.913 INFO:tasks.workunit.client.1.smithi161.stdout:6/915: chown d4/d61/d9d/l10c 6635 1 2024-09-18T12:52:15.913 INFO:tasks.workunit.client.1.smithi161.stdout:9/743: stat d0/d93/cc1 0 2024-09-18T12:52:15.913 INFO:tasks.workunit.client.1.smithi161.stdout:6/916: fdatasync d4/d39/d48/fb6 0 2024-09-18T12:52:15.914 INFO:tasks.workunit.client.0.smithi045.stdout:5/546: dwrite d6/d3e/daa/fb9 [0,4194304] 0 2024-09-18T12:52:15.915 INFO:tasks.workunit.client.0.smithi045.stdout:4/571: rmdir db/de/d1e/d3e/d47/d59/d7a 39 2024-09-18T12:52:15.916 INFO:tasks.workunit.client.0.smithi045.stdout:4/572: stat db/de/d1a/d2e/l53 0 2024-09-18T12:52:15.917 INFO:tasks.workunit.client.1.smithi161.stdout:8/860: rename d0/d3/d10/d21/d4a/d52/d82/d96/dc1/feb to d0/d3/d10/f124 0 2024-09-18T12:52:15.920 INFO:tasks.workunit.client.0.smithi045.stdout:5/547: unlink d6/l22 0 2024-09-18T12:52:15.921 INFO:tasks.workunit.client.1.smithi161.stdout:9/744: mknod d0/dd4/cf6 0 2024-09-18T12:52:15.923 INFO:tasks.workunit.client.1.smithi161.stdout:9/745: fsync d0/d16/d25/d46/fb6 0 2024-09-18T12:52:15.923 INFO:tasks.workunit.client.1.smithi161.stdout:6/917: creat d4/d1a/d1c/d3e/d4d/f133 x:0 0 0 2024-09-18T12:52:15.925 INFO:tasks.workunit.client.0.smithi045.stdout:0/464: symlink d6/l84 0 2024-09-18T12:52:15.926 INFO:tasks.workunit.client.1.smithi161.stdout:0/863: truncate df/d30/d71/d96/dd3/f102 3192401 0 2024-09-18T12:52:15.929 INFO:tasks.workunit.client.0.smithi045.stdout:4/573: creat db/de/d1e/d49/fb8 x:0 0 0 2024-09-18T12:52:15.929 INFO:tasks.workunit.client.1.smithi161.stdout:5/826: dwrite d3/d8/de4/f80 [0,4194304] 0 2024-09-18T12:52:15.930 INFO:tasks.workunit.client.0.smithi045.stdout:4/574: read db/d2c/d35/fa1 [28374,14167] 0 2024-09-18T12:52:15.933 INFO:tasks.workunit.client.0.smithi045.stdout:0/465: unlink d6/d48/d5e/d39/f6d 0 2024-09-18T12:52:15.933 INFO:tasks.workunit.client.1.smithi161.stdout:4/880: dwrite d5/d27/f46 [0,4194304] 0 2024-09-18T12:52:15.937 INFO:tasks.workunit.client.1.smithi161.stdout:8/861: dread d0/d3/d1e/dda/fe1 [0,4194304] 0 2024-09-18T12:52:15.938 INFO:tasks.workunit.client.1.smithi161.stdout:8/862: chown d0/f7a 12024856 1 2024-09-18T12:52:15.941 INFO:tasks.workunit.client.1.smithi161.stdout:2/873: dwrite d0/d4/dab/fe4 [0,4194304] 0 2024-09-18T12:52:15.944 INFO:tasks.workunit.client.1.smithi161.stdout:6/918: mkdir d4/d1a/d1c/d3e/d4d/d125/d134 0 2024-09-18T12:52:15.946 INFO:tasks.workunit.client.0.smithi045.stdout:4/575: rename db/de/d1a/d2e/c7e to db/d2c/d35/d40/d6d/cb9 0 2024-09-18T12:52:15.949 INFO:tasks.workunit.client.1.smithi161.stdout:4/881: mkdir d5/d14/d67/d84/d120/d142 0 2024-09-18T12:52:15.950 INFO:tasks.workunit.client.1.smithi161.stdout:4/882: readlink d5/d27/l34 0 2024-09-18T12:52:15.950 INFO:tasks.workunit.client.0.smithi045.stdout:2/446: sync 2024-09-18T12:52:15.953 INFO:tasks.workunit.client.0.smithi045.stdout:4/576: dwrite f9 [4194304,4194304] 0 2024-09-18T12:52:15.956 INFO:tasks.workunit.client.1.smithi161.stdout:8/863: rename d0/d3/d1e to d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125 0 2024-09-18T12:52:15.958 INFO:tasks.workunit.client.0.smithi045.stdout:2/447: dread d5/d46/f70 [0,4194304] 0 2024-09-18T12:52:15.958 INFO:tasks.workunit.client.1.smithi161.stdout:2/874: mkdir d0/d1/deb/d3d/d4f/d9b/d128 0 2024-09-18T12:52:15.960 INFO:tasks.workunit.client.0.smithi045.stdout:4/577: write db/f30 [286216,22627] 0 2024-09-18T12:52:15.962 INFO:tasks.workunit.client.1.smithi161.stdout:9/746: write d0/db/f50 [658154,108615] 0 2024-09-18T12:52:15.963 INFO:tasks.workunit.client.1.smithi161.stdout:9/747: readlink d0/d47/d48/l95 0 2024-09-18T12:52:15.964 INFO:tasks.workunit.client.0.smithi045.stdout:5/548: truncate d6/db/d6a/d77/f63 1425121 0 2024-09-18T12:52:15.967 INFO:tasks.workunit.client.1.smithi161.stdout:8/864: creat d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f126 x:0 0 0 2024-09-18T12:52:15.968 INFO:tasks.workunit.client.0.smithi045.stdout:2/448: mknod d5/d3a/d3e/c9f 0 2024-09-18T12:52:15.969 INFO:tasks.workunit.client.1.smithi161.stdout:2/875: chown d0/d4/d78/ld3 251402 1 2024-09-18T12:52:15.969 INFO:tasks.workunit.client.1.smithi161.stdout:5/827: dwrite d3/def/f2e [4194304,4194304] 0 2024-09-18T12:52:15.970 INFO:tasks.workunit.client.0.smithi045.stdout:2/449: write d5/d2c/d4d/d76/d93/f98 [523359,81524] 0 2024-09-18T12:52:15.970 INFO:tasks.workunit.client.0.smithi045.stdout:5/549: mkdir d6/db/d19/dbc 0 2024-09-18T12:52:15.981 INFO:tasks.workunit.client.0.smithi045.stdout:4/578: dread db/de/d1e/d3e/d47/d59/d7a/f8b [0,4194304] 0 2024-09-18T12:52:15.984 INFO:tasks.workunit.client.0.smithi045.stdout:2/450: mkdir d5/d3a/da0 0 2024-09-18T12:52:15.986 INFO:tasks.workunit.client.0.smithi045.stdout:4/579: chown db/de/d1e/d3e/c65 108039969 1 2024-09-18T12:52:15.988 INFO:tasks.workunit.client.0.smithi045.stdout:2/451: creat d5/d2c/d4d/d16/fa1 x:0 0 0 2024-09-18T12:52:15.988 INFO:tasks.workunit.client.0.smithi045.stdout:5/550: read d6/db/d6a/d77/f63 [689816,25368] 0 2024-09-18T12:52:15.989 INFO:tasks.workunit.client.0.smithi045.stdout:2/452: chown d5/d3a/d3e/d9a 29525 1 2024-09-18T12:52:15.989 INFO:tasks.workunit.client.0.smithi045.stdout:4/580: rmdir db/de/d1e/d3e/d9a/d73 39 2024-09-18T12:52:15.993 INFO:tasks.workunit.client.0.smithi045.stdout:4/581: creat db/d20/d6b/fba x:0 0 0 2024-09-18T12:52:15.995 INFO:tasks.workunit.client.0.smithi045.stdout:2/453: write d5/d2c/d4d/d33/f37 [2646937,11255] 0 2024-09-18T12:52:15.995 INFO:tasks.workunit.client.0.smithi045.stdout:5/551: creat d6/db/d19/d92/fbd x:0 0 0 2024-09-18T12:52:15.996 INFO:tasks.workunit.client.0.smithi045.stdout:5/552: chown d6/db/d54 571118682 1 2024-09-18T12:52:15.997 INFO:tasks.workunit.client.0.smithi045.stdout:4/582: creat db/de/d1e/d3e/d47/fbb x:0 0 0 2024-09-18T12:52:15.998 INFO:tasks.workunit.client.0.smithi045.stdout:5/553: chown d6/d28/d2b/f2d 40279982 1 2024-09-18T12:52:15.998 INFO:tasks.workunit.client.0.smithi045.stdout:4/583: write db/d20/f70 [1041659,42051] 0 2024-09-18T12:52:15.999 INFO:tasks.workunit.client.0.smithi045.stdout:2/454: mknod d5/d2c/d4d/d16/ca2 0 2024-09-18T12:52:16.001 INFO:tasks.workunit.client.0.smithi045.stdout:2/455: write d5/d2c/f63 [859462,5315] 0 2024-09-18T12:52:16.003 INFO:tasks.workunit.client.0.smithi045.stdout:4/584: unlink db/de/c22 0 2024-09-18T12:52:16.007 INFO:tasks.workunit.client.0.smithi045.stdout:4/585: mkdir db/de/d1a/dbc 0 2024-09-18T12:52:16.007 INFO:tasks.workunit.client.0.smithi045.stdout:4/586: readlink db/d1b/l4a 0 2024-09-18T12:52:16.011 INFO:tasks.workunit.client.0.smithi045.stdout:2/456: write d5/d2c/d4d/d33/f55 [477637,70908] 0 2024-09-18T12:52:16.015 INFO:tasks.workunit.client.0.smithi045.stdout:4/587: link db/de/d1e/d3e/d47/d59/d2f/l67 db/de/d1e/d3e/d9a/d73/d75/lbd 0 2024-09-18T12:52:16.016 INFO:tasks.workunit.client.0.smithi045.stdout:5/554: dread d6/db/f2c [0,4194304] 0 2024-09-18T12:52:16.016 INFO:tasks.workunit.client.0.smithi045.stdout:2/457: dread d5/d2c/d4d/d33/f3d [0,4194304] 0 2024-09-18T12:52:16.016 INFO:tasks.workunit.client.0.smithi045.stdout:4/588: readlink db/de/d1e/d49/l9c 0 2024-09-18T12:52:16.018 INFO:tasks.workunit.client.0.smithi045.stdout:2/458: write d5/d2c/d4d/d76/f77 [451937,48536] 0 2024-09-18T12:52:16.018 INFO:tasks.workunit.client.0.smithi045.stdout:5/555: write d6/db/d19/d92/d61/fad [605342,90081] 0 2024-09-18T12:52:16.022 INFO:tasks.workunit.client.0.smithi045.stdout:4/589: dread db/d20/f44 [4194304,4194304] 0 2024-09-18T12:52:16.022 INFO:tasks.workunit.client.0.smithi045.stdout:4/590: fsync db/de/f9b 0 2024-09-18T12:52:16.025 INFO:tasks.workunit.client.0.smithi045.stdout:5/556: creat d6/db/d5a/d78/d66/fbe x:0 0 0 2024-09-18T12:52:16.027 INFO:tasks.workunit.client.0.smithi045.stdout:2/459: symlink d5/d3a/da0/la3 0 2024-09-18T12:52:16.028 INFO:tasks.workunit.client.0.smithi045.stdout:4/591: symlink db/de/d1e/d3e/d9a/lbe 0 2024-09-18T12:52:16.029 INFO:tasks.workunit.client.0.smithi045.stdout:4/592: dread - db/de/d1e/d3e/f8c zero size 2024-09-18T12:52:16.030 INFO:tasks.workunit.client.0.smithi045.stdout:2/460: fsync d5/d46/f86 0 2024-09-18T12:52:16.031 INFO:tasks.workunit.client.0.smithi045.stdout:2/461: write d5/d46/f8e [752278,16279] 0 2024-09-18T12:52:16.031 INFO:tasks.workunit.client.0.smithi045.stdout:4/593: readlink db/de/d1e/d3e/d47/d59/d2f/l67 0 2024-09-18T12:52:16.032 INFO:tasks.workunit.client.0.smithi045.stdout:2/462: chown d5/d3a/d3e/l4a 200445093 1 2024-09-18T12:52:16.034 INFO:tasks.workunit.client.0.smithi045.stdout:5/557: getdents d6/db/d19/d92/d61/da5 0 2024-09-18T12:52:16.036 INFO:tasks.workunit.client.0.smithi045.stdout:5/558: read d6/db/d5a/d78/d66/f69 [832898,54574] 0 2024-09-18T12:52:16.036 INFO:tasks.workunit.client.0.smithi045.stdout:2/463: rename d5/d2c/d4d/d76/d93/f98 to d5/d2c/d4d/d76/d93/fa4 0 2024-09-18T12:52:16.037 INFO:tasks.workunit.client.0.smithi045.stdout:5/559: truncate d6/f7 3639647 0 2024-09-18T12:52:16.037 INFO:tasks.workunit.client.0.smithi045.stdout:2/464: dread - d5/d2c/d4d/d16/d61/f96 zero size 2024-09-18T12:52:16.039 INFO:tasks.workunit.client.0.smithi045.stdout:2/465: rmdir d5/d3a/da0 39 2024-09-18T12:52:16.040 INFO:tasks.workunit.client.0.smithi045.stdout:5/560: creat d6/db/d19/d92/d5c/dae/fbf x:0 0 0 2024-09-18T12:52:16.041 INFO:tasks.workunit.client.0.smithi045.stdout:2/466: dread d5/d3a/f4c [0,4194304] 0 2024-09-18T12:52:16.042 INFO:tasks.workunit.client.0.smithi045.stdout:5/561: unlink d6/db/d5a/f7c 0 2024-09-18T12:52:16.042 INFO:tasks.workunit.client.0.smithi045.stdout:2/467: fsync d5/d2c/d4d/d16/fa1 0 2024-09-18T12:52:16.042 INFO:tasks.workunit.client.0.smithi045.stdout:2/468: stat d5/d3a/d3e/c41 0 2024-09-18T12:52:16.046 INFO:tasks.workunit.client.0.smithi045.stdout:2/469: dwrite d5/d46/f7e [0,4194304] 0 2024-09-18T12:52:16.064 INFO:tasks.workunit.client.1.smithi161.stdout:7/767: sync 2024-09-18T12:52:16.070 INFO:tasks.workunit.client.1.smithi161.stdout:5/828: chown d3/d8/de4/d8d/db0/fe9 110040906 1 2024-09-18T12:52:16.070 INFO:tasks.workunit.client.1.smithi161.stdout:7/768: write d3/d50/fba [6513808,23081] 0 2024-09-18T12:52:16.070 INFO:tasks.workunit.client.1.smithi161.stdout:9/748: write d0/d16/d25/d28/f33 [4954997,120920] 0 2024-09-18T12:52:16.073 INFO:tasks.workunit.client.1.smithi161.stdout:5/829: chown d3/d44/d6f/dca/d10d/c106 0 1 2024-09-18T12:52:16.076 INFO:tasks.workunit.client.1.smithi161.stdout:8/865: dwrite d0/d3/d10/d21/d4a/d52/d82/d96/fa3 [0,4194304] 0 2024-09-18T12:52:16.078 INFO:tasks.workunit.client.1.smithi161.stdout:5/830: dread d3/d3b/f42 [4194304,4194304] 0 2024-09-18T12:52:16.079 INFO:tasks.workunit.client.0.smithi045.stdout:6/392: sync 2024-09-18T12:52:16.084 INFO:tasks.workunit.client.1.smithi161.stdout:4/883: link d5/d27/d44/de2/dfe/f121 d5/d14/d67/dc7/d47/dbc/d139/f143 0 2024-09-18T12:52:16.085 INFO:tasks.workunit.client.1.smithi161.stdout:8/866: dwrite d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/ff0 [0,4194304] 0 2024-09-18T12:52:16.085 INFO:tasks.workunit.client.1.smithi161.stdout:4/884: dread - d5/d14/d5f/f107 zero size 2024-09-18T12:52:16.086 INFO:tasks.workunit.client.0.smithi045.stdout:2/470: creat d5/d2c/d6f/fa5 x:0 0 0 2024-09-18T12:52:16.089 INFO:tasks.workunit.client.1.smithi161.stdout:2/876: mknod d0/d1/deb/d3d/d4f/c129 0 2024-09-18T12:52:16.092 INFO:tasks.workunit.client.0.smithi045.stdout:6/393: symlink d9/d1a/d48/d75/d81/l8c 0 2024-09-18T12:52:16.093 INFO:tasks.workunit.client.1.smithi161.stdout:9/749: creat d0/d47/ff7 x:0 0 0 2024-09-18T12:52:16.095 INFO:tasks.workunit.client.0.smithi045.stdout:6/394: creat d9/d1a/d48/f8d x:0 0 0 2024-09-18T12:52:16.096 INFO:tasks.workunit.client.1.smithi161.stdout:8/867: rmdir d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/de3 39 2024-09-18T12:52:16.097 INFO:tasks.workunit.client.1.smithi161.stdout:2/877: dread - d0/d5/d43/fba zero size 2024-09-18T12:52:16.098 INFO:tasks.workunit.client.0.smithi045.stdout:6/395: symlink d9/d1a/d2d/d38/d5b/l8e 0 2024-09-18T12:52:16.098 INFO:tasks.workunit.client.1.smithi161.stdout:7/769: symlink d3/le8 0 2024-09-18T12:52:16.099 INFO:tasks.workunit.client.1.smithi161.stdout:4/885: dread d5/d14/d67/dc7/d47/d49/d7b/f135 [0,4194304] 0 2024-09-18T12:52:16.100 INFO:tasks.workunit.client.1.smithi161.stdout:8/868: creat d0/d3/d91/f127 x:0 0 0 2024-09-18T12:52:16.101 INFO:tasks.workunit.client.1.smithi161.stdout:2/878: creat d0/d1/d4c/de5/f12a x:0 0 0 2024-09-18T12:52:16.102 INFO:tasks.workunit.client.1.smithi161.stdout:9/750: mknod d0/d47/d48/de7/cf8 0 2024-09-18T12:52:16.103 INFO:tasks.workunit.client.1.smithi161.stdout:5/831: creat d3/d44/f112 x:0 0 0 2024-09-18T12:52:16.103 INFO:tasks.workunit.client.1.smithi161.stdout:7/770: rmdir d3/d8/d15/da7/d4a 39 2024-09-18T12:52:16.104 INFO:tasks.workunit.client.1.smithi161.stdout:7/771: readlink d3/d8/d15/d99/db0/lda 0 2024-09-18T12:52:16.109 INFO:tasks.workunit.client.1.smithi161.stdout:7/772: creat d3/d8/d15/da7/d24/daf/fe9 x:0 0 0 2024-09-18T12:52:16.111 INFO:tasks.workunit.client.0.smithi045.stdout:6/396: dread d9/d1a/f2e [0,4194304] 0 2024-09-18T12:52:16.111 INFO:tasks.workunit.client.1.smithi161.stdout:8/869: dwrite d0/d3/d10/d21/d4a/f77 [0,4194304] 0 2024-09-18T12:52:16.115 INFO:tasks.workunit.client.1.smithi161.stdout:8/870: creat d0/d3/d10/d21/d4a/d52/d94/f128 x:0 0 0 2024-09-18T12:52:16.118 INFO:tasks.workunit.client.0.smithi045.stdout:6/397: dread d9/d1a/d2d/f5e [0,4194304] 0 2024-09-18T12:52:16.119 INFO:tasks.workunit.client.1.smithi161.stdout:7/773: getdents d3/d8/d15/da7/d24/d31/d7d 0 2024-09-18T12:52:16.120 INFO:tasks.workunit.client.1.smithi161.stdout:8/871: symlink d0/d3/d10/d21/d4a/d52/d82/d96/d98/de7/l129 0 2024-09-18T12:52:16.123 INFO:tasks.workunit.client.0.smithi045.stdout:5/562: dwrite d6/d3e/f9b [0,4194304] 0 2024-09-18T12:52:16.125 INFO:tasks.workunit.client.0.smithi045.stdout:2/471: dwrite d5/d2c/d4d/d16/f2e [0,4194304] 0 2024-09-18T12:52:16.125 INFO:tasks.workunit.client.0.smithi045.stdout:6/398: mkdir d9/d1a/d48/d8f 0 2024-09-18T12:52:16.127 INFO:tasks.workunit.client.1.smithi161.stdout:8/872: creat d0/d3/d10/d21/d4a/d52/d82/d96/dba/d10d/f12a x:0 0 0 2024-09-18T12:52:16.130 INFO:tasks.workunit.client.0.smithi045.stdout:5/563: symlink d6/db/d6a/lc0 0 2024-09-18T12:52:16.131 INFO:tasks.workunit.client.0.smithi045.stdout:2/472: rename d5/d3a/d3e/d9a to d5/d2c/d4d/d76/da6 0 2024-09-18T12:52:16.132 INFO:tasks.workunit.client.1.smithi161.stdout:1/725: sync 2024-09-18T12:52:16.132 INFO:tasks.workunit.client.1.smithi161.stdout:3/829: sync 2024-09-18T12:52:16.134 INFO:tasks.workunit.client.1.smithi161.stdout:8/873: unlink d0/d3/d10/d21/d4a/d52/d66/l88 0 2024-09-18T12:52:16.138 INFO:tasks.workunit.client.1.smithi161.stdout:1/726: read - d1/da/d31/f8d zero size 2024-09-18T12:52:16.140 INFO:tasks.workunit.client.0.smithi045.stdout:2/473: creat d5/d2c/d4d/d76/fa7 x:0 0 0 2024-09-18T12:52:16.141 INFO:tasks.workunit.client.0.smithi045.stdout:2/474: write d5/d2c/d4d/f1b [8949758,47751] 0 2024-09-18T12:52:16.142 INFO:tasks.workunit.client.0.smithi045.stdout:6/399: mknod d9/d1a/d48/d7d/c90 0 2024-09-18T12:52:16.143 INFO:tasks.workunit.client.1.smithi161.stdout:1/727: dread - d1/d26/fd0 zero size 2024-09-18T12:52:16.144 INFO:tasks.workunit.client.0.smithi045.stdout:5/564: link d6/d28/d2b/d51/d6c/f71 d6/db/d70/fc1 0 2024-09-18T12:52:16.144 INFO:tasks.workunit.client.0.smithi045.stdout:5/565: chown d6 75560 1 2024-09-18T12:52:16.147 INFO:tasks.workunit.client.0.smithi045.stdout:6/400: symlink d9/d1a/d2d/d32/l91 0 2024-09-18T12:52:16.147 INFO:tasks.workunit.client.0.smithi045.stdout:5/566: write d6/db/d19/d92/f79 [841746,89838] 0 2024-09-18T12:52:16.148 INFO:tasks.workunit.client.1.smithi161.stdout:3/830: dread d1/d2e/d68/d92/f10b [0,4194304] 0 2024-09-18T12:52:16.149 INFO:tasks.workunit.client.0.smithi045.stdout:2/475: dwrite d5/d2c/d4d/f32 [4194304,4194304] 0 2024-09-18T12:52:16.150 INFO:tasks.workunit.client.0.smithi045.stdout:2/476: fsync d5/d46/f7e 0 2024-09-18T12:52:16.154 INFO:tasks.workunit.client.1.smithi161.stdout:4/886: dwrite d5/d27/d44/de2/fb7 [0,4194304] 0 2024-09-18T12:52:16.156 INFO:tasks.workunit.client.1.smithi161.stdout:9/751: dwrite d0/d16/d25/d28/f3f [0,4194304] 0 2024-09-18T12:52:16.157 INFO:tasks.workunit.client.1.smithi161.stdout:8/874: symlink d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/de3/df4/l12b 0 2024-09-18T12:52:16.157 INFO:tasks.workunit.client.1.smithi161.stdout:5/832: dwrite d3/def/f3e [0,4194304] 0 2024-09-18T12:52:16.159 INFO:tasks.workunit.client.0.smithi045.stdout:5/567: dwrite d6/db/d19/d92/d61/f65 [0,4194304] 0 2024-09-18T12:52:16.159 INFO:tasks.workunit.client.0.smithi045.stdout:2/477: rename d5/d2c/d4d/d16 to d5/d5f/da8 0 2024-09-18T12:52:16.161 INFO:tasks.workunit.client.1.smithi161.stdout:2/879: dwrite d0/d1/deb/d7e/f70 [0,4194304] 0 2024-09-18T12:52:16.162 INFO:tasks.workunit.client.0.smithi045.stdout:2/478: creat d5/d46/fa9 x:0 0 0 2024-09-18T12:52:16.163 INFO:tasks.workunit.client.0.smithi045.stdout:2/479: chown d5/d46/f8e 15840 1 2024-09-18T12:52:16.165 INFO:tasks.workunit.client.1.smithi161.stdout:9/752: readlink d0/d47/d48/lcd 0 2024-09-18T12:52:16.171 INFO:tasks.workunit.client.1.smithi161.stdout:9/753: read - d0/d20/fad zero size 2024-09-18T12:52:16.172 INFO:tasks.workunit.client.0.smithi045.stdout:2/480: getdents d5/d5f/da8 0 2024-09-18T12:52:16.174 INFO:tasks.workunit.client.1.smithi161.stdout:9/754: fdatasync d0/d20/d74/fea 0 2024-09-18T12:52:16.175 INFO:tasks.workunit.client.1.smithi161.stdout:4/887: rmdir d5/d14/d67/dc7/d60/d95/d12a 0 2024-09-18T12:52:16.176 INFO:tasks.workunit.client.1.smithi161.stdout:1/728: dread d1/da/d31/fd3 [0,4194304] 0 2024-09-18T12:52:16.177 INFO:tasks.workunit.client.1.smithi161.stdout:9/755: fsync d0/fac 0 2024-09-18T12:52:16.178 INFO:tasks.workunit.client.1.smithi161.stdout:5/833: dwrite d3/def/f2e [4194304,4194304] 0 2024-09-18T12:52:16.180 INFO:tasks.workunit.client.1.smithi161.stdout:8/875: truncate d0/d3/d10/d21/d4a/d52/d82/d8b/fd8 749081 0 2024-09-18T12:52:16.181 INFO:tasks.workunit.client.1.smithi161.stdout:0/864: sync 2024-09-18T12:52:16.181 INFO:tasks.workunit.client.1.smithi161.stdout:6/919: sync 2024-09-18T12:52:16.182 INFO:tasks.workunit.client.1.smithi161.stdout:1/729: symlink d1/da/d1f/d6b/lf7 0 2024-09-18T12:52:16.182 INFO:tasks.workunit.client.0.smithi045.stdout:2/481: dwrite d5/f22 [4194304,4194304] 0 2024-09-18T12:52:16.183 INFO:tasks.workunit.client.1.smithi161.stdout:9/756: rmdir d0/d16/d25/d46 39 2024-09-18T12:52:16.184 INFO:tasks.workunit.client.1.smithi161.stdout:7/774: dread d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f7f [0,4194304] 0 2024-09-18T12:52:16.184 INFO:tasks.workunit.client.1.smithi161.stdout:5/834: mkdir d3/d3b/d7b/d82/d113 0 2024-09-18T12:52:16.185 INFO:tasks.workunit.client.1.smithi161.stdout:5/835: chown d3/def 245311 1 2024-09-18T12:52:16.185 INFO:tasks.workunit.client.0.smithi045.stdout:2/482: truncate d5/d2c/d4d/d76/d93/fa4 906407 0 2024-09-18T12:52:16.188 INFO:tasks.workunit.client.1.smithi161.stdout:7/775: write d3/d8/d15/da7/f39 [1305366,13358] 0 2024-09-18T12:52:16.188 INFO:tasks.workunit.client.1.smithi161.stdout:5/836: write d3/def/f3e [2160615,82006] 0 2024-09-18T12:52:16.189 INFO:tasks.workunit.client.1.smithi161.stdout:8/876: dread d0/d3/d10/d21/d4a/d52/f58 [0,4194304] 0 2024-09-18T12:52:16.190 INFO:tasks.workunit.client.1.smithi161.stdout:0/865: rmdir df/d30/d4d/d92 39 2024-09-18T12:52:16.191 INFO:tasks.workunit.client.1.smithi161.stdout:1/730: rename d1/d26/f9 to d1/daa/db2/dc0/ff8 0 2024-09-18T12:52:16.192 INFO:tasks.workunit.client.1.smithi161.stdout:8/877: fdatasync d0/d3/d10/d21/f86 0 2024-09-18T12:52:16.193 INFO:tasks.workunit.client.1.smithi161.stdout:6/920: fsync d4/d39/d26/d31/f59 0 2024-09-18T12:52:16.195 INFO:tasks.workunit.client.1.smithi161.stdout:5/837: symlink d3/d3b/d7b/da6/l114 0 2024-09-18T12:52:16.196 INFO:tasks.workunit.client.1.smithi161.stdout:8/878: fsync d0/d3/d10/d21/d4a/d52/d82/d96/dba/fc9 0 2024-09-18T12:52:16.197 INFO:tasks.workunit.client.0.smithi045.stdout:2/483: creat d5/d2c/d4d/d33/faa x:0 0 0 2024-09-18T12:52:16.197 INFO:tasks.workunit.client.1.smithi161.stdout:5/838: chown d3/d44/d6f/dca/d10d/l17 6577 1 2024-09-18T12:52:16.198 INFO:tasks.workunit.client.0.smithi045.stdout:2/484: chown d5/d46/f52 24335 1 2024-09-18T12:52:16.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/731: creat d1/da/d1f/dab/daf/de8/ff9 x:0 0 0 2024-09-18T12:52:16.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/732: dread - d1/da/d39/fbd zero size 2024-09-18T12:52:16.201 INFO:tasks.workunit.client.1.smithi161.stdout:7/776: rename d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/cc2 to d3/d83/cea 0 2024-09-18T12:52:16.202 INFO:tasks.workunit.client.1.smithi161.stdout:6/921: symlink d4/d1a/d1c/d7c/l135 0 2024-09-18T12:52:16.202 INFO:tasks.workunit.client.0.smithi045.stdout:2/485: rename d5/d5f/da8/d61/l67 to d5/d5f/da8/d61/lab 0 2024-09-18T12:52:16.204 INFO:tasks.workunit.client.1.smithi161.stdout:5/839: dread - d3/d3b/fb7 zero size 2024-09-18T12:52:16.204 INFO:tasks.workunit.client.1.smithi161.stdout:9/757: creat d0/db/ff9 x:0 0 0 2024-09-18T12:52:16.205 INFO:tasks.workunit.client.1.smithi161.stdout:8/879: creat d0/d3/d10/d21/d4a/d52/d66/d5b/f12c x:0 0 0 2024-09-18T12:52:16.205 INFO:tasks.workunit.client.1.smithi161.stdout:1/733: readlink d1/d1d/lb7 0 2024-09-18T12:52:16.206 INFO:tasks.workunit.client.1.smithi161.stdout:0/866: unlink df/d30/d4d/d92/cee 0 2024-09-18T12:52:16.208 INFO:tasks.workunit.client.1.smithi161.stdout:9/758: readlink d0/d47/d48/d88/l9f 0 2024-09-18T12:52:16.209 INFO:tasks.workunit.client.1.smithi161.stdout:6/922: rename d4/d39/d26/f2b to d4/d1a/d1c/d3e/d4d/d125/d134/f136 0 2024-09-18T12:52:16.209 INFO:tasks.workunit.client.1.smithi161.stdout:0/867: truncate df/d98/fb5 4605820 0 2024-09-18T12:52:16.210 INFO:tasks.workunit.client.1.smithi161.stdout:8/880: fdatasync d0/d3/d10/d21/d4a/d52/d82/d96/d98/f64 0 2024-09-18T12:52:16.212 INFO:tasks.workunit.client.1.smithi161.stdout:3/831: dread d1/d2e/d24/d1d/fcd [0,4194304] 0 2024-09-18T12:52:16.213 INFO:tasks.workunit.client.1.smithi161.stdout:8/881: readlink d0/d3/d10/d21/d4a/d52/d82/d96/dba/laa 0 2024-09-18T12:52:16.213 INFO:tasks.workunit.client.1.smithi161.stdout:3/832: write d1/d2e/d68/fd6 [586801,125083] 0 2024-09-18T12:52:16.269 INFO:tasks.workunit.client.1.smithi161.stdout:6/923: rmdir d4/d1a/d1c/d3e/d83/d9e/db1/d45/d68 39 2024-09-18T12:52:16.269 INFO:tasks.workunit.client.1.smithi161.stdout:8/882: dread - d0/d3/d11d/ffd zero size 2024-09-18T12:52:16.270 INFO:tasks.workunit.client.1.smithi161.stdout:5/840: getdents d3/d44/d6f/dca 0 2024-09-18T12:52:16.270 INFO:tasks.workunit.client.1.smithi161.stdout:8/883: stat d0/d3/d10/c7d 0 2024-09-18T12:52:16.275 INFO:tasks.workunit.client.1.smithi161.stdout:8/884: stat d0/d3/d10/d21/d4a/d52/d82/d96/d98/l1b 0 2024-09-18T12:52:16.276 INFO:tasks.workunit.client.1.smithi161.stdout:0/868: creat df/d30/d4d/f133 x:0 0 0 2024-09-18T12:52:16.278 INFO:tasks.workunit.client.1.smithi161.stdout:3/833: mknod d1/d2e/d24/d1d/c120 0 2024-09-18T12:52:16.279 INFO:tasks.workunit.client.1.smithi161.stdout:2/880: dwrite d0/d1/d4c/d67/db9/dcb/d8a/f105 [0,4194304] 0 2024-09-18T12:52:16.280 INFO:tasks.workunit.client.1.smithi161.stdout:5/841: write d3/d3b/d54/fc4 [2556673,37177] 0 2024-09-18T12:52:16.284 INFO:tasks.workunit.client.1.smithi161.stdout:0/869: chown df/d30/d71/d96/dd3/lcf 13258 1 2024-09-18T12:52:16.286 INFO:tasks.workunit.client.1.smithi161.stdout:5/842: symlink d3/d3b/d7b/d82/l115 0 2024-09-18T12:52:16.286 INFO:tasks.workunit.client.1.smithi161.stdout:8/885: mkdir d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/d12d 0 2024-09-18T12:52:16.286 INFO:tasks.workunit.client.1.smithi161.stdout:0/870: readlink df/d98/d128/l93 0 2024-09-18T12:52:16.287 INFO:tasks.workunit.client.1.smithi161.stdout:2/881: mknod d0/d1/d4c/d67/db9/dcb/d8a/da8/c12b 0 2024-09-18T12:52:16.289 INFO:tasks.workunit.client.1.smithi161.stdout:3/834: creat d1/f121 x:0 0 0 2024-09-18T12:52:16.291 INFO:tasks.workunit.client.1.smithi161.stdout:1/734: dread f0 [0,4194304] 0 2024-09-18T12:52:16.291 INFO:tasks.workunit.client.1.smithi161.stdout:6/924: dread d4/d1a/f11 [0,4194304] 0 2024-09-18T12:52:16.292 INFO:tasks.workunit.client.1.smithi161.stdout:0/871: unlink df/d30/d71/d96/dd3/d51/dc9/l127 0 2024-09-18T12:52:16.292 INFO:tasks.workunit.client.1.smithi161.stdout:2/882: truncate d0/f24 3279323 0 2024-09-18T12:52:16.293 INFO:tasks.workunit.client.1.smithi161.stdout:7/777: dread d3/d8/f91 [0,4194304] 0 2024-09-18T12:52:16.294 INFO:tasks.workunit.client.1.smithi161.stdout:8/886: mknod d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/de3/df4/c12e 0 2024-09-18T12:52:16.294 INFO:tasks.workunit.client.1.smithi161.stdout:1/735: chown d1/d26/d3a/d52/c5f 96 1 2024-09-18T12:52:16.295 INFO:tasks.workunit.client.1.smithi161.stdout:8/887: dread - d0/dc4/f123 zero size 2024-09-18T12:52:16.296 INFO:tasks.workunit.client.1.smithi161.stdout:2/883: chown d0/f24 1219572173 1 2024-09-18T12:52:16.296 INFO:tasks.workunit.client.1.smithi161.stdout:6/925: chown d4/d1a/d1c/d3e/f99 0 1 2024-09-18T12:52:16.299 INFO:tasks.workunit.client.1.smithi161.stdout:7/778: creat d3/d8/d15/da7/d24/ddd/feb x:0 0 0 2024-09-18T12:52:16.303 INFO:tasks.workunit.client.1.smithi161.stdout:1/736: dwrite d1/d26/f98 [0,4194304] 0 2024-09-18T12:52:16.305 INFO:tasks.workunit.client.1.smithi161.stdout:2/884: dwrite d0/f75 [0,4194304] 0 2024-09-18T12:52:16.347 INFO:tasks.workunit.client.0.smithi045.stdout:1/392: sync 2024-09-18T12:52:16.347 INFO:tasks.workunit.client.0.smithi045.stdout:7/359: sync 2024-09-18T12:52:16.352 INFO:tasks.workunit.client.0.smithi045.stdout:1/393: dwrite d0/d12/f27 [0,4194304] 0 2024-09-18T12:52:16.357 INFO:tasks.workunit.client.0.smithi045.stdout:1/394: dwrite d0/d2d/f45 [0,4194304] 0 2024-09-18T12:52:16.374 INFO:tasks.workunit.client.1.smithi161.stdout:4/888: sync 2024-09-18T12:52:16.395 INFO:tasks.workunit.client.1.smithi161.stdout:6/926: mkdir d4/d1a/d1c/d3e/d83/dad/dd4/d131/d137 0 2024-09-18T12:52:16.399 INFO:tasks.workunit.client.0.smithi045.stdout:7/360: rename d13/d31/d29 to d13/d44/d37/d70/d77 0 2024-09-18T12:52:16.399 INFO:tasks.workunit.client.0.smithi045.stdout:7/361: fdatasync d13/d44/d37/f4a 0 2024-09-18T12:52:16.403 INFO:tasks.workunit.client.1.smithi161.stdout:1/737: mknod d1/d26/da6/cfa 0 2024-09-18T12:52:16.404 INFO:tasks.workunit.client.1.smithi161.stdout:3/835: write d1/d2e/d24/f3a [3503889,72828] 0 2024-09-18T12:52:16.404 INFO:tasks.workunit.client.1.smithi161.stdout:1/738: fsync d1/d26/f98 0 2024-09-18T12:52:16.405 INFO:tasks.workunit.client.1.smithi161.stdout:1/739: readlink d1/d71/leb 0 2024-09-18T12:52:16.406 INFO:tasks.workunit.client.1.smithi161.stdout:2/885: unlink d0/l84 0 2024-09-18T12:52:16.408 INFO:tasks.workunit.client.1.smithi161.stdout:4/889: mknod d5/d32/d39/c144 0 2024-09-18T12:52:16.410 INFO:tasks.workunit.client.1.smithi161.stdout:6/927: mkdir d4/d39/d26/d31/d138 0 2024-09-18T12:52:16.411 INFO:tasks.workunit.client.0.smithi045.stdout:7/362: mkdir d13/d31/d33/d64/d78 0 2024-09-18T12:52:16.412 INFO:tasks.workunit.client.1.smithi161.stdout:0/872: dwrite df/d29/fa2 [0,4194304] 0 2024-09-18T12:52:16.412 INFO:tasks.workunit.client.1.smithi161.stdout:8/888: truncate d0/d3/d10/d21/f3a 2496837 0 2024-09-18T12:52:16.412 INFO:tasks.workunit.client.1.smithi161.stdout:6/928: fsync d4/d1a/d1c/d3e/d83/d9e/db1/d45/fe8 0 2024-09-18T12:52:16.413 INFO:tasks.workunit.client.1.smithi161.stdout:7/779: mkdir d3/d8/d15/dec 0 2024-09-18T12:52:16.415 INFO:tasks.workunit.client.0.smithi045.stdout:7/363: creat d13/d44/d37/d70/f79 x:0 0 0 2024-09-18T12:52:16.417 INFO:tasks.workunit.client.1.smithi161.stdout:3/836: unlink d1/d2e/d14/d2c/d72/fdb 0 2024-09-18T12:52:16.418 INFO:tasks.workunit.client.1.smithi161.stdout:3/837: truncate d1/d2e/d14/f44 2594296 0 2024-09-18T12:52:16.419 INFO:tasks.workunit.client.1.smithi161.stdout:2/886: mknod d0/d1/deb/d3d/d4f/c12c 0 2024-09-18T12:52:16.420 INFO:tasks.workunit.client.1.smithi161.stdout:2/887: readlink d0/d5/d53/l1f 0 2024-09-18T12:52:16.421 INFO:tasks.workunit.client.0.smithi045.stdout:7/364: mknod d13/d31/d33/d64/d78/c7a 0 2024-09-18T12:52:16.424 INFO:tasks.workunit.client.0.smithi045.stdout:1/395: dwrite d0/d2d/f53 [4194304,4194304] 0 2024-09-18T12:52:16.425 INFO:tasks.workunit.client.1.smithi161.stdout:9/759: sync 2024-09-18T12:52:16.425 INFO:tasks.workunit.client.1.smithi161.stdout:5/843: sync 2024-09-18T12:52:16.426 INFO:tasks.workunit.client.1.smithi161.stdout:5/844: fdatasync d3/def/f3c 0 2024-09-18T12:52:16.427 INFO:tasks.workunit.client.1.smithi161.stdout:8/889: symlink d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/de3/l12f 0 2024-09-18T12:52:16.430 INFO:tasks.workunit.client.1.smithi161.stdout:1/740: mknod d1/d26/dad/db6/df6/cfb 0 2024-09-18T12:52:16.430 INFO:tasks.workunit.client.1.smithi161.stdout:3/838: dwrite d1/d2e/d14/d2c/f33 [0,4194304] 0 2024-09-18T12:52:16.432 INFO:tasks.workunit.client.0.smithi045.stdout:1/396: dwrite d0/fb [4194304,4194304] 0 2024-09-18T12:52:16.432 INFO:tasks.workunit.client.0.smithi045.stdout:7/365: creat d13/d44/d37/d70/d77/f7b x:0 0 0 2024-09-18T12:52:16.433 INFO:tasks.workunit.client.0.smithi045.stdout:7/366: fdatasync d13/f24 0 2024-09-18T12:52:16.434 INFO:tasks.workunit.client.0.smithi045.stdout:1/397: chown d0/d2e/f22 5617606 1 2024-09-18T12:52:16.435 INFO:tasks.workunit.client.0.smithi045.stdout:1/398: stat d0/d12/d32/d67/d6d/f72 0 2024-09-18T12:52:16.439 INFO:tasks.workunit.client.0.smithi045.stdout:8/462: sync 2024-09-18T12:52:16.440 INFO:tasks.workunit.client.1.smithi161.stdout:0/873: rename df/d29/c5d to df/de2/dc5/d89/d131/c134 0 2024-09-18T12:52:16.444 INFO:tasks.workunit.client.1.smithi161.stdout:4/890: write d5/d14/d67/dc7/f80 [489999,107746] 0 2024-09-18T12:52:16.445 INFO:tasks.workunit.client.0.smithi045.stdout:7/367: rename d13/d31/d33/c57 to d13/d31/d33/c7c 0 2024-09-18T12:52:16.446 INFO:tasks.workunit.client.0.smithi045.stdout:8/463: dwrite d11/d14/f19 [0,4194304] 0 2024-09-18T12:52:16.448 INFO:tasks.workunit.client.1.smithi161.stdout:8/890: mknod d0/d3/d10/d21/d4a/d52/d82/de6/c130 0 2024-09-18T12:52:16.449 INFO:tasks.workunit.client.0.smithi045.stdout:7/368: mknod d13/d31/d5f/c7d 0 2024-09-18T12:52:16.450 INFO:tasks.workunit.client.0.smithi045.stdout:8/464: mknod d11/d7b/c8f 0 2024-09-18T12:52:16.452 INFO:tasks.workunit.client.0.smithi045.stdout:7/369: symlink d13/d31/d33/l7e 0 2024-09-18T12:52:16.454 INFO:tasks.workunit.client.1.smithi161.stdout:3/839: rename d1/d2e/d24/d1d/fcd to d1/d2e/d68/d11c/f122 0 2024-09-18T12:52:16.458 INFO:tasks.workunit.client.0.smithi045.stdout:7/370: creat d13/d31/d63/f7f x:0 0 0 2024-09-18T12:52:16.459 INFO:tasks.workunit.client.1.smithi161.stdout:4/891: symlink d5/d14/d67/dc7/d60/d95/l145 0 2024-09-18T12:52:16.460 INFO:tasks.workunit.client.0.smithi045.stdout:7/371: creat d13/d44/f80 x:0 0 0 2024-09-18T12:52:16.464 INFO:tasks.workunit.client.1.smithi161.stdout:7/780: link d3/d8/d15/da7/fcf d3/d8/d15/da7/d4a/fed 0 2024-09-18T12:52:16.466 INFO:tasks.workunit.client.1.smithi161.stdout:8/891: mkdir d0/d3/d10/d21/d4a/d52/d94/d131 0 2024-09-18T12:52:16.467 INFO:tasks.workunit.client.1.smithi161.stdout:1/741: mknod d1/da/d1f/d45/cfc 0 2024-09-18T12:52:16.472 INFO:tasks.workunit.client.0.smithi045.stdout:7/372: dread d13/d1a/f27 [0,4194304] 0 2024-09-18T12:52:16.473 INFO:tasks.workunit.client.0.smithi045.stdout:7/373: write d13/d1a/d28/f46 [231089,79519] 0 2024-09-18T12:52:16.473 INFO:tasks.workunit.client.1.smithi161.stdout:6/929: dwrite d4/d39/d26/d31/d76/f9c [0,4194304] 0 2024-09-18T12:52:16.474 INFO:tasks.workunit.client.1.smithi161.stdout:8/892: creat d0/d3/d10/d21/d4a/d52/de2/f132 x:0 0 0 2024-09-18T12:52:16.476 INFO:tasks.workunit.client.0.smithi045.stdout:1/399: write d0/fa [4016281,22073] 0 2024-09-18T12:52:16.478 INFO:tasks.workunit.client.0.smithi045.stdout:7/374: mkdir d13/d31/d52/d81 0 2024-09-18T12:52:16.480 INFO:tasks.workunit.client.1.smithi161.stdout:2/888: dwrite d0/d5/d43/d35/f7a [0,4194304] 0 2024-09-18T12:52:16.480 INFO:tasks.workunit.client.1.smithi161.stdout:8/893: truncate d0/d3/d10/d21/d4a/d52/d82/d96/f72 5114385 0 2024-09-18T12:52:16.485 INFO:tasks.workunit.client.0.smithi045.stdout:7/375: dread d13/d1a/f49 [0,4194304] 0 2024-09-18T12:52:16.489 INFO:tasks.workunit.client.1.smithi161.stdout:1/742: creat d1/da/d1f/dab/dd9/ffd x:0 0 0 2024-09-18T12:52:16.490 INFO:tasks.workunit.client.1.smithi161.stdout:2/889: dwrite d0/d1/d4c/de5/f12a [0,4194304] 0 2024-09-18T12:52:16.491 INFO:tasks.workunit.client.1.smithi161.stdout:1/743: stat d1/d1d/lb7 0 2024-09-18T12:52:16.491 INFO:tasks.workunit.client.0.smithi045.stdout:1/400: rename d0/d2d/d2b/d30/d40/l54 to d0/d2d/d2b/d30/d3d/l78 0 2024-09-18T12:52:16.492 INFO:tasks.workunit.client.1.smithi161.stdout:1/744: dread - d1/fba zero size 2024-09-18T12:52:16.493 INFO:tasks.workunit.client.1.smithi161.stdout:6/930: creat d4/d61/d69/f139 x:0 0 0 2024-09-18T12:52:16.494 INFO:tasks.workunit.client.0.smithi045.stdout:7/376: mkdir d13/d44/d4c/d82 0 2024-09-18T12:52:16.495 INFO:tasks.workunit.client.1.smithi161.stdout:9/760: write d0/d47/d48/d7f/d84/fce [209958,26500] 0 2024-09-18T12:52:16.496 INFO:tasks.workunit.client.0.smithi045.stdout:7/377: write fc [4009685,97921] 0 2024-09-18T12:52:16.497 INFO:tasks.workunit.client.1.smithi161.stdout:3/840: link d1/d2e/d24/f3a d1/d2e/d14/f123 0 2024-09-18T12:52:16.499 INFO:tasks.workunit.client.1.smithi161.stdout:2/890: dwrite d0/d1/d4c/d67/db9/dcb/f103 [0,4194304] 0 2024-09-18T12:52:16.499 INFO:tasks.workunit.client.0.smithi045.stdout:8/465: write d11/d14/d53/f4f [3847201,87503] 0 2024-09-18T12:52:16.500 INFO:tasks.workunit.client.1.smithi161.stdout:0/874: link df/d29/c47 df/de2/dc5/c135 0 2024-09-18T12:52:16.501 INFO:tasks.workunit.client.0.smithi045.stdout:1/401: unlink d0/d2d/d2b/d30/c64 0 2024-09-18T12:52:16.504 INFO:tasks.workunit.client.0.smithi045.stdout:7/378: mknod d13/d31/d5f/c83 0 2024-09-18T12:52:16.506 INFO:tasks.workunit.client.0.smithi045.stdout:7/379: write d13/d1a/d28/f3a [3917057,40872] 0 2024-09-18T12:52:16.506 INFO:tasks.workunit.client.0.smithi045.stdout:8/466: rmdir d11/d76 39 2024-09-18T12:52:16.507 INFO:tasks.workunit.client.1.smithi161.stdout:6/931: read d4/d1a/d1c/f24 [2756814,57814] 0 2024-09-18T12:52:16.508 INFO:tasks.workunit.client.1.smithi161.stdout:8/894: creat d0/d3/d10/d21/d4a/db7/f133 x:0 0 0 2024-09-18T12:52:16.509 INFO:tasks.workunit.client.1.smithi161.stdout:5/845: write d3/d3b/f98 [580191,11941] 0 2024-09-18T12:52:16.509 INFO:tasks.workunit.client.1.smithi161.stdout:2/891: write d0/d1/deb/d7e/f70 [2205795,31514] 0 2024-09-18T12:52:16.510 INFO:tasks.workunit.client.0.smithi045.stdout:1/402: unlink d0/d12/d32/d67/d6d/l76 0 2024-09-18T12:52:16.510 INFO:tasks.workunit.client.1.smithi161.stdout:1/745: creat d1/daa/ffe x:0 0 0 2024-09-18T12:52:16.511 INFO:tasks.workunit.client.0.smithi045.stdout:1/403: readlink d0/d12/l55 0 2024-09-18T12:52:16.511 INFO:tasks.workunit.client.1.smithi161.stdout:2/892: readlink d0/d5/d43/lb7 0 2024-09-18T12:52:16.511 INFO:tasks.workunit.client.1.smithi161.stdout:1/746: dread - d1/daa/fce zero size 2024-09-18T12:52:16.514 INFO:tasks.workunit.client.1.smithi161.stdout:1/747: chown d1/d26/d88/ca4 89 1 2024-09-18T12:52:16.514 INFO:tasks.workunit.client.1.smithi161.stdout:3/841: fsync d1/fd7 0 2024-09-18T12:52:16.515 INFO:tasks.workunit.client.0.smithi045.stdout:7/380: creat d13/d44/d37/d70/f84 x:0 0 0 2024-09-18T12:52:16.515 INFO:tasks.workunit.client.0.smithi045.stdout:1/404: stat d0/c11 0 2024-09-18T12:52:16.517 INFO:tasks.workunit.client.1.smithi161.stdout:3/842: chown d1/d2e/d24/f112 0 1 2024-09-18T12:52:16.517 INFO:tasks.workunit.client.0.smithi045.stdout:8/467: mkdir d11/d8c/d90 0 2024-09-18T12:52:16.520 INFO:tasks.workunit.client.1.smithi161.stdout:3/843: read d1/d2e/d68/fd6 [443185,36467] 0 2024-09-18T12:52:16.520 INFO:tasks.workunit.client.1.smithi161.stdout:5/846: dwrite d3/d8/de4/d8d/fc7 [0,4194304] 0 2024-09-18T12:52:16.520 INFO:tasks.workunit.client.0.smithi045.stdout:7/381: mkdir d13/d44/d37/d70/d77/d85 0 2024-09-18T12:52:16.522 INFO:tasks.workunit.client.0.smithi045.stdout:1/405: dwrite d0/fa [0,4194304] 0 2024-09-18T12:52:16.522 INFO:tasks.workunit.client.1.smithi161.stdout:5/847: dread - d3/d44/d6f/dca/d10d/f107 zero size 2024-09-18T12:52:16.522 INFO:tasks.workunit.client.1.smithi161.stdout:4/892: dwrite d5/d27/d44/d61/d6c/fd1 [0,4194304] 0 2024-09-18T12:52:16.525 INFO:tasks.workunit.client.1.smithi161.stdout:4/893: dread - d5/d27/d44/de2/dfe/f13e zero size 2024-09-18T12:52:16.526 INFO:tasks.workunit.client.1.smithi161.stdout:4/894: dread - d5/d27/d44/de2/dfe/f140 zero size 2024-09-18T12:52:16.527 INFO:tasks.workunit.client.0.smithi045.stdout:7/382: rename d13/d1a/d28/f46 to d13/d44/d37/f86 0 2024-09-18T12:52:16.527 INFO:tasks.workunit.client.1.smithi161.stdout:4/895: readlink d5/d32/d39/dbf/l115 0 2024-09-18T12:52:16.528 INFO:tasks.workunit.client.1.smithi161.stdout:4/896: fsync d5/d27/f46 0 2024-09-18T12:52:16.528 INFO:tasks.workunit.client.1.smithi161.stdout:4/897: chown d5/d32/d39/db6 18 1 2024-09-18T12:52:16.530 INFO:tasks.workunit.client.1.smithi161.stdout:0/875: dread df/f15 [0,4194304] 0 2024-09-18T12:52:16.533 INFO:tasks.workunit.client.0.smithi045.stdout:1/406: fsync d0/d2d/d2b/d30/d3d/f6b 0 2024-09-18T12:52:16.536 INFO:tasks.workunit.client.0.smithi045.stdout:7/383: dread d13/d31/d33/f6e [0,4194304] 0 2024-09-18T12:52:16.537 INFO:tasks.workunit.client.0.smithi045.stdout:8/468: dread d11/d14/f36 [4194304,4194304] 0 2024-09-18T12:52:16.539 INFO:tasks.workunit.client.0.smithi045.stdout:8/469: readlink d11/d20/d46/l40 0 2024-09-18T12:52:16.545 INFO:tasks.workunit.client.0.smithi045.stdout:1/407: truncate d0/f49 1341526 0 2024-09-18T12:52:16.547 INFO:tasks.workunit.client.0.smithi045.stdout:8/470: creat d11/d8c/f91 x:0 0 0 2024-09-18T12:52:16.551 INFO:tasks.workunit.client.0.smithi045.stdout:1/408: symlink d0/d2e/l79 0 2024-09-18T12:52:16.554 INFO:tasks.workunit.client.0.smithi045.stdout:3/420: sync 2024-09-18T12:52:16.554 INFO:tasks.workunit.client.0.smithi045.stdout:9/375: sync 2024-09-18T12:52:16.554 INFO:tasks.workunit.client.0.smithi045.stdout:7/384: link d13/d44/d37/f4d d13/d44/f87 0 2024-09-18T12:52:16.557 INFO:tasks.workunit.client.0.smithi045.stdout:9/376: chown d0/d3/d6/d10/d26/d2e/l58 6 1 2024-09-18T12:52:16.559 INFO:tasks.workunit.client.0.smithi045.stdout:8/471: dread d11/d23/f2b [0,4194304] 0 2024-09-18T12:52:16.564 INFO:tasks.workunit.client.0.smithi045.stdout:3/421: rename d0/d29/c32 to d0/d1e/d2c/d3f/d44/d75/c8b 0 2024-09-18T12:52:16.566 INFO:tasks.workunit.client.0.smithi045.stdout:1/409: dread d0/f23 [0,4194304] 0 2024-09-18T12:52:16.566 INFO:tasks.workunit.client.0.smithi045.stdout:3/422: read d0/f1a [1154753,45575] 0 2024-09-18T12:52:16.567 INFO:tasks.workunit.client.0.smithi045.stdout:9/377: read d0/d3/d6/d10/d2c/f30 [812363,51628] 0 2024-09-18T12:52:16.568 INFO:tasks.workunit.client.0.smithi045.stdout:8/472: readlink d11/d14/d53/d41/l61 0 2024-09-18T12:52:16.569 INFO:tasks.workunit.client.0.smithi045.stdout:9/378: chown d0/d3/d6/d10/l43 243838 1 2024-09-18T12:52:16.573 INFO:tasks.workunit.client.0.smithi045.stdout:1/410: dwrite d0/f3a [4194304,4194304] 0 2024-09-18T12:52:16.575 INFO:tasks.workunit.client.0.smithi045.stdout:8/473: dread d11/d14/f19 [0,4194304] 0 2024-09-18T12:52:16.578 INFO:tasks.workunit.client.0.smithi045.stdout:3/423: unlink d0/d29/d5f/f6b 0 2024-09-18T12:52:16.580 INFO:tasks.workunit.client.0.smithi045.stdout:8/474: dread d11/d20/f27 [0,4194304] 0 2024-09-18T12:52:16.585 INFO:tasks.workunit.client.0.smithi045.stdout:9/379: creat d0/d3/d6/d10/d26/d2e/f7b x:0 0 0 2024-09-18T12:52:16.593 INFO:tasks.workunit.client.0.smithi045.stdout:3/424: mknod d0/d1e/d2c/d3a/c8c 0 2024-09-18T12:52:16.597 INFO:tasks.workunit.client.0.smithi045.stdout:8/475: mknod d11/d20/d59/c92 0 2024-09-18T12:52:16.598 INFO:tasks.workunit.client.0.smithi045.stdout:7/385: link d13/d44/d37/d70/d77/c47 d13/d31/d63/c88 0 2024-09-18T12:52:16.604 INFO:tasks.workunit.client.0.smithi045.stdout:9/380: truncate d0/d3/d6/d10/f29 965698 0 2024-09-18T12:52:16.604 INFO:tasks.workunit.client.0.smithi045.stdout:7/386: dwrite fc [8388608,4194304] 0 2024-09-18T12:52:16.606 INFO:tasks.workunit.client.0.smithi045.stdout:7/387: write d13/d44/f2b [3450834,3562] 0 2024-09-18T12:52:16.612 INFO:tasks.workunit.client.0.smithi045.stdout:7/388: dwrite d13/d31/d63/f7f [0,4194304] 0 2024-09-18T12:52:16.623 INFO:tasks.workunit.client.0.smithi045.stdout:1/411: truncate d0/d2d/d2b/f2f 1938704 0 2024-09-18T12:52:16.624 INFO:tasks.workunit.client.1.smithi161.stdout:6/932: truncate d4/d61/d9d/da3/fdd 630668 0 2024-09-18T12:52:16.626 INFO:tasks.workunit.client.1.smithi161.stdout:1/748: write d1/f28 [3257529,72870] 0 2024-09-18T12:52:16.629 INFO:tasks.workunit.client.0.smithi045.stdout:3/425: mknod d0/d29/d5f/d73/c8d 0 2024-09-18T12:52:16.630 INFO:tasks.workunit.client.0.smithi045.stdout:8/476: symlink d11/d14/d72/l93 0 2024-09-18T12:52:16.632 INFO:tasks.workunit.client.0.smithi045.stdout:0/466: sync 2024-09-18T12:52:16.632 INFO:tasks.workunit.client.0.smithi045.stdout:4/594: sync 2024-09-18T12:52:16.632 INFO:tasks.workunit.client.0.smithi045.stdout:6/401: sync 2024-09-18T12:52:16.632 INFO:tasks.workunit.client.0.smithi045.stdout:8/477: write d11/d14/d53/f6d [940938,88668] 0 2024-09-18T12:52:16.633 INFO:tasks.workunit.client.1.smithi161.stdout:4/898: rename d5/d14/c1c to d5/d14/d67/dc7/d60/d95/c146 0 2024-09-18T12:52:16.635 INFO:tasks.workunit.client.0.smithi045.stdout:8/478: read d11/f13 [3355950,71840] 0 2024-09-18T12:52:16.640 INFO:tasks.workunit.client.1.smithi161.stdout:8/895: dread d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f73 [4194304,4194304] 0 2024-09-18T12:52:16.644 INFO:tasks.workunit.client.0.smithi045.stdout:3/426: creat d0/d22/f8e x:0 0 0 2024-09-18T12:52:16.646 INFO:tasks.workunit.client.1.smithi161.stdout:5/848: creat d3/d44/d6f/d86/d10a/f116 x:0 0 0 2024-09-18T12:52:16.647 INFO:tasks.workunit.client.1.smithi161.stdout:1/749: rename d1/ddd/fe1 to d1/da/d1f/dab/daf/de3/fff 0 2024-09-18T12:52:16.650 INFO:tasks.workunit.client.0.smithi045.stdout:6/402: chown d9/d30/d6c/l87 2 1 2024-09-18T12:52:16.650 INFO:tasks.workunit.client.0.smithi045.stdout:6/403: dread - d9/d1a/d2d/d38/f82 zero size 2024-09-18T12:52:16.651 INFO:tasks.workunit.client.0.smithi045.stdout:0/467: mknod d6/d48/d5e/d39/d58/d3c/d69/c85 0 2024-09-18T12:52:16.653 INFO:tasks.workunit.client.0.smithi045.stdout:9/381: symlink d0/d3/d6/d64/d77/l7c 0 2024-09-18T12:52:16.654 INFO:tasks.workunit.client.1.smithi161.stdout:9/761: link d0/d16/l44 d0/d16/lfa 0 2024-09-18T12:52:16.654 INFO:tasks.workunit.client.0.smithi045.stdout:9/382: dread - d0/d3/d6/d10/d26/d2e/d4e/f67 zero size 2024-09-18T12:52:16.655 INFO:tasks.workunit.client.1.smithi161.stdout:2/893: write d0/f13 [4669594,36651] 0 2024-09-18T12:52:16.655 INFO:tasks.workunit.client.0.smithi045.stdout:9/383: chown d0/d3/d6/d10/d26/d2e/d6f/l73 31734 1 2024-09-18T12:52:16.659 INFO:tasks.workunit.client.0.smithi045.stdout:3/427: rmdir d0/d29/d5f 39 2024-09-18T12:52:16.660 INFO:tasks.workunit.client.0.smithi045.stdout:3/428: chown d0/d1e/d2c/d3a 92314 1 2024-09-18T12:52:16.660 INFO:tasks.workunit.client.0.smithi045.stdout:3/429: dread - d0/d22/f8e zero size 2024-09-18T12:52:16.663 INFO:tasks.workunit.client.1.smithi161.stdout:3/844: write d1/d2e/d68/d69/f99 [15260,49526] 0 2024-09-18T12:52:16.664 INFO:tasks.workunit.client.0.smithi045.stdout:0/468: mkdir d6/d48/d5e/d39/d58/d86 0 2024-09-18T12:52:16.669 INFO:tasks.workunit.client.1.smithi161.stdout:0/876: write fd [2953177,64735] 0 2024-09-18T12:52:16.671 INFO:tasks.workunit.client.0.smithi045.stdout:3/430: truncate d0/d7/f10 4920691 0 2024-09-18T12:52:16.672 INFO:tasks.workunit.client.1.smithi161.stdout:5/849: symlink d3/l117 0 2024-09-18T12:52:16.673 INFO:tasks.workunit.client.1.smithi161.stdout:7/781: sync 2024-09-18T12:52:16.673 INFO:tasks.workunit.client.0.smithi045.stdout:4/595: creat db/fbf x:0 0 0 2024-09-18T12:52:16.673 INFO:tasks.workunit.client.1.smithi161.stdout:5/850: write d3/d3b/d7b/da6/fa8 [1452890,11706] 0 2024-09-18T12:52:16.674 INFO:tasks.workunit.client.1.smithi161.stdout:5/851: chown d3/d3b/d54/c7a 13 1 2024-09-18T12:52:16.675 INFO:tasks.workunit.client.0.smithi045.stdout:4/596: write db/f30 [1595320,22070] 0 2024-09-18T12:52:16.675 INFO:tasks.workunit.client.0.smithi045.stdout:7/389: dwrite d13/d31/f53 [0,4194304] 0 2024-09-18T12:52:16.677 INFO:tasks.workunit.client.1.smithi161.stdout:3/845: dread d1/d2e/d24/d1d/f5d [0,4194304] 0 2024-09-18T12:52:16.677 INFO:tasks.workunit.client.0.smithi045.stdout:4/597: rename db/d2c to db/d2c/d35/dc0 22 2024-09-18T12:52:16.677 INFO:tasks.workunit.client.1.smithi161.stdout:3/846: chown d1/d2e/d14/f30 58502321 1 2024-09-18T12:52:16.678 INFO:tasks.workunit.client.1.smithi161.stdout:3/847: chown d1/d2e/d24/f112 5061990 1 2024-09-18T12:52:16.679 INFO:tasks.workunit.client.1.smithi161.stdout:4/899: creat d5/d14/d67/dc7/d4c/f147 x:0 0 0 2024-09-18T12:52:16.680 INFO:tasks.workunit.client.1.smithi161.stdout:9/762: symlink d0/d16/d25/d28/lfb 0 2024-09-18T12:52:16.682 INFO:tasks.workunit.client.0.smithi045.stdout:1/412: dwrite d0/d12/f3b [0,4194304] 0 2024-09-18T12:52:16.684 INFO:tasks.workunit.client.1.smithi161.stdout:6/933: write d4/d61/f10e [3577633,53784] 0 2024-09-18T12:52:16.688 INFO:tasks.workunit.client.0.smithi045.stdout:0/469: symlink d6/l87 0 2024-09-18T12:52:16.689 INFO:tasks.workunit.client.1.smithi161.stdout:7/782: fsync d3/f8d 0 2024-09-18T12:52:16.690 INFO:tasks.workunit.client.0.smithi045.stdout:7/390: write d13/d31/d33/f4e [873359,86880] 0 2024-09-18T12:52:16.693 INFO:tasks.workunit.client.0.smithi045.stdout:6/404: link d9/d30/c7c d9/d1a/d2d/d38/c92 0 2024-09-18T12:52:16.694 INFO:tasks.workunit.client.0.smithi045.stdout:6/405: write d9/d1a/d2d/d38/d5b/f61 [650312,67602] 0 2024-09-18T12:52:16.696 INFO:tasks.workunit.client.0.smithi045.stdout:6/406: chown d9/d1a/d48 18 1 2024-09-18T12:52:16.696 INFO:tasks.workunit.client.1.smithi161.stdout:4/900: rmdir d5/d14/d5f/da1/de9 39 2024-09-18T12:52:16.696 INFO:tasks.workunit.client.0.smithi045.stdout:3/431: dread d0/d7/f80 [0,4194304] 0 2024-09-18T12:52:16.702 INFO:tasks.workunit.client.0.smithi045.stdout:0/470: mknod d6/d7/d32/c88 0 2024-09-18T12:52:16.703 INFO:tasks.workunit.client.0.smithi045.stdout:0/471: write d6/d48/d5e/d39/d58/d3c/d73/f7f [1410139,28040] 0 2024-09-18T12:52:16.706 INFO:tasks.workunit.client.0.smithi045.stdout:0/472: truncate d6/d48/d5e/d39/d58/d3c/d69/f4c 916140 0 2024-09-18T12:52:16.707 INFO:tasks.workunit.client.0.smithi045.stdout:8/479: getdents d11/d14/d53/d41/d75 0 2024-09-18T12:52:16.708 INFO:tasks.workunit.client.0.smithi045.stdout:8/480: dread - d11/d14/d72/f8d zero size 2024-09-18T12:52:16.709 INFO:tasks.workunit.client.0.smithi045.stdout:8/481: dread - d11/f5f zero size 2024-09-18T12:52:16.710 INFO:tasks.workunit.client.0.smithi045.stdout:4/598: creat db/de/d1e/d3e/d9a/da2/fc1 x:0 0 0 2024-09-18T12:52:16.711 INFO:tasks.workunit.client.0.smithi045.stdout:8/482: read d11/d14/f36 [478241,67866] 0 2024-09-18T12:52:16.712 INFO:tasks.workunit.client.0.smithi045.stdout:9/384: getdents d0/d3/d6/d10 0 2024-09-18T12:52:16.713 INFO:tasks.workunit.client.0.smithi045.stdout:3/432: symlink d0/d1e/d2c/d3f/d44/d75/l8f 0 2024-09-18T12:52:16.714 INFO:tasks.workunit.client.0.smithi045.stdout:9/385: stat d0/d3/l1c 0 2024-09-18T12:52:16.716 INFO:tasks.workunit.client.0.smithi045.stdout:3/433: write d0/d22/f26 [1946702,105261] 0 2024-09-18T12:52:16.718 INFO:tasks.workunit.client.0.smithi045.stdout:8/483: read - d11/d20/f3c zero size 2024-09-18T12:52:16.720 INFO:tasks.workunit.client.0.smithi045.stdout:3/434: chown d0/d7/f23 13596 1 2024-09-18T12:52:16.721 INFO:tasks.workunit.client.0.smithi045.stdout:9/386: read d0/d3/d6/d10/f1b [3583727,36248] 0 2024-09-18T12:52:16.721 INFO:tasks.workunit.client.0.smithi045.stdout:8/484: fdatasync d11/d8c/f91 0 2024-09-18T12:52:16.721 INFO:tasks.workunit.client.0.smithi045.stdout:6/407: creat d9/d1a/d2d/f93 x:0 0 0 2024-09-18T12:52:16.722 INFO:tasks.workunit.client.0.smithi045.stdout:1/413: dwrite d0/d12/f62 [0,4194304] 0 2024-09-18T12:52:16.722 INFO:tasks.workunit.client.0.smithi045.stdout:2/486: sync 2024-09-18T12:52:16.723 INFO:tasks.workunit.client.0.smithi045.stdout:5/568: sync 2024-09-18T12:52:16.724 INFO:tasks.workunit.client.0.smithi045.stdout:7/391: getdents d13/d31/d33/d64/d78 0 2024-09-18T12:52:16.725 INFO:tasks.workunit.client.0.smithi045.stdout:9/387: truncate d0/f50 5070560 0 2024-09-18T12:52:16.726 INFO:tasks.workunit.client.0.smithi045.stdout:4/599: dwrite db/de/d1e/fb2 [0,4194304] 0 2024-09-18T12:52:16.726 INFO:tasks.workunit.client.0.smithi045.stdout:1/414: mknod d0/d2e/c7a 0 2024-09-18T12:52:16.727 INFO:tasks.workunit.client.0.smithi045.stdout:5/569: read d6/db/f50 [624543,742] 0 2024-09-18T12:52:16.728 INFO:tasks.workunit.client.0.smithi045.stdout:2/487: mkdir d5/d2c/dac 0 2024-09-18T12:52:16.730 INFO:tasks.workunit.client.0.smithi045.stdout:0/473: truncate d6/d7/ff 2106656 0 2024-09-18T12:52:16.733 INFO:tasks.workunit.client.0.smithi045.stdout:9/388: write d0/d3/d6/d10/d26/f62 [381561,40456] 0 2024-09-18T12:52:16.733 INFO:tasks.workunit.client.0.smithi045.stdout:4/600: symlink db/d2c/d35/lc2 0 2024-09-18T12:52:16.734 INFO:tasks.workunit.client.0.smithi045.stdout:9/389: chown d0/d3/d6/l14 164 1 2024-09-18T12:52:16.736 INFO:tasks.workunit.client.0.smithi045.stdout:3/435: symlink d0/d29/d5f/l90 0 2024-09-18T12:52:16.738 INFO:tasks.workunit.client.0.smithi045.stdout:4/601: dread - db/de/d1e/d3e/d9a/da2/fc1 zero size 2024-09-18T12:52:16.738 INFO:tasks.workunit.client.0.smithi045.stdout:5/570: dwrite d6/db/d5a/d78/d66/f74 [0,4194304] 0 2024-09-18T12:52:16.739 INFO:tasks.workunit.client.0.smithi045.stdout:4/602: stat db/la4 0 2024-09-18T12:52:16.739 INFO:tasks.workunit.client.0.smithi045.stdout:8/485: link d11/d20/d59/f8e d11/d8c/f94 0 2024-09-18T12:52:16.742 INFO:tasks.workunit.client.0.smithi045.stdout:5/571: write d6/d28/d2b/f93 [326674,110374] 0 2024-09-18T12:52:16.743 INFO:tasks.workunit.client.0.smithi045.stdout:8/486: write d11/f12 [564882,15033] 0 2024-09-18T12:52:16.747 INFO:tasks.workunit.client.0.smithi045.stdout:1/415: mknod d0/c7b 0 2024-09-18T12:52:16.747 INFO:tasks.workunit.client.0.smithi045.stdout:7/392: write d13/d44/f1f [1953004,45627] 0 2024-09-18T12:52:16.750 INFO:tasks.workunit.client.0.smithi045.stdout:4/603: creat db/de/d1e/d3e/d9a/d73/fc3 x:0 0 0 2024-09-18T12:52:16.751 INFO:tasks.workunit.client.0.smithi045.stdout:4/604: truncate db/de/f9b 1198583 0 2024-09-18T12:52:16.752 INFO:tasks.workunit.client.0.smithi045.stdout:9/390: rename d0/d3/d6/d10/d26/d2e/f7b to d0/d3/d6/d10/f7d 0 2024-09-18T12:52:16.754 INFO:tasks.workunit.client.0.smithi045.stdout:7/393: creat d13/d1a/d28/f89 x:0 0 0 2024-09-18T12:52:16.757 INFO:tasks.workunit.client.0.smithi045.stdout:4/605: symlink db/de/d1e/d3e/d9a/da2/lc4 0 2024-09-18T12:52:16.757 INFO:tasks.workunit.client.0.smithi045.stdout:0/474: write d6/f2d [2117704,23567] 0 2024-09-18T12:52:16.759 INFO:tasks.workunit.client.0.smithi045.stdout:7/394: dread d13/d44/d37/d70/d77/f3c [0,4194304] 0 2024-09-18T12:52:16.759 INFO:tasks.workunit.client.0.smithi045.stdout:9/391: truncate d0/d3/d6/d10/d2c/f30 4464539 0 2024-09-18T12:52:16.761 INFO:tasks.workunit.client.1.smithi161.stdout:9/763: mkdir d0/d93/dfc 0 2024-09-18T12:52:16.761 INFO:tasks.workunit.client.1.smithi161.stdout:8/896: getdents d0/d3/d10/d21/d4a/d52/d82/de6/df7 0 2024-09-18T12:52:16.762 INFO:tasks.workunit.client.1.smithi161.stdout:2/894: dwrite d0/d71/fd5 [0,4194304] 0 2024-09-18T12:52:16.763 INFO:tasks.workunit.client.1.smithi161.stdout:0/877: mknod df/d30/d71/d96/dd3/d90/d69/c136 0 2024-09-18T12:52:16.763 INFO:tasks.workunit.client.1.smithi161.stdout:9/764: readlink d0/d47/df1/lee 0 2024-09-18T12:52:16.764 INFO:tasks.workunit.client.0.smithi045.stdout:4/606: rename db/de/fb1 to db/de/fc5 0 2024-09-18T12:52:16.764 INFO:tasks.workunit.client.1.smithi161.stdout:1/750: getdents d1/da/d9d 0 2024-09-18T12:52:16.764 INFO:tasks.workunit.client.1.smithi161.stdout:2/895: readlink d0/d1/deb/d7e/l77 0 2024-09-18T12:52:16.766 INFO:tasks.workunit.client.0.smithi045.stdout:1/416: link d0/d12/d32/d37/f43 d0/d2d/d2b/d30/d3d/f7c 0 2024-09-18T12:52:16.768 INFO:tasks.workunit.client.0.smithi045.stdout:5/572: getdents d6/db/d54 0 2024-09-18T12:52:16.768 INFO:tasks.workunit.client.0.smithi045.stdout:8/487: truncate d11/d14/d53/d41/f74 372688 0 2024-09-18T12:52:16.771 INFO:tasks.workunit.client.1.smithi161.stdout:2/896: fsync d0/d1/d4c/d67/db9/dcb/f34 0 2024-09-18T12:52:16.772 INFO:tasks.workunit.client.1.smithi161.stdout:5/852: dwrite d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/da4/fce [0,4194304] 0 2024-09-18T12:52:16.773 INFO:tasks.workunit.client.1.smithi161.stdout:9/765: creat d0/d20/d49/ffd x:0 0 0 2024-09-18T12:52:16.773 INFO:tasks.workunit.client.0.smithi045.stdout:4/607: write db/de/fc5 [367132,47819] 0 2024-09-18T12:52:16.777 INFO:tasks.workunit.client.0.smithi045.stdout:0/475: rename d6/l31 to d6/d48/d5e/d39/l89 0 2024-09-18T12:52:16.778 INFO:tasks.workunit.client.1.smithi161.stdout:6/934: creat d4/d39/d26/f13a x:0 0 0 2024-09-18T12:52:16.778 INFO:tasks.workunit.client.1.smithi161.stdout:6/935: stat d4/f10 0 2024-09-18T12:52:16.779 INFO:tasks.workunit.client.0.smithi045.stdout:1/417: fsync d0/fc 0 2024-09-18T12:52:16.781 INFO:tasks.workunit.client.1.smithi161.stdout:1/751: unlink d1/da/d1f/d45/d73/la1 0 2024-09-18T12:52:16.782 INFO:tasks.workunit.client.0.smithi045.stdout:5/573: mkdir d6/db/d54/dc2 0 2024-09-18T12:52:16.783 INFO:tasks.workunit.client.0.smithi045.stdout:5/574: dread - d6/d3e/fb8 zero size 2024-09-18T12:52:16.786 INFO:tasks.workunit.client.0.smithi045.stdout:7/395: rename d13/f16 to d13/f8a 0 2024-09-18T12:52:16.787 INFO:tasks.workunit.client.1.smithi161.stdout:1/752: dwrite d1/f15 [0,4194304] 0 2024-09-18T12:52:16.788 INFO:tasks.workunit.client.0.smithi045.stdout:7/396: chown d13/d31/c30 64811 1 2024-09-18T12:52:16.789 INFO:tasks.workunit.client.0.smithi045.stdout:4/608: symlink db/de/d1e/d3e/d47/d59/d7a/lc6 0 2024-09-18T12:52:16.793 INFO:tasks.workunit.client.0.smithi045.stdout:4/609: write db/de/d1e/d3e/f8c [388522,128110] 0 2024-09-18T12:52:16.793 INFO:tasks.workunit.client.0.smithi045.stdout:5/575: dwrite d6/db/fbb [0,4194304] 0 2024-09-18T12:52:16.797 INFO:tasks.workunit.client.0.smithi045.stdout:9/392: rename d0/d3/d6/d10/d26/f4a to d0/d3/d6/d10/d2c/d63/f7e 0 2024-09-18T12:52:16.797 INFO:tasks.workunit.client.0.smithi045.stdout:0/476: creat d6/d35/f8a x:0 0 0 2024-09-18T12:52:16.799 INFO:tasks.workunit.client.0.smithi045.stdout:4/610: chown db/de/d1e/d3e/d9a/d73/fc3 1595879 1 2024-09-18T12:52:16.800 INFO:tasks.workunit.client.1.smithi161.stdout:8/897: dwrite d0/d3/d10/d21/d4a/d52/d82/d96/d98/fd5 [0,4194304] 0 2024-09-18T12:52:16.802 INFO:tasks.workunit.client.0.smithi045.stdout:5/576: dread d6/db/fbb [0,4194304] 0 2024-09-18T12:52:16.802 INFO:tasks.workunit.client.1.smithi161.stdout:0/878: dread df/d30/d71/f87 [0,4194304] 0 2024-09-18T12:52:16.802 INFO:tasks.workunit.client.1.smithi161.stdout:5/853: dread - d3/d44/d6f/dca/d10d/d4b/f5f zero size 2024-09-18T12:52:16.803 INFO:tasks.workunit.client.0.smithi045.stdout:4/611: read db/de/d1e/fb2 [2131685,105779] 0 2024-09-18T12:52:16.807 INFO:tasks.workunit.client.1.smithi161.stdout:5/854: write d3/d8/de4/d8d/db0/fe9 [695775,69999] 0 2024-09-18T12:52:16.808 INFO:tasks.workunit.client.0.smithi045.stdout:9/393: dwrite d0/d3/d6/d10/d2c/f57 [0,4194304] 0 2024-09-18T12:52:16.809 INFO:tasks.workunit.client.1.smithi161.stdout:0/879: truncate df/d30/d71/d96/dd3/d51/dc9/f119 324900 0 2024-09-18T12:52:16.810 INFO:tasks.workunit.client.0.smithi045.stdout:0/477: fdatasync d6/d7/f79 0 2024-09-18T12:52:16.810 INFO:tasks.workunit.client.1.smithi161.stdout:9/766: mknod d0/d20/d74/ded/cfe 0 2024-09-18T12:52:16.811 INFO:tasks.workunit.client.0.smithi045.stdout:9/394: chown d0/d3/d6/d10/d26/d2e/f5e 259835753 1 2024-09-18T12:52:16.812 INFO:tasks.workunit.client.0.smithi045.stdout:0/478: chown d6/d48/d5e/d39/d58/d3c/d69 6 1 2024-09-18T12:52:16.813 INFO:tasks.workunit.client.0.smithi045.stdout:8/488: dread d11/f13 [0,4194304] 0 2024-09-18T12:52:16.814 INFO:tasks.workunit.client.0.smithi045.stdout:8/489: fsync d11/f12 0 2024-09-18T12:52:16.814 INFO:tasks.workunit.client.1.smithi161.stdout:1/753: dread d1/da/d1f/d45/d73/fc7 [0,4194304] 0 2024-09-18T12:52:16.816 INFO:tasks.workunit.client.1.smithi161.stdout:5/855: dread d3/d44/d6f/dca/d10d/d4b/d8e/d24/f36 [0,4194304] 0 2024-09-18T12:52:16.816 INFO:tasks.workunit.client.1.smithi161.stdout:4/901: getdents d5/d14/d67/dc7/d47/d49/dca/d100 0 2024-09-18T12:52:16.818 INFO:tasks.workunit.client.0.smithi045.stdout:5/577: rmdir d6/d28/d2b/d51 39 2024-09-18T12:52:16.818 INFO:tasks.workunit.client.1.smithi161.stdout:5/856: chown d3/d8/df8/ffb 10 1 2024-09-18T12:52:16.820 INFO:tasks.workunit.client.1.smithi161.stdout:1/754: read d1/da/f16 [3449873,105412] 0 2024-09-18T12:52:16.821 INFO:tasks.workunit.client.0.smithi045.stdout:8/490: dread d11/d20/d59/f8e [0,4194304] 0 2024-09-18T12:52:16.822 INFO:tasks.workunit.client.0.smithi045.stdout:4/612: mknod db/de/d1e/d3e/d47/d59/d2f/cc7 0 2024-09-18T12:52:16.825 INFO:tasks.workunit.client.1.smithi161.stdout:4/902: dwrite d5/d32/d39/d4d/f96 [4194304,4194304] 0 2024-09-18T12:52:16.827 INFO:tasks.workunit.client.1.smithi161.stdout:9/767: rmdir d0/d47/d48/d7f/d9e 39 2024-09-18T12:52:16.828 INFO:tasks.workunit.client.1.smithi161.stdout:8/898: mkdir d0/d3/d10/d21/d4a/d52/d82/d96/d134 0 2024-09-18T12:52:16.834 INFO:tasks.workunit.client.1.smithi161.stdout:4/903: creat d5/d27/d44/d61/d6c/d8f/f148 x:0 0 0 2024-09-18T12:52:16.836 INFO:tasks.workunit.client.0.smithi045.stdout:8/491: fdatasync d11/d14/f19 0 2024-09-18T12:52:16.837 INFO:tasks.workunit.client.0.smithi045.stdout:4/613: creat db/d2c/fc8 x:0 0 0 2024-09-18T12:52:16.838 INFO:tasks.workunit.client.1.smithi161.stdout:8/899: symlink d0/d3/d10/d21/d4a/d52/d82/d96/dba/d10d/l135 0 2024-09-18T12:52:16.839 INFO:tasks.workunit.client.0.smithi045.stdout:9/395: fsync d0/d3/d6/d10/f29 0 2024-09-18T12:52:16.839 INFO:tasks.workunit.client.0.smithi045.stdout:4/614: write db/d2c/d35/d40/faf [562306,130354] 0 2024-09-18T12:52:16.841 INFO:tasks.workunit.client.0.smithi045.stdout:7/397: getdents d13/d31/d52 0 2024-09-18T12:52:16.842 INFO:tasks.workunit.client.0.smithi045.stdout:5/578: link d6/d3e/f3f d6/db/d19/d92/d61/fc3 0 2024-09-18T12:52:16.844 INFO:tasks.workunit.client.1.smithi161.stdout:6/936: dread d4/d39/d26/fb2 [0,4194304] 0 2024-09-18T12:52:16.845 INFO:tasks.workunit.client.0.smithi045.stdout:8/492: rename d11/d7b/c8a to d11/d14/d53/c95 0 2024-09-18T12:52:16.846 INFO:tasks.workunit.client.0.smithi045.stdout:8/493: chown d11/d20/d60 446983699 1 2024-09-18T12:52:16.847 INFO:tasks.workunit.client.0.smithi045.stdout:8/494: readlink d11/d14/d53/d41/l6e 0 2024-09-18T12:52:16.847 INFO:tasks.workunit.client.0.smithi045.stdout:0/479: link d6/d7/l2f d6/d48/d5e/d39/d58/d3b/d65/l8b 0 2024-09-18T12:52:16.848 INFO:tasks.workunit.client.1.smithi161.stdout:4/904: dread d5/d14/d67/dc7/f7a [0,4194304] 0 2024-09-18T12:52:16.849 INFO:tasks.workunit.client.1.smithi161.stdout:9/768: getdents d0/d47/d48 0 2024-09-18T12:52:16.849 INFO:tasks.workunit.client.0.smithi045.stdout:5/579: truncate d6/db/d5a/d78/d66/f69 662774 0 2024-09-18T12:52:16.850 INFO:tasks.workunit.client.1.smithi161.stdout:9/769: dread d0/d16/d25/d28/fbe [0,4194304] 0 2024-09-18T12:52:16.851 INFO:tasks.workunit.client.0.smithi045.stdout:4/615: rename db/d20/c27 to db/d2c/d35/d40/d6d/cc9 0 2024-09-18T12:52:16.852 INFO:tasks.workunit.client.1.smithi161.stdout:4/905: mknod d5/d14/d67/dc7/d9b/c149 0 2024-09-18T12:52:16.855 INFO:tasks.workunit.client.0.smithi045.stdout:9/396: link d0/d3/d6/f2d d0/f7f 0 2024-09-18T12:52:16.855 INFO:tasks.workunit.client.0.smithi045.stdout:9/397: readlink d0/l18 0 2024-09-18T12:52:16.857 INFO:tasks.workunit.client.0.smithi045.stdout:7/398: rename d13/f32 to d13/d31/d33/d64/d78/f8b 0 2024-09-18T12:52:16.858 INFO:tasks.workunit.client.1.smithi161.stdout:6/937: getdents d4/d39/d26/d31 0 2024-09-18T12:52:16.859 INFO:tasks.workunit.client.0.smithi045.stdout:4/616: mkdir db/de/d1e/d3e/d47/d59/d2f/dca 0 2024-09-18T12:52:16.862 INFO:tasks.workunit.client.0.smithi045.stdout:8/495: link d11/f17 d11/d20/d46/d79/f96 0 2024-09-18T12:52:16.862 INFO:tasks.workunit.client.0.smithi045.stdout:7/399: dread d13/d1a/f59 [0,4194304] 0 2024-09-18T12:52:16.863 INFO:tasks.workunit.client.0.smithi045.stdout:7/400: dread d13/d1a/f49 [0,4194304] 0 2024-09-18T12:52:16.866 INFO:tasks.workunit.client.1.smithi161.stdout:6/938: creat d4/d1a/d1c/d7c/f13b x:0 0 0 2024-09-18T12:52:16.867 INFO:tasks.workunit.client.1.smithi161.stdout:4/906: creat d5/d27/f14a x:0 0 0 2024-09-18T12:52:16.869 INFO:tasks.workunit.client.1.smithi161.stdout:2/897: dwrite d0/f24 [0,4194304] 0 2024-09-18T12:52:16.871 INFO:tasks.workunit.client.0.smithi045.stdout:8/496: dread d11/d76/f88 [0,4194304] 0 2024-09-18T12:52:16.872 INFO:tasks.workunit.client.0.smithi045.stdout:8/497: readlink d11/d23/l8b 0 2024-09-18T12:52:16.872 INFO:tasks.workunit.client.0.smithi045.stdout:8/498: dread - d11/d20/f5d zero size 2024-09-18T12:52:16.875 INFO:tasks.workunit.client.1.smithi161.stdout:2/898: mkdir d0/d71/da9/dd6/d12d 0 2024-09-18T12:52:16.875 INFO:tasks.workunit.client.1.smithi161.stdout:8/900: fdatasync d0/d3/d10/d21/d4a/d52/d82/d96/d98/fd5 0 2024-09-18T12:52:16.875 INFO:tasks.workunit.client.1.smithi161.stdout:5/857: write d3/d44/d6f/dca/d10d/f41 [384727,66989] 0 2024-09-18T12:52:16.876 INFO:tasks.workunit.client.1.smithi161.stdout:4/907: mkdir d5/d14/d67/dc7/d47/dbc/d139/d14b 0 2024-09-18T12:52:16.877 INFO:tasks.workunit.client.1.smithi161.stdout:1/755: write d1/da/d1f/d45/f6d [314335,91009] 0 2024-09-18T12:52:16.878 INFO:tasks.workunit.client.1.smithi161.stdout:3/848: sync 2024-09-18T12:52:16.878 INFO:tasks.workunit.client.1.smithi161.stdout:7/783: sync 2024-09-18T12:52:16.879 INFO:tasks.workunit.client.0.smithi045.stdout:0/480: dread d6/d7/ff [0,4194304] 0 2024-09-18T12:52:16.881 INFO:tasks.workunit.client.0.smithi045.stdout:8/499: mknod d11/d20/d60/c97 0 2024-09-18T12:52:16.885 INFO:tasks.workunit.client.1.smithi161.stdout:3/849: read d1/d2e/d14/d65/d76/d88/fef [21566,22512] 0 2024-09-18T12:52:16.888 INFO:tasks.workunit.client.0.smithi045.stdout:0/481: dwrite d6/d48/d5e/f75 [0,4194304] 0 2024-09-18T12:52:16.888 INFO:tasks.workunit.client.1.smithi161.stdout:6/939: dread d4/f19 [0,4194304] 0 2024-09-18T12:52:16.889 INFO:tasks.workunit.client.1.smithi161.stdout:2/899: dread d0/d5/d43/d35/d98/ddf/d8b/f97 [0,4194304] 0 2024-09-18T12:52:16.891 INFO:tasks.workunit.client.0.smithi045.stdout:5/580: dread d6/db/d19/d92/f76 [0,4194304] 0 2024-09-18T12:52:16.891 INFO:tasks.workunit.client.1.smithi161.stdout:0/880: dwrite df/d30/d71/d96/dd3/f102 [0,4194304] 0 2024-09-18T12:52:16.894 INFO:tasks.workunit.client.1.smithi161.stdout:5/858: dread d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/f49 [0,4194304] 0 2024-09-18T12:52:16.895 INFO:tasks.workunit.client.1.smithi161.stdout:8/901: mkdir d0/d3/d10/d21/d4a/d52/d82/d96/dba/d10d/d136 0 2024-09-18T12:52:16.895 INFO:tasks.workunit.client.1.smithi161.stdout:5/859: readlink d3/d8/lb3 0 2024-09-18T12:52:16.897 INFO:tasks.workunit.client.1.smithi161.stdout:8/902: fsync d0/d3/d10/f42 0 2024-09-18T12:52:16.901 INFO:tasks.workunit.client.0.smithi045.stdout:0/482: dwrite d6/d48/d5e/d39/d58/d3c/d69/f4b [0,4194304] 0 2024-09-18T12:52:16.901 INFO:tasks.workunit.client.0.smithi045.stdout:9/398: dread d0/f3e [0,4194304] 0 2024-09-18T12:52:16.901 INFO:tasks.workunit.client.1.smithi161.stdout:5/860: stat d3/d8/de4/f97 0 2024-09-18T12:52:16.901 INFO:tasks.workunit.client.1.smithi161.stdout:5/861: readlink d3/d44/d6f/dca/d10d/d4b/d8e/d24/ldf 0 2024-09-18T12:52:16.901 INFO:tasks.workunit.client.0.smithi045.stdout:5/581: symlink d6/db/d6a/lc4 0 2024-09-18T12:52:16.908 INFO:tasks.workunit.client.0.smithi045.stdout:9/399: rmdir d0/d3/d6/d10/d26/d2e/d4e 39 2024-09-18T12:52:16.910 INFO:tasks.workunit.client.1.smithi161.stdout:3/850: mknod d1/d2e/d14/d65/d76/d8c/d9d/c124 0 2024-09-18T12:52:16.911 INFO:tasks.workunit.client.0.smithi045.stdout:5/582: dwrite d6/db/d19/d92/d61/fad [0,4194304] 0 2024-09-18T12:52:16.915 INFO:tasks.workunit.client.0.smithi045.stdout:9/400: truncate d0/d3/d6/d10/d26/d2e/d4e/f5a 4932250 0 2024-09-18T12:52:16.916 INFO:tasks.workunit.client.0.smithi045.stdout:9/401: dread - d0/f61 zero size 2024-09-18T12:52:16.917 INFO:tasks.workunit.client.1.smithi161.stdout:7/784: read - d3/d8/d15/da7/d4a/d59/f73 zero size 2024-09-18T12:52:16.919 INFO:tasks.workunit.client.1.smithi161.stdout:9/770: dwrite d0/d47/d48/f4a [0,4194304] 0 2024-09-18T12:52:16.920 INFO:tasks.workunit.client.1.smithi161.stdout:0/881: creat df/d98/f137 x:0 0 0 2024-09-18T12:52:16.923 INFO:tasks.workunit.client.1.smithi161.stdout:2/900: symlink d0/d1/deb/d3d/d4f/d9b/l12e 0 2024-09-18T12:52:16.928 INFO:tasks.workunit.client.0.smithi045.stdout:8/500: rename d11/d20/d46/d79 to d11/d14/d53/d41/d57/d98 0 2024-09-18T12:52:16.933 INFO:tasks.workunit.client.0.smithi045.stdout:8/501: fdatasync d11/d14/d53/f3e 0 2024-09-18T12:52:16.935 INFO:tasks.workunit.client.1.smithi161.stdout:5/862: mkdir d3/d44/d6f/dca/d10d/d85/d118 0 2024-09-18T12:52:16.935 INFO:tasks.workunit.client.0.smithi045.stdout:4/617: dwrite db/f63 [0,4194304] 0 2024-09-18T12:52:16.937 INFO:tasks.workunit.client.0.smithi045.stdout:0/483: rename d6/d48/d5e/f2e to d6/d48/d5e/d39/d58/d3b/d6b/f8c 0 2024-09-18T12:52:16.940 INFO:tasks.workunit.client.1.smithi161.stdout:3/851: dread - d1/d2e/d14/d65/d76/d88/fc6 zero size 2024-09-18T12:52:16.940 INFO:tasks.workunit.client.1.smithi161.stdout:4/908: write d5/d27/f81 [965917,46771] 0 2024-09-18T12:52:16.943 INFO:tasks.workunit.client.1.smithi161.stdout:3/852: stat d1/d2e/d24/d84/d9a/fc2 0 2024-09-18T12:52:16.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/940: getdents d4/d39/d26/d31/d138 0 2024-09-18T12:52:16.947 INFO:tasks.workunit.client.1.smithi161.stdout:1/756: dwrite d1/d26/f50 [0,4194304] 0 2024-09-18T12:52:16.947 INFO:tasks.workunit.client.0.smithi045.stdout:4/618: creat db/de/d1e/d49/fcb x:0 0 0 2024-09-18T12:52:16.948 INFO:tasks.workunit.client.1.smithi161.stdout:1/757: chown d1/da/d1f/l58 7 1 2024-09-18T12:52:16.949 INFO:tasks.workunit.client.1.smithi161.stdout:1/758: chown d1/d26/d3a/d52/c5e 21763864 1 2024-09-18T12:52:16.950 INFO:tasks.workunit.client.1.smithi161.stdout:2/901: creat d0/d71/da9/d9f/dd0/d10c/f12f x:0 0 0 2024-09-18T12:52:16.952 INFO:tasks.workunit.client.0.smithi045.stdout:0/484: mkdir d6/d48/d5e/d39/d58/d3b/d65/d8d 0 2024-09-18T12:52:16.954 INFO:tasks.workunit.client.1.smithi161.stdout:1/759: dread d1/da/d9d/f94 [0,4194304] 0 2024-09-18T12:52:16.954 INFO:tasks.workunit.client.1.smithi161.stdout:1/760: stat d1/f28 0 2024-09-18T12:52:16.955 INFO:tasks.workunit.client.0.smithi045.stdout:4/619: mkdir db/d2c/d35/dcc 0 2024-09-18T12:52:16.955 INFO:tasks.workunit.client.0.smithi045.stdout:5/583: truncate d6/d28/d2b/f4e 3037394 0 2024-09-18T12:52:16.961 INFO:tasks.workunit.client.0.smithi045.stdout:9/402: rename d0/d3/d6/d10/d26/d2e/d4e/f68 to d0/d3/d6/d10/d2c/f80 0 2024-09-18T12:52:16.962 INFO:tasks.workunit.client.1.smithi161.stdout:8/903: write d0/d3/d10/f18 [528115,66074] 0 2024-09-18T12:52:16.962 INFO:tasks.workunit.client.1.smithi161.stdout:4/909: dread d5/d27/d44/f55 [0,4194304] 0 2024-09-18T12:52:16.963 INFO:tasks.workunit.client.0.smithi045.stdout:0/485: fdatasync d6/f36 0 2024-09-18T12:52:16.964 INFO:tasks.workunit.client.1.smithi161.stdout:3/853: dwrite d1/d2e/d68/d69/d7d/fca [0,4194304] 0 2024-09-18T12:52:16.965 INFO:tasks.workunit.client.1.smithi161.stdout:4/910: readlink d5/d14/d67/dc7/lb5 0 2024-09-18T12:52:16.966 INFO:tasks.workunit.client.1.smithi161.stdout:3/854: chown d1/d2e/d24/d1d/fa9 59566820 1 2024-09-18T12:52:16.968 INFO:tasks.workunit.client.0.smithi045.stdout:4/620: mkdir db/d2c/dcd 0 2024-09-18T12:52:16.971 INFO:tasks.workunit.client.1.smithi161.stdout:2/902: fsync d0/d1/deb/d3d/f99 0 2024-09-18T12:52:16.974 INFO:tasks.workunit.client.1.smithi161.stdout:0/882: write df/d30/d71/d96/dd3/d90/f4b [25616,73497] 0 2024-09-18T12:52:16.974 INFO:tasks.workunit.client.0.smithi045.stdout:9/403: write d0/d3/d6/d10/d26/f60 [1011817,59728] 0 2024-09-18T12:52:16.977 INFO:tasks.workunit.client.1.smithi161.stdout:9/771: dwrite d0/fd [4194304,4194304] 0 2024-09-18T12:52:16.978 INFO:tasks.workunit.client.0.smithi045.stdout:8/502: getdents d11/d20/d59 0 2024-09-18T12:52:16.984 INFO:tasks.workunit.client.0.smithi045.stdout:0/486: creat d6/d48/d5e/d39/d58/d3c/f8e x:0 0 0 2024-09-18T12:52:16.985 INFO:tasks.workunit.client.1.smithi161.stdout:8/904: dread d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/f50 [0,4194304] 0 2024-09-18T12:52:16.989 INFO:tasks.workunit.client.1.smithi161.stdout:6/941: creat d4/d1a/d1c/d3e/d83/d9e/db1/d45/d68/f13c x:0 0 0 2024-09-18T12:52:16.990 INFO:tasks.workunit.client.0.smithi045.stdout:5/584: symlink d6/d28/d2b/d51/d6c/lc5 0 2024-09-18T12:52:16.990 INFO:tasks.workunit.client.1.smithi161.stdout:6/942: dread - d4/d1a/d1c/d7c/fdc zero size 2024-09-18T12:52:16.993 INFO:tasks.workunit.client.1.smithi161.stdout:4/911: creat d5/d27/d44/de2/f14c x:0 0 0 2024-09-18T12:52:16.993 INFO:tasks.workunit.client.1.smithi161.stdout:1/761: write d1/d26/d88/fbe [588407,14677] 0 2024-09-18T12:52:16.994 INFO:tasks.workunit.client.1.smithi161.stdout:3/855: truncate d1/d2e/d24/d1d/f43 2235820 0 2024-09-18T12:52:16.994 INFO:tasks.workunit.client.1.smithi161.stdout:4/912: truncate d5/d27/f14a 495578 0 2024-09-18T12:52:16.995 INFO:tasks.workunit.client.0.smithi045.stdout:4/621: unlink db/d20/d6b/cad 0 2024-09-18T12:52:16.995 INFO:tasks.workunit.client.1.smithi161.stdout:3/856: write d1/d2e/d14/d78/fc3 [5130869,42930] 0 2024-09-18T12:52:16.998 INFO:tasks.workunit.client.0.smithi045.stdout:9/404: link d0/d3/d6/d10/d2c/d63/f7e d0/d3/d6/d10/f81 0 2024-09-18T12:52:17.000 INFO:tasks.workunit.client.0.smithi045.stdout:5/585: mknod d6/d28/d2b/d51/d97/dab/cc6 0 2024-09-18T12:52:17.002 INFO:tasks.workunit.client.1.smithi161.stdout:0/883: rename df/d98/d128/fbd to df/d29/d36/dde/d124/f138 0 2024-09-18T12:52:17.003 INFO:tasks.workunit.client.0.smithi045.stdout:4/622: mkdir db/de/d1e/d3e/d9a/d73/dce 0 2024-09-18T12:52:17.004 INFO:tasks.workunit.client.0.smithi045.stdout:0/487: dread d6/d35/f37 [0,4194304] 0 2024-09-18T12:52:17.005 INFO:tasks.workunit.client.0.smithi045.stdout:4/623: chown db/de/d1e/d3e/d47/d59/d7a/c8f 537735872 1 2024-09-18T12:52:17.006 INFO:tasks.workunit.client.1.smithi161.stdout:9/772: creat d0/d93/da0/fff x:0 0 0 2024-09-18T12:52:17.006 INFO:tasks.workunit.client.0.smithi045.stdout:4/624: fsync f9 0 2024-09-18T12:52:17.008 INFO:tasks.workunit.client.1.smithi161.stdout:1/762: dread d1/fc [4194304,4194304] 0 2024-09-18T12:52:17.008 INFO:tasks.workunit.client.0.smithi045.stdout:9/405: unlink d0/d3/d6/d52/l53 0 2024-09-18T12:52:17.012 INFO:tasks.workunit.client.0.smithi045.stdout:0/488: dwrite d6/d7/f14 [4194304,4194304] 0 2024-09-18T12:52:17.014 INFO:tasks.workunit.client.1.smithi161.stdout:8/905: mknod d0/d3/d10/d21/d4a/c137 0 2024-09-18T12:52:17.015 INFO:tasks.workunit.client.0.smithi045.stdout:5/586: dread d6/db/d54/fb6 [0,4194304] 0 2024-09-18T12:52:17.017 INFO:tasks.workunit.client.0.smithi045.stdout:4/625: rename db/la4 to db/de/d1a/dbc/lcf 0 2024-09-18T12:52:17.018 INFO:tasks.workunit.client.0.smithi045.stdout:0/489: dread d6/d35/f37 [0,4194304] 0 2024-09-18T12:52:17.018 INFO:tasks.workunit.client.0.smithi045.stdout:4/626: chown db/de/d1e/d49 232260265 1 2024-09-18T12:52:17.019 INFO:tasks.workunit.client.1.smithi161.stdout:6/943: symlink d4/d1a/d1c/d3e/d83/da2/l13d 0 2024-09-18T12:52:17.019 INFO:tasks.workunit.client.0.smithi045.stdout:0/490: dread - d6/d35/f8a zero size 2024-09-18T12:52:17.021 INFO:tasks.workunit.client.0.smithi045.stdout:9/406: truncate d0/fc 997369 0 2024-09-18T12:52:17.023 INFO:tasks.workunit.client.0.smithi045.stdout:4/627: dread db/de/fc5 [0,4194304] 0 2024-09-18T12:52:17.024 INFO:tasks.workunit.client.1.smithi161.stdout:4/913: chown d5/d14/d67/dc7/d60/d95/fba 261396583 1 2024-09-18T12:52:17.025 INFO:tasks.workunit.client.0.smithi045.stdout:4/628: write db/de/d1e/d3e/d47/d59/d2f/f36 [2122986,81405] 0 2024-09-18T12:52:17.025 INFO:tasks.workunit.client.1.smithi161.stdout:3/857: symlink d1/d2e/d68/d11c/l125 0 2024-09-18T12:52:17.026 INFO:tasks.workunit.client.0.smithi045.stdout:4/629: chown db/d2c/d35/d40/d77/l5a 366556 1 2024-09-18T12:52:17.027 INFO:tasks.workunit.client.1.smithi161.stdout:5/863: link d3/d3b/d54/cb6 d3/d3b/c119 0 2024-09-18T12:52:17.029 INFO:tasks.workunit.client.0.smithi045.stdout:5/587: mkdir d6/dc7 0 2024-09-18T12:52:17.031 INFO:tasks.workunit.client.1.smithi161.stdout:7/785: sync 2024-09-18T12:52:17.032 INFO:tasks.workunit.client.0.smithi045.stdout:5/588: write d6/db/d6a/d77/f8c [734129,34150] 0 2024-09-18T12:52:17.032 INFO:tasks.workunit.client.1.smithi161.stdout:2/903: link d0/d1/deb/d7e/f70 d0/d5/d43/d23/ddd/f130 0 2024-09-18T12:52:17.033 INFO:tasks.workunit.client.1.smithi161.stdout:7/786: stat d3/d8/d15/da7/d24/d31/d7d/la0 0 2024-09-18T12:52:17.034 INFO:tasks.workunit.client.1.smithi161.stdout:5/864: dwrite d3/d8/fcf [0,4194304] 0 2024-09-18T12:52:17.034 INFO:tasks.workunit.client.0.smithi045.stdout:5/589: fsync d6/d3e/f26 0 2024-09-18T12:52:17.035 INFO:tasks.workunit.client.0.smithi045.stdout:4/630: dwrite db/de/d1e/d3e/d47/d59/f87 [0,4194304] 0 2024-09-18T12:52:17.035 INFO:tasks.workunit.client.1.smithi161.stdout:5/865: readlink d3/d3b/d54/l103 0 2024-09-18T12:52:17.041 INFO:tasks.workunit.client.0.smithi045.stdout:0/491: creat d6/d48/d5e/d39/d58/d86/f8f x:0 0 0 2024-09-18T12:52:17.043 INFO:tasks.workunit.client.1.smithi161.stdout:5/866: dwrite d3/d44/d6f/dca/d10d/f1c [0,4194304] 0 2024-09-18T12:52:17.044 INFO:tasks.workunit.client.0.smithi045.stdout:0/492: write d6/d48/d5e/d39/d58/d3c/f8e [267406,115648] 0 2024-09-18T12:52:17.046 INFO:tasks.workunit.client.1.smithi161.stdout:5/867: chown d3/d8/l76 5 1 2024-09-18T12:52:17.048 INFO:tasks.workunit.client.1.smithi161.stdout:8/906: fdatasync d0/d3/d10/d21/d4a/d52/d82/d96/f60 0 2024-09-18T12:52:17.049 INFO:tasks.workunit.client.1.smithi161.stdout:6/944: mkdir d4/d39/d26/d31/d13e 0 2024-09-18T12:52:17.051 INFO:tasks.workunit.client.1.smithi161.stdout:4/914: mknod d5/d14/d67/dc7/d60/d95/dda/de8/c14d 0 2024-09-18T12:52:17.052 INFO:tasks.workunit.client.1.smithi161.stdout:4/915: readlink d5/d14/d67/d84/dae/db8/lf1 0 2024-09-18T12:52:17.058 INFO:tasks.workunit.client.0.smithi045.stdout:4/631: unlink db/de/d1a/d2e/l53 0 2024-09-18T12:52:17.059 INFO:tasks.workunit.client.0.smithi045.stdout:4/632: chown db/de/d1e/d3e/d9a/d73/dce 4598 1 2024-09-18T12:52:17.060 INFO:tasks.workunit.client.0.smithi045.stdout:4/633: write db/de/d1a/d2e/f92 [109111,130905] 0 2024-09-18T12:52:17.060 INFO:tasks.workunit.client.0.smithi045.stdout:0/493: mknod d6/d48/c90 0 2024-09-18T12:52:17.062 INFO:tasks.workunit.client.0.smithi045.stdout:4/634: chown db/d2c/d35/d40/d77/f4c 5133 1 2024-09-18T12:52:17.062 INFO:tasks.workunit.client.1.smithi161.stdout:7/787: readlink d3/d8/d15/l3a 0 2024-09-18T12:52:17.062 INFO:tasks.workunit.client.1.smithi161.stdout:1/763: write d1/daa/ff2 [253991,90431] 0 2024-09-18T12:52:17.063 INFO:tasks.workunit.client.1.smithi161.stdout:7/788: fsync d3/d50/fc5 0 2024-09-18T12:52:17.063 INFO:tasks.workunit.client.0.smithi045.stdout:9/407: creat d0/d3/d6/d10/d26/d2e/f82 x:0 0 0 2024-09-18T12:52:17.068 INFO:tasks.workunit.client.1.smithi161.stdout:9/773: mknod d0/d47/d48/d7f/d9e/c100 0 2024-09-18T12:52:17.069 INFO:tasks.workunit.client.0.smithi045.stdout:4/635: dwrite db/de/d1e/d3e/d47/fbb [0,4194304] 0 2024-09-18T12:52:17.070 INFO:tasks.workunit.client.0.smithi045.stdout:5/590: write d6/db/d19/d92/f60 [4351681,56169] 0 2024-09-18T12:52:17.072 INFO:tasks.workunit.client.0.smithi045.stdout:9/408: truncate d0/d3/d6/d10/d26/d2e/f3c 2045192 0 2024-09-18T12:52:17.074 INFO:tasks.workunit.client.1.smithi161.stdout:8/907: creat d0/d3/d91/f138 x:0 0 0 2024-09-18T12:52:17.074 INFO:tasks.workunit.client.0.smithi045.stdout:0/494: truncate d6/d7/f29 2229933 0 2024-09-18T12:52:17.077 INFO:tasks.workunit.client.0.smithi045.stdout:5/591: dwrite d6/db/f6b [4194304,4194304] 0 2024-09-18T12:52:17.078 INFO:tasks.workunit.client.1.smithi161.stdout:6/945: fdatasync d4/d39/d26/f40 0 2024-09-18T12:52:17.080 INFO:tasks.workunit.client.0.smithi045.stdout:9/409: mknod d0/c83 0 2024-09-18T12:52:17.082 INFO:tasks.workunit.client.0.smithi045.stdout:5/592: dread d6/db/d6a/d77/f8c [0,4194304] 0 2024-09-18T12:52:17.083 INFO:tasks.workunit.client.0.smithi045.stdout:0/495: fdatasync d6/d35/f3e 0 2024-09-18T12:52:17.085 INFO:tasks.workunit.client.0.smithi045.stdout:0/496: write d6/d7/f6c [2459534,23555] 0 2024-09-18T12:52:17.086 INFO:tasks.workunit.client.1.smithi161.stdout:3/858: mkdir d1/d2e/d14/d90/d10d/d126 0 2024-09-18T12:52:17.088 INFO:tasks.workunit.client.1.smithi161.stdout:2/904: symlink d0/d4/l131 0 2024-09-18T12:52:17.092 INFO:tasks.workunit.client.1.smithi161.stdout:0/884: rename df/d29/d36/f43 to df/de2/dc5/dca/f139 0 2024-09-18T12:52:17.093 INFO:tasks.workunit.client.0.smithi045.stdout:9/410: dread d0/f7f [0,4194304] 0 2024-09-18T12:52:17.099 INFO:tasks.workunit.client.1.smithi161.stdout:8/908: rmdir d0 39 2024-09-18T12:52:17.105 INFO:tasks.workunit.client.0.smithi045.stdout:9/411: chown d0/d3/d6/d64/c74 0 1 2024-09-18T12:52:17.105 INFO:tasks.workunit.client.1.smithi161.stdout:4/916: dwrite d5/d14/d67/f90 [0,4194304] 0 2024-09-18T12:52:17.105 INFO:tasks.workunit.client.1.smithi161.stdout:6/946: truncate d4/d1a/d1c/d3e/d83/d9e/db1/d45/ddf/ff6 606 0 2024-09-18T12:52:17.105 INFO:tasks.workunit.client.1.smithi161.stdout:6/947: chown d4/d1a 6 1 2024-09-18T12:52:17.106 INFO:tasks.workunit.client.1.smithi161.stdout:6/948: write d4/d1a/f13 [3272990,125963] 0 2024-09-18T12:52:17.106 INFO:tasks.workunit.client.1.smithi161.stdout:6/949: stat d4/d39/d26/d31 0 2024-09-18T12:52:17.109 INFO:tasks.workunit.client.1.smithi161.stdout:1/764: unlink d1/c4e 0 2024-09-18T12:52:17.110 INFO:tasks.workunit.client.0.smithi045.stdout:0/497: link d6/d7/d32/c88 d6/d48/d5e/d39/d58/d3c/d69/c91 0 2024-09-18T12:52:17.112 INFO:tasks.workunit.client.1.smithi161.stdout:6/950: dwrite d4/d39/d47/d51/f104 [0,4194304] 0 2024-09-18T12:52:17.113 INFO:tasks.workunit.client.0.smithi045.stdout:9/412: dwrite d0/f66 [0,4194304] 0 2024-09-18T12:52:17.113 INFO:tasks.workunit.client.0.smithi045.stdout:5/593: dwrite d6/db/d19/f68 [0,4194304] 0 2024-09-18T12:52:17.114 INFO:tasks.workunit.client.1.smithi161.stdout:6/951: fdatasync d4/d1a/d1c/d3e/d83/da2/f128 0 2024-09-18T12:52:17.122 INFO:tasks.workunit.client.1.smithi161.stdout:1/765: dread d1/d26/d3a/d52/fbb [0,4194304] 0 2024-09-18T12:52:17.123 INFO:tasks.workunit.client.1.smithi161.stdout:5/868: truncate d3/d3b/d7b/d82/f9d 4075647 0 2024-09-18T12:52:17.125 INFO:tasks.workunit.client.1.smithi161.stdout:5/869: readlink d3/d44/d6f/dca/d10d/l75 0 2024-09-18T12:52:17.127 INFO:tasks.workunit.client.1.smithi161.stdout:2/905: rename d0/d1/deb/d93 to d0/d71/da9/d9f/dd0/d10c/d132 0 2024-09-18T12:52:17.130 INFO:tasks.workunit.client.0.smithi045.stdout:9/413: dread d0/d3/d6/d10/d26/f60 [0,4194304] 0 2024-09-18T12:52:17.132 INFO:tasks.workunit.client.1.smithi161.stdout:4/917: mknod d5/da9/db9/c14e 0 2024-09-18T12:52:17.133 INFO:tasks.workunit.client.0.smithi045.stdout:5/594: symlink d6/d28/d2b/d51/lc8 0 2024-09-18T12:52:17.134 INFO:tasks.workunit.client.1.smithi161.stdout:3/859: dwrite d1/d2e/d24/d84/fc1 [0,4194304] 0 2024-09-18T12:52:17.134 INFO:tasks.workunit.client.0.smithi045.stdout:0/498: dread d6/d7/f14 [0,4194304] 0 2024-09-18T12:52:17.138 INFO:tasks.workunit.client.1.smithi161.stdout:7/789: rmdir d3/d8/d15/dec 0 2024-09-18T12:52:17.138 INFO:tasks.workunit.client.1.smithi161.stdout:7/790: read - d3/d36/f8b zero size 2024-09-18T12:52:17.142 INFO:tasks.workunit.client.0.smithi045.stdout:0/499: dread d6/d48/d5e/d39/d58/d3c/d69/f4c [0,4194304] 0 2024-09-18T12:52:17.143 INFO:tasks.workunit.client.1.smithi161.stdout:5/870: rmdir d3/d8/de4/d8d/ddb 39 2024-09-18T12:52:17.144 INFO:tasks.workunit.client.0.smithi045.stdout:0/500: dread - d6/d48/d5e/d39/d58/d3b/d65/f7a zero size 2024-09-18T12:52:17.145 INFO:tasks.workunit.client.1.smithi161.stdout:9/774: truncate d0/d16/d25/d46/f68 2958790 0 2024-09-18T12:52:17.148 INFO:tasks.workunit.client.1.smithi161.stdout:2/906: rename d0/d71/da9/d9f/la7 to d0/d1/d4c/d67/db9/dcb/d8a/dfa/l133 0 2024-09-18T12:52:17.148 INFO:tasks.workunit.client.1.smithi161.stdout:2/907: write d0/d1/f5e [1029028,3031] 0 2024-09-18T12:52:17.152 INFO:tasks.workunit.client.1.smithi161.stdout:3/860: rmdir d1/d2e/d68/d92/dba/dd9 39 2024-09-18T12:52:17.154 INFO:tasks.workunit.client.1.smithi161.stdout:3/861: read d1/d2e/d14/d2c/f31 [3421022,119655] 0 2024-09-18T12:52:17.156 INFO:tasks.workunit.client.1.smithi161.stdout:8/909: creat d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/de3/df4/f139 x:0 0 0 2024-09-18T12:52:17.157 INFO:tasks.workunit.client.0.smithi045.stdout:9/414: write d0/d3/d6/d10/f1b [5231716,22026] 0 2024-09-18T12:52:17.162 INFO:tasks.workunit.client.1.smithi161.stdout:6/952: write d4/f10 [3006108,106360] 0 2024-09-18T12:52:17.162 INFO:tasks.workunit.client.0.smithi045.stdout:5/595: dread d6/db/d5a/d78/f45 [0,4194304] 0 2024-09-18T12:52:17.162 INFO:tasks.workunit.client.1.smithi161.stdout:1/766: write d1/d26/fb [1837109,61758] 0 2024-09-18T12:52:17.167 INFO:tasks.workunit.client.1.smithi161.stdout:8/910: dwrite d0/d3/d10/d21/d4a/d52/d94/f128 [0,4194304] 0 2024-09-18T12:52:17.168 INFO:tasks.workunit.client.0.smithi045.stdout:9/415: dwrite d0/d3/d6/d10/f7d [0,4194304] 0 2024-09-18T12:52:17.169 INFO:tasks.workunit.client.1.smithi161.stdout:7/791: dwrite d3/d8/d15/da7/d4a/fa6 [0,4194304] 0 2024-09-18T12:52:17.171 INFO:tasks.workunit.client.1.smithi161.stdout:3/862: chown d1/d2e/d24/c42 10734 1 2024-09-18T12:52:17.175 INFO:tasks.workunit.client.1.smithi161.stdout:5/871: creat d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/d9f/f11a x:0 0 0 2024-09-18T12:52:17.178 INFO:tasks.workunit.client.1.smithi161.stdout:3/863: stat d1/d2e/d14/d65/d76/fb4 0 2024-09-18T12:52:17.178 INFO:tasks.workunit.client.0.smithi045.stdout:9/416: symlink d0/d3/d6/d10/d26/d2e/d6f/l84 0 2024-09-18T12:52:17.179 INFO:tasks.workunit.client.1.smithi161.stdout:0/885: dwrite df/d30/f3a [0,4194304] 0 2024-09-18T12:52:17.180 INFO:tasks.workunit.client.0.smithi045.stdout:0/501: dwrite d6/d7/ff [0,4194304] 0 2024-09-18T12:52:17.183 INFO:tasks.workunit.client.0.smithi045.stdout:0/502: fdatasync d6/d7/d32/f33 0 2024-09-18T12:52:17.184 INFO:tasks.workunit.client.0.smithi045.stdout:0/503: chown d6/d7/c3d 321337933 1 2024-09-18T12:52:17.184 INFO:tasks.workunit.client.0.smithi045.stdout:6/408: sync 2024-09-18T12:52:17.185 INFO:tasks.workunit.client.0.smithi045.stdout:6/409: readlink d9/d1a/d48/l4b 0 2024-09-18T12:52:17.185 INFO:tasks.workunit.client.1.smithi161.stdout:3/864: fsync d1/d2e/d68/d92/ded/f22 0 2024-09-18T12:52:17.186 INFO:tasks.workunit.client.1.smithi161.stdout:9/775: write d0/d47/df1/f72 [2448804,28967] 0 2024-09-18T12:52:17.186 INFO:tasks.workunit.client.0.smithi045.stdout:6/410: write d9/d1a/d2d/d38/f40 [4839152,20190] 0 2024-09-18T12:52:17.188 INFO:tasks.workunit.client.0.smithi045.stdout:6/411: dread - d9/d1a/d2d/d38/d5b/f86 zero size 2024-09-18T12:52:17.189 INFO:tasks.workunit.client.1.smithi161.stdout:3/865: dread - d1/d2e/d68/f114 zero size 2024-09-18T12:52:17.191 INFO:tasks.workunit.client.1.smithi161.stdout:1/767: symlink d1/da/d1f/dab/dd9/l100 0 2024-09-18T12:52:17.195 INFO:tasks.workunit.client.1.smithi161.stdout:4/918: dwrite d5/d14/d67/d84/dae/fb0 [0,4194304] 0 2024-09-18T12:52:17.200 INFO:tasks.workunit.client.0.smithi045.stdout:5/596: dwrite d6/d28/d2b/d51/d6c/f71 [4194304,4194304] 0 2024-09-18T12:52:17.201 INFO:tasks.workunit.client.1.smithi161.stdout:7/792: symlink d3/d8/d4f/lee 0 2024-09-18T12:52:17.204 INFO:tasks.workunit.client.1.smithi161.stdout:3/866: dwrite d1/d2e/d24/f112 [0,4194304] 0 2024-09-18T12:52:17.204 INFO:tasks.workunit.client.1.smithi161.stdout:5/872: write d3/d8/de4/d8d/ddb/f10e [517686,44452] 0 2024-09-18T12:52:17.206 INFO:tasks.workunit.client.1.smithi161.stdout:2/908: creat d0/d5/d43/d35/d98/f134 x:0 0 0 2024-09-18T12:52:17.208 INFO:tasks.workunit.client.0.smithi045.stdout:6/412: getdents d9/d30/d7e 0 2024-09-18T12:52:17.209 INFO:tasks.workunit.client.0.smithi045.stdout:6/413: chown d9/d74/c89 56674 1 2024-09-18T12:52:17.210 INFO:tasks.workunit.client.1.smithi161.stdout:5/873: truncate d3/d8/de4/d8d/fc7 4918341 0 2024-09-18T12:52:17.210 INFO:tasks.workunit.client.1.smithi161.stdout:6/953: dread d4/d1a/d1c/d3e/d83/d9e/db1/d28/f3b [0,4194304] 0 2024-09-18T12:52:17.211 INFO:tasks.workunit.client.1.smithi161.stdout:9/776: unlink d0/d47/d48/l83 0 2024-09-18T12:52:17.212 INFO:tasks.workunit.client.1.smithi161.stdout:1/768: mknod d1/daa/db2/c101 0 2024-09-18T12:52:17.212 INFO:tasks.workunit.client.0.smithi045.stdout:6/414: truncate d9/f68 264367 0 2024-09-18T12:52:17.213 INFO:tasks.workunit.client.0.smithi045.stdout:6/415: dread - d9/d1a/d2d/f8a zero size 2024-09-18T12:52:17.213 INFO:tasks.workunit.client.1.smithi161.stdout:4/919: symlink d5/d14/d67/dc7/d60/d95/dda/de1/l14f 0 2024-09-18T12:52:17.216 INFO:tasks.workunit.client.1.smithi161.stdout:2/909: creat d0/d5/d43/d35/d80/f135 x:0 0 0 2024-09-18T12:52:17.216 INFO:tasks.workunit.client.0.smithi045.stdout:6/416: fsync d9/d1a/d1d/f4e 0 2024-09-18T12:52:17.217 INFO:tasks.workunit.client.1.smithi161.stdout:2/910: stat d0/d5/d53/c3c 0 2024-09-18T12:52:17.218 INFO:tasks.workunit.client.1.smithi161.stdout:5/874: chown d3/d8/de4/d8d/l105 39 1 2024-09-18T12:52:17.218 INFO:tasks.workunit.client.0.smithi045.stdout:6/417: truncate d9/d1a/f37 893341 0 2024-09-18T12:52:17.219 INFO:tasks.workunit.client.1.smithi161.stdout:0/886: mknod df/d30/d71/d96/dd3/d51/dc9/d10e/c13a 0 2024-09-18T12:52:17.221 INFO:tasks.workunit.client.1.smithi161.stdout:5/875: truncate d3/d8/de4/f104 1001772 0 2024-09-18T12:52:17.222 INFO:tasks.workunit.client.0.smithi045.stdout:6/418: mknod d9/d1a/d2d/d38/d5b/c94 0 2024-09-18T12:52:17.222 INFO:tasks.workunit.client.1.smithi161.stdout:3/867: dwrite d1/d2e/d14/d65/d76/d88/fdd [0,4194304] 0 2024-09-18T12:52:17.226 INFO:tasks.workunit.client.1.smithi161.stdout:1/769: rename d1/d48/fb5 to d1/da/d1f/dab/daf/de3/f102 0 2024-09-18T12:52:17.226 INFO:tasks.workunit.client.1.smithi161.stdout:3/868: write d1/d2e/d68/d92/ded/f9b [222322,9454] 0 2024-09-18T12:52:17.228 INFO:tasks.workunit.client.1.smithi161.stdout:2/911: truncate d0/d1/deb/d3d/f99 4099306 0 2024-09-18T12:52:17.229 INFO:tasks.workunit.client.1.smithi161.stdout:1/770: write d1/d71/fec [803058,14536] 0 2024-09-18T12:52:17.229 INFO:tasks.workunit.client.1.smithi161.stdout:8/911: link d0/f7a d0/f13a 0 2024-09-18T12:52:17.229 INFO:tasks.workunit.client.1.smithi161.stdout:3/869: chown d1/d2e/d68/d92/ded/f80 528438660 1 2024-09-18T12:52:17.229 INFO:tasks.workunit.client.0.smithi045.stdout:9/417: dwrite d0/f1a [4194304,4194304] 0 2024-09-18T12:52:17.230 INFO:tasks.workunit.client.1.smithi161.stdout:9/777: symlink d0/d20/d49/de2/l101 0 2024-09-18T12:52:17.231 INFO:tasks.workunit.client.1.smithi161.stdout:2/912: read d0/d5/d43/d35/f7a [712643,75923] 0 2024-09-18T12:52:17.232 INFO:tasks.workunit.client.1.smithi161.stdout:2/913: stat d0/d5/d53/l49 0 2024-09-18T12:52:17.233 INFO:tasks.workunit.client.1.smithi161.stdout:0/887: dread df/d30/d4d/f4f [0,4194304] 0 2024-09-18T12:52:17.233 INFO:tasks.workunit.client.1.smithi161.stdout:2/914: fdatasync d0/d1/f3f 0 2024-09-18T12:52:17.234 INFO:tasks.workunit.client.0.smithi045.stdout:6/419: dwrite d9/d56/f8b [0,4194304] 0 2024-09-18T12:52:17.235 INFO:tasks.workunit.client.1.smithi161.stdout:4/920: creat d5/d14/d5f/da1/de9/f150 x:0 0 0 2024-09-18T12:52:17.236 INFO:tasks.workunit.client.1.smithi161.stdout:2/915: write d0/d1/d4c/d67/fe7 [1052325,114804] 0 2024-09-18T12:52:17.237 INFO:tasks.workunit.client.0.smithi045.stdout:9/418: symlink d0/l85 0 2024-09-18T12:52:17.238 INFO:tasks.workunit.client.0.smithi045.stdout:6/420: dread - d9/d1a/d2d/f93 zero size 2024-09-18T12:52:17.241 INFO:tasks.workunit.client.0.smithi045.stdout:9/419: symlink d0/d3/d6/d52/l86 0 2024-09-18T12:52:17.241 INFO:tasks.workunit.client.1.smithi161.stdout:9/778: dread d0/d16/d25/d46/fb6 [0,4194304] 0 2024-09-18T12:52:17.246 INFO:tasks.workunit.client.0.smithi045.stdout:9/420: creat d0/d3/d6/d10/d2c/d63/f87 x:0 0 0 2024-09-18T12:52:17.246 INFO:tasks.workunit.client.1.smithi161.stdout:4/921: dread d5/d27/d44/d61/f116 [0,4194304] 0 2024-09-18T12:52:17.247 INFO:tasks.workunit.client.1.smithi161.stdout:0/888: symlink df/de2/dc5/d86/l13b 0 2024-09-18T12:52:17.249 INFO:tasks.workunit.client.0.smithi045.stdout:6/421: rename d9/d1a/c22 to d9/d30/d7e/c95 0 2024-09-18T12:52:17.251 INFO:tasks.workunit.client.1.smithi161.stdout:9/779: dwrite d0/f3 [0,4194304] 0 2024-09-18T12:52:17.251 INFO:tasks.workunit.client.0.smithi045.stdout:0/504: dwrite d6/f63 [0,4194304] 0 2024-09-18T12:52:17.258 INFO:tasks.workunit.client.1.smithi161.stdout:1/771: dread d1/d26/d3a/f3b [0,4194304] 0 2024-09-18T12:52:17.259 INFO:tasks.workunit.client.0.smithi045.stdout:9/421: dwrite d0/d3/d6/f6c [0,4194304] 0 2024-09-18T12:52:17.263 INFO:tasks.workunit.client.1.smithi161.stdout:3/870: mkdir d1/d2e/d24/d1d/d89/d10f/d127 0 2024-09-18T12:52:17.263 INFO:tasks.workunit.client.1.smithi161.stdout:7/793: write d3/d8/d15/da7/fcf [249934,100268] 0 2024-09-18T12:52:17.263 INFO:tasks.workunit.client.0.smithi045.stdout:5/597: dwrite d6/db/d19/d92/f76 [4194304,4194304] 0 2024-09-18T12:52:17.264 INFO:tasks.workunit.client.1.smithi161.stdout:7/794: dread - d3/d8/fd3 zero size 2024-09-18T12:52:17.264 INFO:tasks.workunit.client.1.smithi161.stdout:3/871: readlink d1/d2e/d68/d92/ded/l23 0 2024-09-18T12:52:17.265 INFO:tasks.workunit.client.0.smithi045.stdout:0/505: chown d6/d35/l52 7477 1 2024-09-18T12:52:17.265 INFO:tasks.workunit.client.0.smithi045.stdout:0/506: read - d6/d35/f72 zero size 2024-09-18T12:52:17.270 INFO:tasks.workunit.client.1.smithi161.stdout:4/922: unlink d5/d27/d44/f88 0 2024-09-18T12:52:17.271 INFO:tasks.workunit.client.0.smithi045.stdout:9/422: mkdir d0/d3/d6/d64/d88 0 2024-09-18T12:52:17.272 INFO:tasks.workunit.client.1.smithi161.stdout:0/889: mknod df/d98/d128/c13c 0 2024-09-18T12:52:17.275 INFO:tasks.workunit.client.1.smithi161.stdout:0/890: dread - df/d30/d4d/f133 zero size 2024-09-18T12:52:17.276 INFO:tasks.workunit.client.1.smithi161.stdout:5/876: rename d3/d8/de4/d8d/dab to d3/d44/d6f/dca/d10d/d11b 0 2024-09-18T12:52:17.278 INFO:tasks.workunit.client.0.smithi045.stdout:0/507: dwrite d6/d48/d5e/d39/d58/d3b/d65/f7a [0,4194304] 0 2024-09-18T12:52:17.278 INFO:tasks.workunit.client.0.smithi045.stdout:5/598: readlink d6/d3e/l29 0 2024-09-18T12:52:17.279 INFO:tasks.workunit.client.0.smithi045.stdout:9/423: dread d0/d3/d6/d10/d26/f62 [0,4194304] 0 2024-09-18T12:52:17.279 INFO:tasks.workunit.client.1.smithi161.stdout:0/891: chown df/d30/d71/d96/dd3/d78/lb0 506017865 1 2024-09-18T12:52:17.280 INFO:tasks.workunit.client.1.smithi161.stdout:6/954: dwrite d4/d39/d47/d51/f52 [4194304,4194304] 0 2024-09-18T12:52:17.281 INFO:tasks.workunit.client.0.smithi045.stdout:9/424: write d0/f59 [651194,32] 0 2024-09-18T12:52:17.281 INFO:tasks.workunit.client.0.smithi045.stdout:5/599: write d6/d28/f88 [492803,64533] 0 2024-09-18T12:52:17.282 INFO:tasks.workunit.client.0.smithi045.stdout:0/508: dread - d6/d48/d5e/d39/d58/d86/f8f zero size 2024-09-18T12:52:17.284 INFO:tasks.workunit.client.1.smithi161.stdout:8/912: dread d0/f13a [0,4194304] 0 2024-09-18T12:52:17.285 INFO:tasks.workunit.client.1.smithi161.stdout:9/780: rmdir d0/d16 39 2024-09-18T12:52:17.285 INFO:tasks.workunit.client.0.smithi045.stdout:9/425: read d0/d3/d6/d10/f7d [2560060,39289] 0 2024-09-18T12:52:17.290 INFO:tasks.workunit.client.1.smithi161.stdout:1/772: symlink d1/d26/dad/db6/df6/l103 0 2024-09-18T12:52:17.291 INFO:tasks.workunit.client.0.smithi045.stdout:9/426: chown d0/d3/d6/d10/d26/d2e/l46 142025970 1 2024-09-18T12:52:17.294 INFO:tasks.workunit.client.1.smithi161.stdout:7/795: creat d3/d8/d15/d99/db0/fef x:0 0 0 2024-09-18T12:52:17.298 INFO:tasks.workunit.client.0.smithi045.stdout:5/600: mkdir d6/db/d19/d92/d61/da5/dc9 0 2024-09-18T12:52:17.298 INFO:tasks.workunit.client.0.smithi045.stdout:0/509: dwrite d6/f7d [0,4194304] 0 2024-09-18T12:52:17.298 INFO:tasks.workunit.client.0.smithi045.stdout:9/427: dread d0/f66 [0,4194304] 0 2024-09-18T12:52:17.300 INFO:tasks.workunit.client.0.smithi045.stdout:5/601: write d6/d28/f8f [414114,51863] 0 2024-09-18T12:52:17.300 INFO:tasks.workunit.client.0.smithi045.stdout:9/428: chown d0/d3/c39 13874740 1 2024-09-18T12:52:17.301 INFO:tasks.workunit.client.0.smithi045.stdout:6/422: dread d9/d1a/d2d/f4a [0,4194304] 0 2024-09-18T12:52:17.305 INFO:tasks.workunit.client.1.smithi161.stdout:0/892: dread df/d30/d4d/d92/f9e [0,4194304] 0 2024-09-18T12:52:17.308 INFO:tasks.workunit.client.1.smithi161.stdout:6/955: creat d4/d1a/d1c/d3e/d83/d9e/db1/d45/dd6/f13f x:0 0 0 2024-09-18T12:52:17.311 INFO:tasks.workunit.client.0.smithi045.stdout:6/423: rename d9/l5f to d9/d56/l96 0 2024-09-18T12:52:17.312 INFO:tasks.workunit.client.1.smithi161.stdout:9/781: mkdir d0/d20/d74/ded/d102 0 2024-09-18T12:52:17.314 INFO:tasks.workunit.client.1.smithi161.stdout:1/773: symlink d1/da/d1f/dab/daf/de3/l104 0 2024-09-18T12:52:17.316 INFO:tasks.workunit.client.0.smithi045.stdout:9/429: rename d0/d3/d6/d52 to d0/d3/d6/d10/d26/d2e/d4e/d76/d89 0 2024-09-18T12:52:17.318 INFO:tasks.workunit.client.0.smithi045.stdout:9/430: rename d0/d3/d6/d10/d26 to d0/d3/d6/d10/d26/d2e/d4e/d76/d8a 22 2024-09-18T12:52:17.320 INFO:tasks.workunit.client.0.smithi045.stdout:9/431: stat d0/d3/d6/d10/d26/d2e/l79 0 2024-09-18T12:52:17.322 INFO:tasks.workunit.client.1.smithi161.stdout:3/872: rename d1/d2e/d68/d92/ded/d49/l93 to d1/d2e/d14/d90/d10d/d126/l128 0 2024-09-18T12:52:17.323 INFO:tasks.workunit.client.1.smithi161.stdout:6/956: dread d4/d39/d26/d31/f53 [0,4194304] 0 2024-09-18T12:52:17.324 INFO:tasks.workunit.client.1.smithi161.stdout:2/916: getdents d0/d71/da9/d9f/dd0 0 2024-09-18T12:52:17.325 INFO:tasks.workunit.client.0.smithi045.stdout:9/432: fsync d0/d3/d6/d10/d26/d2e/f6a 0 2024-09-18T12:52:17.326 INFO:tasks.workunit.client.1.smithi161.stdout:6/957: stat d4/d1a/d1c/d3e/d83/da2/db4/le3 0 2024-09-18T12:52:17.326 INFO:tasks.workunit.client.1.smithi161.stdout:2/917: fsync d0/d1/d4c/d67/db9/dcb/d8a/dfa/f11b 0 2024-09-18T12:52:17.327 INFO:tasks.workunit.client.1.smithi161.stdout:0/893: fdatasync df/d29/f53 0 2024-09-18T12:52:17.329 INFO:tasks.workunit.client.1.smithi161.stdout:9/782: dread d0/d47/df1/f7c [0,4194304] 0 2024-09-18T12:52:17.330 INFO:tasks.workunit.client.1.smithi161.stdout:1/774: symlink d1/daa/db2/dc0/l105 0 2024-09-18T12:52:17.332 INFO:tasks.workunit.client.0.smithi045.stdout:9/433: creat d0/d3/d6/d10/d26/d2e/d4e/d76/f8b x:0 0 0 2024-09-18T12:52:17.332 INFO:tasks.workunit.client.0.smithi045.stdout:0/510: write d6/d7/f42 [543124,108359] 0 2024-09-18T12:52:17.334 INFO:tasks.workunit.client.0.smithi045.stdout:9/434: dread - d0/d3/d6/d10/d26/d2e/f48 zero size 2024-09-18T12:52:17.334 INFO:tasks.workunit.client.1.smithi161.stdout:4/923: link d5/d27/d44/d61/d6c/d8f/fa3 d5/da9/de7/f151 0 2024-09-18T12:52:17.335 INFO:tasks.workunit.client.1.smithi161.stdout:4/924: chown d5/f22 329 1 2024-09-18T12:52:17.337 INFO:tasks.workunit.client.0.smithi045.stdout:6/424: dread d9/d1a/d2d/d38/d5b/f61 [0,4194304] 0 2024-09-18T12:52:17.337 INFO:tasks.workunit.client.0.smithi045.stdout:0/511: mkdir d6/d35/d92 0 2024-09-18T12:52:17.338 INFO:tasks.workunit.client.1.smithi161.stdout:5/877: rename d3/d44/d6f/d86/d10a to d3/d3b/d54/d11c 0 2024-09-18T12:52:17.339 INFO:tasks.workunit.client.1.smithi161.stdout:5/878: fsync d3/d8/fcf 0 2024-09-18T12:52:17.340 INFO:tasks.workunit.client.0.smithi045.stdout:9/435: dwrite d0/f50 [0,4194304] 0 2024-09-18T12:52:17.341 INFO:tasks.workunit.client.1.smithi161.stdout:3/873: mkdir d1/d2e/d14/d2c/d129 0 2024-09-18T12:52:17.343 INFO:tasks.workunit.client.0.smithi045.stdout:9/436: truncate d0/d3/f1f 4845573 0 2024-09-18T12:52:17.344 INFO:tasks.workunit.client.0.smithi045.stdout:6/425: mkdir d9/d1a/d48/d97 0 2024-09-18T12:52:17.345 INFO:tasks.workunit.client.0.smithi045.stdout:0/512: dwrite d6/d7/d32/f33 [0,4194304] 0 2024-09-18T12:52:17.348 INFO:tasks.workunit.client.1.smithi161.stdout:5/879: dwrite d3/d3b/f98 [0,4194304] 0 2024-09-18T12:52:17.349 INFO:tasks.workunit.client.1.smithi161.stdout:8/913: write d0/d3/d10/d21/d4a/d52/d82/fbd [65017,10879] 0 2024-09-18T12:52:17.350 INFO:tasks.workunit.client.1.smithi161.stdout:8/914: truncate d0/dc4/f123 405021 0 2024-09-18T12:52:17.351 INFO:tasks.workunit.client.0.smithi045.stdout:9/437: dread d0/d3/d6/d10/d2c/f57 [0,4194304] 0 2024-09-18T12:52:17.353 INFO:tasks.workunit.client.0.smithi045.stdout:0/513: dread d6/d48/d5e/d39/d58/d3b/d65/f7a [0,4194304] 0 2024-09-18T12:52:17.353 INFO:tasks.workunit.client.0.smithi045.stdout:9/438: write d0/d3/d6/d10/d26/d2e/d4e/d76/f8b [933733,79600] 0 2024-09-18T12:52:17.361 INFO:tasks.workunit.client.1.smithi161.stdout:9/783: truncate d0/d16/d25/d28/d45/f60 5170606 0 2024-09-18T12:52:17.362 INFO:tasks.workunit.client.1.smithi161.stdout:0/894: dwrite df/d29/d36/dde/d124/f138 [0,4194304] 0 2024-09-18T12:52:17.364 INFO:tasks.workunit.client.1.smithi161.stdout:0/895: write df/d30/d71/d96/dd3/d90/f88 [612266,110532] 0 2024-09-18T12:52:17.365 INFO:tasks.workunit.client.1.smithi161.stdout:2/918: rename d0/d1/deb/d3d/d4f to d0/d5/d43/d23/d136 0 2024-09-18T12:52:17.365 INFO:tasks.workunit.client.0.smithi045.stdout:9/439: truncate d0/d3/d6/d10/d2c/d63/f7e 800222 0 2024-09-18T12:52:17.367 INFO:tasks.workunit.client.0.smithi045.stdout:9/440: fsync d0/d3/d6/d10/d2c/f44 0 2024-09-18T12:52:17.367 INFO:tasks.workunit.client.1.smithi161.stdout:6/958: symlink d4/l140 0 2024-09-18T12:52:17.368 INFO:tasks.workunit.client.0.smithi045.stdout:9/441: chown d0/d3/d6/d10/d26/d2e/d4e/f5a 1466099363 1 2024-09-18T12:52:17.369 INFO:tasks.workunit.client.1.smithi161.stdout:5/880: mkdir d3/d3b/d54/d11c/d11d 0 2024-09-18T12:52:17.370 INFO:tasks.workunit.client.1.smithi161.stdout:5/881: readlink d3/d44/d6f/dca/d10d/d11b/ld1 0 2024-09-18T12:52:17.370 INFO:tasks.workunit.client.1.smithi161.stdout:1/775: link d1/da/d31/f77 d1/da/d39/f106 0 2024-09-18T12:52:17.372 INFO:tasks.workunit.client.1.smithi161.stdout:1/776: write d1/f28 [2244007,63254] 0 2024-09-18T12:52:17.376 INFO:tasks.workunit.client.1.smithi161.stdout:2/919: mknod d0/d1/deb/d7e/c137 0 2024-09-18T12:52:17.376 INFO:tasks.workunit.client.1.smithi161.stdout:7/796: link d3/d8/f29 d3/ff0 0 2024-09-18T12:52:17.379 INFO:tasks.workunit.client.1.smithi161.stdout:5/882: creat d3/d44/d6f/dca/d10d/d4b/d8e/d24/d61/de6/f11e x:0 0 0 2024-09-18T12:52:17.379 INFO:tasks.workunit.client.1.smithi161.stdout:9/784: mknod d0/d47/d48/c103 0 2024-09-18T12:52:17.381 INFO:tasks.workunit.client.1.smithi161.stdout:3/874: getdents d1/d2e/d68/d92/ded 0 2024-09-18T12:52:17.383 INFO:tasks.workunit.client.0.smithi045.stdout:6/426: write d9/d1a/d2d/d32/f4c [849078,14761] 0 2024-09-18T12:52:17.383 INFO:tasks.workunit.client.1.smithi161.stdout:4/925: dwrite d5/f17 [0,4194304] 0 2024-09-18T12:52:17.384 INFO:tasks.workunit.client.1.smithi161.stdout:7/797: write d3/d8/d15/da7/d4a/fa6 [4696215,37810] 0 2024-09-18T12:52:17.388 INFO:tasks.workunit.client.1.smithi161.stdout:5/883: read d3/f56 [3519400,65063] 0 2024-09-18T12:52:17.391 INFO:tasks.workunit.client.1.smithi161.stdout:4/926: truncate d5/fea 449554 0 2024-09-18T12:52:17.393 INFO:tasks.workunit.client.0.smithi045.stdout:0/514: dwrite d6/d48/d5e/d39/d58/f59 [0,4194304] 0 2024-09-18T12:52:17.394 INFO:tasks.workunit.client.0.smithi045.stdout:0/515: chown d6/d48/d5e/d39/d58/d3b 343 1 2024-09-18T12:52:17.395 INFO:tasks.workunit.client.1.smithi161.stdout:5/884: creat d3/d44/d6f/f11f x:0 0 0 2024-09-18T12:52:17.395 INFO:tasks.workunit.client.0.smithi045.stdout:0/516: rmdir d6/d35 39 2024-09-18T12:52:17.396 INFO:tasks.workunit.client.1.smithi161.stdout:8/915: dread d0/d3/d10/f63 [0,4194304] 0 2024-09-18T12:52:17.398 INFO:tasks.workunit.client.1.smithi161.stdout:4/927: symlink d5/d14/d67/dc7/d60/d95/dda/de8/l152 0 2024-09-18T12:52:17.398 INFO:tasks.workunit.client.1.smithi161.stdout:2/920: dread d0/d5/f74 [0,4194304] 0 2024-09-18T12:52:17.399 INFO:tasks.workunit.client.1.smithi161.stdout:7/798: creat d3/d8/d15/da7/d24/d31/ff1 x:0 0 0 2024-09-18T12:52:17.401 INFO:tasks.workunit.client.1.smithi161.stdout:0/896: write df/d30/f3f [208236,69134] 0 2024-09-18T12:52:17.405 INFO:tasks.workunit.client.1.smithi161.stdout:0/897: stat df/d29/f3b 0 2024-09-18T12:52:17.406 INFO:tasks.workunit.client.1.smithi161.stdout:2/921: mkdir d0/d5/d53/d7d/d138 0 2024-09-18T12:52:17.407 INFO:tasks.workunit.client.1.smithi161.stdout:0/898: read df/d29/fc0 [4280623,26876] 0 2024-09-18T12:52:17.407 INFO:tasks.workunit.client.1.smithi161.stdout:9/785: write d0/d20/d49/f7e [677548,4051] 0 2024-09-18T12:52:17.407 INFO:tasks.workunit.client.1.smithi161.stdout:7/799: dread d3/d8/d15/da7/d24/d31/f62 [0,4194304] 0 2024-09-18T12:52:17.409 INFO:tasks.workunit.client.1.smithi161.stdout:3/875: getdents d1/d2e/d14/d65/d76/d8c/de0 0 2024-09-18T12:52:17.409 INFO:tasks.workunit.client.1.smithi161.stdout:0/899: dread - df/d29/d36/d94/f116 zero size 2024-09-18T12:52:17.412 INFO:tasks.workunit.client.1.smithi161.stdout:6/959: dread d4/d39/d48/f8b [0,4194304] 0 2024-09-18T12:52:17.412 INFO:tasks.workunit.client.0.smithi045.stdout:6/427: dwrite d9/d30/f33 [0,4194304] 0 2024-09-18T12:52:17.412 INFO:tasks.workunit.client.1.smithi161.stdout:3/876: stat d1/d2e/d14/d2c/l109 0 2024-09-18T12:52:17.414 INFO:tasks.workunit.client.1.smithi161.stdout:1/777: dread d1/daa/db2/dc0/ff8 [0,4194304] 0 2024-09-18T12:52:17.414 INFO:tasks.workunit.client.1.smithi161.stdout:0/900: write df/d30/d71/d96/dd3/d51/f101 [1441879,55072] 0 2024-09-18T12:52:17.416 INFO:tasks.workunit.client.0.smithi045.stdout:0/517: write d6/d7/f29 [714413,115349] 0 2024-09-18T12:52:17.418 INFO:tasks.workunit.client.1.smithi161.stdout:0/901: dread - df/d30/d71/f11a zero size 2024-09-18T12:52:17.418 INFO:tasks.workunit.client.0.smithi045.stdout:2/488: sync 2024-09-18T12:52:17.418 INFO:tasks.workunit.client.0.smithi045.stdout:3/436: sync 2024-09-18T12:52:17.419 INFO:tasks.workunit.client.1.smithi161.stdout:1/778: readlink d1/da/d1f/d45/d73/l93 0 2024-09-18T12:52:17.420 INFO:tasks.workunit.client.0.smithi045.stdout:6/428: rename d9/d30/d7e to d9/d1a/d48/d8f/d98 0 2024-09-18T12:52:17.422 INFO:tasks.workunit.client.1.smithi161.stdout:5/885: dwrite d3/d44/d6f/fbc [0,4194304] 0 2024-09-18T12:52:17.425 INFO:tasks.workunit.client.1.smithi161.stdout:5/886: readlink d3/d44/d6f/dca/d10d/d4b/d8e/d24/l4a 0 2024-09-18T12:52:17.425 INFO:tasks.workunit.client.0.smithi045.stdout:3/437: mkdir d0/d1e/d91 0 2024-09-18T12:52:17.425 INFO:tasks.workunit.client.1.smithi161.stdout:5/887: fdatasync d3/d44/d6f/dca/d10d/f12 0 2024-09-18T12:52:17.428 INFO:tasks.workunit.client.1.smithi161.stdout:4/928: dread d5/d14/d67/dc7/d47/d49/d7b/faf [0,4194304] 0 2024-09-18T12:52:17.429 INFO:tasks.workunit.client.0.smithi045.stdout:6/429: dwrite d9/d1a/d2d/f8a [0,4194304] 0 2024-09-18T12:52:17.431 INFO:tasks.workunit.client.1.smithi161.stdout:8/916: link d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/de3/cec d0/d3/d10/d21/d4a/d52/d82/d96/dc1/c13b 0 2024-09-18T12:52:17.431 INFO:tasks.workunit.client.0.smithi045.stdout:3/438: creat d0/d1e/d2c/d3a/d45/f92 x:0 0 0 2024-09-18T12:52:17.434 INFO:tasks.workunit.client.0.smithi045.stdout:2/489: link d5/d5f/da8/d61/l9b d5/d46/lad 0 2024-09-18T12:52:17.435 INFO:tasks.workunit.client.0.smithi045.stdout:6/430: creat d9/d1a/d48/d7d/f99 x:0 0 0 2024-09-18T12:52:17.437 INFO:tasks.workunit.client.0.smithi045.stdout:3/439: chown d0/d7/f10 2 1 2024-09-18T12:52:17.439 INFO:tasks.workunit.client.0.smithi045.stdout:3/440: chown d0/d22/f8e 15 1 2024-09-18T12:52:17.442 INFO:tasks.workunit.client.0.smithi045.stdout:6/431: dwrite d9/d1a/f37 [0,4194304] 0 2024-09-18T12:52:17.445 INFO:tasks.workunit.client.0.smithi045.stdout:2/490: unlink d5/d5f/da8/l17 0 2024-09-18T12:52:17.446 INFO:tasks.workunit.client.0.smithi045.stdout:2/491: dread - d5/d2c/f88 zero size 2024-09-18T12:52:17.447 INFO:tasks.workunit.client.1.smithi161.stdout:9/786: mknod d0/d47/d48/d7f/d84/c104 0 2024-09-18T12:52:17.452 INFO:tasks.workunit.client.1.smithi161.stdout:3/877: truncate d1/d2e/d14/f123 583378 0 2024-09-18T12:52:17.454 INFO:tasks.workunit.client.0.smithi045.stdout:2/492: rmdir d5 39 2024-09-18T12:52:17.455 INFO:tasks.workunit.client.1.smithi161.stdout:4/929: dread d5/d27/f66 [4194304,4194304] 0 2024-09-18T12:52:17.456 INFO:tasks.workunit.client.1.smithi161.stdout:2/922: truncate d0/d71/da9/dd6/df7/f10b 2570016 0 2024-09-18T12:52:17.457 INFO:tasks.workunit.client.0.smithi045.stdout:6/432: dwrite d9/d1a/d2d/d38/d5b/f61 [4194304,4194304] 0 2024-09-18T12:52:17.457 INFO:tasks.workunit.client.1.smithi161.stdout:4/930: read d5/d14/d67/f76 [645089,103584] 0 2024-09-18T12:52:17.458 INFO:tasks.workunit.client.1.smithi161.stdout:7/800: link d3/d8/d15/d99/db0/le7 d3/d83/lf2 0 2024-09-18T12:52:17.460 INFO:tasks.workunit.client.1.smithi161.stdout:4/931: dread d5/f20 [0,4194304] 0 2024-09-18T12:52:17.464 INFO:tasks.workunit.client.0.smithi045.stdout:2/493: truncate d5/d5f/da8/d61/f89 1760076 0 2024-09-18T12:52:17.465 INFO:tasks.workunit.client.1.smithi161.stdout:3/878: rmdir d1/d2e/d68/de8/df6 39 2024-09-18T12:52:17.466 INFO:tasks.workunit.client.0.smithi045.stdout:2/494: chown d5/d2c/c8d 8678489 1 2024-09-18T12:52:17.474 INFO:tasks.workunit.client.0.smithi045.stdout:2/495: creat d5/d5f/da8/d91/fae x:0 0 0 2024-09-18T12:52:17.476 INFO:tasks.workunit.client.0.smithi045.stdout:6/433: link d9/d1a/d48/l65 d9/d30/l9a 0 2024-09-18T12:52:17.476 INFO:tasks.workunit.client.0.smithi045.stdout:2/496: dread - d5/d5f/da8/d61/f96 zero size 2024-09-18T12:52:17.480 INFO:tasks.workunit.client.0.smithi045.stdout:3/441: dwrite d0/d1e/d2c/f42 [0,4194304] 0 2024-09-18T12:52:17.481 INFO:tasks.workunit.client.0.smithi045.stdout:3/442: write d0/d1e/d2c/f82 [561296,92677] 0 2024-09-18T12:52:17.482 INFO:tasks.workunit.client.0.smithi045.stdout:6/434: dread - d9/f45 zero size 2024-09-18T12:52:17.484 INFO:tasks.workunit.client.0.smithi045.stdout:6/435: fdatasync d9/d1a/d1d/f84 0 2024-09-18T12:52:17.485 INFO:tasks.workunit.client.1.smithi161.stdout:2/923: dread d0/d5/d43/d35/d98/ddf/f59 [0,4194304] 0 2024-09-18T12:52:17.487 INFO:tasks.workunit.client.0.smithi045.stdout:2/497: creat d5/d2c/d4d/d76/faf x:0 0 0 2024-09-18T12:52:17.488 INFO:tasks.workunit.client.1.smithi161.stdout:6/960: getdents d4/d39/d47/d88 0 2024-09-18T12:52:17.489 INFO:tasks.workunit.client.0.smithi045.stdout:3/443: creat d0/d1e/d2c/d3f/d44/f93 x:0 0 0 2024-09-18T12:52:17.490 INFO:tasks.workunit.client.1.smithi161.stdout:9/787: creat d0/d20/d74/ded/d102/f105 x:0 0 0 2024-09-18T12:52:17.491 INFO:tasks.workunit.client.0.smithi045.stdout:3/444: chown d0/d1e/d2c/d3f/c5e 26 1 2024-09-18T12:52:17.492 INFO:tasks.workunit.client.1.smithi161.stdout:5/888: rename d3/d44/d6f/dca/d10d/dd7/de7 to d3/d44/d120 0 2024-09-18T12:52:17.493 INFO:tasks.workunit.client.1.smithi161.stdout:3/879: creat d1/d2e/d14/d2c/d72/f12a x:0 0 0 2024-09-18T12:52:17.494 INFO:tasks.workunit.client.0.smithi045.stdout:2/498: dwrite d5/d2c/d4d/d76/fa7 [0,4194304] 0 2024-09-18T12:52:17.494 INFO:tasks.workunit.client.0.smithi045.stdout:6/436: rename d9/d1a/d2d/f7f to d9/d1a/d48/d8f/f9b 0 2024-09-18T12:52:17.496 INFO:tasks.workunit.client.1.smithi161.stdout:8/917: creat d0/f13c x:0 0 0 2024-09-18T12:52:17.499 INFO:tasks.workunit.client.0.smithi045.stdout:3/445: symlink d0/d1e/d2c/d3a/d45/l94 0 2024-09-18T12:52:17.499 INFO:tasks.workunit.client.0.smithi045.stdout:3/446: dread - d0/d29/d53/f7e zero size 2024-09-18T12:52:17.504 INFO:tasks.workunit.client.1.smithi161.stdout:0/902: link df/d30/d71/dfe/c129 df/d30/d71/d96/dd3/d90/d37/de0/c13d 0 2024-09-18T12:52:17.506 INFO:tasks.workunit.client.1.smithi161.stdout:2/924: mkdir d0/d5/d43/d23/d136/d9b/d139 0 2024-09-18T12:52:17.507 INFO:tasks.workunit.client.1.smithi161.stdout:6/961: rmdir d4/d61/d69 39 2024-09-18T12:52:17.515 INFO:tasks.workunit.client.1.smithi161.stdout:4/932: symlink d5/d14/d67/dc7/d47/dbc/d127/l153 0 2024-09-18T12:52:17.515 INFO:tasks.workunit.client.1.smithi161.stdout:5/889: rmdir d3/d3b/d54 39 2024-09-18T12:52:17.515 INFO:tasks.workunit.client.1.smithi161.stdout:3/880: unlink d1/d2e/d68/f114 0 2024-09-18T12:52:17.516 INFO:tasks.workunit.client.1.smithi161.stdout:8/918: fsync d0/d3/d10/d21/f49 0 2024-09-18T12:52:17.516 INFO:tasks.workunit.client.1.smithi161.stdout:0/903: rename df/d30/d71/d96/dd3/c10c to df/d98/c13e 0 2024-09-18T12:52:17.516 INFO:tasks.workunit.client.1.smithi161.stdout:4/933: readlink d5/d14/d6d/l94 0 2024-09-18T12:52:17.516 INFO:tasks.workunit.client.1.smithi161.stdout:2/925: mknod d0/d5/d43/d23/ded/c13a 0 2024-09-18T12:52:17.518 INFO:tasks.workunit.client.1.smithi161.stdout:2/926: write d0/d5/d43/d35/d98/de1/f120 [833168,102476] 0 2024-09-18T12:52:17.529 INFO:tasks.workunit.client.1.smithi161.stdout:5/890: dread d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/da4/daf/fb2 [0,4194304] 0 2024-09-18T12:52:17.530 INFO:tasks.workunit.client.1.smithi161.stdout:5/891: readlink d3/d44/d6f/dca/d10d/d85/dd3/lf0 0 2024-09-18T12:52:17.532 INFO:tasks.workunit.client.0.smithi045.stdout:6/437: link d9/d1a/d1d/f25 d9/d1a/d48/d97/f9c 0 2024-09-18T12:52:17.535 INFO:tasks.workunit.client.0.smithi045.stdout:3/447: mkdir d0/d1e/d91/d95 0 2024-09-18T12:52:17.540 INFO:tasks.workunit.client.0.smithi045.stdout:6/438: dwrite d9/d56/f8b [0,4194304] 0 2024-09-18T12:52:17.541 INFO:tasks.workunit.client.0.smithi045.stdout:2/499: dwrite d5/d2c/d4d/d33/f55 [0,4194304] 0 2024-09-18T12:52:17.546 INFO:tasks.workunit.client.0.smithi045.stdout:6/439: dwrite d9/d1a/f37 [0,4194304] 0 2024-09-18T12:52:17.548 INFO:tasks.workunit.client.0.smithi045.stdout:6/440: read - d9/d1a/d1d/f84 zero size 2024-09-18T12:52:17.550 INFO:tasks.workunit.client.1.smithi161.stdout:7/801: truncate d3/d50/fba 378394 0 2024-09-18T12:52:17.559 INFO:tasks.workunit.client.0.smithi045.stdout:2/500: creat d5/d2c/d6f/d9d/fb0 x:0 0 0 2024-09-18T12:52:17.563 INFO:tasks.workunit.client.0.smithi045.stdout:6/441: rename d9/f64 to d9/d1a/d48/f9d 0 2024-09-18T12:52:17.564 INFO:tasks.workunit.client.0.smithi045.stdout:2/501: chown d5/d2c/d4d/d33/l39 473847654 1 2024-09-18T12:52:17.566 INFO:tasks.workunit.client.0.smithi045.stdout:6/442: mknod d9/d1a/d2d/d32/c9e 0 2024-09-18T12:52:17.566 INFO:tasks.workunit.client.0.smithi045.stdout:6/443: stat d9/l60 0 2024-09-18T12:52:17.571 INFO:tasks.workunit.client.0.smithi045.stdout:2/502: dwrite d5/d5f/da8/fa1 [0,4194304] 0 2024-09-18T12:52:17.580 INFO:tasks.workunit.client.0.smithi045.stdout:2/503: dwrite d5/d5f/f99 [0,4194304] 0 2024-09-18T12:52:17.585 INFO:tasks.workunit.client.0.smithi045.stdout:3/448: truncate d0/d22/f3d 140071 0 2024-09-18T12:52:17.588 INFO:tasks.workunit.client.1.smithi161.stdout:6/962: unlink d4/d1a/d1c/d3e/d4d/faf 0 2024-09-18T12:52:17.590 INFO:tasks.workunit.client.0.smithi045.stdout:3/449: dread d0/d1e/d2c/f82 [0,4194304] 0 2024-09-18T12:52:17.596 INFO:tasks.workunit.client.1.smithi161.stdout:0/904: creat df/de2/dc5/d86/f13f x:0 0 0 2024-09-18T12:52:17.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/919: creat d0/d3/d10/d21/d4a/d52/d82/d96/dba/f13d x:0 0 0 2024-09-18T12:52:17.604 INFO:tasks.workunit.client.1.smithi161.stdout:8/920: dwrite d0/d3/d10/d21/d4a/d52/d82/d96/f72 [0,4194304] 0 2024-09-18T12:52:17.607 INFO:tasks.workunit.client.1.smithi161.stdout:7/802: dwrite d3/d50/f66 [0,4194304] 0 2024-09-18T12:52:17.612 INFO:tasks.workunit.client.0.smithi045.stdout:3/450: dread d0/d29/f67 [0,4194304] 0 2024-09-18T12:52:17.614 INFO:tasks.workunit.client.1.smithi161.stdout:2/927: mkdir d0/d1/deb/d13b 0 2024-09-18T12:52:17.620 INFO:tasks.workunit.client.1.smithi161.stdout:3/881: creat d1/d2e/d68/d92/dba/f12b x:0 0 0 2024-09-18T12:52:17.623 INFO:tasks.workunit.client.1.smithi161.stdout:4/934: write d5/f20 [851911,105780] 0 2024-09-18T12:52:17.624 INFO:tasks.workunit.client.1.smithi161.stdout:8/921: readlink d0/d3/d10/d21/d4a/lb2 0 2024-09-18T12:52:17.628 INFO:tasks.workunit.client.1.smithi161.stdout:5/892: getdents d3/d44/d6f/dca 0 2024-09-18T12:52:17.631 INFO:tasks.workunit.client.1.smithi161.stdout:8/922: creat d0/d3/d10/d21/d11e/f13e x:0 0 0 2024-09-18T12:52:17.631 INFO:tasks.workunit.client.1.smithi161.stdout:5/893: chown d3/d44/d6f/dca/d10d/d4b/d8e/d24/d61/lf5 1 1 2024-09-18T12:52:17.632 INFO:tasks.workunit.client.1.smithi161.stdout:0/905: write df/d98/d128/dba/f105 [472128,68480] 0 2024-09-18T12:52:17.633 INFO:tasks.workunit.client.1.smithi161.stdout:3/882: symlink d1/d2e/d14/d2c/d129/l12c 0 2024-09-18T12:52:17.634 INFO:tasks.workunit.client.1.smithi161.stdout:6/963: dwrite d4/d61/fd3 [0,4194304] 0 2024-09-18T12:52:17.634 INFO:tasks.workunit.client.0.smithi045.stdout:3/451: truncate d0/fe 725030 0 2024-09-18T12:52:17.635 INFO:tasks.workunit.client.0.smithi045.stdout:3/452: write d0/d1e/d2c/f42 [4565867,60351] 0 2024-09-18T12:52:17.640 INFO:tasks.workunit.client.1.smithi161.stdout:8/923: mknod d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/c13f 0 2024-09-18T12:52:17.640 INFO:tasks.workunit.client.1.smithi161.stdout:6/964: mknod d4/d1a/d1c/d3e/d83/c141 0 2024-09-18T12:52:17.641 INFO:tasks.workunit.client.1.smithi161.stdout:4/935: link d5/d14/d67/dc7/d9b/ld3 d5/d27/d44/de2/d122/l154 0 2024-09-18T12:52:17.642 INFO:tasks.workunit.client.1.smithi161.stdout:2/928: getdents d0/d1/d4c/d67 0 2024-09-18T12:52:17.644 INFO:tasks.workunit.client.1.smithi161.stdout:5/894: creat d3/d44/f121 x:0 0 0 2024-09-18T12:52:17.647 INFO:tasks.workunit.client.1.smithi161.stdout:2/929: write d0/d5/d43/d35/fa3 [2232647,114496] 0 2024-09-18T12:52:17.649 INFO:tasks.workunit.client.1.smithi161.stdout:3/883: dwrite d1/d2e/d68/de8/df6/f11a [0,4194304] 0 2024-09-18T12:52:17.649 INFO:tasks.workunit.client.1.smithi161.stdout:8/924: getdents d0/d3 0 2024-09-18T12:52:17.653 INFO:tasks.workunit.client.1.smithi161.stdout:6/965: mkdir d4/d1a/d1c/d3e/d83/d9e/db1/d28/d81/df4/d142 0 2024-09-18T12:52:17.654 INFO:tasks.workunit.client.1.smithi161.stdout:2/930: creat d0/d5/d43/d23/f13c x:0 0 0 2024-09-18T12:52:17.655 INFO:tasks.workunit.client.1.smithi161.stdout:2/931: chown d0/d5/d43/d23/d136/l6f 657 1 2024-09-18T12:52:17.657 INFO:tasks.workunit.client.1.smithi161.stdout:3/884: write d1/d2e/d24/d1d/d89/fc7 [1559066,125194] 0 2024-09-18T12:52:17.659 INFO:tasks.workunit.client.1.smithi161.stdout:5/895: truncate d3/def/f3c 6151409 0 2024-09-18T12:52:17.660 INFO:tasks.workunit.client.1.smithi161.stdout:5/896: stat d3/d8/f73 0 2024-09-18T12:52:17.661 INFO:tasks.workunit.client.1.smithi161.stdout:4/936: rename d5/d27 to d5/d14/d67/dc7/d60/d95/dda/d155 0 2024-09-18T12:52:17.661 INFO:tasks.workunit.client.1.smithi161.stdout:5/897: read d3/d44/d6f/dca/d10d/d11b/fd8 [11092,68555] 0 2024-09-18T12:52:17.662 INFO:tasks.workunit.client.1.smithi161.stdout:2/932: mknod d0/d1/deb/d3d/c13d 0 2024-09-18T12:52:17.663 INFO:tasks.workunit.client.1.smithi161.stdout:3/885: mknod d1/d2e/d24/d84/d9a/c12d 0 2024-09-18T12:52:17.666 INFO:tasks.workunit.client.1.smithi161.stdout:6/966: mknod d4/d39/d26/d101/c143 0 2024-09-18T12:52:17.666 INFO:tasks.workunit.client.1.smithi161.stdout:5/898: creat d3/d8/de4/d8d/db0/f122 x:0 0 0 2024-09-18T12:52:17.666 INFO:tasks.workunit.client.1.smithi161.stdout:4/937: truncate d5/d14/d5f/f75 1600885 0 2024-09-18T12:52:17.667 INFO:tasks.workunit.client.1.smithi161.stdout:6/967: write d4/d39/d47/f110 [331667,32319] 0 2024-09-18T12:52:17.668 INFO:tasks.workunit.client.1.smithi161.stdout:2/933: symlink d0/d71/da9/d9f/dfe/l13e 0 2024-09-18T12:52:17.669 INFO:tasks.workunit.client.1.smithi161.stdout:0/906: dwrite df/de2/dc5/fdb [0,4194304] 0 2024-09-18T12:52:17.670 INFO:tasks.workunit.client.1.smithi161.stdout:3/886: read - d1/d2e/d68/d92/fac zero size 2024-09-18T12:52:17.671 INFO:tasks.workunit.client.1.smithi161.stdout:5/899: fsync d3/d44/d6f/dca/d10d/d4b/d8e/d24/d61/fc6 0 2024-09-18T12:52:17.672 INFO:tasks.workunit.client.1.smithi161.stdout:0/907: chown df/de2/dc5/d86/f75 56 1 2024-09-18T12:52:17.675 INFO:tasks.workunit.client.1.smithi161.stdout:2/934: creat d0/d5/d43/d23/d136/d9b/f13f x:0 0 0 2024-09-18T12:52:17.676 INFO:tasks.workunit.client.1.smithi161.stdout:6/968: symlink d4/d61/l144 0 2024-09-18T12:52:17.679 INFO:tasks.workunit.client.1.smithi161.stdout:6/969: write d4/f11d [8823097,112918] 0 2024-09-18T12:52:17.682 INFO:tasks.workunit.client.1.smithi161.stdout:6/970: symlink d4/d1a/d1c/d3e/d83/d9e/db1/l145 0 2024-09-18T12:52:17.684 INFO:tasks.workunit.client.1.smithi161.stdout:3/887: dwrite d1/d2e/d14/d65/d76/d8c/f8d [0,4194304] 0 2024-09-18T12:52:17.687 INFO:tasks.workunit.client.1.smithi161.stdout:4/938: write d5/d32/f45 [1303755,14347] 0 2024-09-18T12:52:17.690 INFO:tasks.workunit.client.1.smithi161.stdout:4/939: write d5/d14/d67/dc7/d60/d95/f13d [1041265,24510] 0 2024-09-18T12:52:17.691 INFO:tasks.workunit.client.1.smithi161.stdout:3/888: mknod d1/d2e/d14/d78/c12e 0 2024-09-18T12:52:17.692 INFO:tasks.workunit.client.1.smithi161.stdout:6/971: dread d4/d1a/d1c/d3e/d83/d9e/db1/d28/f94 [0,4194304] 0 2024-09-18T12:52:17.693 INFO:tasks.workunit.client.0.smithi045.stdout:1/418: sync 2024-09-18T12:52:17.693 INFO:tasks.workunit.client.0.smithi045.stdout:1/419: chown d0/d2d/f34 1814335 1 2024-09-18T12:52:17.693 INFO:tasks.workunit.client.1.smithi161.stdout:6/972: fdatasync d4/d39/d48/f121 0 2024-09-18T12:52:17.695 INFO:tasks.workunit.client.0.smithi045.stdout:1/420: symlink d0/d2d/l7d 0 2024-09-18T12:52:17.695 INFO:tasks.workunit.client.1.smithi161.stdout:4/940: creat d5/d14/d67/dc7/f156 x:0 0 0 2024-09-18T12:52:17.695 INFO:tasks.workunit.client.1.smithi161.stdout:6/973: chown d4/d61/d9d/da3/l115 56 1 2024-09-18T12:52:17.699 INFO:tasks.workunit.client.1.smithi161.stdout:4/941: getdents d5/d14/d67/dc7/d60/d95/dda/d155/d44 0 2024-09-18T12:52:17.702 INFO:tasks.workunit.client.1.smithi161.stdout:5/900: dread d3/d44/d6f/dca/d10d/d4b/d8e/fa1 [0,4194304] 0 2024-09-18T12:52:17.703 INFO:tasks.workunit.client.1.smithi161.stdout:4/942: truncate d5/d14/d67/dc7/d4c/fa0 850701 0 2024-09-18T12:52:17.704 INFO:tasks.workunit.client.1.smithi161.stdout:3/889: write d1/d2e/d14/d90/f95 [1371779,69832] 0 2024-09-18T12:52:17.705 INFO:tasks.workunit.client.1.smithi161.stdout:4/943: mkdir d5/da9/d157 0 2024-09-18T12:52:17.705 INFO:tasks.workunit.client.1.smithi161.stdout:4/944: stat d5/d14/c18 0 2024-09-18T12:52:17.707 INFO:tasks.workunit.client.1.smithi161.stdout:5/901: truncate d3/d44/d6f/dca/d10d/d4b/d8e/d24/d61/fe5 647382 0 2024-09-18T12:52:17.707 INFO:tasks.workunit.client.1.smithi161.stdout:4/945: rmdir d5/d14/d5f 39 2024-09-18T12:52:17.710 INFO:tasks.workunit.client.1.smithi161.stdout:3/890: creat d1/d2e/d68/de8/f12f x:0 0 0 2024-09-18T12:52:17.710 INFO:tasks.workunit.client.0.smithi045.stdout:1/421: dread d0/d2d/d2b/f2f [0,4194304] 0 2024-09-18T12:52:17.713 INFO:tasks.workunit.client.1.smithi161.stdout:5/902: truncate d3/d44/d6f/dca/d10d/d4b/d8e/d24/d61/de6/f11e 1003398 0 2024-09-18T12:52:17.713 INFO:tasks.workunit.client.1.smithi161.stdout:0/908: dread df/d29/fc0 [0,4194304] 0 2024-09-18T12:52:17.714 INFO:tasks.workunit.client.1.smithi161.stdout:3/891: symlink d1/d2e/d14/d2c/l130 0 2024-09-18T12:52:17.715 INFO:tasks.workunit.client.1.smithi161.stdout:0/909: write df/d29/fa2 [1064073,14575] 0 2024-09-18T12:52:17.716 INFO:tasks.workunit.client.1.smithi161.stdout:4/946: dwrite d5/d14/d67/d84/d113/f114 [0,4194304] 0 2024-09-18T12:52:17.717 INFO:tasks.workunit.client.1.smithi161.stdout:5/903: chown d3/d44/d6f/dca/d10d/d4b/d8e/d24/lc2 0 1 2024-09-18T12:52:17.717 INFO:tasks.workunit.client.1.smithi161.stdout:3/892: chown d1/d2e/d14/c97 4 1 2024-09-18T12:52:17.721 INFO:tasks.workunit.client.1.smithi161.stdout:5/904: chown d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/da4/daf/fb2 51 1 2024-09-18T12:52:17.722 INFO:tasks.workunit.client.1.smithi161.stdout:3/893: unlink d1/d2e/d68/d69/ff9 0 2024-09-18T12:52:17.722 INFO:tasks.workunit.client.1.smithi161.stdout:4/947: dread - d5/d14/d5f/da1/de9/f150 zero size 2024-09-18T12:52:17.724 INFO:tasks.workunit.client.1.smithi161.stdout:4/948: stat d5/d14/d67/dc7/d60/d95/dda/de8/c14d 0 2024-09-18T12:52:17.725 INFO:tasks.workunit.client.1.smithi161.stdout:4/949: fdatasync d5/d14/d67/d84/d120/f13a 0 2024-09-18T12:52:17.727 INFO:tasks.workunit.client.1.smithi161.stdout:3/894: mkdir d1/d2e/d68/d131 0 2024-09-18T12:52:17.727 INFO:tasks.workunit.client.0.smithi045.stdout:1/422: dread d0/f23 [0,4194304] 0 2024-09-18T12:52:17.730 INFO:tasks.workunit.client.0.smithi045.stdout:1/423: rmdir d0/d2d/d2b/d30/d3d/d5b 39 2024-09-18T12:52:17.730 INFO:tasks.workunit.client.0.smithi045.stdout:1/424: readlink d0/l14 0 2024-09-18T12:52:17.734 INFO:tasks.workunit.client.1.smithi161.stdout:0/910: truncate df/d30/d71/d96/dd3/d90/d37/de0/f115 5405358 0 2024-09-18T12:52:17.736 INFO:tasks.workunit.client.1.smithi161.stdout:3/895: symlink d1/d2e/d68/d92/dba/dd9/l132 0 2024-09-18T12:52:17.736 INFO:tasks.workunit.client.0.smithi045.stdout:1/425: getdents d0/d12/d32 0 2024-09-18T12:52:17.740 INFO:tasks.workunit.client.1.smithi161.stdout:5/905: dwrite d3/d3b/d7b/d82/f9d [0,4194304] 0 2024-09-18T12:52:17.741 INFO:tasks.workunit.client.1.smithi161.stdout:0/911: rename df/de2/dc5/dca/f139 to df/d30/d71/d96/dd3/d51/dc9/f140 0 2024-09-18T12:52:17.742 INFO:tasks.workunit.client.1.smithi161.stdout:4/950: dwrite d5/d14/d67/dc7/d47/d49/f85 [0,4194304] 0 2024-09-18T12:52:17.749 INFO:tasks.workunit.client.0.smithi045.stdout:1/426: dwrite d0/f49 [0,4194304] 0 2024-09-18T12:52:17.752 INFO:tasks.workunit.client.1.smithi161.stdout:3/896: dwrite d1/d2e/d24/f1f [0,4194304] 0 2024-09-18T12:52:17.752 INFO:tasks.workunit.client.1.smithi161.stdout:0/912: dwrite df/d29/d36/fbb [0,4194304] 0 2024-09-18T12:52:17.755 INFO:tasks.workunit.client.0.smithi045.stdout:1/427: creat d0/d12/d32/d67/d6d/f7e x:0 0 0 2024-09-18T12:52:17.759 INFO:tasks.workunit.client.0.smithi045.stdout:1/428: symlink d0/d2d/d2b/d30/d40/d60/l7f 0 2024-09-18T12:52:17.761 INFO:tasks.workunit.client.1.smithi161.stdout:3/897: fsync d1/d2e/d68/d92/ded/d49/fde 0 2024-09-18T12:52:17.762 INFO:tasks.workunit.client.0.smithi045.stdout:1/429: fdatasync d0/d2d/d2b/f52 0 2024-09-18T12:52:17.763 INFO:tasks.workunit.client.1.smithi161.stdout:5/906: truncate d3/fa0 763629 0 2024-09-18T12:52:17.766 INFO:tasks.workunit.client.1.smithi161.stdout:3/898: fdatasync d1/d2e/d68/d92/ded/d49/fde 0 2024-09-18T12:52:17.769 INFO:tasks.workunit.client.1.smithi161.stdout:0/913: write df/d30/d71/d96/dd3/d51/ff3 [218317,7566] 0 2024-09-18T12:52:17.769 INFO:tasks.workunit.client.1.smithi161.stdout:3/899: creat d1/d2e/d14/d2c/de5/f133 x:0 0 0 2024-09-18T12:52:17.778 INFO:tasks.workunit.client.0.smithi045.stdout:1/430: dread d0/d12/f3b [0,4194304] 0 2024-09-18T12:52:17.779 INFO:tasks.workunit.client.1.smithi161.stdout:3/900: dwrite d1/d2e/d68/d69/ff2 [0,4194304] 0 2024-09-18T12:52:17.779 INFO:tasks.workunit.client.1.smithi161.stdout:0/914: dread df/d30/d71/f87 [0,4194304] 0 2024-09-18T12:52:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:17 smithi045 ceph-mon[28315]: pgmap v31: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 102 MiB/s rd, 286 MiB/s wr, 520 op/s 2024-09-18T12:52:17.784 INFO:tasks.workunit.client.1.smithi161.stdout:3/901: rename d1/d2e/d14/d2c/d72 to d1/d2e/d14/d65/d76/d8c/de0/d134 0 2024-09-18T12:52:17.784 INFO:tasks.workunit.client.1.smithi161.stdout:5/907: dread d3/d44/d6f/dca/d10d/f38 [0,4194304] 0 2024-09-18T12:52:17.787 INFO:tasks.workunit.client.0.smithi045.stdout:1/431: dwrite d0/f49 [4194304,4194304] 0 2024-09-18T12:52:17.791 INFO:tasks.workunit.client.1.smithi161.stdout:5/908: mknod d3/d44/d6f/c123 0 2024-09-18T12:52:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:17 smithi161 ceph-mon[35784]: pgmap v31: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 102 MiB/s rd, 286 MiB/s wr, 520 op/s 2024-09-18T12:52:17.794 INFO:tasks.workunit.client.1.smithi161.stdout:0/915: link df/l5a df/d30/d4d/l141 0 2024-09-18T12:52:17.795 INFO:tasks.workunit.client.1.smithi161.stdout:0/916: fsync df/d98/d128/dba/f105 0 2024-09-18T12:52:17.796 INFO:tasks.workunit.client.0.smithi045.stdout:1/432: rename d0/d2d/d2b/d30/d40/d60/f74 to d0/d12/f80 0 2024-09-18T12:52:17.797 INFO:tasks.workunit.client.0.smithi045.stdout:1/433: fdatasync d0/f7 0 2024-09-18T12:52:17.799 INFO:tasks.workunit.client.1.smithi161.stdout:5/909: creat d3/d44/ddc/f124 x:0 0 0 2024-09-18T12:52:17.800 INFO:tasks.workunit.client.1.smithi161.stdout:5/910: dread - d3/d3b/d7b/da6/f108 zero size 2024-09-18T12:52:17.802 INFO:tasks.workunit.client.0.smithi045.stdout:1/434: mknod d0/d12/d32/c81 0 2024-09-18T12:52:17.805 INFO:tasks.workunit.client.0.smithi045.stdout:1/435: dread d0/d2d/d2b/f2f [0,4194304] 0 2024-09-18T12:52:17.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/902: getdents d1/d2e/d14/d78 0 2024-09-18T12:52:17.806 INFO:tasks.workunit.client.0.smithi045.stdout:1/436: dread - d0/d12/d32/d67/d6d/f72 zero size 2024-09-18T12:52:17.807 INFO:tasks.workunit.client.0.smithi045.stdout:1/437: dread - d0/d2d/f68 zero size 2024-09-18T12:52:17.808 INFO:tasks.workunit.client.1.smithi161.stdout:5/911: rmdir d3/d3b/d7b/de3 0 2024-09-18T12:52:17.809 INFO:tasks.workunit.client.1.smithi161.stdout:0/917: link df/d30/d71/d96/dd3/d90/l83 df/d30/d71/d96/dd3/d90/d37/l142 0 2024-09-18T12:52:17.810 INFO:tasks.workunit.client.0.smithi045.stdout:1/438: fdatasync d0/f2 0 2024-09-18T12:52:17.811 INFO:tasks.workunit.client.1.smithi161.stdout:0/918: write df/d30/d71/d96/dd3/d90/d37/dad/f11b [715763,52278] 0 2024-09-18T12:52:17.812 INFO:tasks.workunit.client.0.smithi045.stdout:1/439: mknod d0/c82 0 2024-09-18T12:52:17.813 INFO:tasks.workunit.client.1.smithi161.stdout:0/919: mkdir df/d30/d71/d96/d143 0 2024-09-18T12:52:17.816 INFO:tasks.workunit.client.1.smithi161.stdout:0/920: symlink df/d30/d71/d96/l144 0 2024-09-18T12:52:17.816 INFO:tasks.workunit.client.1.smithi161.stdout:5/912: link d3/d44/d6f/dca/d10d/cbb d3/d8/df1/c125 0 2024-09-18T12:52:17.818 INFO:tasks.workunit.client.1.smithi161.stdout:5/913: readlink d3/d44/d6f/dca/d10d/d85/dd3/lf9 0 2024-09-18T12:52:17.820 INFO:tasks.workunit.client.1.smithi161.stdout:5/914: mknod d3/def/c126 0 2024-09-18T12:52:17.822 INFO:tasks.workunit.client.1.smithi161.stdout:5/915: chown d3/d44/d6f/cb5 47512175 1 2024-09-18T12:52:17.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/921: dwrite fd [0,4194304] 0 2024-09-18T12:52:17.823 INFO:tasks.workunit.client.1.smithi161.stdout:1/779: sync 2024-09-18T12:52:17.824 INFO:tasks.workunit.client.1.smithi161.stdout:9/788: sync 2024-09-18T12:52:17.824 INFO:tasks.workunit.client.1.smithi161.stdout:0/922: fsync df/d30/d71/d96/fb8 0 2024-09-18T12:52:17.825 INFO:tasks.workunit.client.1.smithi161.stdout:5/916: truncate d3/d8/f59 1637712 0 2024-09-18T12:52:17.826 INFO:tasks.workunit.client.1.smithi161.stdout:0/923: write df/f32 [7288292,3567] 0 2024-09-18T12:52:17.826 INFO:tasks.workunit.client.1.smithi161.stdout:9/789: symlink d0/db/d18/l106 0 2024-09-18T12:52:17.829 INFO:tasks.workunit.client.1.smithi161.stdout:1/780: dread d1/da/d1f/d45/d73/f92 [0,4194304] 0 2024-09-18T12:52:17.831 INFO:tasks.workunit.client.0.smithi045.stdout:1/440: dread d0/f69 [0,4194304] 0 2024-09-18T12:52:17.833 INFO:tasks.workunit.client.1.smithi161.stdout:9/790: creat d0/d47/d48/d7f/d9e/f107 x:0 0 0 2024-09-18T12:52:17.834 INFO:tasks.workunit.client.1.smithi161.stdout:5/917: getdents d3/d44/d6f/d86/dfa 0 2024-09-18T12:52:17.836 INFO:tasks.workunit.client.1.smithi161.stdout:0/924: mknod df/d30/c145 0 2024-09-18T12:52:17.837 INFO:tasks.workunit.client.1.smithi161.stdout:1/781: creat d1/da/d1f/d45/d73/f107 x:0 0 0 2024-09-18T12:52:17.838 INFO:tasks.workunit.client.1.smithi161.stdout:9/791: symlink d0/d20/d74/l108 0 2024-09-18T12:52:17.838 INFO:tasks.workunit.client.1.smithi161.stdout:5/918: rmdir d3/d8/df1 39 2024-09-18T12:52:17.839 INFO:tasks.workunit.client.1.smithi161.stdout:0/925: fsync df/d98/d128/fff 0 2024-09-18T12:52:17.839 INFO:tasks.workunit.client.1.smithi161.stdout:1/782: creat d1/da/d31/f108 x:0 0 0 2024-09-18T12:52:17.842 INFO:tasks.workunit.client.0.smithi045.stdout:1/441: dread d0/d2d/d2b/d30/d3d/f7c [0,4194304] 0 2024-09-18T12:52:17.842 INFO:tasks.workunit.client.1.smithi161.stdout:5/919: dread - d3/d44/d6f/dca/d10d/d11b/f100 zero size 2024-09-18T12:52:17.843 INFO:tasks.workunit.client.1.smithi161.stdout:5/920: chown d3/d44/ddc 186172 1 2024-09-18T12:52:17.844 INFO:tasks.workunit.client.1.smithi161.stdout:0/926: dread fd [0,4194304] 0 2024-09-18T12:52:17.845 INFO:tasks.workunit.client.0.smithi045.stdout:1/442: rename d0/d2d/f34 to d0/d2d/f83 0 2024-09-18T12:52:17.846 INFO:tasks.workunit.client.0.smithi045.stdout:1/443: readlink d0/d2d/d2b/d30/d40/d60/l7f 0 2024-09-18T12:52:17.847 INFO:tasks.workunit.client.1.smithi161.stdout:5/921: chown d3/d3b/d54/d11c/f116 111766564 1 2024-09-18T12:52:17.849 INFO:tasks.workunit.client.1.smithi161.stdout:0/927: creat df/d29/d36/d7a/f146 x:0 0 0 2024-09-18T12:52:17.851 INFO:tasks.workunit.client.1.smithi161.stdout:5/922: truncate d3/d3b/d54/fc4 297608 0 2024-09-18T12:52:17.852 INFO:tasks.workunit.client.1.smithi161.stdout:0/928: creat df/d30/d71/d96/dd3/d90/f147 x:0 0 0 2024-09-18T12:52:17.852 INFO:tasks.workunit.client.0.smithi045.stdout:1/444: dwrite d0/d12/d32/d67/d6d/f72 [0,4194304] 0 2024-09-18T12:52:17.854 INFO:tasks.workunit.client.1.smithi161.stdout:1/783: link d1/d26/dad/db6/ccc d1/d26/dad/db6/df6/c109 0 2024-09-18T12:52:17.854 INFO:tasks.workunit.client.0.smithi045.stdout:1/445: write d0/fa [3375183,106703] 0 2024-09-18T12:52:17.858 INFO:tasks.workunit.client.0.smithi045.stdout:1/446: unlink d0/d2d/d2b/d30/d3d/c4a 0 2024-09-18T12:52:17.859 INFO:tasks.workunit.client.1.smithi161.stdout:9/792: dwrite d0/db/d18/f21 [0,4194304] 0 2024-09-18T12:52:17.867 INFO:tasks.workunit.client.0.smithi045.stdout:7/401: sync 2024-09-18T12:52:17.868 INFO:tasks.workunit.client.1.smithi161.stdout:9/793: creat d0/d47/d48/d7f/d9e/da4/f109 x:0 0 0 2024-09-18T12:52:17.869 INFO:tasks.workunit.client.0.smithi045.stdout:1/447: creat d0/d2d/d2b/d30/f84 x:0 0 0 2024-09-18T12:52:17.870 INFO:tasks.workunit.client.0.smithi045.stdout:7/402: fsync d13/f17 0 2024-09-18T12:52:17.871 INFO:tasks.workunit.client.1.smithi161.stdout:5/923: dwrite d3/d8/de4/f97 [0,4194304] 0 2024-09-18T12:52:17.874 INFO:tasks.workunit.client.0.smithi045.stdout:7/403: mkdir d13/d31/d52/d8c 0 2024-09-18T12:52:17.876 INFO:tasks.workunit.client.0.smithi045.stdout:7/404: chown fd 2461248 1 2024-09-18T12:52:17.878 INFO:tasks.workunit.client.1.smithi161.stdout:1/784: dwrite d1/da/d31/f8d [0,4194304] 0 2024-09-18T12:52:17.878 INFO:tasks.workunit.client.1.smithi161.stdout:9/794: creat d0/db/f10a x:0 0 0 2024-09-18T12:52:17.879 INFO:tasks.workunit.client.0.smithi045.stdout:1/448: dwrite d0/d2d/d2b/d30/d3d/f6b [0,4194304] 0 2024-09-18T12:52:17.880 INFO:tasks.workunit.client.1.smithi161.stdout:0/929: truncate df/d30/d71/d96/dd3/d90/f4b 471573 0 2024-09-18T12:52:17.883 INFO:tasks.workunit.client.1.smithi161.stdout:0/930: truncate df/d30/d71/d96/dd3/d90/d37/dad/f11b 1214622 0 2024-09-18T12:52:17.888 INFO:tasks.workunit.client.0.smithi045.stdout:7/405: creat d13/d44/d37/f8d x:0 0 0 2024-09-18T12:52:17.888 INFO:tasks.workunit.client.0.smithi045.stdout:7/406: stat d13/d44/d4c 0 2024-09-18T12:52:17.890 INFO:tasks.workunit.client.0.smithi045.stdout:1/449: rename d0/d2d/l7d to d0/d2d/l85 0 2024-09-18T12:52:17.891 INFO:tasks.workunit.client.0.smithi045.stdout:1/450: readlink d0/d2e/l79 0 2024-09-18T12:52:17.893 INFO:tasks.workunit.client.1.smithi161.stdout:1/785: creat d1/d26/dad/f10a x:0 0 0 2024-09-18T12:52:17.897 INFO:tasks.workunit.client.1.smithi161.stdout:5/924: dwrite d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/f65 [0,4194304] 0 2024-09-18T12:52:17.897 INFO:tasks.workunit.client.0.smithi045.stdout:1/451: unlink d0/d2d/d2b/f52 0 2024-09-18T12:52:17.899 INFO:tasks.workunit.client.1.smithi161.stdout:1/786: creat d1/da/d39/f10b x:0 0 0 2024-09-18T12:52:17.900 INFO:tasks.workunit.client.1.smithi161.stdout:0/931: mknod df/de2/dc5/c148 0 2024-09-18T12:52:17.900 INFO:tasks.workunit.client.1.smithi161.stdout:1/787: chown d1/da/d31/f78 130823808 1 2024-09-18T12:52:17.901 INFO:tasks.workunit.client.1.smithi161.stdout:5/925: truncate d3/def/f32 4080855 0 2024-09-18T12:52:17.902 INFO:tasks.workunit.client.0.smithi045.stdout:7/407: getdents d13 0 2024-09-18T12:52:17.903 INFO:tasks.workunit.client.1.smithi161.stdout:5/926: chown d3/d3b/d54/f69 225066 1 2024-09-18T12:52:17.904 INFO:tasks.workunit.client.0.smithi045.stdout:1/452: mknod d0/d2d/d2b/d30/d3d/c86 0 2024-09-18T12:52:17.905 INFO:tasks.workunit.client.1.smithi161.stdout:5/927: write d3/d44/d6f/d86/fae [926562,52838] 0 2024-09-18T12:52:17.907 INFO:tasks.workunit.client.1.smithi161.stdout:1/788: dwrite d1/fba [0,4194304] 0 2024-09-18T12:52:17.908 INFO:tasks.workunit.client.0.smithi045.stdout:1/453: unlink d0/d2d/d2b/d30/d3d/f6b 0 2024-09-18T12:52:17.910 INFO:tasks.workunit.client.1.smithi161.stdout:1/789: chown d1/d26/dad/db6/df6/l103 107673945 1 2024-09-18T12:52:17.911 INFO:tasks.workunit.client.0.smithi045.stdout:5/602: sync 2024-09-18T12:52:17.911 INFO:tasks.workunit.client.0.smithi045.stdout:6/444: sync 2024-09-18T12:52:17.911 INFO:tasks.workunit.client.0.smithi045.stdout:9/442: sync 2024-09-18T12:52:17.911 INFO:tasks.workunit.client.0.smithi045.stdout:8/503: sync 2024-09-18T12:52:17.911 INFO:tasks.workunit.client.0.smithi045.stdout:2/504: sync 2024-09-18T12:52:17.911 INFO:tasks.workunit.client.0.smithi045.stdout:4/636: sync 2024-09-18T12:52:17.911 INFO:tasks.workunit.client.0.smithi045.stdout:0/518: sync 2024-09-18T12:52:17.911 INFO:tasks.workunit.client.0.smithi045.stdout:3/453: sync 2024-09-18T12:52:17.914 INFO:tasks.workunit.client.1.smithi161.stdout:1/790: fsync d1/da/d1f/dab/dd9/ffd 0 2024-09-18T12:52:17.914 INFO:tasks.workunit.client.1.smithi161.stdout:9/795: dwrite d0/d16/fcb [0,4194304] 0 2024-09-18T12:52:17.914 INFO:tasks.workunit.client.0.smithi045.stdout:5/603: chown d6/db/d19/c47 1009953 1 2024-09-18T12:52:17.914 INFO:tasks.workunit.client.0.smithi045.stdout:1/454: rename d0/f3a to d0/d12/d6f/f87 0 2024-09-18T12:52:17.915 INFO:tasks.workunit.client.0.smithi045.stdout:6/445: write d9/d1a/d48/f8d [716298,54288] 0 2024-09-18T12:52:17.917 INFO:tasks.workunit.client.0.smithi045.stdout:4/637: stat db/de/d1e/d3e/d47/d59/d7a/c8f 0 2024-09-18T12:52:17.920 INFO:tasks.workunit.client.0.smithi045.stdout:8/504: dread d11/d14/d53/d41/d57/f4a [0,4194304] 0 2024-09-18T12:52:17.920 INFO:tasks.workunit.client.1.smithi161.stdout:1/791: creat d1/da/d1f/dab/dd9/f10c x:0 0 0 2024-09-18T12:52:17.921 INFO:tasks.workunit.client.0.smithi045.stdout:4/638: dread - db/de/d1e/d3e/d9a/da2/fc1 zero size 2024-09-18T12:52:17.923 INFO:tasks.workunit.client.0.smithi045.stdout:4/639: readlink db/de/d1e/d3e/d47/l71 0 2024-09-18T12:52:17.923 INFO:tasks.workunit.client.1.smithi161.stdout:0/932: getdents df/d30/d71/d96/dd3 0 2024-09-18T12:52:17.928 INFO:tasks.workunit.client.0.smithi045.stdout:7/408: getdents d13 0 2024-09-18T12:52:17.930 INFO:tasks.workunit.client.0.smithi045.stdout:4/640: dwrite db/de/d1a/d2e/f92 [0,4194304] 0 2024-09-18T12:52:17.931 INFO:tasks.workunit.client.0.smithi045.stdout:0/519: mknod d6/d48/d5e/d39/d58/d3c/c93 0 2024-09-18T12:52:17.932 INFO:tasks.workunit.client.1.smithi161.stdout:0/933: mknod df/d30/d71/d96/dd3/d78/c149 0 2024-09-18T12:52:17.933 INFO:tasks.workunit.client.1.smithi161.stdout:0/934: stat df/d30/d4d/l7c 0 2024-09-18T12:52:17.933 INFO:tasks.workunit.client.0.smithi045.stdout:2/505: symlink d5/d5f/da8/d61/lb1 0 2024-09-18T12:52:17.934 INFO:tasks.workunit.client.1.smithi161.stdout:0/935: stat df/d30/d71/d96/dd3/lcf 0 2024-09-18T12:52:17.936 INFO:tasks.workunit.client.1.smithi161.stdout:5/928: dwrite d3/d8/f77 [0,4194304] 0 2024-09-18T12:52:17.938 INFO:tasks.workunit.client.1.smithi161.stdout:5/929: readlink d3/d44/d6f/dca/d10d/d4b/d8e/l5e 0 2024-09-18T12:52:17.939 INFO:tasks.workunit.client.1.smithi161.stdout:0/936: creat df/d29/f14a x:0 0 0 2024-09-18T12:52:17.939 INFO:tasks.workunit.client.1.smithi161.stdout:0/937: chown df/d29/dc7 8849936 1 2024-09-18T12:52:17.939 INFO:tasks.workunit.client.0.smithi045.stdout:6/446: mkdir d9/d1a/d48/d8f/d9f 0 2024-09-18T12:52:17.940 INFO:tasks.workunit.client.1.smithi161.stdout:9/796: write d0/f24 [2374368,98546] 0 2024-09-18T12:52:17.941 INFO:tasks.workunit.client.1.smithi161.stdout:0/938: chown df/d30/d71/d96/fb8 7069 1 2024-09-18T12:52:17.943 INFO:tasks.workunit.client.0.smithi045.stdout:5/604: rename d6/db/f6b to d6/dc7/fca 0 2024-09-18T12:52:17.945 INFO:tasks.workunit.client.1.smithi161.stdout:1/792: dwrite d1/d26/d88/fa3 [0,4194304] 0 2024-09-18T12:52:17.947 INFO:tasks.workunit.client.0.smithi045.stdout:8/505: mknod d11/d20/d46/c99 0 2024-09-18T12:52:17.948 INFO:tasks.workunit.client.0.smithi045.stdout:6/447: dread d9/d1a/d2d/d32/f4c [0,4194304] 0 2024-09-18T12:52:17.948 INFO:tasks.workunit.client.0.smithi045.stdout:9/443: write d0/d3/d6/f22 [1168387,62753] 0 2024-09-18T12:52:17.949 INFO:tasks.workunit.client.1.smithi161.stdout:8/925: sync 2024-09-18T12:52:17.950 INFO:tasks.workunit.client.1.smithi161.stdout:7/803: sync 2024-09-18T12:52:17.950 INFO:tasks.workunit.client.0.smithi045.stdout:8/506: write fd [650418,20605] 0 2024-09-18T12:52:17.951 INFO:tasks.workunit.client.1.smithi161.stdout:8/926: write d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/ff0 [1939379,60944] 0 2024-09-18T12:52:17.954 INFO:tasks.workunit.client.0.smithi045.stdout:7/409: creat d13/f8e x:0 0 0 2024-09-18T12:52:17.954 INFO:tasks.workunit.client.1.smithi161.stdout:5/930: mkdir d3/d3b/d54/dbd/d127 0 2024-09-18T12:52:17.959 INFO:tasks.workunit.client.1.smithi161.stdout:9/797: symlink d0/d20/l10b 0 2024-09-18T12:52:17.960 INFO:tasks.workunit.client.0.smithi045.stdout:2/506: chown d5/ca 58 1 2024-09-18T12:52:17.962 INFO:tasks.workunit.client.1.smithi161.stdout:8/927: mknod d0/d3/d10/d21/d4a/d52/d66/d5b/de0/c140 0 2024-09-18T12:52:17.963 INFO:tasks.workunit.client.1.smithi161.stdout:5/931: creat d3/d44/d120/f128 x:0 0 0 2024-09-18T12:52:17.966 INFO:tasks.workunit.client.0.smithi045.stdout:5/605: fdatasync d6/db/d19/fa3 0 2024-09-18T12:52:17.967 INFO:tasks.workunit.client.0.smithi045.stdout:5/606: readlink d6/d28/l2e 0 2024-09-18T12:52:17.967 INFO:tasks.workunit.client.1.smithi161.stdout:0/939: link df/d30/d4d/l6f df/de2/dc5/d89/d131/l14b 0 2024-09-18T12:52:17.968 INFO:tasks.workunit.client.1.smithi161.stdout:0/940: chown df/de2/dc5/l97 5893622 1 2024-09-18T12:52:17.970 INFO:tasks.workunit.client.1.smithi161.stdout:8/928: creat d0/d3/d10/d21/d4a/d52/d66/d5b/de0/f141 x:0 0 0 2024-09-18T12:52:17.970 INFO:tasks.workunit.client.1.smithi161.stdout:1/793: dwrite d1/d1d/f21 [0,4194304] 0 2024-09-18T12:52:17.972 INFO:tasks.workunit.client.1.smithi161.stdout:5/932: mknod d3/d44/d6f/dca/d10d/dd7/c129 0 2024-09-18T12:52:17.973 INFO:tasks.workunit.client.1.smithi161.stdout:9/798: mknod d0/d47/df1/c10c 0 2024-09-18T12:52:17.973 INFO:tasks.workunit.client.0.smithi045.stdout:6/448: creat d9/d1a/d2d/d38/d5b/fa0 x:0 0 0 2024-09-18T12:52:17.974 INFO:tasks.workunit.client.1.smithi161.stdout:9/799: read d0/d20/d49/d65/fb7 [693957,70012] 0 2024-09-18T12:52:17.975 INFO:tasks.workunit.client.1.smithi161.stdout:9/800: fdatasync d0/d93/da0/fff 0 2024-09-18T12:52:17.976 INFO:tasks.workunit.client.1.smithi161.stdout:1/794: unlink d1/daa/fe9 0 2024-09-18T12:52:17.977 INFO:tasks.workunit.client.1.smithi161.stdout:8/929: symlink d0/d3/d10/d21/d4a/d52/d66/d5b/de0/l142 0 2024-09-18T12:52:17.978 INFO:tasks.workunit.client.0.smithi045.stdout:4/641: mkdir db/d2c/d35/dcc/dd0 0 2024-09-18T12:52:17.980 INFO:tasks.workunit.client.1.smithi161.stdout:5/933: rmdir d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/d9f 39 2024-09-18T12:52:17.980 INFO:tasks.workunit.client.1.smithi161.stdout:5/934: stat d3/d3b/f98 0 2024-09-18T12:52:17.981 INFO:tasks.workunit.client.0.smithi045.stdout:0/520: mknod d6/d48/d5e/c94 0 2024-09-18T12:52:17.985 INFO:tasks.workunit.client.1.smithi161.stdout:9/801: rename d0 to d0/d16/d25/d28/d10d 22 2024-09-18T12:52:17.985 INFO:tasks.workunit.client.0.smithi045.stdout:2/507: rename d5/d2c/d4d/d33 to d5/d5f/db2 0 2024-09-18T12:52:17.987 INFO:tasks.workunit.client.1.smithi161.stdout:1/795: mkdir d1/da/d1f/d6b/dd2/d10d 0 2024-09-18T12:52:17.987 INFO:tasks.workunit.client.1.smithi161.stdout:1/796: chown d1/da/d1f/fae 234453716 1 2024-09-18T12:52:17.988 INFO:tasks.workunit.client.0.smithi045.stdout:8/507: dwrite d11/d76/f88 [0,4194304] 0 2024-09-18T12:52:17.989 INFO:tasks.workunit.client.0.smithi045.stdout:8/508: chown d11/d23/f2b 29 1 2024-09-18T12:52:17.990 INFO:tasks.workunit.client.0.smithi045.stdout:9/444: creat d0/d3/d6/d64/d88/f8c x:0 0 0 2024-09-18T12:52:17.994 INFO:tasks.workunit.client.1.smithi161.stdout:5/935: rename d3/d8/l76 to d3/d3b/d54/d11c/l12a 0 2024-09-18T12:52:17.996 INFO:tasks.workunit.client.0.smithi045.stdout:3/454: getdents d0/d1e/d2c 0 2024-09-18T12:52:17.997 INFO:tasks.workunit.client.0.smithi045.stdout:8/509: dwrite d11/d14/d72/f8d [0,4194304] 0 2024-09-18T12:52:17.997 INFO:tasks.workunit.client.0.smithi045.stdout:6/449: rmdir d9/d1a/d1d 39 2024-09-18T12:52:17.999 INFO:tasks.workunit.client.1.smithi161.stdout:1/797: symlink d1/da/d1f/dab/daf/de8/l10e 0 2024-09-18T12:52:18.003 INFO:tasks.workunit.client.0.smithi045.stdout:8/510: dread d11/d20/d59/f8e [0,4194304] 0 2024-09-18T12:52:18.004 INFO:tasks.workunit.client.1.smithi161.stdout:8/930: write d0/d3/d10/d21/d4a/d52/d82/fd7 [906900,69524] 0 2024-09-18T12:52:18.005 INFO:tasks.workunit.client.1.smithi161.stdout:1/798: creat d1/d26/dad/f10f x:0 0 0 2024-09-18T12:52:18.006 INFO:tasks.workunit.client.0.smithi045.stdout:1/455: getdents d0/d12/d32/d37 0 2024-09-18T12:52:18.007 INFO:tasks.workunit.client.1.smithi161.stdout:5/936: mkdir d3/d12b 0 2024-09-18T12:52:18.007 INFO:tasks.workunit.client.0.smithi045.stdout:2/508: chown d5/d5f/db2/f80 608291 1 2024-09-18T12:52:18.009 INFO:tasks.workunit.client.1.smithi161.stdout:9/802: creat d0/d16/d25/f10e x:0 0 0 2024-09-18T12:52:18.013 INFO:tasks.workunit.client.0.smithi045.stdout:7/410: truncate f3 1444728 0 2024-09-18T12:52:18.016 INFO:tasks.workunit.client.1.smithi161.stdout:8/931: dwrite d0/dc4/f123 [0,4194304] 0 2024-09-18T12:52:18.018 INFO:tasks.workunit.client.1.smithi161.stdout:5/937: dread d3/d44/d6f/dca/d10d/d4b/d8e/d24/d61/fe5 [0,4194304] 0 2024-09-18T12:52:18.020 INFO:tasks.workunit.client.0.smithi045.stdout:9/445: dread d0/f3e [0,4194304] 0 2024-09-18T12:52:18.024 INFO:tasks.workunit.client.0.smithi045.stdout:1/456: rename d0/d2d/d2b/d30/d40/d60/l7f to d0/d2d/l88 0 2024-09-18T12:52:18.025 INFO:tasks.workunit.client.0.smithi045.stdout:1/457: readlink d0/d2d/d2b/d30/d40/d61/l4b 0 2024-09-18T12:52:18.027 INFO:tasks.workunit.client.0.smithi045.stdout:2/509: creat d5/d2c/d4d/d76/fb3 x:0 0 0 2024-09-18T12:52:18.027 INFO:tasks.workunit.client.0.smithi045.stdout:1/458: fdatasync d0/d12/d32/d67/d6d/f7e 0 2024-09-18T12:52:18.028 INFO:tasks.workunit.client.1.smithi161.stdout:8/932: mknod d0/d3/d10/d21/d4a/d52/d82/d96/d98/de7/c143 0 2024-09-18T12:52:18.031 INFO:tasks.workunit.client.1.smithi161.stdout:1/799: write f0 [618925,112366] 0 2024-09-18T12:52:18.033 INFO:tasks.workunit.client.0.smithi045.stdout:5/607: link d6/db/d6a/lc4 d6/d28/d2b/d51/d97/dab/lcb 0 2024-09-18T12:52:18.034 INFO:tasks.workunit.client.1.smithi161.stdout:8/933: fsync d0/d3/d10/f63 0 2024-09-18T12:52:18.038 INFO:tasks.workunit.client.0.smithi045.stdout:6/450: mkdir d9/d1a/da1 0 2024-09-18T12:52:18.039 INFO:tasks.workunit.client.1.smithi161.stdout:9/803: truncate d0/f24 3254846 0 2024-09-18T12:52:18.040 INFO:tasks.workunit.client.1.smithi161.stdout:1/800: creat d1/da/d31/f110 x:0 0 0 2024-09-18T12:52:18.040 INFO:tasks.workunit.client.0.smithi045.stdout:6/451: dread - d9/d1a/d48/d7d/f99 zero size 2024-09-18T12:52:18.043 INFO:tasks.workunit.client.0.smithi045.stdout:8/511: dwrite d11/d14/d72/f73 [0,4194304] 0 2024-09-18T12:52:18.044 INFO:tasks.workunit.client.0.smithi045.stdout:8/512: fsync d11/d14/f4b 0 2024-09-18T12:52:18.048 INFO:tasks.workunit.client.1.smithi161.stdout:8/934: mkdir d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/d144 0 2024-09-18T12:52:18.050 INFO:tasks.workunit.client.1.smithi161.stdout:5/938: rename d3/d44/d6f/dca/d10d/d4b/f5f to d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/f12c 0 2024-09-18T12:52:18.053 INFO:tasks.workunit.client.1.smithi161.stdout:1/801: rmdir d1/da/d9d 39 2024-09-18T12:52:18.054 INFO:tasks.workunit.client.0.smithi045.stdout:5/608: write d6/db/d5a/d78/f45 [6399592,123765] 0 2024-09-18T12:52:18.055 INFO:tasks.workunit.client.0.smithi045.stdout:5/609: chown d6/d28/f8f 414900104 1 2024-09-18T12:52:18.057 INFO:tasks.workunit.client.0.smithi045.stdout:4/642: getdents db/d2c/d35/dcc 0 2024-09-18T12:52:18.061 INFO:tasks.workunit.client.0.smithi045.stdout:6/452: symlink d9/d74/la2 0 2024-09-18T12:52:18.061 INFO:tasks.workunit.client.0.smithi045.stdout:6/453: stat d9/d30/d6c 0 2024-09-18T12:52:18.067 INFO:tasks.workunit.client.0.smithi045.stdout:8/513: read d11/d14/d53/f54 [1444549,79899] 0 2024-09-18T12:52:18.068 INFO:tasks.workunit.client.0.smithi045.stdout:8/514: chown d11/d14/d53 2010318370 1 2024-09-18T12:52:18.068 INFO:tasks.workunit.client.0.smithi045.stdout:2/510: truncate d5/d2c/d4d/f68 655632 0 2024-09-18T12:52:18.069 INFO:tasks.workunit.client.0.smithi045.stdout:2/511: chown c4 287 1 2024-09-18T12:52:18.069 INFO:tasks.workunit.client.0.smithi045.stdout:1/459: symlink d0/d2d/d2b/d30/d3d/d5b/l89 0 2024-09-18T12:52:18.073 INFO:tasks.workunit.client.0.smithi045.stdout:4/643: creat db/de/d1e/d3e/d47/d59/d2f/fd1 x:0 0 0 2024-09-18T12:52:18.076 INFO:tasks.workunit.client.0.smithi045.stdout:6/454: rename d9/d30/f88 to d9/d1a/d48/d75/d81/fa3 0 2024-09-18T12:52:18.077 INFO:tasks.workunit.client.0.smithi045.stdout:9/446: link d0/d3/d6/l14 d0/d3/d6/d64/d88/l8d 0 2024-09-18T12:52:18.077 INFO:tasks.workunit.client.0.smithi045.stdout:9/447: chown d0/f50 8775032 1 2024-09-18T12:52:18.079 INFO:tasks.workunit.client.0.smithi045.stdout:1/460: symlink d0/d2d/l8a 0 2024-09-18T12:52:18.080 INFO:tasks.workunit.client.1.smithi161.stdout:6/974: sync 2024-09-18T12:52:18.080 INFO:tasks.workunit.client.1.smithi161.stdout:2/935: sync 2024-09-18T12:52:18.081 INFO:tasks.workunit.client.0.smithi045.stdout:7/411: getdents d13/d31/d5f 0 2024-09-18T12:52:18.081 INFO:tasks.workunit.client.0.smithi045.stdout:3/455: link d0/d1e/d39/l36 d0/d29/d5f/d73/d87/l96 0 2024-09-18T12:52:18.082 INFO:tasks.workunit.client.0.smithi045.stdout:6/455: creat d9/d74/fa4 x:0 0 0 2024-09-18T12:52:18.083 INFO:tasks.workunit.client.0.smithi045.stdout:9/448: mknod d0/d3/d6/d10/d26/d2e/d4e/d76/d89/c8e 0 2024-09-18T12:52:18.086 INFO:tasks.workunit.client.0.smithi045.stdout:4/644: creat db/de/d1e/d3e/d78/fd2 x:0 0 0 2024-09-18T12:52:18.087 INFO:tasks.workunit.client.0.smithi045.stdout:6/456: creat d9/d1a/d2d/d38/fa5 x:0 0 0 2024-09-18T12:52:18.088 INFO:tasks.workunit.client.0.smithi045.stdout:4/645: chown db/de/d1e/d49/f4e 1273 1 2024-09-18T12:52:18.088 INFO:tasks.workunit.client.1.smithi161.stdout:8/935: unlink d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/f110 0 2024-09-18T12:52:18.090 INFO:tasks.workunit.client.0.smithi045.stdout:3/456: dread d0/d1e/d2c/d3a/f6d [0,4194304] 0 2024-09-18T12:52:18.091 INFO:tasks.workunit.client.0.smithi045.stdout:7/412: mknod d13/d44/d37/d6a/c8f 0 2024-09-18T12:52:18.092 INFO:tasks.workunit.client.1.smithi161.stdout:8/936: chown d0/d3/d10/d21/f49 1 1 2024-09-18T12:52:18.092 INFO:tasks.workunit.client.1.smithi161.stdout:2/936: write d0/d71/da9/dd6/de8/f117 [413092,100980] 0 2024-09-18T12:52:18.093 INFO:tasks.workunit.client.1.smithi161.stdout:1/802: dwrite d1/d26/dad/db6/fd5 [0,4194304] 0 2024-09-18T12:52:18.095 INFO:tasks.workunit.client.0.smithi045.stdout:2/512: getdents d5/d5f/da8/d91 0 2024-09-18T12:52:18.097 INFO:tasks.workunit.client.0.smithi045.stdout:2/513: write d5/d5f/da8/f31 [1389446,57385] 0 2024-09-18T12:52:18.098 INFO:tasks.workunit.client.1.smithi161.stdout:9/804: dwrite d0/d20/d49/f15 [4194304,4194304] 0 2024-09-18T12:52:18.105 INFO:tasks.workunit.client.0.smithi045.stdout:4/646: dread db/de/d1e/d49/f64 [0,4194304] 0 2024-09-18T12:52:18.108 INFO:tasks.workunit.client.0.smithi045.stdout:7/413: write d13/d1a/f27 [1121713,103400] 0 2024-09-18T12:52:18.110 INFO:tasks.workunit.client.0.smithi045.stdout:9/449: write d0/f4d [1443855,116528] 0 2024-09-18T12:52:18.111 INFO:tasks.workunit.client.0.smithi045.stdout:9/450: chown d0/f50 110 1 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:1/461: dwrite d0/d2d/d2b/f2f [0,4194304] 0 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:3/457: dread d0/d1e/d2c/d3a/d45/f49 [0,4194304] 0 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:2/514: symlink d5/d3a/d6b/lb4 0 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:3/458: dread - d0/d22/f85 zero size 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:6/457: symlink d9/la6 0 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:1/462: read d0/d12/f27 [3494955,112014] 0 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:7/414: rename d13/d44/d37/d72 to d13/d31/d33/d64/d78/d90 0 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:7/415: chown d13/d1a/d28/f3e 7 1 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:2/515: mkdir d5/d3a/d3e/db5 0 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:6/458: mkdir d9/d30/da7 0 2024-09-18T12:52:18.173 INFO:tasks.workunit.client.0.smithi045.stdout:3/459: truncate d0/d1e/f38 1808962 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.0.smithi045.stdout:1/463: unlink d0/f23 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:6/975: write d4/d61/fc2 [530795,128451] 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:8/937: symlink d0/d3/d10/d21/d4a/d52/d94/l145 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:5/939: dwrite d3/d3b/fe8 [0,4194304] 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:5/940: write d3/d8/de4/d8d/db0/fe9 [1632368,104931] 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:9/805: creat d0/d93/f10f x:0 0 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:1/803: write d1/da/d39/f37 [3207196,25098] 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:2/937: symlink d0/d5/l140 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:5/941: readlink d3/d44/d6f/dca/d10d/l75 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:6/976: unlink d4/d1a/f11 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:2/938: creat d0/f141 x:0 0 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:9/806: truncate d0/d16/d25/d46/fc0 2797250 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:1/804: rename d1/d1d/ca7 to d1/d26/dad/c111 0 2024-09-18T12:52:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:4/951: sync 2024-09-18T12:52:18.175 INFO:tasks.workunit.client.1.smithi161.stdout:3/903: sync 2024-09-18T12:52:18.191 INFO:tasks.workunit.client.1.smithi161.stdout:2/939: fdatasync d0/d5/d43/d35/d98/ddf/d8b/f8c 0 2024-09-18T12:52:18.193 INFO:tasks.workunit.client.1.smithi161.stdout:9/807: mkdir d0/d20/d49/de2/d110 0 2024-09-18T12:52:18.195 INFO:tasks.workunit.client.1.smithi161.stdout:5/942: getdents d3/d8/de4/dea 0 2024-09-18T12:52:18.198 INFO:tasks.workunit.client.1.smithi161.stdout:6/977: rename d4/d1a/d1c/d3e/f42 to d4/d1a/d1c/d3e/d83/dad/dd4/d131/f146 0 2024-09-18T12:52:18.200 INFO:tasks.workunit.client.1.smithi161.stdout:5/943: dwrite d3/d44/d6f/dca/d10d/f1c [0,4194304] 0 2024-09-18T12:52:18.201 INFO:tasks.workunit.client.1.smithi161.stdout:6/978: read d4/d39/d26/d31/f53 [432055,76811] 0 2024-09-18T12:52:18.201 INFO:tasks.workunit.client.1.smithi161.stdout:5/944: chown d3/d44/f112 360 1 2024-09-18T12:52:18.202 INFO:tasks.workunit.client.0.smithi045.stdout:2/516: mknod d5/d2c/cb6 0 2024-09-18T12:52:18.202 INFO:tasks.workunit.client.1.smithi161.stdout:1/805: rmdir d1/da/d1f/d6b/dd2 39 2024-09-18T12:52:18.203 INFO:tasks.workunit.client.0.smithi045.stdout:4/647: rmdir db/de/d1e/d3e/d47/d59/d2f/dca 0 2024-09-18T12:52:18.205 INFO:tasks.workunit.client.1.smithi161.stdout:3/904: mknod d1/d2e/d24/d84/c135 0 2024-09-18T12:52:18.205 INFO:tasks.workunit.client.1.smithi161.stdout:5/945: write d3/d44/d6f/dca/d10d/f38 [2855167,88019] 0 2024-09-18T12:52:18.210 INFO:tasks.workunit.client.0.smithi045.stdout:2/517: dread d5/d46/f52 [0,4194304] 0 2024-09-18T12:52:18.211 INFO:tasks.workunit.client.0.smithi045.stdout:1/464: rmdir d0/d2d/d2b/d30 39 2024-09-18T12:52:18.215 INFO:tasks.workunit.client.1.smithi161.stdout:0/941: sync 2024-09-18T12:52:18.215 INFO:tasks.workunit.client.1.smithi161.stdout:7/804: sync 2024-09-18T12:52:18.216 INFO:tasks.workunit.client.0.smithi045.stdout:4/648: dwrite db/de/d1e/d49/fb8 [0,4194304] 0 2024-09-18T12:52:18.216 INFO:tasks.workunit.client.1.smithi161.stdout:0/942: stat df/d30/d71/d96/dd3/f74 0 2024-09-18T12:52:18.217 INFO:tasks.workunit.client.0.smithi045.stdout:6/459: dwrite d9/d1a/d2d/f5e [0,4194304] 0 2024-09-18T12:52:18.218 INFO:tasks.workunit.client.1.smithi161.stdout:9/808: unlink d0/d47/c7d 0 2024-09-18T12:52:18.218 INFO:tasks.workunit.client.0.smithi045.stdout:4/649: write db/de/d1a/d2e/f92 [78233,29864] 0 2024-09-18T12:52:18.220 INFO:tasks.workunit.client.0.smithi045.stdout:9/451: creat d0/d3/d6/d10/d26/f8f x:0 0 0 2024-09-18T12:52:18.226 INFO:tasks.workunit.client.1.smithi161.stdout:8/938: getdents d0/d3/d91 0 2024-09-18T12:52:18.227 INFO:tasks.workunit.client.0.smithi045.stdout:4/650: dread db/de/f90 [0,4194304] 0 2024-09-18T12:52:18.227 INFO:tasks.workunit.client.1.smithi161.stdout:6/979: symlink d4/d61/d9d/da3/l147 0 2024-09-18T12:52:18.228 INFO:tasks.workunit.client.1.smithi161.stdout:4/952: write d5/d14/d67/dc7/d60/d95/dda/d155/f35 [290630,4193] 0 2024-09-18T12:52:18.228 INFO:tasks.workunit.client.0.smithi045.stdout:4/651: fsync db/d2c/d35/d40/f7d 0 2024-09-18T12:52:18.230 INFO:tasks.workunit.client.1.smithi161.stdout:6/980: write d4/d61/ff5 [1922218,46644] 0 2024-09-18T12:52:18.231 INFO:tasks.workunit.client.0.smithi045.stdout:7/416: truncate fd 3006178 0 2024-09-18T12:52:18.231 INFO:tasks.workunit.client.0.smithi045.stdout:1/465: chown d0/d2d/d2b/d30/d40 1822799 1 2024-09-18T12:52:18.235 INFO:tasks.workunit.client.1.smithi161.stdout:3/905: creat d1/d2e/d14/d65/d76/f136 x:0 0 0 2024-09-18T12:52:18.236 INFO:tasks.workunit.client.1.smithi161.stdout:8/939: dwrite d0/d3/d10/d21/d4a/d52/fcf [0,4194304] 0 2024-09-18T12:52:18.237 INFO:tasks.workunit.client.1.smithi161.stdout:2/940: dread d0/d1/deb/f61 [0,4194304] 0 2024-09-18T12:52:18.238 INFO:tasks.workunit.client.0.smithi045.stdout:9/452: rename d0/d3/d6/f6c to d0/d3/f90 0 2024-09-18T12:52:18.240 INFO:tasks.workunit.client.0.smithi045.stdout:7/417: creat d13/d31/d52/f91 x:0 0 0 2024-09-18T12:52:18.251 INFO:tasks.workunit.client.0.smithi045.stdout:4/652: creat db/de/d1e/d3e/d9a/d73/dce/fd3 x:0 0 0 2024-09-18T12:52:18.252 INFO:tasks.workunit.client.0.smithi045.stdout:4/653: stat db/de/d1e/d3e/l97 0 2024-09-18T12:52:18.253 INFO:tasks.workunit.client.0.smithi045.stdout:7/418: rmdir d13/d31/d63 39 2024-09-18T12:52:18.254 INFO:tasks.workunit.client.1.smithi161.stdout:8/940: dread d0/d3/d10/d21/fb6 [0,4194304] 0 2024-09-18T12:52:18.255 INFO:tasks.workunit.client.0.smithi045.stdout:1/466: write d0/d12/f13 [3564606,118290] 0 2024-09-18T12:52:18.256 INFO:tasks.workunit.client.0.smithi045.stdout:1/467: dread - d0/d2d/f68 zero size 2024-09-18T12:52:18.257 INFO:tasks.workunit.client.0.smithi045.stdout:2/518: rmdir d5/d3a/d3e/d9e 0 2024-09-18T12:52:18.261 INFO:tasks.workunit.client.1.smithi161.stdout:1/806: rename d1/da/d31/c95 to d1/da/c112 0 2024-09-18T12:52:18.263 INFO:tasks.workunit.client.0.smithi045.stdout:4/654: mkdir db/de/d1e/d3e/d78/dd4 0 2024-09-18T12:52:18.263 INFO:tasks.workunit.client.1.smithi161.stdout:5/946: dwrite d3/def/f32 [0,4194304] 0 2024-09-18T12:52:18.264 INFO:tasks.workunit.client.1.smithi161.stdout:6/981: symlink d4/l148 0 2024-09-18T12:52:18.264 INFO:tasks.workunit.client.0.smithi045.stdout:6/460: dwrite d9/d1a/d48/d8f/f9b [0,4194304] 0 2024-09-18T12:52:18.267 INFO:tasks.workunit.client.0.smithi045.stdout:7/419: creat d13/d44/d4c/f92 x:0 0 0 2024-09-18T12:52:18.267 INFO:tasks.workunit.client.1.smithi161.stdout:0/943: truncate df/d30/d71/d96/dd3/d51/f101 1107790 0 2024-09-18T12:52:18.273 INFO:tasks.workunit.client.1.smithi161.stdout:2/941: mknod d0/d5/d43/d23/d136/d9b/d139/c142 0 2024-09-18T12:52:18.274 INFO:tasks.workunit.client.1.smithi161.stdout:2/942: read d0/d1/deb/f61 [877805,87803] 0 2024-09-18T12:52:18.274 INFO:tasks.workunit.client.0.smithi045.stdout:2/519: dread d5/f22 [4194304,4194304] 0 2024-09-18T12:52:18.276 INFO:tasks.workunit.client.1.smithi161.stdout:9/809: link d0/d20/d49/ffd d0/db/f111 0 2024-09-18T12:52:18.278 INFO:tasks.workunit.client.0.smithi045.stdout:4/655: fdatasync db/de/d1e/f2d 0 2024-09-18T12:52:18.278 INFO:tasks.workunit.client.1.smithi161.stdout:9/810: read d0/d20/f39 [1435295,31569] 0 2024-09-18T12:52:18.279 INFO:tasks.workunit.client.1.smithi161.stdout:9/811: dread - d0/d16/d25/f10e zero size 2024-09-18T12:52:18.279 INFO:tasks.workunit.client.1.smithi161.stdout:1/807: write d1/da/d9d/fa2 [828917,3013] 0 2024-09-18T12:52:18.279 INFO:tasks.workunit.client.1.smithi161.stdout:9/812: chown d0/d16/d25/d46/fb6 23980 1 2024-09-18T12:52:18.280 INFO:tasks.workunit.client.0.smithi045.stdout:1/468: dwrite d0/d12/f80 [0,4194304] 0 2024-09-18T12:52:18.280 INFO:tasks.workunit.client.1.smithi161.stdout:1/808: write d1/da/d1f/dab/daf/de8/ff9 [529736,102069] 0 2024-09-18T12:52:18.281 INFO:tasks.workunit.client.1.smithi161.stdout:1/809: chown d1/d26 258889905 1 2024-09-18T12:52:18.281 INFO:tasks.workunit.client.1.smithi161.stdout:5/947: creat d3/d8/de4/d8d/ddb/f12d x:0 0 0 2024-09-18T12:52:18.281 INFO:tasks.workunit.client.1.smithi161.stdout:1/810: chown d1/c72 13709872 1 2024-09-18T12:52:18.283 INFO:tasks.workunit.client.0.smithi045.stdout:1/469: truncate d0/d2d/f53 9039685 0 2024-09-18T12:52:18.283 INFO:tasks.workunit.client.1.smithi161.stdout:6/982: chown d4/d39/d26/d31/d76/c12f 76373 1 2024-09-18T12:52:18.285 INFO:tasks.workunit.client.1.smithi161.stdout:7/805: getdents d3/d83/db6 0 2024-09-18T12:52:18.287 INFO:tasks.workunit.client.0.smithi045.stdout:4/656: dwrite db/d20/d6b/fba [0,4194304] 0 2024-09-18T12:52:18.288 INFO:tasks.workunit.client.1.smithi161.stdout:4/953: rename d5/d14/d67/d84/dae/db8/c11e to d5/d14/d5f/c158 0 2024-09-18T12:52:18.289 INFO:tasks.workunit.client.1.smithi161.stdout:2/943: read d0/d1/d4c/d67/db9/dcb/d8a/da8/fc4 [727281,42819] 0 2024-09-18T12:52:18.289 INFO:tasks.workunit.client.0.smithi045.stdout:6/461: creat d9/d1a/d48/d97/fa8 x:0 0 0 2024-09-18T12:52:18.292 INFO:tasks.workunit.client.1.smithi161.stdout:9/813: dwrite d0/d16/d25/d28/f3f [0,4194304] 0 2024-09-18T12:52:18.295 INFO:tasks.workunit.client.0.smithi045.stdout:4/657: dwrite db/d2c/d35/fa1 [0,4194304] 0 2024-09-18T12:52:18.296 INFO:tasks.workunit.client.1.smithi161.stdout:4/954: stat d5/d14/d67/dc7/d60/d95/dda/d155/l9c 0 2024-09-18T12:52:18.296 INFO:tasks.workunit.client.1.smithi161.stdout:9/814: chown d0/d47/f4c 182475 1 2024-09-18T12:52:18.296 INFO:tasks.workunit.client.1.smithi161.stdout:1/811: dwrite d1/d26/d88/fa3 [0,4194304] 0 2024-09-18T12:52:18.299 INFO:tasks.workunit.client.0.smithi045.stdout:4/658: truncate db/de/d1e/d3e/d47/d59/d2f/fd1 708014 0 2024-09-18T12:52:18.301 INFO:tasks.workunit.client.1.smithi161.stdout:5/948: mkdir d3/d8/de4/d8d/ddb/d12e 0 2024-09-18T12:52:18.305 INFO:tasks.workunit.client.0.smithi045.stdout:1/470: write d0/d12/f3b [143925,16061] 0 2024-09-18T12:52:18.313 INFO:tasks.workunit.client.0.smithi045.stdout:6/462: mknod d9/d30/ca9 0 2024-09-18T12:52:18.314 INFO:tasks.workunit.client.1.smithi161.stdout:0/944: write df/f50 [498211,122812] 0 2024-09-18T12:52:18.315 INFO:tasks.workunit.client.0.smithi045.stdout:6/463: dread - d9/d1a/d2d/d38/d5b/f86 zero size 2024-09-18T12:52:18.315 INFO:tasks.workunit.client.1.smithi161.stdout:0/945: readlink df/d30/d71/d96/dd3/d51/dc9/lfb 0 2024-09-18T12:52:18.316 INFO:tasks.workunit.client.0.smithi045.stdout:9/453: link d0/d3/f2b d0/d3/d6/d64/f91 0 2024-09-18T12:52:18.319 INFO:tasks.workunit.client.1.smithi161.stdout:2/944: creat d0/d5/d43/d35/dee/f143 x:0 0 0 2024-09-18T12:52:18.320 INFO:tasks.workunit.client.1.smithi161.stdout:2/945: fdatasync d0/d71/da9/d9f/dd0/f119 0 2024-09-18T12:52:18.321 INFO:tasks.workunit.client.0.smithi045.stdout:4/659: symlink db/de/d1e/d49/ld5 0 2024-09-18T12:52:18.322 INFO:tasks.workunit.client.0.smithi045.stdout:4/660: readlink db/de/d1e/d3e/l97 0 2024-09-18T12:52:18.322 INFO:tasks.workunit.client.1.smithi161.stdout:4/955: write d5/da9/db9/fe6 [50272,47412] 0 2024-09-18T12:52:18.322 INFO:tasks.workunit.client.1.smithi161.stdout:4/956: stat d5/d14/c18 0 2024-09-18T12:52:18.323 INFO:tasks.workunit.client.0.smithi045.stdout:4/661: chown db/d20/f44 833010293 1 2024-09-18T12:52:18.324 INFO:tasks.workunit.client.0.smithi045.stdout:7/420: rename d13/d31/d63/c88 to d13/d31/d52/c93 0 2024-09-18T12:52:18.327 INFO:tasks.workunit.client.0.smithi045.stdout:0/521: sync 2024-09-18T12:52:18.328 INFO:tasks.workunit.client.1.smithi161.stdout:5/949: chown d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/la2 5689 1 2024-09-18T12:52:18.328 INFO:tasks.workunit.client.0.smithi045.stdout:2/520: truncate d5/d5f/da8/f3b 1028163 0 2024-09-18T12:52:18.329 INFO:tasks.workunit.client.1.smithi161.stdout:5/950: chown d3/d44/d6f/dca/d10d/d4b/d8e/d24 69564060 1 2024-09-18T12:52:18.329 INFO:tasks.workunit.client.1.smithi161.stdout:5/951: chown d3/d3b/d54/f10b 3 1 2024-09-18T12:52:18.330 INFO:tasks.workunit.client.0.smithi045.stdout:4/662: creat db/d20/fd6 x:0 0 0 2024-09-18T12:52:18.330 INFO:tasks.workunit.client.0.smithi045.stdout:2/521: write d5/d5f/f78 [659721,25216] 0 2024-09-18T12:52:18.331 INFO:tasks.workunit.client.1.smithi161.stdout:3/906: rename d1/d2e/d24/f3a to d1/d2e/d68/de8/df6/f137 0 2024-09-18T12:52:18.332 INFO:tasks.workunit.client.0.smithi045.stdout:6/464: rename d9/f23 to d9/d30/faa 0 2024-09-18T12:52:18.333 INFO:tasks.workunit.client.0.smithi045.stdout:6/465: chown d9/d56/f8b 4 1 2024-09-18T12:52:18.334 INFO:tasks.workunit.client.1.smithi161.stdout:0/946: dread df/f32 [8388608,4194304] 0 2024-09-18T12:52:18.334 INFO:tasks.workunit.client.1.smithi161.stdout:7/806: getdents d3/d8/d15/da7/d24/ddd/de5 0 2024-09-18T12:52:18.335 INFO:tasks.workunit.client.0.smithi045.stdout:9/454: fdatasync d0/d3/d6/d10/d2c/f80 0 2024-09-18T12:52:18.335 INFO:tasks.workunit.client.1.smithi161.stdout:0/947: write df/d29/f12e [52807,120716] 0 2024-09-18T12:52:18.337 INFO:tasks.workunit.client.1.smithi161.stdout:3/907: dread d1/d2e/f28 [0,4194304] 0 2024-09-18T12:52:18.337 INFO:tasks.workunit.client.1.smithi161.stdout:4/957: rmdir d5/da9/de7 39 2024-09-18T12:52:18.340 INFO:tasks.workunit.client.0.smithi045.stdout:4/663: unlink db/de/d1e/d3e/d9a/c19 0 2024-09-18T12:52:18.346 INFO:tasks.workunit.client.0.smithi045.stdout:7/421: rename d13/d31/d63 to d13/d31/d5f/d94 0 2024-09-18T12:52:18.348 INFO:tasks.workunit.client.1.smithi161.stdout:3/908: dread d1/d2e/d68/d11c/f122 [0,4194304] 0 2024-09-18T12:52:18.349 INFO:tasks.workunit.client.0.smithi045.stdout:6/466: fdatasync d9/d1a/d48/d75/d81/fa3 0 2024-09-18T12:52:18.352 INFO:tasks.workunit.client.0.smithi045.stdout:3/460: sync 2024-09-18T12:52:18.352 INFO:tasks.workunit.client.0.smithi045.stdout:5/610: sync 2024-09-18T12:52:18.352 INFO:tasks.workunit.client.0.smithi045.stdout:8/515: sync 2024-09-18T12:52:18.353 INFO:tasks.workunit.client.1.smithi161.stdout:8/941: rename d0/d3/d10/d21/d4a/d52/d94/l145 to d0/d3/d10/d21/d11e/l146 0 2024-09-18T12:52:18.355 INFO:tasks.workunit.client.1.smithi161.stdout:1/812: truncate d1/d48/f99 8440540 0 2024-09-18T12:52:18.355 INFO:tasks.workunit.client.0.smithi045.stdout:1/471: dwrite d0/d2d/d2b/f36 [0,4194304] 0 2024-09-18T12:52:18.356 INFO:tasks.workunit.client.1.smithi161.stdout:7/807: symlink d3/d8/d4b/lf3 0 2024-09-18T12:52:18.358 INFO:tasks.workunit.client.1.smithi161.stdout:2/946: fdatasync d0/d71/da9/d9f/f123 0 2024-09-18T12:52:18.359 INFO:tasks.workunit.client.0.smithi045.stdout:2/522: dwrite d5/d5f/da8/d61/f66 [0,4194304] 0 2024-09-18T12:52:18.361 INFO:tasks.workunit.client.1.smithi161.stdout:0/948: unlink df/de2/dc5/d8a/f113 0 2024-09-18T12:52:18.363 INFO:tasks.workunit.client.1.smithi161.stdout:2/947: dread d0/d5/d43/d35/d98/ddf/f59 [0,4194304] 0 2024-09-18T12:52:18.368 INFO:tasks.workunit.client.1.smithi161.stdout:5/952: link d3/d44/d6f/dca/d10d/ff2 d3/d44/d6f/d86/dfa/f12f 0 2024-09-18T12:52:18.371 INFO:tasks.workunit.client.0.smithi045.stdout:7/422: dwrite d13/d31/d33/d64/d78/f8b [0,4194304] 0 2024-09-18T12:52:18.373 INFO:tasks.workunit.client.1.smithi161.stdout:6/983: rename d4/d61/d69/da0/dab to d4/d1a/d1c/d3e/d83/d9e/db1/d45/d68/d149 0 2024-09-18T12:52:18.374 INFO:tasks.workunit.client.0.smithi045.stdout:5/611: mkdir d6/d28/dcc 0 2024-09-18T12:52:18.378 INFO:tasks.workunit.client.0.smithi045.stdout:9/455: truncate d0/fc 1884531 0 2024-09-18T12:52:18.380 INFO:tasks.workunit.client.1.smithi161.stdout:0/949: truncate df/f23 1504594 0 2024-09-18T12:52:18.383 INFO:tasks.workunit.client.0.smithi045.stdout:4/664: symlink db/d2c/d35/dcc/dd0/ld7 0 2024-09-18T12:52:18.384 INFO:tasks.workunit.client.1.smithi161.stdout:9/815: rename d0/d47/cf5 to d0/d47/d48/d9a/c112 0 2024-09-18T12:52:18.384 INFO:tasks.workunit.client.0.smithi045.stdout:4/665: write db/d20/f44 [4086395,22402] 0 2024-09-18T12:52:18.386 INFO:tasks.workunit.client.0.smithi045.stdout:9/456: dwrite d0/d3/d6/d10/d2c/f44 [0,4194304] 0 2024-09-18T12:52:18.386 INFO:tasks.workunit.client.1.smithi161.stdout:6/984: fsync d4/d1a/d1c/d3e/d83/d9e/fa4 0 2024-09-18T12:52:18.387 INFO:tasks.workunit.client.1.smithi161.stdout:0/950: dwrite df/de2/dc5/d86/da5/f12c [0,4194304] 0 2024-09-18T12:52:18.389 INFO:tasks.workunit.client.1.smithi161.stdout:0/951: write df/de2/dc5/d86/f7e [2921047,46089] 0 2024-09-18T12:52:18.389 INFO:tasks.workunit.client.1.smithi161.stdout:8/942: symlink d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/l147 0 2024-09-18T12:52:18.392 INFO:tasks.workunit.client.0.smithi045.stdout:7/423: creat d13/d44/f95 x:0 0 0 2024-09-18T12:52:18.397 INFO:tasks.workunit.client.0.smithi045.stdout:3/461: symlink d0/d1e/d39/l97 0 2024-09-18T12:52:18.400 INFO:tasks.workunit.client.0.smithi045.stdout:6/467: truncate d9/d1a/d2d/d32/f62 763173 0 2024-09-18T12:52:18.401 INFO:tasks.workunit.client.0.smithi045.stdout:0/522: getdents d6/d48/d5e/d39/d58/d3b 0 2024-09-18T12:52:18.406 INFO:tasks.workunit.client.1.smithi161.stdout:3/909: rename d1/d2e/d68/d92/ded/c10c to d1/d2e/d14/d90/d10d/c138 0 2024-09-18T12:52:18.406 INFO:tasks.workunit.client.1.smithi161.stdout:9/816: rmdir d0/d20/d49/d65 39 2024-09-18T12:52:18.407 INFO:tasks.workunit.client.0.smithi045.stdout:5/612: symlink d6/lcd 0 2024-09-18T12:52:18.408 INFO:tasks.workunit.client.1.smithi161.stdout:6/985: fsync d4/d1a/d1c/d3e/d83/d9e/db1/f116 0 2024-09-18T12:52:18.408 INFO:tasks.workunit.client.1.smithi161.stdout:9/817: write d0/d20/d74/ded/d102/f105 [118120,72329] 0 2024-09-18T12:52:18.409 INFO:tasks.workunit.client.1.smithi161.stdout:3/910: chown d1/d2e/d14/d65/d76/d8c/d9d/c124 5 1 2024-09-18T12:52:18.410 INFO:tasks.workunit.client.1.smithi161.stdout:9/818: chown d0/d20/d49/fa1 850416621 1 2024-09-18T12:52:18.410 INFO:tasks.workunit.client.0.smithi045.stdout:8/516: creat d11/d14/d53/d41/f9a x:0 0 0 2024-09-18T12:52:18.412 INFO:tasks.workunit.client.1.smithi161.stdout:9/819: write d0/d47/df1/f72 [5044794,89431] 0 2024-09-18T12:52:18.412 INFO:tasks.workunit.client.0.smithi045.stdout:8/517: read d11/d8c/f94 [221919,78433] 0 2024-09-18T12:52:18.413 INFO:tasks.workunit.client.1.smithi161.stdout:1/813: creat d1/f113 x:0 0 0 2024-09-18T12:52:18.414 INFO:tasks.workunit.client.1.smithi161.stdout:6/986: dread d4/d39/d48/f8b [0,4194304] 0 2024-09-18T12:52:18.415 INFO:tasks.workunit.client.0.smithi045.stdout:1/472: rename d0/d2d/d2b/d30/d3d to d0/d2d/d2b/d30/d8b 0 2024-09-18T12:52:18.415 INFO:tasks.workunit.client.0.smithi045.stdout:5/613: dwrite d6/d28/f8f [0,4194304] 0 2024-09-18T12:52:18.415 INFO:tasks.workunit.client.1.smithi161.stdout:7/808: dread d3/d8/d15/f3b [0,4194304] 0 2024-09-18T12:52:18.416 INFO:tasks.workunit.client.1.smithi161.stdout:4/958: getdents d5/d32 0 2024-09-18T12:52:18.418 INFO:tasks.workunit.client.0.smithi045.stdout:9/457: symlink d0/d3/d6/d10/d26/l92 0 2024-09-18T12:52:18.419 INFO:tasks.workunit.client.1.smithi161.stdout:8/943: dread d0/d3/f69 [0,4194304] 0 2024-09-18T12:52:18.420 INFO:tasks.workunit.client.1.smithi161.stdout:5/953: rename d3/d3b/d54/l5d to d3/d44/d120/dde/l130 0 2024-09-18T12:52:18.426 INFO:tasks.workunit.client.1.smithi161.stdout:8/944: dwrite d0/d3/d10/d21/d4a/d52/d66/f5c [0,4194304] 0 2024-09-18T12:52:18.430 INFO:tasks.workunit.client.0.smithi045.stdout:3/462: unlink d0/f18 0 2024-09-18T12:52:18.431 INFO:tasks.workunit.client.0.smithi045.stdout:3/463: chown d0/d7 207770 1 2024-09-18T12:52:18.432 INFO:tasks.workunit.client.1.smithi161.stdout:2/948: truncate d0/d4/d78/fbe 4329086 0 2024-09-18T12:52:18.434 INFO:tasks.workunit.client.0.smithi045.stdout:5/614: dread d6/db/d19/d92/d61/f72 [0,4194304] 0 2024-09-18T12:52:18.434 INFO:tasks.workunit.client.1.smithi161.stdout:3/911: dread d1/d2e/d24/d1d/f9f [0,4194304] 0 2024-09-18T12:52:18.435 INFO:tasks.workunit.client.1.smithi161.stdout:3/912: dread - d1/d2e/d68/de8/df6/ffa zero size 2024-09-18T12:52:18.436 INFO:tasks.workunit.client.0.smithi045.stdout:5/615: write d6/db/d5a/d78/f45 [274506,51412] 0 2024-09-18T12:52:18.436 INFO:tasks.workunit.client.0.smithi045.stdout:8/518: fsync d11/d20/f27 0 2024-09-18T12:52:18.437 INFO:tasks.workunit.client.1.smithi161.stdout:1/814: stat d1/da/f19 0 2024-09-18T12:52:18.437 INFO:tasks.workunit.client.0.smithi045.stdout:8/519: dread - d11/d20/f5d zero size 2024-09-18T12:52:18.447 INFO:tasks.workunit.client.0.smithi045.stdout:6/468: dwrite d9/d1a/d2d/d38/f44 [0,4194304] 0 2024-09-18T12:52:18.449 INFO:tasks.workunit.client.0.smithi045.stdout:6/469: fsync d9/d1a/d2d/d38/f40 0 2024-09-18T12:52:18.449 INFO:tasks.workunit.client.0.smithi045.stdout:4/666: rename db/de/d1e/d3e/d47/d59/d2f/fd1 to db/de/d1e/fd8 0 2024-09-18T12:52:18.450 INFO:tasks.workunit.client.1.smithi161.stdout:9/820: dread d0/d16/f9c [0,4194304] 0 2024-09-18T12:52:18.451 INFO:tasks.workunit.client.0.smithi045.stdout:4/667: readlink db/d20/d6b/l96 0 2024-09-18T12:52:18.451 INFO:tasks.workunit.client.0.smithi045.stdout:4/668: stat db 0 2024-09-18T12:52:18.452 INFO:tasks.workunit.client.0.smithi045.stdout:7/424: truncate d13/d31/d33/f4e 79928 0 2024-09-18T12:52:18.452 INFO:tasks.workunit.client.0.smithi045.stdout:5/616: dread d6/db/d5a/d78/d66/f7b [0,4194304] 0 2024-09-18T12:52:18.457 INFO:tasks.workunit.client.1.smithi161.stdout:8/945: unlink d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/ca4 0 2024-09-18T12:52:18.459 INFO:tasks.workunit.client.0.smithi045.stdout:7/425: dwrite d13/f61 [0,4194304] 0 2024-09-18T12:52:18.461 INFO:tasks.workunit.client.1.smithi161.stdout:0/952: link df/d29/l5c df/d30/d71/d96/dd3/d90/l14c 0 2024-09-18T12:52:18.464 INFO:tasks.workunit.client.1.smithi161.stdout:2/949: symlink d0/d1/d4c/de5/l144 0 2024-09-18T12:52:18.468 INFO:tasks.workunit.client.1.smithi161.stdout:7/809: write d3/d8/d15/f3b [4930302,23356] 0 2024-09-18T12:52:18.473 INFO:tasks.workunit.client.0.smithi045.stdout:6/470: mkdir d9/d1a/d48/d8f/d98/dab 0 2024-09-18T12:52:18.474 INFO:tasks.workunit.client.1.smithi161.stdout:8/946: truncate d0/d3/f69 2681101 0 2024-09-18T12:52:18.475 INFO:tasks.workunit.client.0.smithi045.stdout:3/464: mknod d0/d7/c98 0 2024-09-18T12:52:18.476 INFO:tasks.workunit.client.0.smithi045.stdout:4/669: chown db/de/d1e/d3e/d9a/l18 339077 1 2024-09-18T12:52:18.476 INFO:tasks.workunit.client.1.smithi161.stdout:4/959: dwrite d5/d14/d67/dc7/d60/d95/dda/d155/d44/f55 [0,4194304] 0 2024-09-18T12:52:18.479 INFO:tasks.workunit.client.1.smithi161.stdout:7/810: unlink d3/d8/d15/da7/d4a/d64/d8c/d9f/f2f 0 2024-09-18T12:52:18.479 INFO:tasks.workunit.client.1.smithi161.stdout:6/987: link d4/d1a/d1c/c96 d4/d39/d3a/c14a 0 2024-09-18T12:52:18.482 INFO:tasks.workunit.client.1.smithi161.stdout:5/954: rename d3/d3b/d7b/da6 to d3/d131 0 2024-09-18T12:52:18.484 INFO:tasks.workunit.client.1.smithi161.stdout:5/955: chown d3/d44/d6f/dca/d10d/d11b/f100 2 1 2024-09-18T12:52:18.484 INFO:tasks.workunit.client.0.smithi045.stdout:7/426: rename d13/d44/f51 to d13/d44/d37/d70/f96 0 2024-09-18T12:52:18.484 INFO:tasks.workunit.client.1.smithi161.stdout:8/947: dwrite d0/d3/d10/d21/d4a/d52/d66/d5b/d6e/f126 [0,4194304] 0 2024-09-18T12:52:18.485 INFO:tasks.workunit.client.1.smithi161.stdout:6/988: rmdir d4 39 2024-09-18T12:52:18.486 INFO:tasks.workunit.client.0.smithi045.stdout:8/520: symlink d11/d8c/d90/l9b 0 2024-09-18T12:52:18.487 INFO:tasks.workunit.client.1.smithi161.stdout:7/811: mkdir d3/d8/d15/da7/d24/daf/df4 0 2024-09-18T12:52:18.487 INFO:tasks.workunit.client.0.smithi045.stdout:4/670: mknod db/de/d1e/d49/cd9 0 2024-09-18T12:52:18.490 INFO:tasks.workunit.client.1.smithi161.stdout:4/960: mknod d5/c159 0 2024-09-18T12:52:18.492 INFO:tasks.workunit.client.1.smithi161.stdout:2/950: dread d0/d5/d43/d35/d98/ddf/f60 [0,4194304] 0 2024-09-18T12:52:18.492 INFO:tasks.workunit.client.0.smithi045.stdout:6/471: rename d9/d1a/d2d/c4f to d9/d1a/d2d/d32/cac 0 2024-09-18T12:52:18.494 INFO:tasks.workunit.client.1.smithi161.stdout:8/948: symlink d0/d3/d91/l148 0 2024-09-18T12:52:18.495 INFO:tasks.workunit.client.0.smithi045.stdout:9/458: getdents d0/d3/d6/d64 0 2024-09-18T12:52:18.495 INFO:tasks.workunit.client.1.smithi161.stdout:7/812: dwrite d3/d8/d15/da7/d4a/d64/d8c/fd8 [0,4194304] 0 2024-09-18T12:52:18.496 INFO:tasks.workunit.client.0.smithi045.stdout:9/459: read - d0/f61 zero size 2024-09-18T12:52:18.496 INFO:tasks.workunit.client.0.smithi045.stdout:4/671: creat db/d2c/d35/d40/d77/fda x:0 0 0 2024-09-18T12:52:18.498 INFO:tasks.workunit.client.0.smithi045.stdout:4/672: write db/d20/f70 [1326052,122330] 0 2024-09-18T12:52:18.498 INFO:tasks.workunit.client.0.smithi045.stdout:7/427: symlink d13/d44/d37/d70/d77/d85/l97 0 2024-09-18T12:52:18.500 INFO:tasks.workunit.client.0.smithi045.stdout:7/428: chown d13/d44/d37/d70/f79 61 1 2024-09-18T12:52:18.500 INFO:tasks.workunit.client.1.smithi161.stdout:8/949: read d0/d3/d10/d21/f48 [3966625,11793] 0 2024-09-18T12:52:18.500 INFO:tasks.workunit.client.1.smithi161.stdout:6/989: creat d4/d39/d26/d31/f14b x:0 0 0 2024-09-18T12:52:18.502 INFO:tasks.workunit.client.0.smithi045.stdout:3/465: rename d0/d22/l27 to d0/d1e/d91/l99 0 2024-09-18T12:52:18.502 INFO:tasks.workunit.client.1.smithi161.stdout:8/950: readlink d0/d3/d10/d21/d4a/d52/d70/l79 0 2024-09-18T12:52:18.503 INFO:tasks.workunit.client.0.smithi045.stdout:3/466: fsync d0/d29/d53/f7e 0 2024-09-18T12:52:18.503 INFO:tasks.workunit.client.1.smithi161.stdout:2/951: mknod d0/d5/d43/d23/d136/d9b/d139/c145 0 2024-09-18T12:52:18.503 INFO:tasks.workunit.client.1.smithi161.stdout:8/951: chown d0/d3/d10/d21/d4a/d52/d82/d96/d98/ffc 38 1 2024-09-18T12:52:18.503 INFO:tasks.workunit.client.0.smithi045.stdout:3/467: fsync d0/d22/f8e 0 2024-09-18T12:52:18.504 INFO:tasks.workunit.client.0.smithi045.stdout:6/472: symlink d9/d1a/d2d/d38/d5b/d67/lad 0 2024-09-18T12:52:18.506 INFO:tasks.workunit.client.1.smithi161.stdout:5/956: creat d3/d44/f132 x:0 0 0 2024-09-18T12:52:18.507 INFO:tasks.workunit.client.0.smithi045.stdout:9/460: mknod d0/d3/d6/d10/d26/d2e/d4e/c93 0 2024-09-18T12:52:18.507 INFO:tasks.workunit.client.1.smithi161.stdout:6/990: mknod d4/d39/d26/d101/c14c 0 2024-09-18T12:52:18.508 INFO:tasks.workunit.client.0.smithi045.stdout:5/617: link d6/db/d19/c38 d6/db/cce 0 2024-09-18T12:52:18.510 INFO:tasks.workunit.client.0.smithi045.stdout:5/618: stat d6/db/d54/c89 0 2024-09-18T12:52:18.510 INFO:tasks.workunit.client.0.smithi045.stdout:7/429: creat d13/d44/d37/f98 x:0 0 0 2024-09-18T12:52:18.511 INFO:tasks.workunit.client.0.smithi045.stdout:6/473: dwrite d9/d1a/d48/f53 [0,4194304] 0 2024-09-18T12:52:18.511 INFO:tasks.workunit.client.0.smithi045.stdout:4/673: rename db/d2c/fc8 to db/de/d1e/d3e/fdb 0 2024-09-18T12:52:18.513 INFO:tasks.workunit.client.1.smithi161.stdout:5/957: mknod d3/d3b/d7b/c133 0 2024-09-18T12:52:18.514 INFO:tasks.workunit.client.1.smithi161.stdout:6/991: dwrite d4/d1a/d1c/d3e/d83/dad/dbd/f108 [0,4194304] 0 2024-09-18T12:52:18.514 INFO:tasks.workunit.client.1.smithi161.stdout:8/952: dwrite d0/d3/d10/d21/d4a/d52/d66/d5b/fae [0,4194304] 0 2024-09-18T12:52:18.519 INFO:tasks.workunit.client.1.smithi161.stdout:5/958: creat d3/d8/de4/d8d/db0/dd4/f134 x:0 0 0 2024-09-18T12:52:18.520 INFO:tasks.workunit.client.1.smithi161.stdout:6/992: chown d4/d61/l144 6163 1 2024-09-18T12:52:18.520 INFO:tasks.workunit.client.1.smithi161.stdout:2/952: link d0/d71/da9/d9f/dd0/d10c/d132/fbd d0/d1/deb/d13b/f146 0 2024-09-18T12:52:18.522 INFO:tasks.workunit.client.0.smithi045.stdout:7/430: creat d13/d31/d5f/f99 x:0 0 0 2024-09-18T12:52:18.522 INFO:tasks.workunit.client.0.smithi045.stdout:5/619: fdatasync d6/db/d19/d92/d5c/f62 0 2024-09-18T12:52:18.523 INFO:tasks.workunit.client.0.smithi045.stdout:5/620: chown d6/db 230 1 2024-09-18T12:52:18.524 INFO:tasks.workunit.client.0.smithi045.stdout:4/674: creat db/de/d1a/dbc/fdc x:0 0 0 2024-09-18T12:52:18.525 INFO:tasks.workunit.client.0.smithi045.stdout:5/621: dread - d6/db/d19/d92/d5c/dae/fbf zero size 2024-09-18T12:52:18.526 INFO:tasks.workunit.client.0.smithi045.stdout:3/468: symlink d0/d7/l9a 0 2024-09-18T12:52:18.532 INFO:tasks.workunit.client.0.smithi045.stdout:8/521: getdents d11/d8c 0 2024-09-18T12:52:18.535 INFO:tasks.workunit.client.0.smithi045.stdout:7/431: mkdir d13/d31/d33/d9a 0 2024-09-18T12:52:18.535 INFO:tasks.workunit.client.0.smithi045.stdout:7/432: chown d13/d44/d37/d70/d77/d6d 250914 1 2024-09-18T12:52:18.536 INFO:tasks.workunit.client.0.smithi045.stdout:4/675: creat db/d2c/d35/dcc/dd0/fdd x:0 0 0 2024-09-18T12:52:18.540 INFO:tasks.workunit.client.0.smithi045.stdout:6/474: creat d9/d1a/d48/d8f/d98/dab/fae x:0 0 0 2024-09-18T12:52:18.541 INFO:tasks.workunit.client.0.smithi045.stdout:7/433: dwrite d13/d44/f95 [0,4194304] 0 2024-09-18T12:52:18.542 INFO:tasks.workunit.client.0.smithi045.stdout:8/522: unlink d11/d14/d53/d41/f4d 0 2024-09-18T12:52:18.544 INFO:tasks.workunit.client.0.smithi045.stdout:3/469: creat d0/d1e/d2c/d3a/d8a/f9b x:0 0 0 2024-09-18T12:52:18.546 INFO:tasks.workunit.client.0.smithi045.stdout:6/475: dread d9/d1a/d2d/d38/d5b/f61 [4194304,4194304] 0 2024-09-18T12:52:18.550 INFO:tasks.workunit.client.0.smithi045.stdout:7/434: mkdir d13/d1a/d9b 0 2024-09-18T12:52:18.551 INFO:tasks.workunit.client.0.smithi045.stdout:2/523: sync 2024-09-18T12:52:18.553 INFO:tasks.workunit.client.0.smithi045.stdout:3/470: truncate d0/d22/f71 958777 0 2024-09-18T12:52:18.554 INFO:tasks.workunit.client.0.smithi045.stdout:6/476: rmdir d9/d1a/d48/d8f/d98 39 2024-09-18T12:52:18.558 INFO:tasks.workunit.client.0.smithi045.stdout:7/435: dwrite d13/d31/d5f/d94/f7f [4194304,4194304] 0 2024-09-18T12:52:18.559 INFO:tasks.workunit.client.0.smithi045.stdout:4/676: creat db/de/d1e/fde x:0 0 0 2024-09-18T12:52:18.560 INFO:tasks.workunit.client.0.smithi045.stdout:2/524: fsync d5/d46/f73 0 2024-09-18T12:52:18.562 INFO:tasks.workunit.client.0.smithi045.stdout:4/677: write db/f63 [1536570,6621] 0 2024-09-18T12:52:18.565 INFO:tasks.workunit.client.0.smithi045.stdout:3/471: dwrite d0/d29/d5f/f65 [4194304,4194304] 0 2024-09-18T12:52:18.566 INFO:tasks.workunit.client.0.smithi045.stdout:7/436: rename d13/d31/f53 to d13/f9c 0 2024-09-18T12:52:18.569 INFO:tasks.workunit.client.0.smithi045.stdout:6/477: creat d9/d1a/d48/d8f/d9f/faf x:0 0 0 2024-09-18T12:52:18.571 INFO:tasks.workunit.client.1.smithi161.stdout:2/953: symlink d0/d4/d78/l147 0 2024-09-18T12:52:18.573 INFO:tasks.workunit.client.1.smithi161.stdout:5/959: symlink d3/d44/d6f/dca/d10d/d11b/l135 0 2024-09-18T12:52:18.574 INFO:tasks.workunit.client.1.smithi161.stdout:5/960: fdatasync d3/d8/de4/d8d/db0/f111 0 2024-09-18T12:52:18.576 INFO:tasks.workunit.client.1.smithi161.stdout:2/954: truncate d0/d1/d4c/d67/db9/dcb/d8a/f124 864260 0 2024-09-18T12:52:18.576 INFO:tasks.workunit.client.1.smithi161.stdout:5/961: truncate d3/d3b/fe8 5049432 0 2024-09-18T12:52:18.577 INFO:tasks.workunit.client.1.smithi161.stdout:8/953: truncate d0/d3/d10/f42 3173306 0 2024-09-18T12:52:18.578 INFO:tasks.workunit.client.0.smithi045.stdout:7/437: chown d13/d44/f87 11195674 1 2024-09-18T12:52:18.581 INFO:tasks.workunit.client.0.smithi045.stdout:2/525: unlink d5/d46/lad 0 2024-09-18T12:52:18.582 INFO:tasks.workunit.client.0.smithi045.stdout:4/678: dread db/d20/f70 [0,4194304] 0 2024-09-18T12:52:18.584 INFO:tasks.workunit.client.1.smithi161.stdout:8/954: fsync d0/d3/d91/fc7 0 2024-09-18T12:52:18.586 INFO:tasks.workunit.client.0.smithi045.stdout:8/523: dread d11/d20/d60/f70 [0,4194304] 0 2024-09-18T12:52:18.587 INFO:tasks.workunit.client.0.smithi045.stdout:8/524: write d11/d14/d53/f4f [4317620,129553] 0 2024-09-18T12:52:18.590 INFO:tasks.workunit.client.1.smithi161.stdout:5/962: rename d3/d8/de4/f104 to d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/da4/daf/f136 0 2024-09-18T12:52:18.594 INFO:tasks.workunit.client.1.smithi161.stdout:6/993: creat d4/d39/f14d x:0 0 0 2024-09-18T12:52:18.597 INFO:tasks.workunit.client.0.smithi045.stdout:8/525: dwrite d11/f12 [0,4194304] 0 2024-09-18T12:52:18.597 INFO:tasks.workunit.client.0.smithi045.stdout:1/473: dwrite d0/d2d/f83 [0,4194304] 0 2024-09-18T12:52:18.604 INFO:tasks.workunit.client.0.smithi045.stdout:7/438: creat d13/d31/d52/d81/f9d x:0 0 0 2024-09-18T12:52:18.605 INFO:tasks.workunit.client.0.smithi045.stdout:4/679: creat db/de/d1e/d3e/d78/fdf x:0 0 0 2024-09-18T12:52:18.610 INFO:tasks.workunit.client.1.smithi161.stdout:9/821: dwrite d0/d47/d48/f61 [0,4194304] 0 2024-09-18T12:52:18.616 INFO:tasks.workunit.client.1.smithi161.stdout:6/994: dread d4/d1a/d1c/d3e/d83/d9e/fa4 [0,4194304] 0 2024-09-18T12:52:18.618 INFO:tasks.workunit.client.0.smithi045.stdout:8/526: dread d11/d23/f2b [0,4194304] 0 2024-09-18T12:52:18.620 INFO:tasks.workunit.client.0.smithi045.stdout:8/527: write d11/d14/d53/d41/f9a [645560,107917] 0 2024-09-18T12:52:18.621 INFO:tasks.workunit.client.1.smithi161.stdout:5/963: creat d3/d44/d6f/dca/d10d/d4b/d8e/f137 x:0 0 0 2024-09-18T12:52:18.621 INFO:tasks.workunit.client.0.smithi045.stdout:8/528: chown d11/d14/d72/l93 16328 1 2024-09-18T12:52:18.622 INFO:tasks.workunit.client.0.smithi045.stdout:8/529: chown d11/d14/f19 419589 1 2024-09-18T12:52:18.623 INFO:tasks.workunit.client.1.smithi161.stdout:6/995: dwrite d4/f10 [0,4194304] 0 2024-09-18T12:52:18.624 INFO:tasks.workunit.client.1.smithi161.stdout:5/964: chown d3/d44/d6f/dca/d10d/dd7/fed 37 1 2024-09-18T12:52:18.629 INFO:tasks.workunit.client.1.smithi161.stdout:6/996: mkdir d4/d1a/d1c/d3e/d83/da2/db4/d14e 0 2024-09-18T12:52:18.637 INFO:tasks.workunit.client.1.smithi161.stdout:6/997: dwrite d4/d61/d69/fe7 [0,4194304] 0 2024-09-18T12:52:18.641 INFO:tasks.workunit.client.1.smithi161.stdout:4/961: dwrite d5/f8 [0,4194304] 0 2024-09-18T12:52:18.642 INFO:tasks.workunit.client.1.smithi161.stdout:5/965: dread d3/d44/d6f/dca/d10d/d4b/d8e/d24/f70 [0,4194304] 0 2024-09-18T12:52:18.649 INFO:tasks.workunit.client.1.smithi161.stdout:4/962: mknod d5/d14/d5f/da1/de9/c15a 0 2024-09-18T12:52:18.653 INFO:tasks.workunit.client.0.smithi045.stdout:8/530: dread d11/d14/f3a [0,4194304] 0 2024-09-18T12:52:18.655 INFO:tasks.workunit.client.1.smithi161.stdout:4/963: truncate d5/d14/fdc 381380 0 2024-09-18T12:52:18.658 INFO:tasks.workunit.client.0.smithi045.stdout:9/461: truncate d0/d3/d6/d10/f1b 3121165 0 2024-09-18T12:52:18.662 INFO:tasks.workunit.client.1.smithi161.stdout:6/998: link d4/d1a/d1c/d3e/d83/d9e/db1/c27 d4/d39/c14f 0 2024-09-18T12:52:18.664 INFO:tasks.workunit.client.0.smithi045.stdout:7/439: creat d13/d44/d37/d6a/f9e x:0 0 0 2024-09-18T12:52:18.666 INFO:tasks.workunit.client.0.smithi045.stdout:4/680: truncate db/de/f6a 1320020 0 2024-09-18T12:52:18.667 INFO:tasks.workunit.client.0.smithi045.stdout:5/622: write d6/db/d6a/d77/f8c [457956,96346] 0 2024-09-18T12:52:18.667 INFO:tasks.workunit.client.1.smithi161.stdout:6/999: symlink d4/d1a/d1c/d3e/d83/dad/l150 0 2024-09-18T12:52:18.668 INFO:tasks.workunit.client.0.smithi045.stdout:8/531: mknod d11/d76/c9c 0 2024-09-18T12:52:18.670 INFO:tasks.workunit.client.1.smithi161.stdout:4/964: rmdir d5/d14/d67/d84/d120/d142 0 2024-09-18T12:52:18.673 INFO:tasks.workunit.client.0.smithi045.stdout:7/440: creat d13/d44/d37/d70/f9f x:0 0 0 2024-09-18T12:52:18.674 INFO:tasks.workunit.client.1.smithi161.stdout:4/965: creat d5/d14/d5f/da1/de9/f15b x:0 0 0 2024-09-18T12:52:18.675 INFO:tasks.workunit.client.0.smithi045.stdout:4/681: creat db/d20/d6b/fe0 x:0 0 0 2024-09-18T12:52:18.676 INFO:tasks.workunit.client.0.smithi045.stdout:4/682: dread - db/d2c/d35/d40/d77/fb3 zero size 2024-09-18T12:52:18.676 INFO:tasks.workunit.client.0.smithi045.stdout:5/623: mknod d6/d28/d2b/d51/d97/ccf 0 2024-09-18T12:52:18.679 INFO:tasks.workunit.client.0.smithi045.stdout:9/462: rename d0/d3/l54 to d0/d3/d6/d10/d26/d2e/d4e/d76/l94 0 2024-09-18T12:52:18.680 INFO:tasks.workunit.client.1.smithi161.stdout:4/966: symlink d5/d14/d67/dc7/d47/l15c 0 2024-09-18T12:52:18.680 INFO:tasks.workunit.client.0.smithi045.stdout:1/474: link d0/d2d/f68 d0/d2d/d6c/f8c 0 2024-09-18T12:52:18.683 INFO:tasks.workunit.client.0.smithi045.stdout:8/532: truncate d11/d14/d53/d41/f74 1059755 0 2024-09-18T12:52:18.684 INFO:tasks.workunit.client.0.smithi045.stdout:7/441: symlink d13/d44/d37/d70/d77/d6d/la0 0 2024-09-18T12:52:18.686 INFO:tasks.workunit.client.0.smithi045.stdout:1/475: rename d0/d2d/f83 to d0/d12/d32/d67/d6a/f8d 0 2024-09-18T12:52:18.688 INFO:tasks.workunit.client.0.smithi045.stdout:1/476: readlink d0/d2d/d2b/d30/d40/l73 0 2024-09-18T12:52:18.688 INFO:tasks.workunit.client.0.smithi045.stdout:5/624: link d6/d3e/f35 d6/d28/fd0 0 2024-09-18T12:52:18.688 INFO:tasks.workunit.client.0.smithi045.stdout:1/477: chown d0/fc 631 1 2024-09-18T12:52:18.689 INFO:tasks.workunit.client.0.smithi045.stdout:1/478: chown d0/c82 28065067 1 2024-09-18T12:52:18.692 INFO:tasks.workunit.client.0.smithi045.stdout:4/683: dread f9 [4194304,4194304] 0 2024-09-18T12:52:18.692 INFO:tasks.workunit.client.0.smithi045.stdout:7/442: unlink d13/d31/f26 0 2024-09-18T12:52:18.693 INFO:tasks.workunit.client.1.smithi161.stdout:4/967: dread d5/d14/d5f/da1/fc0 [0,4194304] 0 2024-09-18T12:52:18.694 INFO:tasks.workunit.client.0.smithi045.stdout:8/533: rename d11/d20/f27 to d11/d23/f9d 0 2024-09-18T12:52:18.694 INFO:tasks.workunit.client.1.smithi161.stdout:4/968: read - d5/d14/d5f/da1/de9/f150 zero size 2024-09-18T12:52:18.695 INFO:tasks.workunit.client.0.smithi045.stdout:1/479: fsync d0/d2e/f28 0 2024-09-18T12:52:18.695 INFO:tasks.workunit.client.0.smithi045.stdout:8/534: readlink d11/d20/d46/l4e 0 2024-09-18T12:52:18.696 INFO:tasks.workunit.client.0.smithi045.stdout:8/535: chown d11/d14/f4c 4119925 1 2024-09-18T12:52:18.698 INFO:tasks.workunit.client.1.smithi161.stdout:4/969: mknod d5/d14/d67/dc7/d60/d95/dda/d155/d44/de2/dfe/c15d 0 2024-09-18T12:52:18.700 INFO:tasks.workunit.client.0.smithi045.stdout:0/523: sync 2024-09-18T12:52:18.704 INFO:tasks.workunit.client.1.smithi161.stdout:4/970: dwrite d5/d14/d67/d84/d113/f12b [0,4194304] 0 2024-09-18T12:52:18.704 INFO:tasks.workunit.client.1.smithi161.stdout:2/955: write d0/d5/d43/d35/f7a [3610725,72507] 0 2024-09-18T12:52:18.705 INFO:tasks.workunit.client.1.smithi161.stdout:3/913: sync 2024-09-18T12:52:18.708 INFO:tasks.workunit.client.1.smithi161.stdout:2/956: mkdir d0/d1/deb/d148 0 2024-09-18T12:52:18.712 INFO:tasks.workunit.client.1.smithi161.stdout:2/957: creat d0/d5/d53/d7d/f149 x:0 0 0 2024-09-18T12:52:18.714 INFO:tasks.workunit.client.1.smithi161.stdout:8/955: dwrite d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/f46 [4194304,4194304] 0 2024-09-18T12:52:18.715 INFO:tasks.workunit.client.0.smithi045.stdout:7/443: rmdir d13/d44/d37/d70/d77 39 2024-09-18T12:52:18.716 INFO:tasks.workunit.client.0.smithi045.stdout:4/684: dwrite db/de/d1a/d2e/f81 [0,4194304] 0 2024-09-18T12:52:18.716 INFO:tasks.workunit.client.0.smithi045.stdout:0/524: dread - d6/d7/f79 zero size 2024-09-18T12:52:18.718 INFO:tasks.workunit.client.1.smithi161.stdout:2/958: creat d0/d1/deb/d3d/da5/f14a x:0 0 0 2024-09-18T12:52:18.719 INFO:tasks.workunit.client.0.smithi045.stdout:6/478: truncate d9/d1a/f80 1995826 0 2024-09-18T12:52:18.719 INFO:tasks.workunit.client.0.smithi045.stdout:7/444: write d13/d44/d37/d6a/f9e [1017575,57106] 0 2024-09-18T12:52:18.721 INFO:tasks.workunit.client.0.smithi045.stdout:2/526: write d5/d5f/db2/f55 [5074787,66244] 0 2024-09-18T12:52:18.724 INFO:tasks.workunit.client.1.smithi161.stdout:2/959: fdatasync d0/d5/d43/fba 0 2024-09-18T12:52:18.727 INFO:tasks.workunit.client.0.smithi045.stdout:2/527: chown d5/d2c/f63 4549361 1 2024-09-18T12:52:18.727 INFO:tasks.workunit.client.0.smithi045.stdout:0/525: chown d6/d35/l55 21360 1 2024-09-18T12:52:18.728 INFO:tasks.workunit.client.0.smithi045.stdout:8/536: dread d11/d14/d72/f8d [0,4194304] 0 2024-09-18T12:52:18.730 INFO:tasks.workunit.client.1.smithi161.stdout:9/822: dwrite d0/d20/d49/fb5 [0,4194304] 0 2024-09-18T12:52:18.731 INFO:tasks.workunit.client.0.smithi045.stdout:4/685: rename db/de/d1e/d3e/d9a/d73/d75 to db/de/d1e/d3e/de1 0 2024-09-18T12:52:18.732 INFO:tasks.workunit.client.0.smithi045.stdout:7/445: chown d13/d44/d37/d70/d77/f7b 5722117 1 2024-09-18T12:52:18.733 INFO:tasks.workunit.client.1.smithi161.stdout:3/914: dread d1/f19 [0,4194304] 0 2024-09-18T12:52:18.733 INFO:tasks.workunit.client.1.smithi161.stdout:9/823: truncate d0/db/f111 710553 0 2024-09-18T12:52:18.735 INFO:tasks.workunit.client.0.smithi045.stdout:6/479: dwrite d9/d1a/d2d/d38/f82 [0,4194304] 0 2024-09-18T12:52:18.736 INFO:tasks.workunit.client.0.smithi045.stdout:6/480: chown d9/c15 0 1 2024-09-18T12:52:18.738 INFO:tasks.workunit.client.0.smithi045.stdout:1/480: dread d0/f2 [0,4194304] 0 2024-09-18T12:52:18.738 INFO:tasks.workunit.client.1.smithi161.stdout:2/960: creat d0/d1/d4c/d67/db9/d10a/f14b x:0 0 0 2024-09-18T12:52:18.739 INFO:tasks.workunit.client.1.smithi161.stdout:9/824: mknod d0/d93/c113 0 2024-09-18T12:52:18.747 INFO:tasks.workunit.client.0.smithi045.stdout:6/481: rename d9/d1a/da1 to d9/d1a/d2d/d32/db0 0 2024-09-18T12:52:18.748 INFO:tasks.workunit.client.1.smithi161.stdout:3/915: dread d1/d2e/d14/d65/d76/d88/f8e [0,4194304] 0 2024-09-18T12:52:18.749 INFO:tasks.workunit.client.1.smithi161.stdout:2/961: creat d0/d1/d4c/d67/db9/f14c x:0 0 0 2024-09-18T12:52:18.752 INFO:tasks.workunit.client.0.smithi045.stdout:1/481: write d0/f69 [2790480,95777] 0 2024-09-18T12:52:18.754 INFO:tasks.workunit.client.0.smithi045.stdout:2/528: creat d5/fb7 x:0 0 0 2024-09-18T12:52:18.755 INFO:tasks.workunit.client.1.smithi161.stdout:5/966: write d3/f13 [298905,92930] 0 2024-09-18T12:52:18.755 INFO:tasks.workunit.client.0.smithi045.stdout:7/446: symlink d13/d1a/d9b/la1 0 2024-09-18T12:52:18.755 INFO:tasks.workunit.client.0.smithi045.stdout:0/526: dread d6/d35/f37 [0,4194304] 0 2024-09-18T12:52:18.756 INFO:tasks.workunit.client.0.smithi045.stdout:0/527: chown d6/d35 103 1 2024-09-18T12:52:18.757 INFO:tasks.workunit.client.1.smithi161.stdout:3/916: mknod d1/d2e/d24/d1d/d89/db0/c139 0 2024-09-18T12:52:18.757 INFO:tasks.workunit.client.0.smithi045.stdout:7/447: stat d13/d31/d33/d64/d78/c7a 0 2024-09-18T12:52:18.758 INFO:tasks.workunit.client.1.smithi161.stdout:3/917: readlink d1/d2e/d24/lec 0 2024-09-18T12:52:18.761 INFO:tasks.workunit.client.1.smithi161.stdout:5/967: dread d3/d44/d6f/dca/d10d/d4b/d8e/d24/f70 [0,4194304] 0 2024-09-18T12:52:18.763 INFO:tasks.workunit.client.0.smithi045.stdout:1/482: mknod d0/d2e/c8e 0 2024-09-18T12:52:18.764 INFO:tasks.workunit.client.1.smithi161.stdout:5/968: dread d3/d44/d6f/dca/d10d/d4b/d8e/d24/d61/de6/f11e [0,4194304] 0 2024-09-18T12:52:18.764 INFO:tasks.workunit.client.0.smithi045.stdout:1/483: stat d0/d2d/d2b/d30/f48 0 2024-09-18T12:52:18.765 INFO:tasks.workunit.client.1.smithi161.stdout:5/969: chown d3/d44/d6f/d86/dfa 22472124 1 2024-09-18T12:52:18.766 INFO:tasks.workunit.client.1.smithi161.stdout:5/970: chown d3/d44/d6f/dca/d10d/dd7 6937917 1 2024-09-18T12:52:18.768 INFO:tasks.workunit.client.0.smithi045.stdout:7/448: rmdir d13 39 2024-09-18T12:52:18.768 INFO:tasks.workunit.client.1.smithi161.stdout:2/962: dread d0/d5/d43/f18 [0,4194304] 0 2024-09-18T12:52:18.769 INFO:tasks.workunit.client.0.smithi045.stdout:8/537: dread d11/f17 [4194304,4194304] 0 2024-09-18T12:52:18.771 INFO:tasks.workunit.client.0.smithi045.stdout:6/482: getdents d9/d1a/d2d/d32/db0 0 2024-09-18T12:52:18.775 INFO:tasks.workunit.client.0.smithi045.stdout:1/484: rename d0/d12/d32/d37 to d0/d2d/d2b/d30/d40/d60/d8f 0 2024-09-18T12:52:18.776 INFO:tasks.workunit.client.1.smithi161.stdout:2/963: rmdir d0/d71/da9/d9f/dfe 39 2024-09-18T12:52:18.776 INFO:tasks.workunit.client.0.smithi045.stdout:1/485: chown d0/f69 53622294 1 2024-09-18T12:52:18.777 INFO:tasks.workunit.client.1.smithi161.stdout:2/964: dread - d0/d1/d4c/f111 zero size 2024-09-18T12:52:18.780 INFO:tasks.workunit.client.1.smithi161.stdout:3/918: getdents d1/d2e/d24/d1d/d89 0 2024-09-18T12:52:18.781 INFO:tasks.workunit.client.1.smithi161.stdout:3/919: read d1/d2e/d68/d69/fc9 [431290,2011] 0 2024-09-18T12:52:18.782 INFO:tasks.workunit.client.0.smithi045.stdout:8/538: chown d11/d14/d53/c95 37 1 2024-09-18T12:52:18.791 INFO:tasks.workunit.client.0.smithi045.stdout:1/486: rmdir d0/d12 39 2024-09-18T12:52:18.793 INFO:tasks.workunit.client.0.smithi045.stdout:8/539: mknod d11/d76/c9e 0 2024-09-18T12:52:18.799 INFO:tasks.workunit.client.1.smithi161.stdout:8/956: dwrite d0/d3/d10/d21/f48 [0,4194304] 0 2024-09-18T12:52:18.800 INFO:tasks.workunit.client.0.smithi045.stdout:8/540: symlink d11/d14/d53/d41/l9f 0 2024-09-18T12:52:18.802 INFO:tasks.workunit.client.1.smithi161.stdout:8/957: rmdir d0/d3/d10/d21/d4a 39 2024-09-18T12:52:18.805 INFO:tasks.workunit.client.0.smithi045.stdout:7/449: getdents d13/d31/d33/d64/d78 0 2024-09-18T12:52:18.808 INFO:tasks.workunit.client.0.smithi045.stdout:6/483: getdents d9/d1a/d48/d8f/d98/dab 0 2024-09-18T12:52:18.809 INFO:tasks.workunit.client.0.smithi045.stdout:8/541: dwrite d11/d20/d46/f51 [0,4194304] 0 2024-09-18T12:52:18.810 INFO:tasks.workunit.client.0.smithi045.stdout:6/484: stat d9/d1a/d2d/d38/d5b 0 2024-09-18T12:52:18.810 INFO:tasks.workunit.client.0.smithi045.stdout:8/542: stat d11/l6a 0 2024-09-18T12:52:18.811 INFO:tasks.workunit.client.0.smithi045.stdout:4/686: dwrite db/f21 [0,4194304] 0 2024-09-18T12:52:18.811 INFO:tasks.workunit.client.1.smithi161.stdout:9/825: write d0/d20/d49/f14 [3851199,73718] 0 2024-09-18T12:52:18.812 INFO:tasks.workunit.client.0.smithi045.stdout:8/543: stat d11/d14/d53/d41/d57/d98 0 2024-09-18T12:52:18.813 INFO:tasks.workunit.client.0.smithi045.stdout:8/544: stat d11/l49 0 2024-09-18T12:52:18.815 INFO:tasks.workunit.client.0.smithi045.stdout:9/463: rename d0/d3/d6/d64/d88/l8d to d0/d3/d6/d10/d26/l95 0 2024-09-18T12:52:18.817 INFO:tasks.workunit.client.0.smithi045.stdout:1/487: getdents d0 0 2024-09-18T12:52:18.818 INFO:tasks.workunit.client.0.smithi045.stdout:3/472: sync 2024-09-18T12:52:18.820 INFO:tasks.workunit.client.0.smithi045.stdout:2/529: write d5/d3a/f4c [2104747,90105] 0 2024-09-18T12:52:18.821 INFO:tasks.workunit.client.1.smithi161.stdout:9/826: creat d0/d93/da0/f114 x:0 0 0 2024-09-18T12:52:18.821 INFO:tasks.workunit.client.0.smithi045.stdout:0/528: write d6/d48/d5e/d39/d58/d3c/f47 [3366782,102737] 0 2024-09-18T12:52:18.824 INFO:tasks.workunit.client.0.smithi045.stdout:4/687: creat db/de/d1e/d3e/d47/d59/d7a/fe2 x:0 0 0 2024-09-18T12:52:18.824 INFO:tasks.workunit.client.0.smithi045.stdout:6/485: read d9/d1a/d2d/d38/d5b/f61 [848183,119171] 0 2024-09-18T12:52:18.824 INFO:tasks.workunit.client.1.smithi161.stdout:1/815: sync 2024-09-18T12:52:18.824 INFO:tasks.workunit.client.1.smithi161.stdout:0/953: sync 2024-09-18T12:52:18.826 INFO:tasks.workunit.client.1.smithi161.stdout:1/816: write d1/d26/d88/fbe [346704,105141] 0 2024-09-18T12:52:18.828 INFO:tasks.workunit.client.1.smithi161.stdout:2/965: write d0/d1/d4c/d67/db9/dcb/d8a/da8/fc4 [1750544,131032] 0 2024-09-18T12:52:18.829 INFO:tasks.workunit.client.0.smithi045.stdout:7/450: rename d13/d31/d5f/f99 to d13/d44/d37/d70/d77/d6d/fa2 0 2024-09-18T12:52:18.832 INFO:tasks.workunit.client.0.smithi045.stdout:1/488: rmdir d0 39 2024-09-18T12:52:18.833 INFO:tasks.workunit.client.1.smithi161.stdout:5/971: dwrite d3/d44/d6f/dca/d10d/d4b/d8e/d24/f36 [0,4194304] 0 2024-09-18T12:52:18.833 INFO:tasks.workunit.client.1.smithi161.stdout:1/817: truncate d1/da/d31/fd3 2130839 0 2024-09-18T12:52:18.836 INFO:tasks.workunit.client.0.smithi045.stdout:2/530: rmdir d5/d3a/d3e 39 2024-09-18T12:52:18.836 INFO:tasks.workunit.client.1.smithi161.stdout:3/920: write d1/d2e/d68/d92/ded/f38 [54411,124373] 0 2024-09-18T12:52:18.836 INFO:tasks.workunit.client.1.smithi161.stdout:9/827: dread d0/f29 [0,4194304] 0 2024-09-18T12:52:18.840 INFO:tasks.workunit.client.1.smithi161.stdout:8/958: write d0/d3/d10/d21/d4a/d52/d66/d5b/f5e [1872227,13644] 0 2024-09-18T12:52:18.842 INFO:tasks.workunit.client.0.smithi045.stdout:8/545: fsync f9 0 2024-09-18T12:52:18.843 INFO:tasks.workunit.client.1.smithi161.stdout:9/828: dwrite d0/d47/ff7 [0,4194304] 0 2024-09-18T12:52:18.843 INFO:tasks.workunit.client.1.smithi161.stdout:7/813: sync 2024-09-18T12:52:18.843 INFO:tasks.workunit.client.1.smithi161.stdout:4/971: sync 2024-09-18T12:52:18.844 INFO:tasks.workunit.client.1.smithi161.stdout:3/921: rmdir d1/d2e/d14/d65 39 2024-09-18T12:52:18.845 INFO:tasks.workunit.client.1.smithi161.stdout:9/829: chown d0/db/l40 7187 1 2024-09-18T12:52:18.846 INFO:tasks.workunit.client.1.smithi161.stdout:4/972: read - d5/d14/d67/dc7/d9b/f133 zero size 2024-09-18T12:52:18.846 INFO:tasks.workunit.client.0.smithi045.stdout:2/531: dwrite d5/d5f/da8/fa1 [4194304,4194304] 0 2024-09-18T12:52:18.847 INFO:tasks.workunit.client.0.smithi045.stdout:0/529: rename d6/d7/f79 to d6/d48/d5e/d39/d58/d3b/f95 0 2024-09-18T12:52:18.849 INFO:tasks.workunit.client.1.smithi161.stdout:9/830: write d0/d47/d48/d7f/d9e/da4/f109 [501431,7102] 0 2024-09-18T12:52:18.851 INFO:tasks.workunit.client.0.smithi045.stdout:0/530: write d6/d48/d5e/d39/d58/d3b/d65/f77 [15638,83477] 0 2024-09-18T12:52:18.851 INFO:tasks.workunit.client.1.smithi161.stdout:9/831: stat d0/d20/l78 0 2024-09-18T12:52:18.851 INFO:tasks.workunit.client.1.smithi161.stdout:0/954: dread df/d30/d71/d96/dd3/f74 [0,4194304] 0 2024-09-18T12:52:18.852 INFO:tasks.workunit.client.1.smithi161.stdout:5/972: creat d3/d3b/d54/dbd/d127/f138 x:0 0 0 2024-09-18T12:52:18.852 INFO:tasks.workunit.client.1.smithi161.stdout:9/832: write d0/dd4/feb [189816,97186] 0 2024-09-18T12:52:18.853 INFO:tasks.workunit.client.1.smithi161.stdout:9/833: dread - d0/d20/d49/fa1 zero size 2024-09-18T12:52:18.860 INFO:tasks.workunit.client.1.smithi161.stdout:2/966: write d0/d1/f7 [555409,76277] 0 2024-09-18T12:52:18.863 INFO:tasks.workunit.client.0.smithi045.stdout:5/625: sync 2024-09-18T12:52:18.863 INFO:tasks.workunit.client.0.smithi045.stdout:3/473: getdents d0/d29/d53 0 2024-09-18T12:52:18.863 INFO:tasks.workunit.client.0.smithi045.stdout:5/626: write d6/db/d19/f68 [4987565,86507] 0 2024-09-18T12:52:18.865 INFO:tasks.workunit.client.1.smithi161.stdout:1/818: dwrite d1/d26/f3f [0,4194304] 0 2024-09-18T12:52:18.867 INFO:tasks.workunit.client.1.smithi161.stdout:5/973: symlink d3/d3b/d7b/l139 0 2024-09-18T12:52:18.867 INFO:tasks.workunit.client.1.smithi161.stdout:5/974: chown d3/d44/d120/dde 114348 1 2024-09-18T12:52:18.868 INFO:tasks.workunit.client.1.smithi161.stdout:4/973: mknod d5/d14/d67/dc7/d60/d95/dda/d155/d44/df3/c15e 0 2024-09-18T12:52:18.870 INFO:tasks.workunit.client.0.smithi045.stdout:9/464: dwrite d0/d3/d6/d10/f81 [0,4194304] 0 2024-09-18T12:52:18.877 INFO:tasks.workunit.client.1.smithi161.stdout:2/967: chown d0/d5/c1c 421205853 1 2024-09-18T12:52:18.881 INFO:tasks.workunit.client.0.smithi045.stdout:8/546: dread d11/d14/f36 [0,4194304] 0 2024-09-18T12:52:18.881 INFO:tasks.workunit.client.1.smithi161.stdout:1/819: creat d1/daa/db2/f114 x:0 0 0 2024-09-18T12:52:18.883 INFO:tasks.workunit.client.1.smithi161.stdout:9/834: mkdir d0/d20/d115 0 2024-09-18T12:52:18.886 INFO:tasks.workunit.client.1.smithi161.stdout:3/922: creat d1/f13a x:0 0 0 2024-09-18T12:52:18.886 INFO:tasks.workunit.client.1.smithi161.stdout:5/975: dread d3/def/f2e [0,4194304] 0 2024-09-18T12:52:18.887 INFO:tasks.workunit.client.1.smithi161.stdout:3/923: write d1/d2e/d14/d2c/de5/f133 [912016,13220] 0 2024-09-18T12:52:18.888 INFO:tasks.workunit.client.0.smithi045.stdout:4/688: rename db/d2c/d35/c57 to db/d2c/d35/d40/d6d/da9/ce3 0 2024-09-18T12:52:18.888 INFO:tasks.workunit.client.1.smithi161.stdout:3/924: chown d1/d2e/d14/d78/ff3 27 1 2024-09-18T12:52:18.889 INFO:tasks.workunit.client.1.smithi161.stdout:3/925: stat d1/d2e/d24/d1d/d89/db0/ca3 0 2024-09-18T12:52:18.890 INFO:tasks.workunit.client.0.smithi045.stdout:7/451: write d13/d31/f2d [1580099,2747] 0 2024-09-18T12:52:18.891 INFO:tasks.workunit.client.0.smithi045.stdout:9/465: fsync d0/f3e 0 2024-09-18T12:52:18.891 INFO:tasks.workunit.client.0.smithi045.stdout:7/452: dread - d13/d44/d4c/f92 zero size 2024-09-18T12:52:18.893 INFO:tasks.workunit.client.0.smithi045.stdout:0/531: write d6/d35/f37 [1815222,97310] 0 2024-09-18T12:52:18.894 INFO:tasks.workunit.client.0.smithi045.stdout:0/532: chown d6/d48/d5e/c64 14 1 2024-09-18T12:52:18.895 INFO:tasks.workunit.client.1.smithi161.stdout:0/955: creat df/d29/d36/f14d x:0 0 0 2024-09-18T12:52:18.896 INFO:tasks.workunit.client.0.smithi045.stdout:0/533: chown d6/d7/f14 9156 1 2024-09-18T12:52:18.899 INFO:tasks.workunit.client.1.smithi161.stdout:7/814: dwrite d3/d8/d15/da7/d24/ddd/fde [0,4194304] 0 2024-09-18T12:52:18.903 INFO:tasks.workunit.client.0.smithi045.stdout:0/534: dwrite d6/d48/d5e/d39/d58/d86/f8f [0,4194304] 0 2024-09-18T12:52:18.905 INFO:tasks.workunit.client.0.smithi045.stdout:0/535: dread - d6/d48/d5e/d39/d58/d3b/f95 zero size 2024-09-18T12:52:18.908 INFO:tasks.workunit.client.0.smithi045.stdout:4/689: dread db/de/d1e/d3e/d47/fbb [0,4194304] 0 2024-09-18T12:52:18.951 INFO:tasks.workunit.client.0.smithi045.stdout:3/474: mknod d0/c9c 0 2024-09-18T12:52:18.952 INFO:tasks.workunit.client.1.smithi161.stdout:5/976: stat d3/def/c67 0 2024-09-18T12:52:18.954 INFO:tasks.workunit.client.0.smithi045.stdout:6/486: getdents d9/d1a/d2d/d32 0 2024-09-18T12:52:18.955 INFO:tasks.workunit.client.1.smithi161.stdout:2/968: write d0/d5/d43/d35/d98/fd9 [38872,123333] 0 2024-09-18T12:52:18.958 INFO:tasks.workunit.client.1.smithi161.stdout:8/959: getdents d0/d3/d10/d21/d4a/d52/d82/d96/dba/d10d 0 2024-09-18T12:52:18.959 INFO:tasks.workunit.client.1.smithi161.stdout:8/960: dread - d0/d3/d10/d21/d4a/d52/d82/d96/d98/ffc zero size 2024-09-18T12:52:18.960 INFO:tasks.workunit.client.0.smithi045.stdout:1/489: truncate d0/d12/d32/d67/d6d/f72 1482318 0 2024-09-18T12:52:18.961 INFO:tasks.workunit.client.0.smithi045.stdout:8/547: rename d11/d20/d59 to d11/d76/da0 0 2024-09-18T12:52:18.965 INFO:tasks.workunit.client.1.smithi161.stdout:8/961: dwrite d0/d3/d10/d21/d4a/db7/fd9 [0,4194304] 0 2024-09-18T12:52:18.967 INFO:tasks.workunit.client.1.smithi161.stdout:0/956: truncate df/d29/d36/f5b 4260516 0 2024-09-18T12:52:18.968 INFO:tasks.workunit.client.1.smithi161.stdout:0/957: chown df/de2/dc5/d86/f6c 58 1 2024-09-18T12:52:18.968 INFO:tasks.workunit.client.0.smithi045.stdout:9/466: rmdir d0/d3 39 2024-09-18T12:52:18.973 INFO:tasks.workunit.client.1.smithi161.stdout:7/815: symlink d3/d36/lf5 0 2024-09-18T12:52:18.975 INFO:tasks.workunit.client.0.smithi045.stdout:2/532: rmdir d5/d2c/d4d/d76/da6 0 2024-09-18T12:52:18.976 INFO:tasks.workunit.client.1.smithi161.stdout:0/958: dwrite df/d30/d4d/d92/f9e [4194304,4194304] 0 2024-09-18T12:52:18.980 INFO:tasks.workunit.client.1.smithi161.stdout:9/835: rename d0/d47/d48/f75 to d0/d16/d25/d86/dae/f116 0 2024-09-18T12:52:18.985 INFO:tasks.workunit.client.0.smithi045.stdout:4/690: write db/de/d1e/d49/f64 [1323207,126422] 0 2024-09-18T12:52:18.985 INFO:tasks.workunit.client.0.smithi045.stdout:4/691: dread - db/d20/fd6 zero size 2024-09-18T12:52:18.988 INFO:tasks.workunit.client.0.smithi045.stdout:3/475: symlink d0/d1e/d2c/d3a/l9d 0 2024-09-18T12:52:18.988 INFO:tasks.workunit.client.0.smithi045.stdout:3/476: chown d0/d22/c2f 6683 1 2024-09-18T12:52:18.991 INFO:tasks.workunit.client.0.smithi045.stdout:5/627: link d6/d3e/lb3 d6/d28/d2b/d51/d97/ld1 0 2024-09-18T12:52:18.991 INFO:tasks.workunit.client.0.smithi045.stdout:5/628: chown d6/d28/c30 235022 1 2024-09-18T12:52:18.992 INFO:tasks.workunit.client.1.smithi161.stdout:4/974: getdents d5/d14/d5f/da1 0 2024-09-18T12:52:18.992 INFO:tasks.workunit.client.0.smithi045.stdout:5/629: dread - d6/db/d19/d92/fbd zero size 2024-09-18T12:52:18.995 INFO:tasks.workunit.client.1.smithi161.stdout:1/820: sync 2024-09-18T12:52:18.999 INFO:tasks.workunit.client.1.smithi161.stdout:4/975: dwrite d5/d14/d67/dc7/f156 [0,4194304] 0 2024-09-18T12:52:18.999 INFO:tasks.workunit.client.0.smithi045.stdout:5/630: dwrite d6/db/d5a/d78/f45 [4194304,4194304] 0 2024-09-18T12:52:19.010 INFO:tasks.workunit.client.1.smithi161.stdout:9/836: dread d0/d47/df1/f72 [0,4194304] 0 2024-09-18T12:52:19.014 INFO:tasks.workunit.client.0.smithi045.stdout:9/467: dread d0/d3/d6/d10/d2c/d63/f7e [0,4194304] 0 2024-09-18T12:52:19.017 INFO:tasks.workunit.client.1.smithi161.stdout:9/837: dread d0/d16/d25/d28/f33 [4194304,4194304] 0 2024-09-18T12:52:19.019 INFO:tasks.workunit.client.1.smithi161.stdout:7/816: mknod d3/d8/d15/da7/d24/ddd/de5/cf6 0 2024-09-18T12:52:19.029 INFO:tasks.workunit.client.0.smithi045.stdout:5/631: mknod d6/d3e/cd2 0 2024-09-18T12:52:19.035 INFO:tasks.workunit.client.1.smithi161.stdout:3/926: getdents d1/d2e/d24/d1d/d89/db0 0 2024-09-18T12:52:19.036 INFO:tasks.workunit.client.0.smithi045.stdout:9/468: mknod d0/d3/d6/c96 0 2024-09-18T12:52:19.041 INFO:tasks.workunit.client.1.smithi161.stdout:0/959: creat df/de2/dc5/f14e x:0 0 0 2024-09-18T12:52:19.042 INFO:tasks.workunit.client.0.smithi045.stdout:3/477: mknod d0/d29/c9e 0 2024-09-18T12:52:19.043 INFO:tasks.workunit.client.1.smithi161.stdout:4/976: symlink d5/d14/d67/dc7/d47/d49/l15f 0 2024-09-18T12:52:19.045 INFO:tasks.workunit.client.1.smithi161.stdout:2/969: rename d0/d1/d4c/d67/db9/d10a to d0/d5/d14d 0 2024-09-18T12:52:19.048 INFO:tasks.workunit.client.1.smithi161.stdout:5/977: getdents d3/d44 0 2024-09-18T12:52:19.052 INFO:tasks.workunit.client.0.smithi045.stdout:4/692: creat db/de/d1e/d3e/d9a/fe4 x:0 0 0 2024-09-18T12:52:19.053 INFO:tasks.workunit.client.0.smithi045.stdout:8/548: getdents d11 0 2024-09-18T12:52:19.055 INFO:tasks.workunit.client.0.smithi045.stdout:8/549: write d11/f12 [1209023,125353] 0 2024-09-18T12:52:19.055 INFO:tasks.workunit.client.1.smithi161.stdout:0/960: creat df/de2/dc5/d8a/f14f x:0 0 0 2024-09-18T12:52:19.058 INFO:tasks.workunit.client.1.smithi161.stdout:4/977: mknod d5/d32/d39/db6/c160 0 2024-09-18T12:52:19.060 INFO:tasks.workunit.client.1.smithi161.stdout:2/970: rename d0/d1/d4c/d67/db9/dcb/d8a to d0/d71/da9/dd6/df7/d14e 0 2024-09-18T12:52:19.061 INFO:tasks.workunit.client.1.smithi161.stdout:9/838: creat d0/d20/d49/f117 x:0 0 0 2024-09-18T12:52:19.062 INFO:tasks.workunit.client.0.smithi045.stdout:4/693: mknod db/d2c/d35/d40/d6d/da9/ce5 0 2024-09-18T12:52:19.065 INFO:tasks.workunit.client.1.smithi161.stdout:4/978: creat d5/d14/d67/dc7/d60/d95/dda/d155/d44/d61/f161 x:0 0 0 2024-09-18T12:52:19.065 INFO:tasks.workunit.client.0.smithi045.stdout:8/550: write d11/d14/f3a [4891468,75895] 0 2024-09-18T12:52:19.067 INFO:tasks.workunit.client.1.smithi161.stdout:3/927: rename d1/d2e/d24/f112 to d1/d2e/d14/d65/d76/d8c/f13b 0 2024-09-18T12:52:19.068 INFO:tasks.workunit.client.1.smithi161.stdout:2/971: dwrite d0/d71/da9/dd6/df7/d14e/dfa/f11b [0,4194304] 0 2024-09-18T12:52:19.068 INFO:tasks.workunit.client.0.smithi045.stdout:4/694: symlink db/d2c/d35/le6 0 2024-09-18T12:52:19.069 INFO:tasks.workunit.client.1.smithi161.stdout:2/972: chown d0/d1/deb/d7e/c57 125025860 1 2024-09-18T12:52:19.070 INFO:tasks.workunit.client.0.smithi045.stdout:8/551: mkdir d11/d76/da0/da1 0 2024-09-18T12:52:19.073 INFO:tasks.workunit.client.0.smithi045.stdout:5/632: getdents d6/d28/d2b/d7f 0 2024-09-18T12:52:19.075 INFO:tasks.workunit.client.0.smithi045.stdout:4/695: unlink db/de/d1a/d2e/f92 0 2024-09-18T12:52:19.075 INFO:tasks.workunit.client.0.smithi045.stdout:4/696: fdatasync db/d20/fac 0 2024-09-18T12:52:19.076 INFO:tasks.workunit.client.1.smithi161.stdout:4/979: symlink d5/d14/d67/dc7/d47/dbc/d127/l162 0 2024-09-18T12:52:19.077 INFO:tasks.workunit.client.1.smithi161.stdout:3/928: dwrite d1/d2e/d14/d2c/de5/f133 [0,4194304] 0 2024-09-18T12:52:19.078 INFO:tasks.workunit.client.0.smithi045.stdout:5/633: fsync d6/db/f50 0 2024-09-18T12:52:19.079 INFO:tasks.workunit.client.1.smithi161.stdout:3/929: write d1/d2e/d24/f11f [142394,128841] 0 2024-09-18T12:52:19.080 INFO:tasks.workunit.client.0.smithi045.stdout:5/634: truncate d6/d28/d2b/f93 1566458 0 2024-09-18T12:52:19.081 INFO:tasks.workunit.client.1.smithi161.stdout:2/973: truncate d0/d1/d4c/d67/fc8 1152512 0 2024-09-18T12:52:19.082 INFO:tasks.workunit.client.0.smithi045.stdout:5/635: fdatasync d6/db/d6a/d77/f8c 0 2024-09-18T12:52:19.083 INFO:tasks.workunit.client.1.smithi161.stdout:0/961: dread df/de2/dc5/d89/f8b [0,4194304] 0 2024-09-18T12:52:19.083 INFO:tasks.workunit.client.1.smithi161.stdout:2/974: fsync d0/d71/da9/dd6/f102 0 2024-09-18T12:52:19.083 INFO:tasks.workunit.client.0.smithi045.stdout:4/697: mknod db/d20/d6b/ce7 0 2024-09-18T12:52:19.085 INFO:tasks.workunit.client.0.smithi045.stdout:4/698: dread - db/d2c/d35/dcc/dd0/fdd zero size 2024-09-18T12:52:19.086 INFO:tasks.workunit.client.1.smithi161.stdout:4/980: rename d5/d32/d39/db6/ff6 to d5/d14/d67/dc7/d60/d95/dda/d155/d44/d61/f163 0 2024-09-18T12:52:19.089 INFO:tasks.workunit.client.1.smithi161.stdout:9/839: getdents d0/db 0 2024-09-18T12:52:19.098 INFO:tasks.workunit.client.1.smithi161.stdout:4/981: rmdir d5/d14 39 2024-09-18T12:52:19.101 INFO:tasks.workunit.client.0.smithi045.stdout:5/636: creat d6/db/d19/dbc/fd3 x:0 0 0 2024-09-18T12:52:19.102 INFO:tasks.workunit.client.1.smithi161.stdout:4/982: dread d5/da9/db9/fe6 [0,4194304] 0 2024-09-18T12:52:19.104 INFO:tasks.workunit.client.1.smithi161.stdout:2/975: mknod d0/d71/da9/c14f 0 2024-09-18T12:52:19.106 INFO:tasks.workunit.client.0.smithi045.stdout:1/490: unlink d0/fa 0 2024-09-18T12:52:19.113 INFO:tasks.workunit.client.1.smithi161.stdout:4/983: chown d5/d14/d67/dc7/d47/d49/dca/d102 36 1 2024-09-18T12:52:19.114 INFO:tasks.workunit.client.1.smithi161.stdout:4/984: write d5/d14/d5f/da1/de9/f150 [761149,128863] 0 2024-09-18T12:52:19.117 INFO:tasks.workunit.client.1.smithi161.stdout:4/985: symlink d5/da9/db9/l164 0 2024-09-18T12:52:19.118 INFO:tasks.workunit.client.0.smithi045.stdout:5/637: dread d6/db/d19/f4f [0,4194304] 0 2024-09-18T12:52:19.118 INFO:tasks.workunit.client.1.smithi161.stdout:2/976: creat d0/d5/d43/f150 x:0 0 0 2024-09-18T12:52:19.119 INFO:tasks.workunit.client.1.smithi161.stdout:4/986: mkdir d5/d14/d67/dc7/d47/d49/dca/d100/d165 0 2024-09-18T12:52:19.120 INFO:tasks.workunit.client.0.smithi045.stdout:5/638: fdatasync d6/db/fe 0 2024-09-18T12:52:19.123 INFO:tasks.workunit.client.1.smithi161.stdout:2/977: creat d0/d71/da9/d9f/dd0/d10c/d132/f151 x:0 0 0 2024-09-18T12:52:19.123 INFO:tasks.workunit.client.1.smithi161.stdout:8/962: dwrite d0/f45 [4194304,4194304] 0 2024-09-18T12:52:19.127 INFO:tasks.workunit.client.0.smithi045.stdout:5/639: creat d6/db/d19/d92/d61/da5/dc9/fd4 x:0 0 0 2024-09-18T12:52:19.129 INFO:tasks.workunit.client.0.smithi045.stdout:5/640: write d6/db/d19/d92/fbd [479558,97871] 0 2024-09-18T12:52:19.130 INFO:tasks.workunit.client.1.smithi161.stdout:8/963: unlink d0/d3/fc3 0 2024-09-18T12:52:19.135 INFO:tasks.workunit.client.1.smithi161.stdout:8/964: mknod d0/d3/d91/c149 0 2024-09-18T12:52:19.135 INFO:tasks.workunit.client.1.smithi161.stdout:2/978: dwrite d0/d71/da9/d9f/dfe/f11c [0,4194304] 0 2024-09-18T12:52:19.139 INFO:tasks.workunit.client.1.smithi161.stdout:4/987: dread d5/d32/f38 [4194304,4194304] 0 2024-09-18T12:52:19.139 INFO:tasks.workunit.client.1.smithi161.stdout:8/965: creat d0/d3/d10/d21/d11e/f14a x:0 0 0 2024-09-18T12:52:19.141 INFO:tasks.workunit.client.1.smithi161.stdout:2/979: mkdir d0/d5/d43/d35/dee/d152 0 2024-09-18T12:52:19.141 INFO:tasks.workunit.client.1.smithi161.stdout:8/966: read - d0/d3/d10/f10b zero size 2024-09-18T12:52:19.144 INFO:tasks.workunit.client.1.smithi161.stdout:4/988: creat d5/d14/d67/d84/dae/d136/f166 x:0 0 0 2024-09-18T12:52:19.145 INFO:tasks.workunit.client.1.smithi161.stdout:8/967: dread d0/f6b [0,4194304] 0 2024-09-18T12:52:19.146 INFO:tasks.workunit.client.1.smithi161.stdout:2/980: unlink d0/d4/dab/fe4 0 2024-09-18T12:52:19.147 INFO:tasks.workunit.client.0.smithi045.stdout:7/453: truncate d13/f61 3083612 0 2024-09-18T12:52:19.148 INFO:tasks.workunit.client.0.smithi045.stdout:7/454: truncate d13/f8a 4749455 0 2024-09-18T12:52:19.150 INFO:tasks.workunit.client.0.smithi045.stdout:7/455: truncate d13/d44/d37/d70/f84 546211 0 2024-09-18T12:52:19.150 INFO:tasks.workunit.client.0.smithi045.stdout:7/456: fsync d13/f24 0 2024-09-18T12:52:19.154 INFO:tasks.workunit.client.1.smithi161.stdout:4/989: mknod d5/d14/d67/dc7/d47/d49/dca/d100/d165/c167 0 2024-09-18T12:52:19.157 INFO:tasks.workunit.client.0.smithi045.stdout:5/641: unlink d6/db/fbb 0 2024-09-18T12:52:19.157 INFO:tasks.workunit.client.0.smithi045.stdout:5/642: chown d6/d28/d2b/d51/d97 2371 1 2024-09-18T12:52:19.160 INFO:tasks.workunit.client.0.smithi045.stdout:5/643: rmdir d6/db/d6a/d6d 39 2024-09-18T12:52:19.166 INFO:tasks.workunit.client.0.smithi045.stdout:0/536: symlink d6/d48/d5e/d39/l96 0 2024-09-18T12:52:19.169 INFO:tasks.workunit.client.0.smithi045.stdout:0/537: fsync d6/d7/fa 0 2024-09-18T12:52:19.188 INFO:tasks.workunit.client.1.smithi161.stdout:9/840: truncate d0/d47/d48/f4a 1093133 0 2024-09-18T12:52:19.188 INFO:tasks.workunit.client.1.smithi161.stdout:0/962: dwrite df/d30/d71/fe9 [0,4194304] 0 2024-09-18T12:52:19.189 INFO:tasks.workunit.client.1.smithi161.stdout:9/841: chown d0/d16/d25/d28/f31 120 1 2024-09-18T12:52:19.190 INFO:tasks.workunit.client.1.smithi161.stdout:9/842: chown d0/dd4/cf6 8226900 1 2024-09-18T12:52:19.191 INFO:tasks.workunit.client.1.smithi161.stdout:9/843: creat d0/d47/f118 x:0 0 0 2024-09-18T12:52:19.192 INFO:tasks.workunit.client.1.smithi161.stdout:0/963: symlink df/de2/dc5/d86/da5/d12b/l150 0 2024-09-18T12:52:19.193 INFO:tasks.workunit.client.1.smithi161.stdout:0/964: truncate df/d29/f2c 4935904 0 2024-09-18T12:52:19.195 INFO:tasks.workunit.client.1.smithi161.stdout:0/965: mkdir df/d98/d128/dba/d151 0 2024-09-18T12:52:19.197 INFO:tasks.workunit.client.1.smithi161.stdout:9/844: dwrite d0/db/ff9 [0,4194304] 0 2024-09-18T12:52:19.199 INFO:tasks.workunit.client.1.smithi161.stdout:0/966: creat df/d30/d71/dfe/f152 x:0 0 0 2024-09-18T12:52:19.201 INFO:tasks.workunit.client.1.smithi161.stdout:0/967: creat df/d30/d71/d96/dd3/f153 x:0 0 0 2024-09-18T12:52:19.202 INFO:tasks.workunit.client.1.smithi161.stdout:8/968: getdents d0/d3/d10/d21/d11e 0 2024-09-18T12:52:19.203 INFO:tasks.workunit.client.1.smithi161.stdout:9/845: mknod d0/d47/d48/de7/c119 0 2024-09-18T12:52:19.204 INFO:tasks.workunit.client.1.smithi161.stdout:0/968: creat df/d29/d36/d7a/deb/f154 x:0 0 0 2024-09-18T12:52:19.206 INFO:tasks.workunit.client.1.smithi161.stdout:7/817: mknod d3/d8/d15/da7/cf7 0 2024-09-18T12:52:19.208 INFO:tasks.workunit.client.1.smithi161.stdout:9/846: symlink d0/d47/df1/d59/ddb/l11a 0 2024-09-18T12:52:19.210 INFO:tasks.workunit.client.1.smithi161.stdout:7/818: rmdir d3/d8/d15/da7/d4a/d64/d8c/d9f 39 2024-09-18T12:52:19.212 INFO:tasks.workunit.client.1.smithi161.stdout:9/847: write d0/d16/fdc [291092,63695] 0 2024-09-18T12:52:19.215 INFO:tasks.workunit.client.1.smithi161.stdout:8/969: dwrite d0/d3/d10/d21/d4a/f10e [0,4194304] 0 2024-09-18T12:52:19.215 INFO:tasks.workunit.client.0.smithi045.stdout:6/487: rename d9/d1a/d2d/d38/f40 to d9/d1a/d48/fb1 0 2024-09-18T12:52:19.217 INFO:tasks.workunit.client.0.smithi045.stdout:2/533: dwrite d5/d5f/db2/f43 [0,4194304] 0 2024-09-18T12:52:19.217 INFO:tasks.workunit.client.0.smithi045.stdout:9/469: truncate d0/d3/d6/f4f 432518 0 2024-09-18T12:52:19.218 INFO:tasks.workunit.client.1.smithi161.stdout:8/970: chown d0/d3/d10/d21/d4a/d52/d66 58841 1 2024-09-18T12:52:19.218 INFO:tasks.workunit.client.1.smithi161.stdout:4/990: write d5/da9/fef [233856,127035] 0 2024-09-18T12:52:19.219 INFO:tasks.workunit.client.0.smithi045.stdout:5/644: dread d6/d3e/f36 [0,4194304] 0 2024-09-18T12:52:19.220 INFO:tasks.workunit.client.0.smithi045.stdout:4/699: truncate db/f30 3310196 0 2024-09-18T12:52:19.222 INFO:tasks.workunit.client.1.smithi161.stdout:2/981: dwrite d0/d5/d43/d35/d80/fca [0,4194304] 0 2024-09-18T12:52:19.225 INFO:tasks.workunit.client.0.smithi045.stdout:5/645: write d6/db/d19/d92/d5c/dae/fbf [135164,39618] 0 2024-09-18T12:52:19.225 INFO:tasks.workunit.client.0.smithi045.stdout:3/478: rename d0/d29/d5f/f79 to d0/d1e/d91/d95/f9f 0 2024-09-18T12:52:19.226 INFO:tasks.workunit.client.0.smithi045.stdout:6/488: mknod d9/d1a/d48/d8f/d98/cb2 0 2024-09-18T12:52:19.228 INFO:tasks.workunit.client.0.smithi045.stdout:8/552: dwrite d11/f13 [0,4194304] 0 2024-09-18T12:52:19.230 INFO:tasks.workunit.client.1.smithi161.stdout:1/821: sync 2024-09-18T12:52:19.232 INFO:tasks.workunit.client.0.smithi045.stdout:4/700: unlink db/d1b/l39 0 2024-09-18T12:52:19.232 INFO:tasks.workunit.client.1.smithi161.stdout:1/822: chown d1/d26/d3a/d52/c5e 30816116 1 2024-09-18T12:52:19.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/848: creat d0/d20/d49/de6/f11b x:0 0 0 2024-09-18T12:52:19.235 INFO:tasks.workunit.client.0.smithi045.stdout:9/470: symlink d0/d3/d6/d10/d26/d2e/d4e/d76/l97 0 2024-09-18T12:52:19.237 INFO:tasks.workunit.client.0.smithi045.stdout:9/471: stat d0/d3/d6/d10/d2c/l5f 0 2024-09-18T12:52:19.245 INFO:tasks.workunit.client.1.smithi161.stdout:4/991: truncate d5/d14/d67/d84/f77 490580 0 2024-09-18T12:52:19.246 INFO:tasks.workunit.client.1.smithi161.stdout:7/819: dread d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f90 [0,4194304] 0 2024-09-18T12:52:19.246 INFO:tasks.workunit.client.0.smithi045.stdout:5/646: unlink d6/db/d6a/ca4 0 2024-09-18T12:52:19.246 INFO:tasks.workunit.client.0.smithi045.stdout:5/647: stat d6/l3b 0 2024-09-18T12:52:19.247 INFO:tasks.workunit.client.1.smithi161.stdout:7/820: chown d3/d8/d15/da7/d24/le6 2746 1 2024-09-18T12:52:19.248 INFO:tasks.workunit.client.0.smithi045.stdout:5/648: chown d6/d28/d2b/d51/d97/lb5 5 1 2024-09-18T12:52:19.248 INFO:tasks.workunit.client.1.smithi161.stdout:7/821: readlink d3/d8/d15/da7/d44/l9d 0 2024-09-18T12:52:19.248 INFO:tasks.workunit.client.0.smithi045.stdout:6/489: mkdir d9/d56/db3 0 2024-09-18T12:52:19.249 INFO:tasks.workunit.client.0.smithi045.stdout:5/649: write d6/db/d5a/d78/d66/fbe [898950,34230] 0 2024-09-18T12:52:19.250 INFO:tasks.workunit.client.1.smithi161.stdout:7/822: truncate d3/d8/d15/da7/d24/ddd/feb 33079 0 2024-09-18T12:52:19.250 INFO:tasks.workunit.client.1.smithi161.stdout:7/823: chown d3/d8/d15/de2 2 1 2024-09-18T12:52:19.250 INFO:tasks.workunit.client.0.smithi045.stdout:6/490: read d9/d56/f57 [3220120,33745] 0 2024-09-18T12:52:19.251 INFO:tasks.workunit.client.0.smithi045.stdout:3/479: mkdir d0/d29/d5f/d73/da0 0 2024-09-18T12:52:19.252 INFO:tasks.workunit.client.1.smithi161.stdout:7/824: truncate d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/fb9 565473 0 2024-09-18T12:52:19.253 INFO:tasks.workunit.client.1.smithi161.stdout:7/825: chown d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/fb9 1622744921 1 2024-09-18T12:52:19.255 INFO:tasks.workunit.client.0.smithi045.stdout:1/491: unlink d0/d2d/d2b/d30/f84 0 2024-09-18T12:52:19.256 INFO:tasks.workunit.client.1.smithi161.stdout:4/992: symlink d5/d14/d67/dc7/d60/d95/dda/d155/d44/de2/dfe/l168 0 2024-09-18T12:52:19.259 INFO:tasks.workunit.client.0.smithi045.stdout:9/472: chown d0/d3/d6/d10/d26/c38 437 1 2024-09-18T12:52:19.259 INFO:tasks.workunit.client.1.smithi161.stdout:0/969: dwrite df/d29/d36/f5b [0,4194304] 0 2024-09-18T12:52:19.260 INFO:tasks.workunit.client.1.smithi161.stdout:9/849: symlink d0/d47/d48/d88/l11c 0 2024-09-18T12:52:19.263 INFO:tasks.workunit.client.0.smithi045.stdout:0/538: link d6/d48/d5e/d39/d58/d3b/l56 d6/d48/l97 0 2024-09-18T12:52:19.264 INFO:tasks.workunit.client.1.smithi161.stdout:2/982: link d0/d5/d43/d23/d136/l6f d0/d1/deb/d3d/l153 0 2024-09-18T12:52:19.265 INFO:tasks.workunit.client.1.smithi161.stdout:2/983: chown d0/d71/da9/dd6/df7/d14e/da8/c12b 1760 1 2024-09-18T12:52:19.265 INFO:tasks.workunit.client.1.smithi161.stdout:2/984: dread - d0/d5/d43/d23/d136/d9b/f121 zero size 2024-09-18T12:52:19.265 INFO:tasks.workunit.client.1.smithi161.stdout:2/985: stat d0/d4/cb3 0 2024-09-18T12:52:19.270 INFO:tasks.workunit.client.0.smithi045.stdout:6/491: mknod d9/d1a/d48/d8f/d98/cb4 0 2024-09-18T12:52:19.273 INFO:tasks.workunit.client.1.smithi161.stdout:9/850: symlink d0/d93/l11d 0 2024-09-18T12:52:19.275 INFO:tasks.workunit.client.1.smithi161.stdout:8/971: dwrite d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/de3/f107 [0,4194304] 0 2024-09-18T12:52:19.276 INFO:tasks.workunit.client.1.smithi161.stdout:8/972: readlink d0/d3/d10/d21/d4a/d52/d94/l9f 0 2024-09-18T12:52:19.277 INFO:tasks.workunit.client.1.smithi161.stdout:7/826: creat d3/d8/d4f/dc1/ff8 x:0 0 0 2024-09-18T12:52:19.282 INFO:tasks.workunit.client.0.smithi045.stdout:8/553: write d11/d8c/f94 [180634,82653] 0 2024-09-18T12:52:19.283 INFO:tasks.workunit.client.1.smithi161.stdout:8/973: dread d0/d3/d10/d21/d4a/db7/fd9 [0,4194304] 0 2024-09-18T12:52:19.285 INFO:tasks.workunit.client.1.smithi161.stdout:8/974: write d0/d3/d10/d21/d4a/d52/d82/d96/dba/f10c [649581,9441] 0 2024-09-18T12:52:19.286 INFO:tasks.workunit.client.0.smithi045.stdout:9/473: creat d0/d3/d6/f98 x:0 0 0 2024-09-18T12:52:19.286 INFO:tasks.workunit.client.0.smithi045.stdout:3/480: dread d0/d1e/d39/f43 [0,4194304] 0 2024-09-18T12:52:19.288 INFO:tasks.workunit.client.1.smithi161.stdout:2/986: dread d0/d1/fe0 [0,4194304] 0 2024-09-18T12:52:19.288 INFO:tasks.workunit.client.1.smithi161.stdout:0/970: dwrite df/d30/d71/d96/dd3/d90/f88 [0,4194304] 0 2024-09-18T12:52:19.289 INFO:tasks.workunit.client.1.smithi161.stdout:5/978: sync 2024-09-18T12:52:19.289 INFO:tasks.workunit.client.1.smithi161.stdout:3/930: sync 2024-09-18T12:52:19.289 INFO:tasks.workunit.client.0.smithi045.stdout:2/534: link d5/d5f/da8/d91/f90 d5/d5f/da8/d61/fb8 0 2024-09-18T12:52:19.291 INFO:tasks.workunit.client.1.smithi161.stdout:1/823: write d1/da/d31/fd3 [2499941,35221] 0 2024-09-18T12:52:19.292 INFO:tasks.workunit.client.1.smithi161.stdout:9/851: creat d0/d47/d48/d7f/d9e/da4/f11e x:0 0 0 2024-09-18T12:52:19.293 INFO:tasks.workunit.client.0.smithi045.stdout:0/539: truncate d6/d48/d5e/f44 926452 0 2024-09-18T12:52:19.298 INFO:tasks.workunit.client.1.smithi161.stdout:4/993: link d5/d32/d39/c144 d5/d14/d67/d84/dae/db8/c169 0 2024-09-18T12:52:19.301 INFO:tasks.workunit.client.0.smithi045.stdout:6/492: creat d9/d1a/d2d/d38/d5b/fb5 x:0 0 0 2024-09-18T12:52:19.303 INFO:tasks.workunit.client.0.smithi045.stdout:6/493: read d9/d1a/d2d/f8a [3371189,116789] 0 2024-09-18T12:52:19.306 INFO:tasks.workunit.client.0.smithi045.stdout:4/701: creat db/de/d1e/d3e/d47/d59/fe8 x:0 0 0 2024-09-18T12:52:19.307 INFO:tasks.workunit.client.0.smithi045.stdout:8/554: truncate d11/d14/d53/f54 260970 0 2024-09-18T12:52:19.307 INFO:tasks.workunit.client.0.smithi045.stdout:4/702: dread - db/de/d1e/d49/fcb zero size 2024-09-18T12:52:19.307 INFO:tasks.workunit.client.1.smithi161.stdout:0/971: rmdir df/d30/d71/d96/dd3/d90/d37/de0 39 2024-09-18T12:52:19.308 INFO:tasks.workunit.client.0.smithi045.stdout:8/555: read d11/d14/d53/f6d [753297,39660] 0 2024-09-18T12:52:19.309 INFO:tasks.workunit.client.0.smithi045.stdout:3/481: unlink d0/d7/c1c 0 2024-09-18T12:52:19.312 INFO:tasks.workunit.client.0.smithi045.stdout:9/474: rename d0/d3/d6/f22 to d0/d3/d6/f99 0 2024-09-18T12:52:19.313 INFO:tasks.workunit.client.1.smithi161.stdout:1/824: chown d1/da/d39/f37 153 1 2024-09-18T12:52:19.314 INFO:tasks.workunit.client.1.smithi161.stdout:1/825: write d1/d26/f3f [5225109,103074] 0 2024-09-18T12:52:19.314 INFO:tasks.workunit.client.0.smithi045.stdout:5/650: truncate d6/db/d19/d92/f76 1072862 0 2024-09-18T12:52:19.315 INFO:tasks.workunit.client.1.smithi161.stdout:1/826: read d1/ff [1274099,22337] 0 2024-09-18T12:52:19.317 INFO:tasks.workunit.client.1.smithi161.stdout:9/852: creat d0/d47/d48/d7f/d9e/da4/f11f x:0 0 0 2024-09-18T12:52:19.317 INFO:tasks.workunit.client.0.smithi045.stdout:1/492: write d0/f2 [347866,123457] 0 2024-09-18T12:52:19.329 INFO:tasks.workunit.client.1.smithi161.stdout:8/975: link d0/d3/d10/d21/d4a/d52/d66/fe9 d0/d3/d10/d21/d4a/d52/d66/f14b 0 2024-09-18T12:52:19.330 INFO:tasks.workunit.client.1.smithi161.stdout:8/976: readlink d0/d3/d10/d21/d4a/d52/d82/d96/dba/l9a 0 2024-09-18T12:52:19.332 INFO:tasks.workunit.client.1.smithi161.stdout:7/827: write d3/d8/d15/da7/d4a/d59/f6e [392209,41750] 0 2024-09-18T12:52:19.333 INFO:tasks.workunit.client.1.smithi161.stdout:7/828: write d3/d8/d15/da7/d4a/fa6 [2481722,55021] 0 2024-09-18T12:52:19.333 INFO:tasks.workunit.client.1.smithi161.stdout:0/972: creat df/d30/d71/d96/dd3/d90/f155 x:0 0 0 2024-09-18T12:52:19.340 INFO:tasks.workunit.client.0.smithi045.stdout:1/493: truncate d0/d12/f13 5184298 0 2024-09-18T12:52:19.344 INFO:tasks.workunit.client.0.smithi045.stdout:3/482: dwrite d0/d1e/d2c/d3a/f3c [0,4194304] 0 2024-09-18T12:52:19.345 INFO:tasks.workunit.client.1.smithi161.stdout:9/853: rename d0/db/d18/f80 to d0/d47/d48/d7f/d84/f120 0 2024-09-18T12:52:19.345 INFO:tasks.workunit.client.1.smithi161.stdout:1/827: dread d1/d26/f2f [0,4194304] 0 2024-09-18T12:52:19.346 INFO:tasks.workunit.client.1.smithi161.stdout:2/987: truncate d0/d5/d43/d35/f7a 3852106 0 2024-09-18T12:52:19.347 INFO:tasks.workunit.client.1.smithi161.stdout:2/988: write d0/d71/da9/d9f/dd0/d10c/d132/fbc [660566,23885] 0 2024-09-18T12:52:19.349 INFO:tasks.workunit.client.0.smithi045.stdout:4/703: mkdir db/de9 0 2024-09-18T12:52:19.350 INFO:tasks.workunit.client.1.smithi161.stdout:4/994: symlink d5/d14/d67/dc7/d60/d95/dda/d155/d44/de2/d122/l16a 0 2024-09-18T12:52:19.352 INFO:tasks.workunit.client.1.smithi161.stdout:8/977: symlink d0/d3/d10/d21/d4a/d52/d82/l14c 0 2024-09-18T12:52:19.353 INFO:tasks.workunit.client.1.smithi161.stdout:8/978: write d0/d3/d10/d21/d4a/f109 [3338580,33308] 0 2024-09-18T12:52:19.355 INFO:tasks.workunit.client.1.smithi161.stdout:8/979: read d0/d3/d10/d21/f48 [691871,22893] 0 2024-09-18T12:52:19.356 INFO:tasks.workunit.client.0.smithi045.stdout:0/540: creat d6/f98 x:0 0 0 2024-09-18T12:52:19.357 INFO:tasks.workunit.client.0.smithi045.stdout:1/494: creat d0/d2d/f90 x:0 0 0 2024-09-18T12:52:19.357 INFO:tasks.workunit.client.1.smithi161.stdout:3/931: link d1/d2e/d14/d65/d76/d8c/d9d/lf0 d1/d2e/d68/d92/dba/dd9/l13c 0 2024-09-18T12:52:19.359 INFO:tasks.workunit.client.0.smithi045.stdout:6/494: link d9/d1a/d2d/d38/c6b d9/d1a/d2d/d32/cb6 0 2024-09-18T12:52:19.360 INFO:tasks.workunit.client.1.smithi161.stdout:9/854: readlink d0/d47/d48/lcd 0 2024-09-18T12:52:19.360 INFO:tasks.workunit.client.0.smithi045.stdout:6/495: chown d9/d1a/d2d/d38/l55 1 1 2024-09-18T12:52:19.361 INFO:tasks.workunit.client.0.smithi045.stdout:3/483: creat d0/d22/fa1 x:0 0 0 2024-09-18T12:52:19.361 INFO:tasks.workunit.client.1.smithi161.stdout:1/828: dread - d1/fb8 zero size 2024-09-18T12:52:19.362 INFO:tasks.workunit.client.0.smithi045.stdout:6/496: write d9/d74/fa4 [949736,70354] 0 2024-09-18T12:52:19.362 INFO:tasks.workunit.client.0.smithi045.stdout:6/497: chown d9/d1a/l2a 1431 1 2024-09-18T12:52:19.363 INFO:tasks.workunit.client.0.smithi045.stdout:4/704: creat db/de/d1e/d3e/d47/d59/d7a/fea x:0 0 0 2024-09-18T12:52:19.366 INFO:tasks.workunit.client.0.smithi045.stdout:2/535: getdents d5/d3a/d6b 0 2024-09-18T12:52:19.367 INFO:tasks.workunit.client.1.smithi161.stdout:9/855: dwrite d0/d16/d25/d28/f73 [0,4194304] 0 2024-09-18T12:52:19.367 INFO:tasks.workunit.client.1.smithi161.stdout:0/973: dread df/d29/f62 [0,4194304] 0 2024-09-18T12:52:19.367 INFO:tasks.workunit.client.0.smithi045.stdout:2/536: chown d5/d5f/da8/c26 571238 1 2024-09-18T12:52:19.367 INFO:tasks.workunit.client.0.smithi045.stdout:2/537: read - d5/fb7 zero size 2024-09-18T12:52:19.369 INFO:tasks.workunit.client.1.smithi161.stdout:2/989: creat d0/d5/d53/f154 x:0 0 0 2024-09-18T12:52:19.369 INFO:tasks.workunit.client.1.smithi161.stdout:0/974: stat df/d30/d71/d96/dd3/d90/l14c 0 2024-09-18T12:52:19.372 INFO:tasks.workunit.client.0.smithi045.stdout:1/495: mknod d0/d2d/d2b/d30/d40/d60/d8f/c91 0 2024-09-18T12:52:19.374 INFO:tasks.workunit.client.1.smithi161.stdout:5/979: getdents d3/d3b/d54 0 2024-09-18T12:52:19.377 INFO:tasks.workunit.client.0.smithi045.stdout:3/484: creat d0/d1e/d91/d95/fa2 x:0 0 0 2024-09-18T12:52:19.378 INFO:tasks.workunit.client.0.smithi045.stdout:6/498: fsync d9/f45 0 2024-09-18T12:52:19.380 INFO:tasks.workunit.client.0.smithi045.stdout:6/499: write d9/d1a/d2d/d38/d5b/fb5 [511599,6790] 0 2024-09-18T12:52:19.383 INFO:tasks.workunit.client.0.smithi045.stdout:2/538: creat d5/d2c/d6f/d9d/fb9 x:0 0 0 2024-09-18T12:52:19.384 INFO:tasks.workunit.client.1.smithi161.stdout:7/829: symlink d3/d8/d15/da7/d24/daf/df4/lf9 0 2024-09-18T12:52:19.385 INFO:tasks.workunit.client.1.smithi161.stdout:7/830: read - d3/d8/d15/d99/db0/fef zero size 2024-09-18T12:52:19.386 INFO:tasks.workunit.client.0.smithi045.stdout:1/496: mkdir d0/d2d/d92 0 2024-09-18T12:52:19.387 INFO:tasks.workunit.client.1.smithi161.stdout:9/856: dread d0/d20/d49/f15 [0,4194304] 0 2024-09-18T12:52:19.394 INFO:tasks.workunit.client.0.smithi045.stdout:0/541: dwrite d6/d7/f1f [0,4194304] 0 2024-09-18T12:52:19.398 INFO:tasks.workunit.client.1.smithi161.stdout:2/990: creat d0/d71/da9/d9f/dd0/f155 x:0 0 0 2024-09-18T12:52:19.398 INFO:tasks.workunit.client.0.smithi045.stdout:2/539: read d5/d2c/d4d/f54 [200834,66786] 0 2024-09-18T12:52:19.400 INFO:tasks.workunit.client.1.smithi161.stdout:4/995: dread d5/da9/de7/f151 [0,4194304] 0 2024-09-18T12:52:19.400 INFO:tasks.workunit.client.0.smithi045.stdout:3/485: creat d0/d29/d5f/d73/d87/fa3 x:0 0 0 2024-09-18T12:52:19.401 INFO:tasks.workunit.client.1.smithi161.stdout:4/996: chown d5/d14/d5f/da1 0 1 2024-09-18T12:52:19.401 INFO:tasks.workunit.client.1.smithi161.stdout:4/997: fsync d5/d14/d67/dc7/d60/d95/dda/d155/f46 0 2024-09-18T12:52:19.402 INFO:tasks.workunit.client.1.smithi161.stdout:5/980: unlink d3/ccb 0 2024-09-18T12:52:19.404 INFO:tasks.workunit.client.0.smithi045.stdout:1/497: rename d0/d2d/d2b/l6e to d0/d2d/d92/l93 0 2024-09-18T12:52:19.405 INFO:tasks.workunit.client.1.smithi161.stdout:1/829: write d1/d26/fe [399285,12824] 0 2024-09-18T12:52:19.405 INFO:tasks.workunit.client.0.smithi045.stdout:4/705: link db/de/d1e/l6e db/d2c/d35/d40/d77/dab/leb 0 2024-09-18T12:52:19.406 INFO:tasks.workunit.client.1.smithi161.stdout:8/980: symlink d0/d3/d10/d21/d4a/d52/d82/d96/l14d 0 2024-09-18T12:52:19.408 INFO:tasks.workunit.client.0.smithi045.stdout:6/500: mknod d9/d1a/d48/d8f/cb7 0 2024-09-18T12:52:19.409 INFO:tasks.workunit.client.1.smithi161.stdout:7/831: fdatasync d3/d8/d15/da7/d4a/d59/f73 0 2024-09-18T12:52:19.410 INFO:tasks.workunit.client.0.smithi045.stdout:2/540: read d5/d3a/f5b [1569674,124397] 0 2024-09-18T12:52:19.411 INFO:tasks.workunit.client.0.smithi045.stdout:3/486: creat d0/d1e/d2c/d3a/d8a/fa4 x:0 0 0 2024-09-18T12:52:19.412 INFO:tasks.workunit.client.1.smithi161.stdout:9/857: unlink d0/dd4/feb 0 2024-09-18T12:52:19.415 INFO:tasks.workunit.client.0.smithi045.stdout:1/498: readlink d0/d12/l75 0 2024-09-18T12:52:19.416 INFO:tasks.workunit.client.0.smithi045.stdout:1/499: rename d0/d2d/d2b/d30/d40/d60 to d0/d2d/d2b/d30/d40/d60/d8f/d94 22 2024-09-18T12:52:19.417 INFO:tasks.workunit.client.0.smithi045.stdout:1/500: dread - d0/d12/d32/d67/d6d/f7e zero size 2024-09-18T12:52:19.417 INFO:tasks.workunit.client.0.smithi045.stdout:4/706: symlink db/d2c/d35/dcc/dd0/lec 0 2024-09-18T12:52:19.419 INFO:tasks.workunit.client.0.smithi045.stdout:6/501: chown d9/d1a/d1d 46554142 1 2024-09-18T12:52:19.421 INFO:tasks.workunit.client.0.smithi045.stdout:2/541: symlink d5/d5f/da8/d61/lba 0 2024-09-18T12:52:19.422 INFO:tasks.workunit.client.0.smithi045.stdout:3/487: fsync d0/d22/f2e 0 2024-09-18T12:52:19.425 INFO:tasks.workunit.client.1.smithi161.stdout:4/998: symlink d5/d14/d5f/l16b 0 2024-09-18T12:52:19.428 INFO:tasks.workunit.client.1.smithi161.stdout:5/981: fsync d3/f56 0 2024-09-18T12:52:19.431 INFO:tasks.workunit.client.1.smithi161.stdout:1/830: rename d1/da/d39/l9f to d1/da/d1f/dab/daf/de8/l115 0 2024-09-18T12:52:19.432 INFO:tasks.workunit.client.1.smithi161.stdout:1/831: chown d1/da/d1f/d6b/lf7 2784284 1 2024-09-18T12:52:19.433 INFO:tasks.workunit.client.1.smithi161.stdout:3/932: creat d1/d2e/d68/de8/f13d x:0 0 0 2024-09-18T12:52:19.433 INFO:tasks.workunit.client.1.smithi161.stdout:3/933: chown d1/d2e/d24/d1d/f5d 33290553 1 2024-09-18T12:52:19.434 INFO:tasks.workunit.client.1.smithi161.stdout:3/934: chown d1/d2e/d14/d2c/f31 20865121 1 2024-09-18T12:52:19.435 INFO:tasks.workunit.client.0.smithi045.stdout:4/707: mknod db/de/d1e/d3e/d47/db7/ced 0 2024-09-18T12:52:19.437 INFO:tasks.workunit.client.0.smithi045.stdout:4/708: write db/d2c/d35/dcc/dd0/fdd [275889,42703] 0 2024-09-18T12:52:19.438 INFO:tasks.workunit.client.0.smithi045.stdout:6/502: truncate d9/f68 941017 0 2024-09-18T12:52:19.439 INFO:tasks.workunit.client.0.smithi045.stdout:1/501: dwrite d0/d2d/d2b/d30/d40/d60/d8f/f43 [0,4194304] 0 2024-09-18T12:52:19.439 INFO:tasks.workunit.client.1.smithi161.stdout:3/935: dwrite d1/d2e/d68/d92/dba/fee [0,4194304] 0 2024-09-18T12:52:19.439 INFO:tasks.workunit.client.1.smithi161.stdout:9/858: truncate d0/f1f 4131352 0 2024-09-18T12:52:19.441 INFO:tasks.workunit.client.0.smithi045.stdout:6/503: chown d9/d1a/d2d/d38/f44 21253 1 2024-09-18T12:52:19.441 INFO:tasks.workunit.client.0.smithi045.stdout:1/502: truncate d0/f2 2755353 0 2024-09-18T12:52:19.442 INFO:tasks.workunit.client.0.smithi045.stdout:3/488: write d0/d1e/d2c/d5c/f60 [1415433,6570] 0 2024-09-18T12:52:19.442 INFO:tasks.workunit.client.0.smithi045.stdout:1/503: readlink d0/d12/l75 0 2024-09-18T12:52:19.444 INFO:tasks.workunit.client.1.smithi161.stdout:0/975: creat df/d30/d4d/f156 x:0 0 0 2024-09-18T12:52:19.448 INFO:tasks.workunit.client.0.smithi045.stdout:4/709: dwrite db/de/d1a/d2e/f81 [0,4194304] 0 2024-09-18T12:52:19.452 INFO:tasks.workunit.client.1.smithi161.stdout:8/981: rename d0/d3/d91/f138 to d0/d3/d10/d21/d4a/d52/d82/f14e 0 2024-09-18T12:52:19.455 INFO:tasks.workunit.client.1.smithi161.stdout:8/982: chown d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/de3/l12f 111531 1 2024-09-18T12:52:19.455 INFO:tasks.workunit.client.1.smithi161.stdout:1/832: readlink d1/da/l34 0 2024-09-18T12:52:19.458 INFO:tasks.workunit.client.0.smithi045.stdout:6/504: creat d9/d56/db3/fb8 x:0 0 0 2024-09-18T12:52:19.458 INFO:tasks.workunit.client.1.smithi161.stdout:7/832: getdents d3/d8/d15/da7/d24/d31/d7d 0 2024-09-18T12:52:19.459 INFO:tasks.workunit.client.0.smithi045.stdout:4/710: readlink db/d2c/d35/d40/d77/dab/l86 0 2024-09-18T12:52:19.462 INFO:tasks.workunit.client.1.smithi161.stdout:2/991: creat d0/d1/d4c/d67/db9/dcb/f156 x:0 0 0 2024-09-18T12:52:19.462 INFO:tasks.workunit.client.0.smithi045.stdout:1/504: dread d0/d12/f13 [0,4194304] 0 2024-09-18T12:52:19.463 INFO:tasks.workunit.client.1.smithi161.stdout:4/999: symlink d5/da9/d157/l16c 0 2024-09-18T12:52:19.464 INFO:tasks.workunit.client.0.smithi045.stdout:3/489: dwrite d0/d7/f80 [0,4194304] 0 2024-09-18T12:52:19.467 INFO:tasks.workunit.client.1.smithi161.stdout:0/976: read df/d30/d4d/f7b [818347,92885] 0 2024-09-18T12:52:19.469 INFO:tasks.workunit.client.1.smithi161.stdout:9/859: dread d0/f6e [0,4194304] 0 2024-09-18T12:52:19.471 INFO:tasks.workunit.client.0.smithi045.stdout:2/542: truncate d5/d3a/f4c 2120411 0 2024-09-18T12:52:19.473 INFO:tasks.workunit.client.1.smithi161.stdout:8/983: read d0/d3/d10/d21/d4a/d52/d82/d96/dc1/f106 [1892017,107026] 0 2024-09-18T12:52:19.474 INFO:tasks.workunit.client.1.smithi161.stdout:1/833: rename d1/daa/ff2 to d1/da/d1f/dab/daf/de3/f116 0 2024-09-18T12:52:19.477 INFO:tasks.workunit.client.1.smithi161.stdout:3/936: mknod d1/c13e 0 2024-09-18T12:52:19.478 INFO:tasks.workunit.client.0.smithi045.stdout:2/543: mkdir d5/d5f/da8/d61/dbb 0 2024-09-18T12:52:19.479 INFO:tasks.workunit.client.1.smithi161.stdout:5/982: dwrite d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/da4/daf/fb2 [0,4194304] 0 2024-09-18T12:52:19.483 INFO:tasks.workunit.client.0.smithi045.stdout:3/490: creat d0/d29/fa5 x:0 0 0 2024-09-18T12:52:19.484 INFO:tasks.workunit.client.1.smithi161.stdout:0/977: mknod df/d30/d71/d96/c157 0 2024-09-18T12:52:19.487 INFO:tasks.workunit.client.0.smithi045.stdout:2/544: dwrite d5/d5f/da8/f2e [4194304,4194304] 0 2024-09-18T12:52:19.487 INFO:tasks.workunit.client.0.smithi045.stdout:4/711: truncate db/d20/f44 6272930 0 2024-09-18T12:52:19.488 INFO:tasks.workunit.client.1.smithi161.stdout:5/983: dread d3/d3b/d54/f69 [0,4194304] 0 2024-09-18T12:52:19.488 INFO:tasks.workunit.client.0.smithi045.stdout:4/712: chown l1 1571 1 2024-09-18T12:52:19.490 INFO:tasks.workunit.client.0.smithi045.stdout:2/545: write d5/d5f/f78 [83546,69959] 0 2024-09-18T12:52:19.492 INFO:tasks.workunit.client.0.smithi045.stdout:3/491: symlink d0/d1e/d2c/d3a/d45/la6 0 2024-09-18T12:52:19.493 INFO:tasks.workunit.client.1.smithi161.stdout:8/984: creat d0/d3/d10/d21/d4a/f14f x:0 0 0 2024-09-18T12:52:19.493 INFO:tasks.workunit.client.0.smithi045.stdout:3/492: read d0/f4b [2220656,28884] 0 2024-09-18T12:52:19.494 INFO:tasks.workunit.client.1.smithi161.stdout:1/834: creat d1/daa/db2/dc0/f117 x:0 0 0 2024-09-18T12:52:19.494 INFO:tasks.workunit.client.0.smithi045.stdout:4/713: creat db/de/d1e/d3e/d78/fee x:0 0 0 2024-09-18T12:52:19.495 INFO:tasks.workunit.client.1.smithi161.stdout:7/833: mknod d3/d8/d15/cfa 0 2024-09-18T12:52:19.496 INFO:tasks.workunit.client.1.smithi161.stdout:8/985: write d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/de3/df4/f11b [725793,47161] 0 2024-09-18T12:52:19.497 INFO:tasks.workunit.client.1.smithi161.stdout:3/937: stat d1/d2e/d68/d92/ded/d49/fdf 0 2024-09-18T12:52:19.499 INFO:tasks.workunit.client.1.smithi161.stdout:3/938: dread - d1/d2e/d24/d1d/d89/db0/de4/f113 zero size 2024-09-18T12:52:19.502 INFO:tasks.workunit.client.0.smithi045.stdout:2/546: fdatasync d5/d5f/db2/f4f 0 2024-09-18T12:52:19.502 INFO:tasks.workunit.client.0.smithi045.stdout:4/714: dwrite db/de/d1e/d3e/d9a/fe4 [0,4194304] 0 2024-09-18T12:52:19.507 INFO:tasks.workunit.client.1.smithi161.stdout:3/939: dwrite d1/d2e/d14/f56 [4194304,4194304] 0 2024-09-18T12:52:19.507 INFO:tasks.workunit.client.1.smithi161.stdout:5/984: chown d3/d3b/l10c 66336070 1 2024-09-18T12:52:19.508 INFO:tasks.workunit.client.0.smithi045.stdout:1/505: dread d0/f6 [0,4194304] 0 2024-09-18T12:52:19.511 INFO:tasks.workunit.client.1.smithi161.stdout:1/835: rename d1/d26/d3a/d52 to d1/da/d1f/dab/daf/de8/d118 0 2024-09-18T12:52:19.514 INFO:tasks.workunit.client.1.smithi161.stdout:7/834: mkdir d3/d8/d15/d99/dfb 0 2024-09-18T12:52:19.516 INFO:tasks.workunit.client.1.smithi161.stdout:7/835: stat d3/d8/l1f 0 2024-09-18T12:52:19.516 INFO:tasks.workunit.client.1.smithi161.stdout:2/992: dwrite d0/d5/d43/fba [0,4194304] 0 2024-09-18T12:52:19.517 INFO:tasks.workunit.client.0.smithi045.stdout:2/547: fdatasync d5/f5c 0 2024-09-18T12:52:19.517 INFO:tasks.workunit.client.0.smithi045.stdout:2/548: fdatasync d5/d5f/da8/f64 0 2024-09-18T12:52:19.519 INFO:tasks.workunit.client.0.smithi045.stdout:1/506: rename d0/d2d/d2b/f36 to d0/d12/d32/d67/d6d/f95 0 2024-09-18T12:52:19.519 INFO:tasks.workunit.client.0.smithi045.stdout:1/507: chown d0/d12 1694 1 2024-09-18T12:52:19.521 INFO:tasks.workunit.client.0.smithi045.stdout:4/715: mknod db/de9/cef 0 2024-09-18T12:52:19.526 INFO:tasks.workunit.client.0.smithi045.stdout:4/716: dwrite db/d2c/d35/f91 [4194304,4194304] 0 2024-09-18T12:52:19.527 INFO:tasks.workunit.client.1.smithi161.stdout:1/836: dread d1/da/d9d/fa2 [0,4194304] 0 2024-09-18T12:52:19.531 INFO:tasks.workunit.client.1.smithi161.stdout:0/978: dwrite df/d30/d71/d96/dd3/d78/fd4 [4194304,4194304] 0 2024-09-18T12:52:19.532 INFO:tasks.workunit.client.1.smithi161.stdout:0/979: stat df/d30/d71/d96/dd3/d90/f130 0 2024-09-18T12:52:19.533 INFO:tasks.workunit.client.1.smithi161.stdout:0/980: fsync df/d29/d36/d94/f116 0 2024-09-18T12:52:19.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:19 smithi045 ceph-mon[28315]: pgmap v32: 65 pgs: 65 active+clean; 2.8 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 106 MiB/s rd, 258 MiB/s wr, 489 op/s 2024-09-18T12:52:19.590 INFO:tasks.workunit.client.0.smithi045.stdout:3/493: getdents d0/d1e 0 2024-09-18T12:52:19.591 INFO:tasks.workunit.client.1.smithi161.stdout:5/985: mknod d3/d8/de4/d8d/db0/dd4/c13a 0 2024-09-18T12:52:19.591 INFO:tasks.workunit.client.1.smithi161.stdout:5/986: chown d3/d8/l90 0 1 2024-09-18T12:52:19.593 INFO:tasks.workunit.client.0.smithi045.stdout:2/549: creat d5/d2c/d6f/d9d/fbc x:0 0 0 2024-09-18T12:52:19.594 INFO:tasks.workunit.client.0.smithi045.stdout:1/508: rmdir d0 39 2024-09-18T12:52:19.596 INFO:tasks.workunit.client.0.smithi045.stdout:4/717: mknod db/d2c/d35/d40/d77/cf0 0 2024-09-18T12:52:19.597 INFO:tasks.workunit.client.0.smithi045.stdout:4/718: chown db/d2c/d35/d40 6 1 2024-09-18T12:52:19.598 INFO:tasks.workunit.client.0.smithi045.stdout:2/550: dwrite d5/d5f/db2/f55 [0,4194304] 0 2024-09-18T12:52:19.699 INFO:tasks.workunit.client.1.smithi161.stdout:2/993: sync 2024-09-18T12:52:19.699 INFO:tasks.workunit.client.1.smithi161.stdout:3/940: sync 2024-09-18T12:52:19.704 INFO:tasks.workunit.client.0.smithi045.stdout:3/494: mknod d0/d1e/d91/d95/ca7 0 2024-09-18T12:52:19.706 INFO:tasks.workunit.client.1.smithi161.stdout:8/986: write d0/d3/d10/d21/fce [429262,114086] 0 2024-09-18T12:52:19.710 INFO:tasks.workunit.client.0.smithi045.stdout:4/719: unlink db/de/d1e/d3e/d47/d59/d7a/fe2 0 2024-09-18T12:52:19.722 INFO:tasks.workunit.client.0.smithi045.stdout:2/551: link d5/d46/f70 d5/d5f/da8/d61/fbd 0 2024-09-18T12:52:19.723 INFO:tasks.workunit.client.0.smithi045.stdout:3/495: mkdir d0/d1e/d39/da8 0 2024-09-18T12:52:19.723 INFO:tasks.workunit.client.0.smithi045.stdout:1/509: dwrite d0/d12/d32/d67/d6d/f95 [0,4194304] 0 2024-09-18T12:52:19.728 INFO:tasks.workunit.client.0.smithi045.stdout:2/552: fdatasync d5/d5f/da8/d61/fb8 0 2024-09-18T12:52:19.734 INFO:tasks.workunit.client.0.smithi045.stdout:2/553: dwrite d5/d5f/f83 [0,4194304] 0 2024-09-18T12:52:19.735 INFO:tasks.workunit.client.0.smithi045.stdout:2/554: chown d5/d46/f7e 20633468 1 2024-09-18T12:52:19.738 INFO:tasks.workunit.client.0.smithi045.stdout:2/555: readlink d5/d5f/db2/l3f 0 2024-09-18T12:52:19.740 INFO:tasks.workunit.client.0.smithi045.stdout:2/556: write d5/d5f/f99 [186956,74111] 0 2024-09-18T12:52:19.747 INFO:tasks.workunit.client.0.smithi045.stdout:2/557: dwrite d5/d46/f7e [0,4194304] 0 2024-09-18T12:52:19.758 INFO:tasks.workunit.client.1.smithi161.stdout:9/860: getdents d0/d47/df1 0 2024-09-18T12:52:19.759 INFO:tasks.workunit.client.1.smithi161.stdout:1/837: creat d1/daa/db2/dc0/f119 x:0 0 0 2024-09-18T12:52:19.760 INFO:tasks.workunit.client.1.smithi161.stdout:1/838: write d1/d26/dad/db6/fd5 [833558,20856] 0 2024-09-18T12:52:19.761 INFO:tasks.workunit.client.1.smithi161.stdout:0/981: rename df/d29/d36/d7a/cc4 to df/d29/d36/d7a/deb/c158 0 2024-09-18T12:52:19.765 INFO:tasks.workunit.client.1.smithi161.stdout:2/994: rmdir d0/d71/ddb 39 2024-09-18T12:52:19.767 INFO:tasks.workunit.client.1.smithi161.stdout:3/941: creat d1/d2e/d14/d2c/f13f x:0 0 0 2024-09-18T12:52:19.768 INFO:tasks.workunit.client.1.smithi161.stdout:3/942: write d1/d2e/d68/d69/d7d/fda [1028533,10110] 0 2024-09-18T12:52:19.768 INFO:tasks.workunit.client.1.smithi161.stdout:8/987: creat d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/dda/de3/df4/f150 x:0 0 0 2024-09-18T12:52:19.768 INFO:tasks.workunit.client.1.smithi161.stdout:3/943: dread - d1/f13a zero size 2024-09-18T12:52:19.769 INFO:tasks.workunit.client.0.smithi045.stdout:3/496: write d0/fe [3943960,44630] 0 2024-09-18T12:52:19.770 INFO:tasks.workunit.client.1.smithi161.stdout:3/944: write d1/d2e/d14/d65/d76/f136 [733985,88872] 0 2024-09-18T12:52:19.771 INFO:tasks.workunit.client.0.smithi045.stdout:1/510: write d0/d2d/d2b/d30/f48 [4001737,12629] 0 2024-09-18T12:52:19.774 INFO:tasks.workunit.client.1.smithi161.stdout:7/836: creat d3/ffc x:0 0 0 2024-09-18T12:52:19.775 INFO:tasks.workunit.client.0.smithi045.stdout:1/511: dread d0/f6 [0,4194304] 0 2024-09-18T12:52:19.775 INFO:tasks.workunit.client.0.smithi045.stdout:3/497: rename d0/d1e/d2c/d3a/d45/l56 to d0/d1e/d91/d95/la9 0 2024-09-18T12:52:19.777 INFO:tasks.workunit.client.0.smithi045.stdout:3/498: read d0/d1e/f38 [947737,79776] 0 2024-09-18T12:52:19.777 INFO:tasks.workunit.client.1.smithi161.stdout:2/995: creat d0/d4/d78/f157 x:0 0 0 2024-09-18T12:52:19.778 INFO:tasks.workunit.client.0.smithi045.stdout:3/499: chown d0/d1e/d2c/d3a/d8a/fa4 352018400 1 2024-09-18T12:52:19.781 INFO:tasks.workunit.client.0.smithi045.stdout:1/512: fsync d0/d2d/d6c/f8c 0 2024-09-18T12:52:19.782 INFO:tasks.workunit.client.1.smithi161.stdout:0/982: mknod df/de4/c159 0 2024-09-18T12:52:19.784 INFO:tasks.workunit.client.1.smithi161.stdout:3/945: symlink d1/d2e/d14/d2c/d129/l140 0 2024-09-18T12:52:19.785 INFO:tasks.workunit.client.1.smithi161.stdout:3/946: write d1/d2e/d68/d92/dba/f12b [646544,45869] 0 2024-09-18T12:52:19.788 INFO:tasks.workunit.client.0.smithi045.stdout:1/513: creat d0/d12/d32/d67/d6a/f96 x:0 0 0 2024-09-18T12:52:19.790 INFO:tasks.workunit.client.0.smithi045.stdout:3/500: mkdir d0/d29/d5f/daa 0 2024-09-18T12:52:19.792 INFO:tasks.workunit.client.1.smithi161.stdout:2/996: rmdir d0/d5/d43/d35/dee/d109 39 2024-09-18T12:52:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:19 smithi161 ceph-mon[35784]: pgmap v32: 65 pgs: 65 active+clean; 2.8 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 106 MiB/s rd, 258 MiB/s wr, 489 op/s 2024-09-18T12:52:19.793 INFO:tasks.workunit.client.0.smithi045.stdout:1/514: stat d0/d2d/l88 0 2024-09-18T12:52:19.793 INFO:tasks.workunit.client.1.smithi161.stdout:2/997: write d0/d71/da9/dd6/de8/f117 [77575,37970] 0 2024-09-18T12:52:19.796 INFO:tasks.workunit.client.0.smithi045.stdout:1/515: unlink d0/d2d/d2b/d30/d40/l73 0 2024-09-18T12:52:19.799 INFO:tasks.workunit.client.0.smithi045.stdout:2/558: dwrite d5/d5f/db2/f40 [0,4194304] 0 2024-09-18T12:52:19.800 INFO:tasks.workunit.client.1.smithi161.stdout:1/839: link d1/da/d1f/dab/daf/de8/d118/c8f d1/da/d9d/c11a 0 2024-09-18T12:52:19.803 INFO:tasks.workunit.client.0.smithi045.stdout:1/516: write d0/fb [4959418,118241] 0 2024-09-18T12:52:19.807 INFO:tasks.workunit.client.1.smithi161.stdout:5/987: dwrite d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/fa3 [0,4194304] 0 2024-09-18T12:52:19.810 INFO:tasks.workunit.client.1.smithi161.stdout:9/861: getdents d0/d47/d48/d9a 0 2024-09-18T12:52:19.812 INFO:tasks.workunit.client.1.smithi161.stdout:0/983: symlink df/d30/d71/l15a 0 2024-09-18T12:52:19.812 INFO:tasks.workunit.client.1.smithi161.stdout:8/988: write d0/d3/d10/fcc [509227,29896] 0 2024-09-18T12:52:19.816 INFO:tasks.workunit.client.1.smithi161.stdout:1/840: creat d1/da/d1f/d45/d73/f11b x:0 0 0 2024-09-18T12:52:19.817 INFO:tasks.workunit.client.0.smithi045.stdout:2/559: creat d5/d3a/fbe x:0 0 0 2024-09-18T12:52:19.818 INFO:tasks.workunit.client.1.smithi161.stdout:2/998: symlink d0/d1/l158 0 2024-09-18T12:52:19.819 INFO:tasks.workunit.client.1.smithi161.stdout:5/988: rmdir d3 39 2024-09-18T12:52:19.821 INFO:tasks.workunit.client.1.smithi161.stdout:7/837: write d3/d8/d4b/f6f [5054545,112998] 0 2024-09-18T12:52:19.821 INFO:tasks.workunit.client.1.smithi161.stdout:9/862: mkdir d0/db/d18/d121 0 2024-09-18T12:52:19.824 INFO:tasks.workunit.client.1.smithi161.stdout:0/984: rename df/d29/d36/dde/d124 to df/de2/dc5/d8a/d15b 0 2024-09-18T12:52:19.824 INFO:tasks.workunit.client.0.smithi045.stdout:3/501: truncate d0/f4b 1050399 0 2024-09-18T12:52:19.826 INFO:tasks.workunit.client.1.smithi161.stdout:1/841: write d1/da/d1f/d45/d73/f87 [4980764,48475] 0 2024-09-18T12:52:19.826 INFO:tasks.workunit.client.1.smithi161.stdout:0/985: fdatasync df/d30/d71/d96/dd3/d90/f155 0 2024-09-18T12:52:19.829 INFO:tasks.workunit.client.1.smithi161.stdout:5/989: write d3/d44/f132 [500772,106347] 0 2024-09-18T12:52:19.831 INFO:tasks.workunit.client.1.smithi161.stdout:7/838: rmdir d3/d8/d79 39 2024-09-18T12:52:19.831 INFO:tasks.workunit.client.0.smithi045.stdout:3/502: symlink d0/lab 0 2024-09-18T12:52:19.832 INFO:tasks.workunit.client.1.smithi161.stdout:3/947: getdents d1/d2e/d68/de8/df6 0 2024-09-18T12:52:19.832 INFO:tasks.workunit.client.1.smithi161.stdout:9/863: dwrite d0/db/f10a [0,4194304] 0 2024-09-18T12:52:19.834 INFO:tasks.workunit.client.0.smithi045.stdout:3/503: mknod d0/d1e/d2c/d3f/d44/cac 0 2024-09-18T12:52:19.834 INFO:tasks.workunit.client.1.smithi161.stdout:8/989: rename d0/d3/d10/d21/d4a/d52/d66/d5b/de0 to d0/d3/d10/d21/d4a/d52/d70/d151 0 2024-09-18T12:52:19.836 INFO:tasks.workunit.client.1.smithi161.stdout:0/986: symlink df/de2/l15c 0 2024-09-18T12:52:19.838 INFO:tasks.workunit.client.1.smithi161.stdout:8/990: fsync d0/d3/d10/d21/d4a/d52/d82/d96/fa3 0 2024-09-18T12:52:19.839 INFO:tasks.workunit.client.1.smithi161.stdout:5/990: mkdir d3/d44/d120/dde/d13b 0 2024-09-18T12:52:19.840 INFO:tasks.workunit.client.1.smithi161.stdout:8/991: write d0/d3/d10/d21/f86 [1773575,106285] 0 2024-09-18T12:52:19.841 INFO:tasks.workunit.client.0.smithi045.stdout:3/504: dwrite d0/d1e/d91/d95/fa2 [0,4194304] 0 2024-09-18T12:52:19.843 INFO:tasks.workunit.client.0.smithi045.stdout:1/517: dread d0/fc [0,4194304] 0 2024-09-18T12:52:19.844 INFO:tasks.workunit.client.1.smithi161.stdout:3/948: mknod d1/d2e/d68/c141 0 2024-09-18T12:52:19.844 INFO:tasks.workunit.client.0.smithi045.stdout:3/505: write d0/d1e/d2c/f42 [3264837,15552] 0 2024-09-18T12:52:19.845 INFO:tasks.workunit.client.0.smithi045.stdout:2/560: truncate d5/d5f/db2/f3c 2037654 0 2024-09-18T12:52:19.851 INFO:tasks.workunit.client.0.smithi045.stdout:7/457: sync 2024-09-18T12:52:19.851 INFO:tasks.workunit.client.0.smithi045.stdout:1/518: rename d0/d12/d32/d67/d6a/f8d to d0/d2d/d2b/d30/d40/d60/d8f/f97 0 2024-09-18T12:52:19.851 INFO:tasks.workunit.client.0.smithi045.stdout:9/475: sync 2024-09-18T12:52:19.852 INFO:tasks.workunit.client.0.smithi045.stdout:8/556: sync 2024-09-18T12:52:19.852 INFO:tasks.workunit.client.1.smithi161.stdout:7/839: unlink d3/d7e/fdf 0 2024-09-18T12:52:19.852 INFO:tasks.workunit.client.1.smithi161.stdout:1/842: dread d1/da/d39/f61 [0,4194304] 0 2024-09-18T12:52:19.854 INFO:tasks.workunit.client.1.smithi161.stdout:2/999: dwrite d0/d5/d43/d35/d98/ddf/d8b/f97 [0,4194304] 0 2024-09-18T12:52:19.856 INFO:tasks.workunit.client.1.smithi161.stdout:0/987: dread df/d30/d71/d96/dd3/f114 [0,4194304] 0 2024-09-18T12:52:19.857 INFO:tasks.workunit.client.1.smithi161.stdout:3/949: mknod d1/d2e/d68/d69/d7d/c142 0 2024-09-18T12:52:19.857 INFO:tasks.workunit.client.0.smithi045.stdout:2/561: creat d5/d5f/db2/fbf x:0 0 0 2024-09-18T12:52:19.858 INFO:tasks.workunit.client.1.smithi161.stdout:9/864: getdents d0/d93/dfc 0 2024-09-18T12:52:19.860 INFO:tasks.workunit.client.0.smithi045.stdout:3/506: dread d0/d29/f67 [0,4194304] 0 2024-09-18T12:52:19.866 INFO:tasks.workunit.client.0.smithi045.stdout:2/562: dread d5/d5f/f78 [0,4194304] 0 2024-09-18T12:52:19.867 INFO:tasks.workunit.client.1.smithi161.stdout:5/991: fsync d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/f12c 0 2024-09-18T12:52:19.867 INFO:tasks.workunit.client.0.smithi045.stdout:3/507: dwrite d0/d22/fa1 [0,4194304] 0 2024-09-18T12:52:19.874 INFO:tasks.workunit.client.1.smithi161.stdout:8/992: write d0/d3/d10/d21/d4a/d52/d82/d8b/d120/d125/f50 [3803625,102516] 0 2024-09-18T12:52:19.876 INFO:tasks.workunit.client.1.smithi161.stdout:1/843: symlink d1/d26/da6/l11c 0 2024-09-18T12:52:19.876 INFO:tasks.workunit.client.1.smithi161.stdout:1/844: fdatasync d1/f113 0 2024-09-18T12:52:19.877 INFO:tasks.workunit.client.1.smithi161.stdout:8/993: chown d0/d3/d10/d21/d4a/d52/d66/d5b/fae 20 1 2024-09-18T12:52:19.879 INFO:tasks.workunit.client.1.smithi161.stdout:1/845: truncate d1/d26/dad/db6/fe4 79483 0 2024-09-18T12:52:19.879 INFO:tasks.workunit.client.0.smithi045.stdout:8/557: write d11/d23/f2b [855367,85955] 0 2024-09-18T12:52:19.880 INFO:tasks.workunit.client.1.smithi161.stdout:3/950: truncate d1/f19 658447 0 2024-09-18T12:52:19.882 INFO:tasks.workunit.client.0.smithi045.stdout:2/563: write d5/d5f/db2/faa [124115,73887] 0 2024-09-18T12:52:19.884 INFO:tasks.workunit.client.0.smithi045.stdout:3/508: creat d0/d1e/d91/fad x:0 0 0 2024-09-18T12:52:19.886 INFO:tasks.workunit.client.0.smithi045.stdout:3/509: dread - d0/d22/f8e zero size 2024-09-18T12:52:19.887 INFO:tasks.workunit.client.1.smithi161.stdout:5/992: rmdir d3/d44/ddc 39 2024-09-18T12:52:19.889 INFO:tasks.workunit.client.0.smithi045.stdout:3/510: write d0/d22/f85 [91776,56017] 0 2024-09-18T12:52:19.890 INFO:tasks.workunit.client.0.smithi045.stdout:8/558: dwrite d11/d23/f2b [0,4194304] 0 2024-09-18T12:52:19.891 INFO:tasks.workunit.client.0.smithi045.stdout:9/476: dread d0/d3/d6/d10/f1b [0,4194304] 0 2024-09-18T12:52:19.892 INFO:tasks.workunit.client.0.smithi045.stdout:3/511: stat d0/d22/f8e 0 2024-09-18T12:52:19.893 INFO:tasks.workunit.client.0.smithi045.stdout:2/564: creat d5/d5f/da8/d61/dbb/fc0 x:0 0 0 2024-09-18T12:52:19.894 INFO:tasks.workunit.client.0.smithi045.stdout:1/519: dwrite d0/d12/d32/d67/d6d/f72 [0,4194304] 0 2024-09-18T12:52:19.894 INFO:tasks.workunit.client.1.smithi161.stdout:8/994: read d0/d3/f69 [508193,64245] 0 2024-09-18T12:52:19.896 INFO:tasks.workunit.client.0.smithi045.stdout:3/512: rmdir d0/d29/d5f 39 2024-09-18T12:52:19.896 INFO:tasks.workunit.client.1.smithi161.stdout:0/988: dwrite df/f1c [0,4194304] 0 2024-09-18T12:52:19.899 INFO:tasks.workunit.client.0.smithi045.stdout:1/520: fdatasync d0/f69 0 2024-09-18T12:52:19.901 INFO:tasks.workunit.client.0.smithi045.stdout:2/565: creat d5/d2c/dac/fc1 x:0 0 0 2024-09-18T12:52:19.903 INFO:tasks.workunit.client.1.smithi161.stdout:9/865: dwrite d0/f2f [0,4194304] 0 2024-09-18T12:52:19.905 INFO:tasks.workunit.client.0.smithi045.stdout:2/566: creat d5/d5f/da8/d61/fc2 x:0 0 0 2024-09-18T12:52:19.906 INFO:tasks.workunit.client.1.smithi161.stdout:9/866: write d0/d20/d49/de6/f11b [388169,107599] 0 2024-09-18T12:52:19.908 INFO:tasks.workunit.client.1.smithi161.stdout:3/951: mkdir d1/d2e/d24/d1d/d89/d10f/d127/d143 0 2024-09-18T12:52:19.911 INFO:tasks.workunit.client.1.smithi161.stdout:1/846: creat d1/da/d1f/d6b/dd2/f11d x:0 0 0 2024-09-18T12:52:19.911 INFO:tasks.workunit.client.1.smithi161.stdout:8/995: creat d0/d3/d10/d21/d4a/d52/d82/d96/dba/d10d/f152 x:0 0 0 2024-09-18T12:52:19.916 INFO:tasks.workunit.client.1.smithi161.stdout:7/840: getdents d3/d8/d15/da7/d44 0 2024-09-18T12:52:19.917 INFO:tasks.workunit.client.1.smithi161.stdout:5/993: rename d3 to d3/d44/d6f/dca/d10d/d85/dd3/d13c 22 2024-09-18T12:52:19.918 INFO:tasks.workunit.client.1.smithi161.stdout:8/996: chown d0/d3/d10/d21/d4a/d52/d82/d8b/fd6 11 1 2024-09-18T12:52:19.918 INFO:tasks.workunit.client.1.smithi161.stdout:3/952: mknod d1/d2e/d68/d92/dba/c144 0 2024-09-18T12:52:19.918 INFO:tasks.workunit.client.1.smithi161.stdout:9/867: dwrite d0/d93/f10f [0,4194304] 0 2024-09-18T12:52:19.920 INFO:tasks.workunit.client.1.smithi161.stdout:8/997: read - d0/d3/d10/d21/d11e/f14a zero size 2024-09-18T12:52:19.921 INFO:tasks.workunit.client.1.smithi161.stdout:7/841: write d3/d8/f91 [5181381,17591] 0 2024-09-18T12:52:19.922 INFO:tasks.workunit.client.1.smithi161.stdout:3/953: fsync d1/d2e/d24/d1d/f9f 0 2024-09-18T12:52:19.923 INFO:tasks.workunit.client.1.smithi161.stdout:0/989: link df/d30/d71/d96/dd3/cf1 df/d29/c15d 0 2024-09-18T12:52:19.924 INFO:tasks.workunit.client.1.smithi161.stdout:3/954: dread - d1/d2e/d68/d92/fac zero size 2024-09-18T12:52:19.928 INFO:tasks.workunit.client.1.smithi161.stdout:0/990: unlink df/lfc 0 2024-09-18T12:52:19.929 INFO:tasks.workunit.client.1.smithi161.stdout:8/998: read d0/d3/d10/d21/d4a/d52/d66/d5b/fa0 [2204962,78634] 0 2024-09-18T12:52:19.929 INFO:tasks.workunit.client.1.smithi161.stdout:9/868: link d0/d20/cec d0/d47/df1/d59/ddb/c122 0 2024-09-18T12:52:19.930 INFO:tasks.workunit.client.1.smithi161.stdout:0/991: write df/d30/d4d/d92/f9e [6322268,38210] 0 2024-09-18T12:52:19.931 INFO:tasks.workunit.client.0.smithi045.stdout:2/567: getdents d5/d2c/dac 0 2024-09-18T12:52:19.933 INFO:tasks.workunit.client.1.smithi161.stdout:3/955: creat d1/d2e/d14/d65/f145 x:0 0 0 2024-09-18T12:52:19.933 INFO:tasks.workunit.client.0.smithi045.stdout:2/568: truncate d5/d2c/d4d/d76/d93/fa4 944071 0 2024-09-18T12:52:19.934 INFO:tasks.workunit.client.1.smithi161.stdout:3/956: chown d1/d2e/d14/d2c/l4e 10920687 1 2024-09-18T12:52:19.935 INFO:tasks.workunit.client.1.smithi161.stdout:9/869: write d0/d47/df1/d59/ddb/fe3 [276962,19997] 0 2024-09-18T12:52:19.937 INFO:tasks.workunit.client.1.smithi161.stdout:0/992: mkdir df/d30/d71/d96/dd3/d78/d15e 0 2024-09-18T12:52:19.938 INFO:tasks.workunit.client.0.smithi045.stdout:2/569: creat d5/d3a/d6b/fc3 x:0 0 0 2024-09-18T12:52:19.940 INFO:tasks.workunit.client.0.smithi045.stdout:1/521: truncate d0/d2d/d2b/d30/d40/d60/d8f/f97 3665784 0 2024-09-18T12:52:19.941 INFO:tasks.workunit.client.1.smithi161.stdout:0/993: dread df/d30/f3f [0,4194304] 0 2024-09-18T12:52:19.941 INFO:tasks.workunit.client.1.smithi161.stdout:3/957: unlink d1/d2e/d14/d65/d76/d8c/de0/d134/f12a 0 2024-09-18T12:52:19.942 INFO:tasks.workunit.client.0.smithi045.stdout:2/570: readlink d5/d5f/da8/d61/lab 0 2024-09-18T12:52:19.944 INFO:tasks.workunit.client.1.smithi161.stdout:9/870: creat d0/d20/d74/ded/d102/f123 x:0 0 0 2024-09-18T12:52:19.945 INFO:tasks.workunit.client.0.smithi045.stdout:1/522: creat d0/d12/d32/d67/f98 x:0 0 0 2024-09-18T12:52:19.945 INFO:tasks.workunit.client.0.smithi045.stdout:1/523: fsync d0/f69 0 2024-09-18T12:52:19.945 INFO:tasks.workunit.client.1.smithi161.stdout:1/847: dread d1/d26/d88/fa3 [0,4194304] 0 2024-09-18T12:52:19.946 INFO:tasks.workunit.client.0.smithi045.stdout:1/524: chown d0/d2d/d2b/d30/d40/d61 688 1 2024-09-18T12:52:19.947 INFO:tasks.workunit.client.1.smithi161.stdout:1/848: write d1/d71/fef [165706,38621] 0 2024-09-18T12:52:19.948 INFO:tasks.workunit.client.0.smithi045.stdout:1/525: write d0/d2d/d2b/d30/d8b/f7c [5112305,39634] 0 2024-09-18T12:52:19.948 INFO:tasks.workunit.client.1.smithi161.stdout:0/994: dread df/d30/d4d/f4f [0,4194304] 0 2024-09-18T12:52:19.953 INFO:tasks.workunit.client.1.smithi161.stdout:5/994: dwrite d3/d8/f91 [0,4194304] 0 2024-09-18T12:52:19.954 INFO:tasks.workunit.client.1.smithi161.stdout:1/849: truncate d1/d26/dad/fd1 928808 0 2024-09-18T12:52:19.954 INFO:tasks.workunit.client.1.smithi161.stdout:8/999: write d0/d3/d10/d21/f3a [1032320,28249] 0 2024-09-18T12:52:19.955 INFO:tasks.workunit.client.0.smithi045.stdout:2/571: creat d5/d2c/d4d/fc4 x:0 0 0 2024-09-18T12:52:19.958 INFO:tasks.workunit.client.0.smithi045.stdout:1/526: symlink d0/d2d/d2b/d30/l99 0 2024-09-18T12:52:19.959 INFO:tasks.workunit.client.1.smithi161.stdout:1/850: write d1/d26/f3f [5105288,90278] 0 2024-09-18T12:52:19.964 INFO:tasks.workunit.client.0.smithi045.stdout:2/572: mkdir d5/dc5 0 2024-09-18T12:52:19.966 INFO:tasks.workunit.client.0.smithi045.stdout:1/527: dwrite d0/d12/d32/d67/d6a/f96 [0,4194304] 0 2024-09-18T12:52:19.966 INFO:tasks.workunit.client.0.smithi045.stdout:2/573: truncate d5/d5f/f8b 457387 0 2024-09-18T12:52:19.971 INFO:tasks.workunit.client.1.smithi161.stdout:3/958: getdents d1/d2e/d14/d65 0 2024-09-18T12:52:19.975 INFO:tasks.workunit.client.1.smithi161.stdout:0/995: link df/d30/d71/faa df/d30/d71/d96/f15f 0 2024-09-18T12:52:19.977 INFO:tasks.workunit.client.0.smithi045.stdout:2/574: write d5/d46/f70 [438239,76068] 0 2024-09-18T12:52:19.978 INFO:tasks.workunit.client.0.smithi045.stdout:1/528: creat d0/f9a x:0 0 0 2024-09-18T12:52:19.980 INFO:tasks.workunit.client.1.smithi161.stdout:5/995: getdents d3/d131 0 2024-09-18T12:52:19.981 INFO:tasks.workunit.client.0.smithi045.stdout:1/529: dread - d0/d2d/d2b/d30/d8b/f4e zero size 2024-09-18T12:52:19.981 INFO:tasks.workunit.client.0.smithi045.stdout:1/530: stat d0/f9a 0 2024-09-18T12:52:19.982 INFO:tasks.workunit.client.0.smithi045.stdout:1/531: dread - d0/d12/d32/d67/d6d/f7e zero size 2024-09-18T12:52:19.982 INFO:tasks.workunit.client.1.smithi161.stdout:1/851: dwrite d1/da/d31/f77 [0,4194304] 0 2024-09-18T12:52:19.983 INFO:tasks.workunit.client.1.smithi161.stdout:0/996: creat df/f160 x:0 0 0 2024-09-18T12:52:19.983 INFO:tasks.workunit.client.0.smithi045.stdout:1/532: rmdir d0/d2d/d2b/d30 39 2024-09-18T12:52:19.986 INFO:tasks.workunit.client.1.smithi161.stdout:1/852: read d1/d26/f7 [7952394,87389] 0 2024-09-18T12:52:19.987 INFO:tasks.workunit.client.0.smithi045.stdout:1/533: creat d0/d2d/d2b/f9b x:0 0 0 2024-09-18T12:52:19.988 INFO:tasks.workunit.client.1.smithi161.stdout:5/996: write d3/d44/d6f/dca/d10d/d4b/d8e/d24/d61/fc6 [813738,51277] 0 2024-09-18T12:52:19.990 INFO:tasks.workunit.client.1.smithi161.stdout:1/853: mknod d1/d48/c11e 0 2024-09-18T12:52:19.992 INFO:tasks.workunit.client.1.smithi161.stdout:5/997: read d3/d44/d6f/dca/d10d/d4b/d8e/f8a [4599108,7961] 0 2024-09-18T12:52:19.992 INFO:tasks.workunit.client.1.smithi161.stdout:1/854: fdatasync d1/da/d39/f37 0 2024-09-18T12:52:19.993 INFO:tasks.workunit.client.0.smithi045.stdout:1/534: dwrite d0/d12/d32/d67/d6d/f95 [0,4194304] 0 2024-09-18T12:52:19.994 INFO:tasks.workunit.client.1.smithi161.stdout:1/855: write d1/d26/d88/fb0 [570533,55351] 0 2024-09-18T12:52:19.996 INFO:tasks.workunit.client.1.smithi161.stdout:3/959: dread d1/d2e/d24/d1d/d89/fc7 [0,4194304] 0 2024-09-18T12:52:19.997 INFO:tasks.workunit.client.0.smithi045.stdout:1/535: mkdir d0/d12/d32/d67/d6d/d9c 0 2024-09-18T12:52:19.999 INFO:tasks.workunit.client.1.smithi161.stdout:5/998: rename d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/cc1 to d3/d8/de4/d8d/ddb/d12e/c13d 0 2024-09-18T12:52:20.000 INFO:tasks.workunit.client.0.smithi045.stdout:1/536: truncate d0/f6 1302835 0 2024-09-18T12:52:20.000 INFO:tasks.workunit.client.1.smithi161.stdout:1/856: chown d1/da/d1f/dab/daf/de8/d118/l66 100364050 1 2024-09-18T12:52:20.002 INFO:tasks.workunit.client.1.smithi161.stdout:5/999: chown d3/d44/d6f/dca/d10d/d4b/d8e/d24/db8/da4 8 1 2024-09-18T12:52:20.002 INFO:tasks.workunit.client.0.smithi045.stdout:1/537: chown d0/f7 23119 1 2024-09-18T12:52:20.003 INFO:tasks.workunit.client.1.smithi161.stdout:3/960: mkdir d1/d2e/d68/d11c/d146 0 2024-09-18T12:52:20.003 INFO:tasks.workunit.client.1.smithi161.stdout:1/857: chown d1/daa/db2/dc0/ff8 31075 1 2024-09-18T12:52:20.005 INFO:tasks.workunit.client.1.smithi161.stdout:1/858: readlink d1/d1d/l35 0 2024-09-18T12:52:20.006 INFO:tasks.workunit.client.0.smithi045.stdout:1/538: symlink d0/d2d/d2b/d30/d8b/d5b/l9d 0 2024-09-18T12:52:20.007 INFO:tasks.workunit.client.1.smithi161.stdout:0/997: dread df/d29/fc0 [0,4194304] 0 2024-09-18T12:52:20.008 INFO:tasks.workunit.client.1.smithi161.stdout:0/998: truncate df/d29/d36/fbb 4229469 0 2024-09-18T12:52:20.011 INFO:tasks.workunit.client.1.smithi161.stdout:0/999: mkdir df/d30/d71/d96/dd3/d90/d37/d161 0 2024-09-18T12:52:20.015 INFO:tasks.workunit.client.1.smithi161.stdout:3/961: truncate d1/d2e/d68/d92/ded/f7 981748 0 2024-09-18T12:52:20.015 INFO:tasks.workunit.client.1.smithi161.stdout:1/859: write d1/da/d1f/dab/daf/de8/d118/f69 [2251095,32132] 0 2024-09-18T12:52:20.020 INFO:tasks.workunit.client.0.smithi045.stdout:1/539: dread d0/d2e/f42 [0,4194304] 0 2024-09-18T12:52:20.024 INFO:tasks.workunit.client.1.smithi161.stdout:3/962: stat d1/d2e/d14/d2c/cf1 0 2024-09-18T12:52:20.026 INFO:tasks.workunit.client.0.smithi045.stdout:1/540: mknod d0/d2d/d2b/d30/d40/d60/c9e 0 2024-09-18T12:52:20.026 INFO:tasks.workunit.client.0.smithi045.stdout:1/541: read - d0/d2d/f68 zero size 2024-09-18T12:52:20.027 INFO:tasks.workunit.client.1.smithi161.stdout:3/963: creat d1/d2e/d24/d84/f147 x:0 0 0 2024-09-18T12:52:20.027 INFO:tasks.workunit.client.1.smithi161.stdout:3/964: chown d1/d2e/d68/d69/c75 421 1 2024-09-18T12:52:20.030 INFO:tasks.workunit.client.1.smithi161.stdout:3/965: creat d1/d2e/d24/d1d/d89/f148 x:0 0 0 2024-09-18T12:52:20.032 INFO:tasks.workunit.client.1.smithi161.stdout:9/871: sync 2024-09-18T12:52:20.033 INFO:tasks.workunit.client.1.smithi161.stdout:7/842: sync 2024-09-18T12:52:20.034 INFO:tasks.workunit.client.1.smithi161.stdout:1/860: dwrite d1/d26/d3a/fc9 [0,4194304] 0 2024-09-18T12:52:20.035 INFO:tasks.workunit.client.1.smithi161.stdout:3/966: fsync d1/d2e/d68/d92/ded/f7 0 2024-09-18T12:52:20.035 INFO:tasks.workunit.client.1.smithi161.stdout:1/861: fsync d1/f28 0 2024-09-18T12:52:20.038 INFO:tasks.workunit.client.1.smithi161.stdout:9/872: mkdir d0/d20/d49/d124 0 2024-09-18T12:52:20.040 INFO:tasks.workunit.client.1.smithi161.stdout:9/873: chown d0/d47/df1/d59/ddb/l11a 3 1 2024-09-18T12:52:20.041 INFO:tasks.workunit.client.1.smithi161.stdout:1/862: mkdir d1/da/d1f/d6b/d11f 0 2024-09-18T12:52:20.041 INFO:tasks.workunit.client.0.smithi045.stdout:1/542: dwrite d0/fe [4194304,4194304] 0 2024-09-18T12:52:20.043 INFO:tasks.workunit.client.0.smithi045.stdout:1/543: write d0/d12/f3b [493375,102449] 0 2024-09-18T12:52:20.043 INFO:tasks.workunit.client.1.smithi161.stdout:9/874: write d0/f6e [1893144,16556] 0 2024-09-18T12:52:20.044 INFO:tasks.workunit.client.1.smithi161.stdout:7/843: write d3/d8/d15/da7/d24/f51 [2282049,43841] 0 2024-09-18T12:52:20.046 INFO:tasks.workunit.client.1.smithi161.stdout:1/863: rmdir d1 39 2024-09-18T12:52:20.049 INFO:tasks.workunit.client.1.smithi161.stdout:9/875: creat d0/d47/df1/d59/f125 x:0 0 0 2024-09-18T12:52:20.051 INFO:tasks.workunit.client.0.smithi045.stdout:1/544: dwrite d0/d12/d32/d67/d6d/f95 [0,4194304] 0 2024-09-18T12:52:20.054 INFO:tasks.workunit.client.1.smithi161.stdout:9/876: creat d0/d47/d48/d9a/f126 x:0 0 0 2024-09-18T12:52:20.057 INFO:tasks.workunit.client.1.smithi161.stdout:1/864: mknod d1/d71/ded/c120 0 2024-09-18T12:52:20.059 INFO:tasks.workunit.client.0.smithi045.stdout:1/545: truncate d0/f7 4714249 0 2024-09-18T12:52:20.060 INFO:tasks.workunit.client.1.smithi161.stdout:7/844: mknod d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/d89/d8f/cfd 0 2024-09-18T12:52:20.060 INFO:tasks.workunit.client.0.smithi045.stdout:1/546: chown d0/d2e/f58 2132672 1 2024-09-18T12:52:20.063 INFO:tasks.workunit.client.1.smithi161.stdout:3/967: dread d1/d2e/d14/d90/fbf [0,4194304] 0 2024-09-18T12:52:20.064 INFO:tasks.workunit.client.1.smithi161.stdout:7/845: symlink d3/d8/d15/d99/db0/lfe 0 2024-09-18T12:52:20.065 INFO:tasks.workunit.client.1.smithi161.stdout:3/968: stat d1/d2e/d14/d90/fd8 0 2024-09-18T12:52:20.066 INFO:tasks.workunit.client.1.smithi161.stdout:7/846: read d3/d50/fba [260481,120111] 0 2024-09-18T12:52:20.067 INFO:tasks.workunit.client.1.smithi161.stdout:3/969: chown d1/d2e/d14/d65/d76/d8c/de0/d134/lfd 4638 1 2024-09-18T12:52:20.076 INFO:tasks.workunit.client.1.smithi161.stdout:1/865: dread d1/d26/f50 [0,4194304] 0 2024-09-18T12:52:20.082 INFO:tasks.workunit.client.0.smithi045.stdout:1/547: write d0/d12/f27 [5112954,48383] 0 2024-09-18T12:52:20.083 INFO:tasks.workunit.client.1.smithi161.stdout:7/847: write d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/f6c [2469781,11174] 0 2024-09-18T12:52:20.084 INFO:tasks.workunit.client.0.smithi045.stdout:1/548: unlink d0/d2d/d2b/d30/d40/d60/c9e 0 2024-09-18T12:52:20.085 INFO:tasks.workunit.client.1.smithi161.stdout:1/866: truncate d1/d26/d88/fa3 2785965 0 2024-09-18T12:52:20.088 INFO:tasks.workunit.client.1.smithi161.stdout:9/877: dwrite d0/d16/d25/d86/dae/f116 [0,4194304] 0 2024-09-18T12:52:20.089 INFO:tasks.workunit.client.1.smithi161.stdout:1/867: rename d1/da/d31/l41 to d1/da/dc6/l121 0 2024-09-18T12:52:20.089 INFO:tasks.workunit.client.0.smithi045.stdout:5/651: sync 2024-09-18T12:52:20.090 INFO:tasks.workunit.client.0.smithi045.stdout:0/542: sync 2024-09-18T12:52:20.090 INFO:tasks.workunit.client.1.smithi161.stdout:1/868: readlink d1/da/d1f/d6b/lf7 0 2024-09-18T12:52:20.091 INFO:tasks.workunit.client.1.smithi161.stdout:1/869: stat d1/dbf/lc8 0 2024-09-18T12:52:20.091 INFO:tasks.workunit.client.1.smithi161.stdout:1/870: write d1/da/d31/f110 [952499,92600] 0 2024-09-18T12:52:20.092 INFO:tasks.workunit.client.0.smithi045.stdout:0/543: fsync d6/d7/ff 0 2024-09-18T12:52:20.094 INFO:tasks.workunit.client.0.smithi045.stdout:5/652: rmdir d6/db/d6a 39 2024-09-18T12:52:20.096 INFO:tasks.workunit.client.0.smithi045.stdout:5/653: chown d6/db/d19/d92/d5c 0 1 2024-09-18T12:52:20.098 INFO:tasks.workunit.client.0.smithi045.stdout:5/654: write d6/db/d19/d92/d5c/dae/fbf [981899,66605] 0 2024-09-18T12:52:20.099 INFO:tasks.workunit.client.0.smithi045.stdout:5/655: readlink d6/db/d70/l85 0 2024-09-18T12:52:20.099 INFO:tasks.workunit.client.0.smithi045.stdout:1/549: dread d0/d12/f3b [0,4194304] 0 2024-09-18T12:52:20.101 INFO:tasks.workunit.client.0.smithi045.stdout:5/656: chown d6/db/d19/d92/d61/da5/dc9/fd4 94279 1 2024-09-18T12:52:20.101 INFO:tasks.workunit.client.1.smithi161.stdout:7/848: link d3/d8/d15/da7/d24/d31/ff1 d3/d8/d15/da7/d4a/d64/d8c/d9f/dd7/fff 0 2024-09-18T12:52:20.103 INFO:tasks.workunit.client.1.smithi161.stdout:9/878: mkdir d0/db/d18/d121/d127 0 2024-09-18T12:52:20.105 INFO:tasks.workunit.client.0.smithi045.stdout:0/544: link d6/f98 d6/d48/d5e/d39/d58/d86/f99 0 2024-09-18T12:52:20.106 INFO:tasks.workunit.client.1.smithi161.stdout:1/871: mknod d1/d1d/c122 0 2024-09-18T12:52:20.107 INFO:tasks.workunit.client.1.smithi161.stdout:1/872: truncate d1/daa/ffe 422499 0 2024-09-18T12:52:20.110 INFO:tasks.workunit.client.1.smithi161.stdout:7/849: rename d3/c85 to d3/d8/d15/da7/d4a/d64/d8c/d9f/d55/c100 0 2024-09-18T12:52:20.111 INFO:tasks.workunit.client.0.smithi045.stdout:0/545: rmdir d6/d48 39 2024-09-18T12:52:20.111 INFO:tasks.workunit.client.0.smithi045.stdout:0/546: chown d6/d7/c3d 922 1 2024-09-18T12:52:20.112 INFO:tasks.workunit.client.0.smithi045.stdout:0/547: rename d6/d7 to d6/d7/d32/d9a 22 2024-09-18T12:52:20.112 INFO:tasks.workunit.client.0.smithi045.stdout:1/550: mknod d0/d2d/d6c/c9f 0 2024-09-18T12:52:20.114 INFO:tasks.workunit.client.1.smithi161.stdout:1/873: dwrite d1/d71/fac [0,4194304] 0 2024-09-18T12:52:20.115 INFO:tasks.workunit.client.0.smithi045.stdout:1/551: symlink d0/la0 0 2024-09-18T12:52:20.118 INFO:tasks.workunit.client.1.smithi161.stdout:1/874: readlink d1/d1d/l25 0 2024-09-18T12:52:20.122 INFO:tasks.workunit.client.1.smithi161.stdout:1/875: dread d1/da/d1f/f2c [0,4194304] 0 2024-09-18T12:52:20.124 INFO:tasks.workunit.client.0.smithi045.stdout:0/548: dwrite d6/d48/d5e/d39/d58/d3c/f47 [0,4194304] 0 2024-09-18T12:52:20.131 INFO:tasks.workunit.client.0.smithi045.stdout:5/657: dwrite d6/d28/d2b/f2d [0,4194304] 0 2024-09-18T12:52:20.132 INFO:tasks.workunit.client.1.smithi161.stdout:9/879: dwrite d0/d16/f9c [0,4194304] 0 2024-09-18T12:52:20.134 INFO:tasks.workunit.client.1.smithi161.stdout:7/850: dread d3/d8/d15/f3c [0,4194304] 0 2024-09-18T12:52:20.136 INFO:tasks.workunit.client.1.smithi161.stdout:1/876: getdents d1 0 2024-09-18T12:52:20.139 INFO:tasks.workunit.client.0.smithi045.stdout:1/552: dwrite d0/d2d/d2b/d30/d40/d60/d8f/f70 [0,4194304] 0 2024-09-18T12:52:20.142 INFO:tasks.workunit.client.0.smithi045.stdout:0/549: truncate d6/d7/d32/f33 706061 0 2024-09-18T12:52:20.143 INFO:tasks.workunit.client.0.smithi045.stdout:5/658: write d6/db/fe [3926290,111455] 0 2024-09-18T12:52:20.148 INFO:tasks.workunit.client.0.smithi045.stdout:5/659: chown d6/d28/d2b/f4e 0 1 2024-09-18T12:52:20.149 INFO:tasks.workunit.client.1.smithi161.stdout:1/877: dwrite d1/da/d1f/dab/daf/de3/fff [0,4194304] 0 2024-09-18T12:52:20.150 INFO:tasks.workunit.client.0.smithi045.stdout:5/660: write d6/db/d19/d92/fbd [1004090,109696] 0 2024-09-18T12:52:20.152 INFO:tasks.workunit.client.0.smithi045.stdout:5/661: mkdir d6/db/d54/dd5 0 2024-09-18T12:52:20.154 INFO:tasks.workunit.client.0.smithi045.stdout:5/662: dread - d6/d3e/fa0 zero size 2024-09-18T12:52:20.154 INFO:tasks.workunit.client.1.smithi161.stdout:1/878: creat d1/daa/db2/dc0/f123 x:0 0 0 2024-09-18T12:52:20.155 INFO:tasks.workunit.client.1.smithi161.stdout:1/879: chown d1/da/d31/fd3 27217 1 2024-09-18T12:52:20.157 INFO:tasks.workunit.client.0.smithi045.stdout:6/505: sync 2024-09-18T12:52:20.159 INFO:tasks.workunit.client.1.smithi161.stdout:1/880: creat d1/d26/d88/f124 x:0 0 0 2024-09-18T12:52:20.160 INFO:tasks.workunit.client.0.smithi045.stdout:6/506: link d9/d1a/d2d/f78 d9/d1a/d48/fb9 0 2024-09-18T12:52:20.161 INFO:tasks.workunit.client.0.smithi045.stdout:6/507: chown d9/d30/ca9 121579 1 2024-09-18T12:52:20.166 INFO:tasks.workunit.client.1.smithi161.stdout:3/970: sync 2024-09-18T12:52:20.172 INFO:tasks.workunit.client.0.smithi045.stdout:1/553: write d0/d2d/d2b/d30/f4f [1096975,51246] 0 2024-09-18T12:52:20.173 INFO:tasks.workunit.client.1.smithi161.stdout:9/880: truncate d0/d20/d49/d65/f92 3658107 0 2024-09-18T12:52:20.174 INFO:tasks.workunit.client.1.smithi161.stdout:9/881: stat d0/db/d18/d121/d127 0 2024-09-18T12:52:20.174 INFO:tasks.workunit.client.1.smithi161.stdout:7/851: dread d3/d8/d15/da7/d4a/d64/d8c/d9f/f5f [0,4194304] 0 2024-09-18T12:52:20.177 INFO:tasks.workunit.client.0.smithi045.stdout:5/663: truncate d6/db/d5a/d78/f45 5300411 0 2024-09-18T12:52:20.178 INFO:tasks.workunit.client.1.smithi161.stdout:7/852: write d3/d83/db6/fd6 [7001407,24598] 0 2024-09-18T12:52:20.179 INFO:tasks.workunit.client.1.smithi161.stdout:7/853: chown d3/fa3 101126832 1 2024-09-18T12:52:20.179 INFO:tasks.workunit.client.0.smithi045.stdout:0/550: dwrite d6/d35/f3f [0,4194304] 0 2024-09-18T12:52:20.180 INFO:tasks.workunit.client.0.smithi045.stdout:1/554: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:52:20.182 INFO:tasks.workunit.client.1.smithi161.stdout:7/854: unlink d3/d8/d15/l3a 0 2024-09-18T12:52:20.183 INFO:tasks.workunit.client.0.smithi045.stdout:5/664: fdatasync d6/db/d5a/d78/d66/f7b 0 2024-09-18T12:52:20.185 INFO:tasks.workunit.client.1.smithi161.stdout:3/971: write d1/d2e/d24/d84/d9a/fc2 [595616,108830] 0 2024-09-18T12:52:20.185 INFO:tasks.workunit.client.0.smithi045.stdout:0/551: mkdir d6/d7/d32/d9b 0 2024-09-18T12:52:20.186 INFO:tasks.workunit.client.1.smithi161.stdout:1/881: dread d1/da/d31/fd3 [0,4194304] 0 2024-09-18T12:52:20.189 INFO:tasks.workunit.client.1.smithi161.stdout:7/855: mkdir d3/d8/d15/d99/db0/d101 0 2024-09-18T12:52:20.189 INFO:tasks.workunit.client.0.smithi045.stdout:6/508: dwrite d9/d1a/d2d/d38/f3d [0,4194304] 0 2024-09-18T12:52:20.191 INFO:tasks.workunit.client.1.smithi161.stdout:3/972: mkdir d1/d2e/d24/d1d/d89/db0/de4/d149 0 2024-09-18T12:52:20.193 INFO:tasks.workunit.client.1.smithi161.stdout:9/882: dread d0/d16/d25/d46/f68 [0,4194304] 0 2024-09-18T12:52:20.197 INFO:tasks.workunit.client.1.smithi161.stdout:1/882: mknod d1/da/d1f/d6b/dd2/c125 0 2024-09-18T12:52:20.199 INFO:tasks.workunit.client.0.smithi045.stdout:0/552: dwrite d6/d48/d5e/d39/d58/d3c/d69/f4b [0,4194304] 0 2024-09-18T12:52:20.201 INFO:tasks.workunit.client.0.smithi045.stdout:0/553: readlink d6/d48/d5e/d39/d58/l4e 0 2024-09-18T12:52:20.203 INFO:tasks.workunit.client.1.smithi161.stdout:1/883: dwrite d1/da/d39/f106 [0,4194304] 0 2024-09-18T12:52:20.204 INFO:tasks.workunit.client.1.smithi161.stdout:1/884: stat d1/d1d/l35 0 2024-09-18T12:52:20.205 INFO:tasks.workunit.client.1.smithi161.stdout:1/885: stat d1/da/d1f/c75 0 2024-09-18T12:52:20.206 INFO:tasks.workunit.client.1.smithi161.stdout:1/886: dread - d1/da/d39/fbd zero size 2024-09-18T12:52:20.207 INFO:tasks.workunit.client.1.smithi161.stdout:7/856: mkdir d3/d36/d102 0 2024-09-18T12:52:20.207 INFO:tasks.workunit.client.1.smithi161.stdout:1/887: stat d1/d26/dad 0 2024-09-18T12:52:20.211 INFO:tasks.workunit.client.1.smithi161.stdout:3/973: mkdir d1/d2e/d14/d90/d10d/d14a 0 2024-09-18T12:52:20.211 INFO:tasks.workunit.client.1.smithi161.stdout:1/888: read d1/f28 [920842,73941] 0 2024-09-18T12:52:20.212 INFO:tasks.workunit.client.1.smithi161.stdout:1/889: fdatasync d1/d71/fec 0 2024-09-18T12:52:20.215 INFO:tasks.workunit.client.0.smithi045.stdout:6/509: fdatasync d9/d1a/d48/fb9 0 2024-09-18T12:52:20.216 INFO:tasks.workunit.client.0.smithi045.stdout:6/510: read - d9/d1a/d2d/d38/d5b/fa0 zero size 2024-09-18T12:52:20.217 INFO:tasks.workunit.client.0.smithi045.stdout:0/554: symlink d6/d48/d5e/d39/d58/l9c 0 2024-09-18T12:52:20.225 INFO:tasks.workunit.client.1.smithi161.stdout:9/883: dread d0/d20/d49/fb5 [0,4194304] 0 2024-09-18T12:52:20.226 INFO:tasks.workunit.client.1.smithi161.stdout:9/884: stat d0/db/c1d 0 2024-09-18T12:52:20.226 INFO:tasks.workunit.client.0.smithi045.stdout:0/555: unlink d6/d48/d5e/d39/d58/d3b/d65/l8b 0 2024-09-18T12:52:20.226 INFO:tasks.workunit.client.0.smithi045.stdout:6/511: link d9/d1a/d2d/d32/l50 d9/d30/lba 0 2024-09-18T12:52:20.230 INFO:tasks.workunit.client.0.smithi045.stdout:0/556: creat d6/f9d x:0 0 0 2024-09-18T12:52:20.233 INFO:tasks.workunit.client.0.smithi045.stdout:0/557: creat d6/d7/d32/f9e x:0 0 0 2024-09-18T12:52:20.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/885: dwrite d0/db/f10a [4194304,4194304] 0 2024-09-18T12:52:20.233 INFO:tasks.workunit.client.0.smithi045.stdout:1/555: dread d0/f49 [0,4194304] 0 2024-09-18T12:52:20.234 INFO:tasks.workunit.client.1.smithi161.stdout:9/886: chown d0/f2f 23673597 1 2024-09-18T12:52:20.235 INFO:tasks.workunit.client.0.smithi045.stdout:1/556: fsync d0/d2d/d2b/f2f 0 2024-09-18T12:52:20.237 INFO:tasks.workunit.client.0.smithi045.stdout:5/665: write d6/db/d5a/f5f [404919,119886] 0 2024-09-18T12:52:20.238 INFO:tasks.workunit.client.0.smithi045.stdout:5/666: stat d6/d28/d2b/d51/d6c/f8d 0 2024-09-18T12:52:20.239 INFO:tasks.workunit.client.0.smithi045.stdout:5/667: dread - d6/db/d19/d92/d5c/f98 zero size 2024-09-18T12:52:20.240 INFO:tasks.workunit.client.1.smithi161.stdout:3/974: dread d1/d2e/d68/de8/df6/f11a [0,4194304] 0 2024-09-18T12:52:20.244 INFO:tasks.workunit.client.0.smithi045.stdout:1/557: creat d0/d12/d32/d67/d6d/fa1 x:0 0 0 2024-09-18T12:52:20.244 INFO:tasks.workunit.client.0.smithi045.stdout:0/558: dread d6/d48/d5e/d39/d58/d3c/d69/f4c [0,4194304] 0 2024-09-18T12:52:20.245 INFO:tasks.workunit.client.1.smithi161.stdout:7/857: write d3/d36/f8b [240583,22694] 0 2024-09-18T12:52:20.247 INFO:tasks.workunit.client.0.smithi045.stdout:1/558: readlink d0/d2d/d92/l93 0 2024-09-18T12:52:20.248 INFO:tasks.workunit.client.1.smithi161.stdout:3/975: dwrite d1/d2e/d14/d90/fd8 [0,4194304] 0 2024-09-18T12:52:20.250 INFO:tasks.workunit.client.1.smithi161.stdout:7/858: mknod d3/d83/c103 0 2024-09-18T12:52:20.253 INFO:tasks.workunit.client.1.smithi161.stdout:7/859: dread d3/d8/d15/da7/d24/ddd/feb [0,4194304] 0 2024-09-18T12:52:20.253 INFO:tasks.workunit.client.0.smithi045.stdout:0/559: mknod d6/d35/c9f 0 2024-09-18T12:52:20.254 INFO:tasks.workunit.client.1.smithi161.stdout:3/976: creat d1/d2e/d14/d65/d76/d88/f14b x:0 0 0 2024-09-18T12:52:20.256 INFO:tasks.workunit.client.0.smithi045.stdout:1/559: creat d0/d12/d32/d67/d6d/fa2 x:0 0 0 2024-09-18T12:52:20.258 INFO:tasks.workunit.client.1.smithi161.stdout:7/860: rmdir d3/d8/d15/da7/d4a/d59 39 2024-09-18T12:52:20.259 INFO:tasks.workunit.client.0.smithi045.stdout:1/560: write d0/f2 [662908,94247] 0 2024-09-18T12:52:20.261 INFO:tasks.workunit.client.0.smithi045.stdout:6/512: dwrite d9/d1a/d1d/f4e [0,4194304] 0 2024-09-18T12:52:20.263 INFO:tasks.workunit.client.0.smithi045.stdout:6/513: chown d9/d1a/l2a 0 1 2024-09-18T12:52:20.264 INFO:tasks.workunit.client.0.smithi045.stdout:0/560: read d6/d7/ff [3067682,130026] 0 2024-09-18T12:52:20.266 INFO:tasks.workunit.client.0.smithi045.stdout:6/514: mkdir d9/d1a/d48/d75/d81/dbb 0 2024-09-18T12:52:20.268 INFO:tasks.workunit.client.1.smithi161.stdout:7/861: mkdir d3/d8/d15/d99/dfb/d104 0 2024-09-18T12:52:20.271 INFO:tasks.workunit.client.1.smithi161.stdout:3/977: rmdir d1/d2e/d68/d11c/d146 0 2024-09-18T12:52:20.273 INFO:tasks.workunit.client.0.smithi045.stdout:0/561: symlink d6/d7/d32/d9b/la0 0 2024-09-18T12:52:20.274 INFO:tasks.workunit.client.1.smithi161.stdout:7/862: rename d3/d8/d4f/lee to d3/d83/l105 0 2024-09-18T12:52:20.275 INFO:tasks.workunit.client.1.smithi161.stdout:7/863: chown d3/d8/d15/da7/d4a/ld9 3133 1 2024-09-18T12:52:20.275 INFO:tasks.workunit.client.0.smithi045.stdout:6/515: symlink d9/d56/db3/lbc 0 2024-09-18T12:52:20.276 INFO:tasks.workunit.client.1.smithi161.stdout:7/864: write d3/d8/d15/da7/f39 [2541910,31240] 0 2024-09-18T12:52:20.276 INFO:tasks.workunit.client.1.smithi161.stdout:3/978: creat d1/d2e/d24/d1d/d89/db0/f14c x:0 0 0 2024-09-18T12:52:20.282 INFO:tasks.workunit.client.0.smithi045.stdout:6/516: getdents d9/d1a/d48/d97 0 2024-09-18T12:52:20.282 INFO:tasks.workunit.client.0.smithi045.stdout:1/561: dwrite d0/fc [0,4194304] 0 2024-09-18T12:52:20.283 INFO:tasks.workunit.client.1.smithi161.stdout:7/865: dwrite d3/d8/d15/da7/f39 [0,4194304] 0 2024-09-18T12:52:20.284 INFO:tasks.workunit.client.0.smithi045.stdout:1/562: chown d0/f9a 1604390778 1 2024-09-18T12:52:20.285 INFO:tasks.workunit.client.0.smithi045.stdout:6/517: symlink d9/d1a/d48/d75/d81/lbd 0 2024-09-18T12:52:20.288 INFO:tasks.workunit.client.1.smithi161.stdout:3/979: dread d1/d2e/d14/f44 [0,4194304] 0 2024-09-18T12:52:20.289 INFO:tasks.workunit.client.0.smithi045.stdout:6/518: symlink d9/d56/lbe 0 2024-09-18T12:52:20.291 INFO:tasks.workunit.client.1.smithi161.stdout:7/866: link d3/d50/f66 d3/d8/d15/da7/d44/f106 0 2024-09-18T12:52:20.295 INFO:tasks.workunit.client.1.smithi161.stdout:3/980: rename d1/d2e/d68/d92/fac to d1/d2e/d68/f14d 0 2024-09-18T12:52:20.296 INFO:tasks.workunit.client.0.smithi045.stdout:6/519: symlink d9/d1a/d2d/d38/d5b/d67/lbf 0 2024-09-18T12:52:20.298 INFO:tasks.workunit.client.1.smithi161.stdout:3/981: mkdir d1/d2e/d68/d69/d14e 0 2024-09-18T12:52:20.300 INFO:tasks.workunit.client.1.smithi161.stdout:7/867: symlink d3/d8/d15/da7/l107 0 2024-09-18T12:52:20.301 INFO:tasks.workunit.client.1.smithi161.stdout:3/982: getdents d1/d2e/d68/d69/d14e 0 2024-09-18T12:52:20.309 INFO:tasks.workunit.client.1.smithi161.stdout:7/868: write d3/ff0 [3159561,117297] 0 2024-09-18T12:52:20.312 INFO:tasks.workunit.client.1.smithi161.stdout:7/869: dread - d3/d8/d4f/fbf zero size 2024-09-18T12:52:20.313 INFO:tasks.workunit.client.0.smithi045.stdout:6/520: dwrite d9/d1a/d2d/d32/f62 [0,4194304] 0 2024-09-18T12:52:20.314 INFO:tasks.workunit.client.0.smithi045.stdout:1/563: dread d0/f7 [0,4194304] 0 2024-09-18T12:52:20.315 INFO:tasks.workunit.client.1.smithi161.stdout:3/983: dwrite d1/d2e/d68/d69/fc9 [4194304,4194304] 0 2024-09-18T12:52:20.316 INFO:tasks.workunit.client.0.smithi045.stdout:1/564: fsync d0/d12/d32/d67/f98 0 2024-09-18T12:52:20.316 INFO:tasks.workunit.client.1.smithi161.stdout:7/870: dread - d3/d8/d15/da7/d4a/d59/f73 zero size 2024-09-18T12:52:20.319 INFO:tasks.workunit.client.1.smithi161.stdout:3/984: fsync d1/d2e/d24/d1d/f2a 0 2024-09-18T12:52:20.319 INFO:tasks.workunit.client.0.smithi045.stdout:6/521: rmdir d9/d1a/d2d/d38/d5b 39 2024-09-18T12:52:20.320 INFO:tasks.workunit.client.0.smithi045.stdout:6/522: chown d9/d1a/l73 14501760 1 2024-09-18T12:52:20.322 INFO:tasks.workunit.client.0.smithi045.stdout:1/565: truncate d0/f7 1145367 0 2024-09-18T12:52:20.323 INFO:tasks.workunit.client.0.smithi045.stdout:6/523: chown d9/f13 9676831 1 2024-09-18T12:52:20.324 INFO:tasks.workunit.client.1.smithi161.stdout:3/985: creat d1/d2e/d24/d1d/d89/db0/de4/d149/f14f x:0 0 0 2024-09-18T12:52:20.327 INFO:tasks.workunit.client.0.smithi045.stdout:6/524: rename d9/d30/da7 to d9/d56/db3/dc0 0 2024-09-18T12:52:20.328 INFO:tasks.workunit.client.1.smithi161.stdout:7/871: write d3/d8/d15/da7/d4a/fd1 [2090592,19179] 0 2024-09-18T12:52:20.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/890: sync 2024-09-18T12:52:20.329 INFO:tasks.workunit.client.1.smithi161.stdout:3/986: creat d1/d2e/d68/d92/ded/d49/dce/f150 x:0 0 0 2024-09-18T12:52:20.330 INFO:tasks.workunit.client.1.smithi161.stdout:7/872: fdatasync d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/fbb 0 2024-09-18T12:52:20.331 INFO:tasks.workunit.client.1.smithi161.stdout:1/891: chown d1/d26/d3a/c8a 211351693 1 2024-09-18T12:52:20.331 INFO:tasks.workunit.client.0.smithi045.stdout:1/566: dwrite d0/f49 [4194304,4194304] 0 2024-09-18T12:52:20.334 INFO:tasks.workunit.client.0.smithi045.stdout:1/567: chown d0/l5e 1007182308 1 2024-09-18T12:52:20.336 INFO:tasks.workunit.client.1.smithi161.stdout:7/873: mknod d3/d8/d15/da7/c108 0 2024-09-18T12:52:20.336 INFO:tasks.workunit.client.0.smithi045.stdout:4/720: sync 2024-09-18T12:52:20.337 INFO:tasks.workunit.client.0.smithi045.stdout:1/568: mknod d0/d12/d32/ca3 0 2024-09-18T12:52:20.337 INFO:tasks.workunit.client.0.smithi045.stdout:4/721: fdatasync db/de/fae 0 2024-09-18T12:52:20.338 INFO:tasks.workunit.client.1.smithi161.stdout:7/874: chown d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/d9b/cbd 0 1 2024-09-18T12:52:20.339 INFO:tasks.workunit.client.1.smithi161.stdout:1/892: dwrite d1/d26/d3a/f7b [0,4194304] 0 2024-09-18T12:52:20.344 INFO:tasks.workunit.client.0.smithi045.stdout:1/569: dwrite d0/fc [4194304,4194304] 0 2024-09-18T12:52:20.344 INFO:tasks.workunit.client.0.smithi045.stdout:4/722: getdents db/de/d1a/d2e 0 2024-09-18T12:52:20.354 INFO:tasks.workunit.client.1.smithi161.stdout:3/987: dread d1/d2e/d14/d2c/f31 [0,4194304] 0 2024-09-18T12:52:20.355 INFO:tasks.workunit.client.1.smithi161.stdout:3/988: truncate d1/f13a 264925 0 2024-09-18T12:52:20.360 INFO:tasks.workunit.client.0.smithi045.stdout:4/723: fsync db/de/d1e/d3e/d47/d59/f74 0 2024-09-18T12:52:20.361 INFO:tasks.workunit.client.0.smithi045.stdout:4/724: chown db/d2c/d35/d40 51226462 1 2024-09-18T12:52:20.362 INFO:tasks.workunit.client.0.smithi045.stdout:6/525: dwrite d9/d30/f3e [0,4194304] 0 2024-09-18T12:52:20.364 INFO:tasks.workunit.client.0.smithi045.stdout:6/526: readlink d9/d1a/d48/l4b 0 2024-09-18T12:52:20.372 INFO:tasks.workunit.client.1.smithi161.stdout:3/989: write d1/d2e/d14/d65/d76/d88/f8e [896361,120340] 0 2024-09-18T12:52:20.373 INFO:tasks.workunit.client.0.smithi045.stdout:6/527: dread d9/d1a/d2d/d38/d5b/d67/f79 [0,4194304] 0 2024-09-18T12:52:20.377 INFO:tasks.workunit.client.0.smithi045.stdout:4/725: write db/d2c/d35/d40/d77/fa7 [1029288,5382] 0 2024-09-18T12:52:20.377 INFO:tasks.workunit.client.0.smithi045.stdout:4/726: write db/de/d1e/d3e/d9a/d73/fc3 [46402,90362] 0 2024-09-18T12:52:20.377 INFO:tasks.workunit.client.0.smithi045.stdout:6/528: dread d9/d1a/d2d/d38/d5b/d67/f79 [0,4194304] 0 2024-09-18T12:52:20.378 INFO:tasks.workunit.client.1.smithi161.stdout:7/875: dread d3/d8/d15/f1e [0,4194304] 0 2024-09-18T12:52:20.378 INFO:tasks.workunit.client.0.smithi045.stdout:1/570: dread d0/d2d/d2b/f2f [0,4194304] 0 2024-09-18T12:52:20.378 INFO:tasks.workunit.client.0.smithi045.stdout:6/529: mkdir d9/d1a/d48/dc1 0 2024-09-18T12:52:20.379 INFO:tasks.workunit.client.1.smithi161.stdout:7/876: write d3/d8/d15/da7/d24/ddd/fde [3256420,1005] 0 2024-09-18T12:52:20.380 INFO:tasks.workunit.client.0.smithi045.stdout:4/727: truncate db/d20/f44 4093476 0 2024-09-18T12:52:20.381 INFO:tasks.workunit.client.1.smithi161.stdout:7/877: dread - d3/d8/d15/da7/d24/daf/fe9 zero size 2024-09-18T12:52:20.382 INFO:tasks.workunit.client.1.smithi161.stdout:3/990: dwrite d1/d2e/d14/d65/f91 [0,4194304] 0 2024-09-18T12:52:20.382 INFO:tasks.workunit.client.0.smithi045.stdout:6/530: creat d9/d56/db3/fc2 x:0 0 0 2024-09-18T12:52:20.383 INFO:tasks.workunit.client.0.smithi045.stdout:4/728: creat db/de/d1e/d3e/de1/ff1 x:0 0 0 2024-09-18T12:52:20.387 INFO:tasks.workunit.client.1.smithi161.stdout:7/878: mkdir d3/d8/d15/da7/d24/d31/d109 0 2024-09-18T12:52:20.389 INFO:tasks.workunit.client.0.smithi045.stdout:1/571: link d0/c7b d0/d2d/d2b/ca4 0 2024-09-18T12:52:20.390 INFO:tasks.workunit.client.1.smithi161.stdout:3/991: dwrite d1/d2e/d68/d69/ff2 [4194304,4194304] 0 2024-09-18T12:52:20.391 INFO:tasks.workunit.client.1.smithi161.stdout:7/879: mknod d3/d8/d15/da7/d4a/d59/c10a 0 2024-09-18T12:52:20.392 INFO:tasks.workunit.client.1.smithi161.stdout:7/880: write d3/d8/d15/da7/fcf [860743,88155] 0 2024-09-18T12:52:20.393 INFO:tasks.workunit.client.0.smithi045.stdout:1/572: unlink d0/d12/d32/c81 0 2024-09-18T12:52:20.395 INFO:tasks.workunit.client.1.smithi161.stdout:3/992: creat d1/d2e/d68/de8/df6/f151 x:0 0 0 2024-09-18T12:52:20.396 INFO:tasks.workunit.client.0.smithi045.stdout:1/573: symlink d0/d12/la5 0 2024-09-18T12:52:20.397 INFO:tasks.workunit.client.1.smithi161.stdout:7/881: rmdir d3/d8/d15/da7 39 2024-09-18T12:52:20.400 INFO:tasks.workunit.client.0.smithi045.stdout:1/574: read d0/d12/f62 [126339,97739] 0 2024-09-18T12:52:20.400 INFO:tasks.workunit.client.1.smithi161.stdout:3/993: fdatasync d1/d2e/d14/d78/d83/fa7 0 2024-09-18T12:52:20.401 INFO:tasks.workunit.client.0.smithi045.stdout:6/531: dwrite d9/f45 [0,4194304] 0 2024-09-18T12:52:20.403 INFO:tasks.workunit.client.1.smithi161.stdout:7/882: dread - d3/d36/fad zero size 2024-09-18T12:52:20.408 INFO:tasks.workunit.client.1.smithi161.stdout:3/994: creat d1/d2e/f152 x:0 0 0 2024-09-18T12:52:20.410 INFO:tasks.workunit.client.0.smithi045.stdout:6/532: read d9/d1a/d2d/d32/f4c [303375,16327] 0 2024-09-18T12:52:20.413 INFO:tasks.workunit.client.1.smithi161.stdout:3/995: dread d1/d2e/d14/d90/fd8 [0,4194304] 0 2024-09-18T12:52:20.417 INFO:tasks.workunit.client.0.smithi045.stdout:6/533: creat d9/d1a/d48/d75/fc3 x:0 0 0 2024-09-18T12:52:20.417 INFO:tasks.workunit.client.0.smithi045.stdout:4/729: dread db/de/d1e/fb2 [0,4194304] 0 2024-09-18T12:52:20.418 INFO:tasks.workunit.client.1.smithi161.stdout:3/996: creat d1/d2e/d14/d65/d76/f153 x:0 0 0 2024-09-18T12:52:20.420 INFO:tasks.workunit.client.0.smithi045.stdout:1/575: creat d0/d2d/d2b/d30/fa6 x:0 0 0 2024-09-18T12:52:20.420 INFO:tasks.workunit.client.0.smithi045.stdout:1/576: chown d0/f2 1 1 2024-09-18T12:52:20.423 INFO:tasks.workunit.client.0.smithi045.stdout:4/730: rename db/d2c/d35/dcc/dd0/lec to db/d2c/dcd/lf2 0 2024-09-18T12:52:20.425 INFO:tasks.workunit.client.1.smithi161.stdout:3/997: symlink d1/d2e/d68/d131/l154 0 2024-09-18T12:52:20.427 INFO:tasks.workunit.client.0.smithi045.stdout:4/731: creat db/de/d1a/ff3 x:0 0 0 2024-09-18T12:52:20.428 INFO:tasks.workunit.client.1.smithi161.stdout:7/883: dwrite d3/d8/d15/da7/d4a/d64/d8c/d9f/dd7/fdb [0,4194304] 0 2024-09-18T12:52:20.428 INFO:tasks.workunit.client.1.smithi161.stdout:9/887: sync 2024-09-18T12:52:20.429 INFO:tasks.workunit.client.0.smithi045.stdout:4/732: write db/de/d1e/d3e/d9a/da2/fc1 [423225,109353] 0 2024-09-18T12:52:20.430 INFO:tasks.workunit.client.1.smithi161.stdout:3/998: rmdir d1/d2e/d24/d1d/d89/d10f/d127 39 2024-09-18T12:52:20.432 INFO:tasks.workunit.client.0.smithi045.stdout:4/733: truncate db/de/d1e/d3e/d47/d59/d7a/fea 64239 0 2024-09-18T12:52:20.432 INFO:tasks.workunit.client.1.smithi161.stdout:3/999: write d1/d2e/d68/d92/dba/fee [4931283,11161] 0 2024-09-18T12:52:20.434 INFO:tasks.workunit.client.0.smithi045.stdout:4/734: truncate db/de/d1e/d3e/d47/d59/fe8 463102 0 2024-09-18T12:52:20.434 INFO:tasks.workunit.client.0.smithi045.stdout:1/577: write d0/d2d/f68 [468911,62136] 0 2024-09-18T12:52:20.438 INFO:tasks.workunit.client.1.smithi161.stdout:7/884: dwrite d3/d8/d15/da7/d24/d31/d7d/f9e [0,4194304] 0 2024-09-18T12:52:20.439 INFO:tasks.workunit.client.0.smithi045.stdout:1/578: chown d0/d2d/d2b/ca4 1761 1 2024-09-18T12:52:20.440 INFO:tasks.workunit.client.0.smithi045.stdout:4/735: symlink db/de/d1e/d3e/de1/lf4 0 2024-09-18T12:52:20.442 INFO:tasks.workunit.client.0.smithi045.stdout:1/579: fdatasync d0/d12/d32/d67/d6d/f72 0 2024-09-18T12:52:20.442 INFO:tasks.workunit.client.0.smithi045.stdout:6/534: dwrite d9/fc [0,4194304] 0 2024-09-18T12:52:20.443 INFO:tasks.workunit.client.0.smithi045.stdout:6/535: dread - d9/d56/db3/fc2 zero size 2024-09-18T12:52:20.450 INFO:tasks.workunit.client.1.smithi161.stdout:1/893: sync 2024-09-18T12:52:20.469 INFO:tasks.workunit.client.1.smithi161.stdout:1/894: dread d1/da/d1f/dab/daf/de3/f102 [0,4194304] 0 2024-09-18T12:52:20.471 INFO:tasks.workunit.client.1.smithi161.stdout:1/895: truncate d1/da/d1f/dab/daf/de3/f102 4595605 0 2024-09-18T12:52:20.503 INFO:tasks.workunit.client.0.smithi045.stdout:7/458: sync 2024-09-18T12:52:20.504 INFO:tasks.workunit.client.0.smithi045.stdout:8/559: sync 2024-09-18T12:52:20.504 INFO:tasks.workunit.client.0.smithi045.stdout:9/477: sync 2024-09-18T12:52:20.504 INFO:tasks.workunit.client.0.smithi045.stdout:7/459: stat d13/d44/d37/d6a/f9e 0 2024-09-18T12:52:20.505 INFO:tasks.workunit.client.0.smithi045.stdout:9/478: truncate d0/f2 8859953 0 2024-09-18T12:52:20.552 INFO:tasks.workunit.client.1.smithi161.stdout:1/896: mkdir d1/ddd/d126 0 2024-09-18T12:52:20.553 INFO:tasks.workunit.client.0.smithi045.stdout:4/736: mknod db/de/d1a/cf5 0 2024-09-18T12:52:20.556 INFO:tasks.workunit.client.0.smithi045.stdout:4/737: dread db/de/d1e/fb2 [0,4194304] 0 2024-09-18T12:52:20.558 INFO:tasks.workunit.client.1.smithi161.stdout:9/888: dwrite d0/d16/d25/d46/fc0 [0,4194304] 0 2024-09-18T12:52:20.561 INFO:tasks.workunit.client.0.smithi045.stdout:7/460: fsync d13/d1a/f59 0 2024-09-18T12:52:20.563 INFO:tasks.workunit.client.0.smithi045.stdout:9/479: write d0/d3/d6/f99 [2095986,32338] 0 2024-09-18T12:52:20.570 INFO:tasks.workunit.client.0.smithi045.stdout:4/738: unlink db/d2c/d35/d40/d77/f98 0 2024-09-18T12:52:20.578 INFO:tasks.workunit.client.0.smithi045.stdout:7/461: rename d13/d31/d52/d8c to d13/d44/d37/d6a/da3 0 2024-09-18T12:52:20.580 INFO:tasks.workunit.client.0.smithi045.stdout:9/480: mkdir d0/d3/d6/d64/d77/d9a 0 2024-09-18T12:52:20.581 INFO:tasks.workunit.client.0.smithi045.stdout:9/481: write d0/d3/d6/d10/d26/f8f [791100,51722] 0 2024-09-18T12:52:20.582 INFO:tasks.workunit.client.0.smithi045.stdout:9/482: chown d0/d3/d6/d64/d77/l7c 290043 1 2024-09-18T12:52:20.583 INFO:tasks.workunit.client.0.smithi045.stdout:1/580: write d0/d2d/d2b/d30/d40/d60/d8f/f97 [4428780,23959] 0 2024-09-18T12:52:20.587 INFO:tasks.workunit.client.0.smithi045.stdout:8/560: write d11/d14/d53/d41/f74 [1096304,31357] 0 2024-09-18T12:52:20.588 INFO:tasks.workunit.client.0.smithi045.stdout:8/561: readlink d11/d20/l7a 0 2024-09-18T12:52:20.588 INFO:tasks.workunit.client.0.smithi045.stdout:8/562: chown d11/d20/c6c 6764 1 2024-09-18T12:52:20.589 INFO:tasks.workunit.client.0.smithi045.stdout:6/536: getdents d9/d1a/d2d/d38/d5b/d67 0 2024-09-18T12:52:20.590 INFO:tasks.workunit.client.0.smithi045.stdout:4/739: mknod db/de/d1e/d3e/d47/d59/cf6 0 2024-09-18T12:52:20.590 INFO:tasks.workunit.client.0.smithi045.stdout:6/537: readlink d9/d1a/d2d/d38/d5b/l8e 0 2024-09-18T12:52:20.591 INFO:tasks.workunit.client.0.smithi045.stdout:4/740: write db/de/d1e/d49/fb8 [982585,62790] 0 2024-09-18T12:52:20.594 INFO:tasks.workunit.client.0.smithi045.stdout:6/538: write d9/d1a/d2d/d38/f3d [1342150,109352] 0 2024-09-18T12:52:20.594 INFO:tasks.workunit.client.0.smithi045.stdout:4/741: write db/d20/d6b/fba [1963270,82155] 0 2024-09-18T12:52:20.607 INFO:tasks.workunit.client.0.smithi045.stdout:7/462: rename d13/f9c to d13/d44/d37/d70/d77/fa4 0 2024-09-18T12:52:20.607 INFO:tasks.workunit.client.0.smithi045.stdout:7/463: readlink d13/d31/d33/l7e 0 2024-09-18T12:52:20.608 INFO:tasks.workunit.client.0.smithi045.stdout:1/581: dread d0/d2d/f35 [0,4194304] 0 2024-09-18T12:52:20.609 INFO:tasks.workunit.client.0.smithi045.stdout:3/513: sync 2024-09-18T12:52:20.611 INFO:tasks.workunit.client.0.smithi045.stdout:6/539: rmdir d9/d1a/d48/d97 39 2024-09-18T12:52:20.611 INFO:tasks.workunit.client.0.smithi045.stdout:6/540: readlink d9/d56/l77 0 2024-09-18T12:52:20.616 INFO:tasks.workunit.client.0.smithi045.stdout:7/464: symlink d13/d31/d33/d64/d78/d90/la5 0 2024-09-18T12:52:20.619 INFO:tasks.workunit.client.0.smithi045.stdout:9/483: dwrite d0/d3/d6/d10/d2c/f49 [4194304,4194304] 0 2024-09-18T12:52:20.622 INFO:tasks.workunit.client.0.smithi045.stdout:8/563: dwrite d11/d14/d53/f6d [0,4194304] 0 2024-09-18T12:52:20.636 INFO:tasks.workunit.client.0.smithi045.stdout:4/742: dwrite db/de/d1e/d3e/d9a/f7c [4194304,4194304] 0 2024-09-18T12:52:20.637 INFO:tasks.workunit.client.0.smithi045.stdout:1/582: write d0/d2d/f35 [337946,17037] 0 2024-09-18T12:52:20.638 INFO:tasks.workunit.client.0.smithi045.stdout:4/743: stat db/d2c/dcd 0 2024-09-18T12:52:20.638 INFO:tasks.workunit.client.0.smithi045.stdout:1/583: dread - d0/d2d/f90 zero size 2024-09-18T12:52:20.645 INFO:tasks.workunit.client.0.smithi045.stdout:8/564: dread d11/f12 [0,4194304] 0 2024-09-18T12:52:20.650 INFO:tasks.workunit.client.0.smithi045.stdout:6/541: rmdir d9/d56/db3 39 2024-09-18T12:52:20.650 INFO:tasks.workunit.client.0.smithi045.stdout:6/542: dread - d9/d1a/d2d/d38/d5b/f86 zero size 2024-09-18T12:52:20.656 INFO:tasks.workunit.client.0.smithi045.stdout:7/465: rename d13/d44/f1f to d13/d31/d33/d64/d78/fa6 0 2024-09-18T12:52:20.657 INFO:tasks.workunit.client.1.smithi161.stdout:1/897: rmdir d1/d26/dad 39 2024-09-18T12:52:20.658 INFO:tasks.workunit.client.0.smithi045.stdout:9/484: creat d0/d3/d6/d10/d2c/f9b x:0 0 0 2024-09-18T12:52:20.659 INFO:tasks.workunit.client.1.smithi161.stdout:9/889: creat d0/d47/f128 x:0 0 0 2024-09-18T12:52:20.661 INFO:tasks.workunit.client.1.smithi161.stdout:7/885: creat d3/d8/d15/da7/d44/f10b x:0 0 0 2024-09-18T12:52:20.663 INFO:tasks.workunit.client.1.smithi161.stdout:1/898: rename d1/c72 to d1/ddd/d126/c127 0 2024-09-18T12:52:20.664 INFO:tasks.workunit.client.0.smithi045.stdout:4/744: creat db/d2c/d35/dcc/dd0/ff7 x:0 0 0 2024-09-18T12:52:20.665 INFO:tasks.workunit.client.0.smithi045.stdout:4/745: fsync db/d2c/d35/d40/f7d 0 2024-09-18T12:52:20.665 INFO:tasks.workunit.client.1.smithi161.stdout:9/890: readlink d0/d47/l67 0 2024-09-18T12:52:20.666 INFO:tasks.workunit.client.0.smithi045.stdout:4/746: dread - db/de/d1e/d49/fcb zero size 2024-09-18T12:52:20.666 INFO:tasks.workunit.client.1.smithi161.stdout:7/886: dwrite d3/d50/fd4 [0,4194304] 0 2024-09-18T12:52:20.668 INFO:tasks.workunit.client.1.smithi161.stdout:7/887: stat d3/d8/d15/da7/d4a/d59/f6e 0 2024-09-18T12:52:20.671 INFO:tasks.workunit.client.1.smithi161.stdout:9/891: creat d0/d93/da0/f129 x:0 0 0 2024-09-18T12:52:20.672 INFO:tasks.workunit.client.0.smithi045.stdout:8/565: dread d11/d14/f4c [0,4194304] 0 2024-09-18T12:52:20.673 INFO:tasks.workunit.client.0.smithi045.stdout:1/584: rename d0/d2e to d0/d12/da7 0 2024-09-18T12:52:20.676 INFO:tasks.workunit.client.1.smithi161.stdout:9/892: unlink d0/d47/d48/d7f/d84/fce 0 2024-09-18T12:52:20.677 INFO:tasks.workunit.client.0.smithi045.stdout:9/485: readlink d0/d3/d6/d10/d2c/l37 0 2024-09-18T12:52:20.679 INFO:tasks.workunit.client.0.smithi045.stdout:5/668: sync 2024-09-18T12:52:20.679 INFO:tasks.workunit.client.0.smithi045.stdout:2/575: sync 2024-09-18T12:52:20.679 INFO:tasks.workunit.client.0.smithi045.stdout:0/562: sync 2024-09-18T12:52:20.680 INFO:tasks.workunit.client.0.smithi045.stdout:2/576: stat d5/d5f/db2/f40 0 2024-09-18T12:52:20.681 INFO:tasks.workunit.client.1.smithi161.stdout:9/893: rename d0/db/d18/d121/d127 to d0/db/d18/d121/d12a 0 2024-09-18T12:52:20.681 INFO:tasks.workunit.client.0.smithi045.stdout:2/577: write d5/d3a/d6b/fc3 [923959,63344] 0 2024-09-18T12:52:20.682 INFO:tasks.workunit.client.0.smithi045.stdout:4/747: symlink db/de/d1e/d3e/d9a/da2/lf8 0 2024-09-18T12:52:20.684 INFO:tasks.workunit.client.1.smithi161.stdout:9/894: unlink d0/d20/d74/l108 0 2024-09-18T12:52:20.685 INFO:tasks.workunit.client.0.smithi045.stdout:6/543: truncate d9/f68 1421734 0 2024-09-18T12:52:20.686 INFO:tasks.workunit.client.0.smithi045.stdout:6/544: fsync d9/d1a/d48/d8f/d9f/faf 0 2024-09-18T12:52:20.687 INFO:tasks.workunit.client.0.smithi045.stdout:8/566: creat d11/d76/fa2 x:0 0 0 2024-09-18T12:52:20.690 INFO:tasks.workunit.client.0.smithi045.stdout:7/466: link d13/d44/d37/d70/f9f d13/d31/d52/fa7 0 2024-09-18T12:52:20.691 INFO:tasks.workunit.client.0.smithi045.stdout:9/486: dread - d0/d3/d6/f71 zero size 2024-09-18T12:52:20.694 INFO:tasks.workunit.client.0.smithi045.stdout:2/578: mkdir d5/d5f/da8/d61/dbb/dc6 0 2024-09-18T12:52:20.695 INFO:tasks.workunit.client.0.smithi045.stdout:6/545: symlink d9/d1a/d48/d7d/lc4 0 2024-09-18T12:52:20.699 INFO:tasks.workunit.client.0.smithi045.stdout:5/669: dread d6/d3e/f9b [0,4194304] 0 2024-09-18T12:52:20.702 INFO:tasks.workunit.client.0.smithi045.stdout:7/467: dwrite d13/d44/f80 [0,4194304] 0 2024-09-18T12:52:20.706 INFO:tasks.workunit.client.0.smithi045.stdout:4/748: dread db/f30 [0,4194304] 0 2024-09-18T12:52:20.709 INFO:tasks.workunit.client.0.smithi045.stdout:5/670: unlink d6/d3e/fb8 0 2024-09-18T12:52:20.711 INFO:tasks.workunit.client.0.smithi045.stdout:7/468: symlink d13/d1a/d28/la8 0 2024-09-18T12:52:20.712 INFO:tasks.workunit.client.1.smithi161.stdout:1/899: symlink d1/da/d39/l128 0 2024-09-18T12:52:20.712 INFO:tasks.workunit.client.1.smithi161.stdout:7/888: write d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f7f [1179013,21499] 0 2024-09-18T12:52:20.713 INFO:tasks.workunit.client.0.smithi045.stdout:3/514: dwrite d0/d1e/d2c/d3a/f3c [0,4194304] 0 2024-09-18T12:52:20.715 INFO:tasks.workunit.client.0.smithi045.stdout:3/515: chown d0/d1e/d2c/d3a/d45/la6 165173265 1 2024-09-18T12:52:20.716 INFO:tasks.workunit.client.0.smithi045.stdout:2/579: mkdir d5/d5f/da8/d61/dbb/dc6/dc7 0 2024-09-18T12:52:20.717 INFO:tasks.workunit.client.0.smithi045.stdout:3/516: truncate d0/d1e/d91/fad 119783 0 2024-09-18T12:52:20.718 INFO:tasks.workunit.client.1.smithi161.stdout:7/889: dwrite d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/fbb [4194304,4194304] 0 2024-09-18T12:52:20.718 INFO:tasks.workunit.client.0.smithi045.stdout:6/546: mknod d9/d1a/d48/dc1/cc5 0 2024-09-18T12:52:20.725 INFO:tasks.workunit.client.1.smithi161.stdout:9/895: write d0/d16/d25/d28/f31 [1149742,31142] 0 2024-09-18T12:52:20.726 INFO:tasks.workunit.client.0.smithi045.stdout:7/469: mknod d13/d31/d52/ca9 0 2024-09-18T12:52:20.727 INFO:tasks.workunit.client.1.smithi161.stdout:1/900: dwrite d1/d26/d88/fbe [0,4194304] 0 2024-09-18T12:52:20.728 INFO:tasks.workunit.client.0.smithi045.stdout:0/563: getdents d6/d48/d5e/d39 0 2024-09-18T12:52:20.730 INFO:tasks.workunit.client.1.smithi161.stdout:7/890: rename d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/d89/c8e to d3/d8/d4b/c10c 0 2024-09-18T12:52:20.731 INFO:tasks.workunit.client.0.smithi045.stdout:2/580: symlink d5/d5f/da8/d91/lc8 0 2024-09-18T12:52:20.731 INFO:tasks.workunit.client.0.smithi045.stdout:8/567: write d11/d76/da0/f89 [216485,93301] 0 2024-09-18T12:52:20.732 INFO:tasks.workunit.client.1.smithi161.stdout:1/901: dread d1/da/d31/f110 [0,4194304] 0 2024-09-18T12:52:20.733 INFO:tasks.workunit.client.0.smithi045.stdout:9/487: write d0/f7f [1803318,86850] 0 2024-09-18T12:52:20.735 INFO:tasks.workunit.client.0.smithi045.stdout:3/517: creat d0/d1e/d2c/d3f/fae x:0 0 0 2024-09-18T12:52:20.736 INFO:tasks.workunit.client.0.smithi045.stdout:7/470: dwrite d13/d44/d37/f8d [0,4194304] 0 2024-09-18T12:52:20.738 INFO:tasks.workunit.client.0.smithi045.stdout:9/488: chown d0/d3/d6/d10/l43 251 1 2024-09-18T12:52:20.739 INFO:tasks.workunit.client.1.smithi161.stdout:7/891: read d3/d8/d4f/dc1/fc7 [783573,34465] 0 2024-09-18T12:52:20.740 INFO:tasks.workunit.client.0.smithi045.stdout:7/471: fsync d13/d44/d37/d70/f79 0 2024-09-18T12:52:20.741 INFO:tasks.workunit.client.0.smithi045.stdout:9/489: chown d0/d3/d6/f99 1449 1 2024-09-18T12:52:20.742 INFO:tasks.workunit.client.0.smithi045.stdout:5/671: write d6/db/d19/f4f [3725022,112142] 0 2024-09-18T12:52:20.744 INFO:tasks.workunit.client.0.smithi045.stdout:0/564: creat d6/d48/d5e/d39/d58/d86/fa1 x:0 0 0 2024-09-18T12:52:20.744 INFO:tasks.workunit.client.0.smithi045.stdout:1/585: dwrite d0/f6 [0,4194304] 0 2024-09-18T12:52:20.745 INFO:tasks.workunit.client.0.smithi045.stdout:9/490: chown d0/d3/d6/d64/d77 30028950 1 2024-09-18T12:52:20.745 INFO:tasks.workunit.client.1.smithi161.stdout:9/896: creat d0/d20/f12b x:0 0 0 2024-09-18T12:52:20.747 INFO:tasks.workunit.client.1.smithi161.stdout:7/892: rmdir d3 39 2024-09-18T12:52:20.747 INFO:tasks.workunit.client.1.smithi161.stdout:1/902: dwrite d1/da/d1f/f2c [0,4194304] 0 2024-09-18T12:52:20.747 INFO:tasks.workunit.client.0.smithi045.stdout:0/565: dread - d6/d7/d32/f9e zero size 2024-09-18T12:52:20.748 INFO:tasks.workunit.client.0.smithi045.stdout:6/547: mkdir d9/d1a/d48/dc6 0 2024-09-18T12:52:20.748 INFO:tasks.workunit.client.0.smithi045.stdout:9/491: fdatasync d0/d3/d6/d10/d26/d2e/d4e/f5a 0 2024-09-18T12:52:20.749 INFO:tasks.workunit.client.0.smithi045.stdout:8/568: mkdir d11/d20/d60/da3 0 2024-09-18T12:52:20.749 INFO:tasks.workunit.client.0.smithi045.stdout:6/548: write d9/d1a/d2d/d38/f3d [3840949,79523] 0 2024-09-18T12:52:20.750 INFO:tasks.workunit.client.0.smithi045.stdout:3/518: creat d0/d22/faf x:0 0 0 2024-09-18T12:52:20.752 INFO:tasks.workunit.client.0.smithi045.stdout:8/569: chown d11/d14/d53/d41/d57/d98 263 1 2024-09-18T12:52:20.755 INFO:tasks.workunit.client.0.smithi045.stdout:7/472: mknod d13/d31/d5f/d94/caa 0 2024-09-18T12:52:20.755 INFO:tasks.workunit.client.0.smithi045.stdout:5/672: unlink d6/db/d5a/d78/d66/c6e 0 2024-09-18T12:52:20.756 INFO:tasks.workunit.client.1.smithi161.stdout:1/903: dwrite d1/da/d39/f106 [0,4194304] 0 2024-09-18T12:52:20.758 INFO:tasks.workunit.client.1.smithi161.stdout:7/893: creat d3/d8/d15/da7/d24/d31/d109/f10d x:0 0 0 2024-09-18T12:52:20.758 INFO:tasks.workunit.client.0.smithi045.stdout:0/566: creat d6/d7/d32/fa2 x:0 0 0 2024-09-18T12:52:20.759 INFO:tasks.workunit.client.1.smithi161.stdout:7/894: chown d3/d83/db6 549 1 2024-09-18T12:52:20.759 INFO:tasks.workunit.client.0.smithi045.stdout:9/492: creat d0/d3/d6/d64/f9c x:0 0 0 2024-09-18T12:52:20.760 INFO:tasks.workunit.client.0.smithi045.stdout:6/549: fsync d9/d1a/d48/f9d 0 2024-09-18T12:52:20.761 INFO:tasks.workunit.client.0.smithi045.stdout:4/749: getdents db/de/d1e/d3e/de1 0 2024-09-18T12:52:20.762 INFO:tasks.workunit.client.0.smithi045.stdout:4/750: stat db/de/d1e 0 2024-09-18T12:52:20.762 INFO:tasks.workunit.client.0.smithi045.stdout:3/519: creat d0/d1e/d2c/d3a/fb0 x:0 0 0 2024-09-18T12:52:20.763 INFO:tasks.workunit.client.0.smithi045.stdout:3/520: stat d0/f83 0 2024-09-18T12:52:20.764 INFO:tasks.workunit.client.0.smithi045.stdout:1/586: mknod d0/d2d/d2b/ca8 0 2024-09-18T12:52:20.766 INFO:tasks.workunit.client.0.smithi045.stdout:7/473: unlink d13/d1a/f27 0 2024-09-18T12:52:20.766 INFO:tasks.workunit.client.0.smithi045.stdout:7/474: fsync d13/d44/f80 0 2024-09-18T12:52:20.768 INFO:tasks.workunit.client.0.smithi045.stdout:2/581: creat d5/d3a/fc9 x:0 0 0 2024-09-18T12:52:20.770 INFO:tasks.workunit.client.0.smithi045.stdout:6/550: rmdir d9 39 2024-09-18T12:52:20.773 INFO:tasks.workunit.client.1.smithi161.stdout:1/904: dread d1/d26/d3a/f3b [0,4194304] 0 2024-09-18T12:52:20.777 INFO:tasks.workunit.client.0.smithi045.stdout:9/493: dwrite d0/d3/d6/d10/d26/f60 [0,4194304] 0 2024-09-18T12:52:20.778 INFO:tasks.workunit.client.0.smithi045.stdout:2/582: mknod d5/d2c/d4d/d76/cca 0 2024-09-18T12:52:20.782 INFO:tasks.workunit.client.0.smithi045.stdout:4/751: dwrite db/de/d1e/d3e/d47/d59/d7a/f8b [0,4194304] 0 2024-09-18T12:52:20.787 INFO:tasks.workunit.client.0.smithi045.stdout:1/587: symlink d0/d12/d32/d67/d6d/d9c/la9 0 2024-09-18T12:52:20.788 INFO:tasks.workunit.client.1.smithi161.stdout:1/905: getdents d1 0 2024-09-18T12:52:20.788 INFO:tasks.workunit.client.1.smithi161.stdout:9/897: dread d0/d47/f4c [4194304,4194304] 0 2024-09-18T12:52:20.790 INFO:tasks.workunit.client.0.smithi045.stdout:9/494: mkdir d0/d3/d6/d9d 0 2024-09-18T12:52:20.792 INFO:tasks.workunit.client.1.smithi161.stdout:1/906: read d1/da/d1f/d45/d73/f87 [3929585,1118] 0 2024-09-18T12:52:20.793 INFO:tasks.workunit.client.1.smithi161.stdout:1/907: stat d1/da/d1f/dab/daf 0 2024-09-18T12:52:20.793 INFO:tasks.workunit.client.0.smithi045.stdout:6/551: mkdir d9/d1a/d48/d75/dc7 0 2024-09-18T12:52:20.795 INFO:tasks.workunit.client.0.smithi045.stdout:4/752: creat db/de/d1e/d49/ff9 x:0 0 0 2024-09-18T12:52:20.796 INFO:tasks.workunit.client.1.smithi161.stdout:9/898: creat d0/d20/d49/de2/f12c x:0 0 0 2024-09-18T12:52:20.798 INFO:tasks.workunit.client.0.smithi045.stdout:2/583: dread d5/f5c [0,4194304] 0 2024-09-18T12:52:20.802 INFO:tasks.workunit.client.0.smithi045.stdout:7/475: rename d13/d44/d37/d70/d77/f7b to d13/d44/d37/d70/d77/fab 0 2024-09-18T12:52:20.803 INFO:tasks.workunit.client.1.smithi161.stdout:9/899: creat d0/d47/df1/f12d x:0 0 0 2024-09-18T12:52:20.805 INFO:tasks.workunit.client.0.smithi045.stdout:1/588: mknod d0/d2d/d2b/d30/d40/d60/caa 0 2024-09-18T12:52:20.806 INFO:tasks.workunit.client.0.smithi045.stdout:9/495: dread d0/d3/d6/d10/d2c/f49 [0,4194304] 0 2024-09-18T12:52:20.807 INFO:tasks.workunit.client.0.smithi045.stdout:0/567: dread d6/d35/f5f [0,4194304] 0 2024-09-18T12:52:20.808 INFO:tasks.workunit.client.0.smithi045.stdout:0/568: chown d6/d48/d5e/d39/d58/c2c 14862531 1 2024-09-18T12:52:20.810 INFO:tasks.workunit.client.0.smithi045.stdout:0/569: write d6/d48/d5e/d39/d58/d3c/f47 [1491611,119433] 0 2024-09-18T12:52:20.810 INFO:tasks.workunit.client.1.smithi161.stdout:7/895: truncate d3/f7 9522883 0 2024-09-18T12:52:20.813 INFO:tasks.workunit.client.0.smithi045.stdout:4/753: rename db/de/d1e/fd8 to db/d2c/d35/d40/d77/ffa 0 2024-09-18T12:52:20.814 INFO:tasks.workunit.client.0.smithi045.stdout:4/754: write db/f63 [3118147,14150] 0 2024-09-18T12:52:20.816 INFO:tasks.workunit.client.0.smithi045.stdout:3/521: rmdir d0/d29/d5f/daa 0 2024-09-18T12:52:20.818 INFO:tasks.workunit.client.1.smithi161.stdout:1/908: link d1/daa/db2/dc0/ce5 d1/da/c129 0 2024-09-18T12:52:20.819 INFO:tasks.workunit.client.0.smithi045.stdout:8/570: dwrite f6 [0,4194304] 0 2024-09-18T12:52:20.819 INFO:tasks.workunit.client.0.smithi045.stdout:7/476: mknod d13/d31/d5f/cac 0 2024-09-18T12:52:20.827 INFO:tasks.workunit.client.0.smithi045.stdout:1/589: creat d0/d12/d32/d67/d6d/d9c/fab x:0 0 0 2024-09-18T12:52:20.829 INFO:tasks.workunit.client.0.smithi045.stdout:6/552: getdents d9/d1a/d2d/d32/db0 0 2024-09-18T12:52:20.832 INFO:tasks.workunit.client.0.smithi045.stdout:0/570: stat d6/d35/l52 0 2024-09-18T12:52:20.834 INFO:tasks.workunit.client.1.smithi161.stdout:9/900: write d0/d47/df1/d59/ddb/fe3 [1111637,77620] 0 2024-09-18T12:52:20.835 INFO:tasks.workunit.client.0.smithi045.stdout:2/584: mkdir d5/d2c/d4d/dcb 0 2024-09-18T12:52:20.837 INFO:tasks.workunit.client.0.smithi045.stdout:4/755: symlink db/d20/d6b/lfb 0 2024-09-18T12:52:20.838 INFO:tasks.workunit.client.1.smithi161.stdout:7/896: truncate d3/d8/d15/da7/d4a/d64/d8c/d9f/dd7/fdb 1409408 0 2024-09-18T12:52:20.839 INFO:tasks.workunit.client.1.smithi161.stdout:9/901: creat d0/d47/f12e x:0 0 0 2024-09-18T12:52:20.840 INFO:tasks.workunit.client.0.smithi045.stdout:3/522: unlink d0/d1e/d2c/d3f/l7c 0 2024-09-18T12:52:20.841 INFO:tasks.workunit.client.0.smithi045.stdout:3/523: readlink d0/d29/d5f/l90 0 2024-09-18T12:52:20.841 INFO:tasks.workunit.client.1.smithi161.stdout:7/897: symlink d3/d8/d4f/l10e 0 2024-09-18T12:52:20.842 INFO:tasks.workunit.client.0.smithi045.stdout:8/571: truncate d11/d14/d53/d41/d57/f4a 456986 0 2024-09-18T12:52:20.844 INFO:tasks.workunit.client.1.smithi161.stdout:1/909: dwrite d1/da/d9d/fa2 [0,4194304] 0 2024-09-18T12:52:20.844 INFO:tasks.workunit.client.1.smithi161.stdout:9/902: rename d0/d16/d25/d46/f68 to d0/d93/da0/f12f 0 2024-09-18T12:52:20.847 INFO:tasks.workunit.client.0.smithi045.stdout:1/590: mknod d0/d12/d32/d67/d6d/cac 0 2024-09-18T12:52:20.850 INFO:tasks.workunit.client.0.smithi045.stdout:0/571: write d6/d7/f14 [1919166,10863] 0 2024-09-18T12:52:20.851 INFO:tasks.workunit.client.0.smithi045.stdout:2/585: unlink d5/d5f/db2/faa 0 2024-09-18T12:52:20.852 INFO:tasks.workunit.client.1.smithi161.stdout:9/903: dwrite d0/d47/df1/d59/ddb/fe3 [0,4194304] 0 2024-09-18T12:52:20.852 INFO:tasks.workunit.client.0.smithi045.stdout:0/572: dread - d6/d7/d32/fa2 zero size 2024-09-18T12:52:20.855 INFO:tasks.workunit.client.0.smithi045.stdout:4/756: creat db/de/d1e/d3e/d47/d59/d7a/ffc x:0 0 0 2024-09-18T12:52:20.856 INFO:tasks.workunit.client.0.smithi045.stdout:4/757: chown db/de/d1e/d3e/d47/fbb 506 1 2024-09-18T12:52:20.857 INFO:tasks.workunit.client.0.smithi045.stdout:8/572: write d11/f5f [377084,94326] 0 2024-09-18T12:52:20.859 INFO:tasks.workunit.client.1.smithi161.stdout:1/910: symlink d1/da/d1f/d6b/l12a 0 2024-09-18T12:52:20.861 INFO:tasks.workunit.client.0.smithi045.stdout:9/496: creat d0/f9e x:0 0 0 2024-09-18T12:52:20.862 INFO:tasks.workunit.client.0.smithi045.stdout:7/477: dread d13/d31/d5f/f69 [0,4194304] 0 2024-09-18T12:52:20.863 INFO:tasks.workunit.client.1.smithi161.stdout:9/904: mkdir d0/d47/d130 0 2024-09-18T12:52:20.864 INFO:tasks.workunit.client.0.smithi045.stdout:7/478: write d13/d1a/d28/f89 [150130,17485] 0 2024-09-18T12:52:20.865 INFO:tasks.workunit.client.1.smithi161.stdout:9/905: write d0/d16/d25/d46/fb6 [350983,106024] 0 2024-09-18T12:52:20.865 INFO:tasks.workunit.client.0.smithi045.stdout:1/591: creat d0/d2d/d6c/fad x:0 0 0 2024-09-18T12:52:20.868 INFO:tasks.workunit.client.0.smithi045.stdout:6/553: unlink d9/d1a/d1d/c34 0 2024-09-18T12:52:20.870 INFO:tasks.workunit.client.0.smithi045.stdout:2/586: creat d5/d5f/fcc x:0 0 0 2024-09-18T12:52:20.871 INFO:tasks.workunit.client.1.smithi161.stdout:1/911: creat d1/d26/dad/f12b x:0 0 0 2024-09-18T12:52:20.872 INFO:tasks.workunit.client.0.smithi045.stdout:0/573: fdatasync d6/d48/f5c 0 2024-09-18T12:52:20.873 INFO:tasks.workunit.client.1.smithi161.stdout:7/898: dwrite d3/d8/d15/f1e [0,4194304] 0 2024-09-18T12:52:20.875 INFO:tasks.workunit.client.1.smithi161.stdout:1/912: fdatasync d1/da/f19 0 2024-09-18T12:52:20.876 INFO:tasks.workunit.client.1.smithi161.stdout:7/899: stat d3/d8/d15/da7/d4a/d64/d8c/d9f/dd7/fff 0 2024-09-18T12:52:20.878 INFO:tasks.workunit.client.1.smithi161.stdout:9/906: creat d0/d47/d48/d7f/f131 x:0 0 0 2024-09-18T12:52:20.881 INFO:tasks.workunit.client.0.smithi045.stdout:7/479: creat d13/d44/fad x:0 0 0 2024-09-18T12:52:20.882 INFO:tasks.workunit.client.0.smithi045.stdout:1/592: symlink d0/d2d/d2b/d30/d40/lae 0 2024-09-18T12:52:20.884 INFO:tasks.workunit.client.0.smithi045.stdout:1/593: fdatasync d0/d2d/d2b/d30/d40/d60/d8f/f70 0 2024-09-18T12:52:20.887 INFO:tasks.workunit.client.0.smithi045.stdout:6/554: creat d9/d1a/d48/d75/fc8 x:0 0 0 2024-09-18T12:52:20.889 INFO:tasks.workunit.client.0.smithi045.stdout:7/480: dread d13/d44/d37/f4d [0,4194304] 0 2024-09-18T12:52:20.889 INFO:tasks.workunit.client.0.smithi045.stdout:4/758: dread db/de/d1a/f3d [0,4194304] 0 2024-09-18T12:52:20.889 INFO:tasks.workunit.client.1.smithi161.stdout:9/907: rename d0/d47/d48/f61 to d0/d47/d48/d88/f132 0 2024-09-18T12:52:20.890 INFO:tasks.workunit.client.0.smithi045.stdout:2/587: chown d5/d2c/d4d/f68 0 1 2024-09-18T12:52:20.892 INFO:tasks.workunit.client.0.smithi045.stdout:2/588: write d5/d2c/d4d/d76/fb3 [913173,93480] 0 2024-09-18T12:52:20.892 INFO:tasks.workunit.client.1.smithi161.stdout:1/913: symlink d1/da/d1f/d6b/d11f/l12c 0 2024-09-18T12:52:20.895 INFO:tasks.workunit.client.0.smithi045.stdout:0/574: mknod d6/d48/d5e/d39/d58/ca3 0 2024-09-18T12:52:20.897 INFO:tasks.workunit.client.1.smithi161.stdout:9/908: mkdir d0/db/d18/d121/d12a/d133 0 2024-09-18T12:52:20.898 INFO:tasks.workunit.client.0.smithi045.stdout:8/573: mknod d11/d76/da0/da1/ca4 0 2024-09-18T12:52:20.899 INFO:tasks.workunit.client.1.smithi161.stdout:1/914: symlink d1/da/d1f/d6b/dd2/l12d 0 2024-09-18T12:52:20.900 INFO:tasks.workunit.client.0.smithi045.stdout:9/497: dwrite d0/d3/d6/d10/d2c/d63/f7e [0,4194304] 0 2024-09-18T12:52:20.900 INFO:tasks.workunit.client.1.smithi161.stdout:7/900: creat d3/d8/d15/da7/d4a/d64/d8c/f10f x:0 0 0 2024-09-18T12:52:20.902 INFO:tasks.workunit.client.1.smithi161.stdout:9/909: unlink d0/d47/df1/f12d 0 2024-09-18T12:52:20.904 INFO:tasks.workunit.client.0.smithi045.stdout:1/594: rename d0/d12/d32/d67/d6a/f51 to d0/d12/d32/d67/d6a/faf 0 2024-09-18T12:52:20.906 INFO:tasks.workunit.client.0.smithi045.stdout:7/481: fdatasync d13/d1a/f2e 0 2024-09-18T12:52:20.908 INFO:tasks.workunit.client.0.smithi045.stdout:4/759: creat db/d1b/ffd x:0 0 0 2024-09-18T12:52:20.909 INFO:tasks.workunit.client.0.smithi045.stdout:4/760: dread - db/d2c/d35/d40/d77/fb3 zero size 2024-09-18T12:52:20.912 INFO:tasks.workunit.client.0.smithi045.stdout:6/555: rmdir d9/d1a/d2d/d38/d5b 39 2024-09-18T12:52:20.916 INFO:tasks.workunit.client.0.smithi045.stdout:4/761: dwrite db/de/d1e/d3e/d9a/f5c [4194304,4194304] 0 2024-09-18T12:52:20.922 INFO:tasks.workunit.client.1.smithi161.stdout:1/915: link d1/da/f18 d1/da/d1f/d6b/f12e 0 2024-09-18T12:52:20.926 INFO:tasks.workunit.client.1.smithi161.stdout:9/910: getdents d0/d93/da0 0 2024-09-18T12:52:20.926 INFO:tasks.workunit.client.0.smithi045.stdout:7/482: symlink d13/d44/d37/d6a/da3/lae 0 2024-09-18T12:52:20.928 INFO:tasks.workunit.client.1.smithi161.stdout:1/916: symlink d1/d26/d88/l12f 0 2024-09-18T12:52:20.931 INFO:tasks.workunit.client.1.smithi161.stdout:7/901: write d3/f11 [570810,84712] 0 2024-09-18T12:52:20.932 INFO:tasks.workunit.client.0.smithi045.stdout:6/556: fsync d9/d1a/d48/fb1 0 2024-09-18T12:52:20.933 INFO:tasks.workunit.client.1.smithi161.stdout:9/911: getdents d0/d16/d25/d86/df4 0 2024-09-18T12:52:20.933 INFO:tasks.workunit.client.0.smithi045.stdout:7/483: dwrite d13/d44/d37/f4a [4194304,4194304] 0 2024-09-18T12:52:20.937 INFO:tasks.workunit.client.0.smithi045.stdout:4/762: dread db/d2c/d35/d40/f68 [0,4194304] 0 2024-09-18T12:52:20.937 INFO:tasks.workunit.client.0.smithi045.stdout:2/589: write d5/d5f/f78 [348312,60836] 0 2024-09-18T12:52:20.938 INFO:tasks.workunit.client.1.smithi161.stdout:9/912: rmdir d0/d20/d74/ded/d102 39 2024-09-18T12:52:20.941 INFO:tasks.workunit.client.0.smithi045.stdout:9/498: link d0/f1a d0/d3/d6/d10/d26/d2e/d4e/f9f 0 2024-09-18T12:52:20.942 INFO:tasks.workunit.client.1.smithi161.stdout:7/902: mkdir d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/d110 0 2024-09-18T12:52:20.944 INFO:tasks.workunit.client.0.smithi045.stdout:8/574: dwrite d11/d23/f9d [0,4194304] 0 2024-09-18T12:52:20.951 INFO:tasks.workunit.client.0.smithi045.stdout:2/590: rename d5/d5f/db2/f80 to d5/d5f/da8/d61/dbb/fcd 0 2024-09-18T12:52:20.951 INFO:tasks.workunit.client.0.smithi045.stdout:7/484: truncate d13/d44/d37/d70/d77/f60 480277 0 2024-09-18T12:52:20.955 INFO:tasks.workunit.client.0.smithi045.stdout:6/557: rmdir d9/d1a/d2d/d38 39 2024-09-18T12:52:20.955 INFO:tasks.workunit.client.0.smithi045.stdout:8/575: creat d11/d7b/fa5 x:0 0 0 2024-09-18T12:52:20.956 INFO:tasks.workunit.client.0.smithi045.stdout:0/575: getdents d6/d48/d5e/d39/d58 0 2024-09-18T12:52:20.960 INFO:tasks.workunit.client.0.smithi045.stdout:7/485: rename d13/d44/l35 to d13/d44/d4c/laf 0 2024-09-18T12:52:20.960 INFO:tasks.workunit.client.0.smithi045.stdout:1/595: write d0/f7 [1599979,124268] 0 2024-09-18T12:52:20.961 INFO:tasks.workunit.client.1.smithi161.stdout:7/903: dread d3/d8/d15/da7/d4a/d59/f69 [0,4194304] 0 2024-09-18T12:52:20.962 INFO:tasks.workunit.client.1.smithi161.stdout:7/904: chown d3/fb3 82 1 2024-09-18T12:52:20.963 INFO:tasks.workunit.client.1.smithi161.stdout:7/905: truncate d3/ffc 150574 0 2024-09-18T12:52:20.964 INFO:tasks.workunit.client.1.smithi161.stdout:7/906: truncate d3/d8/f91 6010248 0 2024-09-18T12:52:20.964 INFO:tasks.workunit.client.0.smithi045.stdout:2/591: rename d5/d5f/da8/d91 to d5/d5f/da8/d61/dbb/dc6/dc7/dce 0 2024-09-18T12:52:20.965 INFO:tasks.workunit.client.0.smithi045.stdout:0/576: dwrite d6/f63 [0,4194304] 0 2024-09-18T12:52:20.966 INFO:tasks.workunit.client.1.smithi161.stdout:9/913: write d0/f24 [3517617,42594] 0 2024-09-18T12:52:20.967 INFO:tasks.workunit.client.0.smithi045.stdout:7/486: unlink d13/d44/f95 0 2024-09-18T12:52:20.967 INFO:tasks.workunit.client.0.smithi045.stdout:2/592: read d5/d2c/d4d/d76/fb3 [209738,101343] 0 2024-09-18T12:52:20.967 INFO:tasks.workunit.client.1.smithi161.stdout:9/914: chown d0/d47/d48/d7f/d84/c104 6556 1 2024-09-18T12:52:20.970 INFO:tasks.workunit.client.1.smithi161.stdout:7/907: rmdir d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/d89/d8f 39 2024-09-18T12:52:20.971 INFO:tasks.workunit.client.0.smithi045.stdout:9/499: write d0/d3/d6/d10/f1b [610799,34185] 0 2024-09-18T12:52:20.973 INFO:tasks.workunit.client.1.smithi161.stdout:9/915: mkdir d0/d20/d49/d65/d134 0 2024-09-18T12:52:20.974 INFO:tasks.workunit.client.1.smithi161.stdout:9/916: write d0/d93/da0/fff [918687,79463] 0 2024-09-18T12:52:20.975 INFO:tasks.workunit.client.0.smithi045.stdout:8/576: write d11/d14/d53/d41/d57/d98/f96 [1637042,102790] 0 2024-09-18T12:52:20.976 INFO:tasks.workunit.client.1.smithi161.stdout:9/917: write d0/d16/d25/d28/f3f [4249473,81288] 0 2024-09-18T12:52:20.977 INFO:tasks.workunit.client.1.smithi161.stdout:7/908: dread d3/d8/d15/da7/d4a/d64/d8c/d9f/dd7/fdb [0,4194304] 0 2024-09-18T12:52:20.978 INFO:tasks.workunit.client.0.smithi045.stdout:1/596: symlink d0/d2d/d2b/d30/d40/lb0 0 2024-09-18T12:52:20.980 INFO:tasks.workunit.client.0.smithi045.stdout:4/763: dread db/de/f7b [0,4194304] 0 2024-09-18T12:52:20.982 INFO:tasks.workunit.client.0.smithi045.stdout:6/558: truncate d9/d1a/f37 3800502 0 2024-09-18T12:52:20.983 INFO:tasks.workunit.client.0.smithi045.stdout:8/577: dwrite d11/d20/d46/f51 [0,4194304] 0 2024-09-18T12:52:20.985 INFO:tasks.workunit.client.0.smithi045.stdout:8/578: read d11/d23/f9d [1961568,112181] 0 2024-09-18T12:52:20.985 INFO:tasks.workunit.client.1.smithi161.stdout:7/909: symlink d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/d9b/l111 0 2024-09-18T12:52:20.986 INFO:tasks.workunit.client.1.smithi161.stdout:7/910: chown d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f7f 23 1 2024-09-18T12:52:20.987 INFO:tasks.workunit.client.1.smithi161.stdout:7/911: fsync d3/f11 0 2024-09-18T12:52:20.987 INFO:tasks.workunit.client.0.smithi045.stdout:1/597: dread d0/d2d/d2b/d30/d40/d60/d8f/f70 [0,4194304] 0 2024-09-18T12:52:20.988 INFO:tasks.workunit.client.1.smithi161.stdout:7/912: read - d3/d8/d15/da7/d24/d31/ff1 zero size 2024-09-18T12:52:20.989 INFO:tasks.workunit.client.1.smithi161.stdout:7/913: stat d3/d8/d15/da7/d24/d31/f68 0 2024-09-18T12:52:20.989 INFO:tasks.workunit.client.1.smithi161.stdout:7/914: chown d3/d8/d15/f3b 48977 1 2024-09-18T12:52:20.991 INFO:tasks.workunit.client.1.smithi161.stdout:7/915: write d3/d8/d15/da7/d4a/fd1 [2806305,49195] 0 2024-09-18T12:52:20.993 INFO:tasks.workunit.client.0.smithi045.stdout:8/579: dwrite d11/f5f [0,4194304] 0 2024-09-18T12:52:20.996 INFO:tasks.workunit.client.0.smithi045.stdout:0/577: creat d6/d48/d5e/d39/d58/d66/fa4 x:0 0 0 2024-09-18T12:52:20.997 INFO:tasks.workunit.client.1.smithi161.stdout:9/918: dwrite d0/d16/d25/f27 [0,4194304] 0 2024-09-18T12:52:20.998 INFO:tasks.workunit.client.0.smithi045.stdout:7/487: dread d13/d31/f2d [0,4194304] 0 2024-09-18T12:52:21.001 INFO:tasks.workunit.client.1.smithi161.stdout:7/916: dwrite d3/d8/d15/da7/d24/daf/fe9 [0,4194304] 0 2024-09-18T12:52:21.002 INFO:tasks.workunit.client.0.smithi045.stdout:0/578: symlink d6/d48/d5e/d39/d58/d66/la5 0 2024-09-18T12:52:21.003 INFO:tasks.workunit.client.0.smithi045.stdout:4/764: creat db/de/d1e/ffe x:0 0 0 2024-09-18T12:52:21.007 INFO:tasks.workunit.client.1.smithi161.stdout:9/919: dwrite d0/fac [0,4194304] 0 2024-09-18T12:52:21.008 INFO:tasks.workunit.client.0.smithi045.stdout:7/488: creat d13/d31/d52/fb0 x:0 0 0 2024-09-18T12:52:21.008 INFO:tasks.workunit.client.1.smithi161.stdout:7/917: creat d3/d8/d15/da7/d24/d31/d109/f112 x:0 0 0 2024-09-18T12:52:21.013 INFO:tasks.workunit.client.0.smithi045.stdout:7/489: dread - d13/d44/d37/f98 zero size 2024-09-18T12:52:21.013 INFO:tasks.workunit.client.0.smithi045.stdout:0/579: dwrite d6/d35/f50 [0,4194304] 0 2024-09-18T12:52:21.014 INFO:tasks.workunit.client.0.smithi045.stdout:6/559: write d9/d1a/d1d/f5a [982426,67750] 0 2024-09-18T12:52:21.016 INFO:tasks.workunit.client.1.smithi161.stdout:9/920: mknod d0/d20/d49/d124/c135 0 2024-09-18T12:52:21.020 INFO:tasks.workunit.client.0.smithi045.stdout:2/593: write d5/d5f/da8/d61/f89 [340591,68572] 0 2024-09-18T12:52:21.021 INFO:tasks.workunit.client.0.smithi045.stdout:7/490: stat d13/d31/d33/d64/d78 0 2024-09-18T12:52:21.023 INFO:tasks.workunit.client.0.smithi045.stdout:4/765: rename db/de/d1e/d3e/d9a/l18 to db/de/d1e/lff 0 2024-09-18T12:52:21.023 INFO:tasks.workunit.client.0.smithi045.stdout:7/491: write d13/d44/fad [134517,4288] 0 2024-09-18T12:52:21.024 INFO:tasks.workunit.client.0.smithi045.stdout:1/598: write d0/d2d/d2b/d30/d8b/f4e [240192,72877] 0 2024-09-18T12:52:21.025 INFO:tasks.workunit.client.1.smithi161.stdout:7/918: creat d3/d8/d15/da7/d4a/d64/d8c/f113 x:0 0 0 2024-09-18T12:52:21.027 INFO:tasks.workunit.client.1.smithi161.stdout:9/921: mkdir d0/d47/df1/d59/ddb/d136 0 2024-09-18T12:52:21.027 INFO:tasks.workunit.client.0.smithi045.stdout:6/560: fsync d9/d1a/d2d/d38/fa5 0 2024-09-18T12:52:21.028 INFO:tasks.workunit.client.0.smithi045.stdout:7/492: readlink d13/d31/d33/l7e 0 2024-09-18T12:52:21.029 INFO:tasks.workunit.client.0.smithi045.stdout:4/766: mkdir db/de/d1e/d3e/d78/d100 0 2024-09-18T12:52:21.029 INFO:tasks.workunit.client.0.smithi045.stdout:0/580: dwrite d6/d48/d5e/d39/d58/d86/fa1 [0,4194304] 0 2024-09-18T12:52:21.031 INFO:tasks.workunit.client.0.smithi045.stdout:1/599: mkdir d0/d2d/db1 0 2024-09-18T12:52:21.031 INFO:tasks.workunit.client.1.smithi161.stdout:7/919: mkdir d3/d8/d15/da7/d114 0 2024-09-18T12:52:21.032 INFO:tasks.workunit.client.1.smithi161.stdout:9/922: mkdir d0/d93/dfc/d137 0 2024-09-18T12:52:21.033 INFO:tasks.workunit.client.0.smithi045.stdout:7/493: rmdir d13/d1a 39 2024-09-18T12:52:21.034 INFO:tasks.workunit.client.0.smithi045.stdout:4/767: write db/de/d1e/ffe [136907,77147] 0 2024-09-18T12:52:21.036 INFO:tasks.workunit.client.0.smithi045.stdout:6/561: symlink d9/d1a/d48/d8f/d98/lc9 0 2024-09-18T12:52:21.036 INFO:tasks.workunit.client.1.smithi161.stdout:9/923: mknod d0/d16/d25/d86/dae/c138 0 2024-09-18T12:52:21.037 INFO:tasks.workunit.client.0.smithi045.stdout:8/580: dwrite d11/f5f [4194304,4194304] 0 2024-09-18T12:52:21.037 INFO:tasks.workunit.client.1.smithi161.stdout:7/920: readlink d3/d8/d15/da7/d44/la8 0 2024-09-18T12:52:21.038 INFO:tasks.workunit.client.1.smithi161.stdout:7/921: chown d3/d50 1861947 1 2024-09-18T12:52:21.039 INFO:tasks.workunit.client.0.smithi045.stdout:1/600: creat d0/d12/d32/d67/d6a/fb2 x:0 0 0 2024-09-18T12:52:21.041 INFO:tasks.workunit.client.0.smithi045.stdout:6/562: write d9/d1a/d48/d75/fc3 [64741,15265] 0 2024-09-18T12:52:21.042 INFO:tasks.workunit.client.0.smithi045.stdout:2/594: dwrite d5/d5f/f83 [0,4194304] 0 2024-09-18T12:52:21.045 INFO:tasks.workunit.client.0.smithi045.stdout:0/581: mknod d6/d48/d5e/d39/d58/d3b/d65/ca6 0 2024-09-18T12:52:21.045 INFO:tasks.workunit.client.0.smithi045.stdout:6/563: write d9/d1a/d2d/d32/f62 [5083846,129565] 0 2024-09-18T12:52:21.046 INFO:tasks.workunit.client.1.smithi161.stdout:7/922: mkdir d3/d8/d15/da7/d24/daf/d115 0 2024-09-18T12:52:21.049 INFO:tasks.workunit.client.0.smithi045.stdout:4/768: mknod db/d2c/dcd/c101 0 2024-09-18T12:52:21.050 INFO:tasks.workunit.client.0.smithi045.stdout:4/769: dread - db/d20/d6b/fe0 zero size 2024-09-18T12:52:21.051 INFO:tasks.workunit.client.1.smithi161.stdout:9/924: mkdir d0/d47/d48/d139 0 2024-09-18T12:52:21.053 INFO:tasks.workunit.client.1.smithi161.stdout:7/923: mkdir d3/d83/db6/d116 0 2024-09-18T12:52:21.054 INFO:tasks.workunit.client.1.smithi161.stdout:7/924: write d3/d8/d4b/f6f [1163541,51335] 0 2024-09-18T12:52:21.055 INFO:tasks.workunit.client.0.smithi045.stdout:1/601: mkdir d0/d2d/d6c/db3 0 2024-09-18T12:52:21.056 INFO:tasks.workunit.client.0.smithi045.stdout:1/602: chown d0/d2d/d2b/d30/d40/d60/caa 41 1 2024-09-18T12:52:21.057 INFO:tasks.workunit.client.1.smithi161.stdout:9/925: truncate d0/d16/d25/d28/f38 3680003 0 2024-09-18T12:52:21.062 INFO:tasks.workunit.client.0.smithi045.stdout:2/595: truncate d5/d46/f86 1498759 0 2024-09-18T12:52:21.063 INFO:tasks.workunit.client.0.smithi045.stdout:6/564: fdatasync d9/d30/faa 0 2024-09-18T12:52:21.065 INFO:tasks.workunit.client.0.smithi045.stdout:6/565: fdatasync d9/d1a/d2d/f93 0 2024-09-18T12:52:21.066 INFO:tasks.workunit.client.0.smithi045.stdout:0/582: truncate d6/d48/d5e/d39/d58/f68 829697 0 2024-09-18T12:52:21.068 INFO:tasks.workunit.client.0.smithi045.stdout:4/770: read db/de/d1e/f2d [3819583,19367] 0 2024-09-18T12:52:21.068 INFO:tasks.workunit.client.0.smithi045.stdout:4/771: read - db/de/d1e/d3e/d78/fee zero size 2024-09-18T12:52:21.069 INFO:tasks.workunit.client.1.smithi161.stdout:7/925: creat d3/d8/d15/da7/d44/f117 x:0 0 0 2024-09-18T12:52:21.070 INFO:tasks.workunit.client.1.smithi161.stdout:7/926: read d3/d8/d4f/f61 [2022623,22515] 0 2024-09-18T12:52:21.071 INFO:tasks.workunit.client.0.smithi045.stdout:1/603: symlink d0/d12/da7/lb4 0 2024-09-18T12:52:21.073 INFO:tasks.workunit.client.1.smithi161.stdout:9/926: dread d0/db/f26 [0,4194304] 0 2024-09-18T12:52:21.076 INFO:tasks.workunit.client.1.smithi161.stdout:7/927: creat d3/d8/d15/da7/d24/d31/d7d/f118 x:0 0 0 2024-09-18T12:52:21.077 INFO:tasks.workunit.client.1.smithi161.stdout:7/928: write d3/ff0 [1501512,61468] 0 2024-09-18T12:52:21.077 INFO:tasks.workunit.client.0.smithi045.stdout:6/566: mknod d9/d1a/d48/d8f/d98/cca 0 2024-09-18T12:52:21.079 INFO:tasks.workunit.client.0.smithi045.stdout:0/583: rename d6/c26 to d6/d35/d92/ca7 0 2024-09-18T12:52:21.081 INFO:tasks.workunit.client.0.smithi045.stdout:8/581: truncate d11/d14/f36 2361477 0 2024-09-18T12:52:21.083 INFO:tasks.workunit.client.0.smithi045.stdout:2/596: write d5/d2c/d4d/f68 [1511467,106116] 0 2024-09-18T12:52:21.084 INFO:tasks.workunit.client.1.smithi161.stdout:7/929: mkdir d3/d8/d4b/d119 0 2024-09-18T12:52:21.086 INFO:tasks.workunit.client.1.smithi161.stdout:9/927: link d0/d47/d48/d7f/d9e/da4/f11f d0/d16/d25/f13a 0 2024-09-18T12:52:21.088 INFO:tasks.workunit.client.1.smithi161.stdout:7/930: mkdir d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/d11a 0 2024-09-18T12:52:21.089 INFO:tasks.workunit.client.1.smithi161.stdout:9/928: mknod d0/d20/d115/c13b 0 2024-09-18T12:52:21.090 INFO:tasks.workunit.client.0.smithi045.stdout:1/604: rename d0/d12/f80 to d0/d12/d6f/fb5 0 2024-09-18T12:52:21.093 INFO:tasks.workunit.client.0.smithi045.stdout:0/584: truncate d6/d48/d5e/f78 202348 0 2024-09-18T12:52:21.095 INFO:tasks.workunit.client.0.smithi045.stdout:4/772: mknod db/de/d1e/d3e/d47/d59/c102 0 2024-09-18T12:52:21.096 INFO:tasks.workunit.client.0.smithi045.stdout:4/773: fsync db/de/d1e/d3e/de1/ff1 0 2024-09-18T12:52:21.097 INFO:tasks.workunit.client.1.smithi161.stdout:7/931: mknod d3/d8/d15/da7/c11b 0 2024-09-18T12:52:21.097 INFO:tasks.workunit.client.0.smithi045.stdout:4/774: fsync db/de/d1e/d3e/d9a/f7c 0 2024-09-18T12:52:21.099 INFO:tasks.workunit.client.1.smithi161.stdout:9/929: mkdir d0/db/d18/d121/d12a/d133/d13c 0 2024-09-18T12:52:21.099 INFO:tasks.workunit.client.1.smithi161.stdout:9/930: chown d0/d20/d49/f117 15 1 2024-09-18T12:52:21.100 INFO:tasks.workunit.client.0.smithi045.stdout:7/494: link d13/d31/d5f/c7d d13/d31/cb1 0 2024-09-18T12:52:21.100 INFO:tasks.workunit.client.1.smithi161.stdout:9/931: stat d0/d20/f39 0 2024-09-18T12:52:21.100 INFO:tasks.workunit.client.1.smithi161.stdout:9/932: truncate d0/d47/f118 839928 0 2024-09-18T12:52:21.101 INFO:tasks.workunit.client.0.smithi045.stdout:7/495: write d13/d31/d5f/d94/f7f [3729395,19780] 0 2024-09-18T12:52:21.103 INFO:tasks.workunit.client.1.smithi161.stdout:7/932: mknod d3/d8/d15/da7/d44/c11c 0 2024-09-18T12:52:21.106 INFO:tasks.workunit.client.0.smithi045.stdout:4/775: dwrite db/de/fae [0,4194304] 0 2024-09-18T12:52:21.106 INFO:tasks.workunit.client.0.smithi045.stdout:2/597: rename d5/d5f/f78 to d5/d46/fcf 0 2024-09-18T12:52:21.106 INFO:tasks.workunit.client.1.smithi161.stdout:7/933: read d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/f7f [1165689,74734] 0 2024-09-18T12:52:21.109 INFO:tasks.workunit.client.0.smithi045.stdout:6/567: dwrite d9/d1a/d2d/d32/f4c [0,4194304] 0 2024-09-18T12:52:21.111 INFO:tasks.workunit.client.1.smithi161.stdout:9/933: getdents d0/d16/d25/d86/df4 0 2024-09-18T12:52:21.111 INFO:tasks.workunit.client.0.smithi045.stdout:6/568: write d9/d1a/d48/d8f/d98/dab/fae [369740,57550] 0 2024-09-18T12:52:21.113 INFO:tasks.workunit.client.0.smithi045.stdout:8/582: write d11/d14/d53/d41/f7c [984867,70368] 0 2024-09-18T12:52:21.117 INFO:tasks.workunit.client.1.smithi161.stdout:1/917: sync 2024-09-18T12:52:21.118 INFO:tasks.workunit.client.1.smithi161.stdout:1/918: chown d1/d26/dad/db6 42410 1 2024-09-18T12:52:21.118 INFO:tasks.workunit.client.1.smithi161.stdout:7/934: mknod d3/d8/d15/da7/d4a/c11d 0 2024-09-18T12:52:21.121 INFO:tasks.workunit.client.0.smithi045.stdout:4/776: rmdir db/de/d1e/d3e/d78 39 2024-09-18T12:52:21.122 INFO:tasks.workunit.client.0.smithi045.stdout:4/777: chown db/de9/cef 328230 1 2024-09-18T12:52:21.122 INFO:tasks.workunit.client.1.smithi161.stdout:7/935: creat d3/d8/d15/da7/d24/d31/d7d/f11e x:0 0 0 2024-09-18T12:52:21.123 INFO:tasks.workunit.client.0.smithi045.stdout:4/778: chown db/d2c/d35/dcc/dd0/ld7 2447 1 2024-09-18T12:52:21.124 INFO:tasks.workunit.client.0.smithi045.stdout:2/598: creat d5/d5f/da8/d61/dbb/dc6/fd0 x:0 0 0 2024-09-18T12:52:21.125 INFO:tasks.workunit.client.1.smithi161.stdout:7/936: creat d3/d83/f11f x:0 0 0 2024-09-18T12:52:21.126 INFO:tasks.workunit.client.0.smithi045.stdout:6/569: mkdir d9/d1a/d48/d7d/dcb 0 2024-09-18T12:52:21.126 INFO:tasks.workunit.client.1.smithi161.stdout:7/937: chown d3/d8/d15/da7/d4a/d64/d8c/d9f/f5f 14035 1 2024-09-18T12:52:21.127 INFO:tasks.workunit.client.1.smithi161.stdout:1/919: creat d1/da/d1f/d6b/dd2/d10d/f130 x:0 0 0 2024-09-18T12:52:21.129 INFO:tasks.workunit.client.0.smithi045.stdout:5/673: sync 2024-09-18T12:52:21.129 INFO:tasks.workunit.client.0.smithi045.stdout:3/524: sync 2024-09-18T12:52:21.130 INFO:tasks.workunit.client.0.smithi045.stdout:6/570: read d9/d56/f57 [2424884,46285] 0 2024-09-18T12:52:21.134 INFO:tasks.workunit.client.1.smithi161.stdout:1/920: dwrite d1/f15 [4194304,4194304] 0 2024-09-18T12:52:21.134 INFO:tasks.workunit.client.0.smithi045.stdout:2/599: creat d5/d5f/da8/d61/fd1 x:0 0 0 2024-09-18T12:52:21.136 INFO:tasks.workunit.client.0.smithi045.stdout:7/496: dread d13/d44/f2b [0,4194304] 0 2024-09-18T12:52:21.137 INFO:tasks.workunit.client.0.smithi045.stdout:1/605: rename d0/d2d/f35 to d0/d2d/d2b/fb6 0 2024-09-18T12:52:21.139 INFO:tasks.workunit.client.0.smithi045.stdout:1/606: stat d0/d2d/d2b/d30/c59 0 2024-09-18T12:52:21.140 INFO:tasks.workunit.client.1.smithi161.stdout:9/934: write d0/d16/fa6 [170732,87762] 0 2024-09-18T12:52:21.143 INFO:tasks.workunit.client.0.smithi045.stdout:3/525: dread d0/d22/f3d [0,4194304] 0 2024-09-18T12:52:21.144 INFO:tasks.workunit.client.0.smithi045.stdout:3/526: write d0/d1e/d2c/d3a/f3c [1269604,42102] 0 2024-09-18T12:52:21.146 INFO:tasks.workunit.client.0.smithi045.stdout:0/585: write d6/d48/d5e/f44 [1912959,116138] 0 2024-09-18T12:52:21.147 INFO:tasks.workunit.client.0.smithi045.stdout:7/497: rmdir d13/d31/d5f/d94 39 2024-09-18T12:52:21.149 INFO:tasks.workunit.client.0.smithi045.stdout:1/607: symlink d0/d12/da7/lb7 0 2024-09-18T12:52:21.151 INFO:tasks.workunit.client.1.smithi161.stdout:1/921: dread d1/d26/f10 [0,4194304] 0 2024-09-18T12:52:21.153 INFO:tasks.workunit.client.0.smithi045.stdout:3/527: mkdir d0/d1e/d91/d95/db1 0 2024-09-18T12:52:21.153 INFO:tasks.workunit.client.0.smithi045.stdout:8/583: write f9 [1659273,118391] 0 2024-09-18T12:52:21.154 INFO:tasks.workunit.client.1.smithi161.stdout:1/922: readlink d1/da/d1f/dab/daf/de8/l115 0 2024-09-18T12:52:21.155 INFO:tasks.workunit.client.1.smithi161.stdout:1/923: stat d1/daa 0 2024-09-18T12:52:21.155 INFO:tasks.workunit.client.0.smithi045.stdout:8/584: chown d11/d76/c9e 838364 1 2024-09-18T12:52:21.155 INFO:tasks.workunit.client.0.smithi045.stdout:3/528: write d0/d1e/d2c/d3a/f6d [2215397,37825] 0 2024-09-18T12:52:21.155 INFO:tasks.workunit.client.0.smithi045.stdout:8/585: chown d11/d14 104 1 2024-09-18T12:52:21.156 INFO:tasks.workunit.client.1.smithi161.stdout:1/924: truncate d1/da/d39/f10b 774237 0 2024-09-18T12:52:21.157 INFO:tasks.workunit.client.0.smithi045.stdout:0/586: creat d6/d48/d5e/d39/d58/d3b/fa8 x:0 0 0 2024-09-18T12:52:21.158 INFO:tasks.workunit.client.1.smithi161.stdout:7/938: dwrite d3/d8/d15/da7/d4a/d64/f7b [0,4194304] 0 2024-09-18T12:52:21.158 INFO:tasks.workunit.client.0.smithi045.stdout:0/587: fsync d6/d48/d5e/d39/d58/f59 0 2024-09-18T12:52:21.159 INFO:tasks.workunit.client.0.smithi045.stdout:5/674: creat d6/db/fd6 x:0 0 0 2024-09-18T12:52:21.159 INFO:tasks.workunit.client.1.smithi161.stdout:7/939: readlink d3/d8/d4b/ld2 0 2024-09-18T12:52:21.160 INFO:tasks.workunit.client.0.smithi045.stdout:5/675: readlink d6/d28/d2b/l58 0 2024-09-18T12:52:21.161 INFO:tasks.workunit.client.1.smithi161.stdout:9/935: write d0/db/d18/f36 [1277890,104489] 0 2024-09-18T12:52:21.161 INFO:tasks.workunit.client.1.smithi161.stdout:1/925: rmdir d1/da/d1f/d45/d73 39 2024-09-18T12:52:21.161 INFO:tasks.workunit.client.0.smithi045.stdout:8/586: dread d11/d14/d53/d41/f9a [0,4194304] 0 2024-09-18T12:52:21.162 INFO:tasks.workunit.client.0.smithi045.stdout:2/600: write d5/d2c/d4d/f54 [2271323,20046] 0 2024-09-18T12:52:21.163 INFO:tasks.workunit.client.0.smithi045.stdout:1/608: creat d0/d2d/d2b/d30/d40/d60/d8f/fb8 x:0 0 0 2024-09-18T12:52:21.164 INFO:tasks.workunit.client.1.smithi161.stdout:7/940: fsync d3/d8/d4f/fbf 0 2024-09-18T12:52:21.167 INFO:tasks.workunit.client.1.smithi161.stdout:1/926: symlink d1/d26/d3a/l131 0 2024-09-18T12:52:21.168 INFO:tasks.workunit.client.1.smithi161.stdout:7/941: dread d3/f2e [0,4194304] 0 2024-09-18T12:52:21.168 INFO:tasks.workunit.client.1.smithi161.stdout:9/936: symlink d0/db/d18/d121/d12a/d133/l13d 0 2024-09-18T12:52:21.170 INFO:tasks.workunit.client.1.smithi161.stdout:1/927: mknod d1/da/d1f/dab/daf/de8/c132 0 2024-09-18T12:52:21.171 INFO:tasks.workunit.client.0.smithi045.stdout:0/588: fsync d6/d48/d5e/d39/d58/d3b/fa8 0 2024-09-18T12:52:21.173 INFO:tasks.workunit.client.0.smithi045.stdout:0/589: write d6/d48/d5e/d39/d58/d3c/f8e [1285662,20223] 0 2024-09-18T12:52:21.174 INFO:tasks.workunit.client.0.smithi045.stdout:6/571: getdents d9/d1a/d48/d7d 0 2024-09-18T12:52:21.176 INFO:tasks.workunit.client.1.smithi161.stdout:9/937: unlink d0/d47/d48/d7f/d9e/da4/f11f 0 2024-09-18T12:52:21.178 INFO:tasks.workunit.client.1.smithi161.stdout:1/928: symlink d1/da/d31/l133 0 2024-09-18T12:52:21.180 INFO:tasks.workunit.client.0.smithi045.stdout:2/601: chown d5/f42 6819944 1 2024-09-18T12:52:21.182 INFO:tasks.workunit.client.0.smithi045.stdout:8/587: mkdir d11/d14/d53/d41/d57/da6 0 2024-09-18T12:52:21.183 INFO:tasks.workunit.client.0.smithi045.stdout:8/588: truncate d11/d76/da0/f89 1327550 0 2024-09-18T12:52:21.183 INFO:tasks.workunit.client.1.smithi161.stdout:7/942: write d3/d8/d15/da7/d24/d31/f68 [28422,821] 0 2024-09-18T12:52:21.185 INFO:tasks.workunit.client.1.smithi161.stdout:7/943: dread - d3/d8/d15/da7/d44/f10b zero size 2024-09-18T12:52:21.186 INFO:tasks.workunit.client.1.smithi161.stdout:1/929: write d1/da/d1f/d45/f83 [430154,95216] 0 2024-09-18T12:52:21.188 INFO:tasks.workunit.client.0.smithi045.stdout:7/498: link d13/d1a/d28/f3a d13/d31/d33/fb2 0 2024-09-18T12:52:21.190 INFO:tasks.workunit.client.1.smithi161.stdout:9/938: dwrite d0/d47/f4c [4194304,4194304] 0 2024-09-18T12:52:21.191 INFO:tasks.workunit.client.1.smithi161.stdout:9/939: write d0/d20/d49/de2/f12c [642198,38445] 0 2024-09-18T12:52:21.192 INFO:tasks.workunit.client.0.smithi045.stdout:0/590: truncate d6/d48/d5e/d39/d58/f25 4894884 0 2024-09-18T12:52:21.194 INFO:tasks.workunit.client.0.smithi045.stdout:0/591: write d6/d48/d5e/d39/d58/d86/fa1 [1897290,115295] 0 2024-09-18T12:52:21.194 INFO:tasks.workunit.client.0.smithi045.stdout:2/602: creat d5/d2c/fd2 x:0 0 0 2024-09-18T12:52:21.196 INFO:tasks.workunit.client.0.smithi045.stdout:0/592: dread - d6/d48/d5e/d39/d58/d66/fa4 zero size 2024-09-18T12:52:21.201 INFO:tasks.workunit.client.0.smithi045.stdout:0/593: stat d6/d48/d5e/d39/d58/d86/f99 0 2024-09-18T12:52:21.201 INFO:tasks.workunit.client.1.smithi161.stdout:7/944: dwrite d3/d8/d4f/f61 [0,4194304] 0 2024-09-18T12:52:21.201 INFO:tasks.workunit.client.1.smithi161.stdout:1/930: dwrite d1/da/d1f/dab/ff1 [0,4194304] 0 2024-09-18T12:52:21.203 INFO:tasks.workunit.client.0.smithi045.stdout:3/529: creat d0/d7/fb2 x:0 0 0 2024-09-18T12:52:21.205 INFO:tasks.workunit.client.1.smithi161.stdout:7/945: creat d3/d8/d4b/f120 x:0 0 0 2024-09-18T12:52:21.207 INFO:tasks.workunit.client.1.smithi161.stdout:1/931: dread d1/d26/d3a/f7b [0,4194304] 0 2024-09-18T12:52:21.209 INFO:tasks.workunit.client.0.smithi045.stdout:5/676: link d6/d28/d2b/c32 d6/d28/dcc/cd7 0 2024-09-18T12:52:21.210 INFO:tasks.workunit.client.1.smithi161.stdout:9/940: creat d0/d16/d25/d86/dae/f13e x:0 0 0 2024-09-18T12:52:21.212 INFO:tasks.workunit.client.0.smithi045.stdout:0/594: mkdir d6/d7/d32/da9 0 2024-09-18T12:52:21.214 INFO:tasks.workunit.client.0.smithi045.stdout:1/609: creat d0/d2d/d2b/d30/fb9 x:0 0 0 2024-09-18T12:52:21.215 INFO:tasks.workunit.client.1.smithi161.stdout:1/932: creat d1/dbf/f134 x:0 0 0 2024-09-18T12:52:21.216 INFO:tasks.workunit.client.1.smithi161.stdout:9/941: write d0/d16/d25/d46/fb6 [1392312,64171] 0 2024-09-18T12:52:21.219 INFO:tasks.workunit.client.1.smithi161.stdout:1/933: write d1/da/d1f/dab/daf/de3/f102 [5399371,80768] 0 2024-09-18T12:52:21.220 INFO:tasks.workunit.client.0.smithi045.stdout:3/530: read d0/f3e [1186359,53939] 0 2024-09-18T12:52:21.220 INFO:tasks.workunit.client.0.smithi045.stdout:0/595: unlink d6/d35/f3f 0 2024-09-18T12:52:21.221 INFO:tasks.workunit.client.0.smithi045.stdout:8/589: dread d11/d14/d53/f4f [0,4194304] 0 2024-09-18T12:52:21.222 INFO:tasks.workunit.client.0.smithi045.stdout:1/610: mknod d0/d2d/d2b/d30/d8b/d5b/cba 0 2024-09-18T12:52:21.223 INFO:tasks.workunit.client.0.smithi045.stdout:8/590: readlink d11/d76/da0/l80 0 2024-09-18T12:52:21.223 INFO:tasks.workunit.client.1.smithi161.stdout:1/934: creat d1/d26/da6/f135 x:0 0 0 2024-09-18T12:52:21.225 INFO:tasks.workunit.client.0.smithi045.stdout:8/591: chown d11/d20/f71 80902527 1 2024-09-18T12:52:21.225 INFO:tasks.workunit.client.0.smithi045.stdout:0/596: truncate d6/d48/d5e/d39/d58/d86/f99 193140 0 2024-09-18T12:52:21.225 INFO:tasks.workunit.client.1.smithi161.stdout:1/935: mknod d1/d48/c136 0 2024-09-18T12:52:21.226 INFO:tasks.workunit.client.0.smithi045.stdout:8/592: write d11/d14/f4b [165909,108687] 0 2024-09-18T12:52:21.228 INFO:tasks.workunit.client.0.smithi045.stdout:6/572: truncate d9/d1a/d48/d8f/f9b 2849203 0 2024-09-18T12:52:21.228 INFO:tasks.workunit.client.1.smithi161.stdout:9/942: dwrite d0/d16/d25/d28/f73 [0,4194304] 0 2024-09-18T12:52:21.228 INFO:tasks.workunit.client.1.smithi161.stdout:7/946: dread d3/d8/d15/da7/d44/f106 [0,4194304] 0 2024-09-18T12:52:21.230 INFO:tasks.workunit.client.1.smithi161.stdout:9/943: write d0/d47/f128 [782253,37280] 0 2024-09-18T12:52:21.230 INFO:tasks.workunit.client.1.smithi161.stdout:7/947: dread - d3/d8/d15/da7/d24/d31/ff1 zero size 2024-09-18T12:52:21.231 INFO:tasks.workunit.client.0.smithi045.stdout:7/499: getdents d13/d44 0 2024-09-18T12:52:21.233 INFO:tasks.workunit.client.0.smithi045.stdout:6/573: write d9/d1a/d48/d8f/d98/dab/fae [1217072,81742] 0 2024-09-18T12:52:21.236 INFO:tasks.workunit.client.0.smithi045.stdout:8/593: dwrite fa [0,4194304] 0 2024-09-18T12:52:21.244 INFO:tasks.workunit.client.0.smithi045.stdout:2/603: dwrite d5/d5f/db2/f69 [0,4194304] 0 2024-09-18T12:52:21.245 INFO:tasks.workunit.client.1.smithi161.stdout:7/948: symlink d3/d8/d15/d99/dfb/l121 0 2024-09-18T12:52:21.247 INFO:tasks.workunit.client.0.smithi045.stdout:5/677: dwrite d6/db/d5a/d78/d66/f7b [0,4194304] 0 2024-09-18T12:52:21.248 INFO:tasks.workunit.client.1.smithi161.stdout:7/949: write d3/d8/d15/d99/db0/fef [581830,68110] 0 2024-09-18T12:52:21.249 INFO:tasks.workunit.client.0.smithi045.stdout:2/604: stat d5/d3a/d6b/l87 0 2024-09-18T12:52:21.250 INFO:tasks.workunit.client.1.smithi161.stdout:9/944: unlink d0/d20/cec 0 2024-09-18T12:52:21.250 INFO:tasks.workunit.client.0.smithi045.stdout:1/611: write d0/d12/da7/f58 [1680399,121317] 0 2024-09-18T12:52:21.251 INFO:tasks.workunit.client.0.smithi045.stdout:8/594: dwrite d11/d76/f88 [4194304,4194304] 0 2024-09-18T12:52:21.252 INFO:tasks.workunit.client.1.smithi161.stdout:7/950: chown d3/d8/d15/da7/d44/db7 0 1 2024-09-18T12:52:21.262 INFO:tasks.workunit.client.1.smithi161.stdout:7/951: getdents d3/d8/d4f/dc1 0 2024-09-18T12:52:21.263 INFO:tasks.workunit.client.0.smithi045.stdout:1/612: write d0/d12/d32/d67/d6d/fa1 [751853,129451] 0 2024-09-18T12:52:21.264 INFO:tasks.workunit.client.0.smithi045.stdout:7/500: dwrite d13/d44/d37/d70/d77/d6d/fa2 [0,4194304] 0 2024-09-18T12:52:21.265 INFO:tasks.workunit.client.0.smithi045.stdout:8/595: creat d11/d8c/d90/fa7 x:0 0 0 2024-09-18T12:52:21.266 INFO:tasks.workunit.client.1.smithi161.stdout:7/952: rename d3/d8/d15/da7/cf7 to d3/d7e/c122 0 2024-09-18T12:52:21.270 INFO:tasks.workunit.client.0.smithi045.stdout:7/501: creat d13/d1a/d9b/fb3 x:0 0 0 2024-09-18T12:52:21.271 INFO:tasks.workunit.client.0.smithi045.stdout:8/596: creat d11/d7b/fa8 x:0 0 0 2024-09-18T12:52:21.273 INFO:tasks.workunit.client.0.smithi045.stdout:7/502: chown d13/d31/d5f/f69 3132673 1 2024-09-18T12:52:21.273 INFO:tasks.workunit.client.1.smithi161.stdout:7/953: rename d3/d8/d15/da7/d24/d31/d7d/f9e to d3/d8/d15/da7/d4a/d64/d8c/d9f/d4d/f123 0 2024-09-18T12:52:21.276 INFO:tasks.workunit.client.0.smithi045.stdout:7/503: chown d13/d31/d5f 10505420 1 2024-09-18T12:52:21.277 INFO:tasks.workunit.client.0.smithi045.stdout:7/504: fdatasync d13/d1a/d9b/fb3 0 2024-09-18T12:52:21.277 INFO:tasks.workunit.client.0.smithi045.stdout:2/605: rmdir d5/d2c/d4d/dcb 0 2024-09-18T12:52:21.278 INFO:tasks.workunit.client.1.smithi161.stdout:1/936: write d1/d26/d3a/f4f [107948,45579] 0 2024-09-18T12:52:21.279 INFO:tasks.workunit.client.1.smithi161.stdout:7/954: creat d3/d8/d4b/f124 x:0 0 0 2024-09-18T12:52:21.279 INFO:tasks.workunit.client.1.smithi161.stdout:7/955: readlink d3/d8/d4b/l72 0 2024-09-18T12:52:21.282 INFO:tasks.workunit.client.0.smithi045.stdout:8/597: rename d11/d14/d53/d41/d57/da6 to d11/d14/d72/da9 0 2024-09-18T12:52:21.285 INFO:tasks.workunit.client.1.smithi161.stdout:1/937: dwrite d1/da/d1f/dab/dd9/f10c [0,4194304] 0 2024-09-18T12:52:21.286 INFO:tasks.workunit.client.0.smithi045.stdout:5/678: write d6/db/f43 [7981816,87777] 0 2024-09-18T12:52:21.291 INFO:tasks.workunit.client.1.smithi161.stdout:1/938: dread d1/d26/d88/fb0 [0,4194304] 0 2024-09-18T12:52:21.292 INFO:tasks.workunit.client.0.smithi045.stdout:6/574: dwrite d9/d1a/d2d/d38/d5b/d67/f79 [0,4194304] 0 2024-09-18T12:52:21.292 INFO:tasks.workunit.client.1.smithi161.stdout:1/939: write d1/d1d/fe0 [1409821,78429] 0 2024-09-18T12:52:21.304 INFO:tasks.workunit.client.0.smithi045.stdout:1/613: dwrite d0/d12/da7/f28 [0,4194304] 0 2024-09-18T12:52:21.307 INFO:tasks.workunit.client.0.smithi045.stdout:2/606: unlink d5/d5f/db2/l2a 0 2024-09-18T12:52:21.308 INFO:tasks.workunit.client.1.smithi161.stdout:7/956: link d3/d8/d15/da7/d24/daf/lc0 d3/d8/d15/da7/d24/l125 0 2024-09-18T12:52:21.309 INFO:tasks.workunit.client.0.smithi045.stdout:1/614: write d0/d12/d32/d67/d6d/fa2 [627491,72689] 0 2024-09-18T12:52:21.309 INFO:tasks.workunit.client.1.smithi161.stdout:7/957: write d3/d8/f91 [4057563,108973] 0 2024-09-18T12:52:21.311 INFO:tasks.workunit.client.0.smithi045.stdout:7/505: dwrite d13/d31/d5f/f69 [0,4194304] 0 2024-09-18T12:52:21.320 INFO:tasks.workunit.client.0.smithi045.stdout:6/575: dread d9/f18 [0,4194304] 0 2024-09-18T12:52:21.321 INFO:tasks.workunit.client.0.smithi045.stdout:1/615: dwrite d0/d12/da7/f42 [0,4194304] 0 2024-09-18T12:52:21.321 INFO:tasks.workunit.client.0.smithi045.stdout:2/607: mknod d5/d3a/cd3 0 2024-09-18T12:52:21.324 INFO:tasks.workunit.client.0.smithi045.stdout:7/506: fsync d13/d44/d37/d70/d77/f5c 0 2024-09-18T12:52:21.324 INFO:tasks.workunit.client.1.smithi161.stdout:1/940: getdents d1/d26/da6 0 2024-09-18T12:52:21.325 INFO:tasks.workunit.client.0.smithi045.stdout:7/507: stat d13/d44/d37/d70/f84 0 2024-09-18T12:52:21.325 INFO:tasks.workunit.client.1.smithi161.stdout:1/941: chown d1/da/d31/f77 2 1 2024-09-18T12:52:21.329 INFO:tasks.workunit.client.0.smithi045.stdout:7/508: fdatasync d13/d1a/d9b/fb3 0 2024-09-18T12:52:21.329 INFO:tasks.workunit.client.0.smithi045.stdout:8/598: write d11/d14/f36 [2536265,24814] 0 2024-09-18T12:52:21.329 INFO:tasks.workunit.client.1.smithi161.stdout:1/942: mkdir d1/d1d/d137 0 2024-09-18T12:52:21.330 INFO:tasks.workunit.client.1.smithi161.stdout:7/958: write d3/d36/fad [282013,126258] 0 2024-09-18T12:52:21.332 INFO:tasks.workunit.client.1.smithi161.stdout:1/943: creat d1/d26/dad/f138 x:0 0 0 2024-09-18T12:52:21.333 INFO:tasks.workunit.client.1.smithi161.stdout:7/959: mkdir d3/d8/d15/da7/d44/db7/d126 0 2024-09-18T12:52:21.334 INFO:tasks.workunit.client.0.smithi045.stdout:5/679: dwrite d6/db/f50 [0,4194304] 0 2024-09-18T12:52:21.334 INFO:tasks.workunit.client.1.smithi161.stdout:7/960: dread - d3/d8/d15/da7/d4a/d64/d8c/d9f/dd7/fff zero size 2024-09-18T12:52:21.335 INFO:tasks.workunit.client.0.smithi045.stdout:2/608: rmdir d5/dc5 0 2024-09-18T12:52:21.335 INFO:tasks.workunit.client.1.smithi161.stdout:1/944: truncate d1/f97 1960275 0 2024-09-18T12:52:21.336 INFO:tasks.workunit.client.1.smithi161.stdout:1/945: stat d1/da/d1f/dab/daf/de8/d118/c5e 0 2024-09-18T12:52:21.336 INFO:tasks.workunit.client.0.smithi045.stdout:5/680: fdatasync d6/d3e/f26 0 2024-09-18T12:52:21.339 INFO:tasks.workunit.client.0.smithi045.stdout:1/616: rename d0/fc to d0/d2d/d2b/fbb 0 2024-09-18T12:52:21.340 INFO:tasks.workunit.client.0.smithi045.stdout:1/617: chown d0/d12/d32/d67/d6a/fb2 8416 1 2024-09-18T12:52:21.341 INFO:tasks.workunit.client.0.smithi045.stdout:1/618: read d0/f69 [3291985,115847] 0 2024-09-18T12:52:21.342 INFO:tasks.workunit.client.0.smithi045.stdout:2/609: rmdir d5/d5f 39 2024-09-18T12:52:21.343 INFO:tasks.workunit.client.1.smithi161.stdout:1/946: dread d1/d71/fef [0,4194304] 0 2024-09-18T12:52:21.343 INFO:tasks.workunit.client.1.smithi161.stdout:7/961: mkdir d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/d89/d8f/d127 0 2024-09-18T12:52:21.346 INFO:tasks.workunit.client.0.smithi045.stdout:8/599: unlink d11/d14/d53/f54 0 2024-09-18T12:52:21.348 INFO:tasks.workunit.client.1.smithi161.stdout:1/947: dwrite d1/da/d31/f77 [0,4194304] 0 2024-09-18T12:52:21.349 INFO:tasks.workunit.client.0.smithi045.stdout:5/681: fdatasync d6/db/d6a/d77/f8c 0 2024-09-18T12:52:21.350 INFO:tasks.workunit.client.1.smithi161.stdout:7/962: rename d3/d50/l78 to d3/d8/d15/da7/d24/daf/l128 0 2024-09-18T12:52:21.351 INFO:tasks.workunit.client.0.smithi045.stdout:5/682: chown d6/d28/d2b/d51/d6c/f8d 473 1 2024-09-18T12:52:21.353 INFO:tasks.workunit.client.1.smithi161.stdout:1/948: mknod d1/d71/ded/c139 0 2024-09-18T12:52:21.355 INFO:tasks.workunit.client.1.smithi161.stdout:1/949: chown d1/da/d39/f106 550056215 1 2024-09-18T12:52:21.355 INFO:tasks.workunit.client.0.smithi045.stdout:8/600: dwrite d11/d20/d60/f70 [0,4194304] 0 2024-09-18T12:52:21.355 INFO:tasks.workunit.client.0.smithi045.stdout:7/509: link d13/d44/d37/d70/d77/d6d/la0 d13/d44/d37/d6a/da3/lb4 0 2024-09-18T12:52:21.357 INFO:tasks.workunit.client.0.smithi045.stdout:7/510: truncate d13/d44/fad 595687 0 2024-09-18T12:52:21.358 INFO:tasks.workunit.client.0.smithi045.stdout:1/619: mknod d0/d2d/d6c/db3/cbc 0 2024-09-18T12:52:21.358 INFO:tasks.workunit.client.1.smithi161.stdout:7/963: dwrite d3/f11 [0,4194304] 0 2024-09-18T12:52:21.359 INFO:tasks.workunit.client.0.smithi045.stdout:1/620: readlink d0/d2d/d2b/d30/l99 0 2024-09-18T12:52:21.363 INFO:tasks.workunit.client.0.smithi045.stdout:2/610: mkdir d5/d3a/d3e/dd4 0 2024-09-18T12:52:21.366 INFO:tasks.workunit.client.0.smithi045.stdout:9/500: sync 2024-09-18T12:52:21.367 INFO:tasks.workunit.client.0.smithi045.stdout:7/511: dread d13/d1a/f41 [0,4194304] 0 2024-09-18T12:52:21.368 INFO:tasks.workunit.client.1.smithi161.stdout:7/964: link d3/d8/d15/da7/d4a/d59/f69 d3/d8/d15/da7/d24/d31/d109/f129 0 2024-09-18T12:52:21.368 INFO:tasks.workunit.client.0.smithi045.stdout:2/611: mkdir d5/d2c/d4d/d76/dd5 0 2024-09-18T12:52:21.372 INFO:tasks.workunit.client.0.smithi045.stdout:8/601: getdents d11/d7b 0 2024-09-18T12:52:21.372 INFO:tasks.workunit.client.0.smithi045.stdout:6/576: dread f5 [0,4194304] 0 2024-09-18T12:52:21.373 INFO:tasks.workunit.client.0.smithi045.stdout:1/621: dread d0/d12/da7/f28 [0,4194304] 0 2024-09-18T12:52:21.381 INFO:tasks.workunit.client.0.smithi045.stdout:6/577: symlink d9/d1a/d2d/d38/d5b/d67/lcc 0 2024-09-18T12:52:21.382 INFO:tasks.workunit.client.0.smithi045.stdout:2/612: dwrite d5/d46/f73 [0,4194304] 0 2024-09-18T12:52:21.386 INFO:tasks.workunit.client.0.smithi045.stdout:1/622: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:52:21.389 INFO:tasks.workunit.client.0.smithi045.stdout:8/602: dwrite d11/d14/d53/f4f [4194304,4194304] 0 2024-09-18T12:52:21.392 INFO:tasks.workunit.client.0.smithi045.stdout:2/613: creat d5/d5f/da8/d61/dbb/dc6/dc7/fd6 x:0 0 0 2024-09-18T12:52:21.396 INFO:tasks.workunit.client.0.smithi045.stdout:8/603: mknod d11/caa 0 2024-09-18T12:52:21.399 INFO:tasks.workunit.client.0.smithi045.stdout:2/614: symlink d5/d3a/d6b/ld7 0 2024-09-18T12:52:21.399 INFO:tasks.workunit.client.0.smithi045.stdout:8/604: chown d11/d14/f3a 1909188 1 2024-09-18T12:52:21.400 INFO:tasks.workunit.client.0.smithi045.stdout:9/501: dread d0/d3/d6/d10/d26/d2e/f3c [0,4194304] 0 2024-09-18T12:52:21.401 INFO:tasks.workunit.client.0.smithi045.stdout:5/683: write d6/db/d19/d92/f76 [1755269,16620] 0 2024-09-18T12:52:21.402 INFO:tasks.workunit.client.1.smithi161.stdout:1/950: dwrite d1/d1d/f57 [0,4194304] 0 2024-09-18T12:52:21.402 INFO:tasks.workunit.client.0.smithi045.stdout:7/512: write d13/d1a/f59 [1523087,89450] 0 2024-09-18T12:52:21.404 INFO:tasks.workunit.client.0.smithi045.stdout:8/605: fsync d11/d14/f4c 0 2024-09-18T12:52:21.408 INFO:tasks.workunit.client.0.smithi045.stdout:6/578: write d9/d1a/d2d/f78 [598034,83605] 0 2024-09-18T12:52:21.409 INFO:tasks.workunit.client.0.smithi045.stdout:7/513: chown d13/d31/d5f/d94/caa 446439 1 2024-09-18T12:52:21.409 INFO:tasks.workunit.client.0.smithi045.stdout:7/514: dread - d13/d31/d52/fb0 zero size 2024-09-18T12:52:21.409 INFO:tasks.workunit.client.0.smithi045.stdout:9/502: unlink d0/d3/d6/d64/c74 0 2024-09-18T12:52:21.409 INFO:tasks.workunit.client.1.smithi161.stdout:1/951: creat d1/dbf/f13a x:0 0 0 2024-09-18T12:52:21.410 INFO:tasks.workunit.client.0.smithi045.stdout:8/606: write d11/d20/d46/f43 [1077623,84077] 0 2024-09-18T12:52:21.410 INFO:tasks.workunit.client.0.smithi045.stdout:5/684: mknod d6/db/d5a/cd8 0 2024-09-18T12:52:21.412 INFO:tasks.workunit.client.1.smithi161.stdout:1/952: stat d1/da/d1f/d45/d73 0 2024-09-18T12:52:21.412 INFO:tasks.workunit.client.0.smithi045.stdout:5/685: dread - d6/db/fd6 zero size 2024-09-18T12:52:21.412 INFO:tasks.workunit.client.0.smithi045.stdout:2/615: symlink d5/d5f/da8/d61/dbb/ld8 0 2024-09-18T12:52:21.414 INFO:tasks.workunit.client.0.smithi045.stdout:2/616: chown d5/d5f/da8/f2e 481200 1 2024-09-18T12:52:21.415 INFO:tasks.workunit.client.0.smithi045.stdout:6/579: fsync d9/d1a/d2d/f8a 0 2024-09-18T12:52:21.415 INFO:tasks.workunit.client.0.smithi045.stdout:6/580: chown d9/f28 38086 1 2024-09-18T12:52:21.416 INFO:tasks.workunit.client.1.smithi161.stdout:1/953: write d1/da/d1f/d45/d73/fc7 [2795833,1810] 0 2024-09-18T12:52:21.416 INFO:tasks.workunit.client.0.smithi045.stdout:1/623: truncate d0/d12/d32/d67/d6a/f96 4029603 0 2024-09-18T12:52:21.418 INFO:tasks.workunit.client.0.smithi045.stdout:1/624: fdatasync d0/d12/d32/d67/d6d/f95 0 2024-09-18T12:52:21.420 INFO:tasks.workunit.client.0.smithi045.stdout:5/686: mknod d6/d28/d2b/d51/d97/cd9 0 2024-09-18T12:52:21.421 INFO:tasks.workunit.client.0.smithi045.stdout:5/687: readlink d6/db/d19/d92/d5c/lb1 0 2024-09-18T12:52:21.421 INFO:tasks.workunit.client.0.smithi045.stdout:2/617: creat d5/d5f/da8/d61/dbb/dc6/dc7/dce/fd9 x:0 0 0 2024-09-18T12:52:21.422 INFO:tasks.workunit.client.0.smithi045.stdout:2/618: dread - d5/d3a/fbe zero size 2024-09-18T12:52:21.422 INFO:tasks.workunit.client.0.smithi045.stdout:7/515: symlink d13/d44/d4c/d82/lb5 0 2024-09-18T12:52:21.425 INFO:tasks.workunit.client.0.smithi045.stdout:1/625: readlink d0/l14 0 2024-09-18T12:52:21.429 INFO:tasks.workunit.client.0.smithi045.stdout:7/516: rename d13/f6c to d13/d44/d4c/d82/fb6 0 2024-09-18T12:52:21.431 INFO:tasks.workunit.client.0.smithi045.stdout:1/626: mkdir d0/d2d/d6c/db3/dbd 0 2024-09-18T12:52:21.433 INFO:tasks.workunit.client.0.smithi045.stdout:8/607: write d11/d20/d46/f78 [742562,104658] 0 2024-09-18T12:52:21.436 INFO:tasks.workunit.client.0.smithi045.stdout:1/627: write d0/d2d/d2b/d30/f4f [3244079,127189] 0 2024-09-18T12:52:21.437 INFO:tasks.workunit.client.0.smithi045.stdout:2/619: getdents d5/d3a/d3e 0 2024-09-18T12:52:21.438 INFO:tasks.workunit.client.0.smithi045.stdout:6/581: dread d9/d1a/d2d/d38/f3d [0,4194304] 0 2024-09-18T12:52:21.440 INFO:tasks.workunit.client.1.smithi161.stdout:9/945: sync 2024-09-18T12:52:21.441 INFO:tasks.workunit.client.0.smithi045.stdout:7/517: creat d13/d44/d37/d70/fb7 x:0 0 0 2024-09-18T12:52:21.441 INFO:tasks.workunit.client.0.smithi045.stdout:1/628: dread - d0/f9a zero size 2024-09-18T12:52:21.442 INFO:tasks.workunit.client.0.smithi045.stdout:9/503: dwrite d0/d3/d6/d10/d26/d2e/f6a [0,4194304] 0 2024-09-18T12:52:21.444 INFO:tasks.workunit.client.0.smithi045.stdout:1/629: readlink d0/d2d/d2b/d30/d8b/d5b/l89 0 2024-09-18T12:52:21.447 INFO:tasks.workunit.client.0.smithi045.stdout:8/608: truncate d11/d20/d46/f78 669849 0 2024-09-18T12:52:21.448 INFO:tasks.workunit.client.0.smithi045.stdout:2/620: mknod d5/d3a/cda 0 2024-09-18T12:52:21.449 INFO:tasks.workunit.client.1.smithi161.stdout:9/946: dread d0/f29 [0,4194304] 0 2024-09-18T12:52:21.450 INFO:tasks.workunit.client.0.smithi045.stdout:9/504: creat d0/d3/d6/d64/fa0 x:0 0 0 2024-09-18T12:52:21.450 INFO:tasks.workunit.client.0.smithi045.stdout:2/621: write d5/d3a/fc9 [311559,71380] 0 2024-09-18T12:52:21.453 INFO:tasks.workunit.client.0.smithi045.stdout:8/609: creat d11/d14/d72/da9/fab x:0 0 0 2024-09-18T12:52:21.454 INFO:tasks.workunit.client.1.smithi161.stdout:9/947: creat d0/d47/d48/de7/f13f x:0 0 0 2024-09-18T12:52:21.457 INFO:tasks.workunit.client.0.smithi045.stdout:9/505: truncate d0/d3/d6/d10/d2c/f49 5886534 0 2024-09-18T12:52:21.458 INFO:tasks.workunit.client.1.smithi161.stdout:9/948: dread d0/d16/d25/d28/f73 [0,4194304] 0 2024-09-18T12:52:21.459 INFO:tasks.workunit.client.0.smithi045.stdout:2/622: dwrite d5/fb7 [0,4194304] 0 2024-09-18T12:52:21.460 INFO:tasks.workunit.client.0.smithi045.stdout:8/610: rename d11/d20/l63 to d11/d14/d53/lac 0 2024-09-18T12:52:21.460 INFO:tasks.workunit.client.1.smithi161.stdout:9/949: stat d0/d47/df1/f8e 0 2024-09-18T12:52:21.462 INFO:tasks.workunit.client.0.smithi045.stdout:7/518: dread fc [0,4194304] 0 2024-09-18T12:52:21.467 INFO:tasks.workunit.client.0.smithi045.stdout:2/623: mknod d5/d5f/da8/d61/dbb/cdb 0 2024-09-18T12:52:21.467 INFO:tasks.workunit.client.0.smithi045.stdout:2/624: readlink d5/d5f/da8/d61/lab 0 2024-09-18T12:52:21.468 INFO:tasks.workunit.client.0.smithi045.stdout:6/582: truncate d9/d1a/d48/f53 2029742 0 2024-09-18T12:52:21.469 INFO:tasks.workunit.client.0.smithi045.stdout:7/519: creat d13/d31/d33/d64/d78/d90/fb8 x:0 0 0 2024-09-18T12:52:21.472 INFO:tasks.workunit.client.0.smithi045.stdout:1/630: write d0/d12/d32/d67/d6a/faf [1426146,108973] 0 2024-09-18T12:52:21.473 INFO:tasks.workunit.client.0.smithi045.stdout:2/625: creat d5/d5f/da8/d61/dbb/dc6/fdc x:0 0 0 2024-09-18T12:52:21.477 INFO:tasks.workunit.client.0.smithi045.stdout:1/631: creat d0/d12/d32/d67/d6a/fbe x:0 0 0 2024-09-18T12:52:21.478 INFO:tasks.workunit.client.0.smithi045.stdout:6/583: link d9/d1a/d48/d8f/d9f/faf d9/d1a/d48/d75/fcd 0 2024-09-18T12:52:21.479 INFO:tasks.workunit.client.0.smithi045.stdout:6/584: fdatasync d9/d1a/d2d/f5e 0 2024-09-18T12:52:21.480 INFO:tasks.workunit.client.1.smithi161.stdout:9/950: write d0/db/fbc [783590,109348] 0 2024-09-18T12:52:21.483 INFO:tasks.workunit.client.1.smithi161.stdout:9/951: creat d0/db/d18/f140 x:0 0 0 2024-09-18T12:52:21.485 INFO:tasks.workunit.client.0.smithi045.stdout:7/520: rmdir d13/d31/d33/d9a 0 2024-09-18T12:52:21.486 INFO:tasks.workunit.client.0.smithi045.stdout:8/611: truncate d11/d23/f9d 1887853 0 2024-09-18T12:52:21.488 INFO:tasks.workunit.client.0.smithi045.stdout:7/521: creat d13/d31/d33/d64/d78/d90/fb9 x:0 0 0 2024-09-18T12:52:21.489 INFO:tasks.workunit.client.0.smithi045.stdout:7/522: chown d13/d44/d37/f4a 225 1 2024-09-18T12:52:21.493 INFO:tasks.workunit.client.1.smithi161.stdout:9/952: creat d0/d20/d74/ded/f141 x:0 0 0 2024-09-18T12:52:21.494 INFO:tasks.workunit.client.1.smithi161.stdout:9/953: write d0/d47/f118 [1688438,101616] 0 2024-09-18T12:52:21.498 INFO:tasks.workunit.client.0.smithi045.stdout:1/632: getdents d0 0 2024-09-18T12:52:21.499 INFO:tasks.workunit.client.1.smithi161.stdout:9/954: dwrite d0/f2f [4194304,4194304] 0 2024-09-18T12:52:21.502 INFO:tasks.workunit.client.0.smithi045.stdout:1/633: dread d0/d12/d32/d67/d6d/fa2 [0,4194304] 0 2024-09-18T12:52:21.503 INFO:tasks.workunit.client.1.smithi161.stdout:9/955: fdatasync d0/d47/f77 0 2024-09-18T12:52:21.506 INFO:tasks.workunit.client.0.smithi045.stdout:8/612: write d11/d14/d53/d41/d57/f4a [124149,22426] 0 2024-09-18T12:52:21.507 INFO:tasks.workunit.client.1.smithi161.stdout:9/956: symlink d0/db/d6f/l142 0 2024-09-18T12:52:21.509 INFO:tasks.workunit.client.1.smithi161.stdout:9/957: symlink d0/db/d18/l143 0 2024-09-18T12:52:21.512 INFO:tasks.workunit.client.0.smithi045.stdout:1/634: dwrite d0/d2d/d2b/f2f [0,4194304] 0 2024-09-18T12:52:21.513 INFO:tasks.workunit.client.1.smithi161.stdout:7/965: sync 2024-09-18T12:52:21.513 INFO:tasks.workunit.client.0.smithi045.stdout:7/523: dwrite d13/d1a/f41 [0,4194304] 0 2024-09-18T12:52:21.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/966: symlink d3/d8/d15/da7/d24/d31/d7d/l12a 0 2024-09-18T12:52:21.520 INFO:tasks.workunit.client.0.smithi045.stdout:7/524: creat d13/d44/d4c/fba x:0 0 0 2024-09-18T12:52:21.522 INFO:tasks.workunit.client.0.smithi045.stdout:1/635: rename d0/d12/da7/f42 to d0/d2d/d92/fbf 0 2024-09-18T12:52:21.523 INFO:tasks.workunit.client.1.smithi161.stdout:7/967: readlink d3/d8/l3f 0 2024-09-18T12:52:21.525 INFO:tasks.workunit.client.0.smithi045.stdout:1/636: mknod d0/d2d/d92/cc0 0 2024-09-18T12:52:21.526 INFO:tasks.workunit.client.0.smithi045.stdout:8/613: dread d11/d14/d53/f3e [0,4194304] 0 2024-09-18T12:52:21.527 INFO:tasks.workunit.client.1.smithi161.stdout:9/958: write d0/d47/d48/f4a [1876251,5576] 0 2024-09-18T12:52:21.527 INFO:tasks.workunit.client.0.smithi045.stdout:8/614: chown d11/c35 24171768 1 2024-09-18T12:52:21.527 INFO:tasks.workunit.client.0.smithi045.stdout:7/525: link d13/d44/d4c/f62 d13/d31/d33/d64/d78/fbb 0 2024-09-18T12:52:21.528 INFO:tasks.workunit.client.1.smithi161.stdout:7/968: dread d3/d8/d15/da7/d44/f106 [0,4194304] 0 2024-09-18T12:52:21.529 INFO:tasks.workunit.client.0.smithi045.stdout:1/637: creat d0/d2d/d2b/d30/d40/d60/d8f/fc1 x:0 0 0 2024-09-18T12:52:21.530 INFO:tasks.workunit.client.0.smithi045.stdout:8/615: chown d11/d14/d53/lac 3548712 1 2024-09-18T12:52:21.530 INFO:tasks.workunit.client.0.smithi045.stdout:8/616: stat d11/d20/d46/l40 0 2024-09-18T12:52:21.531 INFO:tasks.workunit.client.1.smithi161.stdout:9/959: mknod d0/d20/d49/d124/c144 0 2024-09-18T12:52:21.536 INFO:tasks.workunit.client.0.smithi045.stdout:7/526: getdents d13/d31/d5f 0 2024-09-18T12:52:21.536 INFO:tasks.workunit.client.0.smithi045.stdout:8/617: truncate d11/d20/d46/f78 454958 0 2024-09-18T12:52:21.536 INFO:tasks.workunit.client.0.smithi045.stdout:7/527: chown c12 0 1 2024-09-18T12:52:21.537 INFO:tasks.workunit.client.0.smithi045.stdout:8/618: chown d11/d76/da0 485453 1 2024-09-18T12:52:21.538 INFO:tasks.workunit.client.0.smithi045.stdout:1/638: dwrite d0/d2d/d2b/fbb [8388608,4194304] 0 2024-09-18T12:52:21.539 INFO:tasks.workunit.client.0.smithi045.stdout:1/639: stat d0/d2d/d2b/d30/f48 0 2024-09-18T12:52:21.541 INFO:tasks.workunit.client.1.smithi161.stdout:9/960: dwrite d0/d93/da0/f114 [0,4194304] 0 2024-09-18T12:52:21.542 INFO:tasks.workunit.client.1.smithi161.stdout:9/961: chown d0/d20/d74 4 1 2024-09-18T12:52:21.543 INFO:tasks.workunit.client.0.smithi045.stdout:8/619: read d11/d20/d46/f43 [1127388,85120] 0 2024-09-18T12:52:21.545 INFO:tasks.workunit.client.0.smithi045.stdout:7/528: dread d13/d1a/f1b [0,4194304] 0 2024-09-18T12:52:21.553 INFO:tasks.workunit.client.0.smithi045.stdout:8/620: dwrite d11/d14/d53/d41/d57/f4a [0,4194304] 0 2024-09-18T12:52:21.559 INFO:tasks.workunit.client.0.smithi045.stdout:7/529: getdents d13/d31/d52 0 2024-09-18T12:52:21.566 INFO:tasks.workunit.client.0.smithi045.stdout:7/530: creat d13/d44/d37/fbc x:0 0 0 2024-09-18T12:52:21.573 INFO:tasks.workunit.client.0.smithi045.stdout:7/531: symlink d13/lbd 0 2024-09-18T12:52:21.577 INFO:tasks.workunit.client.0.smithi045.stdout:7/532: symlink d13/d44/d37/d6a/lbe 0 2024-09-18T12:52:21.579 INFO:tasks.workunit.client.1.smithi161.stdout:1/954: sync 2024-09-18T12:52:21.595 INFO:tasks.workunit.client.0.smithi045.stdout:1/640: truncate d0/d12/d32/d67/d6a/faf 76381 0 2024-09-18T12:52:21.597 INFO:tasks.workunit.client.1.smithi161.stdout:7/969: creat d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/d89/f12b x:0 0 0 2024-09-18T12:52:21.597 INFO:tasks.workunit.client.1.smithi161.stdout:7/970: stat d3/d36 0 2024-09-18T12:52:21.599 INFO:tasks.workunit.client.0.smithi045.stdout:8/621: write fa [1912654,83359] 0 2024-09-18T12:52:21.599 INFO:tasks.workunit.client.1.smithi161.stdout:1/955: creat d1/da/d1f/dab/daf/f13b x:0 0 0 2024-09-18T12:52:21.600 INFO:tasks.workunit.client.1.smithi161.stdout:7/971: truncate d3/d36/f65 4519887 0 2024-09-18T12:52:21.601 INFO:tasks.workunit.client.0.smithi045.stdout:8/622: symlink d11/d8c/lad 0 2024-09-18T12:52:21.601 INFO:tasks.workunit.client.1.smithi161.stdout:1/956: readlink d1/d1d/l40 0 2024-09-18T12:52:21.606 INFO:tasks.workunit.client.0.smithi045.stdout:8/623: rename d11/d14/d53/d41/d57/d98/f96 to d11/d20/fae 0 2024-09-18T12:52:21.608 INFO:tasks.workunit.client.0.smithi045.stdout:8/624: creat d11/d20/d46/faf x:0 0 0 2024-09-18T12:52:21.615 INFO:tasks.workunit.client.0.smithi045.stdout:8/625: rename d11/d14/f4b to d11/d14/d72/da9/fb0 0 2024-09-18T12:52:21.616 INFO:tasks.workunit.client.0.smithi045.stdout:8/626: read d11/d20/d60/f70 [2525121,58048] 0 2024-09-18T12:52:21.624 INFO:tasks.workunit.client.0.smithi045.stdout:4/779: sync 2024-09-18T12:52:21.624 INFO:tasks.workunit.client.0.smithi045.stdout:8/627: symlink d11/d14/d53/d41/d75/lb1 0 2024-09-18T12:52:21.624 INFO:tasks.workunit.client.0.smithi045.stdout:8/628: chown d11/d23/c26 32740935 1 2024-09-18T12:52:21.628 INFO:tasks.workunit.client.0.smithi045.stdout:8/629: mknod d11/d20/d60/da3/cb2 0 2024-09-18T12:52:21.628 INFO:tasks.workunit.client.0.smithi045.stdout:8/630: readlink d11/d14/l55 0 2024-09-18T12:52:21.629 INFO:tasks.workunit.client.0.smithi045.stdout:4/780: creat db/f103 x:0 0 0 2024-09-18T12:52:21.631 INFO:tasks.workunit.client.1.smithi161.stdout:9/962: write d0/d16/d25/d28/d45/fde [415003,2044] 0 2024-09-18T12:52:21.632 INFO:tasks.workunit.client.1.smithi161.stdout:9/963: readlink d0/d47/d48/l95 0 2024-09-18T12:52:21.635 INFO:tasks.workunit.client.1.smithi161.stdout:9/964: mkdir d0/d47/d48/d88/d145 0 2024-09-18T12:52:21.636 INFO:tasks.workunit.client.1.smithi161.stdout:9/965: fdatasync d0/d47/d48/d9a/f126 0 2024-09-18T12:52:21.637 INFO:tasks.workunit.client.0.smithi045.stdout:8/631: dwrite d11/d14/d72/da9/fb0 [0,4194304] 0 2024-09-18T12:52:21.637 INFO:tasks.workunit.client.1.smithi161.stdout:1/957: write d1/da/d1f/f51 [3699073,39689] 0 2024-09-18T12:52:21.638 INFO:tasks.workunit.client.0.smithi045.stdout:4/781: link db/d2c/la6 db/d2c/dcd/l104 0 2024-09-18T12:52:21.640 INFO:tasks.workunit.client.1.smithi161.stdout:9/966: fsync d0/d16/d25/f10e 0 2024-09-18T12:52:21.641 INFO:tasks.workunit.client.1.smithi161.stdout:1/958: unlink d1/d26/fb 0 2024-09-18T12:52:21.643 INFO:tasks.workunit.client.1.smithi161.stdout:7/972: dwrite d3/f8d [0,4194304] 0 2024-09-18T12:52:21.645 INFO:tasks.workunit.client.0.smithi045.stdout:4/782: unlink db/de/d1e/fde 0 2024-09-18T12:52:21.645 INFO:tasks.workunit.client.1.smithi161.stdout:7/973: chown d3/d8/d15/da7/d4a/d64/d8c/d9f 11 1 2024-09-18T12:52:21.647 INFO:tasks.workunit.client.0.smithi045.stdout:4/783: truncate db/de/d1e/d3e/d47/d59/d7a/fea 692517 0 2024-09-18T12:52:21.648 INFO:tasks.workunit.client.0.smithi045.stdout:4/784: stat db/d20/fd6 0 2024-09-18T12:52:21.657 INFO:tasks.workunit.client.1.smithi161.stdout:7/974: creat d3/d8/d15/d99/db0/d101/f12c x:0 0 0 2024-09-18T12:52:21.659 INFO:tasks.workunit.client.0.smithi045.stdout:4/785: rename db/de/d1e/d3e/d47/d59/c102 to db/de/d1e/d3e/d47/d59/c105 0 2024-09-18T12:52:21.662 INFO:tasks.workunit.client.1.smithi161.stdout:9/967: dread d0/d93/f10f [0,4194304] 0 2024-09-18T12:52:21.662 INFO:tasks.workunit.client.0.smithi045.stdout:4/786: mkdir db/de/d1e/d3e/d47/db7/d106 0 2024-09-18T12:52:21.664 INFO:tasks.workunit.client.1.smithi161.stdout:7/975: dwrite d3/d8/d15/da7/d24/ddd/fde [4194304,4194304] 0 2024-09-18T12:52:21.665 INFO:tasks.workunit.client.1.smithi161.stdout:9/968: truncate d0/db/d18/f140 976751 0 2024-09-18T12:52:21.672 INFO:tasks.workunit.client.1.smithi161.stdout:7/976: creat d3/d8/d15/d99/db0/d101/f12d x:0 0 0 2024-09-18T12:52:21.674 INFO:tasks.workunit.client.0.smithi045.stdout:8/632: truncate d11/d14/f3a 4289548 0 2024-09-18T12:52:21.676 INFO:tasks.workunit.client.1.smithi161.stdout:7/977: rename d3/d8/d4b/ld2 to d3/d36/d102/l12e 0 2024-09-18T12:52:21.676 INFO:tasks.workunit.client.0.smithi045.stdout:4/787: dread db/de/d1e/d3e/d47/d59/d2f/f6c [0,4194304] 0 2024-09-18T12:52:21.678 INFO:tasks.workunit.client.0.smithi045.stdout:4/788: readlink db/de/d1e/d3e/d9a/da2/lf8 0 2024-09-18T12:52:21.678 INFO:tasks.workunit.client.1.smithi161.stdout:1/959: write d1/d26/f24 [363863,55746] 0 2024-09-18T12:52:21.679 INFO:tasks.workunit.client.1.smithi161.stdout:1/960: chown d1/fc 37 1 2024-09-18T12:52:21.680 INFO:tasks.workunit.client.1.smithi161.stdout:7/978: unlink d3/d8/d4f/c63 0 2024-09-18T12:52:21.684 INFO:tasks.workunit.client.0.smithi045.stdout:4/789: dwrite db/f63 [0,4194304] 0 2024-09-18T12:52:21.685 INFO:tasks.workunit.client.1.smithi161.stdout:7/979: symlink d3/d83/db6/l12f 0 2024-09-18T12:52:21.687 INFO:tasks.workunit.client.1.smithi161.stdout:7/980: mknod d3/d8/d15/da7/d24/daf/c130 0 2024-09-18T12:52:21.690 INFO:tasks.workunit.client.1.smithi161.stdout:9/969: dwrite d0/db/d18/f69 [0,4194304] 0 2024-09-18T12:52:21.690 INFO:tasks.workunit.client.0.smithi045.stdout:4/790: rename db/de/d1e/d3e/de1/d9e/lb4 to db/de/d1e/d3e/d47/db7/l107 0 2024-09-18T12:52:21.692 INFO:tasks.workunit.client.0.smithi045.stdout:4/791: truncate db/de/d1a/ff3 612665 0 2024-09-18T12:52:21.693 INFO:tasks.workunit.client.1.smithi161.stdout:7/981: rmdir d3/d8/d15/d99 39 2024-09-18T12:52:21.694 INFO:tasks.workunit.client.1.smithi161.stdout:7/982: chown d3/d8/d15/da7/d4a/d59 191663 1 2024-09-18T12:52:21.695 INFO:tasks.workunit.client.0.smithi045.stdout:4/792: write db/de/d1e/d3e/d47/d59/d7a/ffc [796584,47449] 0 2024-09-18T12:52:21.698 INFO:tasks.workunit.client.1.smithi161.stdout:1/961: write d1/fb8 [654221,30440] 0 2024-09-18T12:52:21.699 INFO:tasks.workunit.client.0.smithi045.stdout:8/633: dwrite d11/d14/d53/d41/f9a [0,4194304] 0 2024-09-18T12:52:21.702 INFO:tasks.workunit.client.1.smithi161.stdout:7/983: dwrite d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/d89/f12b [0,4194304] 0 2024-09-18T12:52:21.703 INFO:tasks.workunit.client.1.smithi161.stdout:7/984: write d3/f8d [4215563,14806] 0 2024-09-18T12:52:21.706 INFO:tasks.workunit.client.0.smithi045.stdout:4/793: dwrite db/de/d1e/d49/ff9 [0,4194304] 0 2024-09-18T12:52:21.709 INFO:tasks.workunit.client.1.smithi161.stdout:7/985: rename d3/d83/c84 to d3/d8/d15/de2/c131 0 2024-09-18T12:52:21.713 INFO:tasks.workunit.client.0.smithi045.stdout:4/794: fdatasync db/d2c/d35/d40/d77/ffa 0 2024-09-18T12:52:21.714 INFO:tasks.workunit.client.1.smithi161.stdout:9/970: write d0/d16/d25/d28/f38 [207784,6352] 0 2024-09-18T12:52:21.716 INFO:tasks.workunit.client.1.smithi161.stdout:7/986: mkdir d3/d8/d15/da7/d24/d31/d132 0 2024-09-18T12:52:21.716 INFO:tasks.workunit.client.1.smithi161.stdout:1/962: write d1/d26/d88/fb0 [636148,75146] 0 2024-09-18T12:52:21.720 INFO:tasks.workunit.client.1.smithi161.stdout:7/987: creat d3/d8/d15/de2/f133 x:0 0 0 2024-09-18T12:52:21.721 INFO:tasks.workunit.client.0.smithi045.stdout:4/795: dwrite db/de/d1e/d49/f4e [0,4194304] 0 2024-09-18T12:52:21.723 INFO:tasks.workunit.client.1.smithi161.stdout:9/971: link d0/db/lb4 d0/d47/d48/l146 0 2024-09-18T12:52:21.723 INFO:tasks.workunit.client.0.smithi045.stdout:4/796: dread - db/d2c/d35/d40/d77/fda zero size 2024-09-18T12:52:21.724 INFO:tasks.workunit.client.1.smithi161.stdout:1/963: dwrite d1/da/d1f/d6b/dd2/d10d/f130 [0,4194304] 0 2024-09-18T12:52:21.725 INFO:tasks.workunit.client.0.smithi045.stdout:4/797: rmdir db/de 39 2024-09-18T12:52:21.726 INFO:tasks.workunit.client.1.smithi161.stdout:9/972: mknod d0/d20/d49/de6/c147 0 2024-09-18T12:52:21.732 INFO:tasks.workunit.client.1.smithi161.stdout:9/973: creat d0/d16/d25/d46/f148 x:0 0 0 2024-09-18T12:52:21.733 INFO:tasks.workunit.client.1.smithi161.stdout:9/974: chown d0/d20/l10b 1 1 2024-09-18T12:52:21.733 INFO:tasks.workunit.client.0.smithi045.stdout:4/798: getdents db/d2c/d35/d40/d6d 0 2024-09-18T12:52:21.735 INFO:tasks.workunit.client.1.smithi161.stdout:9/975: fdatasync d0/f22 0 2024-09-18T12:52:21.736 INFO:tasks.workunit.client.1.smithi161.stdout:9/976: readlink d0/l1c 0 2024-09-18T12:52:21.736 INFO:tasks.workunit.client.0.smithi045.stdout:8/634: dwrite d11/d14/f52 [0,4194304] 0 2024-09-18T12:52:21.742 INFO:tasks.workunit.client.1.smithi161.stdout:9/977: mkdir d0/d47/d48/d7f/d84/d149 0 2024-09-18T12:52:21.742 INFO:tasks.workunit.client.1.smithi161.stdout:7/988: write d3/d8/d4f/fbf [503074,20665] 0 2024-09-18T12:52:21.744 INFO:tasks.workunit.client.0.smithi045.stdout:8/635: mknod d11/d14/d53/d41/d57/d98/cb3 0 2024-09-18T12:52:21.746 INFO:tasks.workunit.client.0.smithi045.stdout:4/799: mkdir db/de/d1e/d3e/d78/d100/d108 0 2024-09-18T12:52:21.748 INFO:tasks.workunit.client.0.smithi045.stdout:4/800: write db/d20/fd6 [93964,53936] 0 2024-09-18T12:52:21.748 INFO:tasks.workunit.client.1.smithi161.stdout:9/978: stat d0/d47/df1/d59/ddb/fe3 0 2024-09-18T12:52:21.749 INFO:tasks.workunit.client.0.smithi045.stdout:4/801: chown db/de/d1e/d3e/d9a/lbe 1 1 2024-09-18T12:52:21.750 INFO:tasks.workunit.client.1.smithi161.stdout:7/989: dwrite d3/d36/fad [0,4194304] 0 2024-09-18T12:52:21.752 INFO:tasks.workunit.client.0.smithi045.stdout:4/802: unlink db/de/d1e/d3e/d9a/fe4 0 2024-09-18T12:52:21.752 INFO:tasks.workunit.client.1.smithi161.stdout:7/990: write d3/d8/d15/da7/d4a/fed [1167123,8090] 0 2024-09-18T12:52:21.752 INFO:tasks.workunit.client.0.smithi045.stdout:4/803: write db/d20/d6b/fba [3352852,123631] 0 2024-09-18T12:52:21.757 INFO:tasks.workunit.client.0.smithi045.stdout:4/804: mkdir db/de/d1e/d3e/d78/d109 0 2024-09-18T12:52:21.761 INFO:tasks.workunit.client.0.smithi045.stdout:8/636: fsync d11/d14/f52 0 2024-09-18T12:52:21.768 INFO:tasks.workunit.client.0.smithi045.stdout:8/637: dwrite d11/d14/f1e [0,4194304] 0 2024-09-18T12:52:21.769 INFO:tasks.workunit.client.1.smithi161.stdout:7/991: dwrite d3/d8/f80 [8388608,4194304] 0 2024-09-18T12:52:21.771 INFO:tasks.workunit.client.0.smithi045.stdout:8/638: mknod d11/d8c/d90/cb4 0 2024-09-18T12:52:21.772 INFO:tasks.workunit.client.1.smithi161.stdout:9/979: dread d0/d16/f62 [0,4194304] 0 2024-09-18T12:52:21.773 INFO:tasks.workunit.client.0.smithi045.stdout:8/639: creat d11/d20/d60/da3/fb5 x:0 0 0 2024-09-18T12:52:21.775 INFO:tasks.workunit.client.1.smithi161.stdout:7/992: getdents d3/d8/d15 0 2024-09-18T12:52:21.776 INFO:tasks.workunit.client.1.smithi161.stdout:9/980: symlink d0/d47/d48/de7/l14a 0 2024-09-18T12:52:21.779 INFO:tasks.workunit.client.1.smithi161.stdout:9/981: write d0/d20/d49/fb5 [2764989,116282] 0 2024-09-18T12:52:21.782 INFO:tasks.workunit.client.1.smithi161.stdout:9/982: mkdir d0/d93/da0/de5/d14b 0 2024-09-18T12:52:21.783 INFO:tasks.workunit.client.1.smithi161.stdout:9/983: chown d0/d47/d48/d9a/cd7 258148 1 2024-09-18T12:52:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:21 smithi045 ceph-mon[28315]: pgmap v33: 65 pgs: 65 active+clean; 2.8 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 93 MiB/s rd, 210 MiB/s wr, 429 op/s 2024-09-18T12:52:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:21 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:21.784 INFO:tasks.workunit.client.1.smithi161.stdout:7/993: dwrite d3/d8/d15/da7/d4a/d64/d8c/f10f [0,4194304] 0 2024-09-18T12:52:21.786 INFO:tasks.workunit.client.1.smithi161.stdout:9/984: symlink d0/d20/d74/l14c 0 2024-09-18T12:52:21.787 INFO:tasks.workunit.client.1.smithi161.stdout:7/994: mknod d3/d8/d15/da7/d4a/d59/c134 0 2024-09-18T12:52:21.788 INFO:tasks.workunit.client.1.smithi161.stdout:7/995: write d3/d36/fad [2068024,100865] 0 2024-09-18T12:52:21.790 INFO:tasks.workunit.client.0.smithi045.stdout:8/640: write d11/d20/f71 [1273800,50302] 0 2024-09-18T12:52:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:21 smithi161 ceph-mon[35784]: pgmap v33: 65 pgs: 65 active+clean; 2.8 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 93 MiB/s rd, 210 MiB/s wr, 429 op/s 2024-09-18T12:52:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:21 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:21.795 INFO:tasks.workunit.client.0.smithi045.stdout:8/641: creat d11/d8c/d90/fb6 x:0 0 0 2024-09-18T12:52:21.795 INFO:tasks.workunit.client.1.smithi161.stdout:7/996: getdents d3/d8/d15/da7/d4a/d64 0 2024-09-18T12:52:21.797 INFO:tasks.workunit.client.0.smithi045.stdout:8/642: mknod d11/d14/d53/d41/d75/cb7 0 2024-09-18T12:52:21.798 INFO:tasks.workunit.client.1.smithi161.stdout:7/997: truncate d3/d8/d15/da7/d24/d31/d109/f10d 693776 0 2024-09-18T12:52:21.798 INFO:tasks.workunit.client.1.smithi161.stdout:7/998: stat d3/d50 0 2024-09-18T12:52:21.801 INFO:tasks.workunit.client.1.smithi161.stdout:7/999: symlink d3/d8/d15/da7/d4a/d64/d8c/d9f/d77/l135 0 2024-09-18T12:52:21.802 INFO:tasks.workunit.client.0.smithi045.stdout:8/643: write d11/f13 [3302198,122245] 0 2024-09-18T12:52:21.805 INFO:tasks.workunit.client.0.smithi045.stdout:8/644: link d11/f13 d11/d14/d53/d41/d57/d98/fb8 0 2024-09-18T12:52:21.807 INFO:tasks.workunit.client.0.smithi045.stdout:8/645: getdents d11/d7b 0 2024-09-18T12:52:21.807 INFO:tasks.workunit.client.1.smithi161.stdout:9/985: dread d0/d47/d48/d9a/f9d [0,4194304] 0 2024-09-18T12:52:21.808 INFO:tasks.workunit.client.0.smithi045.stdout:8/646: symlink d11/d7b/lb9 0 2024-09-18T12:52:21.810 INFO:tasks.workunit.client.0.smithi045.stdout:8/647: creat d11/d14/d53/d41/d75/fba x:0 0 0 2024-09-18T12:52:21.811 INFO:tasks.workunit.client.0.smithi045.stdout:8/648: write d11/d14/f36 [1801213,19817] 0 2024-09-18T12:52:21.812 INFO:tasks.workunit.client.0.smithi045.stdout:8/649: truncate d11/d14/d53/f3e 3042750 0 2024-09-18T12:52:21.816 INFO:tasks.workunit.client.0.smithi045.stdout:8/650: link d11/d14/d72/da9/fb0 d11/d14/d53/d41/d75/fbb 0 2024-09-18T12:52:21.817 INFO:tasks.workunit.client.1.smithi161.stdout:9/986: write d0/d20/d74/fea [69422,37990] 0 2024-09-18T12:52:21.817 INFO:tasks.workunit.client.0.smithi045.stdout:8/651: read d11/d14/d53/d41/f7c [880825,76839] 0 2024-09-18T12:52:21.818 INFO:tasks.workunit.client.0.smithi045.stdout:8/652: readlink d11/d14/d53/d41/d57/l67 0 2024-09-18T12:52:21.818 INFO:tasks.workunit.client.1.smithi161.stdout:9/987: creat d0/d47/f14d x:0 0 0 2024-09-18T12:52:21.819 INFO:tasks.workunit.client.0.smithi045.stdout:8/653: mknod d11/d14/d72/da9/cbc 0 2024-09-18T12:52:21.821 INFO:tasks.workunit.client.0.smithi045.stdout:8/654: unlink d11/d14/c86 0 2024-09-18T12:52:21.822 INFO:tasks.workunit.client.1.smithi161.stdout:9/988: getdents d0/d93/da0 0 2024-09-18T12:52:21.823 INFO:tasks.workunit.client.0.smithi045.stdout:8/655: mkdir d11/d14/d53/d41/d57/dbd 0 2024-09-18T12:52:21.823 INFO:tasks.workunit.client.1.smithi161.stdout:9/989: symlink d0/dd4/l14e 0 2024-09-18T12:52:21.824 INFO:tasks.workunit.client.1.smithi161.stdout:9/990: stat d0/d47/d48/d88 0 2024-09-18T12:52:21.826 INFO:tasks.workunit.client.1.smithi161.stdout:9/991: creat d0/d16/d25/d86/df4/f14f x:0 0 0 2024-09-18T12:52:21.826 INFO:tasks.workunit.client.1.smithi161.stdout:9/992: chown d0/db/d18/d121 2 1 2024-09-18T12:52:21.826 INFO:tasks.workunit.client.0.smithi045.stdout:8/656: dread d11/d14/f4c [0,4194304] 0 2024-09-18T12:52:21.827 INFO:tasks.workunit.client.1.smithi161.stdout:9/993: fsync d0/d93/da0/fff 0 2024-09-18T12:52:21.827 INFO:tasks.workunit.client.1.smithi161.stdout:9/994: readlink d0/d47/df1/d59/lef 0 2024-09-18T12:52:21.828 INFO:tasks.workunit.client.0.smithi045.stdout:8/657: chown d11/f5f 1 1 2024-09-18T12:52:21.828 INFO:tasks.workunit.client.0.smithi045.stdout:8/658: chown d11/d14/d72/l93 1911986 1 2024-09-18T12:52:21.828 INFO:tasks.workunit.client.0.smithi045.stdout:8/659: readlink d11/d20/d46/l68 0 2024-09-18T12:52:21.830 INFO:tasks.workunit.client.1.smithi161.stdout:9/995: unlink d0/d16/f76 0 2024-09-18T12:52:21.830 INFO:tasks.workunit.client.0.smithi045.stdout:8/660: readlink d11/d20/d46/l7e 0 2024-09-18T12:52:21.832 INFO:tasks.workunit.client.1.smithi161.stdout:9/996: creat d0/d47/d130/f150 x:0 0 0 2024-09-18T12:52:21.833 INFO:tasks.workunit.client.0.smithi045.stdout:8/661: symlink d11/d23/lbe 0 2024-09-18T12:52:21.833 INFO:tasks.workunit.client.1.smithi161.stdout:9/997: truncate d0/d20/d74/fea 330659 0 2024-09-18T12:52:21.833 INFO:tasks.workunit.client.1.smithi161.stdout:9/998: readlink d0/d16/l58 0 2024-09-18T12:52:21.834 INFO:tasks.workunit.client.0.smithi045.stdout:8/662: symlink d11/d8c/d90/lbf 0 2024-09-18T12:52:21.836 INFO:tasks.workunit.client.1.smithi161.stdout:9/999: unlink d0/d20/d49/f14 0 2024-09-18T12:52:21.838 INFO:tasks.workunit.client.0.smithi045.stdout:8/663: creat d11/d14/d53/d41/d75/fc0 x:0 0 0 2024-09-18T12:52:21.841 INFO:tasks.workunit.client.0.smithi045.stdout:8/664: rename f9 to d11/d8c/d90/fc1 0 2024-09-18T12:52:21.847 INFO:tasks.workunit.client.0.smithi045.stdout:8/665: dwrite f6 [0,4194304] 0 2024-09-18T12:52:21.848 INFO:tasks.workunit.client.0.smithi045.stdout:8/666: write d11/d7b/fa5 [321301,61397] 0 2024-09-18T12:52:21.854 INFO:tasks.workunit.client.0.smithi045.stdout:0/597: sync 2024-09-18T12:52:21.854 INFO:tasks.workunit.client.0.smithi045.stdout:3/531: sync 2024-09-18T12:52:21.864 INFO:tasks.workunit.client.0.smithi045.stdout:3/532: truncate d0/d1e/d2c/d3a/f6d 977970 0 2024-09-18T12:52:21.868 INFO:tasks.workunit.client.0.smithi045.stdout:8/667: dwrite d11/d20/f3c [0,4194304] 0 2024-09-18T12:52:21.869 INFO:tasks.workunit.client.0.smithi045.stdout:0/598: dread d6/d7/fa [0,4194304] 0 2024-09-18T12:52:21.872 INFO:tasks.workunit.client.0.smithi045.stdout:3/533: rename d0/d22/f28 to d0/d29/d5f/fb3 0 2024-09-18T12:52:21.873 INFO:tasks.workunit.client.0.smithi045.stdout:8/668: write d11/d20/fae [338115,26871] 0 2024-09-18T12:52:21.874 INFO:tasks.workunit.client.0.smithi045.stdout:8/669: readlink d11/d14/d53/d41/l6e 0 2024-09-18T12:52:21.875 INFO:tasks.workunit.client.0.smithi045.stdout:0/599: read d6/d48/d5e/d39/d58/d3b/d65/f7a [694708,92424] 0 2024-09-18T12:52:21.877 INFO:tasks.workunit.client.0.smithi045.stdout:8/670: creat d11/d14/d72/da9/fc2 x:0 0 0 2024-09-18T12:52:21.877 INFO:tasks.workunit.client.0.smithi045.stdout:0/600: mkdir d6/daa 0 2024-09-18T12:52:21.878 INFO:tasks.workunit.client.0.smithi045.stdout:0/601: readlink d6/l84 0 2024-09-18T12:52:21.880 INFO:tasks.workunit.client.0.smithi045.stdout:8/671: rename d11/d14/d53/d41/d57 to d11/d20/d60/dc3 0 2024-09-18T12:52:21.881 INFO:tasks.workunit.client.0.smithi045.stdout:0/602: mknod d6/d48/d5e/d39/d58/d66/cab 0 2024-09-18T12:52:21.883 INFO:tasks.workunit.client.0.smithi045.stdout:8/672: symlink d11/d14/d72/da9/lc4 0 2024-09-18T12:52:21.885 INFO:tasks.workunit.client.0.smithi045.stdout:0/603: rename d6/d48/f5c to d6/d48/d5e/d39/d58/d3b/d6b/fac 0 2024-09-18T12:52:21.886 INFO:tasks.workunit.client.0.smithi045.stdout:8/673: mkdir d11/d14/d72/da9/dc5 0 2024-09-18T12:52:21.887 INFO:tasks.workunit.client.0.smithi045.stdout:8/674: stat d11/d20/d46/f51 0 2024-09-18T12:52:21.888 INFO:tasks.workunit.client.0.smithi045.stdout:0/604: creat d6/d48/d5e/d39/d58/d86/fad x:0 0 0 2024-09-18T12:52:21.889 INFO:tasks.workunit.client.0.smithi045.stdout:0/605: chown d6/d35/d92 26742431 1 2024-09-18T12:52:21.889 INFO:tasks.workunit.client.0.smithi045.stdout:8/675: mkdir d11/d20/d46/dc6 0 2024-09-18T12:52:21.892 INFO:tasks.workunit.client.0.smithi045.stdout:8/676: mknod d11/d76/da0/da1/cc7 0 2024-09-18T12:52:21.893 INFO:tasks.workunit.client.0.smithi045.stdout:3/534: dread d0/d1e/d91/d95/fa2 [0,4194304] 0 2024-09-18T12:52:21.893 INFO:tasks.workunit.client.0.smithi045.stdout:0/606: creat d6/d7/fae x:0 0 0 2024-09-18T12:52:21.894 INFO:tasks.workunit.client.0.smithi045.stdout:8/677: symlink d11/d76/lc8 0 2024-09-18T12:52:21.899 INFO:tasks.workunit.client.0.smithi045.stdout:0/607: dread d6/d48/d5e/d39/d58/d3c/f46 [0,4194304] 0 2024-09-18T12:52:21.900 INFO:tasks.workunit.client.0.smithi045.stdout:3/535: dwrite d0/d1e/d2c/f82 [0,4194304] 0 2024-09-18T12:52:21.903 INFO:tasks.workunit.client.0.smithi045.stdout:0/608: rmdir d6/d48/d5e/d39/d58/d3b/d65 39 2024-09-18T12:52:21.908 INFO:tasks.workunit.client.0.smithi045.stdout:3/536: dwrite d0/d1e/d2c/f42 [4194304,4194304] 0 2024-09-18T12:52:21.910 INFO:tasks.workunit.client.0.smithi045.stdout:3/537: symlink d0/d1e/lb4 0 2024-09-18T12:52:21.914 INFO:tasks.workunit.client.0.smithi045.stdout:0/609: write d6/d48/d5e/f30 [2125738,75155] 0 2024-09-18T12:52:21.917 INFO:tasks.workunit.client.0.smithi045.stdout:0/610: getdents d6/d48/d5e/d39/d58/d86 0 2024-09-18T12:52:21.919 INFO:tasks.workunit.client.0.smithi045.stdout:0/611: rename d6/d35/c3a to d6/d48/caf 0 2024-09-18T12:52:21.920 INFO:tasks.workunit.client.0.smithi045.stdout:0/612: fsync d6/d48/d5e/d39/d58/d86/f8f 0 2024-09-18T12:52:21.922 INFO:tasks.workunit.client.0.smithi045.stdout:0/613: creat d6/d48/d5e/d39/fb0 x:0 0 0 2024-09-18T12:52:21.923 INFO:tasks.workunit.client.0.smithi045.stdout:0/614: rmdir d6/d48/d5e/d39/d58/d66 39 2024-09-18T12:52:21.926 INFO:tasks.workunit.client.0.smithi045.stdout:0/615: read f4 [281936,33033] 0 2024-09-18T12:52:21.931 INFO:tasks.workunit.client.0.smithi045.stdout:0/616: dwrite d6/d48/d5e/d39/d58/f59 [4194304,4194304] 0 2024-09-18T12:52:21.934 INFO:tasks.workunit.client.0.smithi045.stdout:0/617: mknod d6/d7/d32/d9b/cb1 0 2024-09-18T12:52:21.936 INFO:tasks.workunit.client.0.smithi045.stdout:0/618: mkdir d6/daa/db2 0 2024-09-18T12:52:21.938 INFO:tasks.workunit.client.0.smithi045.stdout:0/619: creat d6/d48/d5e/d39/d58/d3b/d6b/fb3 x:0 0 0 2024-09-18T12:52:21.944 INFO:tasks.workunit.client.0.smithi045.stdout:0/620: dwrite d6/d7/f42 [4194304,4194304] 0 2024-09-18T12:52:21.946 INFO:tasks.workunit.client.0.smithi045.stdout:0/621: dread d6/d48/d5e/f78 [0,4194304] 0 2024-09-18T12:52:21.949 INFO:tasks.workunit.client.0.smithi045.stdout:0/622: mknod d6/daa/db2/cb4 0 2024-09-18T12:52:21.950 INFO:tasks.workunit.client.0.smithi045.stdout:0/623: chown d6/d7/d32/c57 3640444 1 2024-09-18T12:52:21.951 INFO:tasks.workunit.client.0.smithi045.stdout:0/624: fdatasync d6/d48/d5e/d39/d58/d3b/d6b/fb3 0 2024-09-18T12:52:21.954 INFO:tasks.workunit.client.0.smithi045.stdout:0/625: mkdir d6/d48/d5e/d39/d58/db5 0 2024-09-18T12:52:21.956 INFO:tasks.workunit.client.0.smithi045.stdout:0/626: mknod d6/d48/d5e/d39/d58/d3b/cb6 0 2024-09-18T12:52:21.957 INFO:tasks.workunit.client.1.smithi161.stdout:1/964: sync 2024-09-18T12:52:21.960 INFO:tasks.workunit.client.0.smithi045.stdout:0/627: read d6/d7/d32/f33 [527165,95431] 0 2024-09-18T12:52:21.960 INFO:tasks.workunit.client.0.smithi045.stdout:0/628: fsync d6/d7/f29 0 2024-09-18T12:52:21.962 INFO:tasks.workunit.client.1.smithi161.stdout:1/965: dwrite d1/da/d1f/f2c [0,4194304] 0 2024-09-18T12:52:21.962 INFO:tasks.workunit.client.0.smithi045.stdout:0/629: creat d6/d48/d5e/d39/d58/d3c/fb7 x:0 0 0 2024-09-18T12:52:21.963 INFO:tasks.workunit.client.1.smithi161.stdout:1/966: truncate d1/fb8 1082986 0 2024-09-18T12:52:21.965 INFO:tasks.workunit.client.1.smithi161.stdout:1/967: symlink d1/d48/l13c 0 2024-09-18T12:52:21.966 INFO:tasks.workunit.client.1.smithi161.stdout:1/968: write d1/fba [3623950,75017] 0 2024-09-18T12:52:21.969 INFO:tasks.workunit.client.1.smithi161.stdout:1/969: unlink d1/da/d1f/d45/d73/f92 0 2024-09-18T12:52:21.970 INFO:tasks.workunit.client.1.smithi161.stdout:1/970: dread - d1/da/d1f/d45/d73/f11b zero size 2024-09-18T12:52:21.974 INFO:tasks.workunit.client.0.smithi045.stdout:0/630: dread d6/d48/d5e/d39/d58/d3c/f47 [0,4194304] 0 2024-09-18T12:52:21.977 INFO:tasks.workunit.client.0.smithi045.stdout:0/631: creat d6/d48/d5e/d39/d58/d3c/d69/fb8 x:0 0 0 2024-09-18T12:52:22.097 INFO:tasks.workunit.client.0.smithi045.stdout:5/688: sync 2024-09-18T12:52:22.097 INFO:tasks.workunit.client.0.smithi045.stdout:5/689: readlink d6/db/d54/lba 0 2024-09-18T12:52:22.099 INFO:tasks.workunit.client.0.smithi045.stdout:5/690: unlink d6/d28/c37 0 2024-09-18T12:52:22.099 INFO:tasks.workunit.client.0.smithi045.stdout:5/691: stat d6/db/d54 0 2024-09-18T12:52:22.101 INFO:tasks.workunit.client.0.smithi045.stdout:5/692: write d6/db/f2c [1159037,118944] 0 2024-09-18T12:52:22.104 INFO:tasks.workunit.client.0.smithi045.stdout:5/693: dread d6/db/f50 [0,4194304] 0 2024-09-18T12:52:22.108 INFO:tasks.workunit.client.0.smithi045.stdout:5/694: dread d6/db/d5a/d78/d66/fbe [0,4194304] 0 2024-09-18T12:52:22.109 INFO:tasks.workunit.client.0.smithi045.stdout:5/695: chown d6/d28/f88 11331082 1 2024-09-18T12:52:22.112 INFO:tasks.workunit.client.0.smithi045.stdout:5/696: truncate d6/db/d5a/d78/d66/f69 1086395 0 2024-09-18T12:52:22.113 INFO:tasks.workunit.client.0.smithi045.stdout:5/697: rmdir d6/dc7 39 2024-09-18T12:52:22.118 INFO:tasks.workunit.client.0.smithi045.stdout:5/698: rename d6/db/d19/d92/c20 to d6/d28/d2b/d51/cda 0 2024-09-18T12:52:22.123 INFO:tasks.workunit.client.1.smithi161.stdout:1/971: sync 2024-09-18T12:52:22.127 INFO:tasks.workunit.client.1.smithi161.stdout:1/972: link d1/f62 d1/da/d1f/f13d 0 2024-09-18T12:52:22.130 INFO:tasks.workunit.client.1.smithi161.stdout:1/973: fdatasync d1/d26/f7 0 2024-09-18T12:52:22.133 INFO:tasks.workunit.client.0.smithi045.stdout:5/699: dwrite d6/d3e/f3f [4194304,4194304] 0 2024-09-18T12:52:22.133 INFO:tasks.workunit.client.1.smithi161.stdout:1/974: creat d1/da/d1f/d45/f13e x:0 0 0 2024-09-18T12:52:22.136 INFO:tasks.workunit.client.0.smithi045.stdout:5/700: fdatasync d6/d28/d2b/d51/fb7 0 2024-09-18T12:52:22.137 INFO:tasks.workunit.client.1.smithi161.stdout:1/975: mknod d1/daa/c13f 0 2024-09-18T12:52:22.138 INFO:tasks.workunit.client.0.smithi045.stdout:5/701: symlink d6/db/d54/dd5/ldb 0 2024-09-18T12:52:22.139 INFO:tasks.workunit.client.0.smithi045.stdout:5/702: chown d6/db/d19/d92/d5c 10744 1 2024-09-18T12:52:22.140 INFO:tasks.workunit.client.1.smithi161.stdout:1/976: creat d1/da/d1f/dab/daf/de8/f140 x:0 0 0 2024-09-18T12:52:22.152 INFO:tasks.workunit.client.0.smithi045.stdout:5/703: truncate d6/db/d19/d92/f60 3054861 0 2024-09-18T12:52:22.156 INFO:tasks.workunit.client.1.smithi161.stdout:1/977: dread d1/da/d1f/dab/daf/de8/d118/f69 [0,4194304] 0 2024-09-18T12:52:22.157 INFO:tasks.workunit.client.1.smithi161.stdout:1/978: write d1/f15 [3858694,94350] 0 2024-09-18T12:52:22.158 INFO:tasks.workunit.client.0.smithi045.stdout:5/704: truncate d6/d28/d2b/f2d 188836 0 2024-09-18T12:52:22.160 INFO:tasks.workunit.client.1.smithi161.stdout:1/979: mkdir d1/da/d1f/d6b/d11f/d141 0 2024-09-18T12:52:22.166 INFO:tasks.workunit.client.1.smithi161.stdout:1/980: dwrite d1/d1d/fe0 [0,4194304] 0 2024-09-18T12:52:22.168 INFO:tasks.workunit.client.1.smithi161.stdout:1/981: truncate d1/da/d1f/dab/daf/de8/d118/f69 4872696 0 2024-09-18T12:52:22.173 INFO:tasks.workunit.client.1.smithi161.stdout:1/982: rmdir d1/da/d1f/d6b/d11f/d141 0 2024-09-18T12:52:22.174 INFO:tasks.workunit.client.1.smithi161.stdout:1/983: fsync d1/da/d1f/d45/d73/f107 0 2024-09-18T12:52:22.177 INFO:tasks.workunit.client.1.smithi161.stdout:1/984: rename d1/da/d1f/d6b/l12a to d1/da/d31/l142 0 2024-09-18T12:52:22.179 INFO:tasks.workunit.client.1.smithi161.stdout:1/985: symlink d1/da/d1f/d6b/dd2/d10d/l143 0 2024-09-18T12:52:22.180 INFO:tasks.workunit.client.1.smithi161.stdout:1/986: write d1/d26/f24 [312935,115418] 0 2024-09-18T12:52:22.182 INFO:tasks.workunit.client.0.smithi045.stdout:5/705: dread d6/dc7/fca [0,4194304] 0 2024-09-18T12:52:22.182 INFO:tasks.workunit.client.1.smithi161.stdout:1/987: mknod d1/da/d1f/d45/c144 0 2024-09-18T12:52:22.183 INFO:tasks.workunit.client.1.smithi161.stdout:1/988: stat d1/d48/c136 0 2024-09-18T12:52:22.184 INFO:tasks.workunit.client.0.smithi045.stdout:5/706: mkdir d6/db/d19/dbc/ddc 0 2024-09-18T12:52:22.186 INFO:tasks.workunit.client.0.smithi045.stdout:5/707: creat d6/db/d19/dbc/fdd x:0 0 0 2024-09-18T12:52:22.188 INFO:tasks.workunit.client.1.smithi161.stdout:1/989: rename d1/da/d9d/c11a to d1/da/d1f/d45/c145 0 2024-09-18T12:52:22.190 INFO:tasks.workunit.client.1.smithi161.stdout:1/990: symlink d1/d71/l146 0 2024-09-18T12:52:22.190 INFO:tasks.workunit.client.1.smithi161.stdout:1/991: chown d1/d1d/l40 45539292 1 2024-09-18T12:52:22.190 INFO:tasks.workunit.client.1.smithi161.stdout:1/992: chown d1/da/d31/f91 2088686 1 2024-09-18T12:52:22.192 INFO:tasks.workunit.client.1.smithi161.stdout:1/993: symlink d1/d1d/l147 0 2024-09-18T12:52:22.194 INFO:tasks.workunit.client.1.smithi161.stdout:1/994: creat d1/d26/dad/db6/f148 x:0 0 0 2024-09-18T12:52:22.194 INFO:tasks.workunit.client.0.smithi045.stdout:9/506: sync 2024-09-18T12:52:22.194 INFO:tasks.workunit.client.0.smithi045.stdout:2/626: sync 2024-09-18T12:52:22.195 INFO:tasks.workunit.client.1.smithi161.stdout:1/995: rmdir d1/d26/d88 39 2024-09-18T12:52:22.196 INFO:tasks.workunit.client.0.smithi045.stdout:2/627: unlink d5/d5f/da8/d61/fb8 0 2024-09-18T12:52:22.199 INFO:tasks.workunit.client.1.smithi161.stdout:1/996: dread d1/d26/d3a/f4f [0,4194304] 0 2024-09-18T12:52:22.200 INFO:tasks.workunit.client.0.smithi045.stdout:9/507: creat d0/d3/d6/d10/d26/fa1 x:0 0 0 2024-09-18T12:52:22.205 INFO:tasks.workunit.client.1.smithi161.stdout:1/997: dwrite d1/f15 [0,4194304] 0 2024-09-18T12:52:22.207 INFO:tasks.workunit.client.1.smithi161.stdout:1/998: mkdir d1/d1d/d149 0 2024-09-18T12:52:22.209 INFO:tasks.workunit.client.0.smithi045.stdout:9/508: write d0/d3/d6/d10/d26/d2e/f32 [1712781,26027] 0 2024-09-18T12:52:22.215 INFO:tasks.workunit.client.0.smithi045.stdout:2/628: dwrite d5/d46/f8e [0,4194304] 0 2024-09-18T12:52:22.216 INFO:tasks.workunit.client.0.smithi045.stdout:2/629: chown d5/d2c/d4d/d76/cca 305437122 1 2024-09-18T12:52:22.217 INFO:tasks.workunit.client.0.smithi045.stdout:9/509: write d0/f66 [1795587,57315] 0 2024-09-18T12:52:22.219 INFO:tasks.workunit.client.0.smithi045.stdout:2/630: dread - d5/d5f/fcc zero size 2024-09-18T12:52:22.220 INFO:tasks.workunit.client.0.smithi045.stdout:9/510: symlink d0/d3/d6/d10/d26/d2e/d4e/la2 0 2024-09-18T12:52:22.224 INFO:tasks.workunit.client.0.smithi045.stdout:9/511: write d0/d3/d6/d10/f1b [4155900,101101] 0 2024-09-18T12:52:22.225 INFO:tasks.workunit.client.0.smithi045.stdout:9/512: truncate d0/d3/d6/d10/f29 2673424 0 2024-09-18T12:52:22.228 INFO:tasks.workunit.client.0.smithi045.stdout:9/513: rename d0/d3/c39 to d0/d3/d6/d10/d26/d2e/d4e/d76/ca3 0 2024-09-18T12:52:22.230 INFO:tasks.workunit.client.0.smithi045.stdout:9/514: mkdir d0/d3/d6/d10/d26/da4 0 2024-09-18T12:52:22.232 INFO:tasks.workunit.client.0.smithi045.stdout:9/515: mkdir d0/d3/d6/d10/d26/d2e/d6f/da5 0 2024-09-18T12:52:22.234 INFO:tasks.workunit.client.0.smithi045.stdout:9/516: mknod d0/d3/d6/d9d/ca6 0 2024-09-18T12:52:22.235 INFO:tasks.workunit.client.0.smithi045.stdout:9/517: chown d0/d3/d6/d10/c75 2269 1 2024-09-18T12:52:22.236 INFO:tasks.workunit.client.0.smithi045.stdout:2/631: dwrite d5/d5f/da8/d61/dbb/fcd [0,4194304] 0 2024-09-18T12:52:22.239 INFO:tasks.workunit.client.0.smithi045.stdout:9/518: mknod d0/d3/d6/d10/d26/d2e/d6f/ca7 0 2024-09-18T12:52:22.239 INFO:tasks.workunit.client.0.smithi045.stdout:2/632: creat d5/d2c/d6f/d9d/fdd x:0 0 0 2024-09-18T12:52:22.247 INFO:tasks.workunit.client.0.smithi045.stdout:2/633: dwrite d5/d2c/d6f/d9d/fb0 [0,4194304] 0 2024-09-18T12:52:22.254 INFO:tasks.workunit.client.0.smithi045.stdout:9/519: dwrite d0/f5c [0,4194304] 0 2024-09-18T12:52:22.255 INFO:tasks.workunit.client.0.smithi045.stdout:9/520: chown d0/d3/d6/d10/d26/l6b 14853 1 2024-09-18T12:52:22.257 INFO:tasks.workunit.client.0.smithi045.stdout:2/634: truncate d5/d5f/db2/f69 1998893 0 2024-09-18T12:52:22.258 INFO:tasks.workunit.client.0.smithi045.stdout:2/635: fsync d5/d5f/da8/fa1 0 2024-09-18T12:52:22.263 INFO:tasks.workunit.client.0.smithi045.stdout:2/636: dread d5/d2c/d4d/d76/d93/fa4 [0,4194304] 0 2024-09-18T12:52:22.264 INFO:tasks.workunit.client.0.smithi045.stdout:2/637: mkdir d5/d5f/da8/dde 0 2024-09-18T12:52:22.265 INFO:tasks.workunit.client.0.smithi045.stdout:2/638: readlink d5/d2c/l2f 0 2024-09-18T12:52:22.265 INFO:tasks.workunit.client.0.smithi045.stdout:2/639: readlink d5/d5f/da8/d61/l7b 0 2024-09-18T12:52:22.266 INFO:tasks.workunit.client.1.smithi161.stdout:1/999: sync 2024-09-18T12:52:22.268 INFO:tasks.workunit.client.0.smithi045.stdout:2/640: link d5/d3a/c44 d5/d3a/d6b/cdf 0 2024-09-18T12:52:22.269 INFO:tasks.workunit.client.0.smithi045.stdout:2/641: dread - d5/d5f/da8/d61/dbb/dc6/dc7/fd6 zero size 2024-09-18T12:52:22.269 INFO:tasks.workunit.client.1.smithi161.stderr:+ rm -rf -- ./tmp.23ogfvswIo 2024-09-18T12:52:22.270 INFO:tasks.workunit.client.0.smithi045.stdout:2/642: mkdir d5/d46/de0 0 2024-09-18T12:52:22.272 INFO:tasks.workunit.client.0.smithi045.stdout:2/643: mknod d5/d2c/d4d/d76/dd5/ce1 0 2024-09-18T12:52:22.273 INFO:tasks.workunit.client.0.smithi045.stdout:2/644: stat d5/d5f/da8/d61/dbb/ld8 0 2024-09-18T12:52:22.274 INFO:tasks.workunit.client.0.smithi045.stdout:7/533: sync 2024-09-18T12:52:22.274 INFO:tasks.workunit.client.0.smithi045.stdout:6/585: sync 2024-09-18T12:52:22.274 INFO:tasks.workunit.client.0.smithi045.stdout:1/641: sync 2024-09-18T12:52:22.274 INFO:tasks.workunit.client.0.smithi045.stdout:0/632: sync 2024-09-18T12:52:22.274 INFO:tasks.workunit.client.0.smithi045.stdout:8/678: sync 2024-09-18T12:52:22.274 INFO:tasks.workunit.client.0.smithi045.stdout:3/538: sync 2024-09-18T12:52:22.274 INFO:tasks.workunit.client.0.smithi045.stdout:4/805: sync 2024-09-18T12:52:22.281 INFO:tasks.workunit.client.0.smithi045.stdout:7/534: unlink d13/d1a/d9b/fb3 0 2024-09-18T12:52:22.287 INFO:tasks.workunit.client.0.smithi045.stdout:4/806: dread db/de/f6a [0,4194304] 0 2024-09-18T12:52:22.287 INFO:tasks.workunit.client.0.smithi045.stdout:9/521: dwrite d0/d3/d6/d10/d2c/f49 [0,4194304] 0 2024-09-18T12:52:22.288 INFO:tasks.workunit.client.0.smithi045.stdout:1/642: rename d0/d2d/f90 to d0/d2d/fc2 0 2024-09-18T12:52:22.289 INFO:tasks.workunit.client.0.smithi045.stdout:3/539: dwrite d0/d22/f26 [0,4194304] 0 2024-09-18T12:52:22.292 INFO:tasks.workunit.client.0.smithi045.stdout:9/522: stat d0/d3/d6/c55 0 2024-09-18T12:52:22.293 INFO:tasks.workunit.client.0.smithi045.stdout:2/645: link d5/d5f/da8/f2e d5/d5f/da8/fe2 0 2024-09-18T12:52:22.293 INFO:tasks.workunit.client.0.smithi045.stdout:1/643: write d0/d2d/d6c/f8c [1354834,92750] 0 2024-09-18T12:52:22.295 INFO:tasks.workunit.client.0.smithi045.stdout:0/633: rename d6/d7/d32/da9 to d6/d48/d5e/d39/d58/d86/db9 0 2024-09-18T12:52:22.295 INFO:tasks.workunit.client.0.smithi045.stdout:2/646: chown d5/d2c/l2f 205430627 1 2024-09-18T12:52:22.296 INFO:tasks.workunit.client.0.smithi045.stdout:0/634: fsync d6/d35/f72 0 2024-09-18T12:52:22.298 INFO:tasks.workunit.client.0.smithi045.stdout:8/679: dread d11/d14/d53/f4f [0,4194304] 0 2024-09-18T12:52:22.299 INFO:tasks.workunit.client.0.smithi045.stdout:2/647: chown d5/d2c/d6f/d9d/fdd 1 1 2024-09-18T12:52:22.299 INFO:tasks.workunit.client.0.smithi045.stdout:5/708: sync 2024-09-18T12:52:22.301 INFO:tasks.workunit.client.0.smithi045.stdout:5/709: write d6/db/d5a/d78/d66/f74 [3823029,98799] 0 2024-09-18T12:52:22.301 INFO:tasks.workunit.client.0.smithi045.stdout:9/523: unlink d0/d3/d6/f71 0 2024-09-18T12:52:22.303 INFO:tasks.workunit.client.0.smithi045.stdout:1/644: symlink d0/lc3 0 2024-09-18T12:52:22.307 INFO:tasks.workunit.client.0.smithi045.stdout:6/586: write d9/d1a/d48/f53 [2610817,39130] 0 2024-09-18T12:52:22.310 INFO:tasks.workunit.client.0.smithi045.stdout:5/710: unlink d6/db/d70/fc1 0 2024-09-18T12:52:22.313 INFO:tasks.workunit.client.0.smithi045.stdout:6/587: rmdir d9/d56 39 2024-09-18T12:52:22.315 INFO:tasks.workunit.client.0.smithi045.stdout:4/807: dwrite db/de/d1e/fb2 [4194304,4194304] 0 2024-09-18T12:52:22.316 INFO:tasks.workunit.client.0.smithi045.stdout:7/535: rename d13/d1a/d28/f3a to d13/fbf 0 2024-09-18T12:52:22.321 INFO:tasks.workunit.client.0.smithi045.stdout:5/711: dwrite d6/db/d5a/d78/d66/f74 [0,4194304] 0 2024-09-18T12:52:22.322 INFO:tasks.workunit.client.0.smithi045.stdout:4/808: creat db/de/f10a x:0 0 0 2024-09-18T12:52:22.323 INFO:tasks.workunit.client.0.smithi045.stdout:0/635: link d6/d48/d5e/d39/d58/d3c/d69/c85 d6/d48/d5e/d39/d58/d3b/cba 0 2024-09-18T12:52:22.323 INFO:tasks.workunit.client.0.smithi045.stdout:5/712: chown d6/l9 618387 1 2024-09-18T12:52:22.327 INFO:tasks.workunit.client.0.smithi045.stdout:3/540: rename d0/d22/f72 to d0/d29/d5f/d73/da0/fb5 0 2024-09-18T12:52:22.330 INFO:tasks.workunit.client.0.smithi045.stdout:7/536: creat d13/d1a/d9b/fc0 x:0 0 0 2024-09-18T12:52:22.330 INFO:tasks.workunit.client.0.smithi045.stdout:2/648: getdents d5/d2c/d6f/d9d 0 2024-09-18T12:52:22.331 INFO:tasks.workunit.client.0.smithi045.stdout:6/588: mknod d9/d1a/d48/d7d/dcb/cce 0 2024-09-18T12:52:22.332 INFO:tasks.workunit.client.0.smithi045.stdout:7/537: dread - d13/d31/d52/d81/f9d zero size 2024-09-18T12:52:22.332 INFO:tasks.workunit.client.0.smithi045.stdout:5/713: symlink d6/db/d5a/d78/d66/lde 0 2024-09-18T12:52:22.332 INFO:tasks.workunit.client.0.smithi045.stdout:2/649: read - d5/d5f/da8/d61/dbb/fc0 zero size 2024-09-18T12:52:22.333 INFO:tasks.workunit.client.0.smithi045.stdout:4/809: symlink db/d2c/d35/d40/d6d/da9/l10b 0 2024-09-18T12:52:22.334 INFO:tasks.workunit.client.0.smithi045.stdout:5/714: write d6/f7 [94903,8811] 0 2024-09-18T12:52:22.335 INFO:tasks.workunit.client.0.smithi045.stdout:5/715: chown d6/db/d19/d92/d61/da5/dc9 1 1 2024-09-18T12:52:22.338 INFO:tasks.workunit.client.0.smithi045.stdout:0/636: rename d6/d48/d5e/d39/d58/d3c/d69/c7c to d6/d48/d5e/d39/d58/d3b/d6b/cbb 0 2024-09-18T12:52:22.339 INFO:tasks.workunit.client.0.smithi045.stdout:0/637: write d6/d48/d5e/f30 [3866696,11637] 0 2024-09-18T12:52:22.339 INFO:tasks.workunit.client.0.smithi045.stdout:6/589: write d9/d56/f8b [2727002,11024] 0 2024-09-18T12:52:22.340 INFO:tasks.workunit.client.0.smithi045.stdout:0/638: dread - d6/d7/d32/f9e zero size 2024-09-18T12:52:22.346 INFO:tasks.workunit.client.0.smithi045.stdout:1/645: fsync d0/d2d/d2b/d30/f4f 0 2024-09-18T12:52:22.347 INFO:tasks.workunit.client.0.smithi045.stdout:9/524: truncate d0/d3/f1f 2779979 0 2024-09-18T12:52:22.360 INFO:tasks.workunit.client.0.smithi045.stdout:7/538: symlink d13/d44/d37/d70/lc1 0 2024-09-18T12:52:22.361 INFO:tasks.workunit.client.0.smithi045.stdout:0/639: symlink d6/d35/d92/lbc 0 2024-09-18T12:52:22.366 INFO:tasks.workunit.client.0.smithi045.stdout:4/810: symlink db/de/d1e/d3e/l10c 0 2024-09-18T12:52:22.366 INFO:tasks.workunit.client.0.smithi045.stdout:2/650: dwrite d5/d46/fa9 [0,4194304] 0 2024-09-18T12:52:22.367 INFO:tasks.workunit.client.0.smithi045.stdout:4/811: chown db/de/d1a/f3d 269874497 1 2024-09-18T12:52:22.375 INFO:tasks.workunit.client.0.smithi045.stdout:9/525: mknod d0/d3/d6/d10/d2c/d63/ca8 0 2024-09-18T12:52:22.378 INFO:tasks.workunit.client.0.smithi045.stdout:6/590: dwrite d9/ff [0,4194304] 0 2024-09-18T12:52:22.380 INFO:tasks.workunit.client.0.smithi045.stdout:7/539: symlink d13/d44/d37/lc2 0 2024-09-18T12:52:22.381 INFO:tasks.workunit.client.0.smithi045.stdout:7/540: stat d13/d44/d4c/d82 0 2024-09-18T12:52:22.383 INFO:tasks.workunit.client.0.smithi045.stdout:7/541: dread - d13/d31/d52/fa7 zero size 2024-09-18T12:52:22.384 INFO:tasks.workunit.client.0.smithi045.stdout:0/640: creat d6/d35/fbd x:0 0 0 2024-09-18T12:52:22.390 INFO:tasks.workunit.client.0.smithi045.stdout:0/641: read - d6/d48/d5e/d39/d58/d86/fad zero size 2024-09-18T12:52:22.390 INFO:tasks.workunit.client.0.smithi045.stdout:2/651: creat d5/d2c/d4d/d76/d93/fe3 x:0 0 0 2024-09-18T12:52:22.392 INFO:tasks.workunit.client.0.smithi045.stdout:6/591: dwrite d9/fc [0,4194304] 0 2024-09-18T12:52:22.394 INFO:tasks.workunit.client.0.smithi045.stdout:3/541: dwrite d0/d1e/d2c/f63 [4194304,4194304] 0 2024-09-18T12:52:22.396 INFO:tasks.workunit.client.0.smithi045.stdout:1/646: dread d0/d12/f3b [0,4194304] 0 2024-09-18T12:52:22.401 INFO:tasks.workunit.client.0.smithi045.stdout:2/652: read - d5/d5f/da8/d61/f96 zero size 2024-09-18T12:52:22.401 INFO:tasks.workunit.client.0.smithi045.stdout:4/812: rename db/de/d1e/d3e/de1 to db/de/d1e/d3e/d78/d100/d108/d10d 0 2024-09-18T12:52:22.401 INFO:tasks.workunit.client.0.smithi045.stdout:1/647: readlink d0/d2d/d2b/d30/d40/lb0 0 2024-09-18T12:52:22.405 INFO:tasks.workunit.client.0.smithi045.stdout:9/526: mkdir d0/d3/d6/d64/d77/da9 0 2024-09-18T12:52:22.407 INFO:tasks.workunit.client.0.smithi045.stdout:6/592: dwrite d9/d1a/d2d/d38/d5b/fa0 [0,4194304] 0 2024-09-18T12:52:22.423 INFO:tasks.workunit.client.0.smithi045.stdout:6/593: chown d9/d1a/d2d/d38/f44 13995064 1 2024-09-18T12:52:22.425 INFO:tasks.workunit.client.0.smithi045.stdout:6/594: write d9/d1a/d2d/d32/f4c [2252658,64353] 0 2024-09-18T12:52:22.426 INFO:tasks.workunit.client.0.smithi045.stdout:0/642: write d6/f36 [2263039,123057] 0 2024-09-18T12:52:22.426 INFO:tasks.workunit.client.0.smithi045.stdout:6/595: chown d9/d30/l52 50 1 2024-09-18T12:52:22.428 INFO:tasks.workunit.client.0.smithi045.stdout:3/542: creat d0/d7/d89/fb6 x:0 0 0 2024-09-18T12:52:22.430 INFO:tasks.workunit.client.0.smithi045.stdout:9/527: symlink d0/d3/laa 0 2024-09-18T12:52:22.432 INFO:tasks.workunit.client.0.smithi045.stdout:2/653: truncate d5/d46/f7e 1679282 0 2024-09-18T12:52:22.434 INFO:tasks.workunit.client.0.smithi045.stdout:6/596: fsync d9/d1a/d1d/f25 0 2024-09-18T12:52:22.439 INFO:tasks.workunit.client.0.smithi045.stdout:4/813: dwrite db/de/d1e/d3e/d47/fbb [0,4194304] 0 2024-09-18T12:52:22.441 INFO:tasks.workunit.client.0.smithi045.stdout:9/528: dwrite d0/f61 [0,4194304] 0 2024-09-18T12:52:22.447 INFO:tasks.workunit.client.0.smithi045.stdout:0/643: getdents d6/d48/d5e/d39/d58/d86/db9 0 2024-09-18T12:52:22.448 INFO:tasks.workunit.client.0.smithi045.stdout:0/644: fdatasync d6/d35/fbd 0 2024-09-18T12:52:22.455 INFO:tasks.workunit.client.0.smithi045.stdout:2/654: creat d5/d3a/d3e/dd4/fe4 x:0 0 0 2024-09-18T12:52:22.458 INFO:tasks.workunit.client.0.smithi045.stdout:4/814: symlink db/d2c/d35/dcc/dd0/l10e 0 2024-09-18T12:52:22.461 INFO:tasks.workunit.client.0.smithi045.stdout:2/655: mknod d5/d2c/d6f/ce5 0 2024-09-18T12:52:22.462 INFO:tasks.workunit.client.0.smithi045.stdout:2/656: dread - d5/d2c/d6f/d9d/fbc zero size 2024-09-18T12:52:22.465 INFO:tasks.workunit.client.0.smithi045.stdout:9/529: mkdir d0/d3/d6/d10/d26/d2e/d6f/da5/dab 0 2024-09-18T12:52:22.466 INFO:tasks.workunit.client.0.smithi045.stdout:4/815: rename db/d20/d6b/lfb to db/d2c/d35/d40/d77/l10f 0 2024-09-18T12:52:22.467 INFO:tasks.workunit.client.0.smithi045.stdout:3/543: truncate d0/d22/fa1 3537754 0 2024-09-18T12:52:22.468 INFO:tasks.workunit.client.0.smithi045.stdout:2/657: dwrite d5/d5f/da8/f6e [0,4194304] 0 2024-09-18T12:52:22.469 INFO:tasks.workunit.client.0.smithi045.stdout:2/658: fsync d5/d2c/d4d/f68 0 2024-09-18T12:52:22.470 INFO:tasks.workunit.client.0.smithi045.stdout:6/597: link d9/l60 d9/d1a/d48/d8f/d98/lcf 0 2024-09-18T12:52:22.471 INFO:tasks.workunit.client.0.smithi045.stdout:9/530: mknod d0/d3/d6/d10/cac 0 2024-09-18T12:52:22.472 INFO:tasks.workunit.client.0.smithi045.stdout:4/816: stat db/de/d1e/lff 0 2024-09-18T12:52:22.474 INFO:tasks.workunit.client.0.smithi045.stdout:4/817: dread - db/de/d1e/d49/fcb zero size 2024-09-18T12:52:22.474 INFO:tasks.workunit.client.0.smithi045.stdout:9/531: write d0/f2 [5133229,69315] 0 2024-09-18T12:52:22.474 INFO:tasks.workunit.client.0.smithi045.stdout:8/680: sync 2024-09-18T12:52:22.481 INFO:tasks.workunit.client.0.smithi045.stdout:4/818: dwrite db/de/d1e/d3e/d47/d59/f87 [0,4194304] 0 2024-09-18T12:52:22.484 INFO:tasks.workunit.client.0.smithi045.stdout:2/659: symlink d5/d2c/d4d/d76/dd5/le6 0 2024-09-18T12:52:22.489 INFO:tasks.workunit.client.0.smithi045.stdout:4/819: dwrite db/de/d1e/d3e/d9a/d73/fc3 [0,4194304] 0 2024-09-18T12:52:22.490 INFO:tasks.workunit.client.0.smithi045.stdout:8/681: mknod d11/d20/d60/dc3/d98/cc9 0 2024-09-18T12:52:22.490 INFO:tasks.workunit.client.0.smithi045.stdout:8/682: write d11/f17 [1645818,1189] 0 2024-09-18T12:52:22.492 INFO:tasks.workunit.client.0.smithi045.stdout:0/645: truncate d6/d48/d5e/d39/d58/d3c/d73/f7f 1363417 0 2024-09-18T12:52:22.492 INFO:tasks.workunit.client.0.smithi045.stdout:4/820: read db/de/d1e/d3e/d9a/da2/fc1 [45552,104369] 0 2024-09-18T12:52:22.493 INFO:tasks.workunit.client.0.smithi045.stdout:0/646: readlink d6/d48/l97 0 2024-09-18T12:52:22.495 INFO:tasks.workunit.client.0.smithi045.stdout:6/598: mkdir d9/d1a/d48/dc6/dd0 0 2024-09-18T12:52:22.496 INFO:tasks.workunit.client.0.smithi045.stdout:0/647: write d6/d48/d5e/f75 [1810736,121454] 0 2024-09-18T12:52:22.496 INFO:tasks.workunit.client.0.smithi045.stdout:6/599: dread - d9/d1a/d48/d75/d81/fa3 zero size 2024-09-18T12:52:22.498 INFO:tasks.workunit.client.0.smithi045.stdout:2/660: chown d5/d46/f86 309275 1 2024-09-18T12:52:22.499 INFO:tasks.workunit.client.0.smithi045.stdout:2/661: dread - d5/d3a/d3e/dd4/fe4 zero size 2024-09-18T12:52:22.503 INFO:tasks.workunit.client.0.smithi045.stdout:8/683: mkdir d11/d76/da0/da1/dca 0 2024-09-18T12:52:22.511 INFO:tasks.workunit.client.0.smithi045.stdout:4/821: truncate f9 5455446 0 2024-09-18T12:52:22.516 INFO:tasks.workunit.client.0.smithi045.stdout:6/600: symlink d9/d1a/d2d/d38/ld1 0 2024-09-18T12:52:22.518 INFO:tasks.workunit.client.0.smithi045.stdout:3/544: rename d0/d1e/d91/d95 to d0/d1e/d39/db7 0 2024-09-18T12:52:22.519 INFO:tasks.workunit.client.0.smithi045.stdout:9/532: getdents d0/d3/d6/d10/d26 0 2024-09-18T12:52:22.521 INFO:tasks.workunit.client.0.smithi045.stdout:4/822: truncate db/f30 1850416 0 2024-09-18T12:52:22.522 INFO:tasks.workunit.client.0.smithi045.stdout:0/648: dread d6/d48/d5e/f24 [4194304,4194304] 0 2024-09-18T12:52:22.523 INFO:tasks.workunit.client.0.smithi045.stdout:8/684: mknod d11/d14/d53/d41/ccb 0 2024-09-18T12:52:22.527 INFO:tasks.workunit.client.0.smithi045.stdout:6/601: dwrite d9/d1a/d2d/d38/d5b/d67/f79 [0,4194304] 0 2024-09-18T12:52:22.533 INFO:tasks.workunit.client.0.smithi045.stdout:4/823: dwrite db/d1b/ffd [0,4194304] 0 2024-09-18T12:52:22.533 INFO:tasks.workunit.client.0.smithi045.stdout:3/545: creat d0/d1e/d2c/d3a/fb8 x:0 0 0 2024-09-18T12:52:22.537 INFO:tasks.workunit.client.0.smithi045.stdout:8/685: dwrite d11/d8c/d90/fb6 [0,4194304] 0 2024-09-18T12:52:22.537 INFO:tasks.workunit.client.0.smithi045.stdout:9/533: rmdir d0/d3/d6/d10 39 2024-09-18T12:52:22.539 INFO:tasks.workunit.client.0.smithi045.stdout:3/546: stat d0/d1e/d39/db7/fa2 0 2024-09-18T12:52:22.540 INFO:tasks.workunit.client.0.smithi045.stdout:3/547: fdatasync d0/d29/fa5 0 2024-09-18T12:52:22.547 INFO:tasks.workunit.client.0.smithi045.stdout:8/686: dwrite d11/d76/f88 [8388608,4194304] 0 2024-09-18T12:52:22.549 INFO:tasks.workunit.client.0.smithi045.stdout:9/534: unlink d0/l85 0 2024-09-18T12:52:22.552 INFO:tasks.workunit.client.0.smithi045.stdout:2/662: rename d5/d5f/fcc to d5/d5f/db2/fe7 0 2024-09-18T12:52:22.557 INFO:tasks.workunit.client.0.smithi045.stdout:0/649: mknod d6/d48/d5e/d39/d58/d3b/d65/cbe 0 2024-09-18T12:52:22.566 INFO:tasks.workunit.client.0.smithi045.stdout:6/602: write d9/f28 [2862723,84033] 0 2024-09-18T12:52:22.567 INFO:tasks.workunit.client.0.smithi045.stdout:4/824: mknod db/de/d1e/d3e/d78/d109/c110 0 2024-09-18T12:52:22.567 INFO:tasks.workunit.client.0.smithi045.stdout:2/663: dread d5/fb7 [0,4194304] 0 2024-09-18T12:52:22.572 INFO:tasks.workunit.client.0.smithi045.stdout:8/687: unlink d11/d20/l30 0 2024-09-18T12:52:22.573 INFO:tasks.workunit.client.0.smithi045.stdout:8/688: read d11/d14/f52 [2733977,112975] 0 2024-09-18T12:52:22.577 INFO:tasks.workunit.client.0.smithi045.stdout:3/548: dread d0/d1e/d2c/d3f/d44/f4c [0,4194304] 0 2024-09-18T12:52:22.585 INFO:tasks.workunit.client.0.smithi045.stdout:2/664: creat d5/d3a/d3e/dd4/fe8 x:0 0 0 2024-09-18T12:52:22.587 INFO:tasks.workunit.client.0.smithi045.stdout:8/689: creat d11/d23/fcc x:0 0 0 2024-09-18T12:52:22.587 INFO:tasks.workunit.client.0.smithi045.stdout:8/690: fdatasync d11/d20/d46/faf 0 2024-09-18T12:52:22.588 INFO:tasks.workunit.client.0.smithi045.stdout:9/535: truncate d0/d3/d6/d10/d26/f62 193031 0 2024-09-18T12:52:22.594 INFO:tasks.workunit.client.0.smithi045.stdout:9/536: dwrite d0/f66 [0,4194304] 0 2024-09-18T12:52:22.597 INFO:tasks.workunit.client.0.smithi045.stdout:2/665: unlink d5/d5f/da8/d61/f66 0 2024-09-18T12:52:22.597 INFO:tasks.workunit.client.0.smithi045.stdout:2/666: dread - d5/d5f/da8/d61/f96 zero size 2024-09-18T12:52:22.598 INFO:tasks.workunit.client.0.smithi045.stdout:2/667: chown d5/d3a/d3e/c9f 94879 1 2024-09-18T12:52:22.600 INFO:tasks.workunit.client.0.smithi045.stdout:2/668: write d5/d5f/da8/d61/fbd [213360,105335] 0 2024-09-18T12:52:22.605 INFO:tasks.workunit.client.0.smithi045.stdout:9/537: symlink d0/d3/d6/d64/d88/lad 0 2024-09-18T12:52:22.608 INFO:tasks.workunit.client.0.smithi045.stdout:0/650: dwrite d6/d48/d5e/f78 [0,4194304] 0 2024-09-18T12:52:22.609 INFO:tasks.workunit.client.0.smithi045.stdout:0/651: dread - d6/d7/fae zero size 2024-09-18T12:52:22.613 INFO:tasks.workunit.client.0.smithi045.stdout:0/652: read d6/d48/d5e/f30 [1166894,92232] 0 2024-09-18T12:52:22.613 INFO:tasks.workunit.client.0.smithi045.stdout:6/603: write d9/d30/f33 [3681854,2005] 0 2024-09-18T12:52:22.614 INFO:tasks.workunit.client.0.smithi045.stdout:6/604: chown d9/d1a/d48/d7d/dcb 1260230 1 2024-09-18T12:52:22.620 INFO:tasks.workunit.client.0.smithi045.stdout:2/669: creat d5/d5f/da8/d61/fe9 x:0 0 0 2024-09-18T12:52:22.624 INFO:tasks.workunit.client.0.smithi045.stdout:9/538: truncate d0/f3e 4566619 0 2024-09-18T12:52:22.629 INFO:tasks.workunit.client.0.smithi045.stdout:6/605: chown d9/d56/db3/lbc 1736500970 1 2024-09-18T12:52:22.630 INFO:tasks.workunit.client.0.smithi045.stdout:3/549: write d0/fe [435034,22684] 0 2024-09-18T12:52:22.641 INFO:tasks.workunit.client.0.smithi045.stdout:6/606: dread d9/d1a/f2e [0,4194304] 0 2024-09-18T12:52:22.642 INFO:tasks.workunit.client.0.smithi045.stdout:6/607: write d9/d1a/d48/f53 [2300033,71330] 0 2024-09-18T12:52:22.664 INFO:tasks.workunit.client.0.smithi045.stdout:8/691: getdents d11/d14/d53/d41 0 2024-09-18T12:52:22.668 INFO:tasks.workunit.client.0.smithi045.stdout:0/653: mkdir d6/d7/dbf 0 2024-09-18T12:52:22.669 INFO:tasks.workunit.client.0.smithi045.stdout:3/550: mkdir d0/d1e/d2c/d3a/d8a/db9 0 2024-09-18T12:52:22.670 INFO:tasks.workunit.client.0.smithi045.stdout:9/539: dwrite d0/d3/d6/d10/d2c/d63/f87 [0,4194304] 0 2024-09-18T12:52:22.674 INFO:tasks.workunit.client.0.smithi045.stdout:6/608: symlink d9/d1a/d48/d8f/d98/ld2 0 2024-09-18T12:52:22.678 INFO:tasks.workunit.client.0.smithi045.stdout:9/540: dwrite d0/f9e [0,4194304] 0 2024-09-18T12:52:22.679 INFO:tasks.workunit.client.0.smithi045.stdout:9/541: chown d0/d3/d6/d10/f29 19885123 1 2024-09-18T12:52:22.683 INFO:tasks.workunit.client.0.smithi045.stdout:0/654: creat d6/d48/d5e/d39/d58/d3c/d73/fc0 x:0 0 0 2024-09-18T12:52:22.687 INFO:tasks.workunit.client.0.smithi045.stdout:8/692: stat d11/d23/f2b 0 2024-09-18T12:52:22.691 INFO:tasks.workunit.client.0.smithi045.stdout:9/542: unlink d0/d3/d6/d10/f7d 0 2024-09-18T12:52:22.692 INFO:tasks.workunit.client.0.smithi045.stdout:0/655: dread - d6/d48/d5e/d39/d58/d66/fa4 zero size 2024-09-18T12:52:22.698 INFO:tasks.workunit.client.0.smithi045.stdout:0/656: unlink d6/d48/d5e/d39/d58/f59 0 2024-09-18T12:52:22.701 INFO:tasks.workunit.client.0.smithi045.stdout:3/551: getdents d0/d29/d5f/d73/d87 0 2024-09-18T12:52:22.704 INFO:tasks.workunit.client.0.smithi045.stdout:5/716: sync 2024-09-18T12:52:22.704 INFO:tasks.workunit.client.0.smithi045.stdout:1/648: sync 2024-09-18T12:52:22.704 INFO:tasks.workunit.client.0.smithi045.stdout:7/542: sync 2024-09-18T12:52:22.704 INFO:tasks.workunit.client.0.smithi045.stdout:6/609: getdents d9/d30 0 2024-09-18T12:52:22.705 INFO:tasks.workunit.client.0.smithi045.stdout:0/657: symlink d6/d35/d92/lc1 0 2024-09-18T12:52:22.706 INFO:tasks.workunit.client.0.smithi045.stdout:7/543: write d13/d1a/d9b/fc0 [793670,41187] 0 2024-09-18T12:52:22.707 INFO:tasks.workunit.client.0.smithi045.stdout:7/544: truncate d13/f8e 538421 0 2024-09-18T12:52:22.709 INFO:tasks.workunit.client.0.smithi045.stdout:9/543: rename d0/d3/d6/d10/f2a to d0/fae 0 2024-09-18T12:52:22.712 INFO:tasks.workunit.client.0.smithi045.stdout:3/552: unlink d0/d7/f1d 0 2024-09-18T12:52:22.717 INFO:tasks.workunit.client.0.smithi045.stdout:7/545: readlink d13/d44/d37/d6a/da3/lb4 0 2024-09-18T12:52:22.720 INFO:tasks.workunit.client.0.smithi045.stdout:5/717: symlink d6/db/ldf 0 2024-09-18T12:52:22.722 INFO:tasks.workunit.client.0.smithi045.stdout:1/649: mknod d0/d2d/d2b/d30/cc4 0 2024-09-18T12:52:22.725 INFO:tasks.workunit.client.0.smithi045.stdout:8/693: getdents d11/d76 0 2024-09-18T12:52:22.729 INFO:tasks.workunit.client.0.smithi045.stdout:7/546: mknod d13/d44/d37/d6a/cc3 0 2024-09-18T12:52:22.731 INFO:tasks.workunit.client.0.smithi045.stdout:2/670: dwrite d5/d5f/da8/d61/dbb/dc6/dc7/dce/f85 [0,4194304] 0 2024-09-18T12:52:22.734 INFO:tasks.workunit.client.0.smithi045.stdout:2/671: chown d5/d5f/da8/d61/dbb/dc6/dc7/dce/f85 43810 1 2024-09-18T12:52:22.735 INFO:tasks.workunit.client.0.smithi045.stdout:4/825: sync 2024-09-18T12:52:22.738 INFO:tasks.workunit.client.0.smithi045.stdout:4/826: write db/de/d1e/d3e/d78/fdf [891793,128028] 0 2024-09-18T12:52:22.739 INFO:tasks.workunit.client.0.smithi045.stdout:0/658: creat d6/fc2 x:0 0 0 2024-09-18T12:52:22.740 INFO:tasks.workunit.client.0.smithi045.stdout:3/553: dwrite d0/d1e/d39/f88 [0,4194304] 0 2024-09-18T12:52:22.746 INFO:tasks.workunit.client.0.smithi045.stdout:8/694: dread d11/d8c/d90/fb6 [0,4194304] 0 2024-09-18T12:52:22.747 INFO:tasks.workunit.client.0.smithi045.stdout:6/610: getdents d9/d1a/d48 0 2024-09-18T12:52:22.748 INFO:tasks.workunit.client.0.smithi045.stdout:2/672: readlink d5/d5f/da8/d61/l9b 0 2024-09-18T12:52:22.751 INFO:tasks.workunit.client.0.smithi045.stdout:1/650: link d0/d2d/d2b/d30/d8b/f7c d0/d2d/fc5 0 2024-09-18T12:52:22.752 INFO:tasks.workunit.client.0.smithi045.stdout:1/651: chown d0/d2d/d2b/f9b 115 1 2024-09-18T12:52:22.754 INFO:tasks.workunit.client.0.smithi045.stdout:1/652: dread - d0/d12/d32/d67/d6a/fbe zero size 2024-09-18T12:52:22.758 INFO:tasks.workunit.client.0.smithi045.stdout:8/695: fsync fa 0 2024-09-18T12:52:22.763 INFO:tasks.workunit.client.0.smithi045.stdout:3/554: unlink d0/d1e/l2d 0 2024-09-18T12:52:22.764 INFO:tasks.workunit.client.0.smithi045.stdout:9/544: write d0/d3/d6/d64/f91 [203677,100624] 0 2024-09-18T12:52:22.766 INFO:tasks.workunit.client.0.smithi045.stdout:7/547: creat d13/d44/d37/d70/fc4 x:0 0 0 2024-09-18T12:52:22.772 INFO:tasks.workunit.client.0.smithi045.stdout:5/718: truncate d6/db/f2c 2160800 0 2024-09-18T12:52:22.772 INFO:tasks.workunit.client.0.smithi045.stdout:9/545: dwrite d0/d3/d6/d10/d26/d2e/f6a [0,4194304] 0 2024-09-18T12:52:22.773 INFO:tasks.workunit.client.0.smithi045.stdout:1/653: mkdir d0/d2d/db1/dc6 0 2024-09-18T12:52:22.775 INFO:tasks.workunit.client.0.smithi045.stdout:3/555: creat d0/d1e/d91/fba x:0 0 0 2024-09-18T12:52:22.782 INFO:tasks.workunit.client.0.smithi045.stdout:4/827: write db/de/d1e/d3e/d47/d59/f5f [3485922,68979] 0 2024-09-18T12:52:22.785 INFO:tasks.workunit.client.0.smithi045.stdout:6/611: creat d9/d56/fd3 x:0 0 0 2024-09-18T12:52:22.786 INFO:tasks.workunit.client.0.smithi045.stdout:4/828: stat db/de/d1e/d3e/d47/l71 0 2024-09-18T12:52:22.788 INFO:tasks.workunit.client.0.smithi045.stdout:0/659: dwrite d6/d48/d5e/f30 [0,4194304] 0 2024-09-18T12:52:22.790 INFO:tasks.workunit.client.0.smithi045.stdout:8/696: dwrite d11/d14/d53/f4f [4194304,4194304] 0 2024-09-18T12:52:22.794 INFO:tasks.workunit.client.0.smithi045.stdout:0/660: dread - d6/d48/d5e/d39/d58/d3c/d73/fc0 zero size 2024-09-18T12:52:22.799 INFO:tasks.workunit.client.0.smithi045.stdout:2/673: dwrite d5/d5f/db2/f69 [0,4194304] 0 2024-09-18T12:52:22.802 INFO:tasks.workunit.client.0.smithi045.stdout:2/674: stat d5/d2c/d4d/l51 0 2024-09-18T12:52:22.804 INFO:tasks.workunit.client.0.smithi045.stdout:8/697: dwrite fa [0,4194304] 0 2024-09-18T12:52:22.808 INFO:tasks.workunit.client.0.smithi045.stdout:3/556: creat d0/d29/d5f/d73/fbb x:0 0 0 2024-09-18T12:52:22.809 INFO:tasks.workunit.client.0.smithi045.stdout:3/557: read - d0/d1e/d91/fba zero size 2024-09-18T12:52:22.814 INFO:tasks.workunit.client.0.smithi045.stdout:6/612: mknod d9/d1a/d48/d75/d81/cd4 0 2024-09-18T12:52:22.818 INFO:tasks.workunit.client.0.smithi045.stdout:0/661: creat d6/d48/d5e/d39/d58/d86/fc3 x:0 0 0 2024-09-18T12:52:22.820 INFO:tasks.workunit.client.0.smithi045.stdout:0/662: write d6/d48/d5e/d39/d58/d86/fc3 [35205,47333] 0 2024-09-18T12:52:22.822 INFO:tasks.workunit.client.0.smithi045.stdout:9/546: creat d0/d3/d6/d64/d77/da9/faf x:0 0 0 2024-09-18T12:52:22.823 INFO:tasks.workunit.client.0.smithi045.stdout:2/675: mknod d5/d5f/da8/d61/dbb/dc6/cea 0 2024-09-18T12:52:22.825 INFO:tasks.workunit.client.0.smithi045.stdout:3/558: dread - d0/f83 zero size 2024-09-18T12:52:22.830 INFO:tasks.workunit.client.0.smithi045.stdout:5/719: rename d6/d28/d2b/d51/d97/lb5 to d6/d28/d2b/le0 0 2024-09-18T12:52:22.831 INFO:tasks.workunit.client.0.smithi045.stdout:9/547: mkdir d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0 0 2024-09-18T12:52:22.832 INFO:tasks.workunit.client.0.smithi045.stdout:9/548: dread - d0/d3/d6/d10/d26/fa1 zero size 2024-09-18T12:52:22.833 INFO:tasks.workunit.client.0.smithi045.stdout:9/549: read d0/f5c [394860,124599] 0 2024-09-18T12:52:22.833 INFO:tasks.workunit.client.0.smithi045.stdout:2/676: mkdir d5/d5f/da8/deb 0 2024-09-18T12:52:22.836 INFO:tasks.workunit.client.0.smithi045.stdout:7/548: truncate d13/f24 9628853 0 2024-09-18T12:52:22.837 INFO:tasks.workunit.client.0.smithi045.stdout:1/654: dread d0/f6 [0,4194304] 0 2024-09-18T12:52:22.838 INFO:tasks.workunit.client.0.smithi045.stdout:4/829: link db/de/d1e/d3e/c8d db/de/d1e/d3e/d47/db7/d106/c111 0 2024-09-18T12:52:22.839 INFO:tasks.workunit.client.0.smithi045.stdout:1/655: write d0/d2d/d2b/d30/d40/d60/d8f/f70 [2385977,128647] 0 2024-09-18T12:52:22.845 INFO:tasks.workunit.client.0.smithi045.stdout:8/698: rename d11/d14/d53/d41/l9f to d11/d14/d53/d41/d75/lcd 0 2024-09-18T12:52:22.854 INFO:tasks.workunit.client.0.smithi045.stdout:3/559: chown d0/d1e/d2c/d3f/d44/l6f 8038566 1 2024-09-18T12:52:22.856 INFO:tasks.workunit.client.0.smithi045.stdout:6/613: dwrite d9/f13 [0,4194304] 0 2024-09-18T12:52:22.857 INFO:tasks.workunit.client.0.smithi045.stdout:7/549: creat d13/d44/d37/d6a/fc5 x:0 0 0 2024-09-18T12:52:22.857 INFO:tasks.workunit.client.0.smithi045.stdout:5/720: dread d6/db/d19/d92/f60 [0,4194304] 0 2024-09-18T12:52:22.858 INFO:tasks.workunit.client.0.smithi045.stdout:4/830: mkdir db/d2c/d35/d40/d6d/d112 0 2024-09-18T12:52:22.859 INFO:tasks.workunit.client.0.smithi045.stdout:7/550: chown d13/d44/d4c/d82/lb5 207187 1 2024-09-18T12:52:22.860 INFO:tasks.workunit.client.0.smithi045.stdout:4/831: write db/de/d1e/d3e/d47/d59/d7a/fea [945954,39343] 0 2024-09-18T12:52:22.864 INFO:tasks.workunit.client.0.smithi045.stdout:0/663: creat d6/d48/d5e/fc4 x:0 0 0 2024-09-18T12:52:22.867 INFO:tasks.workunit.client.0.smithi045.stdout:2/677: rename d5/d5f/da8/d61/l9b to d5/d2c/dac/lec 0 2024-09-18T12:52:22.872 INFO:tasks.workunit.client.0.smithi045.stdout:1/656: write d0/d2d/d2b/d30/d8b/f7c [5324050,104305] 0 2024-09-18T12:52:22.878 INFO:tasks.workunit.client.0.smithi045.stdout:6/614: mknod d9/d30/d6c/cd5 0 2024-09-18T12:52:22.878 INFO:tasks.workunit.client.0.smithi045.stdout:8/699: write d11/d23/f2b [4996602,90043] 0 2024-09-18T12:52:22.879 INFO:tasks.workunit.client.0.smithi045.stdout:6/615: write d9/d1a/d48/d75/d81/fa3 [286502,128410] 0 2024-09-18T12:52:22.880 INFO:tasks.workunit.client.0.smithi045.stdout:5/721: read d6/db/f2c [1320932,71132] 0 2024-09-18T12:52:22.884 INFO:tasks.workunit.client.0.smithi045.stdout:4/832: mknod db/d2c/d35/dcc/dd0/c113 0 2024-09-18T12:52:22.884 INFO:tasks.workunit.client.0.smithi045.stdout:0/664: fsync d6/d7/d32/f33 0 2024-09-18T12:52:22.885 INFO:tasks.workunit.client.0.smithi045.stdout:2/678: fsync d5/d46/fcf 0 2024-09-18T12:52:22.887 INFO:tasks.workunit.client.0.smithi045.stdout:1/657: readlink d0/d2d/d2b/d30/d8b/l78 0 2024-09-18T12:52:22.890 INFO:tasks.workunit.client.0.smithi045.stdout:4/833: dwrite db/de/d1e/d49/ff9 [0,4194304] 0 2024-09-18T12:52:22.893 INFO:tasks.workunit.client.0.smithi045.stdout:8/700: fsync d11/d14/d72/f8d 0 2024-09-18T12:52:22.904 INFO:tasks.workunit.client.0.smithi045.stdout:3/560: dwrite d0/d1e/f2a [0,4194304] 0 2024-09-18T12:52:22.906 INFO:tasks.workunit.client.0.smithi045.stdout:1/658: unlink d0/d12/c41 0 2024-09-18T12:52:22.907 INFO:tasks.workunit.client.0.smithi045.stdout:9/550: getdents d0/d3/d6/d10/d2c 0 2024-09-18T12:52:22.908 INFO:tasks.workunit.client.0.smithi045.stdout:4/834: creat db/de/f114 x:0 0 0 2024-09-18T12:52:22.909 INFO:tasks.workunit.client.0.smithi045.stdout:7/551: dwrite d13/d31/d33/d64/d78/fbb [0,4194304] 0 2024-09-18T12:52:22.910 INFO:tasks.workunit.client.0.smithi045.stdout:6/616: creat d9/d1a/d48/dc6/dd0/fd6 x:0 0 0 2024-09-18T12:52:22.911 INFO:tasks.workunit.client.0.smithi045.stdout:4/835: chown db/de/d1e/d3e/d78/d100/d108/d10d 14 1 2024-09-18T12:52:22.911 INFO:tasks.workunit.client.0.smithi045.stdout:4/836: chown db/de9 6047 1 2024-09-18T12:52:22.912 INFO:tasks.workunit.client.0.smithi045.stdout:7/552: write d13/d31/d33/d64/d78/f8b [101734,69825] 0 2024-09-18T12:52:22.913 INFO:tasks.workunit.client.0.smithi045.stdout:7/553: dread - d13/d44/d37/d70/fb7 zero size 2024-09-18T12:52:22.918 INFO:tasks.workunit.client.0.smithi045.stdout:7/554: dread d13/d44/d4c/f62 [0,4194304] 0 2024-09-18T12:52:22.919 INFO:tasks.workunit.client.0.smithi045.stdout:7/555: chown d13/d44/l6f 6321999 1 2024-09-18T12:52:22.920 INFO:tasks.workunit.client.0.smithi045.stdout:7/556: fdatasync d13/d44/d37/d70/fb7 0 2024-09-18T12:52:22.922 INFO:tasks.workunit.client.0.smithi045.stdout:3/561: rmdir d0/d29/d53 39 2024-09-18T12:52:22.923 INFO:tasks.workunit.client.0.smithi045.stdout:1/659: write d0/f2 [987150,65408] 0 2024-09-18T12:52:22.927 INFO:tasks.workunit.client.0.smithi045.stdout:6/617: rmdir d9/d1a/d2d/d32 39 2024-09-18T12:52:22.929 INFO:tasks.workunit.client.0.smithi045.stdout:4/837: creat db/de/f115 x:0 0 0 2024-09-18T12:52:22.930 INFO:tasks.workunit.client.0.smithi045.stdout:4/838: readlink db/d2c/d35/lc2 0 2024-09-18T12:52:22.931 INFO:tasks.workunit.client.0.smithi045.stdout:8/701: dwrite d11/d14/d53/d41/f74 [0,4194304] 0 2024-09-18T12:52:22.933 INFO:tasks.workunit.client.0.smithi045.stdout:5/722: link d6/db/d19/d92/d61/f65 d6/db/d5a/fe1 0 2024-09-18T12:52:22.936 INFO:tasks.workunit.client.0.smithi045.stdout:0/665: rmdir d6/d7/dbf 0 2024-09-18T12:52:22.941 INFO:tasks.workunit.client.0.smithi045.stdout:1/660: mkdir d0/d2d/d2b/d30/d40/dc7 0 2024-09-18T12:52:22.942 INFO:tasks.workunit.client.0.smithi045.stdout:2/679: write d5/d5f/db2/f3d [607019,75134] 0 2024-09-18T12:52:22.943 INFO:tasks.workunit.client.0.smithi045.stdout:6/618: mkdir d9/d56/db3/dd7 0 2024-09-18T12:52:22.944 INFO:tasks.workunit.client.0.smithi045.stdout:7/557: dwrite d13/d44/d37/d70/d77/fa4 [0,4194304] 0 2024-09-18T12:52:22.945 INFO:tasks.workunit.client.0.smithi045.stdout:6/619: chown d9/d1a/d2d/c41 1448 1 2024-09-18T12:52:22.947 INFO:tasks.workunit.client.0.smithi045.stdout:3/562: dwrite d0/d29/f67 [4194304,4194304] 0 2024-09-18T12:52:22.947 INFO:tasks.workunit.client.0.smithi045.stdout:8/702: rename d11/d14/d72/da9/lc4 to d11/d8c/lce 0 2024-09-18T12:52:22.947 INFO:tasks.workunit.client.0.smithi045.stdout:7/558: dread - d13/d31/d5f/f73 zero size 2024-09-18T12:52:22.948 INFO:tasks.workunit.client.0.smithi045.stdout:5/723: truncate d6/d3e/daa/fb9 1509965 0 2024-09-18T12:52:22.955 INFO:tasks.workunit.client.0.smithi045.stdout:6/620: creat d9/d1a/d48/d7d/dcb/fd8 x:0 0 0 2024-09-18T12:52:22.958 INFO:tasks.workunit.client.0.smithi045.stdout:1/661: rename d0/d2d/d6c/db3 to d0/d2d/db1/dc6/dc8 0 2024-09-18T12:52:22.959 INFO:tasks.workunit.client.0.smithi045.stdout:7/559: creat d13/d31/d5f/fc6 x:0 0 0 2024-09-18T12:52:22.960 INFO:tasks.workunit.client.0.smithi045.stdout:3/563: creat d0/d1e/d2c/d3a/fbc x:0 0 0 2024-09-18T12:52:22.960 INFO:tasks.workunit.client.0.smithi045.stdout:5/724: dread - d6/d28/d2b/d51/d6c/f86 zero size 2024-09-18T12:52:22.962 INFO:tasks.workunit.client.0.smithi045.stdout:4/839: creat db/de/d1e/d3e/d9a/f116 x:0 0 0 2024-09-18T12:52:22.965 INFO:tasks.workunit.client.0.smithi045.stdout:3/564: rename d0/d22/f3d to d0/d1e/d2c/d3f/fbd 0 2024-09-18T12:52:22.965 INFO:tasks.workunit.client.0.smithi045.stdout:5/725: dread - d6/db/d19/d92/d61/da5/fa9 zero size 2024-09-18T12:52:22.968 INFO:tasks.workunit.client.0.smithi045.stdout:8/703: symlink d11/d20/d46/dc6/lcf 0 2024-09-18T12:52:22.970 INFO:tasks.workunit.client.0.smithi045.stdout:6/621: creat d9/d56/fd9 x:0 0 0 2024-09-18T12:52:22.971 INFO:tasks.workunit.client.0.smithi045.stdout:6/622: dread - d9/d56/db3/fc2 zero size 2024-09-18T12:52:22.973 INFO:tasks.workunit.client.0.smithi045.stdout:4/840: truncate db/de/d1e/d3e/d9a/f2b 4699878 0 2024-09-18T12:52:22.973 INFO:tasks.workunit.client.0.smithi045.stdout:8/704: creat d11/d76/fd0 x:0 0 0 2024-09-18T12:52:22.974 INFO:tasks.workunit.client.0.smithi045.stdout:4/841: symlink db/de/l117 0 2024-09-18T12:52:22.977 INFO:tasks.workunit.client.0.smithi045.stdout:8/705: chown d11/d7b 3 1 2024-09-18T12:52:22.981 INFO:tasks.workunit.client.0.smithi045.stdout:4/842: creat db/d2c/d35/d40/d6d/f118 x:0 0 0 2024-09-18T12:52:22.982 INFO:tasks.workunit.client.0.smithi045.stdout:6/623: rename d9/d1a/d48/d8f/d98/lcf to d9/d1a/d48/d75/dc7/lda 0 2024-09-18T12:52:22.983 INFO:tasks.workunit.client.0.smithi045.stdout:6/624: stat d9/d1a/d48/d75 0 2024-09-18T12:52:22.983 INFO:tasks.workunit.client.0.smithi045.stdout:6/625: chown d9/l20 0 1 2024-09-18T12:52:22.984 INFO:tasks.workunit.client.0.smithi045.stdout:7/560: truncate d13/d44/d4c/f62 1763966 0 2024-09-18T12:52:22.985 INFO:tasks.workunit.client.0.smithi045.stdout:8/706: chown d11/f17 43899118 1 2024-09-18T12:52:22.992 INFO:tasks.workunit.client.0.smithi045.stdout:4/843: rename db/de/d1e/d3e/l97 to db/d2c/d35/l119 0 2024-09-18T12:52:22.995 INFO:tasks.workunit.client.0.smithi045.stdout:8/707: mkdir d11/d20/d46/dd1 0 2024-09-18T12:52:23.000 INFO:tasks.workunit.client.0.smithi045.stdout:2/680: truncate d5/d3a/d6b/fc3 274058 0 2024-09-18T12:52:23.001 INFO:tasks.workunit.client.0.smithi045.stdout:0/666: dwrite d6/d48/d5e/d39/d58/f68 [0,4194304] 0 2024-09-18T12:52:23.005 INFO:tasks.workunit.client.0.smithi045.stdout:8/708: rename d11/d20/d46/l4e to d11/d20/d60/dc3/ld2 0 2024-09-18T12:52:23.006 INFO:tasks.workunit.client.0.smithi045.stdout:6/626: creat d9/d1a/d48/d8f/fdb x:0 0 0 2024-09-18T12:52:23.007 INFO:tasks.workunit.client.0.smithi045.stdout:1/662: truncate d0/d2d/d2b/fb6 4067616 0 2024-09-18T12:52:23.010 INFO:tasks.workunit.client.0.smithi045.stdout:4/844: dread db/d2c/d35/d40/d77/fa7 [0,4194304] 0 2024-09-18T12:52:23.011 INFO:tasks.workunit.client.0.smithi045.stdout:5/726: write d6/db/d19/d92/d61/f72 [2905224,96611] 0 2024-09-18T12:52:23.012 INFO:tasks.workunit.client.0.smithi045.stdout:4/845: write db/de/f115 [945136,29728] 0 2024-09-18T12:52:23.012 INFO:tasks.workunit.client.0.smithi045.stdout:8/709: read d11/d20/fae [3924346,25495] 0 2024-09-18T12:52:23.015 INFO:tasks.workunit.client.0.smithi045.stdout:2/681: mknod d5/d46/ced 0 2024-09-18T12:52:23.022 INFO:tasks.workunit.client.0.smithi045.stdout:4/846: dwrite db/de/d1e/d3e/d47/d59/f87 [0,4194304] 0 2024-09-18T12:52:23.024 INFO:tasks.workunit.client.0.smithi045.stdout:1/663: write d0/d2d/fc2 [115446,21861] 0 2024-09-18T12:52:23.032 INFO:tasks.workunit.client.0.smithi045.stdout:6/627: mkdir d9/d1a/d2d/d32/db0/ddc 0 2024-09-18T12:52:23.033 INFO:tasks.workunit.client.0.smithi045.stdout:8/710: dwrite d11/d14/d53/d41/f9a [4194304,4194304] 0 2024-09-18T12:52:23.034 INFO:tasks.workunit.client.0.smithi045.stdout:1/664: dwrite d0/d2d/d2b/d30/d40/d60/d8f/fb8 [0,4194304] 0 2024-09-18T12:52:23.036 INFO:tasks.workunit.client.0.smithi045.stdout:4/847: creat db/de/d1a/d2e/f11a x:0 0 0 2024-09-18T12:52:23.041 INFO:tasks.workunit.client.0.smithi045.stdout:4/848: write db/de/d1e/d3e/d47/fbb [1648571,64120] 0 2024-09-18T12:52:23.049 INFO:tasks.workunit.client.0.smithi045.stdout:0/667: rename d6/d48/d5e/d39/fb0 to d6/d7/fc5 0 2024-09-18T12:52:23.050 INFO:tasks.workunit.client.0.smithi045.stdout:0/668: write d6/d48/d5e/d39/d58/d86/fc3 [143432,103745] 0 2024-09-18T12:52:23.051 INFO:tasks.workunit.client.0.smithi045.stdout:0/669: read d6/f98 [142716,37103] 0 2024-09-18T12:52:23.053 INFO:tasks.workunit.client.0.smithi045.stdout:6/628: creat d9/d1a/d2d/d32/db0/fdd x:0 0 0 2024-09-18T12:52:23.054 INFO:tasks.workunit.client.0.smithi045.stdout:6/629: chown d9/d1a/d2d/d38/d5b/d67 20920013 1 2024-09-18T12:52:23.054 INFO:tasks.workunit.client.0.smithi045.stdout:6/630: readlink d9/d1a/l73 0 2024-09-18T12:52:23.056 INFO:tasks.workunit.client.0.smithi045.stdout:8/711: unlink d11/d8c/d90/fa7 0 2024-09-18T12:52:23.058 INFO:tasks.workunit.client.0.smithi045.stdout:4/849: rmdir db/de/d1a/dbc 39 2024-09-18T12:52:23.063 INFO:tasks.workunit.client.0.smithi045.stdout:8/712: read d11/f5f [6660899,97860] 0 2024-09-18T12:52:23.064 INFO:tasks.workunit.client.0.smithi045.stdout:4/850: creat db/de/d1e/d3e/d47/f11b x:0 0 0 2024-09-18T12:52:23.067 INFO:tasks.workunit.client.0.smithi045.stdout:2/682: rename d5/d5f/l9c to d5/d3a/lee 0 2024-09-18T12:52:23.067 INFO:tasks.workunit.client.0.smithi045.stdout:8/713: dread d11/d76/f88 [8388608,4194304] 0 2024-09-18T12:52:23.069 INFO:tasks.workunit.client.0.smithi045.stdout:0/670: getdents d6/d35/d92 0 2024-09-18T12:52:23.070 INFO:tasks.workunit.client.0.smithi045.stdout:2/683: unlink d5/d5f/da8/d61/fbd 0 2024-09-18T12:52:23.071 INFO:tasks.workunit.client.0.smithi045.stdout:0/671: write d6/d48/d5e/d39/d58/d3b/d6b/fb3 [579774,123934] 0 2024-09-18T12:52:23.071 INFO:tasks.workunit.client.0.smithi045.stdout:8/714: truncate d11/d14/f1b 4383647 0 2024-09-18T12:52:23.074 INFO:tasks.workunit.client.0.smithi045.stdout:8/715: rename d11/d14/f19 to d11/d76/da0/da1/fd3 0 2024-09-18T12:52:23.075 INFO:tasks.workunit.client.0.smithi045.stdout:0/672: symlink d6/d7/lc6 0 2024-09-18T12:52:23.076 INFO:tasks.workunit.client.0.smithi045.stdout:2/684: rmdir d5/d5f/da8/deb 0 2024-09-18T12:52:23.076 INFO:tasks.workunit.client.0.smithi045.stdout:0/673: write d6/d35/f72 [171871,73135] 0 2024-09-18T12:52:23.076 INFO:tasks.workunit.client.0.smithi045.stdout:2/685: fsync d5/d5f/db2/fbf 0 2024-09-18T12:52:23.078 INFO:tasks.workunit.client.0.smithi045.stdout:2/686: write d5/d5f/da8/d61/fe9 [479288,48413] 0 2024-09-18T12:52:23.080 INFO:tasks.workunit.client.0.smithi045.stdout:2/687: creat d5/d5f/da8/fef x:0 0 0 2024-09-18T12:52:23.093 INFO:tasks.workunit.client.0.smithi045.stdout:8/716: truncate d11/f17 4566118 0 2024-09-18T12:52:23.094 INFO:tasks.workunit.client.0.smithi045.stdout:8/717: chown d11/d23/l85 135165 1 2024-09-18T12:52:23.098 INFO:tasks.workunit.client.0.smithi045.stdout:4/851: dread db/f30 [0,4194304] 0 2024-09-18T12:52:23.099 INFO:tasks.workunit.client.0.smithi045.stdout:8/718: creat d11/d20/d60/dc3/dbd/fd4 x:0 0 0 2024-09-18T12:52:23.101 INFO:tasks.workunit.client.0.smithi045.stdout:4/852: fdatasync db/d2c/d35/d40/d77/fa7 0 2024-09-18T12:52:23.103 INFO:tasks.workunit.client.0.smithi045.stdout:8/719: mkdir d11/d20/d60/dc3/dbd/dd5 0 2024-09-18T12:52:23.104 INFO:tasks.workunit.client.0.smithi045.stdout:8/720: fdatasync d11/d14/f36 0 2024-09-18T12:52:23.105 INFO:tasks.workunit.client.0.smithi045.stdout:4/853: symlink db/de/l11c 0 2024-09-18T12:52:23.105 INFO:tasks.workunit.client.0.smithi045.stdout:8/721: write d11/d7b/fa5 [1316971,28015] 0 2024-09-18T12:52:23.106 INFO:tasks.workunit.client.0.smithi045.stdout:4/854: fdatasync db/f63 0 2024-09-18T12:52:23.110 INFO:tasks.workunit.client.0.smithi045.stdout:8/722: dread d11/d14/f52 [0,4194304] 0 2024-09-18T12:52:23.111 INFO:tasks.workunit.client.0.smithi045.stdout:4/855: creat db/d20/d6b/f11d x:0 0 0 2024-09-18T12:52:23.115 INFO:tasks.workunit.client.0.smithi045.stdout:8/723: creat d11/d76/fd6 x:0 0 0 2024-09-18T12:52:23.115 INFO:tasks.workunit.client.0.smithi045.stdout:1/665: dwrite d0/d2d/f45 [0,4194304] 0 2024-09-18T12:52:23.116 INFO:tasks.workunit.client.0.smithi045.stdout:4/856: unlink db/c52 0 2024-09-18T12:52:23.125 INFO:tasks.workunit.client.0.smithi045.stdout:1/666: read d0/d12/d32/d67/d6a/faf [18412,111351] 0 2024-09-18T12:52:23.125 INFO:tasks.workunit.client.0.smithi045.stdout:8/724: dwrite d11/d76/fd0 [0,4194304] 0 2024-09-18T12:52:23.126 INFO:tasks.workunit.client.0.smithi045.stdout:6/631: truncate d9/d1a/d2d/d38/f44 3781058 0 2024-09-18T12:52:23.129 INFO:tasks.workunit.client.0.smithi045.stdout:4/857: dwrite db/de/fae [0,4194304] 0 2024-09-18T12:52:23.131 INFO:tasks.workunit.client.0.smithi045.stdout:6/632: creat d9/d1a/d48/d8f/d98/fde x:0 0 0 2024-09-18T12:52:23.133 INFO:tasks.workunit.client.0.smithi045.stdout:4/858: mknod db/de9/c11e 0 2024-09-18T12:52:23.135 INFO:tasks.workunit.client.0.smithi045.stdout:1/667: dwrite d0/d12/d32/d67/d6a/fb2 [0,4194304] 0 2024-09-18T12:52:23.136 INFO:tasks.workunit.client.0.smithi045.stdout:4/859: write db/de/d1e/d3e/d9a/d73/fc3 [1728422,85356] 0 2024-09-18T12:52:23.139 INFO:tasks.workunit.client.0.smithi045.stdout:0/674: truncate d6/d7/f1f 4033743 0 2024-09-18T12:52:23.143 INFO:tasks.workunit.client.0.smithi045.stdout:8/725: unlink d11/d76/da0/da1/fd3 0 2024-09-18T12:52:23.147 INFO:tasks.workunit.client.0.smithi045.stdout:1/668: rename d0/d12/d32/d67/d6d/f95 to d0/d2d/d2b/d30/d40/fc9 0 2024-09-18T12:52:23.148 INFO:tasks.workunit.client.0.smithi045.stdout:1/669: read d0/d2d/f68 [242243,48139] 0 2024-09-18T12:52:23.149 INFO:tasks.workunit.client.0.smithi045.stdout:1/670: write d0/d2d/f53 [5458921,29930] 0 2024-09-18T12:52:23.152 INFO:tasks.workunit.client.0.smithi045.stdout:0/675: write d6/d48/d5e/d39/d58/d3c/f47 [3694516,18846] 0 2024-09-18T12:52:23.156 INFO:tasks.workunit.client.0.smithi045.stdout:6/633: mkdir d9/d1a/d2d/ddf 0 2024-09-18T12:52:23.157 INFO:tasks.workunit.client.0.smithi045.stdout:1/671: dwrite d0/d2d/d2b/f9b [0,4194304] 0 2024-09-18T12:52:23.159 INFO:tasks.workunit.client.0.smithi045.stdout:1/672: fdatasync d0/d2d/d2b/d30/d40/d60/d8f/f97 0 2024-09-18T12:52:23.168 INFO:tasks.workunit.client.0.smithi045.stdout:4/860: link db/de/d1e/d3e/d47/d59/d7a/f8b db/de/d1e/d3e/d47/d59/d2f/f11f 0 2024-09-18T12:52:23.169 INFO:tasks.workunit.client.0.smithi045.stdout:4/861: stat db/de/d1e/d3e/d47/d59/d7a/c8f 0 2024-09-18T12:52:23.169 INFO:tasks.workunit.client.0.smithi045.stdout:4/862: stat db/de/d1e/d3e/d78/d109 0 2024-09-18T12:52:23.170 INFO:tasks.workunit.client.0.smithi045.stdout:4/863: chown db/d2c/dcd 99965 1 2024-09-18T12:52:23.176 INFO:tasks.workunit.client.0.smithi045.stdout:8/726: mkdir d11/d14/dd7 0 2024-09-18T12:52:23.177 INFO:tasks.workunit.client.0.smithi045.stdout:4/864: dwrite db/de/f10a [0,4194304] 0 2024-09-18T12:52:23.178 INFO:tasks.workunit.client.0.smithi045.stdout:4/865: dread - db/de/d1a/d2e/f11a zero size 2024-09-18T12:52:23.179 INFO:tasks.workunit.client.0.smithi045.stdout:1/673: symlink d0/d12/d6f/lca 0 2024-09-18T12:52:23.189 INFO:tasks.workunit.client.0.smithi045.stdout:8/727: mknod d11/d76/da0/cd8 0 2024-09-18T12:52:23.189 INFO:tasks.workunit.client.0.smithi045.stdout:1/674: mknod d0/d12/d32/d67/d6d/d9c/ccb 0 2024-09-18T12:52:23.191 INFO:tasks.workunit.client.0.smithi045.stdout:1/675: write d0/d2d/d2b/d30/d40/d60/d8f/fb8 [265403,112997] 0 2024-09-18T12:52:23.196 INFO:tasks.workunit.client.0.smithi045.stdout:8/728: rmdir d11/d14/d72 39 2024-09-18T12:52:23.200 INFO:tasks.workunit.client.0.smithi045.stdout:0/676: link d6/d48/d5e/d39/d58/d3b/d65/c71 d6/d35/d92/cc7 0 2024-09-18T12:52:23.202 INFO:tasks.workunit.client.0.smithi045.stdout:0/677: truncate d6/d48/d5e/d39/d58/d86/fad 534003 0 2024-09-18T12:52:23.204 INFO:tasks.workunit.client.0.smithi045.stdout:6/634: getdents d9 0 2024-09-18T12:52:23.207 INFO:tasks.workunit.client.0.smithi045.stdout:6/635: dread - d9/d1a/d48/d8f/d98/fde zero size 2024-09-18T12:52:23.210 INFO:tasks.workunit.client.0.smithi045.stdout:4/866: link db/d20/d6b/l96 db/de/d1e/d3e/l120 0 2024-09-18T12:52:23.212 INFO:tasks.workunit.client.0.smithi045.stdout:0/678: mkdir d6/d48/d5e/d39/d58/db5/dc8 0 2024-09-18T12:52:23.213 INFO:tasks.workunit.client.0.smithi045.stdout:1/676: link d0/d12/da7/lb7 d0/d2d/d2b/d30/d40/lcc 0 2024-09-18T12:52:23.215 INFO:tasks.workunit.client.0.smithi045.stdout:4/867: stat f9 0 2024-09-18T12:52:23.216 INFO:tasks.workunit.client.0.smithi045.stdout:6/636: dwrite d9/d1a/d48/d75/fc8 [0,4194304] 0 2024-09-18T12:52:23.219 INFO:tasks.workunit.client.0.smithi045.stdout:4/868: chown db/de/d1e/d3e/d9a/da2 827154 1 2024-09-18T12:52:23.219 INFO:tasks.workunit.client.0.smithi045.stdout:6/637: readlink d9/d1a/d48/d7d/lc4 0 2024-09-18T12:52:23.220 INFO:tasks.workunit.client.0.smithi045.stdout:8/729: read d11/d76/da0/f89 [320185,126086] 0 2024-09-18T12:52:23.221 INFO:tasks.workunit.client.0.smithi045.stdout:1/677: creat d0/d2d/db1/dc6/dc8/fcd x:0 0 0 2024-09-18T12:52:23.224 INFO:tasks.workunit.client.0.smithi045.stdout:4/869: mkdir db/d20/d121 0 2024-09-18T12:52:23.229 INFO:tasks.workunit.client.0.smithi045.stdout:1/678: creat d0/d12/d32/d67/fce x:0 0 0 2024-09-18T12:52:23.232 INFO:tasks.workunit.client.0.smithi045.stdout:4/870: mkdir db/de/d1e/d3e/d9a/d73/dce/d122 0 2024-09-18T12:52:23.235 INFO:tasks.workunit.client.0.smithi045.stdout:8/730: link d11/d23/f9d d11/d76/da0/da1/dca/fd9 0 2024-09-18T12:52:23.235 INFO:tasks.workunit.client.0.smithi045.stdout:3/565: dread d0/d1e/d39/db7/fa2 [0,4194304] 0 2024-09-18T12:52:23.241 INFO:tasks.workunit.client.0.smithi045.stdout:3/566: fsync d0/f1a 0 2024-09-18T12:52:23.242 INFO:tasks.workunit.client.0.smithi045.stdout:6/638: dread d9/d1a/d48/fb9 [0,4194304] 0 2024-09-18T12:52:23.244 INFO:tasks.workunit.client.0.smithi045.stdout:7/561: dread d13/d31/f2d [0,4194304] 0 2024-09-18T12:52:23.245 INFO:tasks.workunit.client.0.smithi045.stdout:1/679: dread d0/d12/d6f/f87 [0,4194304] 0 2024-09-18T12:52:23.250 INFO:tasks.workunit.client.0.smithi045.stdout:7/562: unlink d13/d1a/f41 0 2024-09-18T12:52:23.254 INFO:tasks.workunit.client.0.smithi045.stdout:1/680: mknod d0/d2d/d92/ccf 0 2024-09-18T12:52:23.255 INFO:tasks.workunit.client.0.smithi045.stdout:0/679: truncate d6/d35/f37 2706922 0 2024-09-18T12:52:23.255 INFO:tasks.workunit.client.0.smithi045.stdout:1/681: write d0/d12/d32/d67/f98 [792265,35524] 0 2024-09-18T12:52:23.260 INFO:tasks.workunit.client.0.smithi045.stdout:7/563: unlink d13/d44/d37/d6a/da3/lb4 0 2024-09-18T12:52:23.262 INFO:tasks.workunit.client.0.smithi045.stdout:8/731: link d11/d14/d53/d41/d75/fbb d11/d76/da0/da1/dca/fda 0 2024-09-18T12:52:23.262 INFO:tasks.workunit.client.0.smithi045.stdout:4/871: write db/de/d1e/d3e/d47/d59/d2f/f11f [3380132,61661] 0 2024-09-18T12:52:23.263 INFO:tasks.workunit.client.0.smithi045.stdout:0/680: dwrite d6/d48/d5e/d39/d58/d3b/d6b/fb3 [0,4194304] 0 2024-09-18T12:52:23.270 INFO:tasks.workunit.client.0.smithi045.stdout:8/732: rmdir d11/d20/d60/dc3/dbd 39 2024-09-18T12:52:23.270 INFO:tasks.workunit.client.0.smithi045.stdout:3/567: write d0/d1e/f38 [911408,28173] 0 2024-09-18T12:52:23.273 INFO:tasks.workunit.client.0.smithi045.stdout:1/682: mkdir d0/d2d/d2b/d30/d40/dc7/dd0 0 2024-09-18T12:52:23.273 INFO:tasks.workunit.client.0.smithi045.stdout:4/872: rmdir db/de/d1e/d3e/d47/d59/d7a 39 2024-09-18T12:52:23.275 INFO:tasks.workunit.client.0.smithi045.stdout:1/683: dread - d0/d2d/db1/dc6/dc8/fcd zero size 2024-09-18T12:52:23.281 INFO:tasks.workunit.client.0.smithi045.stdout:0/681: dwrite d6/d7/fc5 [0,4194304] 0 2024-09-18T12:52:23.282 INFO:tasks.workunit.client.0.smithi045.stdout:0/682: chown d6/d35/d92/lbc 498 1 2024-09-18T12:52:23.287 INFO:tasks.workunit.client.0.smithi045.stdout:1/684: symlink d0/d12/d32/d67/d6d/ld1 0 2024-09-18T12:52:23.288 INFO:tasks.workunit.client.0.smithi045.stdout:1/685: fsync d0/d2d/d2b/d30/fa6 0 2024-09-18T12:52:23.290 INFO:tasks.workunit.client.0.smithi045.stdout:8/733: truncate fd 4189411 0 2024-09-18T12:52:23.293 INFO:tasks.workunit.client.0.smithi045.stdout:0/683: rename d6/d35/f72 to d6/daa/db2/fc9 0 2024-09-18T12:52:23.295 INFO:tasks.workunit.client.0.smithi045.stdout:3/568: write d0/d29/d5f/d73/da0/fb5 [450917,121684] 0 2024-09-18T12:52:23.296 INFO:tasks.workunit.client.0.smithi045.stdout:1/686: dwrite d0/d2d/d2b/d30/fb9 [0,4194304] 0 2024-09-18T12:52:23.297 INFO:tasks.workunit.client.0.smithi045.stdout:1/687: fdatasync d0/d2d/d2b/d30/f4f 0 2024-09-18T12:52:23.300 INFO:tasks.workunit.client.0.smithi045.stdout:1/688: read d0/d2d/d2b/f2f [2385922,102595] 0 2024-09-18T12:52:23.303 INFO:tasks.workunit.client.0.smithi045.stdout:8/734: read d11/d14/d72/da9/fb0 [488651,58562] 0 2024-09-18T12:52:23.303 INFO:tasks.workunit.client.0.smithi045.stdout:7/564: truncate d13/d31/d5f/f69 3797448 0 2024-09-18T12:52:23.304 INFO:tasks.workunit.client.0.smithi045.stdout:8/735: chown d11/d14/d72/f73 3 1 2024-09-18T12:52:23.304 INFO:tasks.workunit.client.0.smithi045.stdout:0/684: rename d6/fc2 to d6/d35/d92/fca 0 2024-09-18T12:52:23.307 INFO:tasks.workunit.client.0.smithi045.stdout:3/569: mkdir d0/d1e/d2c/d3a/d45/dbe 0 2024-09-18T12:52:23.309 INFO:tasks.workunit.client.0.smithi045.stdout:8/736: dread d11/d76/da0/da1/dca/fd9 [0,4194304] 0 2024-09-18T12:52:23.311 INFO:tasks.workunit.client.0.smithi045.stdout:1/689: symlink d0/d12/d32/d67/d6a/ld2 0 2024-09-18T12:52:23.313 INFO:tasks.workunit.client.0.smithi045.stdout:1/690: chown d0/d12/da7/c38 22771440 1 2024-09-18T12:52:23.316 INFO:tasks.workunit.client.0.smithi045.stdout:8/737: dwrite d11/d76/da0/f8e [0,4194304] 0 2024-09-18T12:52:23.318 INFO:tasks.workunit.client.0.smithi045.stdout:7/565: symlink d13/d44/d37/lc7 0 2024-09-18T12:52:23.332 INFO:tasks.workunit.client.0.smithi045.stdout:1/691: mknod d0/d2d/d2b/d30/d40/d60/d8f/cd3 0 2024-09-18T12:52:23.332 INFO:tasks.workunit.client.0.smithi045.stdout:0/685: write f4 [1608122,18412] 0 2024-09-18T12:52:23.337 INFO:tasks.workunit.client.0.smithi045.stdout:8/738: dread d11/d20/f3c [0,4194304] 0 2024-09-18T12:52:23.338 INFO:tasks.workunit.client.0.smithi045.stdout:0/686: symlink d6/d35/d92/lcb 0 2024-09-18T12:52:23.338 INFO:tasks.workunit.client.0.smithi045.stdout:8/739: write d11/d14/f36 [271208,28740] 0 2024-09-18T12:52:23.339 INFO:tasks.workunit.client.0.smithi045.stdout:1/692: rmdir d0/d2d/d2b/d30/d40/d60/d8f 39 2024-09-18T12:52:23.340 INFO:tasks.workunit.client.0.smithi045.stdout:1/693: fsync d0/d2d/d2b/d30/d8b/f7c 0 2024-09-18T12:52:23.341 INFO:tasks.workunit.client.0.smithi045.stdout:7/566: unlink d13/f24 0 2024-09-18T12:52:23.341 INFO:tasks.workunit.client.0.smithi045.stdout:1/694: stat d0/d2d/f53 0 2024-09-18T12:52:23.348 INFO:tasks.workunit.client.0.smithi045.stdout:1/695: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:52:23.355 INFO:tasks.workunit.client.0.smithi045.stdout:0/687: truncate d6/d48/d5e/d39/d58/d3b/d6b/f8c 268107 0 2024-09-18T12:52:23.356 INFO:tasks.workunit.client.0.smithi045.stdout:0/688: dread - d6/d48/d5e/d39/d58/d3b/fa8 zero size 2024-09-18T12:52:23.358 INFO:tasks.workunit.client.0.smithi045.stdout:1/696: rename d0/d12/da7/c38 to d0/d12/d32/d67/d6d/cd4 0 2024-09-18T12:52:23.361 INFO:tasks.workunit.client.0.smithi045.stdout:8/740: write d11/d14/f1b [4585840,78511] 0 2024-09-18T12:52:23.364 INFO:tasks.workunit.client.0.smithi045.stdout:0/689: link d6/d48/d5e/d39/d58/d3c/fb7 d6/d48/d5e/d39/d58/d66/fcc 0 2024-09-18T12:52:23.367 INFO:tasks.workunit.client.0.smithi045.stdout:7/567: write fc [9261643,62774] 0 2024-09-18T12:52:23.368 INFO:tasks.workunit.client.0.smithi045.stdout:1/697: dwrite d0/f6 [0,4194304] 0 2024-09-18T12:52:23.375 INFO:tasks.workunit.client.0.smithi045.stdout:8/741: write d11/d20/d46/f43 [4894013,73856] 0 2024-09-18T12:52:23.378 INFO:tasks.workunit.client.0.smithi045.stdout:7/568: dwrite d13/d44/d37/d70/f79 [0,4194304] 0 2024-09-18T12:52:23.386 INFO:tasks.workunit.client.0.smithi045.stdout:8/742: rmdir d11/d20/d46/dd1 0 2024-09-18T12:52:23.387 INFO:tasks.workunit.client.0.smithi045.stdout:9/551: sync 2024-09-18T12:52:23.387 INFO:tasks.workunit.client.0.smithi045.stdout:7/569: creat d13/d44/d37/d70/d77/fc8 x:0 0 0 2024-09-18T12:52:23.388 INFO:tasks.workunit.client.0.smithi045.stdout:8/743: mknod d11/d14/d53/cdb 0 2024-09-18T12:52:23.389 INFO:tasks.workunit.client.0.smithi045.stdout:7/570: creat d13/d31/d33/fc9 x:0 0 0 2024-09-18T12:52:23.392 INFO:tasks.workunit.client.0.smithi045.stdout:9/552: chown d0/d3/d6/d10/d26/d2e/d4e/d76/ca3 4416273 1 2024-09-18T12:52:23.393 INFO:tasks.workunit.client.0.smithi045.stdout:7/571: fdatasync d13/d31/d5f/d94/f7f 0 2024-09-18T12:52:23.394 INFO:tasks.workunit.client.0.smithi045.stdout:9/553: chown d0/d3/d6/d10/d26/c45 80543096 1 2024-09-18T12:52:23.397 INFO:tasks.workunit.client.0.smithi045.stdout:7/572: mkdir d13/d31/d52/d81/dca 0 2024-09-18T12:52:23.403 INFO:tasks.workunit.client.0.smithi045.stdout:7/573: creat d13/d31/d33/fcb x:0 0 0 2024-09-18T12:52:23.403 INFO:tasks.workunit.client.0.smithi045.stdout:0/690: dread d6/d48/f6f [0,4194304] 0 2024-09-18T12:52:23.403 INFO:tasks.workunit.client.0.smithi045.stdout:7/574: readlink lf 0 2024-09-18T12:52:23.403 INFO:tasks.workunit.client.0.smithi045.stdout:8/744: dread f6 [0,4194304] 0 2024-09-18T12:52:23.404 INFO:tasks.workunit.client.0.smithi045.stdout:0/691: chown d6/d48/d5e/d39/d58/d86 1447189687 1 2024-09-18T12:52:23.408 INFO:tasks.workunit.client.0.smithi045.stdout:0/692: rmdir d6/daa 39 2024-09-18T12:52:23.410 INFO:tasks.workunit.client.0.smithi045.stdout:8/745: mkdir d11/d14/ddc 0 2024-09-18T12:52:23.412 INFO:tasks.workunit.client.0.smithi045.stdout:0/693: creat d6/d48/fcd x:0 0 0 2024-09-18T12:52:23.412 INFO:tasks.workunit.client.0.smithi045.stdout:7/575: fdatasync d13/d1a/d28/f39 0 2024-09-18T12:52:23.414 INFO:tasks.workunit.client.0.smithi045.stdout:7/576: write d13/d31/d52/d81/f9d [861644,64351] 0 2024-09-18T12:52:23.416 INFO:tasks.workunit.client.0.smithi045.stdout:7/577: write d13/d44/d37/d70/fb7 [586065,83721] 0 2024-09-18T12:52:23.418 INFO:tasks.workunit.client.0.smithi045.stdout:8/746: link d11/d20/d60/c5e d11/d20/d46/cdd 0 2024-09-18T12:52:23.422 INFO:tasks.workunit.client.0.smithi045.stdout:8/747: creat d11/d20/d60/fde x:0 0 0 2024-09-18T12:52:23.423 INFO:tasks.workunit.client.0.smithi045.stdout:7/578: dread d13/d44/f87 [0,4194304] 0 2024-09-18T12:52:23.424 INFO:tasks.workunit.client.0.smithi045.stdout:9/554: dwrite d0/fc [0,4194304] 0 2024-09-18T12:52:23.426 INFO:tasks.workunit.client.0.smithi045.stdout:0/694: link d6/d48/d5e/d39/d58/d3c/d69/c70 d6/d7/cce 0 2024-09-18T12:52:23.430 INFO:tasks.workunit.client.0.smithi045.stdout:9/555: read d0/d3/f7 [4222910,3093] 0 2024-09-18T12:52:23.433 INFO:tasks.workunit.client.0.smithi045.stdout:8/748: creat d11/fdf x:0 0 0 2024-09-18T12:52:23.433 INFO:tasks.workunit.client.0.smithi045.stdout:8/749: readlink d11/d7b/lb9 0 2024-09-18T12:52:23.435 INFO:tasks.workunit.client.0.smithi045.stdout:0/695: rmdir d6/d48/d5e/d39/d58/d3c/d69 39 2024-09-18T12:52:23.437 INFO:tasks.workunit.client.0.smithi045.stdout:9/556: mknod d0/d3/d6/d10/d26/d2e/d4e/d76/d89/cb1 0 2024-09-18T12:52:23.439 INFO:tasks.workunit.client.0.smithi045.stdout:8/750: rename d11/d8c/d90 to d11/d14/d72/da9/dc5/de0 0 2024-09-18T12:52:23.440 INFO:tasks.workunit.client.0.smithi045.stdout:8/751: write d11/d14/d72/da9/fab [156723,55337] 0 2024-09-18T12:52:23.441 INFO:tasks.workunit.client.0.smithi045.stdout:8/752: fsync d11/d14/f1b 0 2024-09-18T12:52:23.441 INFO:tasks.workunit.client.0.smithi045.stdout:0/696: creat d6/d7/d32/d9b/fcf x:0 0 0 2024-09-18T12:52:23.443 INFO:tasks.workunit.client.0.smithi045.stdout:9/557: creat d0/d3/d6/d10/d26/d2e/d6f/da5/fb2 x:0 0 0 2024-09-18T12:52:23.446 INFO:tasks.workunit.client.0.smithi045.stdout:8/753: stat d11/d20/d60/dc3/dbd 0 2024-09-18T12:52:23.447 INFO:tasks.workunit.client.0.smithi045.stdout:0/697: mknod d6/d48/d5e/d39/d58/d3b/d65/cd0 0 2024-09-18T12:52:23.449 INFO:tasks.workunit.client.0.smithi045.stdout:7/579: link d13/d44/d37/d70/d77/c47 d13/d31/ccc 0 2024-09-18T12:52:23.450 INFO:tasks.workunit.client.0.smithi045.stdout:7/580: write d13/d44/d37/d70/d77/fc8 [228708,5494] 0 2024-09-18T12:52:23.451 INFO:tasks.workunit.client.0.smithi045.stdout:8/754: rename d11/d7b/fa8 to d11/d76/da0/fe1 0 2024-09-18T12:52:23.452 INFO:tasks.workunit.client.0.smithi045.stdout:0/698: chown d6/d48/d5e/d39/d58/d3b/cba 371280941 1 2024-09-18T12:52:23.452 INFO:tasks.workunit.client.0.smithi045.stdout:8/755: write d11/d20/d60/da3/fb5 [952502,17545] 0 2024-09-18T12:52:23.459 INFO:tasks.workunit.client.0.smithi045.stdout:0/699: rmdir d6/d35/d92 39 2024-09-18T12:52:23.464 INFO:tasks.workunit.client.0.smithi045.stdout:8/756: rename d11/d20/f71 to d11/d14/ddc/fe2 0 2024-09-18T12:52:23.466 INFO:tasks.workunit.client.0.smithi045.stdout:5/727: sync 2024-09-18T12:52:23.466 INFO:tasks.workunit.client.0.smithi045.stdout:2/688: sync 2024-09-18T12:52:23.466 INFO:tasks.workunit.client.0.smithi045.stdout:0/700: dwrite d6/f9d [0,4194304] 0 2024-09-18T12:52:23.467 INFO:tasks.workunit.client.0.smithi045.stdout:5/728: chown d6/l6f 3452782 1 2024-09-18T12:52:23.472 INFO:tasks.workunit.client.0.smithi045.stdout:9/558: write d0/d3/d6/f4f [538930,37275] 0 2024-09-18T12:52:23.478 INFO:tasks.workunit.client.0.smithi045.stdout:5/729: rename d6/d28 to d6/db/d54/de2 0 2024-09-18T12:52:23.478 INFO:tasks.workunit.client.0.smithi045.stdout:5/730: stat d6/lcd 0 2024-09-18T12:52:23.481 INFO:tasks.workunit.client.0.smithi045.stdout:2/689: mknod d5/cf0 0 2024-09-18T12:52:23.484 INFO:tasks.workunit.client.0.smithi045.stdout:7/581: getdents d13/d31 0 2024-09-18T12:52:23.486 INFO:tasks.workunit.client.0.smithi045.stdout:7/582: truncate d13/d44/d4c/fba 964242 0 2024-09-18T12:52:23.486 INFO:tasks.workunit.client.0.smithi045.stdout:0/701: creat d6/daa/db2/fd1 x:0 0 0 2024-09-18T12:52:23.487 INFO:tasks.workunit.client.0.smithi045.stdout:7/583: fdatasync d13/d31/d52/f91 0 2024-09-18T12:52:23.489 INFO:tasks.workunit.client.0.smithi045.stdout:5/731: mknod d6/db/d70/ce3 0 2024-09-18T12:52:23.490 INFO:tasks.workunit.client.0.smithi045.stdout:2/690: mkdir d5/d5f/da8/d61/dbb/dc6/df1 0 2024-09-18T12:52:23.490 INFO:tasks.workunit.client.0.smithi045.stdout:9/559: dread d0/d3/d6/d10/d2c/f30 [0,4194304] 0 2024-09-18T12:52:23.492 INFO:tasks.workunit.client.0.smithi045.stdout:7/584: chown d13/d44/d37/d70/d77/c47 23326549 1 2024-09-18T12:52:23.492 INFO:tasks.workunit.client.0.smithi045.stdout:9/560: chown d0/d3/d6/d10/d26/d2e/d4e/f5a 1145578 1 2024-09-18T12:52:23.493 INFO:tasks.workunit.client.0.smithi045.stdout:7/585: write d13/d44/d4c/fba [1585813,52148] 0 2024-09-18T12:52:23.494 INFO:tasks.workunit.client.0.smithi045.stdout:5/732: mkdir d6/db/d5a/d78/d66/de4 0 2024-09-18T12:52:23.498 INFO:tasks.workunit.client.0.smithi045.stdout:7/586: chown d13/d1a/d28/f34 779924026 1 2024-09-18T12:52:23.499 INFO:tasks.workunit.client.0.smithi045.stdout:0/702: creat d6/d35/fd2 x:0 0 0 2024-09-18T12:52:23.500 INFO:tasks.workunit.client.0.smithi045.stdout:5/733: rmdir d6/db/d5a 39 2024-09-18T12:52:23.506 INFO:tasks.workunit.client.0.smithi045.stdout:7/587: stat d13/d31/d33/f6e 0 2024-09-18T12:52:23.511 INFO:tasks.workunit.client.0.smithi045.stdout:9/561: dwrite d0/d3/d6/d10/d26/d2e/f48 [0,4194304] 0 2024-09-18T12:52:23.516 INFO:tasks.workunit.client.0.smithi045.stdout:0/703: dwrite d6/d48/d5e/d39/d58/d66/fa4 [0,4194304] 0 2024-09-18T12:52:23.521 INFO:tasks.workunit.client.0.smithi045.stdout:5/734: dread d6/db/fe [0,4194304] 0 2024-09-18T12:52:23.521 INFO:tasks.workunit.client.0.smithi045.stdout:7/588: creat d13/d1a/d28/fcd x:0 0 0 2024-09-18T12:52:23.528 INFO:tasks.workunit.client.0.smithi045.stdout:2/691: dwrite d5/d2c/d4d/d76/fa7 [0,4194304] 0 2024-09-18T12:52:23.534 INFO:tasks.workunit.client.0.smithi045.stdout:9/562: truncate d0/f9e 2468843 0 2024-09-18T12:52:23.536 INFO:tasks.workunit.client.0.smithi045.stdout:5/735: rename d6/db/d19/dbc/fdd to d6/db/d19/fe5 0 2024-09-18T12:52:23.538 INFO:tasks.workunit.client.0.smithi045.stdout:0/704: link d6/d48/d5e/fc4 d6/daa/db2/fd3 0 2024-09-18T12:52:23.539 INFO:tasks.workunit.client.0.smithi045.stdout:0/705: dread - d6/d7/fae zero size 2024-09-18T12:52:23.549 INFO:tasks.workunit.client.0.smithi045.stdout:9/563: fsync d0/d3/f31 0 2024-09-18T12:52:23.553 INFO:tasks.workunit.client.0.smithi045.stdout:5/736: write d6/db/d54/de2/d2b/d51/fb7 [885259,128847] 0 2024-09-18T12:52:23.555 INFO:tasks.workunit.client.0.smithi045.stdout:2/692: truncate d5/d5f/da8/f64 2176270 0 2024-09-18T12:52:23.557 INFO:tasks.workunit.client.0.smithi045.stdout:7/589: dwrite d13/d44/d37/d70/d77/f60 [0,4194304] 0 2024-09-18T12:52:23.559 INFO:tasks.workunit.client.0.smithi045.stdout:2/693: fsync d5/d2c/d4d/d76/d93/fe3 0 2024-09-18T12:52:23.565 INFO:tasks.workunit.client.0.smithi045.stdout:0/706: write d6/daa/db2/fd3 [67817,62382] 0 2024-09-18T12:52:23.567 INFO:tasks.workunit.client.0.smithi045.stdout:0/707: chown d6/d48/d5e/c61 9192535 1 2024-09-18T12:52:23.568 INFO:tasks.workunit.client.0.smithi045.stdout:0/708: write d6/d35/f50 [233088,119525] 0 2024-09-18T12:52:23.569 INFO:tasks.workunit.client.0.smithi045.stdout:7/590: creat d13/d44/d37/fce x:0 0 0 2024-09-18T12:52:23.571 INFO:tasks.workunit.client.0.smithi045.stdout:7/591: write d13/d44/d37/fbc [1035014,80609] 0 2024-09-18T12:52:23.574 INFO:tasks.workunit.client.0.smithi045.stdout:7/592: read d13/d31/d5f/d94/f7f [3559641,17676] 0 2024-09-18T12:52:23.576 INFO:tasks.workunit.client.0.smithi045.stdout:7/593: fsync d13/d44/d37/d70/d77/d6d/fa2 0 2024-09-18T12:52:23.577 INFO:tasks.workunit.client.0.smithi045.stdout:9/564: unlink d0/d3/d6/d10/d26/l95 0 2024-09-18T12:52:23.578 INFO:tasks.workunit.client.0.smithi045.stdout:2/694: dread d5/d2c/d4d/f28 [0,4194304] 0 2024-09-18T12:52:23.583 INFO:tasks.workunit.client.0.smithi045.stdout:5/737: dread d6/d3e/f36 [0,4194304] 0 2024-09-18T12:52:23.588 INFO:tasks.workunit.client.0.smithi045.stdout:7/594: mknod d13/d31/d33/d64/d78/ccf 0 2024-09-18T12:52:23.590 INFO:tasks.workunit.client.0.smithi045.stdout:2/695: creat d5/d2c/ff2 x:0 0 0 2024-09-18T12:52:23.593 INFO:tasks.workunit.client.0.smithi045.stdout:0/709: unlink d6/d48/d5e/d39/d58/d3c/d69/l7b 0 2024-09-18T12:52:23.601 INFO:tasks.workunit.client.0.smithi045.stdout:7/595: rmdir d13/d31/d52 39 2024-09-18T12:52:23.604 INFO:tasks.workunit.client.0.smithi045.stdout:2/696: creat d5/d5f/da8/d61/dbb/dc6/ff3 x:0 0 0 2024-09-18T12:52:23.606 INFO:tasks.workunit.client.0.smithi045.stdout:2/697: stat d5/d46/de0 0 2024-09-18T12:52:23.608 INFO:tasks.workunit.client.0.smithi045.stdout:2/698: dread d5/d3a/d3e/f74 [0,4194304] 0 2024-09-18T12:52:23.609 INFO:tasks.workunit.client.0.smithi045.stdout:9/565: link d0/d3/d6/d10/d2c/d63/f87 d0/d3/d6/d10/d26/da4/fb3 0 2024-09-18T12:52:23.627 INFO:tasks.workunit.client.0.smithi045.stdout:7/596: rename d13/d44/d37/d70/d77/d6d/la0 to d13/d44/d4c/d82/ld0 0 2024-09-18T12:52:23.633 INFO:tasks.workunit.client.0.smithi045.stdout:5/738: dwrite d6/db/d54/de2/fd0 [0,4194304] 0 2024-09-18T12:52:23.636 INFO:tasks.workunit.client.0.smithi045.stdout:2/699: dread d5/d5f/db2/f55 [0,4194304] 0 2024-09-18T12:52:23.638 INFO:tasks.workunit.client.0.smithi045.stdout:7/597: dwrite d13/d44/d37/d70/d77/d6d/fa2 [0,4194304] 0 2024-09-18T12:52:23.648 INFO:tasks.workunit.client.0.smithi045.stdout:0/710: link d6/d48/d5e/d39/d58/d86/f8f d6/d48/d5e/d39/d58/fd4 0 2024-09-18T12:52:23.650 INFO:tasks.workunit.client.0.smithi045.stdout:2/700: fsync d5/d5f/db2/f4f 0 2024-09-18T12:52:23.650 INFO:tasks.workunit.client.0.smithi045.stdout:0/711: read d6/d48/d5e/f44 [1676462,28754] 0 2024-09-18T12:52:23.652 INFO:tasks.workunit.client.0.smithi045.stdout:5/739: truncate d6/db/d54/de2/d2b/f4e 1820399 0 2024-09-18T12:52:23.656 INFO:tasks.workunit.client.0.smithi045.stdout:5/740: read d6/db/fe [4173180,107700] 0 2024-09-18T12:52:23.659 INFO:tasks.workunit.client.0.smithi045.stdout:9/566: getdents d0/d3/d6/d10/d2c/d63 0 2024-09-18T12:52:23.663 INFO:tasks.workunit.client.0.smithi045.stdout:7/598: creat d13/d44/d37/d70/fd1 x:0 0 0 2024-09-18T12:52:23.667 INFO:tasks.workunit.client.0.smithi045.stdout:2/701: rename d5/d2c/c30 to d5/d46/cf4 0 2024-09-18T12:52:23.669 INFO:tasks.workunit.client.0.smithi045.stdout:9/567: unlink d0/d3/d6/l7a 0 2024-09-18T12:52:23.670 INFO:tasks.workunit.client.0.smithi045.stdout:9/568: readlink d0/d3/d6/d10/l56 0 2024-09-18T12:52:23.671 INFO:tasks.workunit.client.0.smithi045.stdout:0/712: mkdir d6/d48/d5e/d39/d58/d3b/dd5 0 2024-09-18T12:52:23.676 INFO:tasks.workunit.client.0.smithi045.stdout:5/741: link d6/d3e/f9b d6/d3e/fe6 0 2024-09-18T12:52:23.678 INFO:tasks.workunit.client.0.smithi045.stdout:2/702: creat d5/d5f/da8/d61/ff5 x:0 0 0 2024-09-18T12:52:23.679 INFO:tasks.workunit.client.0.smithi045.stdout:9/569: mkdir d0/d3/d6/d10/d26/d2e/d4e/db4 0 2024-09-18T12:52:23.688 INFO:tasks.workunit.client.0.smithi045.stdout:2/703: unlink d5/d2c/d6f/f81 0 2024-09-18T12:52:23.688 INFO:tasks.workunit.client.0.smithi045.stdout:0/713: dread d6/d48/d5e/d39/d58/d86/f8f [0,4194304] 0 2024-09-18T12:52:23.691 INFO:tasks.workunit.client.0.smithi045.stdout:9/570: creat d0/d3/d6/d9d/fb5 x:0 0 0 2024-09-18T12:52:23.696 INFO:tasks.workunit.client.0.smithi045.stdout:2/704: chown d5/d3a/da0 1530 1 2024-09-18T12:52:23.704 INFO:tasks.workunit.client.0.smithi045.stdout:7/599: rename d13/d1a/d9b/fc0 to d13/d31/d52/d81/fd2 0 2024-09-18T12:52:23.708 INFO:tasks.workunit.client.0.smithi045.stdout:9/571: mkdir d0/db6 0 2024-09-18T12:52:23.711 INFO:tasks.workunit.client.0.smithi045.stdout:7/600: symlink d13/d44/d37/ld3 0 2024-09-18T12:52:23.714 INFO:tasks.workunit.client.0.smithi045.stdout:0/714: creat d6/d48/d5e/d39/d58/d3b/fd6 x:0 0 0 2024-09-18T12:52:23.718 INFO:tasks.workunit.client.0.smithi045.stdout:2/705: getdents d5/d5f/da8/d61/dbb 0 2024-09-18T12:52:23.719 INFO:tasks.workunit.client.0.smithi045.stdout:2/706: chown d5/d2c/d4d/d76/cca 907 1 2024-09-18T12:52:23.723 INFO:tasks.workunit.client.0.smithi045.stdout:0/715: mknod d6/cd7 0 2024-09-18T12:52:23.726 INFO:tasks.workunit.client.0.smithi045.stdout:7/601: creat d13/d31/fd4 x:0 0 0 2024-09-18T12:52:23.726 INFO:tasks.workunit.client.0.smithi045.stdout:2/707: dread d5/d2c/d4d/f68 [0,4194304] 0 2024-09-18T12:52:23.727 INFO:tasks.workunit.client.0.smithi045.stdout:7/602: chown d13/d1a/d28 152627507 1 2024-09-18T12:52:23.727 INFO:tasks.workunit.client.0.smithi045.stdout:9/572: dread d0/f5c [0,4194304] 0 2024-09-18T12:52:23.728 INFO:tasks.workunit.client.0.smithi045.stdout:7/603: fsync d13/d44/d37/d70/fb7 0 2024-09-18T12:52:23.729 INFO:tasks.workunit.client.0.smithi045.stdout:2/708: write d5/d46/f7c [1074136,9269] 0 2024-09-18T12:52:23.730 INFO:tasks.workunit.client.0.smithi045.stdout:2/709: stat d5/f22 0 2024-09-18T12:52:23.730 INFO:tasks.workunit.client.0.smithi045.stdout:7/604: write d13/d44/d37/d6a/fc5 [99734,102568] 0 2024-09-18T12:52:23.735 INFO:tasks.workunit.client.0.smithi045.stdout:0/716: creat d6/d48/d5e/d39/d58/d3b/fd8 x:0 0 0 2024-09-18T12:52:23.736 INFO:tasks.workunit.client.0.smithi045.stdout:0/717: readlink d6/d35/l55 0 2024-09-18T12:52:23.742 INFO:tasks.workunit.client.0.smithi045.stdout:0/718: dwrite d6/d7/fc5 [0,4194304] 0 2024-09-18T12:52:23.744 INFO:tasks.workunit.client.0.smithi045.stdout:2/710: rename d5/f34 to d5/d5f/da8/d61/ff6 0 2024-09-18T12:52:23.747 INFO:tasks.workunit.client.0.smithi045.stdout:7/605: creat d13/d44/d37/d70/fd5 x:0 0 0 2024-09-18T12:52:23.749 INFO:tasks.workunit.client.0.smithi045.stdout:0/719: unlink d6/l87 0 2024-09-18T12:52:23.751 INFO:tasks.workunit.client.0.smithi045.stdout:9/573: link d0/f50 d0/d3/d6/fb7 0 2024-09-18T12:52:23.751 INFO:tasks.workunit.client.0.smithi045.stdout:9/574: chown d0/d3/d6/d10/d26/da4 618 1 2024-09-18T12:52:23.756 INFO:tasks.workunit.client.0.smithi045.stdout:5/742: truncate d6/db/d54/de2/d2b/d51/fb7 748308 0 2024-09-18T12:52:23.757 INFO:tasks.workunit.client.0.smithi045.stdout:0/720: readlink d6/d35/d92/lcb 0 2024-09-18T12:52:23.758 INFO:tasks.workunit.client.0.smithi045.stdout:2/711: link d5/d2c/d4d/f68 d5/d5f/da8/d61/dbb/dc6/dc7/ff7 0 2024-09-18T12:52:23.761 INFO:tasks.workunit.client.0.smithi045.stdout:7/606: truncate d13/d44/d4c/f62 235236 0 2024-09-18T12:52:23.763 INFO:tasks.workunit.client.0.smithi045.stdout:0/721: chown d6/d48/d5e/d39/d58/d3c/d73/f7f 2891 1 2024-09-18T12:52:23.772 INFO:tasks.workunit.client.0.smithi045.stdout:0/722: mkdir d6/d48/d5e/d39/d58/d3c/d69/dd9 0 2024-09-18T12:52:23.774 INFO:tasks.workunit.client.0.smithi045.stdout:9/575: link d0/d3/d6/d10/d2c/d63/f87 d0/d3/d6/d64/d77/d9a/fb8 0 2024-09-18T12:52:23.775 INFO:tasks.workunit.client.0.smithi045.stdout:2/712: dread d5/d5f/da8/fe2 [0,4194304] 0 2024-09-18T12:52:23.776 INFO:tasks.workunit.client.0.smithi045.stdout:9/576: truncate d0/d3/d6/d64/d77/da9/faf 832585 0 2024-09-18T12:52:23.778 INFO:tasks.workunit.client.0.smithi045.stdout:5/743: dread d6/db/d54/de2/d2b/d51/d6c/f8d [0,4194304] 0 2024-09-18T12:52:23.779 INFO:tasks.workunit.client.0.smithi045.stdout:5/744: chown d6/db/d19/d92/d61/da5/dc9 488 1 2024-09-18T12:52:23.780 INFO:tasks.workunit.client.0.smithi045.stdout:7/607: creat d13/d31/d52/d81/dca/fd6 x:0 0 0 2024-09-18T12:52:23.781 INFO:tasks.workunit.client.0.smithi045.stdout:5/745: chown d6/db/d54/de2/d2b/c9f 307 1 2024-09-18T12:52:23.783 INFO:tasks.workunit.client.0.smithi045.stdout:0/723: creat d6/d48/d5e/d39/d58/d3c/d73/fda x:0 0 0 2024-09-18T12:52:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:23 smithi045 ceph-mon[28315]: pgmap v34: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 144 MiB/s rd, 315 MiB/s wr, 662 op/s 2024-09-18T12:52:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:23 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:23 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:23 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:23 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:23.787 INFO:tasks.workunit.client.0.smithi045.stdout:2/713: symlink d5/d46/lf8 0 2024-09-18T12:52:23.790 INFO:tasks.workunit.client.0.smithi045.stdout:7/608: truncate d13/d31/d33/d64/d78/d90/fb9 906109 0 2024-09-18T12:52:23.790 INFO:tasks.workunit.client.0.smithi045.stdout:7/609: chown d13/fbf 551 1 2024-09-18T12:52:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:23 smithi161 ceph-mon[35784]: pgmap v34: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 144 MiB/s rd, 315 MiB/s wr, 662 op/s 2024-09-18T12:52:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:23 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:23 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:23 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:23 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:23.794 INFO:tasks.workunit.client.0.smithi045.stdout:5/746: mkdir d6/db/d54/de2/d2b/de7 0 2024-09-18T12:52:23.794 INFO:tasks.workunit.client.0.smithi045.stdout:0/724: getdents d6/d48/d5e/d39/d58/d3b/dd5 0 2024-09-18T12:52:23.795 INFO:tasks.workunit.client.0.smithi045.stdout:5/747: chown d6/db/d70/ce3 1 1 2024-09-18T12:52:23.796 INFO:tasks.workunit.client.0.smithi045.stdout:7/610: dread d13/f17 [0,4194304] 0 2024-09-18T12:52:23.798 INFO:tasks.workunit.client.0.smithi045.stdout:0/725: write d6/d48/d5e/d39/d58/d3b/d6b/fb3 [1430065,69212] 0 2024-09-18T12:52:23.800 INFO:tasks.workunit.client.0.smithi045.stdout:0/726: write d6/d48/d5e/d39/d58/d86/fc3 [1256218,23225] 0 2024-09-18T12:52:23.802 INFO:tasks.workunit.client.0.smithi045.stdout:7/611: readlink d13/d1a/l5e 0 2024-09-18T12:52:23.802 INFO:tasks.workunit.client.0.smithi045.stdout:5/748: dread d6/db/d54/de2/f88 [0,4194304] 0 2024-09-18T12:52:23.803 INFO:tasks.workunit.client.0.smithi045.stdout:5/749: dread - d6/db/d19/dbc/fd3 zero size 2024-09-18T12:52:23.807 INFO:tasks.workunit.client.0.smithi045.stdout:7/612: rename d13/d1a/c5a to d13/d1a/d28/cd7 0 2024-09-18T12:52:23.813 INFO:tasks.workunit.client.0.smithi045.stdout:7/613: dwrite d13/d31/d33/d64/d78/f8b [0,4194304] 0 2024-09-18T12:52:23.818 INFO:tasks.workunit.client.0.smithi045.stdout:2/714: write d5/d5f/da8/d61/ff6 [2526346,30923] 0 2024-09-18T12:52:23.818 INFO:tasks.workunit.client.0.smithi045.stdout:5/750: link d6/db/d19/d92/d5c/lb1 d6/db/d19/d92/le8 0 2024-09-18T12:52:23.818 INFO:tasks.workunit.client.0.smithi045.stdout:7/614: creat d13/d44/d37/d6a/da3/fd8 x:0 0 0 2024-09-18T12:52:23.820 INFO:tasks.workunit.client.0.smithi045.stdout:7/615: read - d13/d44/d37/d70/fd1 zero size 2024-09-18T12:52:23.824 INFO:tasks.workunit.client.0.smithi045.stdout:5/751: creat d6/d3e/fe9 x:0 0 0 2024-09-18T12:52:23.824 INFO:tasks.workunit.client.0.smithi045.stdout:0/727: dwrite d6/d48/f6f [0,4194304] 0 2024-09-18T12:52:23.825 INFO:tasks.workunit.client.0.smithi045.stdout:5/752: dread - d6/db/d19/fe5 zero size 2024-09-18T12:52:23.827 INFO:tasks.workunit.client.0.smithi045.stdout:2/715: fsync d5/d46/f73 0 2024-09-18T12:52:23.828 INFO:tasks.workunit.client.0.smithi045.stdout:7/616: rename d13/d31/d52/f91 to d13/d44/fd9 0 2024-09-18T12:52:23.829 INFO:tasks.workunit.client.0.smithi045.stdout:5/753: chown d6/db/d19/d92/d61/da5/c55 345942 1 2024-09-18T12:52:23.829 INFO:tasks.workunit.client.0.smithi045.stdout:7/617: write d13/d44/d37/d70/fb7 [1168688,124303] 0 2024-09-18T12:52:23.831 INFO:tasks.workunit.client.0.smithi045.stdout:7/618: write d13/d44/d37/d70/fc4 [70650,2719] 0 2024-09-18T12:52:23.851 INFO:tasks.workunit.client.0.smithi045.stdout:2/716: dread d5/d5f/da8/f6e [0,4194304] 0 2024-09-18T12:52:23.852 INFO:tasks.workunit.client.0.smithi045.stdout:2/717: dread - d5/d5f/da8/d61/fc2 zero size 2024-09-18T12:52:23.927 INFO:tasks.workunit.client.0.smithi045.stdout:6/639: sync 2024-09-18T12:52:23.998 INFO:tasks.workunit.client.0.smithi045.stdout:2/718: fdatasync d5/fb7 0 2024-09-18T12:52:24.000 INFO:tasks.workunit.client.0.smithi045.stdout:6/640: creat d9/d1a/d48/d8f/d98/dab/fe0 x:0 0 0 2024-09-18T12:52:24.007 INFO:tasks.workunit.client.0.smithi045.stdout:0/728: creat d6/fdb x:0 0 0 2024-09-18T12:52:24.016 INFO:tasks.workunit.client.0.smithi045.stdout:2/719: read d5/d5f/da8/f31 [2573467,76586] 0 2024-09-18T12:52:24.019 INFO:tasks.workunit.client.0.smithi045.stdout:6/641: rename d9/d1a/d1d to d9/d1a/d48/d7d/dcb/de1 0 2024-09-18T12:52:24.033 INFO:tasks.workunit.client.0.smithi045.stdout:6/642: mkdir d9/d56/db3/dc0/de2 0 2024-09-18T12:52:24.035 INFO:tasks.workunit.client.0.smithi045.stdout:5/754: link d6/d3e/daa/fb9 d6/db/d19/d92/d61/da5/fea 0 2024-09-18T12:52:24.036 INFO:tasks.workunit.client.0.smithi045.stdout:2/720: dread d5/d46/f7e [0,4194304] 0 2024-09-18T12:52:24.040 INFO:tasks.workunit.client.0.smithi045.stdout:6/643: readlink d9/d30/lba 0 2024-09-18T12:52:24.049 INFO:tasks.workunit.client.0.smithi045.stdout:6/644: chown d9/d1a/d48/d8f/d98/c95 1993401 1 2024-09-18T12:52:24.051 INFO:tasks.workunit.client.0.smithi045.stdout:5/755: mkdir d6/db/d6a/d6d/deb 0 2024-09-18T12:52:24.051 INFO:tasks.workunit.client.0.smithi045.stdout:2/721: dread d5/d5f/da8/f3b [0,4194304] 0 2024-09-18T12:52:24.055 INFO:tasks.workunit.client.0.smithi045.stdout:5/756: mkdir d6/db/dec 0 2024-09-18T12:52:24.057 INFO:tasks.workunit.client.0.smithi045.stdout:6/645: dwrite d9/d74/fa4 [0,4194304] 0 2024-09-18T12:52:24.065 INFO:tasks.workunit.client.0.smithi045.stdout:5/757: rename d6/db/d19/d92/d61/f65 to d6/db/d19/dbc/fed 0 2024-09-18T12:52:24.066 INFO:tasks.workunit.client.0.smithi045.stdout:6/646: dwrite d9/d1a/d48/d8f/d98/fde [0,4194304] 0 2024-09-18T12:52:24.068 INFO:tasks.workunit.client.0.smithi045.stdout:6/647: fsync d9/d1a/d48/d8f/fdb 0 2024-09-18T12:52:24.075 INFO:tasks.workunit.client.0.smithi045.stdout:5/758: dwrite d6/db/d19/d92/d61/f72 [4194304,4194304] 0 2024-09-18T12:52:24.079 INFO:tasks.workunit.client.0.smithi045.stdout:4/873: sync 2024-09-18T12:52:24.080 INFO:tasks.workunit.client.0.smithi045.stdout:5/759: stat d6/db/d5a/d78/l3c 0 2024-09-18T12:52:24.080 INFO:tasks.workunit.client.0.smithi045.stdout:4/874: chown db/de/d1a/ff3 396973213 1 2024-09-18T12:52:24.082 INFO:tasks.workunit.client.0.smithi045.stdout:4/875: write db/de/d1e/d3e/d9a/f7c [4563199,32405] 0 2024-09-18T12:52:24.084 INFO:tasks.workunit.client.0.smithi045.stdout:5/760: write d6/dc7/fca [7349363,61469] 0 2024-09-18T12:52:24.084 INFO:tasks.workunit.client.0.smithi045.stdout:4/876: write db/d2c/d35/d40/d77/fa7 [1979489,94558] 0 2024-09-18T12:52:24.089 INFO:tasks.workunit.client.0.smithi045.stdout:4/877: mknod db/de/d1e/d3e/d47/db7/c123 0 2024-09-18T12:52:24.123 INFO:tasks.workunit.client.0.smithi045.stdout:7/619: write d13/d31/d33/f4e [131223,24312] 0 2024-09-18T12:52:24.127 INFO:tasks.workunit.client.0.smithi045.stdout:2/722: link d5/ca d5/d5f/cf9 0 2024-09-18T12:52:24.127 INFO:tasks.workunit.client.0.smithi045.stdout:2/723: fdatasync d5/d5f/db2/fbf 0 2024-09-18T12:52:24.129 INFO:tasks.workunit.client.0.smithi045.stdout:2/724: write d5/d2c/ff2 [564977,100740] 0 2024-09-18T12:52:24.131 INFO:tasks.workunit.client.0.smithi045.stdout:7/620: getdents d13/d31/d33 0 2024-09-18T12:52:24.136 INFO:tasks.workunit.client.0.smithi045.stdout:2/725: dwrite d5/d2c/d4d/d76/fa7 [0,4194304] 0 2024-09-18T12:52:24.137 INFO:tasks.workunit.client.0.smithi045.stdout:2/726: chown d5/d46/de0 4 1 2024-09-18T12:52:24.137 INFO:tasks.workunit.client.0.smithi045.stdout:7/621: dread d13/d31/d33/d64/d78/f8b [0,4194304] 0 2024-09-18T12:52:24.141 INFO:tasks.workunit.client.0.smithi045.stdout:2/727: symlink d5/d5f/da8/d61/dbb/dc6/dc7/lfa 0 2024-09-18T12:52:24.143 INFO:tasks.workunit.client.0.smithi045.stdout:2/728: chown d5/d3a/f5b 48 1 2024-09-18T12:52:24.143 INFO:tasks.workunit.client.0.smithi045.stdout:7/622: read d13/f61 [797798,60425] 0 2024-09-18T12:52:24.144 INFO:tasks.workunit.client.0.smithi045.stdout:2/729: chown d5/d5f 271111 1 2024-09-18T12:52:24.145 INFO:tasks.workunit.client.0.smithi045.stdout:0/729: dwrite d6/d48/d5e/d39/d58/d66/fcc [0,4194304] 0 2024-09-18T12:52:24.147 INFO:tasks.workunit.client.0.smithi045.stdout:3/570: sync 2024-09-18T12:52:24.148 INFO:tasks.workunit.client.0.smithi045.stdout:1/698: sync 2024-09-18T12:52:24.148 INFO:tasks.workunit.client.0.smithi045.stdout:8/757: sync 2024-09-18T12:52:24.148 INFO:tasks.workunit.client.0.smithi045.stdout:9/577: sync 2024-09-18T12:52:24.148 INFO:tasks.workunit.client.0.smithi045.stdout:0/730: chown d6/d48/d5e/f75 0 1 2024-09-18T12:52:24.148 INFO:tasks.workunit.client.0.smithi045.stdout:2/730: readlink d5/d5f/da8/d61/dbb/dc6/dc7/dce/lc8 0 2024-09-18T12:52:24.148 INFO:tasks.workunit.client.0.smithi045.stdout:8/758: stat d11/d20/d60/c97 0 2024-09-18T12:52:24.149 INFO:tasks.workunit.client.0.smithi045.stdout:7/623: mkdir d13/d44/d4c/d82/dda 0 2024-09-18T12:52:24.152 INFO:tasks.workunit.client.0.smithi045.stdout:2/731: write d5/d46/fa9 [3770438,72920] 0 2024-09-18T12:52:24.153 INFO:tasks.workunit.client.0.smithi045.stdout:1/699: write d0/d12/d32/d67/d6a/fbe [364102,104608] 0 2024-09-18T12:52:24.156 INFO:tasks.workunit.client.0.smithi045.stdout:7/624: dread d13/f17 [0,4194304] 0 2024-09-18T12:52:24.156 INFO:tasks.workunit.client.0.smithi045.stdout:8/759: symlink d11/d76/da0/le3 0 2024-09-18T12:52:24.156 INFO:tasks.workunit.client.0.smithi045.stdout:1/700: chown d0/d2d/d2b/d30/d8b/f7c 122 1 2024-09-18T12:52:24.158 INFO:tasks.workunit.client.0.smithi045.stdout:0/731: write d6/d48/d5e/d39/d58/d3b/fd8 [840658,28932] 0 2024-09-18T12:52:24.158 INFO:tasks.workunit.client.0.smithi045.stdout:9/578: write d0/d3/d6/d10/d26/d2e/d6f/da5/fb2 [878505,78632] 0 2024-09-18T12:52:24.158 INFO:tasks.workunit.client.0.smithi045.stdout:3/571: mknod d0/d29/d5f/cbf 0 2024-09-18T12:52:24.161 INFO:tasks.workunit.client.0.smithi045.stdout:2/732: write d5/d2c/d4d/f28 [1385118,81146] 0 2024-09-18T12:52:24.162 INFO:tasks.workunit.client.0.smithi045.stdout:9/579: readlink d0/d3/d6/d10/l56 0 2024-09-18T12:52:24.163 INFO:tasks.workunit.client.0.smithi045.stdout:7/625: mkdir d13/d44/ddb 0 2024-09-18T12:52:24.163 INFO:tasks.workunit.client.0.smithi045.stdout:2/733: chown d5/d2c/d4d/f1b 0 1 2024-09-18T12:52:24.166 INFO:tasks.workunit.client.0.smithi045.stdout:8/760: fdatasync fd 0 2024-09-18T12:52:24.169 INFO:tasks.workunit.client.0.smithi045.stdout:9/580: truncate d0/d3/d6/d9d/fb5 68582 0 2024-09-18T12:52:24.171 INFO:tasks.workunit.client.0.smithi045.stdout:2/734: rmdir d5/d2c/d4d/d76/d93 39 2024-09-18T12:52:24.172 INFO:tasks.workunit.client.0.smithi045.stdout:8/761: write d11/d20/d60/da3/fb5 [925420,29347] 0 2024-09-18T12:52:24.172 INFO:tasks.workunit.client.0.smithi045.stdout:1/701: dwrite d0/d2d/d2b/d30/d8b/f4e [0,4194304] 0 2024-09-18T12:52:24.174 INFO:tasks.workunit.client.0.smithi045.stdout:8/762: write d11/d23/f9d [4267375,26673] 0 2024-09-18T12:52:24.182 INFO:tasks.workunit.client.0.smithi045.stdout:2/735: dwrite d5/d5f/da8/d61/dbb/dc6/ff3 [0,4194304] 0 2024-09-18T12:52:24.187 INFO:tasks.workunit.client.0.smithi045.stdout:7/626: creat d13/fdc x:0 0 0 2024-09-18T12:52:24.189 INFO:tasks.workunit.client.0.smithi045.stdout:7/627: read d13/d44/d37/fbc [454126,54450] 0 2024-09-18T12:52:24.190 INFO:tasks.workunit.client.0.smithi045.stdout:8/763: creat d11/d14/d72/da9/dc5/de0/fe4 x:0 0 0 2024-09-18T12:52:24.190 INFO:tasks.workunit.client.0.smithi045.stdout:7/628: read - d13/d44/d37/d70/d77/fab zero size 2024-09-18T12:52:24.195 INFO:tasks.workunit.client.0.smithi045.stdout:9/581: mknod d0/d3/d6/d64/d77/d9a/cb9 0 2024-09-18T12:52:24.201 INFO:tasks.workunit.client.0.smithi045.stdout:7/629: chown fd 2121302339 1 2024-09-18T12:52:24.201 INFO:tasks.workunit.client.0.smithi045.stdout:7/630: chown d13/d44 42147139 1 2024-09-18T12:52:24.202 INFO:tasks.workunit.client.0.smithi045.stdout:2/736: mknod d5/d3a/cfb 0 2024-09-18T12:52:24.207 INFO:tasks.workunit.client.0.smithi045.stdout:6/648: truncate d9/d1a/d48/d97/f9c 1868728 0 2024-09-18T12:52:24.211 INFO:tasks.workunit.client.0.smithi045.stdout:2/737: dread - d5/d2c/d4d/d76/d93/fe3 zero size 2024-09-18T12:52:24.212 INFO:tasks.workunit.client.0.smithi045.stdout:2/738: chown d5/f42 1426 1 2024-09-18T12:52:24.213 INFO:tasks.workunit.client.0.smithi045.stdout:8/764: creat d11/d14/d53/d41/fe5 x:0 0 0 2024-09-18T12:52:24.213 INFO:tasks.workunit.client.0.smithi045.stdout:2/739: chown d5/d5f/db2/f55 22 1 2024-09-18T12:52:24.221 INFO:tasks.workunit.client.0.smithi045.stdout:8/765: mkdir d11/d20/d60/dc3/d98/de6 0 2024-09-18T12:52:24.221 INFO:tasks.workunit.client.0.smithi045.stdout:5/761: dwrite d6/db/d19/d92/d61/da5/fa9 [0,4194304] 0 2024-09-18T12:52:24.222 INFO:tasks.workunit.client.0.smithi045.stdout:5/762: stat d6/db/fe 0 2024-09-18T12:52:24.230 INFO:tasks.workunit.client.0.smithi045.stdout:4/878: dwrite db/de/d1a/dbc/fdc [0,4194304] 0 2024-09-18T12:52:24.233 INFO:tasks.workunit.client.0.smithi045.stdout:8/766: readlink d11/d20/d60/dc3/ld2 0 2024-09-18T12:52:24.235 INFO:tasks.workunit.client.0.smithi045.stdout:6/649: dread d9/d1a/d48/d7d/dcb/de1/f4e [0,4194304] 0 2024-09-18T12:52:24.237 INFO:tasks.workunit.client.0.smithi045.stdout:5/763: mknod d6/db/cee 0 2024-09-18T12:52:24.238 INFO:tasks.workunit.client.0.smithi045.stdout:8/767: fsync d11/d14/d72/f73 0 2024-09-18T12:52:24.240 INFO:tasks.workunit.client.0.smithi045.stdout:8/768: fsync d11/d14/d53/d41/f9a 0 2024-09-18T12:52:24.240 INFO:tasks.workunit.client.0.smithi045.stdout:6/650: symlink d9/d56/db3/le3 0 2024-09-18T12:52:24.241 INFO:tasks.workunit.client.0.smithi045.stdout:9/582: mknod d0/d3/d6/d10/d26/cba 0 2024-09-18T12:52:24.242 INFO:tasks.workunit.client.0.smithi045.stdout:5/764: fsync d6/db/d19/d92/f25 0 2024-09-18T12:52:24.245 INFO:tasks.workunit.client.0.smithi045.stdout:8/769: creat d11/d7b/fe7 x:0 0 0 2024-09-18T12:52:24.246 INFO:tasks.workunit.client.0.smithi045.stdout:8/770: chown d11/d76/da0/da1 7765 1 2024-09-18T12:52:24.246 INFO:tasks.workunit.client.0.smithi045.stdout:6/651: write d9/d1a/d2d/f78 [1989812,2717] 0 2024-09-18T12:52:24.248 INFO:tasks.workunit.client.0.smithi045.stdout:5/765: readlink d6/db/d54/de2/d2b/le0 0 2024-09-18T12:52:24.248 INFO:tasks.workunit.client.0.smithi045.stdout:5/766: fdatasync d6/db/fd6 0 2024-09-18T12:52:24.249 INFO:tasks.workunit.client.0.smithi045.stdout:5/767: chown d6/db/d54/dd5/ldb 363410547 1 2024-09-18T12:52:24.250 INFO:tasks.workunit.client.0.smithi045.stdout:6/652: creat d9/d1a/d48/dc1/fe4 x:0 0 0 2024-09-18T12:52:24.252 INFO:tasks.workunit.client.0.smithi045.stdout:5/768: creat d6/db/d19/d92/d61/da5/fef x:0 0 0 2024-09-18T12:52:24.253 INFO:tasks.workunit.client.0.smithi045.stdout:6/653: fdatasync d9/d1a/d2d/f4a 0 2024-09-18T12:52:24.255 INFO:tasks.workunit.client.0.smithi045.stdout:5/769: creat d6/db/d5a/d78/d66/ff0 x:0 0 0 2024-09-18T12:52:24.256 INFO:tasks.workunit.client.0.smithi045.stdout:6/654: write d9/d1a/d48/d75/d81/fa3 [389393,111481] 0 2024-09-18T12:52:24.258 INFO:tasks.workunit.client.0.smithi045.stdout:9/583: rename d0/d3/d6/d10/f81 to d0/d3/d6/d10/d26/d2e/d4e/fbb 0 2024-09-18T12:52:24.261 INFO:tasks.workunit.client.0.smithi045.stdout:5/770: rename d6/db/d70/ce3 to d6/db/d54/de2/d2b/d51/d97/cf1 0 2024-09-18T12:52:24.263 INFO:tasks.workunit.client.0.smithi045.stdout:6/655: creat d9/d1a/d2d/d38/fe5 x:0 0 0 2024-09-18T12:52:24.264 INFO:tasks.workunit.client.0.smithi045.stdout:9/584: rename d0/d3/d6/d64/d77/da9/faf to d0/d3/d6/d10/d26/d2e/d6f/da5/fbc 0 2024-09-18T12:52:24.265 INFO:tasks.workunit.client.0.smithi045.stdout:8/771: dread d11/d14/d53/d41/f9a [0,4194304] 0 2024-09-18T12:52:24.266 INFO:tasks.workunit.client.0.smithi045.stdout:8/772: stat d11/d20/d46/l40 0 2024-09-18T12:52:24.267 INFO:tasks.workunit.client.0.smithi045.stdout:8/773: chown d11/d14/d53/d41/d75/fba 3 1 2024-09-18T12:52:24.269 INFO:tasks.workunit.client.0.smithi045.stdout:8/774: read d11/d14/d53/d41/d75/fbb [3397241,25548] 0 2024-09-18T12:52:24.275 INFO:tasks.workunit.client.0.smithi045.stdout:8/775: rename d11/d14/d53/d41/l83 to d11/d7b/le8 0 2024-09-18T12:52:24.279 INFO:tasks.workunit.client.0.smithi045.stdout:0/732: write d6/d48/d5e/d39/d58/fd4 [1344112,59798] 0 2024-09-18T12:52:24.282 INFO:tasks.workunit.client.0.smithi045.stdout:3/572: truncate d0/d1e/f2a 26418 0 2024-09-18T12:52:24.284 INFO:tasks.workunit.client.0.smithi045.stdout:0/733: rename d6/d48/d5e/d39/d58/d3b/dd5 to d6/d48/d5e/d39/d58/d3c/d73/ddc 0 2024-09-18T12:52:24.286 INFO:tasks.workunit.client.0.smithi045.stdout:0/734: fsync d6/d48/d5e/d39/d58/d66/fa4 0 2024-09-18T12:52:24.286 INFO:tasks.workunit.client.0.smithi045.stdout:3/573: mkdir d0/d7/d89/dc0 0 2024-09-18T12:52:24.287 INFO:tasks.workunit.client.0.smithi045.stdout:3/574: chown d0/d1e/d2c/d5c/c61 49 1 2024-09-18T12:52:24.292 INFO:tasks.workunit.client.0.smithi045.stdout:0/735: creat d6/d48/d5e/d39/d58/d3c/fdd x:0 0 0 2024-09-18T12:52:24.293 INFO:tasks.workunit.client.0.smithi045.stdout:8/776: dread d11/f17 [0,4194304] 0 2024-09-18T12:52:24.295 INFO:tasks.workunit.client.0.smithi045.stdout:3/575: dwrite d0/d1e/d2c/d3a/fb0 [0,4194304] 0 2024-09-18T12:52:24.298 INFO:tasks.workunit.client.0.smithi045.stdout:8/777: mkdir d11/d14/d53/de9 0 2024-09-18T12:52:24.299 INFO:tasks.workunit.client.0.smithi045.stdout:8/778: truncate d11/fdf 716882 0 2024-09-18T12:52:24.303 INFO:tasks.workunit.client.0.smithi045.stdout:3/576: fsync d0/d1e/d2c/d3f/d44/f4c 0 2024-09-18T12:52:24.304 INFO:tasks.workunit.client.0.smithi045.stdout:8/779: rmdir d11/d20/d60/da3 39 2024-09-18T12:52:24.306 INFO:tasks.workunit.client.0.smithi045.stdout:7/631: write d13/d44/d4c/f62 [122696,42213] 0 2024-09-18T12:52:24.309 INFO:tasks.workunit.client.0.smithi045.stdout:8/780: mknod d11/d20/d46/cea 0 2024-09-18T12:52:24.309 INFO:tasks.workunit.client.0.smithi045.stdout:2/740: write d5/d2c/f63 [1329016,89711] 0 2024-09-18T12:52:24.314 INFO:tasks.workunit.client.0.smithi045.stdout:2/741: creat d5/d5f/da8/d61/ffc x:0 0 0 2024-09-18T12:52:24.315 INFO:tasks.workunit.client.0.smithi045.stdout:8/781: dread d11/d20/d46/f78 [0,4194304] 0 2024-09-18T12:52:24.316 INFO:tasks.workunit.client.0.smithi045.stdout:8/782: dread - d11/d7b/fe7 zero size 2024-09-18T12:52:24.317 INFO:tasks.workunit.client.0.smithi045.stdout:4/879: write db/de/f90 [2022611,82203] 0 2024-09-18T12:52:24.318 INFO:tasks.workunit.client.0.smithi045.stdout:7/632: getdents d13/d44/d37/d70 0 2024-09-18T12:52:24.321 INFO:tasks.workunit.client.0.smithi045.stdout:2/742: symlink d5/d5f/da8/d61/dbb/dc6/df1/lfd 0 2024-09-18T12:52:24.322 INFO:tasks.workunit.client.0.smithi045.stdout:2/743: chown d5/d5f/da8/d61/dbb/dc6/dc7/dce/fae 107063 1 2024-09-18T12:52:24.322 INFO:tasks.workunit.client.0.smithi045.stdout:2/744: chown d5/d2c/cb6 394638399 1 2024-09-18T12:52:24.326 INFO:tasks.workunit.client.0.smithi045.stdout:2/745: creat d5/d3a/d3e/dd4/ffe x:0 0 0 2024-09-18T12:52:24.327 INFO:tasks.workunit.client.0.smithi045.stdout:4/880: creat db/de/d1e/d3e/d9a/d73/dce/d122/f124 x:0 0 0 2024-09-18T12:52:24.331 INFO:tasks.workunit.client.0.smithi045.stdout:4/881: truncate db/d2c/d35/dcc/dd0/ff7 178265 0 2024-09-18T12:52:24.333 INFO:tasks.workunit.client.0.smithi045.stdout:2/746: dwrite d5/d2c/ff2 [0,4194304] 0 2024-09-18T12:52:24.334 INFO:tasks.workunit.client.0.smithi045.stdout:4/882: rmdir db/de/d1a/dbc 39 2024-09-18T12:52:24.335 INFO:tasks.workunit.client.0.smithi045.stdout:4/883: dread - db/d2c/d35/d40/f7d zero size 2024-09-18T12:52:24.336 INFO:tasks.workunit.client.0.smithi045.stdout:2/747: symlink d5/d2c/d4d/d76/dd5/lff 0 2024-09-18T12:52:24.336 INFO:tasks.workunit.client.0.smithi045.stdout:6/656: write d9/d1a/f2e [949657,32133] 0 2024-09-18T12:52:24.339 INFO:tasks.workunit.client.0.smithi045.stdout:2/748: fsync d5/d5f/da8/d61/f89 0 2024-09-18T12:52:24.344 INFO:tasks.workunit.client.0.smithi045.stdout:4/884: creat db/de/d1e/d3e/d47/d59/d2f/f125 x:0 0 0 2024-09-18T12:52:24.344 INFO:tasks.workunit.client.0.smithi045.stdout:5/771: dwrite d6/db/d19/d92/d61/da5/fea [0,4194304] 0 2024-09-18T12:52:24.347 INFO:tasks.workunit.client.0.smithi045.stdout:4/885: readlink db/de/d1e/d3e/d47/d59/d2f/l61 0 2024-09-18T12:52:24.347 INFO:tasks.workunit.client.0.smithi045.stdout:0/736: write d6/f2d [2635957,60025] 0 2024-09-18T12:52:24.351 INFO:tasks.workunit.client.0.smithi045.stdout:0/737: chown d6/d48/d5e/d39/d58/d3c/l49 148498 1 2024-09-18T12:52:24.351 INFO:tasks.workunit.client.0.smithi045.stdout:2/749: dread d5/d2c/d4d/d76/f77 [0,4194304] 0 2024-09-18T12:52:24.357 INFO:tasks.workunit.client.0.smithi045.stdout:2/750: read - d5/d2c/d4d/d76/d93/fe3 zero size 2024-09-18T12:52:24.357 INFO:tasks.workunit.client.0.smithi045.stdout:5/772: link d6/db/d54/dd5/ldb d6/lf2 0 2024-09-18T12:52:24.359 INFO:tasks.workunit.client.0.smithi045.stdout:4/886: dwrite db/de/d1a/ff3 [0,4194304] 0 2024-09-18T12:52:24.361 INFO:tasks.workunit.client.0.smithi045.stdout:2/751: dread - d5/d2c/d6f/d9d/fbc zero size 2024-09-18T12:52:24.364 INFO:tasks.workunit.client.0.smithi045.stdout:3/577: dwrite d0/f1a [0,4194304] 0 2024-09-18T12:52:24.364 INFO:tasks.workunit.client.0.smithi045.stdout:4/887: chown db/de/d1e/ffe 1 1 2024-09-18T12:52:24.365 INFO:tasks.workunit.client.0.smithi045.stdout:2/752: write d5/d5f/db2/f40 [1477997,112193] 0 2024-09-18T12:52:24.375 INFO:tasks.workunit.client.0.smithi045.stdout:7/633: dwrite d13/d31/d5f/f69 [4194304,4194304] 0 2024-09-18T12:52:24.376 INFO:tasks.workunit.client.0.smithi045.stdout:3/578: dwrite d0/d1e/d39/db7/fa2 [0,4194304] 0 2024-09-18T12:52:24.381 INFO:tasks.workunit.client.0.smithi045.stdout:2/753: dread d5/d5f/db2/f3d [0,4194304] 0 2024-09-18T12:52:24.383 INFO:tasks.workunit.client.0.smithi045.stdout:2/754: chown d5/d5f/da8/d61/dbb/dc6/dc7/dce/fd9 0 1 2024-09-18T12:52:24.384 INFO:tasks.workunit.client.0.smithi045.stdout:4/888: fdatasync db/de/d1e/d3e/d9a/f2b 0 2024-09-18T12:52:24.389 INFO:tasks.workunit.client.0.smithi045.stdout:7/634: symlink d13/d31/d33/ldd 0 2024-09-18T12:52:24.390 INFO:tasks.workunit.client.0.smithi045.stdout:3/579: rmdir d0/d29/d5f/d73/d87 39 2024-09-18T12:52:24.391 INFO:tasks.workunit.client.0.smithi045.stdout:3/580: chown d0/d7 375 1 2024-09-18T12:52:24.391 INFO:tasks.workunit.client.0.smithi045.stdout:0/738: dwrite d6/d48/d5e/d39/d58/d3c/f46 [0,4194304] 0 2024-09-18T12:52:24.399 INFO:tasks.workunit.client.0.smithi045.stdout:4/889: truncate db/de/d1e/d3e/d47/d59/f74 2108074 0 2024-09-18T12:52:24.402 INFO:tasks.workunit.client.0.smithi045.stdout:0/739: dwrite d6/d48/d5e/fc4 [0,4194304] 0 2024-09-18T12:52:24.403 INFO:tasks.workunit.client.0.smithi045.stdout:4/890: stat db/d2c/d35/dcc/dd0/ld7 0 2024-09-18T12:52:24.405 INFO:tasks.workunit.client.0.smithi045.stdout:2/755: rename d5/d2c/d6f/ce5 to d5/c100 0 2024-09-18T12:52:24.406 INFO:tasks.workunit.client.0.smithi045.stdout:7/635: creat d13/d44/d37/d70/d77/fde x:0 0 0 2024-09-18T12:52:24.407 INFO:tasks.workunit.client.0.smithi045.stdout:6/657: dwrite d9/d30/f33 [0,4194304] 0 2024-09-18T12:52:24.410 INFO:tasks.workunit.client.0.smithi045.stdout:4/891: creat db/d2c/d35/f126 x:0 0 0 2024-09-18T12:52:24.417 INFO:tasks.workunit.client.0.smithi045.stdout:6/658: read d9/d1a/d48/f8d [317380,45585] 0 2024-09-18T12:52:24.417 INFO:tasks.workunit.client.0.smithi045.stdout:7/636: truncate d13/d44/d37/d70/f9f 667769 0 2024-09-18T12:52:24.417 INFO:tasks.workunit.client.0.smithi045.stdout:4/892: mknod db/d2c/d35/d40/d77/dab/c127 0 2024-09-18T12:52:24.420 INFO:tasks.workunit.client.0.smithi045.stdout:3/581: link d0/d1e/d2c/d3f/d44/c59 d0/d1e/d91/cc1 0 2024-09-18T12:52:24.422 INFO:tasks.workunit.client.0.smithi045.stdout:2/756: creat d5/d3a/d3e/db5/f101 x:0 0 0 2024-09-18T12:52:24.423 INFO:tasks.workunit.client.0.smithi045.stdout:6/659: dwrite d9/d30/f33 [0,4194304] 0 2024-09-18T12:52:24.426 INFO:tasks.workunit.client.0.smithi045.stdout:0/740: fsync d6/daa/db2/fd3 0 2024-09-18T12:52:24.428 INFO:tasks.workunit.client.0.smithi045.stdout:4/893: creat db/d2c/d35/dcc/dd0/f128 x:0 0 0 2024-09-18T12:52:24.432 INFO:tasks.workunit.client.0.smithi045.stdout:6/660: mkdir d9/d1a/d48/d75/dc7/de6 0 2024-09-18T12:52:24.439 INFO:tasks.workunit.client.0.smithi045.stdout:6/661: dwrite d9/d30/f33 [0,4194304] 0 2024-09-18T12:52:24.441 INFO:tasks.workunit.client.0.smithi045.stdout:0/741: symlink d6/daa/lde 0 2024-09-18T12:52:24.442 INFO:tasks.workunit.client.0.smithi045.stdout:4/894: unlink db/de/d1e/d3e/d47/db7/ced 0 2024-09-18T12:52:24.443 INFO:tasks.workunit.client.0.smithi045.stdout:2/757: dread d5/d2c/d4d/d76/fb3 [0,4194304] 0 2024-09-18T12:52:24.448 INFO:tasks.workunit.client.0.smithi045.stdout:7/637: truncate fc 2680769 0 2024-09-18T12:52:24.449 INFO:tasks.workunit.client.0.smithi045.stdout:6/662: symlink d9/d1a/d48/d8f/d9f/le7 0 2024-09-18T12:52:24.452 INFO:tasks.workunit.client.0.smithi045.stdout:4/895: rename db/de/d1e/d3e/d9a/d73/dce to db/de/d1a/d2e/d129 0 2024-09-18T12:52:24.454 INFO:tasks.workunit.client.0.smithi045.stdout:7/638: creat d13/d44/d37/d6a/fdf x:0 0 0 2024-09-18T12:52:24.454 INFO:tasks.workunit.client.0.smithi045.stdout:6/663: rmdir d9/d56/db3 39 2024-09-18T12:52:24.455 INFO:tasks.workunit.client.0.smithi045.stdout:6/664: chown d9/d30/faa 990 1 2024-09-18T12:52:24.458 INFO:tasks.workunit.client.0.smithi045.stdout:3/582: dread d0/d1e/d2c/f63 [4194304,4194304] 0 2024-09-18T12:52:24.478 INFO:tasks.workunit.client.0.smithi045.stdout:6/665: dwrite d9/d1a/d2d/d38/d5b/d67/f79 [0,4194304] 0 2024-09-18T12:52:24.631 INFO:tasks.workunit.client.0.smithi045.stdout:4/896: creat db/de/d1e/d3e/d78/d100/d108/d10d/f12a x:0 0 0 2024-09-18T12:52:24.631 INFO:tasks.workunit.client.0.smithi045.stdout:4/897: chown db/d1b 1 1 2024-09-18T12:52:24.643 INFO:tasks.workunit.client.0.smithi045.stdout:3/583: symlink d0/d1e/d39/db7/lc2 0 2024-09-18T12:52:24.644 INFO:tasks.workunit.client.0.smithi045.stdout:3/584: dread d0/d1e/d91/fad [0,4194304] 0 2024-09-18T12:52:24.646 INFO:tasks.workunit.client.0.smithi045.stdout:6/666: unlink d9/d1a/d48/d75/fcd 0 2024-09-18T12:52:24.648 INFO:tasks.workunit.client.0.smithi045.stdout:0/742: link d6/d48/d5e/d39/d58/d86/f99 d6/d48/d5e/d39/d58/d3b/d65/fdf 0 2024-09-18T12:52:24.650 INFO:tasks.workunit.client.0.smithi045.stdout:2/758: truncate d5/d5f/da8/d61/dbb/dc6/dc7/dce/f85 1667354 0 2024-09-18T12:52:24.680 INFO:tasks.workunit.client.0.smithi045.stdout:4/898: mknod db/de/d1e/d3e/d47/db7/c12b 0 2024-09-18T12:52:24.681 INFO:tasks.workunit.client.0.smithi045.stdout:7/639: mknod d13/d31/ce0 0 2024-09-18T12:52:24.684 INFO:tasks.workunit.client.0.smithi045.stdout:3/585: symlink d0/d7/d89/lc3 0 2024-09-18T12:52:24.689 INFO:tasks.workunit.client.0.smithi045.stdout:0/743: read d6/d7/f1f [891176,7253] 0 2024-09-18T12:52:24.694 INFO:tasks.workunit.client.0.smithi045.stdout:6/667: dwrite d9/d1a/d2d/d38/d5b/fb5 [0,4194304] 0 2024-09-18T12:52:24.697 INFO:tasks.workunit.client.0.smithi045.stdout:7/640: dread d13/d44/d37/d70/d77/f3c [0,4194304] 0 2024-09-18T12:52:24.699 INFO:tasks.workunit.client.0.smithi045.stdout:2/759: dread d5/d2c/d4d/f5a [0,4194304] 0 2024-09-18T12:52:24.701 INFO:tasks.workunit.client.0.smithi045.stdout:4/899: dread db/de/f9b [0,4194304] 0 2024-09-18T12:52:24.703 INFO:tasks.workunit.client.0.smithi045.stdout:0/744: dwrite d6/d48/d5e/d39/d58/d3c/f46 [0,4194304] 0 2024-09-18T12:52:24.703 INFO:tasks.workunit.client.0.smithi045.stdout:4/900: fsync db/de/f115 0 2024-09-18T12:52:24.709 INFO:tasks.workunit.client.0.smithi045.stdout:7/641: dwrite d13/d44/d37/d70/d77/d6d/fa2 [0,4194304] 0 2024-09-18T12:52:24.717 INFO:tasks.workunit.client.0.smithi045.stdout:3/586: mkdir d0/d7/d89/dc0/dc4 0 2024-09-18T12:52:24.719 INFO:tasks.workunit.client.0.smithi045.stdout:0/745: dread d6/d48/d5e/d39/d58/d3c/d73/f7f [0,4194304] 0 2024-09-18T12:52:24.721 INFO:tasks.workunit.client.0.smithi045.stdout:0/746: read - d6/d48/d5e/d39/d58/d3c/d73/fc0 zero size 2024-09-18T12:52:24.734 INFO:tasks.workunit.client.0.smithi045.stdout:2/760: dwrite d5/d5f/db2/fe7 [0,4194304] 0 2024-09-18T12:52:24.746 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:24 smithi161 ceph-mon[35784]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:24.747 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:24 smithi161 ceph-mon[35784]: Upgrade: Need to upgrade myself (mgr.smithi161.yoflkm) 2024-09-18T12:52:24.747 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:24 smithi161 ceph-mon[35784]: Upgrade: Need to upgrade myself (mgr.smithi161.yoflkm) 2024-09-18T12:52:24.747 INFO:tasks.workunit.client.0.smithi045.stdout:6/668: rename d9/d1a/d48/l65 to d9/d74/le8 0 2024-09-18T12:52:24.749 INFO:tasks.workunit.client.0.smithi045.stdout:3/587: mknod d0/d1e/d39/db7/cc5 0 2024-09-18T12:52:24.763 INFO:tasks.workunit.client.0.smithi045.stdout:3/588: mkdir d0/d7/d89/dc6 0 2024-09-18T12:52:24.764 INFO:tasks.workunit.client.0.smithi045.stdout:0/747: creat d6/d48/d5e/d39/d58/db5/dc8/fe0 x:0 0 0 2024-09-18T12:52:24.765 INFO:tasks.workunit.client.0.smithi045.stdout:2/761: truncate d5/d46/f70 4486500 0 2024-09-18T12:52:24.767 INFO:tasks.workunit.client.0.smithi045.stdout:7/642: creat d13/d44/d37/d70/d77/fe1 x:0 0 0 2024-09-18T12:52:24.768 INFO:tasks.workunit.client.0.smithi045.stdout:7/643: read d13/d44/d37/d70/fb7 [93754,110431] 0 2024-09-18T12:52:24.774 INFO:tasks.workunit.client.0.smithi045.stdout:7/644: dwrite d13/d31/d33/d64/d78/d90/fb9 [0,4194304] 0 2024-09-18T12:52:24.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:24 smithi045 ceph-mon[28315]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:52:24.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:24 smithi045 ceph-mon[28315]: Upgrade: Need to upgrade myself (mgr.smithi161.yoflkm) 2024-09-18T12:52:24.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:24 smithi045 ceph-mon[28315]: Upgrade: Need to upgrade myself (mgr.smithi161.yoflkm) 2024-09-18T12:52:24.833 INFO:tasks.workunit.client.0.smithi045.stdout:7/645: truncate d13/d44/d37/d6a/f9e 1928522 0 2024-09-18T12:52:24.838 INFO:tasks.workunit.client.0.smithi045.stdout:3/589: creat d0/d29/d5f/fc7 x:0 0 0 2024-09-18T12:52:24.840 INFO:tasks.workunit.client.0.smithi045.stdout:7/646: rename d13/d44/d37/d6a/fc5 to d13/d31/d5f/d94/fe2 0 2024-09-18T12:52:24.843 INFO:tasks.workunit.client.0.smithi045.stdout:3/590: truncate d0/d7/f10 2056807 0 2024-09-18T12:52:24.847 INFO:tasks.workunit.client.0.smithi045.stdout:2/762: getdents d5/d5f/da8 0 2024-09-18T12:52:24.848 INFO:tasks.workunit.client.0.smithi045.stdout:3/591: fdatasync d0/d1e/d2c/d5c/f60 0 2024-09-18T12:52:24.876 INFO:tasks.workunit.client.0.smithi045.stdout:4/901: dwrite db/f30 [0,4194304] 0 2024-09-18T12:52:24.892 INFO:tasks.workunit.client.0.smithi045.stdout:6/669: truncate d9/d1a/d48/d97/f9c 2648689 0 2024-09-18T12:52:24.897 INFO:tasks.workunit.client.0.smithi045.stdout:6/670: dwrite d9/d1a/d2d/d32/f62 [0,4194304] 0 2024-09-18T12:52:24.898 INFO:tasks.workunit.client.0.smithi045.stdout:6/671: fsync d9/d1a/d2d/f93 0 2024-09-18T12:52:24.903 INFO:tasks.workunit.client.0.smithi045.stdout:6/672: creat d9/d1a/d48/d8f/d98/dab/fe9 x:0 0 0 2024-09-18T12:52:24.911 INFO:tasks.workunit.client.0.smithi045.stdout:6/673: mkdir d9/d56/db3/dd7/dea 0 2024-09-18T12:52:24.917 INFO:tasks.workunit.client.0.smithi045.stdout:7/647: write d13/d44/d37/fbc [1155544,116281] 0 2024-09-18T12:52:24.919 INFO:tasks.workunit.client.0.smithi045.stdout:3/592: write d0/d29/d5f/fb3 [2984383,113484] 0 2024-09-18T12:52:24.924 INFO:tasks.workunit.client.0.smithi045.stdout:2/763: dwrite d5/d5f/da8/d61/dbb/dc6/dc7/dce/fae [0,4194304] 0 2024-09-18T12:52:24.929 INFO:tasks.workunit.client.0.smithi045.stdout:7/648: truncate d13/d31/d52/fa7 608325 0 2024-09-18T12:52:24.932 INFO:tasks.workunit.client.0.smithi045.stdout:3/593: rename d0/d1e/d2c/d3f/d44/f76 to d0/d1e/d2c/d3a/d8a/fc8 0 2024-09-18T12:52:24.937 INFO:tasks.workunit.client.0.smithi045.stdout:3/594: creat d0/d1e/d2c/d3a/d45/dbe/fc9 x:0 0 0 2024-09-18T12:52:24.939 INFO:tasks.workunit.client.0.smithi045.stdout:4/902: truncate db/de/d1e/d49/ff9 414871 0 2024-09-18T12:52:24.940 INFO:tasks.workunit.client.0.smithi045.stdout:3/595: creat d0/fca x:0 0 0 2024-09-18T12:52:24.941 INFO:tasks.workunit.client.0.smithi045.stdout:3/596: chown d0/d29/d5f/d73/fbb 63 1 2024-09-18T12:52:24.942 INFO:tasks.workunit.client.0.smithi045.stdout:4/903: chown db/de/d1e/d3e/d47/d59/d7a/fea 142 1 2024-09-18T12:52:24.945 INFO:tasks.workunit.client.0.smithi045.stdout:4/904: mknod db/d20/d6b/c12c 0 2024-09-18T12:52:24.951 INFO:tasks.workunit.client.0.smithi045.stdout:4/905: link db/d2c/d35/d40/d77/l5a db/de/d1e/d3e/d78/dd4/l12d 0 2024-09-18T12:52:24.960 INFO:tasks.workunit.client.0.smithi045.stdout:4/906: link db/de/d1e/d49/l69 db/de/d1a/d2e/l12e 0 2024-09-18T12:52:24.963 INFO:tasks.workunit.client.0.smithi045.stdout:7/649: write d13/d1a/d28/f3e [235063,61724] 0 2024-09-18T12:52:24.964 INFO:tasks.workunit.client.0.smithi045.stdout:4/907: rename db/de/d1e/ffe to db/de9/f12f 0 2024-09-18T12:52:24.965 INFO:tasks.workunit.client.0.smithi045.stdout:4/908: readlink db/de/d1e/d3e/d47/d59/d7a/lc6 0 2024-09-18T12:52:24.969 INFO:tasks.workunit.client.0.smithi045.stdout:4/909: unlink db/d20/f9f 0 2024-09-18T12:52:24.971 INFO:tasks.workunit.client.0.smithi045.stdout:7/650: creat d13/d44/d4c/d82/dda/fe3 x:0 0 0 2024-09-18T12:52:24.976 INFO:tasks.workunit.client.0.smithi045.stdout:3/597: dwrite d0/d1e/d2c/d3a/d8a/f9b [0,4194304] 0 2024-09-18T12:52:24.978 INFO:tasks.workunit.client.0.smithi045.stdout:3/598: fsync d0/d29/d5f/f65 0 2024-09-18T12:52:24.980 INFO:tasks.workunit.client.0.smithi045.stdout:3/599: chown d0/d1e/d2c/d3a/d45/l94 317 1 2024-09-18T12:52:24.993 INFO:tasks.workunit.client.0.smithi045.stdout:7/651: dwrite d13/f8a [0,4194304] 0 2024-09-18T12:52:24.996 INFO:tasks.workunit.client.0.smithi045.stdout:7/652: creat d13/d44/fe4 x:0 0 0 2024-09-18T12:52:24.997 INFO:tasks.workunit.client.0.smithi045.stdout:7/653: chown d13/d44/d37/d70/lc1 88 1 2024-09-18T12:52:24.998 INFO:tasks.workunit.client.0.smithi045.stdout:3/600: dwrite d0/f41 [0,4194304] 0 2024-09-18T12:52:24.999 INFO:tasks.workunit.client.0.smithi045.stdout:7/654: mknod d13/d31/d33/d64/d78/d90/ce5 0 2024-09-18T12:52:25.002 INFO:tasks.workunit.client.0.smithi045.stdout:3/601: rename d0/d1e/d2c/d5c/c61 to d0/d1e/d39/db7/ccb 0 2024-09-18T12:52:25.005 INFO:tasks.workunit.client.0.smithi045.stdout:3/602: chown d0/d1e/d2c/d3a/d45/dbe/fc9 125179195 1 2024-09-18T12:52:25.008 INFO:tasks.workunit.client.0.smithi045.stdout:7/655: dwrite d13/d44/d37/d6a/fdf [0,4194304] 0 2024-09-18T12:52:25.015 INFO:tasks.workunit.client.0.smithi045.stdout:7/656: dwrite d13/d44/f80 [0,4194304] 0 2024-09-18T12:52:25.016 INFO:tasks.workunit.client.0.smithi045.stdout:7/657: write d13/d1a/d28/f89 [481087,64221] 0 2024-09-18T12:52:25.018 INFO:tasks.workunit.client.0.smithi045.stdout:7/658: fdatasync d13/d44/d37/d70/f96 0 2024-09-18T12:52:25.021 INFO:tasks.workunit.client.0.smithi045.stdout:7/659: creat d13/d1a/fe6 x:0 0 0 2024-09-18T12:52:25.024 INFO:tasks.workunit.client.0.smithi045.stdout:7/660: symlink d13/d1a/le7 0 2024-09-18T12:52:25.025 INFO:tasks.workunit.client.0.smithi045.stdout:7/661: mknod d13/d31/d52/ce8 0 2024-09-18T12:52:25.027 INFO:tasks.workunit.client.0.smithi045.stdout:7/662: write f3 [965768,67950] 0 2024-09-18T12:52:25.029 INFO:tasks.workunit.client.0.smithi045.stdout:7/663: symlink d13/d44/d4c/d82/le9 0 2024-09-18T12:52:25.031 INFO:tasks.workunit.client.0.smithi045.stdout:7/664: mkdir d13/d31/d33/d64/d78/dea 0 2024-09-18T12:52:25.045 INFO:tasks.workunit.client.0.smithi045.stdout:7/665: dread d13/d31/d33/fb2 [0,4194304] 0 2024-09-18T12:52:25.047 INFO:tasks.workunit.client.0.smithi045.stdout:7/666: mknod d13/d44/d37/ceb 0 2024-09-18T12:52:25.054 INFO:tasks.workunit.client.0.smithi045.stdout:7/667: link d13/d1a/d9b/la1 d13/d31/d33/d64/d78/lec 0 2024-09-18T12:52:25.056 INFO:tasks.workunit.client.0.smithi045.stdout:7/668: truncate d13/d44/d37/fce 145651 0 2024-09-18T12:52:25.058 INFO:tasks.workunit.client.0.smithi045.stdout:7/669: rename d13/d31/d5f/d94/f7f to d13/d31/d33/fed 0 2024-09-18T12:52:25.064 INFO:tasks.workunit.client.0.smithi045.stdout:7/670: dwrite d13/d44/d37/d6a/da3/fd8 [0,4194304] 0 2024-09-18T12:52:25.066 INFO:tasks.workunit.client.0.smithi045.stdout:7/671: read d13/f61 [1956755,123235] 0 2024-09-18T12:52:25.073 INFO:tasks.workunit.client.0.smithi045.stdout:8/783: sync 2024-09-18T12:52:25.074 INFO:tasks.workunit.client.0.smithi045.stdout:1/702: sync 2024-09-18T12:52:25.074 INFO:tasks.workunit.client.0.smithi045.stdout:9/585: sync 2024-09-18T12:52:25.077 INFO:tasks.workunit.client.0.smithi045.stdout:8/784: mknod d11/d20/d60/da3/ceb 0 2024-09-18T12:52:25.078 INFO:tasks.workunit.client.0.smithi045.stdout:8/785: stat d11/d20/fae 0 2024-09-18T12:52:25.079 INFO:tasks.workunit.client.0.smithi045.stdout:7/672: dread fd [0,4194304] 0 2024-09-18T12:52:25.080 INFO:tasks.workunit.client.0.smithi045.stdout:8/786: write d11/d14/d72/da9/fab [1187360,120688] 0 2024-09-18T12:52:25.084 INFO:tasks.workunit.client.0.smithi045.stdout:8/787: dread d11/d20/fae [0,4194304] 0 2024-09-18T12:52:25.088 INFO:tasks.workunit.client.0.smithi045.stdout:9/586: dread d0/d3/d6/d10/d26/d2e/f48 [0,4194304] 0 2024-09-18T12:52:25.088 INFO:tasks.workunit.client.0.smithi045.stdout:9/587: chown d0/d3/d6/d10/d26/d2e/d4e/d76 19742390 1 2024-09-18T12:52:25.212 INFO:tasks.workunit.client.0.smithi045.stdout:7/673: chown d13/d31/d33/c74 19 1 2024-09-18T12:52:25.215 INFO:tasks.workunit.client.0.smithi045.stdout:9/588: creat d0/d3/d6/d64/d77/fbd x:0 0 0 2024-09-18T12:52:25.224 INFO:tasks.workunit.client.0.smithi045.stdout:9/589: dwrite d0/d3/d6/d64/d77/fbd [0,4194304] 0 2024-09-18T12:52:25.225 INFO:tasks.workunit.client.0.smithi045.stdout:8/788: dread d11/f16 [0,4194304] 0 2024-09-18T12:52:25.228 INFO:tasks.workunit.client.0.smithi045.stdout:1/703: dwrite d0/d2d/d92/fbf [4194304,4194304] 0 2024-09-18T12:52:25.232 INFO:tasks.workunit.client.0.smithi045.stdout:9/590: unlink d0/d3/d6/d10/d2c/f30 0 2024-09-18T12:52:25.236 INFO:tasks.workunit.client.0.smithi045.stdout:8/789: truncate d11/d76/da0/da1/dca/fda 3011283 0 2024-09-18T12:52:25.245 INFO:tasks.workunit.client.0.smithi045.stdout:1/704: dwrite d0/d2d/d2b/d30/d40/fc9 [0,4194304] 0 2024-09-18T12:52:25.246 INFO:tasks.workunit.client.0.smithi045.stdout:8/790: dwrite d11/d14/d53/f4f [4194304,4194304] 0 2024-09-18T12:52:25.247 INFO:tasks.workunit.client.0.smithi045.stdout:8/791: dread - d11/d76/fa2 zero size 2024-09-18T12:52:25.250 INFO:tasks.workunit.client.0.smithi045.stdout:1/705: truncate d0/d12/f62 726620 0 2024-09-18T12:52:25.254 INFO:tasks.workunit.client.0.smithi045.stdout:0/748: sync 2024-09-18T12:52:25.256 INFO:tasks.workunit.client.0.smithi045.stdout:0/749: chown d6/d35 453 1 2024-09-18T12:52:25.256 INFO:tasks.workunit.client.0.smithi045.stdout:8/792: rename d11/d20/d60/dc3/dbd/fd4 to d11/d8c/fec 0 2024-09-18T12:52:25.263 INFO:tasks.workunit.client.0.smithi045.stdout:9/591: dwrite d0/d3/d6/d10/d2c/f44 [0,4194304] 0 2024-09-18T12:52:25.268 INFO:tasks.workunit.client.0.smithi045.stdout:1/706: dwrite d0/d12/da7/f28 [0,4194304] 0 2024-09-18T12:52:25.277 INFO:tasks.workunit.client.0.smithi045.stdout:8/793: creat d11/d14/d53/d41/fed x:0 0 0 2024-09-18T12:52:25.279 INFO:tasks.workunit.client.0.smithi045.stdout:8/794: dread - d11/d14/d72/da9/fc2 zero size 2024-09-18T12:52:25.284 INFO:tasks.workunit.client.0.smithi045.stdout:1/707: write d0/d2d/d6c/f8c [1590592,106813] 0 2024-09-18T12:52:25.286 INFO:tasks.workunit.client.0.smithi045.stdout:0/750: dwrite d6/f98 [0,4194304] 0 2024-09-18T12:52:25.294 INFO:tasks.workunit.client.0.smithi045.stdout:1/708: dwrite d0/fb [4194304,4194304] 0 2024-09-18T12:52:25.296 INFO:tasks.workunit.client.0.smithi045.stdout:1/709: fsync d0/d12/d6f/fb5 0 2024-09-18T12:52:25.300 INFO:tasks.workunit.client.0.smithi045.stdout:1/710: symlink d0/d12/d32/d67/d6a/ld5 0 2024-09-18T12:52:25.302 INFO:tasks.workunit.client.0.smithi045.stdout:1/711: mknod d0/d2d/d2b/d30/d8b/cd6 0 2024-09-18T12:52:25.304 INFO:tasks.workunit.client.0.smithi045.stdout:1/712: write d0/d12/da7/f22 [12856611,42888] 0 2024-09-18T12:52:25.312 INFO:tasks.workunit.client.0.smithi045.stdout:1/713: rename d0/d2d/d2b/d30/d40/d60/d8f/f97 to d0/d2d/d2b/d30/d8b/fd7 0 2024-09-18T12:52:25.313 INFO:tasks.workunit.client.0.smithi045.stdout:1/714: chown d0/f6 0 1 2024-09-18T12:52:25.315 INFO:tasks.workunit.client.0.smithi045.stdout:1/715: mknod d0/d12/d32/d67/d6d/d9c/cd8 0 2024-09-18T12:52:25.316 INFO:tasks.workunit.client.0.smithi045.stdout:9/592: dread d0/f66 [0,4194304] 0 2024-09-18T12:52:25.321 INFO:tasks.workunit.client.0.smithi045.stdout:9/593: symlink d0/d3/d6/d10/d26/d2e/d4e/db4/lbe 0 2024-09-18T12:52:25.321 INFO:tasks.workunit.client.0.smithi045.stdout:1/716: dwrite d0/f49 [4194304,4194304] 0 2024-09-18T12:52:25.322 INFO:tasks.workunit.client.0.smithi045.stdout:9/594: write d0/d3/d6/d64/f91 [184832,5253] 0 2024-09-18T12:52:25.324 INFO:tasks.workunit.client.0.smithi045.stdout:9/595: chown d0/d3/d6/d10/d26/da4 58 1 2024-09-18T12:52:25.326 INFO:tasks.workunit.client.0.smithi045.stdout:9/596: readlink d0/d3/d6/d10/d26/d2e/d4e/d76/d89/l6d 0 2024-09-18T12:52:25.327 INFO:tasks.workunit.client.0.smithi045.stdout:1/717: unlink d0/f9a 0 2024-09-18T12:52:25.330 INFO:tasks.workunit.client.0.smithi045.stdout:9/597: creat d0/d3/d6/d64/d77/fbf x:0 0 0 2024-09-18T12:52:25.338 INFO:tasks.workunit.client.0.smithi045.stdout:9/598: getdents d0 0 2024-09-18T12:52:25.339 INFO:tasks.workunit.client.0.smithi045.stdout:9/599: chown d0/d3/d6/d10/d26/c38 2020 1 2024-09-18T12:52:25.340 INFO:tasks.workunit.client.0.smithi045.stdout:1/718: getdents d0/d2d/d2b/d30/d40/d61 0 2024-09-18T12:52:25.342 INFO:tasks.workunit.client.0.smithi045.stdout:9/600: mkdir d0/d3/d6/d64/d88/dc0 0 2024-09-18T12:52:25.343 INFO:tasks.workunit.client.0.smithi045.stdout:9/601: read d0/d3/d6/d10/d26/d2e/f48 [1012179,20740] 0 2024-09-18T12:52:25.344 INFO:tasks.workunit.client.0.smithi045.stdout:1/719: creat d0/d2d/d2b/d30/d40/fd9 x:0 0 0 2024-09-18T12:52:25.357 INFO:tasks.workunit.client.0.smithi045.stdout:1/720: truncate d0/d12/f27 3440858 0 2024-09-18T12:52:25.359 INFO:tasks.workunit.client.0.smithi045.stdout:9/602: dwrite d0/f50 [4194304,4194304] 0 2024-09-18T12:52:25.364 INFO:tasks.workunit.client.0.smithi045.stdout:1/721: creat d0/d2d/d2b/d30/d8b/fda x:0 0 0 2024-09-18T12:52:25.366 INFO:tasks.workunit.client.0.smithi045.stdout:1/722: chown d0/fe 2113972640 1 2024-09-18T12:52:25.369 INFO:tasks.workunit.client.0.smithi045.stdout:1/723: creat d0/d2d/d6c/fdb x:0 0 0 2024-09-18T12:52:25.370 INFO:tasks.workunit.client.0.smithi045.stdout:1/724: fsync d0/d2d/fc5 0 2024-09-18T12:52:25.374 INFO:tasks.workunit.client.0.smithi045.stdout:1/725: creat d0/d2d/d2b/d30/fdc x:0 0 0 2024-09-18T12:52:25.376 INFO:tasks.workunit.client.0.smithi045.stdout:1/726: read d0/f49 [4401166,57630] 0 2024-09-18T12:52:25.377 INFO:tasks.workunit.client.0.smithi045.stdout:1/727: readlink d0/d12/l1e 0 2024-09-18T12:52:25.518 INFO:tasks.workunit.client.0.smithi045.stdout:6/674: sync 2024-09-18T12:52:25.518 INFO:tasks.workunit.client.0.smithi045.stdout:5/773: sync 2024-09-18T12:52:25.520 INFO:tasks.workunit.client.0.smithi045.stdout:5/774: symlink d6/db/d19/dbc/ddc/lf3 0 2024-09-18T12:52:25.522 INFO:tasks.workunit.client.0.smithi045.stdout:6/675: rename d9/d1a/d2d/d32/cb6 to d9/d1a/d48/d75/d81/ceb 0 2024-09-18T12:52:25.525 INFO:tasks.workunit.client.0.smithi045.stdout:6/676: mkdir d9/d1a/d48/d8f/d98/dab/dec 0 2024-09-18T12:52:25.526 INFO:tasks.workunit.client.0.smithi045.stdout:6/677: chown d9/d1a/d48/d75/d81/fa3 528326135 1 2024-09-18T12:52:25.527 INFO:tasks.workunit.client.0.smithi045.stdout:5/775: dread d6/db/d54/de2/d2b/f93 [0,4194304] 0 2024-09-18T12:52:25.536 INFO:tasks.workunit.client.0.smithi045.stdout:5/776: link d6/db/d19/d92/d5c/f98 d6/db/d54/de2/ff4 0 2024-09-18T12:52:25.541 INFO:tasks.workunit.client.0.smithi045.stdout:5/777: dread d6/db/d5a/f5f [0,4194304] 0 2024-09-18T12:52:25.541 INFO:tasks.workunit.client.0.smithi045.stdout:6/678: truncate d9/d1a/d48/d8f/d98/fde 2220132 0 2024-09-18T12:52:25.543 INFO:tasks.workunit.client.0.smithi045.stdout:5/778: symlink d6/db/d6a/d6d/deb/lf5 0 2024-09-18T12:52:25.547 INFO:tasks.workunit.client.0.smithi045.stdout:6/679: dwrite d9/d30/faa [0,4194304] 0 2024-09-18T12:52:25.559 INFO:tasks.workunit.client.0.smithi045.stdout:6/680: link d9/d1a/d48/f8d d9/d56/db3/dc0/de2/fed 0 2024-09-18T12:52:25.560 INFO:tasks.workunit.client.0.smithi045.stdout:5/779: dwrite d6/db/d19/d92/d61/fad [0,4194304] 0 2024-09-18T12:52:25.564 INFO:tasks.workunit.client.0.smithi045.stdout:5/780: symlink d6/db/d6a/d6d/lf6 0 2024-09-18T12:52:25.565 INFO:tasks.workunit.client.0.smithi045.stdout:6/681: mknod d9/d56/db3/dc0/de2/cee 0 2024-09-18T12:52:25.566 INFO:tasks.workunit.client.0.smithi045.stdout:6/682: write d9/d30/f3e [2280522,72262] 0 2024-09-18T12:52:25.569 INFO:tasks.workunit.client.0.smithi045.stdout:5/781: dread d6/db/d19/d92/d61/da5/fa9 [0,4194304] 0 2024-09-18T12:52:25.571 INFO:tasks.workunit.client.0.smithi045.stdout:6/683: creat d9/d56/db3/dc0/de2/fef x:0 0 0 2024-09-18T12:52:25.573 INFO:tasks.workunit.client.0.smithi045.stdout:5/782: unlink d6/db/d19/d92/d5c/dae/fbf 0 2024-09-18T12:52:25.582 INFO:tasks.workunit.client.0.smithi045.stdout:6/684: creat d9/d1a/d2d/ddf/ff0 x:0 0 0 2024-09-18T12:52:25.584 INFO:tasks.workunit.client.0.smithi045.stdout:5/783: unlink d6/d3e/lb3 0 2024-09-18T12:52:25.585 INFO:tasks.workunit.client.0.smithi045.stdout:5/784: fsync d6/d3e/daa/fb9 0 2024-09-18T12:52:25.588 INFO:tasks.workunit.client.0.smithi045.stdout:6/685: dwrite d9/d1a/d2d/f78 [0,4194304] 0 2024-09-18T12:52:25.591 INFO:tasks.workunit.client.0.smithi045.stdout:5/785: getdents d6/db/dec 0 2024-09-18T12:52:25.599 INFO:tasks.workunit.client.0.smithi045.stdout:5/786: rename d6/db/d54/de2/d2b/d51/d97/dab to d6/db/d54/dd5/df7 0 2024-09-18T12:52:25.602 INFO:tasks.workunit.client.0.smithi045.stdout:5/787: mkdir d6/db/d19/d92/d61/da5/dc9/df8 0 2024-09-18T12:52:25.604 INFO:tasks.workunit.client.0.smithi045.stdout:6/686: dread d9/f28 [0,4194304] 0 2024-09-18T12:52:25.605 INFO:tasks.workunit.client.0.smithi045.stdout:6/687: chown d9/d1a/d2d/f5e 60963469 1 2024-09-18T12:52:25.605 INFO:tasks.workunit.client.0.smithi045.stdout:5/788: read d6/d3e/f9b [665648,31573] 0 2024-09-18T12:52:25.606 INFO:tasks.workunit.client.0.smithi045.stdout:5/789: write d6/db/d19/d92/d61/f72 [7353831,26337] 0 2024-09-18T12:52:25.612 INFO:tasks.workunit.client.0.smithi045.stdout:5/790: symlink d6/db/d19/d92/d61/da5/dc9/lf9 0 2024-09-18T12:52:25.616 INFO:tasks.workunit.client.0.smithi045.stdout:5/791: rename d6/db/d54/de2/d2b/c46 to d6/d3e/cfa 0 2024-09-18T12:52:25.621 INFO:tasks.workunit.client.0.smithi045.stdout:5/792: creat d6/db/d19/d92/d61/da5/dc9/ffb x:0 0 0 2024-09-18T12:52:25.622 INFO:tasks.workunit.client.0.smithi045.stdout:5/793: chown d6/db/d6a/d6d 63986176 1 2024-09-18T12:52:25.626 INFO:tasks.workunit.client.0.smithi045.stdout:5/794: read d6/db/d54/de2/d2b/d51/fb7 [687521,36757] 0 2024-09-18T12:52:25.628 INFO:tasks.workunit.client.0.smithi045.stdout:5/795: read - d6/db/d19/d92/d61/da5/dc9/ffb zero size 2024-09-18T12:52:25.659 INFO:tasks.workunit.client.0.smithi045.stdout:5/796: getdents d6/db/d6a 0 2024-09-18T12:52:25.660 INFO:tasks.workunit.client.0.smithi045.stdout:5/797: chown d6/db/d6a/d6d/c8e 3 1 2024-09-18T12:52:25.707 INFO:tasks.workunit.client.0.smithi045.stdout:5/798: write d6/db/d19/d92/d5c/f62 [214954,58860] 0 2024-09-18T12:52:25.710 INFO:tasks.workunit.client.0.smithi045.stdout:5/799: creat d6/db/d19/d92/d61/da5/ffc x:0 0 0 2024-09-18T12:52:25.714 INFO:tasks.workunit.client.0.smithi045.stdout:5/800: getdents d6/db/d54 0 2024-09-18T12:52:25.717 INFO:tasks.workunit.client.0.smithi045.stdout:5/801: creat d6/db/d19/d92/ffd x:0 0 0 2024-09-18T12:52:25.720 INFO:tasks.workunit.client.0.smithi045.stdout:5/802: rename d6/db/d5a to d6/db/d54/dc2/dfe 0 2024-09-18T12:52:25.722 INFO:tasks.workunit.client.0.smithi045.stdout:5/803: rmdir d6/db/d19/dbc/ddc 39 2024-09-18T12:52:25.723 INFO:tasks.workunit.client.0.smithi045.stdout:5/804: write d6/db/d19/d92/d61/da5/fef [651337,65993] 0 2024-09-18T12:52:25.727 INFO:tasks.workunit.client.0.smithi045.stdout:5/805: rename d6/db/d19/f68 to d6/db/fff 0 2024-09-18T12:52:25.729 INFO:tasks.workunit.client.0.smithi045.stdout:5/806: creat d6/db/d70/f100 x:0 0 0 2024-09-18T12:52:25.730 INFO:tasks.workunit.client.0.smithi045.stdout:5/807: fdatasync d6/db/d19/d92/d61/f72 0 2024-09-18T12:52:25.733 INFO:tasks.workunit.client.0.smithi045.stdout:2/764: sync 2024-09-18T12:52:25.733 INFO:tasks.workunit.client.0.smithi045.stdout:4/910: sync 2024-09-18T12:52:25.734 INFO:tasks.workunit.client.0.smithi045.stdout:4/911: chown db/de/d1a/d2e/l51 5 1 2024-09-18T12:52:25.734 INFO:tasks.workunit.client.0.smithi045.stdout:5/808: truncate d6/db/d19/d92/d61/da5/dc9/fd4 837604 0 2024-09-18T12:52:25.738 INFO:tasks.workunit.client.0.smithi045.stdout:4/912: mknod db/d2c/d35/d40/d6d/da9/c130 0 2024-09-18T12:52:25.743 INFO:tasks.workunit.client.0.smithi045.stdout:5/809: rmdir d6/db/d54/de2/d2b/d51/d97 39 2024-09-18T12:52:25.746 INFO:tasks.workunit.client.0.smithi045.stdout:4/913: write db/de/d1e/d3e/d9a/da2/fc1 [679121,475] 0 2024-09-18T12:52:25.749 INFO:tasks.workunit.client.0.smithi045.stdout:2/765: dwrite d5/d46/f86 [0,4194304] 0 2024-09-18T12:52:25.750 INFO:tasks.workunit.client.0.smithi045.stdout:4/914: fdatasync db/de/d1e/d3e/d9a/da2/fc1 0 2024-09-18T12:52:25.751 INFO:tasks.workunit.client.0.smithi045.stdout:4/915: write db/f103 [815124,128455] 0 2024-09-18T12:52:25.753 INFO:tasks.workunit.client.0.smithi045.stdout:5/810: link d6/d3e/l29 d6/db/dec/l101 0 2024-09-18T12:52:25.756 INFO:tasks.workunit.client.0.smithi045.stdout:4/916: stat db/d2c/d35/d40/d6d/cc9 0 2024-09-18T12:52:25.757 INFO:tasks.workunit.client.0.smithi045.stdout:5/811: readlink d6/d3e/l29 0 2024-09-18T12:52:25.758 INFO:tasks.workunit.client.0.smithi045.stdout:4/917: chown db/de/d1e/d3e/d47/l82 218171 1 2024-09-18T12:52:25.759 INFO:tasks.workunit.client.0.smithi045.stdout:4/918: stat db/de/d1e/d3e/d47/d59/d2f 0 2024-09-18T12:52:25.763 INFO:tasks.workunit.client.0.smithi045.stdout:4/919: fsync db/de/d1a/d2e/f7f 0 2024-09-18T12:52:25.766 INFO:tasks.workunit.client.0.smithi045.stdout:5/812: creat d6/db/d19/dbc/f102 x:0 0 0 2024-09-18T12:52:25.768 INFO:tasks.workunit.client.0.smithi045.stdout:2/766: dwrite d5/d2c/d4d/fc4 [0,4194304] 0 2024-09-18T12:52:25.776 INFO:tasks.workunit.client.0.smithi045.stdout:2/767: creat d5/d2c/d4d/d76/dd5/f102 x:0 0 0 2024-09-18T12:52:25.781 INFO:tasks.workunit.client.0.smithi045.stdout:5/813: dwrite d6/db/d19/fe5 [0,4194304] 0 2024-09-18T12:52:25.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:25 smithi045 ceph-mon[28315]: pgmap v35: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 99 MiB/s rd, 205 MiB/s wr, 449 op/s 2024-09-18T12:52:25.784 INFO:tasks.workunit.client.0.smithi045.stdout:2/768: creat d5/d5f/da8/d61/dbb/dc6/dc7/dce/f103 x:0 0 0 2024-09-18T12:52:25.787 INFO:tasks.workunit.client.0.smithi045.stdout:4/920: dread db/de/d1e/d49/fb8 [0,4194304] 0 2024-09-18T12:52:25.788 INFO:tasks.workunit.client.0.smithi045.stdout:4/921: dread - db/d2c/d35/d40/d77/fda zero size 2024-09-18T12:52:25.791 INFO:tasks.workunit.client.0.smithi045.stdout:2/769: rename d5/d2c/d4d/f4e to d5/d5f/da8/dde/f104 0 2024-09-18T12:52:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:25 smithi161 ceph-mon[35784]: pgmap v35: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 99 MiB/s rd, 205 MiB/s wr, 449 op/s 2024-09-18T12:52:25.793 INFO:tasks.workunit.client.0.smithi045.stdout:4/922: chown db/d2c/d35/d40/d6d/da9/ce3 1 1 2024-09-18T12:52:25.794 INFO:tasks.workunit.client.0.smithi045.stdout:4/923: write db/de/d1e/d3e/d9a/f5c [2415396,54306] 0 2024-09-18T12:52:25.797 INFO:tasks.workunit.client.0.smithi045.stdout:4/924: creat db/de/d1e/d3e/d78/d100/d108/d10d/d9e/f131 x:0 0 0 2024-09-18T12:52:25.799 INFO:tasks.workunit.client.0.smithi045.stdout:4/925: fdatasync db/de/d1e/d3e/d47/d59/d7a/f8b 0 2024-09-18T12:52:25.802 INFO:tasks.workunit.client.0.smithi045.stdout:4/926: mknod db/d2c/d35/dcc/dd0/c132 0 2024-09-18T12:52:25.803 INFO:tasks.workunit.client.0.smithi045.stdout:5/814: truncate d6/d3e/f26 1468804 0 2024-09-18T12:52:25.803 INFO:tasks.workunit.client.0.smithi045.stdout:4/927: readlink db/d2c/d35/d40/d77/dab/l86 0 2024-09-18T12:52:25.805 INFO:tasks.workunit.client.0.smithi045.stdout:4/928: chown db/de/d1e/d3e/d78/d100/d108 418994 1 2024-09-18T12:52:25.805 INFO:tasks.workunit.client.0.smithi045.stdout:2/770: dread d5/d5f/da8/f31 [0,4194304] 0 2024-09-18T12:52:25.807 INFO:tasks.workunit.client.0.smithi045.stdout:2/771: truncate d5/d3a/fbe 925232 0 2024-09-18T12:52:25.812 INFO:tasks.workunit.client.0.smithi045.stdout:2/772: dread d5/d46/f7e [0,4194304] 0 2024-09-18T12:52:25.815 INFO:tasks.workunit.client.0.smithi045.stdout:2/773: creat d5/d3a/d3e/db5/f105 x:0 0 0 2024-09-18T12:52:25.815 INFO:tasks.workunit.client.0.smithi045.stdout:4/929: write db/d2c/d35/d40/f79 [3031755,77657] 0 2024-09-18T12:52:25.821 INFO:tasks.workunit.client.0.smithi045.stdout:4/930: rename db/de/d1e/d3e/d47/db7/c12b to db/d2c/d35/d40/d77/dab/c133 0 2024-09-18T12:52:25.821 INFO:tasks.workunit.client.0.smithi045.stdout:2/774: dwrite d5/d2c/ff2 [0,4194304] 0 2024-09-18T12:52:25.826 INFO:tasks.workunit.client.0.smithi045.stdout:4/931: mknod db/de/d1e/d3e/d78/d100/d108/d10d/d9e/c134 0 2024-09-18T12:52:25.828 INFO:tasks.workunit.client.0.smithi045.stdout:4/932: write db/de/d1e/d3e/d78/fdf [89920,24992] 0 2024-09-18T12:52:25.828 INFO:tasks.workunit.client.0.smithi045.stdout:2/775: creat d5/d3a/f106 x:0 0 0 2024-09-18T12:52:25.829 INFO:tasks.workunit.client.0.smithi045.stdout:2/776: stat d5/d5f/da8/d61/dbb/dc6 0 2024-09-18T12:52:25.831 INFO:tasks.workunit.client.0.smithi045.stdout:4/933: truncate db/de/d1e/d3e/d78/fee 736874 0 2024-09-18T12:52:25.833 INFO:tasks.workunit.client.0.smithi045.stdout:2/777: mknod d5/d5f/da8/d61/dbb/dc6/dc7/c107 0 2024-09-18T12:52:25.834 INFO:tasks.workunit.client.0.smithi045.stdout:2/778: fsync d5/d2c/d6f/d9d/fb0 0 2024-09-18T12:52:25.835 INFO:tasks.workunit.client.0.smithi045.stdout:4/934: symlink db/de/d1e/d49/l135 0 2024-09-18T12:52:25.835 INFO:tasks.workunit.client.0.smithi045.stdout:4/935: chown db/de/d1a 83303791 1 2024-09-18T12:52:25.837 INFO:tasks.workunit.client.0.smithi045.stdout:2/779: truncate d5/d5f/da8/d61/dbb/dc6/fd0 602113 0 2024-09-18T12:52:25.842 INFO:tasks.workunit.client.0.smithi045.stdout:4/936: dwrite db/de/d1e/d3e/d9a/f7c [0,4194304] 0 2024-09-18T12:52:25.842 INFO:tasks.workunit.client.0.smithi045.stdout:2/780: fsync d5/f9 0 2024-09-18T12:52:25.844 INFO:tasks.workunit.client.0.smithi045.stdout:4/937: stat db/d2c/d35/d40/d77/fda 0 2024-09-18T12:52:25.852 INFO:tasks.workunit.client.0.smithi045.stdout:4/938: truncate db/de/d1e/d3e/d9a/f2b 235474 0 2024-09-18T12:52:25.854 INFO:tasks.workunit.client.0.smithi045.stdout:4/939: rmdir db/de/d1a/d2e 39 2024-09-18T12:52:25.858 INFO:tasks.workunit.client.0.smithi045.stdout:4/940: creat db/d2c/d35/dcc/f136 x:0 0 0 2024-09-18T12:52:25.859 INFO:tasks.workunit.client.0.smithi045.stdout:4/941: fdatasync db/de/d1e/fb2 0 2024-09-18T12:52:25.862 INFO:tasks.workunit.client.0.smithi045.stdout:2/781: dwrite d5/d2c/d4d/f5a [0,4194304] 0 2024-09-18T12:52:25.863 INFO:tasks.workunit.client.0.smithi045.stdout:4/942: mknod db/de/d1e/d49/c137 0 2024-09-18T12:52:25.868 INFO:tasks.workunit.client.0.smithi045.stdout:2/782: read d5/d46/f7c [342848,32166] 0 2024-09-18T12:52:25.871 INFO:tasks.workunit.client.0.smithi045.stdout:2/783: mknod d5/d2c/d4d/d76/c108 0 2024-09-18T12:52:25.883 INFO:tasks.workunit.client.0.smithi045.stdout:4/943: dread db/de/d1e/d3e/d9a/f2b [0,4194304] 0 2024-09-18T12:52:25.884 INFO:tasks.workunit.client.0.smithi045.stdout:4/944: readlink db/d2c/l5d 0 2024-09-18T12:52:25.885 INFO:tasks.workunit.client.0.smithi045.stdout:2/784: dwrite d5/d5f/f99 [0,4194304] 0 2024-09-18T12:52:25.885 INFO:tasks.workunit.client.0.smithi045.stdout:4/945: fsync db/de/d1e/d3e/d9a/f7c 0 2024-09-18T12:52:25.886 INFO:tasks.workunit.client.0.smithi045.stdout:4/946: chown db/de/d1e/d3e/d9a/da2 133708 1 2024-09-18T12:52:25.888 INFO:tasks.workunit.client.0.smithi045.stdout:2/785: creat d5/d3a/da0/f109 x:0 0 0 2024-09-18T12:52:25.894 INFO:tasks.workunit.client.0.smithi045.stdout:4/947: write db/d20/fac [816628,8787] 0 2024-09-18T12:52:25.901 INFO:tasks.workunit.client.0.smithi045.stdout:4/948: rename db/de/d1e/d3e/d9a/l1c to db/de/d1a/d2e/d129/l138 0 2024-09-18T12:52:25.901 INFO:tasks.workunit.client.0.smithi045.stdout:2/786: dread d5/d46/f52 [0,4194304] 0 2024-09-18T12:52:25.904 INFO:tasks.workunit.client.0.smithi045.stdout:2/787: creat d5/d2c/d4d/d76/dd5/f10a x:0 0 0 2024-09-18T12:52:25.905 INFO:tasks.workunit.client.0.smithi045.stdout:4/949: dread db/de9/f12f [0,4194304] 0 2024-09-18T12:52:25.907 INFO:tasks.workunit.client.0.smithi045.stdout:4/950: write db/de/d1e/d3e/d47/d59/d7a/ffc [244198,122708] 0 2024-09-18T12:52:25.912 INFO:tasks.workunit.client.0.smithi045.stdout:2/788: dwrite d5/d5f/db2/f3c [0,4194304] 0 2024-09-18T12:52:25.913 INFO:tasks.workunit.client.0.smithi045.stdout:4/951: rename db/de/d1e/d3e/d47/db7 to db/d2c/d35/d40/d6d/d112/d139 0 2024-09-18T12:52:25.915 INFO:tasks.workunit.client.0.smithi045.stdout:4/952: write db/d2c/d35/d40/f79 [3010476,112817] 0 2024-09-18T12:52:25.916 INFO:tasks.workunit.client.0.smithi045.stdout:2/789: creat d5/d5f/f10b x:0 0 0 2024-09-18T12:52:25.917 INFO:tasks.workunit.client.0.smithi045.stdout:2/790: write d5/d5f/db2/f4f [4775172,57325] 0 2024-09-18T12:52:25.920 INFO:tasks.workunit.client.0.smithi045.stdout:2/791: write d5/d46/f7c [690011,78849] 0 2024-09-18T12:52:25.922 INFO:tasks.workunit.client.0.smithi045.stdout:2/792: rmdir d5/d5f/da8/d61/dbb/dc6 39 2024-09-18T12:52:25.924 INFO:tasks.workunit.client.0.smithi045.stdout:4/953: dread db/de/f115 [0,4194304] 0 2024-09-18T12:52:25.926 INFO:tasks.workunit.client.0.smithi045.stdout:2/793: write d5/d5f/da8/d61/dbb/dc6/dc7/fd6 [402889,41886] 0 2024-09-18T12:52:25.927 INFO:tasks.workunit.client.0.smithi045.stdout:2/794: readlink d5/d3a/l82 0 2024-09-18T12:52:25.934 INFO:tasks.workunit.client.0.smithi045.stdout:4/954: dwrite db/de/d1a/d2e/d129/d122/f124 [0,4194304] 0 2024-09-18T12:52:25.937 INFO:tasks.workunit.client.0.smithi045.stdout:2/795: dwrite d5/d3a/d3e/db5/f105 [0,4194304] 0 2024-09-18T12:52:25.940 INFO:tasks.workunit.client.0.smithi045.stdout:2/796: truncate d5/d5f/da8/d61/dbb/fc0 90461 0 2024-09-18T12:52:25.942 INFO:tasks.workunit.client.0.smithi045.stdout:4/955: mkdir db/de/d1e/d49/d13a 0 2024-09-18T12:52:25.944 INFO:tasks.workunit.client.0.smithi045.stdout:2/797: creat d5/d5f/da8/f10c x:0 0 0 2024-09-18T12:52:25.948 INFO:tasks.workunit.client.0.smithi045.stdout:2/798: symlink d5/d5f/da8/d61/dbb/dc6/dc7/l10d 0 2024-09-18T12:52:25.949 INFO:tasks.workunit.client.0.smithi045.stdout:4/956: truncate db/de/d1e/d3e/d47/d59/f74 823009 0 2024-09-18T12:52:25.954 INFO:tasks.workunit.client.0.smithi045.stdout:4/957: creat db/de/d1e/d3e/d78/d100/d108/f13b x:0 0 0 2024-09-18T12:52:25.955 INFO:tasks.workunit.client.0.smithi045.stdout:4/958: dread - db/d2c/d35/dcc/f136 zero size 2024-09-18T12:52:25.956 INFO:tasks.workunit.client.0.smithi045.stdout:4/959: chown db/de/f10a 101163629 1 2024-09-18T12:52:25.963 INFO:tasks.workunit.client.0.smithi045.stdout:4/960: dwrite db/de/f114 [0,4194304] 0 2024-09-18T12:52:25.970 INFO:tasks.workunit.client.0.smithi045.stdout:4/961: rename db/de/d1e/d3e/d47/d59/d2f/l67 to db/d2c/dcd/l13c 0 2024-09-18T12:52:25.975 INFO:tasks.workunit.client.0.smithi045.stdout:4/962: rename db/de/d1e/d3e/d47/d59/d2f/f125 to db/de/d1e/d3e/d78/f13d 0 2024-09-18T12:52:25.976 INFO:tasks.workunit.client.0.smithi045.stdout:2/799: dread d5/d5f/da8/d61/dbb/dc6/ff3 [0,4194304] 0 2024-09-18T12:52:25.978 INFO:tasks.workunit.client.0.smithi045.stdout:4/963: mkdir db/de/d1e/d3e/d47/d59/d2f/d13e 0 2024-09-18T12:52:25.980 INFO:tasks.workunit.client.0.smithi045.stdout:2/800: symlink d5/d5f/db2/l10e 0 2024-09-18T12:52:25.985 INFO:tasks.workunit.client.0.smithi045.stdout:4/964: dwrite db/de/d1e/d3e/d78/fdf [0,4194304] 0 2024-09-18T12:52:25.987 INFO:tasks.workunit.client.0.smithi045.stdout:2/801: link d5/d3a/d6b/l87 d5/d5f/da8/d61/l10f 0 2024-09-18T12:52:25.988 INFO:tasks.workunit.client.0.smithi045.stdout:4/965: symlink db/de/d1e/d3e/d47/d59/d7a/l13f 0 2024-09-18T12:52:26.010 INFO:tasks.workunit.client.0.smithi045.stdout:4/966: truncate db/de/d1e/d3e/d47/d59/d7a/ffc 338427 0 2024-09-18T12:52:26.012 INFO:tasks.workunit.client.0.smithi045.stdout:4/967: write db/d2c/d35/f91 [8857707,70779] 0 2024-09-18T12:52:26.015 INFO:tasks.workunit.client.0.smithi045.stdout:2/802: dwrite d5/d2c/d4d/d76/fb3 [0,4194304] 0 2024-09-18T12:52:26.020 INFO:tasks.workunit.client.0.smithi045.stdout:4/968: rename db/de/d1a/d2e/f81 to db/d20/f140 0 2024-09-18T12:52:26.022 INFO:tasks.workunit.client.0.smithi045.stdout:2/803: creat d5/d2c/d4d/d76/dd5/f110 x:0 0 0 2024-09-18T12:52:26.026 INFO:tasks.workunit.client.0.smithi045.stdout:4/969: creat db/d2c/d35/d40/d6d/d112/d139/f141 x:0 0 0 2024-09-18T12:52:26.026 INFO:tasks.workunit.client.0.smithi045.stdout:4/970: fsync db/d2c/d35/f126 0 2024-09-18T12:52:26.028 INFO:tasks.workunit.client.0.smithi045.stdout:4/971: fsync db/de/d1e/d3e/d47/d59/d2f/f11f 0 2024-09-18T12:52:26.032 INFO:tasks.workunit.client.0.smithi045.stdout:4/972: creat db/de/d1e/d3e/d78/d100/f142 x:0 0 0 2024-09-18T12:52:26.034 INFO:tasks.workunit.client.0.smithi045.stdout:2/804: dwrite d5/d5f/da8/fe2 [0,4194304] 0 2024-09-18T12:52:26.039 INFO:tasks.workunit.client.0.smithi045.stdout:2/805: dread d5/d3a/d3e/db5/f105 [0,4194304] 0 2024-09-18T12:52:26.050 INFO:tasks.workunit.client.0.smithi045.stdout:2/806: dwrite d5/d5f/da8/f31 [0,4194304] 0 2024-09-18T12:52:26.051 INFO:tasks.workunit.client.0.smithi045.stdout:2/807: stat d5/d46/fcf 0 2024-09-18T12:52:26.053 INFO:tasks.workunit.client.0.smithi045.stdout:2/808: symlink d5/d3a/d6b/l111 0 2024-09-18T12:52:26.056 INFO:tasks.workunit.client.0.smithi045.stdout:2/809: unlink d5/d5f/f10b 0 2024-09-18T12:52:26.061 INFO:tasks.workunit.client.0.smithi045.stdout:2/810: getdents d5/d2c/d4d/d76/dd5 0 2024-09-18T12:52:26.063 INFO:tasks.workunit.client.0.smithi045.stdout:2/811: chown d5/d5f/da8/d61/dbb/dc6/fdc 5755 1 2024-09-18T12:52:26.069 INFO:tasks.workunit.client.0.smithi045.stdout:2/812: dwrite d5/d5f/f83 [4194304,4194304] 0 2024-09-18T12:52:26.081 INFO:tasks.workunit.client.0.smithi045.stdout:2/813: dread d5/fb7 [0,4194304] 0 2024-09-18T12:52:26.082 INFO:tasks.workunit.client.0.smithi045.stdout:2/814: write d5/d5f/db2/fbf [153971,67272] 0 2024-09-18T12:52:26.083 INFO:tasks.workunit.client.0.smithi045.stdout:2/815: chown d5/d5f/da8/dde 995 1 2024-09-18T12:52:26.084 INFO:tasks.workunit.client.0.smithi045.stdout:2/816: readlink d5/d2c/d4d/d76/dd5/lff 0 2024-09-18T12:52:26.085 INFO:tasks.workunit.client.0.smithi045.stdout:2/817: write d5/d5f/da8/d61/fc2 [752371,29582] 0 2024-09-18T12:52:26.087 INFO:tasks.workunit.client.0.smithi045.stdout:2/818: truncate d5/d2c/d6f/fa5 695790 0 2024-09-18T12:52:26.089 INFO:tasks.workunit.client.0.smithi045.stdout:2/819: creat d5/d5f/f112 x:0 0 0 2024-09-18T12:52:26.090 INFO:tasks.workunit.client.0.smithi045.stdout:2/820: write d5/d5f/da8/d61/fe9 [928908,58727] 0 2024-09-18T12:52:26.091 INFO:tasks.workunit.client.0.smithi045.stdout:2/821: write d5/d2c/d6f/d9d/fb0 [2229654,38485] 0 2024-09-18T12:52:26.107 INFO:tasks.workunit.client.0.smithi045.stdout:2/822: write d5/d5f/da8/dde/f104 [1088329,123498] 0 2024-09-18T12:52:26.109 INFO:tasks.workunit.client.0.smithi045.stdout:2/823: rmdir d5/d5f/da8/d61/dbb/dc6/dc7 39 2024-09-18T12:52:26.114 INFO:tasks.workunit.client.0.smithi045.stdout:2/824: dwrite d5/d5f/da8/d61/f89 [0,4194304] 0 2024-09-18T12:52:26.116 INFO:tasks.workunit.client.0.smithi045.stdout:2/825: read d5/d5f/da8/fa1 [2075974,65403] 0 2024-09-18T12:52:26.117 INFO:tasks.workunit.client.0.smithi045.stdout:2/826: write d5/d5f/da8/d61/ffc [202913,21480] 0 2024-09-18T12:52:26.118 INFO:tasks.workunit.client.0.smithi045.stdout:2/827: chown d5/d5f/da8/fe2 25 1 2024-09-18T12:52:26.128 INFO:tasks.workunit.client.0.smithi045.stdout:2/828: getdents d5/d2c/d4d/d76/d93 0 2024-09-18T12:52:26.129 INFO:tasks.workunit.client.0.smithi045.stdout:2/829: write d5/d3a/d3e/db5/f101 [464536,128123] 0 2024-09-18T12:52:26.130 INFO:tasks.workunit.client.0.smithi045.stdout:2/830: stat d5/d5f/da8/d61/dbb/dc6/fdc 0 2024-09-18T12:52:26.132 INFO:tasks.workunit.client.0.smithi045.stdout:2/831: chown d5/d46/f70 606022 1 2024-09-18T12:52:26.133 INFO:tasks.workunit.client.0.smithi045.stdout:2/832: symlink d5/d5f/da8/d61/l113 0 2024-09-18T12:52:26.134 INFO:tasks.workunit.client.0.smithi045.stdout:2/833: dread - d5/d2c/d4d/d76/dd5/f102 zero size 2024-09-18T12:52:26.135 INFO:tasks.workunit.client.0.smithi045.stdout:2/834: readlink d5/d3a/d6b/l111 0 2024-09-18T12:52:26.143 INFO:tasks.workunit.client.0.smithi045.stdout:2/835: truncate d5/d2c/d4d/f28 2480250 0 2024-09-18T12:52:26.155 INFO:tasks.workunit.client.0.smithi045.stdout:2/836: dwrite d5/d2c/d4d/d76/f77 [0,4194304] 0 2024-09-18T12:52:26.160 INFO:tasks.workunit.client.0.smithi045.stdout:3/603: sync 2024-09-18T12:52:26.162 INFO:tasks.workunit.client.0.smithi045.stdout:2/837: rename d5/d5f/da8/d61/dbb/dc6/dc7/c107 to d5/d2c/d6f/c114 0 2024-09-18T12:52:26.163 INFO:tasks.workunit.client.0.smithi045.stdout:2/838: chown d5/d5f/da8/f6e 28803 1 2024-09-18T12:52:26.164 INFO:tasks.workunit.client.0.smithi045.stdout:2/839: chown d5/d2c/d4d/f68 14315148 1 2024-09-18T12:52:26.165 INFO:tasks.workunit.client.0.smithi045.stdout:2/840: write d5/d46/f8e [3277464,79497] 0 2024-09-18T12:52:26.166 INFO:tasks.workunit.client.0.smithi045.stdout:3/604: rename d0/d7/d89/dc0 to d0/d1e/d2c/d3a/d45/dbe/dcc 0 2024-09-18T12:52:26.166 INFO:tasks.workunit.client.0.smithi045.stdout:2/841: stat d5/d3a/d3e/c62 0 2024-09-18T12:52:26.167 INFO:tasks.workunit.client.0.smithi045.stdout:2/842: fdatasync d5/d5f/da8/d61/dbb/dc6/dc7/fd6 0 2024-09-18T12:52:26.170 INFO:tasks.workunit.client.0.smithi045.stdout:3/605: creat d0/fcd x:0 0 0 2024-09-18T12:52:26.172 INFO:tasks.workunit.client.0.smithi045.stdout:2/843: rename d5/d3a/fc9 to d5/d46/de0/f115 0 2024-09-18T12:52:26.173 INFO:tasks.workunit.client.0.smithi045.stdout:2/844: read d5/d2c/d4d/d76/fb3 [2669522,89358] 0 2024-09-18T12:52:26.174 INFO:tasks.workunit.client.0.smithi045.stdout:3/606: symlink d0/d1e/d2c/lce 0 2024-09-18T12:52:26.181 INFO:tasks.workunit.client.0.smithi045.stdout:2/845: mknod d5/d2c/d4d/d76/c116 0 2024-09-18T12:52:26.183 INFO:tasks.workunit.client.0.smithi045.stdout:2/846: write d5/d3a/d3e/dd4/ffe [60060,95938] 0 2024-09-18T12:52:26.184 INFO:tasks.workunit.client.0.smithi045.stdout:3/607: rename d0/d1e/f2a to d0/d1e/d2c/d3a/fcf 0 2024-09-18T12:52:26.188 INFO:tasks.workunit.client.0.smithi045.stdout:3/608: creat d0/d1e/d2c/d3a/d45/dbe/fd0 x:0 0 0 2024-09-18T12:52:26.191 INFO:tasks.workunit.client.0.smithi045.stdout:3/609: mknod d0/d1e/d2c/cd1 0 2024-09-18T12:52:26.192 INFO:tasks.workunit.client.0.smithi045.stdout:2/847: write d5/d5f/da8/f3b [70083,114718] 0 2024-09-18T12:52:26.197 INFO:tasks.workunit.client.0.smithi045.stdout:2/848: symlink d5/d2c/d4d/d76/dd5/l117 0 2024-09-18T12:52:26.199 INFO:tasks.workunit.client.0.smithi045.stdout:2/849: creat d5/d5f/da8/f118 x:0 0 0 2024-09-18T12:52:26.201 INFO:tasks.workunit.client.0.smithi045.stdout:3/610: dwrite d0/d22/f2e [0,4194304] 0 2024-09-18T12:52:26.202 INFO:tasks.workunit.client.0.smithi045.stdout:2/850: truncate d5/d5f/da8/f6e 4342069 0 2024-09-18T12:52:26.205 INFO:tasks.workunit.client.0.smithi045.stdout:2/851: creat d5/d2c/d6f/d9d/f119 x:0 0 0 2024-09-18T12:52:26.206 INFO:tasks.workunit.client.0.smithi045.stdout:3/611: chown d0/d1e/d2c/d3f/d44/d75/l8f 32057 1 2024-09-18T12:52:26.208 INFO:tasks.workunit.client.0.smithi045.stdout:2/852: mknod d5/d3a/d3e/c11a 0 2024-09-18T12:52:26.209 INFO:tasks.workunit.client.0.smithi045.stdout:3/612: mkdir d0/d7/d89/dd2 0 2024-09-18T12:52:26.211 INFO:tasks.workunit.client.0.smithi045.stdout:2/853: rename d5/d5f/da8/d61/dbb/dc6/dc7 to d5/d2c/dac/d11b 0 2024-09-18T12:52:26.216 INFO:tasks.workunit.client.0.smithi045.stdout:3/613: dwrite d0/f1a [0,4194304] 0 2024-09-18T12:52:26.218 INFO:tasks.workunit.client.0.smithi045.stdout:3/614: chown d0/d1e/d2c/d3a/d45/f92 64976 1 2024-09-18T12:52:26.219 INFO:tasks.workunit.client.0.smithi045.stdout:3/615: chown d0/d1e/d2c/d3a 4632539 1 2024-09-18T12:52:26.222 INFO:tasks.workunit.client.0.smithi045.stdout:3/616: mknod d0/d1e/d2c/d3a/d45/cd3 0 2024-09-18T12:52:26.225 INFO:tasks.workunit.client.0.smithi045.stdout:2/854: truncate d5/d2c/d4d/d76/fa7 989523 0 2024-09-18T12:52:26.228 INFO:tasks.workunit.client.0.smithi045.stdout:2/855: symlink d5/d2c/d4d/d76/dd5/l11c 0 2024-09-18T12:52:26.229 INFO:tasks.workunit.client.0.smithi045.stdout:2/856: readlink d5/d3a/d6b/ld7 0 2024-09-18T12:52:26.243 INFO:tasks.workunit.client.0.smithi045.stdout:3/617: dread d0/d1e/d39/f43 [0,4194304] 0 2024-09-18T12:52:26.245 INFO:tasks.workunit.client.0.smithi045.stdout:3/618: stat d0/l31 0 2024-09-18T12:52:26.250 INFO:tasks.workunit.client.0.smithi045.stdout:3/619: write d0/d1e/d91/fad [296715,96652] 0 2024-09-18T12:52:26.251 INFO:tasks.workunit.client.0.smithi045.stdout:3/620: fsync d0/d7/d89/fb6 0 2024-09-18T12:52:26.251 INFO:tasks.workunit.client.0.smithi045.stdout:3/621: stat d0/d1e/d39/db7 0 2024-09-18T12:52:26.254 INFO:tasks.workunit.client.0.smithi045.stdout:3/622: rmdir d0/d29/d5f/d73/d87 39 2024-09-18T12:52:26.255 INFO:tasks.workunit.client.0.smithi045.stdout:3/623: rmdir d0/d1e/d2c/d3f 39 2024-09-18T12:52:26.258 INFO:tasks.workunit.client.0.smithi045.stdout:3/624: mkdir d0/d1e/d2c/dd4 0 2024-09-18T12:52:26.261 INFO:tasks.workunit.client.0.smithi045.stdout:3/625: mkdir d0/d1e/d2c/d3a/d45/dbe/dd5 0 2024-09-18T12:52:26.266 INFO:tasks.workunit.client.0.smithi045.stdout:3/626: dwrite d0/d22/f26 [0,4194304] 0 2024-09-18T12:52:26.271 INFO:tasks.workunit.client.0.smithi045.stdout:3/627: chown d0/d1e/c25 56 1 2024-09-18T12:52:26.273 INFO:tasks.workunit.client.0.smithi045.stdout:3/628: write d0/d1e/d2c/d3a/d45/dbe/fd0 [835047,31409] 0 2024-09-18T12:52:26.288 INFO:tasks.workunit.client.0.smithi045.stdout:3/629: dread d0/d1e/d2c/d3a/f4a [0,4194304] 0 2024-09-18T12:52:26.301 INFO:tasks.workunit.client.0.smithi045.stdout:3/630: dread d0/d22/fa1 [0,4194304] 0 2024-09-18T12:52:26.303 INFO:tasks.workunit.client.0.smithi045.stdout:7/674: sync 2024-09-18T12:52:26.304 INFO:tasks.workunit.client.0.smithi045.stdout:3/631: mkdir d0/d1e/d39/da8/dd6 0 2024-09-18T12:52:26.304 INFO:tasks.workunit.client.0.smithi045.stdout:7/675: chown d13/d1a/d28/fcd 3899 1 2024-09-18T12:52:26.305 INFO:tasks.workunit.client.0.smithi045.stdout:3/632: write d0/d22/f2e [2330161,78259] 0 2024-09-18T12:52:26.312 INFO:tasks.workunit.client.0.smithi045.stdout:3/633: creat d0/d29/d5f/d73/d87/fd7 x:0 0 0 2024-09-18T12:52:26.313 INFO:tasks.workunit.client.0.smithi045.stdout:3/634: write d0/d1e/d2c/d3a/fb0 [4324580,126934] 0 2024-09-18T12:52:26.318 INFO:tasks.workunit.client.0.smithi045.stdout:3/635: dwrite d0/f1a [0,4194304] 0 2024-09-18T12:52:26.323 INFO:tasks.workunit.client.0.smithi045.stdout:3/636: mkdir d0/d29/d53/dd8 0 2024-09-18T12:52:26.323 INFO:tasks.workunit.client.0.smithi045.stdout:7/676: dwrite d13/f17 [0,4194304] 0 2024-09-18T12:52:26.325 INFO:tasks.workunit.client.0.smithi045.stdout:7/677: fsync d13/d1a/fe6 0 2024-09-18T12:52:26.328 INFO:tasks.workunit.client.0.smithi045.stdout:3/637: mknod d0/d1e/d2c/cd9 0 2024-09-18T12:52:26.332 INFO:tasks.workunit.client.0.smithi045.stdout:7/678: fsync d13/d44/d37/f4a 0 2024-09-18T12:52:26.333 INFO:tasks.workunit.client.0.smithi045.stdout:3/638: dread d0/d1e/d91/fad [0,4194304] 0 2024-09-18T12:52:26.334 INFO:tasks.workunit.client.0.smithi045.stdout:7/679: write d13/d1a/d28/fcd [643065,79388] 0 2024-09-18T12:52:26.337 INFO:tasks.workunit.client.0.smithi045.stdout:7/680: read d13/d31/f2d [717695,75616] 0 2024-09-18T12:52:26.338 INFO:tasks.workunit.client.0.smithi045.stdout:7/681: fdatasync d13/d44/fad 0 2024-09-18T12:52:26.341 INFO:tasks.workunit.client.0.smithi045.stdout:3/639: creat d0/d7/fda x:0 0 0 2024-09-18T12:52:26.342 INFO:tasks.workunit.client.0.smithi045.stdout:3/640: fdatasync d0/d1e/d39/f88 0 2024-09-18T12:52:26.342 INFO:tasks.workunit.client.0.smithi045.stdout:7/682: mknod d13/d1a/d9b/cee 0 2024-09-18T12:52:26.346 INFO:tasks.workunit.client.0.smithi045.stdout:3/641: symlink d0/d1e/d91/ldb 0 2024-09-18T12:52:26.350 INFO:tasks.workunit.client.0.smithi045.stdout:7/683: dwrite d13/d44/d37/d70/d77/fe1 [0,4194304] 0 2024-09-18T12:52:26.353 INFO:tasks.workunit.client.0.smithi045.stdout:3/642: unlink d0/d1e/d2c/d3a/f3c 0 2024-09-18T12:52:26.355 INFO:tasks.workunit.client.0.smithi045.stdout:7/684: write d13/d31/d33/fed [3626001,39026] 0 2024-09-18T12:52:26.366 INFO:tasks.workunit.client.0.smithi045.stdout:7/685: dread d13/d1a/f59 [0,4194304] 0 2024-09-18T12:52:26.368 INFO:tasks.workunit.client.0.smithi045.stdout:7/686: unlink c10 0 2024-09-18T12:52:26.370 INFO:tasks.workunit.client.0.smithi045.stdout:7/687: unlink d13/d44/d4c/c4f 0 2024-09-18T12:52:26.383 INFO:tasks.workunit.client.0.smithi045.stdout:7/688: dread d13/d44/d37/d70/d77/f60 [0,4194304] 0 2024-09-18T12:52:26.398 INFO:tasks.workunit.client.0.smithi045.stdout:7/689: dwrite f2 [0,4194304] 0 2024-09-18T12:52:26.401 INFO:tasks.workunit.client.0.smithi045.stdout:7/690: truncate d13/fbf 1898342 0 2024-09-18T12:52:26.406 INFO:tasks.workunit.client.0.smithi045.stdout:7/691: mknod d13/d44/ddb/cef 0 2024-09-18T12:52:26.406 INFO:tasks.workunit.client.0.smithi045.stdout:7/692: fdatasync d13/d31/fd4 0 2024-09-18T12:52:26.407 INFO:tasks.workunit.client.0.smithi045.stdout:7/693: chown d13/d44/ddb/cef 107472 1 2024-09-18T12:52:26.409 INFO:tasks.workunit.client.0.smithi045.stdout:7/694: write d13/d1a/d28/f3e [1252873,29798] 0 2024-09-18T12:52:26.429 INFO:tasks.workunit.client.0.smithi045.stdout:7/695: dwrite d13/d31/d5f/f73 [0,4194304] 0 2024-09-18T12:52:26.432 INFO:tasks.workunit.client.0.smithi045.stdout:7/696: truncate d13/d44/d37/d70/fd1 131341 0 2024-09-18T12:52:26.432 INFO:tasks.workunit.client.0.smithi045.stdout:7/697: fsync d13/f8e 0 2024-09-18T12:52:26.436 INFO:tasks.workunit.client.0.smithi045.stdout:7/698: unlink d13/d31/d5f/d94/c68 0 2024-09-18T12:52:26.437 INFO:tasks.workunit.client.0.smithi045.stdout:7/699: chown c8 223776 1 2024-09-18T12:52:26.438 INFO:tasks.workunit.client.0.smithi045.stdout:7/700: write d13/d1a/d28/f34 [1093421,124643] 0 2024-09-18T12:52:26.440 INFO:tasks.workunit.client.0.smithi045.stdout:7/701: dread d13/d1a/f59 [0,4194304] 0 2024-09-18T12:52:26.452 INFO:tasks.workunit.client.0.smithi045.stdout:7/702: truncate d13/d44/d4c/fba 1091498 0 2024-09-18T12:52:26.460 INFO:tasks.workunit.client.0.smithi045.stdout:7/703: write d13/d31/f2d [1563463,33477] 0 2024-09-18T12:52:26.469 INFO:tasks.workunit.client.0.smithi045.stdout:7/704: write d13/d44/d37/d70/f9f [1592856,9263] 0 2024-09-18T12:52:26.470 INFO:tasks.workunit.client.0.smithi045.stdout:7/705: fdatasync d13/d31/d5f/fc6 0 2024-09-18T12:52:26.471 INFO:tasks.workunit.client.0.smithi045.stdout:7/706: readlink d13/d44/d4c/d82/le9 0 2024-09-18T12:52:26.478 INFO:tasks.workunit.client.0.smithi045.stdout:7/707: dwrite d13/d44/d37/d70/d77/fab [0,4194304] 0 2024-09-18T12:52:26.483 INFO:tasks.workunit.client.0.smithi045.stdout:7/708: mknod d13/d1a/cf0 0 2024-09-18T12:52:26.485 INFO:tasks.workunit.client.0.smithi045.stdout:7/709: truncate d13/d31/d5f/fc6 701863 0 2024-09-18T12:52:26.486 INFO:tasks.workunit.client.0.smithi045.stdout:7/710: chown d13/d31/d52/d81/f9d 67264237 1 2024-09-18T12:52:26.490 INFO:tasks.workunit.client.0.smithi045.stdout:7/711: rename d13/d44/d37/d70/d77/c65 to d13/d44/d37/cf1 0 2024-09-18T12:52:26.490 INFO:tasks.workunit.client.0.smithi045.stdout:7/712: stat d13/d31/d33/d64/d78/f8b 0 2024-09-18T12:52:26.496 INFO:tasks.workunit.client.0.smithi045.stdout:7/713: creat d13/d1a/ff2 x:0 0 0 2024-09-18T12:52:26.512 INFO:tasks.workunit.client.0.smithi045.stdout:7/714: truncate d13/d44/d37/d6a/fdf 3447911 0 2024-09-18T12:52:26.514 INFO:tasks.workunit.client.0.smithi045.stdout:7/715: rmdir d13/d31/d52/d81/dca 39 2024-09-18T12:52:26.514 INFO:tasks.workunit.client.0.smithi045.stdout:7/716: chown d13/d44/f87 121180442 1 2024-09-18T12:52:26.516 INFO:tasks.workunit.client.0.smithi045.stdout:7/717: chown d13/d31/cb1 15970089 1 2024-09-18T12:52:26.520 INFO:tasks.workunit.client.0.smithi045.stdout:7/718: rename d13/d44/d37/d70/fb7 to d13/d1a/d28/ff3 0 2024-09-18T12:52:26.525 INFO:tasks.workunit.client.0.smithi045.stdout:7/719: getdents d13/d31/d5f/d94 0 2024-09-18T12:52:26.530 INFO:tasks.workunit.client.0.smithi045.stdout:7/720: dwrite d13/d44/d37/d70/f96 [0,4194304] 0 2024-09-18T12:52:26.535 INFO:tasks.workunit.client.0.smithi045.stdout:7/721: mknod d13/d44/d4c/cf4 0 2024-09-18T12:52:26.539 INFO:tasks.workunit.client.0.smithi045.stdout:7/722: creat d13/d44/d4c/ff5 x:0 0 0 2024-09-18T12:52:26.540 INFO:tasks.workunit.client.0.smithi045.stdout:7/723: fdatasync d13/d44/d37/f8d 0 2024-09-18T12:52:26.546 INFO:tasks.workunit.client.0.smithi045.stdout:7/724: dwrite d13/d31/fd4 [0,4194304] 0 2024-09-18T12:52:26.553 INFO:tasks.workunit.client.0.smithi045.stdout:7/725: rename d13/d31/d5f/c7d to d13/d1a/d28/cf6 0 2024-09-18T12:52:26.554 INFO:tasks.workunit.client.0.smithi045.stdout:7/726: chown d13/d1a/d9b 85989713 1 2024-09-18T12:52:26.563 INFO:tasks.workunit.client.0.smithi045.stdout:7/727: rename d13/d44/d4c/c56 to d13/d31/cf7 0 2024-09-18T12:52:26.570 INFO:tasks.workunit.client.0.smithi045.stdout:7/728: dwrite d13/d44/d37/d6a/da3/fd8 [0,4194304] 0 2024-09-18T12:52:27.140 INFO:tasks.workunit.client.0.smithi045.stdout:0/751: sync 2024-09-18T12:52:27.141 INFO:tasks.workunit.client.0.smithi045.stdout:9/603: sync 2024-09-18T12:52:27.141 INFO:tasks.workunit.client.0.smithi045.stdout:8/795: sync 2024-09-18T12:52:27.141 INFO:tasks.workunit.client.0.smithi045.stdout:0/752: chown d6/d48/d5e/d39/d58/d86/f8f 53234 1 2024-09-18T12:52:27.142 INFO:tasks.workunit.client.0.smithi045.stdout:9/604: readlink d0/d3/l5b 0 2024-09-18T12:52:27.143 INFO:tasks.workunit.client.0.smithi045.stdout:8/796: mknod d11/d14/d72/da9/dc5/cee 0 2024-09-18T12:52:27.144 INFO:tasks.workunit.client.0.smithi045.stdout:0/753: read d6/daa/db2/fc9 [5920,21958] 0 2024-09-18T12:52:27.145 INFO:tasks.workunit.client.0.smithi045.stdout:9/605: mkdir d0/d3/d6/d64/dc1 0 2024-09-18T12:52:27.146 INFO:tasks.workunit.client.0.smithi045.stdout:9/606: dread - d0/d3/f31 zero size 2024-09-18T12:52:27.150 INFO:tasks.workunit.client.0.smithi045.stdout:8/797: dwrite d11/d20/f3c [0,4194304] 0 2024-09-18T12:52:27.152 INFO:tasks.workunit.client.0.smithi045.stdout:0/754: link d6/d7/f42 d6/d48/d5e/d39/d58/db5/dc8/fe1 0 2024-09-18T12:52:27.152 INFO:tasks.workunit.client.0.smithi045.stdout:9/607: rmdir d0/d3/d6/d10/d26/d2e/d4e/db4 39 2024-09-18T12:52:27.153 INFO:tasks.workunit.client.0.smithi045.stdout:0/755: chown d6/daa/db2/fd3 8514 1 2024-09-18T12:52:27.154 INFO:tasks.workunit.client.0.smithi045.stdout:9/608: write d0/d3/d6/d10/d26/d2e/f32 [2643130,70843] 0 2024-09-18T12:52:27.154 INFO:tasks.workunit.client.0.smithi045.stdout:8/798: unlink d11/d20/d46/l7e 0 2024-09-18T12:52:27.164 INFO:tasks.workunit.client.0.smithi045.stdout:0/756: link d6/d7/fae d6/d48/d5e/d39/d58/d3c/fe2 0 2024-09-18T12:52:27.165 INFO:tasks.workunit.client.0.smithi045.stdout:0/757: chown d6/d48/d5e/d39/d58/d3b/l82 114780742 1 2024-09-18T12:52:27.166 INFO:tasks.workunit.client.0.smithi045.stdout:8/799: creat d11/d14/d53/d41/fef x:0 0 0 2024-09-18T12:52:27.177 INFO:tasks.workunit.client.0.smithi045.stdout:9/609: dwrite d0/d3/d6/d10/d26/d2e/d4e/f9f [8388608,4194304] 0 2024-09-18T12:52:27.181 INFO:tasks.workunit.client.0.smithi045.stdout:5/815: sync 2024-09-18T12:52:27.181 INFO:tasks.workunit.client.0.smithi045.stdout:1/728: sync 2024-09-18T12:52:27.182 INFO:tasks.workunit.client.0.smithi045.stdout:3/643: sync 2024-09-18T12:52:27.182 INFO:tasks.workunit.client.0.smithi045.stdout:6/688: sync 2024-09-18T12:52:27.182 INFO:tasks.workunit.client.0.smithi045.stdout:2/857: sync 2024-09-18T12:52:27.182 INFO:tasks.workunit.client.0.smithi045.stdout:4/973: sync 2024-09-18T12:52:27.182 INFO:tasks.workunit.client.0.smithi045.stdout:7/729: sync 2024-09-18T12:52:27.182 INFO:tasks.workunit.client.0.smithi045.stdout:0/758: dwrite d6/d48/d5e/d39/d58/d3c/d69/f4c [0,4194304] 0 2024-09-18T12:52:27.183 INFO:tasks.workunit.client.0.smithi045.stdout:8/800: truncate d11/d14/d53/f4f 3020001 0 2024-09-18T12:52:27.189 INFO:tasks.workunit.client.0.smithi045.stdout:4/974: fdatasync db/de/d1e/d3e/d9a/d73/fc3 0 2024-09-18T12:52:27.191 INFO:tasks.workunit.client.0.smithi045.stdout:4/975: chown db/d2c/d35/d40 159227 1 2024-09-18T12:52:27.199 INFO:tasks.workunit.client.0.smithi045.stdout:8/801: dwrite d11/d14/d53/d41/d75/fba [0,4194304] 0 2024-09-18T12:52:27.201 INFO:tasks.workunit.client.0.smithi045.stdout:9/610: dread - d0/d3/d6/d10/d26/d2e/f5e zero size 2024-09-18T12:52:27.207 INFO:tasks.workunit.client.0.smithi045.stdout:0/759: mkdir d6/de3 0 2024-09-18T12:52:27.217 INFO:tasks.workunit.client.0.smithi045.stdout:9/611: mknod d0/d3/d6/d64/d77/cc2 0 2024-09-18T12:52:27.218 INFO:tasks.workunit.client.0.smithi045.stdout:0/760: dwrite d6/d7/fc5 [0,4194304] 0 2024-09-18T12:52:27.220 INFO:tasks.workunit.client.0.smithi045.stdout:6/689: truncate d9/d1a/d48/f8d 269359 0 2024-09-18T12:52:27.221 INFO:tasks.workunit.client.0.smithi045.stdout:5/816: dread d6/d3e/fe6 [0,4194304] 0 2024-09-18T12:52:27.223 INFO:tasks.workunit.client.0.smithi045.stdout:9/612: chown d0/d3/d6/d10/d26/d2e/d4e/d76/ca3 5436350 1 2024-09-18T12:52:27.223 INFO:tasks.workunit.client.0.smithi045.stdout:0/761: truncate d6/d48/d5e/d39/d58/d86/fc3 1653391 0 2024-09-18T12:52:27.228 INFO:tasks.workunit.client.0.smithi045.stdout:3/644: creat d0/d1e/d39/fdc x:0 0 0 2024-09-18T12:52:27.229 INFO:tasks.workunit.client.0.smithi045.stdout:7/730: write d13/d44/d37/d6a/fdf [3144668,22959] 0 2024-09-18T12:52:27.235 INFO:tasks.workunit.client.0.smithi045.stdout:3/645: dread d0/d1e/d2c/d3a/d45/dbe/fd0 [0,4194304] 0 2024-09-18T12:52:27.236 INFO:tasks.workunit.client.0.smithi045.stdout:6/690: mknod d9/d30/cf1 0 2024-09-18T12:52:27.240 INFO:tasks.workunit.client.0.smithi045.stdout:7/731: dwrite d13/d44/d37/d70/d77/fde [0,4194304] 0 2024-09-18T12:52:27.241 INFO:tasks.workunit.client.0.smithi045.stdout:0/762: creat d6/d48/d5e/d39/d58/d66/fe4 x:0 0 0 2024-09-18T12:52:27.242 INFO:tasks.workunit.client.0.smithi045.stdout:7/732: read d13/f8a [2130049,96145] 0 2024-09-18T12:52:27.245 INFO:tasks.workunit.client.0.smithi045.stdout:3/646: dread d0/d1e/f38 [0,4194304] 0 2024-09-18T12:52:27.246 INFO:tasks.workunit.client.0.smithi045.stdout:7/733: chown d13/d31/d33/d64/d78/dea 389 1 2024-09-18T12:52:27.248 INFO:tasks.workunit.client.0.smithi045.stdout:3/647: truncate d0/d29/d5f/d73/da0/fb5 983719 0 2024-09-18T12:52:27.266 INFO:tasks.workunit.client.0.smithi045.stdout:2/858: getdents d5/d3a/d3e/dd4 0 2024-09-18T12:52:27.267 INFO:tasks.workunit.client.0.smithi045.stdout:4/976: rename db/d2c/d35/d40/d77/l5a to db/de/d1e/d3e/l143 0 2024-09-18T12:52:27.268 INFO:tasks.workunit.client.0.smithi045.stdout:2/859: chown d5/d46/de0 450985 1 2024-09-18T12:52:27.268 INFO:tasks.workunit.client.0.smithi045.stdout:5/817: dread d6/d3e/f3f [4194304,4194304] 0 2024-09-18T12:52:27.270 INFO:tasks.workunit.client.0.smithi045.stdout:5/818: dread - d6/d3e/fa0 zero size 2024-09-18T12:52:27.272 INFO:tasks.workunit.client.0.smithi045.stdout:0/763: creat d6/d48/fe5 x:0 0 0 2024-09-18T12:52:27.273 INFO:tasks.workunit.client.0.smithi045.stdout:8/802: getdents d11/d20/d46/dc6 0 2024-09-18T12:52:27.275 INFO:tasks.workunit.client.0.smithi045.stdout:8/803: chown d11/d14/d72/f8d 335 1 2024-09-18T12:52:27.275 INFO:tasks.workunit.client.0.smithi045.stdout:8/804: chown d11/d20/d60/da3/ceb 18080 1 2024-09-18T12:52:27.276 INFO:tasks.workunit.client.0.smithi045.stdout:8/805: readlink d11/d20/d60/dc3/l67 0 2024-09-18T12:52:27.282 INFO:tasks.workunit.client.0.smithi045.stdout:6/691: rename d9/d1a/f2e to d9/d1a/d2d/d38/d5b/d67/ff2 0 2024-09-18T12:52:27.286 INFO:tasks.workunit.client.0.smithi045.stdout:4/977: dread db/de/d1a/ff3 [0,4194304] 0 2024-09-18T12:52:27.291 INFO:tasks.workunit.client.0.smithi045.stdout:0/764: fsync d6/d48/d5e/f44 0 2024-09-18T12:52:27.296 INFO:tasks.workunit.client.0.smithi045.stdout:7/734: rename d13/d44/d37/d6a/cc3 to d13/d44/d37/d6a/da3/cf8 0 2024-09-18T12:52:27.297 INFO:tasks.workunit.client.0.smithi045.stdout:6/692: fdatasync d9/d1a/d2d/f8a 0 2024-09-18T12:52:27.298 INFO:tasks.workunit.client.0.smithi045.stdout:7/735: chown d13/d44/d37/c4b 127629220 1 2024-09-18T12:52:27.307 INFO:tasks.workunit.client.0.smithi045.stdout:0/765: fdatasync d6/d7/d32/fa2 0 2024-09-18T12:52:27.308 INFO:tasks.workunit.client.0.smithi045.stdout:8/806: mknod d11/d20/d60/cf0 0 2024-09-18T12:52:27.310 INFO:tasks.workunit.client.0.smithi045.stdout:0/766: write d6/d48/d5e/d39/d58/d66/fe4 [648609,34814] 0 2024-09-18T12:52:27.314 INFO:tasks.workunit.client.0.smithi045.stdout:3/648: rename d0/d29/d5f/d73/d87/fa3 to d0/d1e/d2c/d3a/d45/dbe/fdd 0 2024-09-18T12:52:27.316 INFO:tasks.workunit.client.0.smithi045.stdout:7/736: dread d13/d31/d33/d64/d78/d90/fb9 [0,4194304] 0 2024-09-18T12:52:27.316 INFO:tasks.workunit.client.0.smithi045.stdout:3/649: fsync d0/d1e/d2c/d3a/d45/dbe/fc9 0 2024-09-18T12:52:27.317 INFO:tasks.workunit.client.0.smithi045.stdout:3/650: chown d0/d1e/d39/db7/ca7 0 1 2024-09-18T12:52:27.320 INFO:tasks.workunit.client.0.smithi045.stdout:3/651: truncate d0/d1e/d39/db7/f9f 5016310 0 2024-09-18T12:52:27.322 INFO:tasks.workunit.client.0.smithi045.stdout:2/860: truncate d5/d5f/f83 92129 0 2024-09-18T12:52:27.323 INFO:tasks.workunit.client.0.smithi045.stdout:2/861: write d5/d3a/d3e/dd4/fe4 [1032439,92387] 0 2024-09-18T12:52:27.325 INFO:tasks.workunit.client.0.smithi045.stdout:8/807: creat d11/d76/ff1 x:0 0 0 2024-09-18T12:52:27.331 INFO:tasks.workunit.client.0.smithi045.stdout:5/819: rename d6/db/d54/dc2/dfe/d78/l56 to d6/db/d54/de2/d2b/d7f/l103 0 2024-09-18T12:52:27.336 INFO:tasks.workunit.client.0.smithi045.stdout:7/737: mknod d13/d44/d37/d70/cf9 0 2024-09-18T12:52:27.337 INFO:tasks.workunit.client.0.smithi045.stdout:6/693: dwrite d9/d1a/d48/d7d/dcb/de1/f5a [0,4194304] 0 2024-09-18T12:52:27.337 INFO:tasks.workunit.client.0.smithi045.stdout:4/978: creat db/de/d1e/d3e/d47/d59/f144 x:0 0 0 2024-09-18T12:52:27.337 INFO:tasks.workunit.client.0.smithi045.stdout:7/738: write d13/d31/d52/d81/f9d [1379643,109977] 0 2024-09-18T12:52:27.339 INFO:tasks.workunit.client.0.smithi045.stdout:2/862: mknod d5/d3a/da0/c11d 0 2024-09-18T12:52:27.339 INFO:tasks.workunit.client.0.smithi045.stdout:3/652: mknod d0/d1e/d2c/dd4/cde 0 2024-09-18T12:52:27.341 INFO:tasks.workunit.client.0.smithi045.stdout:2/863: write d5/d46/fcf [674153,123554] 0 2024-09-18T12:52:27.344 INFO:tasks.workunit.client.0.smithi045.stdout:0/767: dread d6/d48/d5e/f44 [0,4194304] 0 2024-09-18T12:52:27.345 INFO:tasks.workunit.client.0.smithi045.stdout:7/739: creat d13/d44/ddb/ffa x:0 0 0 2024-09-18T12:52:27.346 INFO:tasks.workunit.client.0.smithi045.stdout:5/820: mkdir d6/db/dec/d104 0 2024-09-18T12:52:27.348 INFO:tasks.workunit.client.0.smithi045.stdout:7/740: write d13/d44/d37/fce [940780,5076] 0 2024-09-18T12:52:27.350 INFO:tasks.workunit.client.0.smithi045.stdout:0/768: stat d6/d48/d5e/d39/d58/d66/fa4 0 2024-09-18T12:52:27.352 INFO:tasks.workunit.client.0.smithi045.stdout:2/864: rmdir d5/d3a/d6b 39 2024-09-18T12:52:27.353 INFO:tasks.workunit.client.0.smithi045.stdout:6/694: truncate d9/d1a/d2d/f8a 35895 0 2024-09-18T12:52:27.354 INFO:tasks.workunit.client.0.smithi045.stdout:2/865: truncate d5/d5f/db2/f4f 5586885 0 2024-09-18T12:52:27.354 INFO:tasks.workunit.client.0.smithi045.stdout:4/979: truncate db/de/d1e/d49/f64 3595427 0 2024-09-18T12:52:27.362 INFO:tasks.workunit.client.0.smithi045.stdout:8/808: link d11/d20/l29 d11/d14/d72/da9/dc5/lf2 0 2024-09-18T12:52:27.368 INFO:tasks.workunit.client.0.smithi045.stdout:5/821: write d6/db/d54/dc2/dfe/d78/d66/fbe [1174679,74381] 0 2024-09-18T12:52:27.373 INFO:tasks.workunit.client.0.smithi045.stdout:7/741: symlink d13/d31/d52/d81/lfb 0 2024-09-18T12:52:27.374 INFO:tasks.workunit.client.0.smithi045.stdout:4/980: dread db/de/d1e/d3e/d47/d59/f87 [0,4194304] 0 2024-09-18T12:52:27.385 INFO:tasks.workunit.client.0.smithi045.stdout:4/981: dwrite db/de/d1a/d2e/d129/d122/f124 [4194304,4194304] 0 2024-09-18T12:52:27.387 INFO:tasks.workunit.client.0.smithi045.stdout:4/982: read - db/de/d1e/d49/fcb zero size 2024-09-18T12:52:27.388 INFO:tasks.workunit.client.0.smithi045.stdout:6/695: rename d9/d1a/d48/dc6/dd0 to d9/d1a/df3 0 2024-09-18T12:52:27.388 INFO:tasks.workunit.client.0.smithi045.stdout:3/653: dwrite d0/d1e/d2c/d3a/d45/dbe/fd0 [0,4194304] 0 2024-09-18T12:52:27.399 INFO:tasks.workunit.client.0.smithi045.stdout:0/769: dwrite d6/d35/f3e [0,4194304] 0 2024-09-18T12:52:27.399 INFO:tasks.workunit.client.0.smithi045.stdout:3/654: mkdir d0/d1e/d2c/d3a/ddf 0 2024-09-18T12:52:27.403 INFO:tasks.workunit.client.0.smithi045.stdout:8/809: link d11/d7b/le8 d11/d20/d60/dc3/lf3 0 2024-09-18T12:52:27.406 INFO:tasks.workunit.client.0.smithi045.stdout:6/696: fsync d9/d1a/d48/d8f/f9b 0 2024-09-18T12:52:27.408 INFO:tasks.workunit.client.0.smithi045.stdout:0/770: truncate d6/d35/fd2 338875 0 2024-09-18T12:52:27.410 INFO:tasks.workunit.client.0.smithi045.stdout:2/866: rename d5/d2c/dac/d11b/dce/f103 to d5/d5f/db2/f11e 0 2024-09-18T12:52:27.410 INFO:tasks.workunit.client.0.smithi045.stdout:4/983: dwrite db/de/d1a/d2e/d129/d122/f124 [4194304,4194304] 0 2024-09-18T12:52:27.413 INFO:tasks.workunit.client.0.smithi045.stdout:5/822: link d6/db/d54/de2/d2b/d51/d97/cd9 d6/d3e/daa/c105 0 2024-09-18T12:52:27.414 INFO:tasks.workunit.client.0.smithi045.stdout:0/771: write d6/d48/fcd [125590,52266] 0 2024-09-18T12:52:27.420 INFO:tasks.workunit.client.0.smithi045.stdout:8/810: dwrite d11/d14/d53/f6d [0,4194304] 0 2024-09-18T12:52:27.421 INFO:tasks.workunit.client.0.smithi045.stdout:5/823: chown d6/db/d19/d92/d61/da5/dc9/ffb 22523 1 2024-09-18T12:52:27.422 INFO:tasks.workunit.client.0.smithi045.stdout:8/811: fdatasync d11/d76/fd0 0 2024-09-18T12:52:27.424 INFO:tasks.workunit.client.0.smithi045.stdout:8/812: chown d11/d20/d46/c42 6766808 1 2024-09-18T12:52:27.425 INFO:tasks.workunit.client.0.smithi045.stdout:6/697: dread d9/d1a/d48/d7d/dcb/de1/f5a [0,4194304] 0 2024-09-18T12:52:27.426 INFO:tasks.workunit.client.0.smithi045.stdout:6/698: write d9/d1a/d2d/f93 [297638,84307] 0 2024-09-18T12:52:27.428 INFO:tasks.workunit.client.0.smithi045.stdout:4/984: chown db/de/d1e/d49/ff9 1269754403 1 2024-09-18T12:52:27.428 INFO:tasks.workunit.client.0.smithi045.stdout:7/742: rename d13/f17 to d13/d44/d4c/d82/dda/ffc 0 2024-09-18T12:52:27.430 INFO:tasks.workunit.client.0.smithi045.stdout:0/772: write d6/d48/d5e/f44 [1296316,108765] 0 2024-09-18T12:52:27.431 INFO:tasks.workunit.client.0.smithi045.stdout:6/699: stat d9/d1a/d2d/f78 0 2024-09-18T12:52:27.431 INFO:tasks.workunit.client.0.smithi045.stdout:7/743: chown d13/d44/d37/d70/f96 43746 1 2024-09-18T12:52:27.432 INFO:tasks.workunit.client.0.smithi045.stdout:7/744: chown d13/d31 5 1 2024-09-18T12:52:27.432 INFO:tasks.workunit.client.0.smithi045.stdout:6/700: fsync d9/d1a/d2d/d38/fe5 0 2024-09-18T12:52:27.434 INFO:tasks.workunit.client.0.smithi045.stdout:6/701: dread - d9/d56/fd9 zero size 2024-09-18T12:52:27.438 INFO:tasks.workunit.client.0.smithi045.stdout:5/824: truncate d6/db/d54/de2/d2b/f2d 693201 0 2024-09-18T12:52:27.439 INFO:tasks.workunit.client.0.smithi045.stdout:3/655: dwrite d0/d1e/d2c/d5c/f60 [0,4194304] 0 2024-09-18T12:52:27.439 INFO:tasks.workunit.client.0.smithi045.stdout:7/745: rmdir d13/d44/ddb 39 2024-09-18T12:52:27.441 INFO:tasks.workunit.client.0.smithi045.stdout:8/813: mknod d11/cf4 0 2024-09-18T12:52:27.443 INFO:tasks.workunit.client.0.smithi045.stdout:5/825: symlink d6/db/d6a/d77/l106 0 2024-09-18T12:52:27.446 INFO:tasks.workunit.client.0.smithi045.stdout:5/826: chown d6/db/d19/d92/d61/da5/dc9/lf9 130380 1 2024-09-18T12:52:27.446 INFO:tasks.workunit.client.0.smithi045.stdout:6/702: mknod d9/d1a/d2d/d38/cf4 0 2024-09-18T12:52:27.447 INFO:tasks.workunit.client.0.smithi045.stdout:4/985: creat db/de/d1e/f145 x:0 0 0 2024-09-18T12:52:27.451 INFO:tasks.workunit.client.0.smithi045.stdout:8/814: dwrite d11/d23/fcc [0,4194304] 0 2024-09-18T12:52:27.452 INFO:tasks.workunit.client.0.smithi045.stdout:6/703: stat d9/d1a/d2d/d38/ld1 0 2024-09-18T12:52:27.456 INFO:tasks.workunit.client.0.smithi045.stdout:7/746: creat d13/d44/d37/d70/d77/ffd x:0 0 0 2024-09-18T12:52:27.458 INFO:tasks.workunit.client.0.smithi045.stdout:4/986: fdatasync db/d2c/d35/d40/d77/f4c 0 2024-09-18T12:52:27.459 INFO:tasks.workunit.client.0.smithi045.stdout:3/656: link d0/d7/f80 d0/d29/d53/fe0 0 2024-09-18T12:52:27.460 INFO:tasks.workunit.client.0.smithi045.stdout:5/827: creat d6/db/d54/dc2/dfe/d78/d66/f107 x:0 0 0 2024-09-18T12:52:27.460 INFO:tasks.workunit.client.0.smithi045.stdout:3/657: dread - d0/f83 zero size 2024-09-18T12:52:27.461 INFO:tasks.workunit.client.0.smithi045.stdout:3/658: chown d0/f41 7000645 1 2024-09-18T12:52:27.462 INFO:tasks.workunit.client.0.smithi045.stdout:8/815: mknod d11/d20/d46/cf5 0 2024-09-18T12:52:27.464 INFO:tasks.workunit.client.0.smithi045.stdout:6/704: fdatasync d9/f28 0 2024-09-18T12:52:27.467 INFO:tasks.workunit.client.0.smithi045.stdout:4/987: mkdir db/d2c/d35/d40/d6d/da9/d146 0 2024-09-18T12:52:27.468 INFO:tasks.workunit.client.0.smithi045.stdout:4/988: dread - db/de/d1e/d3e/d47/d59/f144 zero size 2024-09-18T12:52:27.471 INFO:tasks.workunit.client.0.smithi045.stdout:8/816: creat d11/d14/d53/ff6 x:0 0 0 2024-09-18T12:52:27.472 INFO:tasks.workunit.client.0.smithi045.stdout:3/659: rename d0/d29/c46 to d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/ce1 0 2024-09-18T12:52:27.473 INFO:tasks.workunit.client.0.smithi045.stdout:7/747: mkdir d13/d31/d33/d64/d78/dea/dfe 0 2024-09-18T12:52:27.473 INFO:tasks.workunit.client.0.smithi045.stdout:6/705: rmdir d9/d30/d6c 39 2024-09-18T12:52:27.475 INFO:tasks.workunit.client.0.smithi045.stdout:4/989: rmdir db/d2c/d35/d40/d6d 39 2024-09-18T12:52:27.476 INFO:tasks.workunit.client.0.smithi045.stdout:5/828: truncate d6/db/d19/d92/d61/da5/dc9/fd4 34823 0 2024-09-18T12:52:27.478 INFO:tasks.workunit.client.0.smithi045.stdout:8/817: mknod d11/d8c/cf7 0 2024-09-18T12:52:27.480 INFO:tasks.workunit.client.0.smithi045.stdout:7/748: symlink d13/d44/d37/lff 0 2024-09-18T12:52:27.485 INFO:tasks.workunit.client.0.smithi045.stdout:3/660: creat d0/d1e/d2c/d3a/ddf/fe2 x:0 0 0 2024-09-18T12:52:27.485 INFO:tasks.workunit.client.0.smithi045.stdout:8/818: dwrite d11/d20/f3c [0,4194304] 0 2024-09-18T12:52:27.487 INFO:tasks.workunit.client.0.smithi045.stdout:3/661: chown d0/d1e/d2c/d3a/d45/dbe/dcc/dc4 2 1 2024-09-18T12:52:27.492 INFO:tasks.workunit.client.0.smithi045.stdout:7/749: chown d13/d44/d37/d6a/f9e 5288672 1 2024-09-18T12:52:27.495 INFO:tasks.workunit.client.0.smithi045.stdout:8/819: symlink d11/d14/d72/da9/dc5/lf8 0 2024-09-18T12:52:27.496 INFO:tasks.workunit.client.0.smithi045.stdout:8/820: chown d11/d14/d53/d41/d75 3 1 2024-09-18T12:52:27.498 INFO:tasks.workunit.client.0.smithi045.stdout:6/706: creat d9/d56/ff5 x:0 0 0 2024-09-18T12:52:27.499 INFO:tasks.workunit.client.0.smithi045.stdout:4/990: creat db/d2c/d35/d40/d6d/da9/d146/f147 x:0 0 0 2024-09-18T12:52:27.502 INFO:tasks.workunit.client.0.smithi045.stdout:7/750: rename d13/d31/d52/fa7 to d13/d31/d33/d64/d78/dea/dfe/f100 0 2024-09-18T12:52:27.506 INFO:tasks.workunit.client.0.smithi045.stdout:6/707: mknod d9/d1a/d48/d7d/cf6 0 2024-09-18T12:52:27.508 INFO:tasks.workunit.client.0.smithi045.stdout:4/991: creat db/de/f148 x:0 0 0 2024-09-18T12:52:27.510 INFO:tasks.workunit.client.0.smithi045.stdout:5/829: write d6/db/d54/dc2/dfe/d78/d66/f7b [2023842,103618] 0 2024-09-18T12:52:27.512 INFO:tasks.workunit.client.0.smithi045.stdout:8/821: rename d11/d14/d72/da9/dc5/de0 to d11/d20/d46/df9 0 2024-09-18T12:52:27.512 INFO:tasks.workunit.client.0.smithi045.stdout:1/729: sync 2024-09-18T12:52:27.512 INFO:tasks.workunit.client.0.smithi045.stdout:9/613: sync 2024-09-18T12:52:27.514 INFO:tasks.workunit.client.0.smithi045.stdout:7/751: unlink d13/d44/fad 0 2024-09-18T12:52:27.516 INFO:tasks.workunit.client.0.smithi045.stdout:3/662: rmdir d0/d7/d89/dc6 0 2024-09-18T12:52:27.517 INFO:tasks.workunit.client.0.smithi045.stdout:8/822: write d11/d76/fa2 [9357,128226] 0 2024-09-18T12:52:27.523 INFO:tasks.workunit.client.0.smithi045.stdout:3/663: readlink d0/d1e/d39/db7/lc2 0 2024-09-18T12:52:27.523 INFO:tasks.workunit.client.0.smithi045.stdout:8/823: dread - d11/d14/d53/d41/fed zero size 2024-09-18T12:52:27.528 INFO:tasks.workunit.client.0.smithi045.stdout:9/614: dwrite d0/f2 [4194304,4194304] 0 2024-09-18T12:52:27.528 INFO:tasks.workunit.client.0.smithi045.stdout:1/730: dwrite d0/d2d/d2b/d30/f4f [0,4194304] 0 2024-09-18T12:52:27.529 INFO:tasks.workunit.client.0.smithi045.stdout:7/752: rmdir d13/d31/d33/d64/d78 39 2024-09-18T12:52:27.531 INFO:tasks.workunit.client.0.smithi045.stdout:5/830: dread d6/db/d54/dc2/dfe/d78/d66/f74 [0,4194304] 0 2024-09-18T12:52:27.532 INFO:tasks.workunit.client.0.smithi045.stdout:9/615: chown d0/d3/d6/d64/d77/da9 137578 1 2024-09-18T12:52:27.532 INFO:tasks.workunit.client.0.smithi045.stdout:5/831: chown d6/db/d54/de2 841690509 1 2024-09-18T12:52:27.536 INFO:tasks.workunit.client.0.smithi045.stdout:8/824: dread - d11/d8c/f91 zero size 2024-09-18T12:52:27.537 INFO:tasks.workunit.client.0.smithi045.stdout:8/825: chown d11/d20/d60/dc3 15858 1 2024-09-18T12:52:27.538 INFO:tasks.workunit.client.0.smithi045.stdout:6/708: write d9/d1a/d2d/f4a [4393556,56829] 0 2024-09-18T12:52:27.544 INFO:tasks.workunit.client.0.smithi045.stdout:4/992: creat db/d2c/d35/d40/f149 x:0 0 0 2024-09-18T12:52:27.548 INFO:tasks.workunit.client.0.smithi045.stdout:8/826: fsync d11/d8c/f91 0 2024-09-18T12:52:27.551 INFO:tasks.workunit.client.0.smithi045.stdout:3/664: creat d0/d29/fe3 x:0 0 0 2024-09-18T12:52:27.551 INFO:tasks.workunit.client.0.smithi045.stdout:4/993: truncate db/d20/fd6 504497 0 2024-09-18T12:52:27.551 INFO:tasks.workunit.client.0.smithi045.stdout:9/616: dwrite d0/d3/d6/f2d [0,4194304] 0 2024-09-18T12:52:27.558 INFO:tasks.workunit.client.0.smithi045.stdout:9/617: dread - d0/d3/d6/d64/d77/fbf zero size 2024-09-18T12:52:27.559 INFO:tasks.workunit.client.0.smithi045.stdout:6/709: dwrite d9/d1a/d48/d75/d81/fa3 [0,4194304] 0 2024-09-18T12:52:27.561 INFO:tasks.workunit.client.0.smithi045.stdout:1/731: write d0/d2d/d2b/d30/d40/d60/d8f/fc1 [981088,123940] 0 2024-09-18T12:52:27.566 INFO:tasks.workunit.client.0.smithi045.stdout:5/832: write d6/d3e/fa0 [264647,42963] 0 2024-09-18T12:52:27.570 INFO:tasks.workunit.client.0.smithi045.stdout:7/753: dwrite d13/d31/d52/d81/dca/fd6 [0,4194304] 0 2024-09-18T12:52:27.572 INFO:tasks.workunit.client.0.smithi045.stdout:8/827: rmdir d11/d20/d60/da3 39 2024-09-18T12:52:27.574 INFO:tasks.workunit.client.0.smithi045.stdout:9/618: stat d0/d3/laa 0 2024-09-18T12:52:27.575 INFO:tasks.workunit.client.0.smithi045.stdout:9/619: fsync d0/d3/d6/d64/d77/fbd 0 2024-09-18T12:52:27.580 INFO:tasks.workunit.client.0.smithi045.stdout:1/732: creat d0/d2d/d92/fdd x:0 0 0 2024-09-18T12:52:27.581 INFO:tasks.workunit.client.0.smithi045.stdout:4/994: write db/de/d1e/d3e/d78/d100/d108/f13b [760528,45075] 0 2024-09-18T12:52:27.584 INFO:tasks.workunit.client.0.smithi045.stdout:4/995: read - db/d2c/d35/d40/f7d zero size 2024-09-18T12:52:27.586 INFO:tasks.workunit.client.0.smithi045.stdout:6/710: creat d9/d1a/d48/ff7 x:0 0 0 2024-09-18T12:52:27.588 INFO:tasks.workunit.client.0.smithi045.stdout:8/828: rename d11/d20/d46/f43 to d11/d14/d72/da9/ffa 0 2024-09-18T12:52:27.594 INFO:tasks.workunit.client.0.smithi045.stdout:8/829: truncate d11/d7b/fa5 1844782 0 2024-09-18T12:52:27.594 INFO:tasks.workunit.client.0.smithi045.stdout:9/620: dwrite d0/d3/d6/d9d/fb5 [0,4194304] 0 2024-09-18T12:52:27.594 INFO:tasks.workunit.client.0.smithi045.stdout:3/665: dread d0/f41 [0,4194304] 0 2024-09-18T12:52:27.596 INFO:tasks.workunit.client.0.smithi045.stdout:9/621: stat d0/d3/d6/d10/d26/d2e/f48 0 2024-09-18T12:52:27.598 INFO:tasks.workunit.client.0.smithi045.stdout:9/622: stat d0/d3/d6/d10/d26/d2e/d6f/da5/dab 0 2024-09-18T12:52:27.599 INFO:tasks.workunit.client.0.smithi045.stdout:9/623: chown d0/d3/d6/f4f 25 1 2024-09-18T12:52:27.600 INFO:tasks.workunit.client.0.smithi045.stdout:6/711: creat d9/d74/ff8 x:0 0 0 2024-09-18T12:52:27.601 INFO:tasks.workunit.client.0.smithi045.stdout:9/624: chown d0/d3/d6/d10/d26/da4 3139628 1 2024-09-18T12:52:27.601 INFO:tasks.workunit.client.0.smithi045.stdout:4/996: symlink db/de/d1e/d3e/d78/d100/d108/d10d/d9e/l14a 0 2024-09-18T12:52:27.604 INFO:tasks.workunit.client.0.smithi045.stdout:9/625: fdatasync d0/d3/d6/d10/f29 0 2024-09-18T12:52:27.604 INFO:tasks.workunit.client.0.smithi045.stdout:4/997: stat db/d2c/dcd/c101 0 2024-09-18T12:52:27.605 INFO:tasks.workunit.client.0.smithi045.stdout:3/666: dwrite d0/d1e/d2c/d5c/f60 [0,4194304] 0 2024-09-18T12:52:27.605 INFO:tasks.workunit.client.0.smithi045.stdout:7/754: creat d13/d31/d5f/f101 x:0 0 0 2024-09-18T12:52:27.608 INFO:tasks.workunit.client.0.smithi045.stdout:9/626: chown d0/d3/d6/d10/f29 108677 1 2024-09-18T12:52:27.608 INFO:tasks.workunit.client.0.smithi045.stdout:4/998: write db/de/d1e/d3e/d78/fdf [1973490,112706] 0 2024-09-18T12:52:27.613 INFO:tasks.workunit.client.0.smithi045.stdout:5/833: getdents d6/db/d54/dc2 0 2024-09-18T12:52:27.619 INFO:tasks.workunit.client.0.smithi045.stdout:6/712: creat d9/d56/db3/dc0/ff9 x:0 0 0 2024-09-18T12:52:27.626 INFO:tasks.workunit.client.0.smithi045.stdout:7/755: fdatasync d13/d44/d37/d70/d77/f5c 0 2024-09-18T12:52:27.629 INFO:tasks.workunit.client.0.smithi045.stdout:3/667: symlink d0/d1e/d2c/d5c/le4 0 2024-09-18T12:52:27.632 INFO:tasks.workunit.client.0.smithi045.stdout:5/834: symlink d6/db/d54/dc2/dfe/d78/l108 0 2024-09-18T12:52:27.634 INFO:tasks.workunit.client.0.smithi045.stdout:1/733: truncate d0/d12/d32/d67/d6a/fb2 2936705 0 2024-09-18T12:52:27.634 INFO:tasks.workunit.client.0.smithi045.stdout:4/999: dread db/de/d1a/ff3 [0,4194304] 0 2024-09-18T12:52:27.636 INFO:tasks.workunit.client.0.smithi045.stdout:7/756: creat d13/d44/d37/d70/d77/d85/f102 x:0 0 0 2024-09-18T12:52:27.643 INFO:tasks.workunit.client.0.smithi045.stdout:5/835: mkdir d6/d3e/d109 0 2024-09-18T12:52:27.650 INFO:tasks.workunit.client.0.smithi045.stdout:9/627: dwrite d0/f9e [0,4194304] 0 2024-09-18T12:52:27.665 INFO:tasks.workunit.client.0.smithi045.stdout:7/757: dwrite d13/d44/d4c/f92 [0,4194304] 0 2024-09-18T12:52:27.687 INFO:tasks.workunit.client.0.smithi045.stdout:8/830: getdents d11/d14/d72/da9 0 2024-09-18T12:52:27.689 INFO:tasks.workunit.client.0.smithi045.stdout:3/668: rename d0/d1e/l21 to d0/d1e/d39/da8/le5 0 2024-09-18T12:52:27.693 INFO:tasks.workunit.client.0.smithi045.stdout:7/758: mkdir d13/d44/d37/d70/d77/d6d/d103 0 2024-09-18T12:52:27.694 INFO:tasks.workunit.client.0.smithi045.stdout:8/831: creat d11/d14/ddc/ffb x:0 0 0 2024-09-18T12:52:27.700 INFO:tasks.workunit.client.0.smithi045.stdout:6/713: getdents d9/d1a/d48/d75/dc7 0 2024-09-18T12:52:27.700 INFO:tasks.workunit.client.0.smithi045.stdout:7/759: dwrite f3 [0,4194304] 0 2024-09-18T12:52:27.703 INFO:tasks.workunit.client.0.smithi045.stdout:9/628: symlink d0/d3/d6/d10/d26/d2e/d6f/da5/dab/lc3 0 2024-09-18T12:52:27.707 INFO:tasks.workunit.client.0.smithi045.stdout:8/832: read d11/d14/d53/f3e [137724,25635] 0 2024-09-18T12:52:27.708 INFO:tasks.workunit.client.0.smithi045.stdout:5/836: rename d6/db/d19/d92/c64 to d6/db/d6a/d6d/c10a 0 2024-09-18T12:52:27.708 INFO:tasks.workunit.client.0.smithi045.stdout:9/629: chown d0/d3/d6/d10/d26/fa1 13815 1 2024-09-18T12:52:27.714 INFO:tasks.workunit.client.0.smithi045.stdout:1/734: dwrite d0/d12/d32/d67/d6a/fb2 [0,4194304] 0 2024-09-18T12:52:27.714 INFO:tasks.workunit.client.0.smithi045.stdout:6/714: dwrite d9/d56/fd9 [0,4194304] 0 2024-09-18T12:52:27.714 INFO:tasks.workunit.client.0.smithi045.stdout:7/760: dread d13/d44/d37/d70/f84 [0,4194304] 0 2024-09-18T12:52:27.717 INFO:tasks.workunit.client.0.smithi045.stdout:1/735: write d0/d2d/d2b/d30/f4f [4100939,3919] 0 2024-09-18T12:52:27.718 INFO:tasks.workunit.client.0.smithi045.stdout:5/837: read d6/d3e/f33 [372391,83759] 0 2024-09-18T12:52:27.719 INFO:tasks.workunit.client.0.smithi045.stdout:5/838: chown d6/db/d54/dd5/df7/lcb 115051947 1 2024-09-18T12:52:27.720 INFO:tasks.workunit.client.0.smithi045.stdout:5/839: chown d6/db/d54/de2/f8f 649071 1 2024-09-18T12:52:27.722 INFO:tasks.workunit.client.0.smithi045.stdout:9/630: unlink d0/d3/d6/d64/d88/f8c 0 2024-09-18T12:52:27.724 INFO:tasks.workunit.client.0.smithi045.stdout:5/840: read d6/d3e/fa0 [141629,74469] 0 2024-09-18T12:52:27.725 INFO:tasks.workunit.client.0.smithi045.stdout:7/761: rmdir d13/d31/d52 39 2024-09-18T12:52:27.726 INFO:tasks.workunit.client.0.smithi045.stdout:6/715: symlink d9/d1a/d48/dc6/lfa 0 2024-09-18T12:52:27.727 INFO:tasks.workunit.client.0.smithi045.stdout:7/762: dread - d13/d44/fd9 zero size 2024-09-18T12:52:27.729 INFO:tasks.workunit.client.0.smithi045.stdout:9/631: read d0/d3/d6/d10/d26/d2e/d4e/fbb [1772826,126047] 0 2024-09-18T12:52:27.729 INFO:tasks.workunit.client.0.smithi045.stdout:1/736: dwrite d0/d2d/f45 [0,4194304] 0 2024-09-18T12:52:27.733 INFO:tasks.workunit.client.0.smithi045.stdout:5/841: truncate d6/d3e/f9b 1385244 0 2024-09-18T12:52:27.740 INFO:tasks.workunit.client.0.smithi045.stdout:1/737: rmdir d0/d12 39 2024-09-18T12:52:27.741 INFO:tasks.workunit.client.0.smithi045.stdout:6/716: dwrite d9/d56/db3/fc2 [0,4194304] 0 2024-09-18T12:52:27.741 INFO:tasks.workunit.client.0.smithi045.stdout:9/632: write d0/f61 [3044426,53901] 0 2024-09-18T12:52:27.748 INFO:tasks.workunit.client.0.smithi045.stdout:7/763: dwrite d13/d44/d4c/d82/dda/ffc [4194304,4194304] 0 2024-09-18T12:52:27.749 INFO:tasks.workunit.client.0.smithi045.stdout:5/842: dread d6/db/d19/d92/d61/da5/dc9/fd4 [0,4194304] 0 2024-09-18T12:52:27.752 INFO:tasks.workunit.client.0.smithi045.stdout:6/717: symlink d9/d74/lfb 0 2024-09-18T12:52:27.753 INFO:tasks.workunit.client.0.smithi045.stdout:6/718: read d9/d1a/d48/d75/d81/fa3 [3340980,86583] 0 2024-09-18T12:52:27.759 INFO:tasks.workunit.client.0.smithi045.stdout:7/764: creat d13/d1a/d28/f104 x:0 0 0 2024-09-18T12:52:27.760 INFO:tasks.workunit.client.0.smithi045.stdout:1/738: creat d0/d2d/d2b/d30/d40/dc7/dd0/fde x:0 0 0 2024-09-18T12:52:27.762 INFO:tasks.workunit.client.0.smithi045.stdout:5/843: dread d6/d3e/fa0 [0,4194304] 0 2024-09-18T12:52:27.763 INFO:tasks.workunit.client.0.smithi045.stdout:6/719: dwrite d9/d1a/d2d/f4a [0,4194304] 0 2024-09-18T12:52:27.765 INFO:tasks.workunit.client.0.smithi045.stdout:6/720: readlink d9/d1a/d2d/d38/d5b/d67/lad 0 2024-09-18T12:52:27.765 INFO:tasks.workunit.client.0.smithi045.stdout:6/721: readlink d9/d1a/d2d/d38/d5b/l7a 0 2024-09-18T12:52:27.774 INFO:tasks.workunit.client.0.smithi045.stdout:6/722: creat d9/d1a/d2d/d32/db0/ffc x:0 0 0 2024-09-18T12:52:27.776 INFO:tasks.workunit.client.0.smithi045.stdout:9/633: getdents d0/d3/d6/d10/d26/da4 0 2024-09-18T12:52:27.777 INFO:tasks.workunit.client.0.smithi045.stdout:5/844: mknod d6/db/d54/dc2/dfe/d78/d66/de4/c10b 0 2024-09-18T12:52:27.778 INFO:tasks.workunit.client.0.smithi045.stdout:5/845: write d6/d3e/fe9 [587397,64114] 0 2024-09-18T12:52:27.779 INFO:tasks.workunit.client.0.smithi045.stdout:1/739: mkdir d0/d12/d32/d67/d6d/ddf 0 2024-09-18T12:52:27.779 INFO:tasks.workunit.client.0.smithi045.stdout:5/846: readlink d6/db/d70/l85 0 2024-09-18T12:52:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:27 smithi045 ceph-mon[28315]: pgmap v36: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 111 MiB/s rd, 237 MiB/s wr, 515 op/s 2024-09-18T12:52:27.784 INFO:tasks.workunit.client.0.smithi045.stdout:6/723: mkdir d9/d1a/d48/d75/d81/dfd 0 2024-09-18T12:52:27.790 INFO:tasks.workunit.client.0.smithi045.stdout:5/847: dwrite d6/db/d19/d92/d5c/f62 [0,4194304] 0 2024-09-18T12:52:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:27 smithi161 ceph-mon[35784]: pgmap v36: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 111 MiB/s rd, 237 MiB/s wr, 515 op/s 2024-09-18T12:52:27.795 INFO:tasks.workunit.client.0.smithi045.stdout:6/724: rmdir d9/d1a/d48/d75/d81/dfd 0 2024-09-18T12:52:27.796 INFO:tasks.workunit.client.0.smithi045.stdout:5/848: rmdir d6/db/d54/de2/d2b 39 2024-09-18T12:52:27.798 INFO:tasks.workunit.client.0.smithi045.stdout:6/725: write d9/f28 [1005086,31951] 0 2024-09-18T12:52:27.806 INFO:tasks.workunit.client.0.smithi045.stdout:6/726: mkdir d9/d1a/d48/d8f/d98/dab/dec/dfe 0 2024-09-18T12:52:27.806 INFO:tasks.workunit.client.0.smithi045.stdout:1/740: dread d0/d2d/f53 [0,4194304] 0 2024-09-18T12:52:27.811 INFO:tasks.workunit.client.0.smithi045.stdout:6/727: write d9/d1a/d2d/d38/fe5 [60182,76201] 0 2024-09-18T12:52:27.817 INFO:tasks.workunit.client.0.smithi045.stdout:5/849: creat d6/db/d19/d92/f10c x:0 0 0 2024-09-18T12:52:27.819 INFO:tasks.workunit.client.0.smithi045.stdout:5/850: dread - d6/db/d19/dbc/fd3 zero size 2024-09-18T12:52:27.824 INFO:tasks.workunit.client.0.smithi045.stdout:8/833: dwrite d11/d20/d46/f51 [0,4194304] 0 2024-09-18T12:52:27.825 INFO:tasks.workunit.client.0.smithi045.stdout:3/669: dwrite d0/d29/d53/fe0 [4194304,4194304] 0 2024-09-18T12:52:27.827 INFO:tasks.workunit.client.0.smithi045.stdout:6/728: creat d9/d1a/d48/d8f/d98/fff x:0 0 0 2024-09-18T12:52:27.833 INFO:tasks.workunit.client.0.smithi045.stdout:1/741: dwrite d0/d2d/d2b/d30/d40/dc7/dd0/fde [0,4194304] 0 2024-09-18T12:52:27.840 INFO:tasks.workunit.client.0.smithi045.stdout:8/834: write d11/d20/d60/da3/fb5 [1623517,122322] 0 2024-09-18T12:52:27.844 INFO:tasks.workunit.client.0.smithi045.stdout:8/835: rename d11/d20/d60/dc3 to d11/d20/d60/dc3/dbd/dd5/dfc 22 2024-09-18T12:52:27.846 INFO:tasks.workunit.client.0.smithi045.stdout:1/742: rmdir d0/d12/d32/d67/d6d/d9c 39 2024-09-18T12:52:27.852 INFO:tasks.workunit.client.0.smithi045.stdout:6/729: dread d9/d1a/d48/d75/d81/fa3 [0,4194304] 0 2024-09-18T12:52:27.852 INFO:tasks.workunit.client.0.smithi045.stdout:8/836: chown d11/d14/ddc/fe2 15 1 2024-09-18T12:52:27.855 INFO:tasks.workunit.client.0.smithi045.stdout:3/670: truncate d0/d1e/d2c/d3a/f6d 1926222 0 2024-09-18T12:52:27.857 INFO:tasks.workunit.client.0.smithi045.stdout:5/851: mkdir d6/db/d54/de2/d2b/d51/d10d 0 2024-09-18T12:52:27.862 INFO:tasks.workunit.client.0.smithi045.stdout:9/634: dwrite d0/d3/f7 [4194304,4194304] 0 2024-09-18T12:52:27.864 INFO:tasks.workunit.client.0.smithi045.stdout:3/671: fsync d0/d1e/d2c/f42 0 2024-09-18T12:52:27.864 INFO:tasks.workunit.client.0.smithi045.stdout:6/730: creat d9/d1a/d48/d8f/d98/dab/f100 x:0 0 0 2024-09-18T12:52:27.865 INFO:tasks.workunit.client.0.smithi045.stdout:6/731: readlink d9/d56/lbe 0 2024-09-18T12:52:27.872 INFO:tasks.workunit.client.0.smithi045.stdout:6/732: read d9/d1a/d48/f6d [3854591,109020] 0 2024-09-18T12:52:27.874 INFO:tasks.workunit.client.0.smithi045.stdout:9/635: truncate d0/d3/d6/d10/f1b 4185398 0 2024-09-18T12:52:27.877 INFO:tasks.workunit.client.0.smithi045.stdout:8/837: getdents d11/d20 0 2024-09-18T12:52:27.884 INFO:tasks.workunit.client.0.smithi045.stdout:3/672: symlink d0/d1e/d2c/d3f/d44/d75/le6 0 2024-09-18T12:52:27.890 INFO:tasks.workunit.client.0.smithi045.stdout:1/743: dread d0/d12/d32/d67/d6a/f96 [0,4194304] 0 2024-09-18T12:52:27.892 INFO:tasks.workunit.client.0.smithi045.stdout:3/673: mkdir d0/d1e/d39/db7/de7 0 2024-09-18T12:52:27.895 INFO:tasks.workunit.client.0.smithi045.stdout:9/636: dread d0/f50 [4194304,4194304] 0 2024-09-18T12:52:27.896 INFO:tasks.workunit.client.0.smithi045.stdout:9/637: chown d0/d3/d6/d10/d2c 14552368 1 2024-09-18T12:52:27.897 INFO:tasks.workunit.client.0.smithi045.stdout:1/744: creat d0/d2d/db1/fe0 x:0 0 0 2024-09-18T12:52:27.899 INFO:tasks.workunit.client.0.smithi045.stdout:5/852: write d6/db/d19/d92/f76 [111416,21208] 0 2024-09-18T12:52:27.901 INFO:tasks.workunit.client.0.smithi045.stdout:5/853: stat d6/db/d19/d92/d61/da5/fa9 0 2024-09-18T12:52:27.904 INFO:tasks.workunit.client.0.smithi045.stdout:8/838: getdents d11/d23 0 2024-09-18T12:52:27.905 INFO:tasks.workunit.client.0.smithi045.stdout:1/745: rename d0/d2d/d2b/d30/l99 to d0/d2d/d92/le1 0 2024-09-18T12:52:27.906 INFO:tasks.workunit.client.0.smithi045.stdout:9/638: dwrite d0/d3/d6/f2d [4194304,4194304] 0 2024-09-18T12:52:27.915 INFO:tasks.workunit.client.0.smithi045.stdout:1/746: chown d0/c7b 309285 1 2024-09-18T12:52:27.922 INFO:tasks.workunit.client.0.smithi045.stdout:3/674: dwrite d0/d1e/f38 [0,4194304] 0 2024-09-18T12:52:27.926 INFO:tasks.workunit.client.0.smithi045.stdout:3/675: dread - d0/d29/d53/f7e zero size 2024-09-18T12:52:27.928 INFO:tasks.workunit.client.0.smithi045.stdout:1/747: symlink d0/d2d/d2b/d30/d40/d60/le2 0 2024-09-18T12:52:27.930 INFO:tasks.workunit.client.0.smithi045.stdout:5/854: dwrite d6/db/d54/fb6 [0,4194304] 0 2024-09-18T12:52:27.933 INFO:tasks.workunit.client.0.smithi045.stdout:8/839: dread f6 [0,4194304] 0 2024-09-18T12:52:27.940 INFO:tasks.workunit.client.0.smithi045.stdout:3/676: dwrite d0/d29/d5f/d73/da0/fb5 [0,4194304] 0 2024-09-18T12:52:27.940 INFO:tasks.workunit.client.0.smithi045.stdout:9/639: truncate d0/d3/f90 2589729 0 2024-09-18T12:52:27.941 INFO:tasks.workunit.client.0.smithi045.stdout:8/840: unlink d11/d14/d53/lac 0 2024-09-18T12:52:27.946 INFO:tasks.workunit.client.0.smithi045.stdout:3/677: mknod d0/d1e/d39/db7/db1/ce8 0 2024-09-18T12:52:27.947 INFO:tasks.workunit.client.0.smithi045.stdout:1/748: write d0/d2d/d2b/f2f [534268,64182] 0 2024-09-18T12:52:27.948 INFO:tasks.workunit.client.0.smithi045.stdout:9/640: truncate d0/d3/d6/d10/d26/f60 4711041 0 2024-09-18T12:52:27.948 INFO:tasks.workunit.client.0.smithi045.stdout:5/855: dread d6/db/d19/d92/d61/da5/fef [0,4194304] 0 2024-09-18T12:52:27.950 INFO:tasks.workunit.client.0.smithi045.stdout:8/841: mknod d11/d20/d60/dc3/dbd/dd5/cfd 0 2024-09-18T12:52:27.954 INFO:tasks.workunit.client.0.smithi045.stdout:9/641: mknod d0/d3/d6/d10/d26/da4/cc4 0 2024-09-18T12:52:27.956 INFO:tasks.workunit.client.0.smithi045.stdout:8/842: fsync d11/d14/d72/da9/ffa 0 2024-09-18T12:52:27.958 INFO:tasks.workunit.client.0.smithi045.stdout:1/749: dwrite d0/d2d/fc2 [0,4194304] 0 2024-09-18T12:52:27.959 INFO:tasks.workunit.client.0.smithi045.stdout:9/642: mkdir d0/d3/d6/d64/d77/dc5 0 2024-09-18T12:52:27.961 INFO:tasks.workunit.client.0.smithi045.stdout:5/856: dwrite d6/db/d54/fb6 [4194304,4194304] 0 2024-09-18T12:52:27.961 INFO:tasks.workunit.client.0.smithi045.stdout:8/843: truncate d11/fdf 916778 0 2024-09-18T12:52:27.962 INFO:tasks.workunit.client.0.smithi045.stdout:5/857: stat d6/db/d54/de2/d2b/d51/d10d 0 2024-09-18T12:52:27.965 INFO:tasks.workunit.client.0.smithi045.stdout:1/750: symlink d0/le3 0 2024-09-18T12:52:27.967 INFO:tasks.workunit.client.0.smithi045.stdout:1/751: write d0/d2d/f68 [524693,23068] 0 2024-09-18T12:52:27.967 INFO:tasks.workunit.client.0.smithi045.stdout:5/858: write d6/db/d54/dc2/dfe/f5f [105978,102952] 0 2024-09-18T12:52:27.970 INFO:tasks.workunit.client.0.smithi045.stdout:5/859: chown d6/db/l96 1 1 2024-09-18T12:52:27.970 INFO:tasks.workunit.client.0.smithi045.stdout:1/752: stat d0/d2d/d2b/d30/d40/d60/d8f/f70 0 2024-09-18T12:52:27.974 INFO:tasks.workunit.client.0.smithi045.stdout:5/860: mknod d6/db/d19/c10e 0 2024-09-18T12:52:27.976 INFO:tasks.workunit.client.0.smithi045.stdout:1/753: mknod d0/d2d/db1/ce4 0 2024-09-18T12:52:27.980 INFO:tasks.workunit.client.0.smithi045.stdout:3/678: dread d0/d7/f23 [0,4194304] 0 2024-09-18T12:52:27.985 INFO:tasks.workunit.client.0.smithi045.stdout:3/679: mkdir d0/d7/de9 0 2024-09-18T12:52:27.986 INFO:tasks.workunit.client.0.smithi045.stdout:5/861: dwrite d6/db/fe [0,4194304] 0 2024-09-18T12:52:27.988 INFO:tasks.workunit.client.0.smithi045.stdout:5/862: write d6/db/d54/de2/fd0 [3337626,54623] 0 2024-09-18T12:52:27.996 INFO:tasks.workunit.client.0.smithi045.stdout:3/680: symlink d0/d1e/d39/lea 0 2024-09-18T12:52:27.997 INFO:tasks.workunit.client.0.smithi045.stdout:2/867: sync 2024-09-18T12:52:28.001 INFO:tasks.workunit.client.0.smithi045.stdout:3/681: unlink d0/d29/c52 0 2024-09-18T12:52:28.001 INFO:tasks.workunit.client.0.smithi045.stdout:2/868: read - d5/d2c/f88 zero size 2024-09-18T12:52:28.003 INFO:tasks.workunit.client.0.smithi045.stdout:3/682: dread - d0/d1e/d2c/d3a/d45/dbe/fdd zero size 2024-09-18T12:52:28.004 INFO:tasks.workunit.client.0.smithi045.stdout:3/683: fdatasync d0/fca 0 2024-09-18T12:52:28.005 INFO:tasks.workunit.client.0.smithi045.stdout:2/869: creat d5/d2c/d6f/d9d/f11f x:0 0 0 2024-09-18T12:52:28.005 INFO:tasks.workunit.client.0.smithi045.stdout:1/754: dread d0/d2d/d2b/f9b [0,4194304] 0 2024-09-18T12:52:28.007 INFO:tasks.workunit.client.0.smithi045.stdout:5/863: write d6/db/d19/f4f [3547491,104861] 0 2024-09-18T12:52:28.008 INFO:tasks.workunit.client.0.smithi045.stdout:3/684: dread - d0/d22/faf zero size 2024-09-18T12:52:28.009 INFO:tasks.workunit.client.0.smithi045.stdout:2/870: mknod d5/d46/de0/c120 0 2024-09-18T12:52:28.011 INFO:tasks.workunit.client.0.smithi045.stdout:1/755: unlink d0/d2d/d92/fbf 0 2024-09-18T12:52:28.012 INFO:tasks.workunit.client.0.smithi045.stdout:5/864: readlink d6/d3e/l29 0 2024-09-18T12:52:28.014 INFO:tasks.workunit.client.0.smithi045.stdout:2/871: symlink d5/d2c/d6f/l121 0 2024-09-18T12:52:28.019 INFO:tasks.workunit.client.0.smithi045.stdout:2/872: unlink d5/d2c/d4d/c97 0 2024-09-18T12:52:28.021 INFO:tasks.workunit.client.0.smithi045.stdout:1/756: dwrite d0/d2d/f53 [4194304,4194304] 0 2024-09-18T12:52:28.022 INFO:tasks.workunit.client.0.smithi045.stdout:1/757: stat d0/d12/d32/d67/f98 0 2024-09-18T12:52:28.026 INFO:tasks.workunit.client.0.smithi045.stdout:2/873: rename d5/d3a/d3e/dd4/ffe to d5/d2c/d6f/f122 0 2024-09-18T12:52:28.029 INFO:tasks.workunit.client.0.smithi045.stdout:5/865: dread d6/db/d19/d92/f76 [0,4194304] 0 2024-09-18T12:52:28.032 INFO:tasks.workunit.client.0.smithi045.stdout:5/866: chown d6/db/d54/dc2/dfe/cd8 642909927 1 2024-09-18T12:52:28.033 INFO:tasks.workunit.client.0.smithi045.stdout:2/874: dwrite d5/d5f/f99 [0,4194304] 0 2024-09-18T12:52:28.037 INFO:tasks.workunit.client.0.smithi045.stdout:2/875: creat d5/d46/de0/f123 x:0 0 0 2024-09-18T12:52:28.039 INFO:tasks.workunit.client.0.smithi045.stdout:5/867: symlink d6/db/d54/de2/d2b/de7/l10f 0 2024-09-18T12:52:28.054 INFO:tasks.workunit.client.0.smithi045.stdout:2/876: dread - d5/d2c/fd2 zero size 2024-09-18T12:52:28.061 INFO:tasks.workunit.client.0.smithi045.stdout:5/868: dwrite d6/d3e/f3f [4194304,4194304] 0 2024-09-18T12:52:28.062 INFO:tasks.workunit.client.0.smithi045.stdout:1/758: rename d0/d2d/db1/fe0 to d0/d12/d6f/fe5 0 2024-09-18T12:52:28.063 INFO:tasks.workunit.client.0.smithi045.stdout:5/869: dread - d6/db/d19/d92/d5c/f98 zero size 2024-09-18T12:52:28.065 INFO:tasks.workunit.client.0.smithi045.stdout:5/870: dread - d6/db/d19/d92/d61/da5/dc9/ffb zero size 2024-09-18T12:52:28.066 INFO:tasks.workunit.client.0.smithi045.stdout:2/877: truncate d5/d2c/d4d/f5a 3227770 0 2024-09-18T12:52:28.068 INFO:tasks.workunit.client.0.smithi045.stdout:1/759: unlink d0/d2d/d92/l93 0 2024-09-18T12:52:28.075 INFO:tasks.workunit.client.0.smithi045.stdout:1/760: rename d0/d2d/d2b/d30/f48 to d0/fe6 0 2024-09-18T12:52:28.079 INFO:tasks.workunit.client.0.smithi045.stdout:2/878: write d5/d5f/db2/f37 [4475002,83767] 0 2024-09-18T12:52:28.085 INFO:tasks.workunit.client.0.smithi045.stdout:1/761: dwrite d0/f6 [0,4194304] 0 2024-09-18T12:52:28.090 INFO:tasks.workunit.client.0.smithi045.stdout:2/879: getdents d5/d2c/d4d/d76 0 2024-09-18T12:52:28.091 INFO:tasks.workunit.client.0.smithi045.stdout:2/880: readlink d5/d46/lf8 0 2024-09-18T12:52:28.092 INFO:tasks.workunit.client.0.smithi045.stdout:2/881: dread - d5/d3a/f106 zero size 2024-09-18T12:52:28.095 INFO:tasks.workunit.client.0.smithi045.stdout:2/882: rename d5/d3a/d3e/c9f to d5/d2c/d6f/d9d/c124 0 2024-09-18T12:52:28.098 INFO:tasks.workunit.client.0.smithi045.stdout:1/762: write d0/f3c [129150,34289] 0 2024-09-18T12:52:28.109 INFO:tasks.workunit.client.0.smithi045.stdout:1/763: creat d0/d12/d32/d67/d6d/fe7 x:0 0 0 2024-09-18T12:52:28.113 INFO:tasks.workunit.client.0.smithi045.stdout:1/764: unlink d0/d12/d32/d67/f98 0 2024-09-18T12:52:28.114 INFO:tasks.workunit.client.0.smithi045.stdout:2/883: dwrite d5/d2c/d6f/fa5 [0,4194304] 0 2024-09-18T12:52:28.114 INFO:tasks.workunit.client.0.smithi045.stdout:1/765: chown d0/d12/la5 1149642 1 2024-09-18T12:52:28.123 INFO:tasks.workunit.client.0.smithi045.stdout:1/766: dwrite d0/d2d/d2b/d30/d40/fc9 [0,4194304] 0 2024-09-18T12:52:28.128 INFO:tasks.workunit.client.0.smithi045.stdout:2/884: write d5/d2c/d6f/d9d/fb9 [839514,80792] 0 2024-09-18T12:52:28.131 INFO:tasks.workunit.client.0.smithi045.stdout:1/767: dwrite d0/d2d/f53 [0,4194304] 0 2024-09-18T12:52:28.134 INFO:tasks.workunit.client.0.smithi045.stdout:1/768: mknod d0/d12/d6f/ce8 0 2024-09-18T12:52:28.142 INFO:tasks.workunit.client.0.smithi045.stdout:1/769: dwrite d0/d2d/d2b/d30/d40/d60/d8f/f70 [4194304,4194304] 0 2024-09-18T12:52:28.147 INFO:tasks.workunit.client.0.smithi045.stdout:1/770: symlink d0/le9 0 2024-09-18T12:52:28.149 INFO:tasks.workunit.client.0.smithi045.stdout:1/771: symlink d0/d2d/d2b/d30/d40/dc7/lea 0 2024-09-18T12:52:28.150 INFO:tasks.workunit.client.0.smithi045.stdout:1/772: truncate d0/d2d/d2b/d30/d8b/fda 338468 0 2024-09-18T12:52:28.153 INFO:tasks.workunit.client.0.smithi045.stdout:1/773: unlink d0/d12/da7/c7a 0 2024-09-18T12:52:28.154 INFO:tasks.workunit.client.0.smithi045.stdout:1/774: stat d0/d2d/d2b/d30/d40/dc7/dd0/fde 0 2024-09-18T12:52:28.171 INFO:tasks.workunit.client.0.smithi045.stdout:2/885: dread d5/d5f/da8/f6e [0,4194304] 0 2024-09-18T12:52:28.174 INFO:tasks.workunit.client.0.smithi045.stdout:1/775: dwrite d0/d2d/d2b/fb6 [0,4194304] 0 2024-09-18T12:52:28.176 INFO:tasks.workunit.client.0.smithi045.stdout:2/886: stat d5/ca 0 2024-09-18T12:52:28.177 INFO:tasks.workunit.client.0.smithi045.stdout:2/887: dread - d5/d2c/f88 zero size 2024-09-18T12:52:28.182 INFO:tasks.workunit.client.0.smithi045.stdout:1/776: mkdir d0/d2d/d2b/deb 0 2024-09-18T12:52:28.186 INFO:tasks.workunit.client.0.smithi045.stdout:1/777: symlink d0/d2d/d2b/d30/d40/lec 0 2024-09-18T12:52:28.186 INFO:tasks.workunit.client.0.smithi045.stdout:2/888: link d5/d2c/d4d/d76/dd5/ce1 d5/d46/de0/c125 0 2024-09-18T12:52:28.186 INFO:tasks.workunit.client.0.smithi045.stdout:1/778: chown d0/d2d/d92/fdd 91 1 2024-09-18T12:52:28.187 INFO:tasks.workunit.client.0.smithi045.stdout:2/889: write d5/d2c/ff2 [2643376,85408] 0 2024-09-18T12:52:28.189 INFO:tasks.workunit.client.0.smithi045.stdout:1/779: mknod d0/d2d/d2b/d30/d40/d61/ced 0 2024-09-18T12:52:28.190 INFO:tasks.workunit.client.0.smithi045.stdout:2/890: mknod d5/d2c/d6f/d9d/c126 0 2024-09-18T12:52:28.191 INFO:tasks.workunit.client.0.smithi045.stdout:1/780: mknod d0/d2d/cee 0 2024-09-18T12:52:28.193 INFO:tasks.workunit.client.0.smithi045.stdout:1/781: mkdir d0/d2d/d92/def 0 2024-09-18T12:52:28.196 INFO:tasks.workunit.client.0.smithi045.stdout:1/782: symlink d0/d2d/d2b/lf0 0 2024-09-18T12:52:28.201 INFO:tasks.workunit.client.0.smithi045.stdout:1/783: dwrite d0/d2d/f45 [0,4194304] 0 2024-09-18T12:52:28.202 INFO:tasks.workunit.client.0.smithi045.stdout:1/784: truncate d0/f3c 1253771 0 2024-09-18T12:52:28.204 INFO:tasks.workunit.client.0.smithi045.stdout:2/891: truncate d5/d46/f8e 3891297 0 2024-09-18T12:52:28.207 INFO:tasks.workunit.client.0.smithi045.stdout:1/785: creat d0/d2d/d92/def/ff1 x:0 0 0 2024-09-18T12:52:28.208 INFO:tasks.workunit.client.0.smithi045.stdout:2/892: creat d5/d2c/d4d/d76/dd5/f127 x:0 0 0 2024-09-18T12:52:28.209 INFO:tasks.workunit.client.0.smithi045.stdout:2/893: fdatasync d5/d5f/da8/fa1 0 2024-09-18T12:52:28.210 INFO:tasks.workunit.client.0.smithi045.stdout:1/786: dread d0/d12/d32/d67/d6a/faf [0,4194304] 0 2024-09-18T12:52:28.211 INFO:tasks.workunit.client.0.smithi045.stdout:2/894: write d5/d2c/d6f/fa5 [1213260,1384] 0 2024-09-18T12:52:28.217 INFO:tasks.workunit.client.0.smithi045.stdout:1/787: dwrite d0/d2d/f68 [0,4194304] 0 2024-09-18T12:52:28.218 INFO:tasks.workunit.client.0.smithi045.stdout:1/788: readlink d0/d12/l1e 0 2024-09-18T12:52:28.223 INFO:tasks.workunit.client.0.smithi045.stdout:1/789: dread d0/f3c [0,4194304] 0 2024-09-18T12:52:28.232 INFO:tasks.workunit.client.0.smithi045.stdout:1/790: link d0/d2d/d92/cc0 d0/d2d/d92/cf2 0 2024-09-18T12:52:28.237 INFO:tasks.workunit.client.0.smithi045.stdout:1/791: truncate d0/d2d/fc5 5135386 0 2024-09-18T12:52:28.238 INFO:tasks.workunit.client.0.smithi045.stdout:1/792: write d0/d2d/d2b/d30/fa6 [986459,22539] 0 2024-09-18T12:52:28.244 INFO:tasks.workunit.client.0.smithi045.stdout:1/793: creat d0/d2d/d2b/d30/d8b/ff3 x:0 0 0 2024-09-18T12:52:28.244 INFO:tasks.workunit.client.0.smithi045.stdout:1/794: dread - d0/d2d/d92/fdd zero size 2024-09-18T12:52:28.250 INFO:tasks.workunit.client.0.smithi045.stdout:1/795: dread d0/d12/d32/d67/d6d/fa2 [0,4194304] 0 2024-09-18T12:52:28.251 INFO:tasks.workunit.client.0.smithi045.stdout:1/796: write d0/d2d/fc2 [3149967,44203] 0 2024-09-18T12:52:28.252 INFO:tasks.workunit.client.0.smithi045.stdout:1/797: readlink d0/d2d/d2b/d30/d40/d60/le2 0 2024-09-18T12:52:28.258 INFO:tasks.workunit.client.0.smithi045.stdout:1/798: mkdir d0/d2d/d6c/df4 0 2024-09-18T12:52:28.262 INFO:tasks.workunit.client.0.smithi045.stdout:1/799: dread d0/d2d/f45 [0,4194304] 0 2024-09-18T12:52:28.264 INFO:tasks.workunit.client.0.smithi045.stdout:1/800: fdatasync d0/d12/da7/f58 0 2024-09-18T12:52:28.265 INFO:tasks.workunit.client.0.smithi045.stdout:1/801: dread - d0/d12/d6f/fe5 zero size 2024-09-18T12:52:28.277 INFO:tasks.workunit.client.0.smithi045.stdout:1/802: dread d0/d2d/d2b/d30/d40/d60/d8f/fb8 [0,4194304] 0 2024-09-18T12:52:28.278 INFO:tasks.workunit.client.0.smithi045.stdout:1/803: chown d0/d2d/d2b/d30/fb9 431 1 2024-09-18T12:52:28.283 INFO:tasks.workunit.client.0.smithi045.stdout:1/804: dread d0/d12/d32/d67/d6d/fa1 [0,4194304] 0 2024-09-18T12:52:28.285 INFO:tasks.workunit.client.0.smithi045.stdout:1/805: write d0/d12/d32/d67/fce [974050,77681] 0 2024-09-18T12:52:28.288 INFO:tasks.workunit.client.0.smithi045.stdout:1/806: getdents d0/d2d/d2b/d30/d40/dc7/dd0 0 2024-09-18T12:52:28.294 INFO:tasks.workunit.client.0.smithi045.stdout:1/807: rename d0/d12/d32/d67/d6d/cd4 to d0/d2d/d2b/d30/cf5 0 2024-09-18T12:52:28.295 INFO:tasks.workunit.client.0.smithi045.stdout:1/808: write d0/d2d/d2b/d30/d40/dc7/dd0/fde [4399887,118423] 0 2024-09-18T12:52:28.298 INFO:tasks.workunit.client.0.smithi045.stdout:1/809: creat d0/d2d/d2b/d30/d40/dc7/ff6 x:0 0 0 2024-09-18T12:52:28.300 INFO:tasks.workunit.client.0.smithi045.stdout:1/810: mknod d0/d2d/db1/dc6/cf7 0 2024-09-18T12:52:28.301 INFO:tasks.workunit.client.0.smithi045.stdout:1/811: stat d0/d12/d32/ca3 0 2024-09-18T12:52:28.308 INFO:tasks.workunit.client.0.smithi045.stdout:1/812: write d0/d12/d32/d67/d6a/f96 [4225455,19253] 0 2024-09-18T12:52:28.309 INFO:tasks.workunit.client.0.smithi045.stdout:1/813: readlink d0/l14 0 2024-09-18T12:52:28.311 INFO:tasks.workunit.client.0.smithi045.stdout:1/814: write d0/d12/d32/d67/fce [1308055,116616] 0 2024-09-18T12:52:28.317 INFO:tasks.workunit.client.0.smithi045.stdout:1/815: link d0/d2d/d2b/d30/fdc d0/d2d/d2b/d30/d8b/ff8 0 2024-09-18T12:52:28.330 INFO:tasks.workunit.client.0.smithi045.stdout:1/816: write d0/d2d/d6c/fad [978420,97648] 0 2024-09-18T12:52:28.337 INFO:tasks.workunit.client.0.smithi045.stdout:1/817: dwrite d0/d12/d32/d67/d6a/fb2 [4194304,4194304] 0 2024-09-18T12:52:28.341 INFO:tasks.workunit.client.0.smithi045.stdout:1/818: symlink d0/lf9 0 2024-09-18T12:52:28.345 INFO:tasks.workunit.client.0.smithi045.stdout:1/819: unlink d0/d12/d32/d67/d6a/faf 0 2024-09-18T12:52:28.345 INFO:tasks.workunit.client.0.smithi045.stdout:1/820: chown d0/d12/d6f/ce8 3 1 2024-09-18T12:52:28.353 INFO:tasks.workunit.client.0.smithi045.stdout:1/821: dwrite d0/d2d/d2b/d30/d8b/fd7 [0,4194304] 0 2024-09-18T12:52:28.355 INFO:tasks.workunit.client.0.smithi045.stdout:1/822: mknod d0/d2d/d2b/d30/d40/cfa 0 2024-09-18T12:52:28.356 INFO:tasks.workunit.client.0.smithi045.stdout:1/823: chown d0/d2d/c39 19520 1 2024-09-18T12:52:28.359 INFO:tasks.workunit.client.0.smithi045.stdout:1/824: mknod d0/d2d/d2b/deb/cfb 0 2024-09-18T12:52:28.361 INFO:tasks.workunit.client.0.smithi045.stdout:1/825: symlink d0/d2d/d2b/d30/d8b/d5b/lfc 0 2024-09-18T12:52:28.365 INFO:tasks.workunit.client.0.smithi045.stdout:1/826: symlink d0/d12/d32/lfd 0 2024-09-18T12:52:28.365 INFO:tasks.workunit.client.0.smithi045.stdout:1/827: fdatasync d0/d2d/d92/fdd 0 2024-09-18T12:52:28.365 INFO:tasks.workunit.client.0.smithi045.stdout:1/828: write d0/d12/d32/d67/d6d/fe7 [497341,14161] 0 2024-09-18T12:52:28.372 INFO:tasks.workunit.client.0.smithi045.stdout:1/829: dwrite d0/d2d/d2b/d30/d8b/f4e [0,4194304] 0 2024-09-18T12:52:28.380 INFO:tasks.workunit.client.0.smithi045.stdout:1/830: dwrite d0/d2d/d6c/fdb [0,4194304] 0 2024-09-18T12:52:28.383 INFO:tasks.workunit.client.0.smithi045.stdout:1/831: mknod d0/d2d/d2b/cfe 0 2024-09-18T12:52:28.390 INFO:tasks.workunit.client.0.smithi045.stdout:1/832: getdents d0/d2d/d2b/deb 0 2024-09-18T12:52:28.393 INFO:tasks.workunit.client.0.smithi045.stdout:1/833: unlink d0/d2d/l8a 0 2024-09-18T12:52:28.396 INFO:tasks.workunit.client.0.smithi045.stdout:1/834: dread d0/d2d/d6c/fdb [0,4194304] 0 2024-09-18T12:52:28.400 INFO:tasks.workunit.client.0.smithi045.stdout:1/835: creat d0/d2d/db1/dc6/dc8/fff x:0 0 0 2024-09-18T12:52:28.402 INFO:tasks.workunit.client.0.smithi045.stdout:1/836: mkdir d0/d2d/db1/d100 0 2024-09-18T12:52:28.405 INFO:tasks.workunit.client.0.smithi045.stdout:1/837: symlink d0/d2d/d2b/d30/d40/d60/l101 0 2024-09-18T12:52:28.407 INFO:tasks.workunit.client.0.smithi045.stdout:1/838: mkdir d0/d12/d32/d102 0 2024-09-18T12:52:28.408 INFO:tasks.workunit.client.0.smithi045.stdout:1/839: read d0/d2d/d2b/f9b [2196036,41041] 0 2024-09-18T12:52:28.411 INFO:tasks.workunit.client.0.smithi045.stdout:1/840: rename d0/d2d/d6c/f8c to d0/d12/f103 0 2024-09-18T12:52:28.423 INFO:tasks.workunit.client.0.smithi045.stdout:1/841: rename d0/d2d/d6c to d0/d2d/d2b/d30/d40/d60/d8f/d104 0 2024-09-18T12:52:28.437 INFO:tasks.workunit.client.0.smithi045.stdout:1/842: write d0/d2d/d2b/d30/d40/d60/d8f/f43 [3986781,96456] 0 2024-09-18T12:52:28.440 INFO:tasks.workunit.client.0.smithi045.stdout:1/843: mkdir d0/d2d/d2b/d30/d40/d105 0 2024-09-18T12:52:28.450 INFO:tasks.workunit.client.0.smithi045.stdout:1/844: dread d0/d2d/d2b/d30/f4f [0,4194304] 0 2024-09-18T12:52:28.452 INFO:tasks.workunit.client.0.smithi045.stdout:1/845: truncate d0/d2d/d2b/d30/d8b/f4e 5128911 0 2024-09-18T12:52:28.453 INFO:tasks.workunit.client.0.smithi045.stdout:1/846: write d0/d12/da7/f28 [1722139,29225] 0 2024-09-18T12:52:28.456 INFO:tasks.workunit.client.0.smithi045.stdout:1/847: rename d0/d2d/d2b/d30/d40/d60/d8f/d104/c9f to d0/d12/d32/d102/c106 0 2024-09-18T12:52:28.467 INFO:tasks.workunit.client.0.smithi045.stdout:1/848: dread d0/d12/d6f/f87 [0,4194304] 0 2024-09-18T12:52:28.470 INFO:tasks.workunit.client.0.smithi045.stdout:1/849: rename d0/d12/f13 to d0/d12/da7/f107 0 2024-09-18T12:52:28.473 INFO:tasks.workunit.client.0.smithi045.stdout:1/850: unlink d0/d12/d32/d67/d6a/ld5 0 2024-09-18T12:52:28.489 INFO:tasks.workunit.client.0.smithi045.stdout:1/851: dread d0/d2d/d2b/d30/d40/d60/d8f/f43 [0,4194304] 0 2024-09-18T12:52:28.497 INFO:tasks.workunit.client.0.smithi045.stdout:1/852: truncate d0/d2d/d2b/d30/d8b/fda 137259 0 2024-09-18T12:52:28.499 INFO:tasks.workunit.client.0.smithi045.stdout:1/853: mknod d0/d12/d32/d102/c108 0 2024-09-18T12:52:28.506 INFO:tasks.workunit.client.0.smithi045.stdout:1/854: dwrite d0/d2d/d2b/d30/d8b/fd7 [0,4194304] 0 2024-09-18T12:52:28.526 INFO:tasks.workunit.client.0.smithi045.stdout:1/855: dread d0/fe [4194304,4194304] 0 2024-09-18T12:52:28.532 INFO:tasks.workunit.client.0.smithi045.stdout:1/856: dwrite d0/f2 [4194304,4194304] 0 2024-09-18T12:52:28.540 INFO:tasks.workunit.client.0.smithi045.stdout:1/857: dwrite d0/d12/f103 [0,4194304] 0 2024-09-18T12:52:28.568 INFO:tasks.workunit.client.0.smithi045.stdout:1/858: truncate d0/d2d/d2b/d30/d40/d60/d8f/d104/fdb 930835 0 2024-09-18T12:52:28.572 INFO:tasks.workunit.client.0.smithi045.stdout:1/859: mkdir d0/d2d/db1/d109 0 2024-09-18T12:52:28.572 INFO:tasks.workunit.client.0.smithi045.stdout:1/860: chown d0/d2d/f53 73319 1 2024-09-18T12:52:28.576 INFO:tasks.workunit.client.0.smithi045.stdout:1/861: mkdir d0/d2d/d2b/d30/d40/d60/d8f/d104/df4/d10a 0 2024-09-18T12:52:28.591 INFO:tasks.workunit.client.0.smithi045.stdout:1/862: dwrite d0/d2d/d2b/d30/fdc [0,4194304] 0 2024-09-18T12:52:28.595 INFO:tasks.workunit.client.0.smithi045.stdout:1/863: creat d0/d2d/d2b/d30/d40/dc7/dd0/f10b x:0 0 0 2024-09-18T12:52:28.597 INFO:tasks.workunit.client.0.smithi045.stdout:1/864: creat d0/d2d/d2b/d30/d40/dc7/dd0/f10c x:0 0 0 2024-09-18T12:52:28.599 INFO:tasks.workunit.client.0.smithi045.stdout:1/865: mkdir d0/d2d/db1/dc6/d10d 0 2024-09-18T12:52:28.601 INFO:tasks.workunit.client.0.smithi045.stdout:1/866: mkdir d0/d2d/d2b/d30/d8b/d5b/d10e 0 2024-09-18T12:52:28.602 INFO:tasks.workunit.client.0.smithi045.stdout:1/867: write d0/d2d/d2b/fb6 [5056121,77197] 0 2024-09-18T12:52:28.613 INFO:tasks.workunit.client.0.smithi045.stdout:1/868: rename d0/d12/d32/d67/d6d/d9c/cd8 to d0/d2d/d2b/d30/d40/d60/c10f 0 2024-09-18T12:52:28.617 INFO:tasks.workunit.client.0.smithi045.stdout:1/869: creat d0/d2d/db1/dc6/dc8/dbd/f110 x:0 0 0 2024-09-18T12:52:28.618 INFO:tasks.workunit.client.0.smithi045.stdout:1/870: readlink d0/d2d/d2b/d30/d8b/d5b/l5d 0 2024-09-18T12:52:28.619 INFO:tasks.workunit.client.0.smithi045.stdout:1/871: write d0/d2d/d2b/d30/d40/dc7/ff6 [930952,45618] 0 2024-09-18T12:52:28.626 INFO:tasks.workunit.client.0.smithi045.stdout:1/872: getdents d0/d2d/d92/def 0 2024-09-18T12:52:28.628 INFO:tasks.workunit.client.0.smithi045.stdout:1/873: creat d0/d2d/d2b/d30/d40/d60/d8f/f111 x:0 0 0 2024-09-18T12:52:28.634 INFO:tasks.workunit.client.0.smithi045.stdout:1/874: dwrite d0/d12/d32/d67/d6d/fe7 [0,4194304] 0 2024-09-18T12:52:28.635 INFO:tasks.workunit.client.0.smithi045.stdout:1/875: rmdir d0/d2d/d2b 39 2024-09-18T12:52:28.640 INFO:tasks.workunit.client.0.smithi045.stdout:1/876: unlink d0/d2d/d2b/ca4 0 2024-09-18T12:52:28.642 INFO:tasks.workunit.client.0.smithi045.stdout:1/877: fsync d0/d2d/d2b/d30/d40/d60/d8f/f70 0 2024-09-18T12:52:28.648 INFO:tasks.workunit.client.0.smithi045.stdout:1/878: symlink d0/d2d/db1/l112 0 2024-09-18T12:52:28.661 INFO:tasks.workunit.client.0.smithi045.stdout:0/773: sync 2024-09-18T12:52:28.661 INFO:tasks.workunit.client.0.smithi045.stdout:7/765: sync 2024-09-18T12:52:28.708 INFO:tasks.workunit.client.0.smithi045.stdout:0/774: mkdir d6/d48/d5e/d39/d58/d3b/d6b/de6 0 2024-09-18T12:52:28.709 INFO:tasks.workunit.client.0.smithi045.stdout:7/766: symlink d13/d1a/l105 0 2024-09-18T12:52:28.713 INFO:tasks.workunit.client.0.smithi045.stdout:7/767: mkdir d13/d1a/d106 0 2024-09-18T12:52:28.714 INFO:tasks.workunit.client.0.smithi045.stdout:7/768: write d13/f8e [376767,122750] 0 2024-09-18T12:52:28.715 INFO:tasks.workunit.client.0.smithi045.stdout:7/769: readlink d13/l14 0 2024-09-18T12:52:28.716 INFO:tasks.workunit.client.0.smithi045.stdout:0/775: dwrite d6/d48/d5e/d39/d58/d3c/f46 [0,4194304] 0 2024-09-18T12:52:28.716 INFO:tasks.workunit.client.0.smithi045.stdout:7/770: dread - d13/d1a/fe6 zero size 2024-09-18T12:52:28.721 INFO:tasks.workunit.client.0.smithi045.stdout:1/879: dread d0/f69 [4194304,4194304] 0 2024-09-18T12:52:28.721 INFO:tasks.workunit.client.0.smithi045.stdout:7/771: symlink d13/l107 0 2024-09-18T12:52:28.725 INFO:tasks.workunit.client.0.smithi045.stdout:1/880: mknod d0/d2d/d2b/d30/d8b/c113 0 2024-09-18T12:52:28.730 INFO:tasks.workunit.client.0.smithi045.stdout:1/881: link d0/d2d/d2b/d30/d40/dc7/dd0/f10b d0/d2d/db1/f114 0 2024-09-18T12:52:28.734 INFO:tasks.workunit.client.0.smithi045.stdout:6/733: sync 2024-09-18T12:52:28.745 INFO:tasks.workunit.client.0.smithi045.stdout:7/772: dread f3 [0,4194304] 0 2024-09-18T12:52:28.748 INFO:tasks.workunit.client.0.smithi045.stdout:1/882: dread d0/f49 [4194304,4194304] 0 2024-09-18T12:52:28.752 INFO:tasks.workunit.client.0.smithi045.stdout:7/773: symlink d13/d1a/d28/l108 0 2024-09-18T12:52:28.754 INFO:tasks.workunit.client.0.smithi045.stdout:0/776: truncate d6/d35/f50 5099625 0 2024-09-18T12:52:28.756 INFO:tasks.workunit.client.0.smithi045.stdout:1/883: dwrite d0/d2d/d2b/fbb [0,4194304] 0 2024-09-18T12:52:28.756 INFO:tasks.workunit.client.0.smithi045.stdout:0/777: stat d6/d48/d5e/d39/c43 0 2024-09-18T12:52:28.761 INFO:tasks.workunit.client.0.smithi045.stdout:0/778: read - d6/d48/d5e/d39/d58/d3b/f95 zero size 2024-09-18T12:52:28.764 INFO:tasks.workunit.client.0.smithi045.stdout:7/774: getdents d13/d44/d37 0 2024-09-18T12:52:28.773 INFO:tasks.workunit.client.0.smithi045.stdout:7/775: unlink d13/d44/d37/ld3 0 2024-09-18T12:52:28.774 INFO:tasks.workunit.client.0.smithi045.stdout:7/776: write d13/d31/fd4 [3275046,50853] 0 2024-09-18T12:52:28.783 INFO:tasks.workunit.client.0.smithi045.stdout:7/777: link d13/d44/d37/fce d13/d31/f109 0 2024-09-18T12:52:28.787 INFO:tasks.workunit.client.0.smithi045.stdout:7/778: mkdir d13/d44/d37/d6a/da3/d10a 0 2024-09-18T12:52:28.790 INFO:tasks.workunit.client.0.smithi045.stdout:7/779: chown d13/d31/l3f 29900 1 2024-09-18T12:52:28.792 INFO:tasks.workunit.client.0.smithi045.stdout:7/780: symlink d13/d1a/d9b/l10b 0 2024-09-18T12:52:28.795 INFO:tasks.workunit.client.0.smithi045.stdout:7/781: symlink d13/d1a/d106/l10c 0 2024-09-18T12:52:28.796 INFO:tasks.workunit.client.0.smithi045.stdout:7/782: write d13/d44/d37/d70/d77/d85/f102 [925705,90502] 0 2024-09-18T12:52:28.798 INFO:tasks.workunit.client.0.smithi045.stdout:6/734: write d9/d1a/d48/d97/f9c [1314581,90683] 0 2024-09-18T12:52:28.799 INFO:tasks.workunit.client.0.smithi045.stdout:7/783: fsync d13/d44/d37/d70/d77/fa4 0 2024-09-18T12:52:28.799 INFO:tasks.workunit.client.0.smithi045.stdout:5/871: sync 2024-09-18T12:52:28.799 INFO:tasks.workunit.client.0.smithi045.stdout:8/844: sync 2024-09-18T12:52:28.799 INFO:tasks.workunit.client.0.smithi045.stdout:9/643: sync 2024-09-18T12:52:28.799 INFO:tasks.workunit.client.0.smithi045.stdout:2/895: sync 2024-09-18T12:52:28.800 INFO:tasks.workunit.client.0.smithi045.stdout:3/685: sync 2024-09-18T12:52:28.800 INFO:tasks.workunit.client.0.smithi045.stdout:6/735: fsync d9/d1a/d2d/d32/f62 0 2024-09-18T12:52:28.800 INFO:tasks.workunit.client.0.smithi045.stdout:9/644: chown d0 1 1 2024-09-18T12:52:28.803 INFO:tasks.workunit.client.0.smithi045.stdout:2/896: chown d5/d5f/da8/c56 11122743 1 2024-09-18T12:52:28.803 INFO:tasks.workunit.client.0.smithi045.stdout:7/784: mkdir d13/d1a/d28/d10d 0 2024-09-18T12:52:28.804 INFO:tasks.workunit.client.0.smithi045.stdout:0/779: write d6/d48/d5e/d39/d58/d3b/d65/f7a [3395205,50970] 0 2024-09-18T12:52:28.805 INFO:tasks.workunit.client.0.smithi045.stdout:2/897: write d5/d2c/d6f/fa5 [1022630,92087] 0 2024-09-18T12:52:28.805 INFO:tasks.workunit.client.0.smithi045.stdout:5/872: stat d6/db/d54/de2/d2b/f4e 0 2024-09-18T12:52:28.805 INFO:tasks.workunit.client.0.smithi045.stdout:1/884: write d0/d2d/d2b/d30/d40/d60/d8f/d104/fdb [10469,8205] 0 2024-09-18T12:52:28.807 INFO:tasks.workunit.client.0.smithi045.stdout:8/845: symlink d11/d14/d53/d41/d75/lfe 0 2024-09-18T12:52:28.808 INFO:tasks.workunit.client.0.smithi045.stdout:8/846: fsync d11/d76/fa2 0 2024-09-18T12:52:28.809 INFO:tasks.workunit.client.0.smithi045.stdout:5/873: stat d6/db/d54/dc2/dfe/d78/d66/de4/c10b 0 2024-09-18T12:52:28.811 INFO:tasks.workunit.client.0.smithi045.stdout:3/686: creat d0/d1e/d2c/d3a/d45/dbe/dcc/feb x:0 0 0 2024-09-18T12:52:28.813 INFO:tasks.workunit.client.0.smithi045.stdout:0/780: read d6/d7/f14 [3773778,13258] 0 2024-09-18T12:52:28.814 INFO:tasks.workunit.client.0.smithi045.stdout:2/898: creat d5/d5f/f128 x:0 0 0 2024-09-18T12:52:28.816 INFO:tasks.workunit.client.0.smithi045.stdout:1/885: fsync d0/d2d/f45 0 2024-09-18T12:52:28.819 INFO:tasks.workunit.client.0.smithi045.stdout:8/847: symlink d11/d20/d60/dc3/dbd/dd5/lff 0 2024-09-18T12:52:28.822 INFO:tasks.workunit.client.0.smithi045.stdout:0/781: dwrite d6/d48/d5e/d39/d58/d3c/fdd [0,4194304] 0 2024-09-18T12:52:28.824 INFO:tasks.workunit.client.0.smithi045.stdout:1/886: dread d0/d12/d32/d67/d6d/fe7 [0,4194304] 0 2024-09-18T12:52:28.830 INFO:tasks.workunit.client.0.smithi045.stdout:9/645: dwrite d0/d3/d6/d10/d26/f69 [0,4194304] 0 2024-09-18T12:52:28.832 INFO:tasks.workunit.client.0.smithi045.stdout:5/874: symlink d6/db/d19/dbc/ddc/l110 0 2024-09-18T12:52:28.833 INFO:tasks.workunit.client.0.smithi045.stdout:3/687: mknod d0/d1e/d39/cec 0 2024-09-18T12:52:28.834 INFO:tasks.workunit.client.0.smithi045.stdout:2/899: write d5/d2c/d4d/f1b [7597841,87475] 0 2024-09-18T12:52:28.835 INFO:tasks.workunit.client.0.smithi045.stdout:3/688: dread - d0/d29/d5f/fc7 zero size 2024-09-18T12:52:28.836 INFO:tasks.workunit.client.0.smithi045.stdout:7/785: creat d13/d31/d5f/f10e x:0 0 0 2024-09-18T12:52:28.837 INFO:tasks.workunit.client.0.smithi045.stdout:9/646: dread - d0/d3/d6/d64/fa0 zero size 2024-09-18T12:52:28.839 INFO:tasks.workunit.client.0.smithi045.stdout:1/887: write d0/d2d/d2b/d30/f4f [4903548,29258] 0 2024-09-18T12:52:28.839 INFO:tasks.workunit.client.0.smithi045.stdout:8/848: fsync d11/f13 0 2024-09-18T12:52:28.840 INFO:tasks.workunit.client.0.smithi045.stdout:7/786: read - d13/d44/d37/f98 zero size 2024-09-18T12:52:28.841 INFO:tasks.workunit.client.0.smithi045.stdout:0/782: creat d6/d48/d5e/d39/d58/fe7 x:0 0 0 2024-09-18T12:52:28.844 INFO:tasks.workunit.client.0.smithi045.stdout:7/787: fdatasync d13/d44/d37/d70/fc4 0 2024-09-18T12:52:28.845 INFO:tasks.workunit.client.0.smithi045.stdout:1/888: write d0/d2d/d92/def/ff1 [1007486,86586] 0 2024-09-18T12:52:28.846 INFO:tasks.workunit.client.0.smithi045.stdout:9/647: mknod d0/d3/d6/d10/d2c/d63/cc6 0 2024-09-18T12:52:28.849 INFO:tasks.workunit.client.0.smithi045.stdout:2/900: dwrite d5/d3a/da0/f109 [0,4194304] 0 2024-09-18T12:52:28.849 INFO:tasks.workunit.client.0.smithi045.stdout:9/648: chown d0/d3/d6/d10/d26/d2e/l58 1 1 2024-09-18T12:52:28.852 INFO:tasks.workunit.client.0.smithi045.stdout:3/689: link d0/d1e/d39/db7/f9f d0/d29/d5f/fed 0 2024-09-18T12:52:28.854 INFO:tasks.workunit.client.0.smithi045.stdout:3/690: chown d0/d1e/d2c/f42 745011889 1 2024-09-18T12:52:28.855 INFO:tasks.workunit.client.0.smithi045.stdout:3/691: readlink d0/d1e/d2c/d3f/d44/d75/l8f 0 2024-09-18T12:52:28.858 INFO:tasks.workunit.client.0.smithi045.stdout:2/901: unlink d5/d2c/d4d/f92 0 2024-09-18T12:52:28.862 INFO:tasks.workunit.client.0.smithi045.stdout:9/649: chown d0/d3/d6/d64/d77/d9a/fb8 9649683 1 2024-09-18T12:52:28.863 INFO:tasks.workunit.client.0.smithi045.stdout:8/849: write fd [232499,95835] 0 2024-09-18T12:52:28.866 INFO:tasks.workunit.client.0.smithi045.stdout:7/788: creat d13/f10f x:0 0 0 2024-09-18T12:52:28.867 INFO:tasks.workunit.client.0.smithi045.stdout:2/902: dread d5/d2c/d6f/fa5 [0,4194304] 0 2024-09-18T12:52:28.867 INFO:tasks.workunit.client.0.smithi045.stdout:5/875: dwrite d6/d3e/f26 [0,4194304] 0 2024-09-18T12:52:28.870 INFO:tasks.workunit.client.0.smithi045.stdout:5/876: dread - d6/db/d54/de2/d2b/d51/d6c/f86 zero size 2024-09-18T12:52:28.871 INFO:tasks.workunit.client.0.smithi045.stdout:5/877: write d6/d3e/f35 [757305,91734] 0 2024-09-18T12:52:28.872 INFO:tasks.workunit.client.0.smithi045.stdout:0/783: creat d6/d48/d5e/d39/d58/d3b/fe8 x:0 0 0 2024-09-18T12:52:28.880 INFO:tasks.workunit.client.0.smithi045.stdout:1/889: dwrite d0/d2d/db1/dc6/dc8/fcd [0,4194304] 0 2024-09-18T12:52:28.883 INFO:tasks.workunit.client.0.smithi045.stdout:3/692: dwrite d0/d1e/d2c/d3a/d45/f92 [0,4194304] 0 2024-09-18T12:52:28.883 INFO:tasks.workunit.client.0.smithi045.stdout:8/850: rename d11/d14/l3b to d11/d14/d53/d41/d75/l100 0 2024-09-18T12:52:28.893 INFO:tasks.workunit.client.0.smithi045.stdout:2/903: dwrite d5/d5f/da8/f6e [0,4194304] 0 2024-09-18T12:52:28.898 INFO:tasks.workunit.client.0.smithi045.stdout:8/851: rmdir d11/d23 39 2024-09-18T12:52:28.899 INFO:tasks.workunit.client.0.smithi045.stdout:3/693: creat d0/d1e/d2c/d3a/d45/dbe/fee x:0 0 0 2024-09-18T12:52:28.903 INFO:tasks.workunit.client.0.smithi045.stdout:0/784: symlink d6/d48/d5e/le9 0 2024-09-18T12:52:28.906 INFO:tasks.workunit.client.0.smithi045.stdout:7/789: dwrite d13/d31/d33/fcb [0,4194304] 0 2024-09-18T12:52:28.908 INFO:tasks.workunit.client.0.smithi045.stdout:7/790: write d13/d44/d37/d70/fc4 [136724,21799] 0 2024-09-18T12:52:28.911 INFO:tasks.workunit.client.0.smithi045.stdout:2/904: dread d5/d5f/da8/dde/f104 [0,4194304] 0 2024-09-18T12:52:28.912 INFO:tasks.workunit.client.0.smithi045.stdout:9/650: getdents d0/d3/d6/d10 0 2024-09-18T12:52:28.915 INFO:tasks.workunit.client.0.smithi045.stdout:3/694: rename d0/f4b to d0/d1e/d39/db7/db1/fef 0 2024-09-18T12:52:28.918 INFO:tasks.workunit.client.0.smithi045.stdout:9/651: read d0/f61 [2218825,112979] 0 2024-09-18T12:52:28.920 INFO:tasks.workunit.client.0.smithi045.stdout:0/785: rename d6/d35/d92/ca7 to d6/d48/d5e/d39/d58/db5/dc8/cea 0 2024-09-18T12:52:28.923 INFO:tasks.workunit.client.0.smithi045.stdout:3/695: symlink d0/d1e/lf0 0 2024-09-18T12:52:28.924 INFO:tasks.workunit.client.0.smithi045.stdout:9/652: symlink d0/d3/d6/d10/d26/d2e/d6f/lc7 0 2024-09-18T12:52:28.930 INFO:tasks.workunit.client.0.smithi045.stdout:5/878: dwrite d6/db/d54/dc2/dfe/fe1 [0,4194304] 0 2024-09-18T12:52:28.960 INFO:tasks.workunit.client.0.smithi045.stdout:3/696: dread d0/d7/f80 [4194304,4194304] 0 2024-09-18T12:52:28.961 INFO:tasks.workunit.client.0.smithi045.stdout:3/697: read d0/d1e/d2c/d3a/d45/f92 [2763385,90628] 0 2024-09-18T12:52:28.991 INFO:tasks.workunit.client.0.smithi045.stdout:1/890: write d0/f7 [217519,39627] 0 2024-09-18T12:52:28.992 INFO:tasks.workunit.client.0.smithi045.stdout:1/891: fdatasync d0/d2d/d2b/d30/fa6 0 2024-09-18T12:52:28.992 INFO:tasks.workunit.client.0.smithi045.stdout:0/786: creat d6/de3/feb x:0 0 0 2024-09-18T12:52:28.996 INFO:tasks.workunit.client.0.smithi045.stdout:5/879: symlink d6/db/d54/dc2/dfe/d78/d66/l111 0 2024-09-18T12:52:28.997 INFO:tasks.workunit.client.0.smithi045.stdout:2/905: write d5/d3a/d3e/dd4/fe8 [570547,109602] 0 2024-09-18T12:52:29.013 INFO:tasks.workunit.client.0.smithi045.stdout:2/906: mknod d5/d5f/da8/dde/c129 0 2024-09-18T12:52:29.014 INFO:tasks.workunit.client.0.smithi045.stdout:0/787: dread d6/d7/f29 [0,4194304] 0 2024-09-18T12:52:29.018 INFO:tasks.workunit.client.0.smithi045.stdout:0/788: truncate f4 3022016 0 2024-09-18T12:52:29.073 INFO:tasks.workunit.client.0.smithi045.stdout:3/698: dwrite d0/d29/fa5 [0,4194304] 0 2024-09-18T12:52:29.078 INFO:tasks.workunit.client.0.smithi045.stdout:1/892: dwrite d0/d2d/db1/f114 [0,4194304] 0 2024-09-18T12:52:29.081 INFO:tasks.workunit.client.0.smithi045.stdout:1/893: chown d0/d2d/d2b/d30/d40/d60/d8f/fc1 14726 1 2024-09-18T12:52:29.081 INFO:tasks.workunit.client.0.smithi045.stdout:3/699: getdents d0/d1e/d39/db7/de7 0 2024-09-18T12:52:29.083 INFO:tasks.workunit.client.0.smithi045.stdout:3/700: fdatasync d0/d29/d5f/fb3 0 2024-09-18T12:52:29.097 INFO:tasks.workunit.client.0.smithi045.stdout:3/701: dread d0/f3e [0,4194304] 0 2024-09-18T12:52:29.097 INFO:tasks.workunit.client.0.smithi045.stdout:0/789: dwrite d6/d48/d5e/d39/d58/d86/fa1 [4194304,4194304] 0 2024-09-18T12:52:29.098 INFO:tasks.workunit.client.0.smithi045.stdout:3/702: dread - d0/d29/d53/f7e zero size 2024-09-18T12:52:29.102 INFO:tasks.workunit.client.0.smithi045.stdout:2/907: creat d5/d2c/d4d/f12a x:0 0 0 2024-09-18T12:52:29.104 INFO:tasks.workunit.client.0.smithi045.stdout:0/790: rename d6/d7/d32/d9b/fcf to d6/d48/d5e/d39/d58/d3c/d69/dd9/fec 0 2024-09-18T12:52:29.115 INFO:tasks.workunit.client.0.smithi045.stdout:2/908: getdents d5/d2c/d4d/d76 0 2024-09-18T12:52:29.117 INFO:tasks.workunit.client.0.smithi045.stdout:2/909: truncate d5/d2c/d4d/d76/dd5/f110 337078 0 2024-09-18T12:52:29.118 INFO:tasks.workunit.client.0.smithi045.stdout:0/791: getdents d6/d48/d5e/d39/d58/d3c 0 2024-09-18T12:52:29.125 INFO:tasks.workunit.client.0.smithi045.stdout:2/910: link d5/d5f/da8/d61/ff6 d5/d2c/dac/f12b 0 2024-09-18T12:52:29.127 INFO:tasks.workunit.client.0.smithi045.stdout:2/911: mknod d5/d46/de0/c12c 0 2024-09-18T12:52:29.129 INFO:tasks.workunit.client.0.smithi045.stdout:2/912: symlink d5/d2c/d4d/d76/l12d 0 2024-09-18T12:52:29.133 INFO:tasks.workunit.client.0.smithi045.stdout:2/913: dread d5/d46/f52 [0,4194304] 0 2024-09-18T12:52:29.135 INFO:tasks.workunit.client.0.smithi045.stdout:2/914: mkdir d5/d3a/d12e 0 2024-09-18T12:52:29.139 INFO:tasks.workunit.client.0.smithi045.stdout:1/894: truncate d0/d2d/d2b/d30/d40/d60/d8f/fc1 119108 0 2024-09-18T12:52:29.147 INFO:tasks.workunit.client.0.smithi045.stdout:3/703: dwrite d0/d1e/d39/db7/f9f [0,4194304] 0 2024-09-18T12:52:29.153 INFO:tasks.workunit.client.0.smithi045.stdout:0/792: dwrite d6/d48/d5e/d39/d58/d3b/d65/f77 [0,4194304] 0 2024-09-18T12:52:29.154 INFO:tasks.workunit.client.0.smithi045.stdout:1/895: dread d0/d2d/d2b/d30/fb9 [0,4194304] 0 2024-09-18T12:52:29.156 INFO:tasks.workunit.client.0.smithi045.stdout:5/880: symlink d6/db/d54/l112 0 2024-09-18T12:52:29.158 INFO:tasks.workunit.client.0.smithi045.stdout:5/881: truncate d6/d3e/fe9 859432 0 2024-09-18T12:52:29.159 INFO:tasks.workunit.client.0.smithi045.stdout:0/793: creat d6/daa/fed x:0 0 0 2024-09-18T12:52:29.164 INFO:tasks.workunit.client.0.smithi045.stdout:1/896: dwrite d0/d12/d32/d67/fce [0,4194304] 0 2024-09-18T12:52:29.168 INFO:tasks.workunit.client.0.smithi045.stdout:3/704: write d0/d1e/d2c/d3a/fbc [433764,6571] 0 2024-09-18T12:52:29.171 INFO:tasks.workunit.client.0.smithi045.stdout:1/897: creat d0/d2d/d2b/d30/d40/d60/d8f/d104/df4/f115 x:0 0 0 2024-09-18T12:52:29.176 INFO:tasks.workunit.client.0.smithi045.stdout:1/898: dread d0/d2d/d2b/d30/d40/dc7/dd0/f10b [0,4194304] 0 2024-09-18T12:52:29.180 INFO:tasks.workunit.client.0.smithi045.stdout:1/899: rename d0/d2d/db1/dc6/dc8/dbd to d0/d2d/d2b/d30/d40/d61/d116 0 2024-09-18T12:52:29.184 INFO:tasks.workunit.client.0.smithi045.stdout:5/882: truncate d6/dc7/fca 8337693 0 2024-09-18T12:52:29.186 INFO:tasks.workunit.client.0.smithi045.stdout:1/900: mknod d0/d2d/d2b/d30/d40/d105/c117 0 2024-09-18T12:52:29.186 INFO:tasks.workunit.client.0.smithi045.stdout:5/883: mkdir d6/db/d54/dc2/d113 0 2024-09-18T12:52:29.193 INFO:tasks.workunit.client.0.smithi045.stdout:1/901: dwrite d0/d2d/d2b/d30/d40/fd9 [0,4194304] 0 2024-09-18T12:52:29.196 INFO:tasks.workunit.client.0.smithi045.stdout:0/794: dread d6/d48/d5e/d39/d58/d66/fcc [0,4194304] 0 2024-09-18T12:52:29.198 INFO:tasks.workunit.client.0.smithi045.stdout:3/705: dread d0/d1e/d2c/d3a/d8a/f9b [0,4194304] 0 2024-09-18T12:52:29.203 INFO:tasks.workunit.client.0.smithi045.stdout:1/902: creat d0/d2d/d2b/d30/d40/d60/d8f/d104/df4/d10a/f118 x:0 0 0 2024-09-18T12:52:29.206 INFO:tasks.workunit.client.0.smithi045.stdout:3/706: rename d0/d1e/d2c/d3a/d8a/db9 to d0/d1e/d2c/d3a/d8a/df1 0 2024-09-18T12:52:29.209 INFO:tasks.workunit.client.0.smithi045.stdout:0/795: dread d6/d7/fa [0,4194304] 0 2024-09-18T12:52:29.212 INFO:tasks.workunit.client.0.smithi045.stdout:3/707: rename d0/d22/fa1 to d0/d1e/d2c/d3a/d8a/df1/ff2 0 2024-09-18T12:52:29.213 INFO:tasks.workunit.client.0.smithi045.stdout:1/903: link d0/d2d/d92/def/ff1 d0/d12/d32/d67/d6d/d9c/f119 0 2024-09-18T12:52:29.216 INFO:tasks.workunit.client.0.smithi045.stdout:3/708: rmdir d0/d29/d5f 39 2024-09-18T12:52:29.219 INFO:tasks.workunit.client.0.smithi045.stdout:1/904: rename d0/d12/d32/d67/d6a/f96 to d0/d2d/db1/dc6/d10d/f11a 0 2024-09-18T12:52:29.222 INFO:tasks.workunit.client.0.smithi045.stdout:3/709: dwrite d0/d1e/d39/fdc [0,4194304] 0 2024-09-18T12:52:29.225 INFO:tasks.workunit.client.0.smithi045.stdout:0/796: write d6/d35/f5f [3891368,60544] 0 2024-09-18T12:52:29.230 INFO:tasks.workunit.client.0.smithi045.stdout:1/905: symlink d0/d2d/d2b/d30/d40/d60/d8f/l11b 0 2024-09-18T12:52:29.232 INFO:tasks.workunit.client.0.smithi045.stdout:0/797: mkdir d6/daa/dee 0 2024-09-18T12:52:29.233 INFO:tasks.workunit.client.0.smithi045.stdout:1/906: fsync d0/d2d/d2b/f9b 0 2024-09-18T12:52:29.234 INFO:tasks.workunit.client.0.smithi045.stdout:3/710: creat d0/d29/ff3 x:0 0 0 2024-09-18T12:52:29.235 INFO:tasks.workunit.client.0.smithi045.stdout:0/798: mkdir d6/daa/def 0 2024-09-18T12:52:29.236 INFO:tasks.workunit.client.0.smithi045.stdout:3/711: fdatasync d0/d1e/d2c/d3a/d45/dbe/dcc/feb 0 2024-09-18T12:52:29.237 INFO:tasks.workunit.client.0.smithi045.stdout:1/907: dread d0/d2d/f45 [0,4194304] 0 2024-09-18T12:52:29.238 INFO:tasks.workunit.client.0.smithi045.stdout:0/799: creat d6/daa/db2/ff0 x:0 0 0 2024-09-18T12:52:29.241 INFO:tasks.workunit.client.0.smithi045.stdout:0/800: rename d6/d48/d5e/d39/d58/f68 to d6/d48/d5e/d39/d58/d86/ff1 0 2024-09-18T12:52:29.242 INFO:tasks.workunit.client.0.smithi045.stdout:1/908: dread d0/d2d/d2b/d30/d40/fc9 [4194304,4194304] 0 2024-09-18T12:52:29.245 INFO:tasks.workunit.client.0.smithi045.stdout:0/801: rename d6/d48/l67 to d6/lf2 0 2024-09-18T12:52:29.246 INFO:tasks.workunit.client.0.smithi045.stdout:1/909: creat d0/d2d/d2b/d30/d40/d60/d8f/f11c x:0 0 0 2024-09-18T12:52:29.248 INFO:tasks.workunit.client.0.smithi045.stdout:0/802: creat d6/d48/d5e/d39/d58/d3c/d73/ddc/ff3 x:0 0 0 2024-09-18T12:52:29.250 INFO:tasks.workunit.client.0.smithi045.stdout:1/910: link d0/d2d/d2b/d30/fdc d0/d12/f11d 0 2024-09-18T12:52:29.253 INFO:tasks.workunit.client.0.smithi045.stdout:1/911: rmdir d0/d2d/d92/def 39 2024-09-18T12:52:29.258 INFO:tasks.workunit.client.0.smithi045.stdout:1/912: link d0/d2d/d2b/d30/d40/d60/d8f/cd3 d0/d12/d32/d67/d6d/d9c/c11e 0 2024-09-18T12:52:29.262 INFO:tasks.workunit.client.0.smithi045.stdout:0/803: dread d6/d7/fc5 [0,4194304] 0 2024-09-18T12:52:29.269 INFO:tasks.workunit.client.0.smithi045.stdout:1/913: write d0/fe6 [2612501,16089] 0 2024-09-18T12:52:29.274 INFO:tasks.workunit.client.0.smithi045.stdout:0/804: dread d6/d48/d5e/d39/d58/d3b/d65/fdf [0,4194304] 0 2024-09-18T12:52:29.275 INFO:tasks.workunit.client.0.smithi045.stdout:0/805: chown d6/d48/d5e/d39/d58/d3c/d73/ddc 28 1 2024-09-18T12:52:29.279 INFO:tasks.workunit.client.0.smithi045.stdout:0/806: unlink d6/d48/d5e/d39/d58/d3b/d6b/f8c 0 2024-09-18T12:52:29.281 INFO:tasks.workunit.client.0.smithi045.stdout:1/914: dwrite d0/fe [0,4194304] 0 2024-09-18T12:52:29.285 INFO:tasks.workunit.client.0.smithi045.stdout:1/915: rename d0/d12/d32/d67/d6d/f7e to d0/d12/d6f/f11f 0 2024-09-18T12:52:29.288 INFO:tasks.workunit.client.0.smithi045.stdout:0/807: getdents d6 0 2024-09-18T12:52:29.291 INFO:tasks.workunit.client.0.smithi045.stdout:0/808: truncate d6/d48/d5e/d39/d58/fe7 238104 0 2024-09-18T12:52:29.291 INFO:tasks.workunit.client.0.smithi045.stdout:1/916: dwrite d0/fe [0,4194304] 0 2024-09-18T12:52:29.293 INFO:tasks.workunit.client.0.smithi045.stdout:0/809: dread d6/d48/d5e/d39/d58/fe7 [0,4194304] 0 2024-09-18T12:52:29.294 INFO:tasks.workunit.client.0.smithi045.stdout:0/810: dread - d6/fdb zero size 2024-09-18T12:52:29.296 INFO:tasks.workunit.client.0.smithi045.stdout:1/917: unlink d0/d12/d32/d67/d6a/c5a 0 2024-09-18T12:52:29.296 INFO:tasks.workunit.client.0.smithi045.stdout:1/918: chown d0/f7 3015285 1 2024-09-18T12:52:29.299 INFO:tasks.workunit.client.0.smithi045.stdout:1/919: truncate d0/d2d/d2b/d30/d40/d60/d8f/fb8 5140064 0 2024-09-18T12:52:29.299 INFO:tasks.workunit.client.0.smithi045.stdout:0/811: unlink d6/f63 0 2024-09-18T12:52:29.304 INFO:tasks.workunit.client.0.smithi045.stdout:1/920: dwrite d0/f2 [0,4194304] 0 2024-09-18T12:52:29.324 INFO:tasks.workunit.client.0.smithi045.stdout:0/812: fdatasync d6/daa/fed 0 2024-09-18T12:52:29.328 INFO:tasks.workunit.client.0.smithi045.stdout:1/921: write d0/d2d/f45 [2955982,86645] 0 2024-09-18T12:52:29.332 INFO:tasks.workunit.client.0.smithi045.stdout:1/922: symlink d0/d2d/d2b/d30/d8b/l120 0 2024-09-18T12:52:29.333 INFO:tasks.workunit.client.0.smithi045.stdout:0/813: dwrite d6/d7/f6c [0,4194304] 0 2024-09-18T12:52:29.335 INFO:tasks.workunit.client.0.smithi045.stdout:0/814: chown d6/d48/d5e/d39/d58/d3b/l82 77694 1 2024-09-18T12:52:29.338 INFO:tasks.workunit.client.0.smithi045.stdout:1/923: fsync d0/d2d/d2b/d30/d40/d60/d8f/fc1 0 2024-09-18T12:52:29.339 INFO:tasks.workunit.client.0.smithi045.stdout:0/815: dread d6/daa/db2/fc9 [0,4194304] 0 2024-09-18T12:52:29.344 INFO:tasks.workunit.client.0.smithi045.stdout:1/924: rename d0/d2d/d2b/cfe to d0/d2d/db1/c121 0 2024-09-18T12:52:29.346 INFO:tasks.workunit.client.0.smithi045.stdout:1/925: fsync d0/f69 0 2024-09-18T12:52:29.353 INFO:tasks.workunit.client.0.smithi045.stdout:1/926: creat d0/d2d/d2b/f122 x:0 0 0 2024-09-18T12:52:29.355 INFO:tasks.workunit.client.0.smithi045.stdout:0/816: dread f4 [0,4194304] 0 2024-09-18T12:52:29.358 INFO:tasks.workunit.client.0.smithi045.stdout:0/817: creat d6/d48/d5e/d39/d58/d3c/ff4 x:0 0 0 2024-09-18T12:52:29.364 INFO:tasks.workunit.client.0.smithi045.stdout:1/927: dwrite d0/d2d/d2b/d30/d40/d60/d8f/fc1 [0,4194304] 0 2024-09-18T12:52:29.369 INFO:tasks.workunit.client.0.smithi045.stdout:1/928: truncate d0/d12/f3b 3128877 0 2024-09-18T12:52:29.371 INFO:tasks.workunit.client.0.smithi045.stdout:0/818: write d6/d48/d5e/d39/d58/d3c/f47 [1813495,109135] 0 2024-09-18T12:52:29.372 INFO:tasks.workunit.client.0.smithi045.stdout:1/929: dread d0/d2d/d2b/d30/d8b/fda [0,4194304] 0 2024-09-18T12:52:29.375 INFO:tasks.workunit.client.0.smithi045.stdout:0/819: chown d6/d48/d5e/d39/d58/d3c/d73/f7f 163727 1 2024-09-18T12:52:29.382 INFO:tasks.workunit.client.0.smithi045.stdout:0/820: dwrite d6/d48/d5e/d39/d58/d3c/d73/ddc/ff3 [0,4194304] 0 2024-09-18T12:52:29.388 INFO:tasks.workunit.client.0.smithi045.stdout:0/821: mknod d6/d48/cf5 0 2024-09-18T12:52:29.392 INFO:tasks.workunit.client.0.smithi045.stdout:0/822: mkdir d6/d48/d5e/d39/d58/d3b/d6b/de6/df6 0 2024-09-18T12:52:29.394 INFO:tasks.workunit.client.0.smithi045.stdout:1/930: link d0/d12/f3b d0/d2d/d2b/d30/d8b/d5b/d10e/f123 0 2024-09-18T12:52:29.398 INFO:tasks.workunit.client.0.smithi045.stdout:0/823: truncate d6/d48/d5e/d39/d58/d3c/f8e 1589995 0 2024-09-18T12:52:29.399 INFO:tasks.workunit.client.0.smithi045.stdout:1/931: fdatasync d0/d12/d6f/f11f 0 2024-09-18T12:52:29.404 INFO:tasks.workunit.client.0.smithi045.stdout:1/932: rename d0/d12/da7/f58 to d0/d2d/d2b/d30/d40/d61/d116/f124 0 2024-09-18T12:52:29.411 INFO:tasks.workunit.client.0.smithi045.stdout:0/824: dwrite d6/d48/d5e/d39/d58/d3b/f95 [0,4194304] 0 2024-09-18T12:52:29.419 INFO:tasks.workunit.client.0.smithi045.stdout:0/825: dwrite d6/d35/f3e [0,4194304] 0 2024-09-18T12:52:29.422 INFO:tasks.workunit.client.0.smithi045.stdout:0/826: fdatasync d6/d35/fbd 0 2024-09-18T12:52:29.424 INFO:tasks.workunit.client.0.smithi045.stdout:0/827: dread - d6/d48/d5e/d39/d58/d3c/d73/fc0 zero size 2024-09-18T12:52:29.429 INFO:tasks.workunit.client.0.smithi045.stdout:0/828: symlink d6/daa/lf7 0 2024-09-18T12:52:29.433 INFO:tasks.workunit.client.0.smithi045.stdout:0/829: rename d6/d7/c3d to d6/d48/d5e/d39/d58/d66/cf8 0 2024-09-18T12:52:29.437 INFO:tasks.workunit.client.0.smithi045.stdout:0/830: rename d6/d48/d5e/d39/d58/d3c to d6/daa/dee/df9 0 2024-09-18T12:52:29.443 INFO:tasks.workunit.client.0.smithi045.stdout:0/831: write d6/d48/d5e/f30 [4750484,9935] 0 2024-09-18T12:52:29.448 INFO:tasks.workunit.client.0.smithi045.stdout:0/832: link d6/d48/d5e/d39/d58/d86/fad d6/d48/ffa 0 2024-09-18T12:52:29.453 INFO:tasks.workunit.client.0.smithi045.stdout:0/833: truncate d6/d48/d5e/d39/d58/d86/ff1 2994718 0 2024-09-18T12:52:29.455 INFO:tasks.workunit.client.0.smithi045.stdout:0/834: truncate d6/daa/dee/df9/d73/fc0 785466 0 2024-09-18T12:52:29.464 INFO:tasks.workunit.client.0.smithi045.stdout:0/835: getdents d6/d48/d5e/d39/d58/d3b/d65 0 2024-09-18T12:52:29.469 INFO:tasks.workunit.client.0.smithi045.stdout:0/836: dread d6/d48/d5e/d39/d58/d3b/f95 [0,4194304] 0 2024-09-18T12:52:29.474 INFO:tasks.workunit.client.0.smithi045.stdout:0/837: write d6/d48/d5e/d39/d58/d3b/d6b/f76 [751145,87460] 0 2024-09-18T12:52:29.477 INFO:tasks.workunit.client.0.smithi045.stdout:0/838: rmdir d6/d48/d5e/d39 39 2024-09-18T12:52:29.478 INFO:tasks.workunit.client.0.smithi045.stdout:0/839: mknod d6/daa/db2/cfb 0 2024-09-18T12:52:29.482 INFO:tasks.workunit.client.0.smithi045.stdout:0/840: creat d6/d48/d5e/d39/d58/d3b/d65/ffc x:0 0 0 2024-09-18T12:52:29.489 INFO:tasks.workunit.client.0.smithi045.stdout:0/841: write d6/daa/dee/df9/d69/f4b [91585,28834] 0 2024-09-18T12:52:29.503 INFO:tasks.workunit.client.0.smithi045.stdout:0/842: dread d6/d48/d5e/d39/d58/fd4 [0,4194304] 0 2024-09-18T12:52:29.505 INFO:tasks.workunit.client.0.smithi045.stdout:0/843: creat d6/daa/dee/ffd x:0 0 0 2024-09-18T12:52:29.506 INFO:tasks.workunit.client.0.smithi045.stdout:0/844: chown d6/d48/d5e/d39/d58/d3b/d6b/fac 14096221 1 2024-09-18T12:52:29.506 INFO:tasks.workunit.client.0.smithi045.stdout:0/845: stat d6 0 2024-09-18T12:52:29.511 INFO:tasks.workunit.client.0.smithi045.stdout:0/846: write d6/daa/db2/fd1 [593563,44039] 0 2024-09-18T12:52:29.513 INFO:tasks.workunit.client.0.smithi045.stdout:0/847: truncate d6/d35/fd2 519495 0 2024-09-18T12:52:29.515 INFO:tasks.workunit.client.0.smithi045.stdout:0/848: mknod d6/daa/dee/df9/d73/ddc/cfe 0 2024-09-18T12:52:29.518 INFO:tasks.workunit.client.0.smithi045.stdout:0/849: rename d6/d48/d5e/d39/d58/l9c to d6/d48/d5e/d39/d58/d86/db9/lff 0 2024-09-18T12:52:29.756 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:29 smithi045 ceph-mon[28315]: pgmap v37: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 96 MiB/s rd, 210 MiB/s wr, 495 op/s 2024-09-18T12:52:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:29 smithi161 ceph-mon[35784]: pgmap v37: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 96 MiB/s rd, 210 MiB/s wr, 495 op/s 2024-09-18T12:52:29.805 INFO:tasks.workunit.client.0.smithi045.stdout:6/736: sync 2024-09-18T12:52:29.830 INFO:tasks.workunit.client.0.smithi045.stdout:6/737: mknod d9/d1a/d48/d7d/dcb/de1/c101 0 2024-09-18T12:52:29.830 INFO:tasks.workunit.client.0.smithi045.stdout:6/738: chown d9/d30/l52 113403 1 2024-09-18T12:52:29.832 INFO:tasks.workunit.client.0.smithi045.stdout:6/739: symlink d9/d56/db3/l102 0 2024-09-18T12:52:29.838 INFO:tasks.workunit.client.0.smithi045.stdout:6/740: rename d9/d1a/d2d/d38/c83 to d9/d1a/d48/d8f/d9f/c103 0 2024-09-18T12:52:29.838 INFO:tasks.workunit.client.0.smithi045.stdout:6/741: readlink d9/d1a/d2d/l5d 0 2024-09-18T12:52:29.851 INFO:tasks.workunit.client.0.smithi045.stdout:8/852: sync 2024-09-18T12:52:29.858 INFO:tasks.workunit.client.0.smithi045.stdout:8/853: dwrite d11/d76/fa2 [0,4194304] 0 2024-09-18T12:52:29.865 INFO:tasks.workunit.client.0.smithi045.stdout:8/854: mknod d11/d76/da0/da1/c101 0 2024-09-18T12:52:29.870 INFO:tasks.workunit.client.0.smithi045.stdout:8/855: read fd [3240670,37477] 0 2024-09-18T12:52:29.876 INFO:tasks.workunit.client.0.smithi045.stdout:8/856: rmdir d11/d20/d46/df9 39 2024-09-18T12:52:29.885 INFO:tasks.workunit.client.0.smithi045.stdout:8/857: dwrite d11/d8c/fec [0,4194304] 0 2024-09-18T12:52:29.912 INFO:tasks.workunit.client.0.smithi045.stdout:8/858: dread d11/d20/fae [0,4194304] 0 2024-09-18T12:52:29.925 INFO:tasks.workunit.client.0.smithi045.stdout:8/859: dread d11/f13 [0,4194304] 0 2024-09-18T12:52:29.931 INFO:tasks.workunit.client.0.smithi045.stdout:8/860: dwrite d11/d7b/fa5 [0,4194304] 0 2024-09-18T12:52:29.933 INFO:tasks.workunit.client.0.smithi045.stdout:8/861: creat d11/d20/d60/da3/f102 x:0 0 0 2024-09-18T12:52:29.941 INFO:tasks.workunit.client.0.smithi045.stdout:8/862: fsync d11/d20/d60/da3/f102 0 2024-09-18T12:52:29.947 INFO:tasks.workunit.client.0.smithi045.stdout:8/863: dwrite d11/d20/f3c [0,4194304] 0 2024-09-18T12:52:29.949 INFO:tasks.workunit.client.0.smithi045.stdout:8/864: rmdir d11/d14/d53/d41 39 2024-09-18T12:52:29.950 INFO:tasks.workunit.client.0.smithi045.stdout:8/865: chown d11/d76/c9c 2145710720 1 2024-09-18T12:52:30.001 INFO:tasks.workunit.client.0.smithi045.stdout:7/791: sync 2024-09-18T12:52:30.001 INFO:tasks.workunit.client.0.smithi045.stdout:9/653: sync 2024-09-18T12:52:30.001 INFO:tasks.workunit.client.0.smithi045.stdout:2/915: sync 2024-09-18T12:52:30.004 INFO:tasks.workunit.client.0.smithi045.stdout:2/916: chown d5/d2c/dac/lec 60049 1 2024-09-18T12:52:30.008 INFO:tasks.workunit.client.0.smithi045.stdout:7/792: dread d13/d44/f87 [0,4194304] 0 2024-09-18T12:52:30.013 INFO:tasks.workunit.client.0.smithi045.stdout:9/654: link d0/d3/d6/d10/d26/d2e/d4e/la2 d0/d3/d6/d10/d26/d2e/lc8 0 2024-09-18T12:52:30.016 INFO:tasks.workunit.client.0.smithi045.stdout:2/917: dread d5/d5f/da8/f31 [0,4194304] 0 2024-09-18T12:52:30.018 INFO:tasks.workunit.client.0.smithi045.stdout:7/793: mkdir d13/d31/d52/d81/d110 0 2024-09-18T12:52:30.020 INFO:tasks.workunit.client.0.smithi045.stdout:2/918: creat d5/d5f/f12f x:0 0 0 2024-09-18T12:52:30.021 INFO:tasks.workunit.client.0.smithi045.stdout:2/919: stat d5/d2c/d6f/d9d/fdd 0 2024-09-18T12:52:30.021 INFO:tasks.workunit.client.0.smithi045.stdout:9/655: creat d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/fc9 x:0 0 0 2024-09-18T12:52:30.023 INFO:tasks.workunit.client.0.smithi045.stdout:7/794: symlink d13/d44/d37/l111 0 2024-09-18T12:52:30.024 INFO:tasks.workunit.client.0.smithi045.stdout:9/656: read - d0/d3/d6/d10/d2c/f9b zero size 2024-09-18T12:52:30.028 INFO:tasks.workunit.client.0.smithi045.stdout:2/920: rename d5/d3a/d6b/l87 to d5/d5f/da8/d61/dbb/dc6/df1/l130 0 2024-09-18T12:52:30.029 INFO:tasks.workunit.client.0.smithi045.stdout:7/795: creat d13/d31/d33/d64/f112 x:0 0 0 2024-09-18T12:52:30.030 INFO:tasks.workunit.client.0.smithi045.stdout:7/796: chown d13/d31/d52/c93 404606 1 2024-09-18T12:52:30.032 INFO:tasks.workunit.client.0.smithi045.stdout:2/921: creat d5/d5f/da8/d61/f131 x:0 0 0 2024-09-18T12:52:30.034 INFO:tasks.workunit.client.0.smithi045.stdout:7/797: mknod d13/d44/d37/d70/d77/d85/c113 0 2024-09-18T12:52:30.036 INFO:tasks.workunit.client.0.smithi045.stdout:7/798: chown d13/d44/d37/d70/d77/fab 5 1 2024-09-18T12:52:30.037 INFO:tasks.workunit.client.0.smithi045.stdout:7/799: write d13/d44/f80 [1577467,67635] 0 2024-09-18T12:52:30.038 INFO:tasks.workunit.client.0.smithi045.stdout:9/657: rename d0/d3/d6/l21 to d0/d3/d6/d10/d26/d2e/d4e/lca 0 2024-09-18T12:52:30.040 INFO:tasks.workunit.client.0.smithi045.stdout:9/658: write d0/d3/d6/d10/d26/d2e/f32 [3175536,30581] 0 2024-09-18T12:52:30.042 INFO:tasks.workunit.client.0.smithi045.stdout:2/922: creat d5/d3a/f132 x:0 0 0 2024-09-18T12:52:30.044 INFO:tasks.workunit.client.0.smithi045.stdout:2/923: write d5/d3a/d3e/dd4/fe4 [1874972,41341] 0 2024-09-18T12:52:30.048 INFO:tasks.workunit.client.0.smithi045.stdout:2/924: creat d5/d2c/d6f/f133 x:0 0 0 2024-09-18T12:52:30.048 INFO:tasks.workunit.client.0.smithi045.stdout:2/925: chown d5/d5f/da8/d61/dbb/dc6 34521 1 2024-09-18T12:52:30.050 INFO:tasks.workunit.client.0.smithi045.stdout:7/800: rename d13/d44/d37/c4b to d13/c114 0 2024-09-18T12:52:30.054 INFO:tasks.workunit.client.0.smithi045.stdout:2/926: write d5/d5f/db2/f43 [4680494,51689] 0 2024-09-18T12:52:30.055 INFO:tasks.workunit.client.0.smithi045.stdout:9/659: rename d0/d3/d6/d10/d26/da4/cc4 to d0/d3/d6/d10/d26/d2e/d6f/ccb 0 2024-09-18T12:52:30.056 INFO:tasks.workunit.client.0.smithi045.stdout:9/660: readlink d0/d3/d6/d10/l4c 0 2024-09-18T12:52:30.058 INFO:tasks.workunit.client.0.smithi045.stdout:2/927: mknod d5/d3a/d3e/dd4/c134 0 2024-09-18T12:52:30.059 INFO:tasks.workunit.client.0.smithi045.stdout:9/661: truncate d0/d3/d6/d10/d26/d2e/d6f/da5/fb2 1377333 0 2024-09-18T12:52:30.062 INFO:tasks.workunit.client.0.smithi045.stdout:2/928: dread d5/d5f/da8/f3b [0,4194304] 0 2024-09-18T12:52:30.063 INFO:tasks.workunit.client.0.smithi045.stdout:2/929: chown d5 0 1 2024-09-18T12:52:30.064 INFO:tasks.workunit.client.0.smithi045.stdout:2/930: write d5/d3a/d3e/dd4/fe8 [167444,123772] 0 2024-09-18T12:52:30.069 INFO:tasks.workunit.client.0.smithi045.stdout:2/931: creat d5/d2c/d4d/d76/d93/f135 x:0 0 0 2024-09-18T12:52:30.069 INFO:tasks.workunit.client.0.smithi045.stdout:9/662: dwrite d0/d3/d6/d10/d26/d2e/f48 [0,4194304] 0 2024-09-18T12:52:30.070 INFO:tasks.workunit.client.0.smithi045.stdout:2/932: chown d5/f42 36272867 1 2024-09-18T12:52:30.079 INFO:tasks.workunit.client.0.smithi045.stdout:2/933: dwrite d5/d5f/da8/d61/fc2 [0,4194304] 0 2024-09-18T12:52:30.087 INFO:tasks.workunit.client.0.smithi045.stdout:2/934: dwrite d5/d5f/da8/d61/fe9 [0,4194304] 0 2024-09-18T12:52:30.092 INFO:tasks.workunit.client.0.smithi045.stdout:9/663: dread d0/d3/d6/d64/d77/fbd [0,4194304] 0 2024-09-18T12:52:30.101 INFO:tasks.workunit.client.0.smithi045.stdout:9/664: getdents d0/d3/d6/d10/d26/d2e/d6f/da5/dab 0 2024-09-18T12:52:30.118 INFO:tasks.workunit.client.0.smithi045.stdout:2/935: dread d5/d46/f70 [0,4194304] 0 2024-09-18T12:52:30.120 INFO:tasks.workunit.client.0.smithi045.stdout:2/936: chown d5/d5f/da8/d61/dbb/dc6/ff3 0 1 2024-09-18T12:52:30.120 INFO:tasks.workunit.client.0.smithi045.stdout:9/665: dread d0/d3/d6/d10/d2c/f80 [0,4194304] 0 2024-09-18T12:52:30.122 INFO:tasks.workunit.client.0.smithi045.stdout:2/937: mknod d5/d5f/c136 0 2024-09-18T12:52:30.124 INFO:tasks.workunit.client.0.smithi045.stdout:9/666: truncate d0/d3/d6/d10/d26/d2e/d4e/d76/f8b 1373064 0 2024-09-18T12:52:30.126 INFO:tasks.workunit.client.0.smithi045.stdout:9/667: symlink d0/d3/d6/d9d/lcc 0 2024-09-18T12:52:30.128 INFO:tasks.workunit.client.0.smithi045.stdout:2/938: dwrite d5/d3a/da0/f109 [0,4194304] 0 2024-09-18T12:52:30.130 INFO:tasks.workunit.client.0.smithi045.stdout:9/668: symlink d0/d3/d6/d9d/lcd 0 2024-09-18T12:52:30.132 INFO:tasks.workunit.client.0.smithi045.stdout:9/669: readlink d0/d3/d6/d10/l65 0 2024-09-18T12:52:30.135 INFO:tasks.workunit.client.0.smithi045.stdout:9/670: stat d0/d3/c20 0 2024-09-18T12:52:30.137 INFO:tasks.workunit.client.0.smithi045.stdout:2/939: rename d5/d2c/d4d/f28 to d5/d3a/d12e/f137 0 2024-09-18T12:52:30.138 INFO:tasks.workunit.client.0.smithi045.stdout:2/940: chown d5/d5f/da8/ca2 28719 1 2024-09-18T12:52:30.139 INFO:tasks.workunit.client.0.smithi045.stdout:9/671: chown d0/d3/d6/d10/d26/d2e/d6f/da5/fb2 0 1 2024-09-18T12:52:30.142 INFO:tasks.workunit.client.0.smithi045.stdout:9/672: symlink d0/lce 0 2024-09-18T12:52:30.145 INFO:tasks.workunit.client.0.smithi045.stdout:9/673: creat d0/d3/d6/d64/d77/d9a/fcf x:0 0 0 2024-09-18T12:52:30.148 INFO:tasks.workunit.client.0.smithi045.stdout:9/674: write d0/f66 [2196176,35848] 0 2024-09-18T12:52:30.152 INFO:tasks.workunit.client.0.smithi045.stdout:9/675: truncate d0/d3/d6/f4f 1421555 0 2024-09-18T12:52:30.153 INFO:tasks.workunit.client.0.smithi045.stdout:2/941: dwrite d5/d46/f8e [0,4194304] 0 2024-09-18T12:52:30.163 INFO:tasks.workunit.client.0.smithi045.stdout:2/942: dwrite d5/d3a/d3e/dd4/fe8 [0,4194304] 0 2024-09-18T12:52:30.166 INFO:tasks.workunit.client.0.smithi045.stdout:2/943: mkdir d5/d3a/d12e/d138 0 2024-09-18T12:52:30.168 INFO:tasks.workunit.client.0.smithi045.stdout:9/676: dread d0/d3/d6/d10/d26/d2e/d4e/fbb [0,4194304] 0 2024-09-18T12:52:30.170 INFO:tasks.workunit.client.0.smithi045.stdout:2/944: fdatasync d5/d2c/dac/d11b/dce/f85 0 2024-09-18T12:52:30.173 INFO:tasks.workunit.client.0.smithi045.stdout:9/677: fsync d0/d3/d6/d10/d2c/f80 0 2024-09-18T12:52:30.177 INFO:tasks.workunit.client.0.smithi045.stdout:9/678: rename d0/d3/d6/d10/d26/d2e/d4e/d76/l97 to d0/d3/d6/d10/d26/d2e/d6f/da5/ld0 0 2024-09-18T12:52:30.181 INFO:tasks.workunit.client.0.smithi045.stdout:9/679: rename d0/d3/d6/d10/d26/d2e/f5e to d0/d3/d6/d10/d26/da4/fd1 0 2024-09-18T12:52:30.182 INFO:tasks.workunit.client.0.smithi045.stdout:9/680: fsync d0/d3/d6/d10/d2c/f49 0 2024-09-18T12:52:30.185 INFO:tasks.workunit.client.0.smithi045.stdout:9/681: creat d0/d3/d6/d10/d26/d2e/d4e/d76/fd2 x:0 0 0 2024-09-18T12:52:30.186 INFO:tasks.workunit.client.0.smithi045.stdout:9/682: write d0/d3/d6/d9d/fb5 [3779141,73155] 0 2024-09-18T12:52:30.193 INFO:tasks.workunit.client.0.smithi045.stdout:2/945: dwrite d5/d3a/d12e/f137 [0,4194304] 0 2024-09-18T12:52:30.198 INFO:tasks.workunit.client.0.smithi045.stdout:9/683: write d0/d3/d6/d10/d26/fa1 [571711,78192] 0 2024-09-18T12:52:30.204 INFO:tasks.workunit.client.0.smithi045.stdout:9/684: dwrite d0/d3/d6/d10/d26/d2e/f6a [0,4194304] 0 2024-09-18T12:52:30.208 INFO:tasks.workunit.client.0.smithi045.stdout:9/685: mknod d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/cd3 0 2024-09-18T12:52:30.211 INFO:tasks.workunit.client.0.smithi045.stdout:9/686: readlink d0/d3/d6/d10/d26/d2e/d4e/db4/lbe 0 2024-09-18T12:52:30.212 INFO:tasks.workunit.client.0.smithi045.stdout:9/687: fsync d0/d3/d6/fb7 0 2024-09-18T12:52:30.213 INFO:tasks.workunit.client.0.smithi045.stdout:9/688: chown d0/d3/d6/d10/d26/d2e/d4e/d76 23057 1 2024-09-18T12:52:30.217 INFO:tasks.workunit.client.0.smithi045.stdout:9/689: creat d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/fd4 x:0 0 0 2024-09-18T12:52:30.218 INFO:tasks.workunit.client.0.smithi045.stdout:9/690: truncate d0/f59 632890 0 2024-09-18T12:52:30.219 INFO:tasks.workunit.client.0.smithi045.stdout:9/691: chown d0/d3/d6/d10/d26/d2e/d4e/f5a 54695 1 2024-09-18T12:52:30.221 INFO:tasks.workunit.client.0.smithi045.stdout:9/692: mkdir d0/d3/d6/d64/d77/dd5 0 2024-09-18T12:52:30.223 INFO:tasks.workunit.client.0.smithi045.stdout:5/884: sync 2024-09-18T12:52:30.223 INFO:tasks.workunit.client.0.smithi045.stdout:3/712: sync 2024-09-18T12:52:30.223 INFO:tasks.workunit.client.0.smithi045.stdout:3/713: fsync d0/d29/ff3 0 2024-09-18T12:52:30.224 INFO:tasks.workunit.client.0.smithi045.stdout:3/714: chown d0/d1e/d91 21737 1 2024-09-18T12:52:30.225 INFO:tasks.workunit.client.0.smithi045.stdout:9/693: read d0/d3/d6/d10/d2c/f57 [3043431,81553] 0 2024-09-18T12:52:30.225 INFO:tasks.workunit.client.0.smithi045.stdout:5/885: stat d6/db/d6a/d6d/c10a 0 2024-09-18T12:52:30.226 INFO:tasks.workunit.client.0.smithi045.stdout:3/715: mknod d0/d1e/d2c/d5c/cf4 0 2024-09-18T12:52:30.226 INFO:tasks.workunit.client.0.smithi045.stdout:2/946: dread d5/d3a/d3e/db5/f105 [0,4194304] 0 2024-09-18T12:52:30.227 INFO:tasks.workunit.client.0.smithi045.stdout:2/947: chown d5/d2c/ff2 1 1 2024-09-18T12:52:30.230 INFO:tasks.workunit.client.0.smithi045.stdout:3/716: dread d0/d22/f71 [0,4194304] 0 2024-09-18T12:52:30.230 INFO:tasks.workunit.client.0.smithi045.stdout:5/886: symlink d6/db/d19/d92/d61/da5/l114 0 2024-09-18T12:52:30.233 INFO:tasks.workunit.client.0.smithi045.stdout:9/694: dwrite d0/f61 [4194304,4194304] 0 2024-09-18T12:52:30.243 INFO:tasks.workunit.client.0.smithi045.stdout:9/695: truncate d0/d3/d6/d10/d26/d2e/d4e/f67 236736 0 2024-09-18T12:52:30.250 INFO:tasks.workunit.client.0.smithi045.stdout:9/696: link d0/d3/c20 d0/d3/d6/d64/d88/dc0/cd6 0 2024-09-18T12:52:30.258 INFO:tasks.workunit.client.0.smithi045.stdout:5/887: write d6/db/d54/de2/d2b/d51/d6c/f86 [866383,125118] 0 2024-09-18T12:52:30.265 INFO:tasks.workunit.client.0.smithi045.stdout:3/717: dwrite d0/d29/d5f/d73/fbb [0,4194304] 0 2024-09-18T12:52:30.267 INFO:tasks.workunit.client.0.smithi045.stdout:3/718: write d0/d7/d89/fb6 [697139,95109] 0 2024-09-18T12:52:30.268 INFO:tasks.workunit.client.0.smithi045.stdout:3/719: chown d0/l31 5414 1 2024-09-18T12:52:30.269 INFO:tasks.workunit.client.0.smithi045.stdout:9/697: dread d0/f1a [8388608,4194304] 0 2024-09-18T12:52:30.269 INFO:tasks.workunit.client.0.smithi045.stdout:5/888: rename d6/db/d19/d92/le8 to d6/db/d54/de2/d2b/d51/d6c/l115 0 2024-09-18T12:52:30.271 INFO:tasks.workunit.client.0.smithi045.stdout:9/698: dread - d0/d3/d6/d10/d2c/f9b zero size 2024-09-18T12:52:30.274 INFO:tasks.workunit.client.0.smithi045.stdout:3/720: creat d0/d1e/d39/db7/de7/ff5 x:0 0 0 2024-09-18T12:52:30.275 INFO:tasks.workunit.client.0.smithi045.stdout:3/721: fdatasync d0/f1a 0 2024-09-18T12:52:30.276 INFO:tasks.workunit.client.0.smithi045.stdout:5/889: getdents d6/db/d54/dc2/dfe/d78/d66/de4 0 2024-09-18T12:52:30.280 INFO:tasks.workunit.client.0.smithi045.stdout:9/699: dwrite d0/d3/d6/d10/d26/d2e/d4e/d76/fd2 [0,4194304] 0 2024-09-18T12:52:30.283 INFO:tasks.workunit.client.0.smithi045.stdout:3/722: creat d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/ff6 x:0 0 0 2024-09-18T12:52:30.284 INFO:tasks.workunit.client.0.smithi045.stdout:3/723: chown d0/d1e/d39/lea 3453 1 2024-09-18T12:52:30.287 INFO:tasks.workunit.client.0.smithi045.stdout:9/700: creat d0/d3/d6/d9d/fd7 x:0 0 0 2024-09-18T12:52:30.293 INFO:tasks.workunit.client.0.smithi045.stdout:3/724: unlink d0/d1e/d39/da8/le5 0 2024-09-18T12:52:30.294 INFO:tasks.workunit.client.0.smithi045.stdout:5/890: dwrite d6/db/d19/d92/fbd [0,4194304] 0 2024-09-18T12:52:30.299 INFO:tasks.workunit.client.0.smithi045.stdout:5/891: creat d6/db/d54/dd5/f116 x:0 0 0 2024-09-18T12:52:30.300 INFO:tasks.workunit.client.0.smithi045.stdout:5/892: stat d6/db/d19/d92/d61/da5/ffc 0 2024-09-18T12:52:30.300 INFO:tasks.workunit.client.0.smithi045.stdout:5/893: fdatasync d6/db/fe 0 2024-09-18T12:52:30.311 INFO:tasks.workunit.client.0.smithi045.stdout:3/725: dwrite d0/d1e/d2c/d3a/d45/f92 [4194304,4194304] 0 2024-09-18T12:52:30.315 INFO:tasks.workunit.client.0.smithi045.stdout:5/894: dwrite d6/db/d54/de2/d2b/d51/fb7 [0,4194304] 0 2024-09-18T12:52:30.323 INFO:tasks.workunit.client.0.smithi045.stdout:3/726: write d0/d7/f23 [3170165,56214] 0 2024-09-18T12:52:30.333 INFO:tasks.workunit.client.0.smithi045.stdout:5/895: write d6/db/d54/de2/d2b/d51/d6c/f71 [8522354,109988] 0 2024-09-18T12:52:30.336 INFO:tasks.workunit.client.0.smithi045.stdout:5/896: creat d6/db/d19/d92/d5c/f117 x:0 0 0 2024-09-18T12:52:30.337 INFO:tasks.workunit.client.0.smithi045.stdout:3/727: dread d0/d1e/d2c/d3a/d8a/df1/ff2 [0,4194304] 0 2024-09-18T12:52:30.339 INFO:tasks.workunit.client.0.smithi045.stdout:3/728: mknod d0/d22/cf7 0 2024-09-18T12:52:30.340 INFO:tasks.workunit.client.0.smithi045.stdout:3/729: chown d0/d1e/d2c/d3a/d45/dbe/dcc/dc4 0 1 2024-09-18T12:52:30.341 INFO:tasks.workunit.client.0.smithi045.stdout:5/897: truncate d6/db/d54/de2/d2b/f4e 475733 0 2024-09-18T12:52:30.341 INFO:tasks.workunit.client.0.smithi045.stdout:5/898: chown d6/db/d19/d92/l1b 7 1 2024-09-18T12:52:30.342 INFO:tasks.workunit.client.0.smithi045.stdout:5/899: chown d6/db/d54/c89 311038876 1 2024-09-18T12:52:30.344 INFO:tasks.workunit.client.0.smithi045.stdout:3/730: dread d0/d29/d5f/d73/fbb [0,4194304] 0 2024-09-18T12:52:30.349 INFO:tasks.workunit.client.0.smithi045.stdout:3/731: creat d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/ff8 x:0 0 0 2024-09-18T12:52:30.352 INFO:tasks.workunit.client.0.smithi045.stdout:3/732: symlink d0/d1e/d2c/d3f/lf9 0 2024-09-18T12:52:30.354 INFO:tasks.workunit.client.0.smithi045.stdout:3/733: chown d0/d7/f10 3 1 2024-09-18T12:52:30.360 INFO:tasks.workunit.client.0.smithi045.stdout:5/900: dwrite d6/d3e/fe6 [0,4194304] 0 2024-09-18T12:52:30.367 INFO:tasks.workunit.client.0.smithi045.stdout:5/901: dwrite d6/db/d19/fe5 [0,4194304] 0 2024-09-18T12:52:30.368 INFO:tasks.workunit.client.0.smithi045.stdout:5/902: read d6/d3e/f9b [975445,90009] 0 2024-09-18T12:52:30.375 INFO:tasks.workunit.client.0.smithi045.stdout:3/734: dread d0/d22/f2e [0,4194304] 0 2024-09-18T12:52:30.379 INFO:tasks.workunit.client.0.smithi045.stdout:5/903: dwrite d6/db/d54/de2/d2b/d51/d6c/f86 [0,4194304] 0 2024-09-18T12:52:30.383 INFO:tasks.workunit.client.0.smithi045.stdout:3/735: creat d0/d1e/d2c/d3f/d44/d75/ffa x:0 0 0 2024-09-18T12:52:30.387 INFO:tasks.workunit.client.0.smithi045.stdout:3/736: creat d0/d1e/d2c/d3a/d45/dbe/dcc/ffb x:0 0 0 2024-09-18T12:52:30.388 INFO:tasks.workunit.client.0.smithi045.stdout:3/737: read - d0/fcd zero size 2024-09-18T12:52:30.390 INFO:tasks.workunit.client.0.smithi045.stdout:5/904: link d6/db/d54/de2/d2b/d51/d97/cf1 d6/db/d54/de2/d2b/c118 0 2024-09-18T12:52:30.392 INFO:tasks.workunit.client.0.smithi045.stdout:3/738: truncate d0/d1e/d2c/d3a/d8a/df1/ff2 4377468 0 2024-09-18T12:52:30.392 INFO:tasks.workunit.client.0.smithi045.stdout:5/905: mkdir d6/db/d54/de2/d2b/d7f/d119 0 2024-09-18T12:52:30.395 INFO:tasks.workunit.client.0.smithi045.stdout:3/739: mkdir d0/d1e/d39/da8/dd6/dfc 0 2024-09-18T12:52:30.395 INFO:tasks.workunit.client.0.smithi045.stdout:5/906: write d6/db/d19/fa3 [4469003,115284] 0 2024-09-18T12:52:30.398 INFO:tasks.workunit.client.0.smithi045.stdout:3/740: dread d0/d1e/d2c/d3a/fcf [0,4194304] 0 2024-09-18T12:52:30.401 INFO:tasks.workunit.client.0.smithi045.stdout:5/907: dwrite d6/db/d19/d92/ffd [0,4194304] 0 2024-09-18T12:52:30.403 INFO:tasks.workunit.client.0.smithi045.stdout:5/908: readlink d6/db/d54/de2/d2b/le0 0 2024-09-18T12:52:30.403 INFO:tasks.workunit.client.0.smithi045.stdout:3/741: read d0/d1e/d2c/d3f/fbd [53839,81251] 0 2024-09-18T12:52:30.404 INFO:tasks.workunit.client.0.smithi045.stdout:3/742: read d0/d22/f71 [856713,21121] 0 2024-09-18T12:52:30.406 INFO:tasks.workunit.client.0.smithi045.stdout:5/909: creat d6/d3e/f11a x:0 0 0 2024-09-18T12:52:30.421 INFO:tasks.workunit.client.0.smithi045.stdout:3/743: dwrite d0/f83 [0,4194304] 0 2024-09-18T12:52:30.423 INFO:tasks.workunit.client.0.smithi045.stdout:3/744: chown d0/d1e/d2c/d3a/d45/dbe/dcc/dc4 153244195 1 2024-09-18T12:52:30.427 INFO:tasks.workunit.client.0.smithi045.stdout:5/910: dread d6/db/d19/d92/d61/fc3 [0,4194304] 0 2024-09-18T12:52:30.428 INFO:tasks.workunit.client.0.smithi045.stdout:3/745: rename d0/d29/d5f/d73/d87/fd7 to d0/d1e/d91/ffd 0 2024-09-18T12:52:30.429 INFO:tasks.workunit.client.0.smithi045.stdout:3/746: chown d0/d29/d5f/cbf 11 1 2024-09-18T12:52:30.430 INFO:tasks.workunit.client.0.smithi045.stdout:5/911: mkdir d6/db/d19/d11b 0 2024-09-18T12:52:30.430 INFO:tasks.workunit.client.0.smithi045.stdout:3/747: dread - d0/d1e/d2c/d3a/d45/dbe/fdd zero size 2024-09-18T12:52:30.432 INFO:tasks.workunit.client.0.smithi045.stdout:5/912: chown d6/db/d54/dc2/dfe/d78/d66/de4 28270770 1 2024-09-18T12:52:30.434 INFO:tasks.workunit.client.0.smithi045.stdout:5/913: stat d6/db/d54/dc2/dfe/d78/f45 0 2024-09-18T12:52:30.443 INFO:tasks.workunit.client.0.smithi045.stdout:3/748: truncate d0/d1e/d2c/d3a/d45/f92 2843009 0 2024-09-18T12:52:30.448 INFO:tasks.workunit.client.0.smithi045.stdout:5/914: truncate d6/db/d54/dc2/dfe/d78/d66/f74 3402572 0 2024-09-18T12:52:30.460 INFO:tasks.workunit.client.0.smithi045.stdout:3/749: truncate d0/d1e/d39/fdc 4059787 0 2024-09-18T12:52:30.465 INFO:tasks.workunit.client.0.smithi045.stdout:5/915: write d6/db/d54/de2/d2b/f93 [192284,73767] 0 2024-09-18T12:52:30.467 INFO:tasks.workunit.client.0.smithi045.stdout:5/916: truncate d6/db/d19/d92/d5c/f117 658235 0 2024-09-18T12:52:30.473 INFO:tasks.workunit.client.0.smithi045.stdout:5/917: dwrite d6/d3e/f9b [0,4194304] 0 2024-09-18T12:52:30.478 INFO:tasks.workunit.client.0.smithi045.stdout:3/750: write d0/d1e/d2c/d3a/d45/f6c [1015278,94519] 0 2024-09-18T12:52:30.485 INFO:tasks.workunit.client.0.smithi045.stdout:3/751: creat d0/d1e/d2c/d3a/d45/ffe x:0 0 0 2024-09-18T12:52:30.488 INFO:tasks.workunit.client.0.smithi045.stdout:3/752: mkdir d0/d29/d53/dff 0 2024-09-18T12:52:30.491 INFO:tasks.workunit.client.0.smithi045.stdout:3/753: mknod d0/d1e/d2c/d3f/d44/d75/c100 0 2024-09-18T12:52:30.494 INFO:tasks.workunit.client.0.smithi045.stdout:5/918: truncate d6/db/d54/de2/fd0 4017489 0 2024-09-18T12:52:30.495 INFO:tasks.workunit.client.0.smithi045.stdout:3/754: write d0/d1e/d91/ffd [343270,50240] 0 2024-09-18T12:52:30.500 INFO:tasks.workunit.client.0.smithi045.stdout:3/755: symlink d0/d1e/l101 0 2024-09-18T12:52:30.506 INFO:tasks.workunit.client.0.smithi045.stdout:3/756: getdents d0/d1e/d2c/d5c 0 2024-09-18T12:52:30.506 INFO:tasks.workunit.client.0.smithi045.stdout:5/919: dread d6/db/d19/d92/d61/f72 [0,4194304] 0 2024-09-18T12:52:30.508 INFO:tasks.workunit.client.0.smithi045.stdout:0/850: sync 2024-09-18T12:52:30.508 INFO:tasks.workunit.client.0.smithi045.stdout:1/933: sync 2024-09-18T12:52:30.508 INFO:tasks.workunit.client.0.smithi045.stdout:6/742: sync 2024-09-18T12:52:30.509 INFO:tasks.workunit.client.0.smithi045.stdout:8/866: sync 2024-09-18T12:52:30.510 INFO:tasks.workunit.client.0.smithi045.stdout:1/934: dread - d0/d2d/d92/fdd zero size 2024-09-18T12:52:30.516 INFO:tasks.workunit.client.0.smithi045.stdout:6/743: creat d9/d1a/d48/dc1/f104 x:0 0 0 2024-09-18T12:52:30.518 INFO:tasks.workunit.client.0.smithi045.stdout:1/935: dwrite d0/d2d/d2b/f122 [0,4194304] 0 2024-09-18T12:52:30.519 INFO:tasks.workunit.client.0.smithi045.stdout:3/757: write d0/d1e/d39/f43 [1441657,18260] 0 2024-09-18T12:52:30.524 INFO:tasks.workunit.client.0.smithi045.stdout:8/867: write d11/d14/d72/f73 [1352755,38296] 0 2024-09-18T12:52:30.528 INFO:tasks.workunit.client.0.smithi045.stdout:5/920: truncate d6/db/d54/de2/d2b/d51/d6c/f71 2862758 0 2024-09-18T12:52:30.529 INFO:tasks.workunit.client.0.smithi045.stdout:0/851: dwrite d6/d48/d5e/fc4 [0,4194304] 0 2024-09-18T12:52:30.530 INFO:tasks.workunit.client.0.smithi045.stdout:3/758: dwrite d0/f1a [4194304,4194304] 0 2024-09-18T12:52:30.531 INFO:tasks.workunit.client.0.smithi045.stdout:6/744: creat d9/d1a/d2d/d32/f105 x:0 0 0 2024-09-18T12:52:30.533 INFO:tasks.workunit.client.0.smithi045.stdout:5/921: chown d6/db/d19/dbc/fd3 1097 1 2024-09-18T12:52:30.534 INFO:tasks.workunit.client.0.smithi045.stdout:1/936: rename d0/d2d/d2b/ca8 to d0/d2d/db1/c125 0 2024-09-18T12:52:30.540 INFO:tasks.workunit.client.0.smithi045.stdout:0/852: read d6/d48/d5e/d39/d58/d3b/fd8 [823717,48835] 0 2024-09-18T12:52:30.547 INFO:tasks.workunit.client.0.smithi045.stdout:5/922: rename d6/db/d54/c89 to d6/db/d54/dc2/dfe/d78/d66/de4/c11c 0 2024-09-18T12:52:30.549 INFO:tasks.workunit.client.0.smithi045.stdout:5/923: write d6/db/d19/fa3 [5163277,21223] 0 2024-09-18T12:52:30.550 INFO:tasks.workunit.client.0.smithi045.stdout:5/924: chown d6/db/d54/de2 3486 1 2024-09-18T12:52:30.554 INFO:tasks.workunit.client.0.smithi045.stdout:6/745: write d9/d56/fd3 [753347,88747] 0 2024-09-18T12:52:30.555 INFO:tasks.workunit.client.0.smithi045.stdout:8/868: write d11/f12 [2691052,121323] 0 2024-09-18T12:52:30.562 INFO:tasks.workunit.client.0.smithi045.stdout:3/759: truncate d0/d1e/d2c/d3a/d8a/f9b 335061 0 2024-09-18T12:52:30.565 INFO:tasks.workunit.client.0.smithi045.stdout:0/853: write d6/daa/dee/df9/d73/f7f [1637896,34724] 0 2024-09-18T12:52:30.565 INFO:tasks.workunit.client.0.smithi045.stdout:1/937: dread d0/f6 [0,4194304] 0 2024-09-18T12:52:30.568 INFO:tasks.workunit.client.0.smithi045.stdout:5/925: unlink d6/db/d54/de2/d2b/c118 0 2024-09-18T12:52:30.572 INFO:tasks.workunit.client.0.smithi045.stdout:8/869: write d11/d20/d46/faf [2986,53034] 0 2024-09-18T12:52:30.576 INFO:tasks.workunit.client.0.smithi045.stdout:3/760: write d0/d29/f67 [6339624,23881] 0 2024-09-18T12:52:30.577 INFO:tasks.workunit.client.0.smithi045.stdout:0/854: rmdir d6/d48/d5e/d39/d58/db5/dc8 39 2024-09-18T12:52:30.580 INFO:tasks.workunit.client.0.smithi045.stdout:5/926: dread d6/db/d54/dc2/dfe/d78/d66/f7b [0,4194304] 0 2024-09-18T12:52:30.581 INFO:tasks.workunit.client.0.smithi045.stdout:1/938: write d0/d12/d32/d67/fce [4537909,72645] 0 2024-09-18T12:52:30.586 INFO:tasks.workunit.client.0.smithi045.stdout:0/855: mkdir d6/d48/d5e/d39/d58/d3b/d65/d100 0 2024-09-18T12:52:30.588 INFO:tasks.workunit.client.0.smithi045.stdout:5/927: dwrite d6/db/d19/fa3 [0,4194304] 0 2024-09-18T12:52:30.592 INFO:tasks.workunit.client.0.smithi045.stdout:1/939: creat d0/d2d/d2b/d30/d40/dc7/f126 x:0 0 0 2024-09-18T12:52:30.593 INFO:tasks.workunit.client.0.smithi045.stdout:8/870: symlink d11/d20/d46/df9/l103 0 2024-09-18T12:52:30.595 INFO:tasks.workunit.client.0.smithi045.stdout:8/871: truncate d11/d14/f1b 4989355 0 2024-09-18T12:52:30.596 INFO:tasks.workunit.client.0.smithi045.stdout:8/872: stat d11/d76/c9e 0 2024-09-18T12:52:30.596 INFO:tasks.workunit.client.0.smithi045.stdout:0/856: creat d6/d48/d5e/d39/d58/d66/f101 x:0 0 0 2024-09-18T12:52:30.604 INFO:tasks.workunit.client.0.smithi045.stdout:3/761: link d0/d1e/d2c/c3b d0/d1e/d2c/d3f/d44/c102 0 2024-09-18T12:52:30.608 INFO:tasks.workunit.client.0.smithi045.stdout:3/762: fdatasync d0/d1e/d2c/f63 0 2024-09-18T12:52:30.609 INFO:tasks.workunit.client.0.smithi045.stdout:1/940: link d0/d2d/db1/dc6/cf7 d0/d2d/d2b/d30/d40/d60/d8f/d104/df4/d10a/c127 0 2024-09-18T12:52:30.611 INFO:tasks.workunit.client.0.smithi045.stdout:3/763: truncate d0/d1e/d91/ffd 1323358 0 2024-09-18T12:52:30.616 INFO:tasks.workunit.client.0.smithi045.stdout:5/928: truncate d6/d3e/f3f 3204030 0 2024-09-18T12:52:30.616 INFO:tasks.workunit.client.0.smithi045.stdout:0/857: write d6/d7/fae [977815,119771] 0 2024-09-18T12:52:30.618 INFO:tasks.workunit.client.0.smithi045.stdout:1/941: unlink d0/d2d/d2b/d30/d40/d60/le2 0 2024-09-18T12:52:30.619 INFO:tasks.workunit.client.0.smithi045.stdout:3/764: dread - d0/d22/f8e zero size 2024-09-18T12:52:30.620 INFO:tasks.workunit.client.0.smithi045.stdout:8/873: truncate d11/d23/fcc 3233740 0 2024-09-18T12:52:30.620 INFO:tasks.workunit.client.0.smithi045.stdout:0/858: dread d6/d48/d5e/d39/d58/d3b/f95 [0,4194304] 0 2024-09-18T12:52:30.631 INFO:tasks.workunit.client.0.smithi045.stdout:3/765: mkdir d0/d29/d53/dff/d103 0 2024-09-18T12:52:30.633 INFO:tasks.workunit.client.0.smithi045.stdout:5/929: rename d6/db/f43 to d6/db/d54/de2/d2b/d51/f11d 0 2024-09-18T12:52:30.708 INFO:tasks.workunit.client.0.smithi045.stdout:3/766: truncate d0/d1e/d2c/f82 1112323 0 2024-09-18T12:52:30.708 INFO:tasks.workunit.client.0.smithi045.stdout:0/859: write d6/f7d [873719,53946] 0 2024-09-18T12:52:30.708 INFO:tasks.workunit.client.0.smithi045.stdout:1/942: dwrite d0/d12/d32/d67/d6d/fa2 [0,4194304] 0 2024-09-18T12:52:30.715 INFO:tasks.workunit.client.0.smithi045.stdout:8/874: dwrite d11/d14/d53/f3e [0,4194304] 0 2024-09-18T12:52:30.719 INFO:tasks.workunit.client.0.smithi045.stdout:3/767: dwrite d0/d7/d89/fb6 [0,4194304] 0 2024-09-18T12:52:30.722 INFO:tasks.workunit.client.0.smithi045.stdout:3/768: rename d0 to d0/d1e/d2c/d3a/ddf/d104 22 2024-09-18T12:52:30.722 INFO:tasks.workunit.client.0.smithi045.stdout:3/769: chown d0/d1e/d39/db7/cc5 908164 1 2024-09-18T12:52:30.723 INFO:tasks.workunit.client.0.smithi045.stdout:3/770: chown d0/d1e/d2c/d3a/d45/dbe/fc9 511233 1 2024-09-18T12:52:30.742 INFO:tasks.workunit.client.0.smithi045.stdout:0/860: read d6/d35/f37 [2515430,114773] 0 2024-09-18T12:52:30.745 INFO:tasks.workunit.client.0.smithi045.stdout:3/771: rmdir d0/d1e/d39/da8/dd6 39 2024-09-18T12:52:30.745 INFO:tasks.workunit.client.0.smithi045.stdout:0/861: read d6/d48/d5e/f30 [2871275,20644] 0 2024-09-18T12:52:30.748 INFO:tasks.workunit.client.0.smithi045.stdout:7/801: sync 2024-09-18T12:52:30.749 INFO:tasks.workunit.client.0.smithi045.stdout:1/943: mknod d0/d2d/db1/d109/c128 0 2024-09-18T12:52:30.751 INFO:tasks.workunit.client.0.smithi045.stdout:8/875: dread - d11/d14/d53/d41/fe5 zero size 2024-09-18T12:52:30.752 INFO:tasks.workunit.client.0.smithi045.stdout:0/862: dwrite d6/daa/db2/fd1 [0,4194304] 0 2024-09-18T12:52:30.752 INFO:tasks.workunit.client.0.smithi045.stdout:3/772: symlink d0/d29/d5f/d73/da0/l105 0 2024-09-18T12:52:30.753 INFO:tasks.workunit.client.0.smithi045.stdout:0/863: chown d6/d48/cf5 131 1 2024-09-18T12:52:30.757 INFO:tasks.workunit.client.0.smithi045.stdout:7/802: fsync d13/d44/d37/d70/d77/fa4 0 2024-09-18T12:52:30.759 INFO:tasks.workunit.client.0.smithi045.stdout:1/944: creat d0/d2d/d2b/d30/d40/d60/d8f/f129 x:0 0 0 2024-09-18T12:52:30.760 INFO:tasks.workunit.client.0.smithi045.stdout:8/876: chown d11/c31 7314537 1 2024-09-18T12:52:30.762 INFO:tasks.workunit.client.0.smithi045.stdout:3/773: creat d0/d29/d5f/d73/d87/f106 x:0 0 0 2024-09-18T12:52:30.763 INFO:tasks.workunit.client.0.smithi045.stdout:3/774: chown d0/d1e/d2c/d3a/d45/dbe 31538060 1 2024-09-18T12:52:30.768 INFO:tasks.workunit.client.0.smithi045.stdout:0/864: creat d6/daa/def/f102 x:0 0 0 2024-09-18T12:52:30.770 INFO:tasks.workunit.client.0.smithi045.stdout:7/803: link d13/d31/d52/d81/f9d d13/d44/d37/d70/d77/d6d/f115 0 2024-09-18T12:52:30.771 INFO:tasks.workunit.client.0.smithi045.stdout:8/877: symlink d11/d20/d60/l104 0 2024-09-18T12:52:30.772 INFO:tasks.workunit.client.0.smithi045.stdout:5/930: dwrite d6/dc7/fca [4194304,4194304] 0 2024-09-18T12:52:30.774 INFO:tasks.workunit.client.0.smithi045.stdout:1/945: rename d0/d2d/d2b/d30/d40/d60/d8f/d104/df4/d10a/c127 to d0/d2d/d2b/d30/d40/d60/d8f/d104/c12a 0 2024-09-18T12:52:30.846 INFO:tasks.workunit.client.0.smithi045.stdout:5/931: creat d6/db/d6a/f11e x:0 0 0 2024-09-18T12:52:30.849 INFO:tasks.workunit.client.0.smithi045.stdout:8/878: write d11/d20/d60/dc3/f4a [2775821,74544] 0 2024-09-18T12:52:30.852 INFO:tasks.workunit.client.0.smithi045.stdout:1/946: rename d0/c82 to d0/d12/d32/d67/d6d/ddf/c12b 0 2024-09-18T12:52:30.852 INFO:tasks.workunit.client.0.smithi045.stdout:8/879: dread d11/d20/d46/faf [0,4194304] 0 2024-09-18T12:52:30.854 INFO:tasks.workunit.client.0.smithi045.stdout:8/880: chown d11/d14/d53/d41/d75 741 1 2024-09-18T12:52:30.854 INFO:tasks.workunit.client.0.smithi045.stdout:5/932: mknod d6/db/d19/dbc/ddc/c11f 0 2024-09-18T12:52:30.855 INFO:tasks.workunit.client.0.smithi045.stdout:1/947: chown d0/d2d/d2b/d30/d40/d60/d8f/c91 133774118 1 2024-09-18T12:52:30.856 INFO:tasks.workunit.client.0.smithi045.stdout:5/933: write d6/db/d19/fa3 [1378652,92547] 0 2024-09-18T12:52:30.861 INFO:tasks.workunit.client.0.smithi045.stdout:3/775: dread d0/d29/d53/fe0 [4194304,4194304] 0 2024-09-18T12:52:30.865 INFO:tasks.workunit.client.0.smithi045.stdout:8/881: truncate d11/d14/f3a 3681787 0 2024-09-18T12:52:30.868 INFO:tasks.workunit.client.0.smithi045.stdout:5/934: mknod d6/db/d54/de2/d2b/d7f/d119/c120 0 2024-09-18T12:52:30.870 INFO:tasks.workunit.client.0.smithi045.stdout:8/882: creat d11/d20/d46/df9/f105 x:0 0 0 2024-09-18T12:52:30.871 INFO:tasks.workunit.client.0.smithi045.stdout:3/776: dwrite d0/d1e/d2c/d3a/d45/dbe/fee [0,4194304] 0 2024-09-18T12:52:30.880 INFO:tasks.workunit.client.0.smithi045.stdout:5/935: rmdir d6/d3e/d109 0 2024-09-18T12:52:30.883 INFO:tasks.workunit.client.0.smithi045.stdout:2/948: sync 2024-09-18T12:52:30.884 INFO:tasks.workunit.client.0.smithi045.stdout:9/701: sync 2024-09-18T12:52:30.884 INFO:tasks.workunit.client.0.smithi045.stdout:8/883: dread d11/f12 [0,4194304] 0 2024-09-18T12:52:30.884 INFO:tasks.workunit.client.0.smithi045.stdout:9/702: chown d0/f7f 210 1 2024-09-18T12:52:30.887 INFO:tasks.workunit.client.0.smithi045.stdout:2/949: symlink d5/d2c/d6f/l139 0 2024-09-18T12:52:30.892 INFO:tasks.workunit.client.0.smithi045.stdout:5/936: rename d6/db/d19/d92/l1b to d6/db/d6a/d77/l121 0 2024-09-18T12:52:30.892 INFO:tasks.workunit.client.0.smithi045.stdout:8/884: dwrite d11/d20/d60/dc3/f4a [0,4194304] 0 2024-09-18T12:52:30.899 INFO:tasks.workunit.client.0.smithi045.stdout:8/885: symlink d11/d14/d53/d41/d75/l106 0 2024-09-18T12:52:30.902 INFO:tasks.workunit.client.0.smithi045.stdout:8/886: symlink d11/d76/da0/da1/l107 0 2024-09-18T12:52:30.905 INFO:tasks.workunit.client.0.smithi045.stdout:9/703: dread d0/d3/f7 [4194304,4194304] 0 2024-09-18T12:52:30.907 INFO:tasks.workunit.client.0.smithi045.stdout:7/804: truncate d13/d44/d37/d70/f9f 273478 0 2024-09-18T12:52:30.910 INFO:tasks.workunit.client.0.smithi045.stdout:7/805: fdatasync d13/d31/d33/d64/d78/fbb 0 2024-09-18T12:52:30.916 INFO:tasks.workunit.client.0.smithi045.stdout:1/948: dwrite d0/f69 [0,4194304] 0 2024-09-18T12:52:30.924 INFO:tasks.workunit.client.0.smithi045.stdout:3/777: truncate d0/f1a 4992792 0 2024-09-18T12:52:30.929 INFO:tasks.workunit.client.0.smithi045.stdout:7/806: dread d13/d44/d37/d6a/fdf [0,4194304] 0 2024-09-18T12:52:30.931 INFO:tasks.workunit.client.0.smithi045.stdout:9/704: dread d0/d3/d6/d10/d26/d2e/d4e/f5a [0,4194304] 0 2024-09-18T12:52:30.935 INFO:tasks.workunit.client.0.smithi045.stdout:8/887: write d11/d14/d53/d41/fe5 [428222,12414] 0 2024-09-18T12:52:30.939 INFO:tasks.workunit.client.0.smithi045.stdout:9/705: fsync d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/fc9 0 2024-09-18T12:52:30.940 INFO:tasks.workunit.client.0.smithi045.stdout:1/949: write d0/d12/d32/d67/d6d/fa1 [1852282,11010] 0 2024-09-18T12:52:30.943 INFO:tasks.workunit.client.0.smithi045.stdout:2/950: dwrite d5/d2c/d4d/f5a [0,4194304] 0 2024-09-18T12:52:30.944 INFO:tasks.workunit.client.0.smithi045.stdout:5/937: dwrite d6/db/d19/d92/d61/da5/fa9 [0,4194304] 0 2024-09-18T12:52:30.947 INFO:tasks.workunit.client.0.smithi045.stdout:1/950: chown d0/f6 35 1 2024-09-18T12:52:30.949 INFO:tasks.workunit.client.0.smithi045.stdout:8/888: creat d11/d20/d60/dc3/d98/f108 x:0 0 0 2024-09-18T12:52:30.953 INFO:tasks.workunit.client.0.smithi045.stdout:2/951: write d5/d3a/f132 [497567,57097] 0 2024-09-18T12:52:30.953 INFO:tasks.workunit.client.0.smithi045.stdout:3/778: dread d0/d1e/d39/f43 [0,4194304] 0 2024-09-18T12:52:30.953 INFO:tasks.workunit.client.0.smithi045.stdout:7/807: dread d13/d44/d4c/d82/dda/ffc [0,4194304] 0 2024-09-18T12:52:30.954 INFO:tasks.workunit.client.0.smithi045.stdout:6/746: sync 2024-09-18T12:52:30.954 INFO:tasks.workunit.client.0.smithi045.stdout:1/951: fdatasync d0/f3c 0 2024-09-18T12:52:30.956 INFO:tasks.workunit.client.0.smithi045.stdout:9/706: mknod d0/d3/d6/d10/d26/d2e/d4e/d76/cd8 0 2024-09-18T12:52:30.958 INFO:tasks.workunit.client.0.smithi045.stdout:5/938: symlink d6/db/d54/de2/d2b/d7f/l122 0 2024-09-18T12:52:30.965 INFO:tasks.workunit.client.0.smithi045.stdout:3/779: creat d0/d1e/d2c/dd4/f107 x:0 0 0 2024-09-18T12:52:30.970 INFO:tasks.workunit.client.0.smithi045.stdout:6/747: truncate d9/d1a/d2d/d38/d5b/f61 6029008 0 2024-09-18T12:52:30.973 INFO:tasks.workunit.client.0.smithi045.stdout:3/780: dwrite d0/d1e/d2c/d3a/d45/ffe [0,4194304] 0 2024-09-18T12:52:30.979 INFO:tasks.workunit.client.0.smithi045.stdout:7/808: dwrite d13/d44/f2b [0,4194304] 0 2024-09-18T12:52:30.981 INFO:tasks.workunit.client.0.smithi045.stdout:1/952: write d0/d2d/d2b/d30/fb9 [1872975,52692] 0 2024-09-18T12:52:30.982 INFO:tasks.workunit.client.0.smithi045.stdout:7/809: write d13/d1a/d28/f3e [938558,10425] 0 2024-09-18T12:52:30.985 INFO:tasks.workunit.client.0.smithi045.stdout:5/939: write d6/d3e/f33 [139073,3114] 0 2024-09-18T12:52:30.986 INFO:tasks.workunit.client.0.smithi045.stdout:6/748: rename d9/d56/db3/dc0 to d9/d1a/d48/d75/d106 0 2024-09-18T12:52:30.990 INFO:tasks.workunit.client.0.smithi045.stdout:9/707: truncate d0/d3/d6/f2d 2708170 0 2024-09-18T12:52:30.992 INFO:tasks.workunit.client.0.smithi045.stdout:8/889: dwrite d11/d14/d53/d41/f7c [0,4194304] 0 2024-09-18T12:52:30.995 INFO:tasks.workunit.client.0.smithi045.stdout:7/810: mknod d13/d31/d33/c116 0 2024-09-18T12:52:30.995 INFO:tasks.workunit.client.0.smithi045.stdout:5/940: mknod d6/dc7/c123 0 2024-09-18T12:52:30.999 INFO:tasks.workunit.client.0.smithi045.stdout:2/952: getdents d5/d5f/da8/d61/dbb 0 2024-09-18T12:52:31.002 INFO:tasks.workunit.client.0.smithi045.stdout:9/708: chown d0/d3/d6/d64/d88/dc0/cd6 1686945 1 2024-09-18T12:52:31.004 INFO:tasks.workunit.client.0.smithi045.stdout:9/709: fsync d0/d3/d6/fb7 0 2024-09-18T12:52:31.004 INFO:tasks.workunit.client.0.smithi045.stdout:0/865: sync 2024-09-18T12:52:31.004 INFO:tasks.workunit.client.0.smithi045.stdout:9/710: readlink d0/d3/d6/d10/l43 0 2024-09-18T12:52:31.006 INFO:tasks.workunit.client.0.smithi045.stdout:1/953: symlink d0/d2d/d2b/l12c 0 2024-09-18T12:52:31.007 INFO:tasks.workunit.client.0.smithi045.stdout:8/890: truncate d11/d20/d46/df9/fb6 2342141 0 2024-09-18T12:52:31.010 INFO:tasks.workunit.client.0.smithi045.stdout:1/954: dread d0/f69 [0,4194304] 0 2024-09-18T12:52:31.017 INFO:tasks.workunit.client.0.smithi045.stdout:2/953: symlink d5/d2c/l13a 0 2024-09-18T12:52:31.017 INFO:tasks.workunit.client.0.smithi045.stdout:6/749: dread d9/d56/f57 [0,4194304] 0 2024-09-18T12:52:31.020 INFO:tasks.workunit.client.0.smithi045.stdout:5/941: dwrite d6/db/d19/d92/d5c/f98 [0,4194304] 0 2024-09-18T12:52:31.023 INFO:tasks.workunit.client.0.smithi045.stdout:9/711: symlink d0/d3/d6/d64/d77/d9a/ld9 0 2024-09-18T12:52:31.028 INFO:tasks.workunit.client.0.smithi045.stdout:8/891: truncate d11/d20/d46/f78 1237377 0 2024-09-18T12:52:31.033 INFO:tasks.workunit.client.0.smithi045.stdout:1/955: rename d0/d2d/d2b/d30/d40/dc7/dd0 to d0/d2d/d2b/d30/d40/d60/d8f/d104/d12d 0 2024-09-18T12:52:31.034 INFO:tasks.workunit.client.0.smithi045.stdout:3/781: link d0/d1e/c25 d0/d1e/d2c/d3f/d44/c108 0 2024-09-18T12:52:31.037 INFO:tasks.workunit.client.0.smithi045.stdout:0/866: truncate d6/d48/d5e/d39/d58/d86/ff1 992477 0 2024-09-18T12:52:31.037 INFO:tasks.workunit.client.0.smithi045.stdout:9/712: rmdir d0/d3/d6/d64 39 2024-09-18T12:52:31.038 INFO:tasks.workunit.client.0.smithi045.stdout:0/867: chown d6/d48 1746 1 2024-09-18T12:52:31.039 INFO:tasks.workunit.client.0.smithi045.stdout:8/892: symlink d11/d14/d53/d41/d75/l109 0 2024-09-18T12:52:31.040 INFO:tasks.workunit.client.0.smithi045.stdout:7/811: link d13/d44/d37/fbc d13/d31/d5f/d94/f117 0 2024-09-18T12:52:31.042 INFO:tasks.workunit.client.0.smithi045.stdout:3/782: creat d0/d1e/d39/db7/de7/f109 x:0 0 0 2024-09-18T12:52:31.047 INFO:tasks.workunit.client.0.smithi045.stdout:2/954: dwrite d5/d5f/da8/d61/dbb/dc6/ff3 [4194304,4194304] 0 2024-09-18T12:52:31.049 INFO:tasks.workunit.client.0.smithi045.stdout:8/893: mknod d11/d14/d72/da9/c10a 0 2024-09-18T12:52:31.055 INFO:tasks.workunit.client.0.smithi045.stdout:0/868: dread d6/d48/d5e/fc4 [0,4194304] 0 2024-09-18T12:52:31.055 INFO:tasks.workunit.client.0.smithi045.stdout:5/942: dread d6/db/d54/de2/fd0 [0,4194304] 0 2024-09-18T12:52:31.057 INFO:tasks.workunit.client.0.smithi045.stdout:5/943: dread - d6/db/d19/dbc/f102 zero size 2024-09-18T12:52:31.059 INFO:tasks.workunit.client.0.smithi045.stdout:9/713: dread d0/f66 [0,4194304] 0 2024-09-18T12:52:31.061 INFO:tasks.workunit.client.0.smithi045.stdout:2/955: unlink d5/d2c/d4d/fc4 0 2024-09-18T12:52:31.062 INFO:tasks.workunit.client.0.smithi045.stdout:1/956: dread d0/d12/d32/d67/d6d/fe7 [0,4194304] 0 2024-09-18T12:52:31.062 INFO:tasks.workunit.client.0.smithi045.stdout:7/812: chown d13/d44/d37/fbc 0 1 2024-09-18T12:52:31.066 INFO:tasks.workunit.client.0.smithi045.stdout:3/783: dread d0/d1e/d2c/f82 [0,4194304] 0 2024-09-18T12:52:31.069 INFO:tasks.workunit.client.0.smithi045.stdout:8/894: rename d11/d23 to d11/d14/d72/da9/dc5/d10b 0 2024-09-18T12:52:31.071 INFO:tasks.workunit.client.0.smithi045.stdout:6/750: dwrite d9/d1a/d2d/f5e [4194304,4194304] 0 2024-09-18T12:52:31.071 INFO:tasks.workunit.client.0.smithi045.stdout:3/784: dread d0/d1e/d2c/d3f/fbd [0,4194304] 0 2024-09-18T12:52:31.074 INFO:tasks.workunit.client.0.smithi045.stdout:0/869: mknod d6/daa/dee/df9/d73/c103 0 2024-09-18T12:52:31.075 INFO:tasks.workunit.client.0.smithi045.stdout:5/944: unlink d6/db/d70/f100 0 2024-09-18T12:52:31.075 INFO:tasks.workunit.client.0.smithi045.stdout:5/945: readlink d6/d3e/l99 0 2024-09-18T12:52:31.077 INFO:tasks.workunit.client.0.smithi045.stdout:9/714: mknod d0/cda 0 2024-09-18T12:52:31.081 INFO:tasks.workunit.client.0.smithi045.stdout:2/956: creat d5/d2c/d4d/d76/d93/f13b x:0 0 0 2024-09-18T12:52:31.088 INFO:tasks.workunit.client.0.smithi045.stdout:3/785: symlink d0/d7/d89/l10a 0 2024-09-18T12:52:31.098 INFO:tasks.workunit.client.0.smithi045.stdout:6/751: dread d9/d1a/d2d/d38/f3d [0,4194304] 0 2024-09-18T12:52:31.099 INFO:tasks.workunit.client.0.smithi045.stdout:6/752: chown d9/d1a/d48/dc6/lfa 242 1 2024-09-18T12:52:31.106 INFO:tasks.workunit.client.0.smithi045.stdout:2/957: mkdir d5/d2c/dac/d11b/d13c 0 2024-09-18T12:52:31.107 INFO:tasks.workunit.client.0.smithi045.stdout:2/958: chown d5/d2c/fd2 1744 1 2024-09-18T12:52:31.109 INFO:tasks.workunit.client.0.smithi045.stdout:7/813: symlink d13/d44/d37/d6a/da3/d10a/l118 0 2024-09-18T12:52:31.110 INFO:tasks.workunit.client.0.smithi045.stdout:5/946: write d6/db/fd6 [484569,116283] 0 2024-09-18T12:52:31.111 INFO:tasks.workunit.client.0.smithi045.stdout:5/947: stat d6/db/cee 0 2024-09-18T12:52:31.114 INFO:tasks.workunit.client.0.smithi045.stdout:6/753: dread d9/d1a/d48/d97/f9c [0,4194304] 0 2024-09-18T12:52:31.114 INFO:tasks.workunit.client.0.smithi045.stdout:8/895: fsync d11/d20/d46/df9/fb6 0 2024-09-18T12:52:31.115 INFO:tasks.workunit.client.0.smithi045.stdout:0/870: link d6/d48/d5e/fc4 d6/d35/d92/f104 0 2024-09-18T12:52:31.116 INFO:tasks.workunit.client.0.smithi045.stdout:9/715: dread d0/d3/d6/d10/f29 [0,4194304] 0 2024-09-18T12:52:31.121 INFO:tasks.workunit.client.0.smithi045.stdout:5/948: dread d6/db/d19/d92/d61/da5/fef [0,4194304] 0 2024-09-18T12:52:31.121 INFO:tasks.workunit.client.0.smithi045.stdout:1/957: truncate d0/d2d/d2b/d30/d40/d60/d8f/fb8 120739 0 2024-09-18T12:52:31.125 INFO:tasks.workunit.client.0.smithi045.stdout:0/871: mknod d6/daa/def/c105 0 2024-09-18T12:52:31.128 INFO:tasks.workunit.client.0.smithi045.stdout:1/958: chown d0/d2d/d2b/lf0 17086246 1 2024-09-18T12:52:31.131 INFO:tasks.workunit.client.0.smithi045.stdout:5/949: write d6/db/d19/d92/d61/da5/dc9/ffb [234812,21968] 0 2024-09-18T12:52:31.133 INFO:tasks.workunit.client.0.smithi045.stdout:6/754: dwrite d9/d1a/d48/dc1/f104 [0,4194304] 0 2024-09-18T12:52:31.139 INFO:tasks.workunit.client.0.smithi045.stdout:7/814: dread d13/d44/d37/d6a/da3/fd8 [0,4194304] 0 2024-09-18T12:52:31.139 INFO:tasks.workunit.client.0.smithi045.stdout:9/716: dwrite d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/fc9 [0,4194304] 0 2024-09-18T12:52:31.142 INFO:tasks.workunit.client.0.smithi045.stdout:9/717: write d0/f2 [7380730,33214] 0 2024-09-18T12:52:31.147 INFO:tasks.workunit.client.0.smithi045.stdout:8/896: dread d11/d14/d53/d41/d75/fba [0,4194304] 0 2024-09-18T12:52:31.151 INFO:tasks.workunit.client.0.smithi045.stdout:6/755: chown d9/d1a/d48/d75/d106/de2/fed 62569 1 2024-09-18T12:52:31.153 INFO:tasks.workunit.client.0.smithi045.stdout:7/815: dwrite d13/d31/fd4 [0,4194304] 0 2024-09-18T12:52:31.154 INFO:tasks.workunit.client.0.smithi045.stdout:0/872: write d6/f9d [3379768,117016] 0 2024-09-18T12:52:31.155 INFO:tasks.workunit.client.0.smithi045.stdout:9/718: mknod d0/d3/d6/d10/d2c/d63/cdb 0 2024-09-18T12:52:31.159 INFO:tasks.workunit.client.0.smithi045.stdout:5/950: creat d6/f124 x:0 0 0 2024-09-18T12:52:31.160 INFO:tasks.workunit.client.0.smithi045.stdout:8/897: rmdir d11/d14/d53/d41/d75 39 2024-09-18T12:52:31.162 INFO:tasks.workunit.client.0.smithi045.stdout:8/898: chown d11/d20/d46/df9/l103 0 1 2024-09-18T12:52:31.164 INFO:tasks.workunit.client.0.smithi045.stdout:7/816: symlink d13/d44/d37/d6a/l119 0 2024-09-18T12:52:31.168 INFO:tasks.workunit.client.0.smithi045.stdout:9/719: symlink d0/ldc 0 2024-09-18T12:52:31.171 INFO:tasks.workunit.client.0.smithi045.stdout:5/951: unlink d6/db/c24 0 2024-09-18T12:52:31.175 INFO:tasks.workunit.client.0.smithi045.stdout:9/720: fdatasync d0/d3/d6/d64/d77/fbf 0 2024-09-18T12:52:31.175 INFO:tasks.workunit.client.0.smithi045.stdout:7/817: dread d13/d1a/d28/ff3 [0,4194304] 0 2024-09-18T12:52:31.182 INFO:tasks.workunit.client.0.smithi045.stdout:7/818: mknod d13/d44/d4c/d82/c11a 0 2024-09-18T12:52:31.182 INFO:tasks.workunit.client.0.smithi045.stdout:6/756: write d9/d1a/d48/d7d/dcb/fd8 [131239,2745] 0 2024-09-18T12:52:31.186 INFO:tasks.workunit.client.0.smithi045.stdout:5/952: dread d6/db/d19/d92/fbd [0,4194304] 0 2024-09-18T12:52:31.188 INFO:tasks.workunit.client.0.smithi045.stdout:1/959: truncate d0/d2d/d2b/d30/d40/d60/d8f/fb8 986835 0 2024-09-18T12:52:31.192 INFO:tasks.workunit.client.0.smithi045.stdout:9/721: creat d0/d3/d6/d64/d88/dc0/fdd x:0 0 0 2024-09-18T12:52:31.194 INFO:tasks.workunit.client.0.smithi045.stdout:0/873: dwrite d6/d35/d92/f104 [0,4194304] 0 2024-09-18T12:52:31.198 INFO:tasks.workunit.client.0.smithi045.stdout:7/819: unlink d13/d44/c2a 0 2024-09-18T12:52:31.198 INFO:tasks.workunit.client.0.smithi045.stdout:8/899: dwrite d11/f12 [0,4194304] 0 2024-09-18T12:52:31.201 INFO:tasks.workunit.client.0.smithi045.stdout:5/953: dread d6/db/d19/d92/f60 [0,4194304] 0 2024-09-18T12:52:31.204 INFO:tasks.workunit.client.0.smithi045.stdout:6/757: write d9/f68 [1754149,85999] 0 2024-09-18T12:52:31.206 INFO:tasks.workunit.client.0.smithi045.stdout:9/722: creat d0/d3/d6/d10/d2c/d63/fde x:0 0 0 2024-09-18T12:52:31.209 INFO:tasks.workunit.client.0.smithi045.stdout:8/900: dread d11/d20/d46/faf [0,4194304] 0 2024-09-18T12:52:31.211 INFO:tasks.workunit.client.0.smithi045.stdout:8/901: readlink d11/d14/d72/l93 0 2024-09-18T12:52:31.212 INFO:tasks.workunit.client.0.smithi045.stdout:6/758: unlink d9/d1a/d48/d75/d106/ff9 0 2024-09-18T12:52:31.213 INFO:tasks.workunit.client.0.smithi045.stdout:1/960: dwrite d0/f3c [0,4194304] 0 2024-09-18T12:52:31.216 INFO:tasks.workunit.client.0.smithi045.stdout:7/820: creat d13/d31/f11b x:0 0 0 2024-09-18T12:52:31.218 INFO:tasks.workunit.client.0.smithi045.stdout:8/902: mkdir d11/d14/ddc/d10c 0 2024-09-18T12:52:31.220 INFO:tasks.workunit.client.0.smithi045.stdout:9/723: symlink d0/d3/d6/ldf 0 2024-09-18T12:52:31.221 INFO:tasks.workunit.client.0.smithi045.stdout:6/759: rmdir d9/d1a/d2d/d32/db0 39 2024-09-18T12:52:31.222 INFO:tasks.workunit.client.0.smithi045.stdout:0/874: link d6/daa/dee/df9/d73/fda d6/daa/f106 0 2024-09-18T12:52:31.225 INFO:tasks.workunit.client.0.smithi045.stdout:1/961: creat d0/d2d/d2b/d30/d40/d60/d8f/d104/df4/d10a/f12e x:0 0 0 2024-09-18T12:52:31.227 INFO:tasks.workunit.client.0.smithi045.stdout:5/954: creat d6/db/d54/de2/d2b/f125 x:0 0 0 2024-09-18T12:52:31.230 INFO:tasks.workunit.client.0.smithi045.stdout:7/821: creat d13/d31/d52/d81/dca/f11c x:0 0 0 2024-09-18T12:52:31.231 INFO:tasks.workunit.client.0.smithi045.stdout:8/903: write d11/d14/ddc/fe2 [419900,84456] 0 2024-09-18T12:52:31.231 INFO:tasks.workunit.client.0.smithi045.stdout:5/955: dread d6/db/d54/de2/ff4 [0,4194304] 0 2024-09-18T12:52:31.237 INFO:tasks.workunit.client.0.smithi045.stdout:0/875: creat d6/daa/dee/df9/d69/f107 x:0 0 0 2024-09-18T12:52:31.238 INFO:tasks.workunit.client.0.smithi045.stdout:1/962: creat d0/d2d/d2b/d30/d40/d60/d8f/d104/df4/f12f x:0 0 0 2024-09-18T12:52:31.240 INFO:tasks.workunit.client.0.smithi045.stdout:1/963: write d0/d2d/d2b/d30/d40/d60/d8f/d104/df4/f12f [328287,13522] 0 2024-09-18T12:52:31.241 INFO:tasks.workunit.client.0.smithi045.stdout:7/822: dread d13/f61 [0,4194304] 0 2024-09-18T12:52:31.246 INFO:tasks.workunit.client.0.smithi045.stdout:8/904: dread d11/d14/d72/da9/fab [0,4194304] 0 2024-09-18T12:52:31.249 INFO:tasks.workunit.client.0.smithi045.stdout:0/876: creat d6/d48/f108 x:0 0 0 2024-09-18T12:52:31.255 INFO:tasks.workunit.client.0.smithi045.stdout:1/964: symlink d0/d2d/db1/dc6/l130 0 2024-09-18T12:52:31.256 INFO:tasks.workunit.client.0.smithi045.stdout:1/965: fdatasync d0/d2d/d2b/d30/d40/d60/d8f/f70 0 2024-09-18T12:52:31.257 INFO:tasks.workunit.client.0.smithi045.stdout:1/966: dread d0/d2d/d2b/d30/d8b/fda [0,4194304] 0 2024-09-18T12:52:31.260 INFO:tasks.workunit.client.0.smithi045.stdout:6/760: rmdir d9/d56/db3/dd7/dea 0 2024-09-18T12:52:31.299 INFO:tasks.workunit.client.0.smithi045.stdout:0/877: mkdir d6/d35/d92/d109 0 2024-09-18T12:52:31.299 INFO:tasks.workunit.client.0.smithi045.stdout:5/956: rmdir d6/db/d19/d92/d61/da5/dc9/df8 0 2024-09-18T12:52:31.300 INFO:tasks.workunit.client.0.smithi045.stdout:9/724: dwrite d0/d3/d6/d10/d26/d2e/d4e/d76/f8b [0,4194304] 0 2024-09-18T12:52:31.300 INFO:tasks.workunit.client.0.smithi045.stdout:1/967: rename d0/d2d to d0/d12/d32/d67/d6d/d9c/d131 0 2024-09-18T12:52:31.300 INFO:tasks.workunit.client.0.smithi045.stdout:0/878: chown f4 7182 1 2024-09-18T12:52:31.307 INFO:tasks.workunit.client.0.smithi045.stdout:7/823: getdents d13/d31/d33/d64/d78 0 2024-09-18T12:52:31.308 INFO:tasks.workunit.client.0.smithi045.stdout:6/761: write d9/d1a/d2d/d32/db0/fdd [201079,30639] 0 2024-09-18T12:52:31.311 INFO:tasks.workunit.client.0.smithi045.stdout:9/725: symlink d0/d3/d6/d64/d88/le0 0 2024-09-18T12:52:31.311 INFO:tasks.workunit.client.0.smithi045.stdout:5/957: dwrite d6/db/d54/dc2/dfe/f5f [0,4194304] 0 2024-09-18T12:52:31.311 INFO:tasks.workunit.client.0.smithi045.stdout:6/762: chown d9/d56/db3/fb8 704660896 1 2024-09-18T12:52:31.313 INFO:tasks.workunit.client.0.smithi045.stdout:0/879: write d6/d7/d32/f9e [460515,17919] 0 2024-09-18T12:52:31.314 INFO:tasks.workunit.client.0.smithi045.stdout:1/968: mkdir d0/d12/d32/d67/d6d/d9c/d131/d132 0 2024-09-18T12:52:31.315 INFO:tasks.workunit.client.0.smithi045.stdout:7/824: mkdir d13/d31/d52/d11d 0 2024-09-18T12:52:31.318 INFO:tasks.workunit.client.0.smithi045.stdout:6/763: chown d9/d1a/d2d/d38/d5b/f61 0 1 2024-09-18T12:52:31.318 INFO:tasks.workunit.client.0.smithi045.stdout:9/726: symlink d0/d3/d6/d10/d26/da4/le1 0 2024-09-18T12:52:31.319 INFO:tasks.workunit.client.0.smithi045.stdout:6/764: chown d9/f68 12958741 1 2024-09-18T12:52:31.319 INFO:tasks.workunit.client.0.smithi045.stdout:7/825: fdatasync d13/d31/f2d 0 2024-09-18T12:52:31.321 INFO:tasks.workunit.client.0.smithi045.stdout:0/880: mkdir d6/d48/d5e/d39/d58/d86/db9/d10a 0 2024-09-18T12:52:31.322 INFO:tasks.workunit.client.0.smithi045.stdout:1/969: write d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d60/d8f/d104/d12d/f10b [5231280,130534] 0 2024-09-18T12:52:31.324 INFO:tasks.workunit.client.0.smithi045.stdout:5/958: truncate d6/db/d19/d92/d61/f72 7522553 0 2024-09-18T12:52:31.325 INFO:tasks.workunit.client.0.smithi045.stdout:6/765: fdatasync d9/d1a/d48/f53 0 2024-09-18T12:52:31.326 INFO:tasks.workunit.client.0.smithi045.stdout:5/959: write d6/db/d19/d92/d5c/f62 [2402410,113559] 0 2024-09-18T12:52:31.327 INFO:tasks.workunit.client.0.smithi045.stdout:9/727: rename d0/d3/d6/d64/d77/fbd to d0/d3/d6/d64/dc1/fe2 0 2024-09-18T12:52:31.329 INFO:tasks.workunit.client.0.smithi045.stdout:7/826: creat d13/d31/d33/d64/d78/dea/f11e x:0 0 0 2024-09-18T12:52:31.331 INFO:tasks.workunit.client.0.smithi045.stdout:0/881: write d6/d48/d5e/d39/d58/d86/f8f [105916,37081] 0 2024-09-18T12:52:31.333 INFO:tasks.workunit.client.0.smithi045.stdout:1/970: mkdir d0/d12/d32/d67/d6a/d133 0 2024-09-18T12:52:31.336 INFO:tasks.workunit.client.0.smithi045.stdout:5/960: dwrite d6/d3e/fe6 [0,4194304] 0 2024-09-18T12:52:31.338 INFO:tasks.workunit.client.0.smithi045.stdout:1/971: write d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/fa6 [498936,93297] 0 2024-09-18T12:52:31.340 INFO:tasks.workunit.client.0.smithi045.stdout:5/961: chown d6/db/d54/de2/d2b/d51/l9a 26521295 1 2024-09-18T12:52:31.341 INFO:tasks.workunit.client.0.smithi045.stdout:7/827: dwrite d13/d31/d5f/f73 [0,4194304] 0 2024-09-18T12:52:31.341 INFO:tasks.workunit.client.0.smithi045.stdout:6/766: dread - d9/d1a/d2d/ddf/ff0 zero size 2024-09-18T12:52:31.343 INFO:tasks.workunit.client.0.smithi045.stdout:7/828: truncate d13/f10f 472148 0 2024-09-18T12:52:31.348 INFO:tasks.workunit.client.0.smithi045.stdout:5/962: dread d6/db/d19/d92/d5c/f117 [0,4194304] 0 2024-09-18T12:52:31.348 INFO:tasks.workunit.client.0.smithi045.stdout:6/767: write d9/d1a/d2d/d32/db0/ffc [558444,55539] 0 2024-09-18T12:52:31.350 INFO:tasks.workunit.client.0.smithi045.stdout:1/972: mknod d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d61/d116/c134 0 2024-09-18T12:52:31.352 INFO:tasks.workunit.client.0.smithi045.stdout:0/882: fdatasync d6/daa/dee/df9/d69/dd9/fec 0 2024-09-18T12:52:31.354 INFO:tasks.workunit.client.0.smithi045.stdout:6/768: creat d9/d1a/d48/dc1/f107 x:0 0 0 2024-09-18T12:52:31.356 INFO:tasks.workunit.client.0.smithi045.stdout:5/963: dwrite d6/db/d19/fe5 [4194304,4194304] 0 2024-09-18T12:52:31.357 INFO:tasks.workunit.client.0.smithi045.stdout:7/829: symlink d13/d44/d4c/d82/l11f 0 2024-09-18T12:52:31.365 INFO:tasks.workunit.client.0.smithi045.stdout:0/883: chown d6/d48/d5e/d39/d58/d86/db9/lff 161 1 2024-09-18T12:52:31.367 INFO:tasks.workunit.client.0.smithi045.stdout:5/964: creat d6/db/d54/dc2/dfe/d78/d66/de4/f126 x:0 0 0 2024-09-18T12:52:31.368 INFO:tasks.workunit.client.0.smithi045.stdout:1/973: fsync d0/d12/da7/f107 0 2024-09-18T12:52:31.369 INFO:tasks.workunit.client.0.smithi045.stdout:5/965: dread - d6/db/d54/de2/d2b/f125 zero size 2024-09-18T12:52:31.379 INFO:tasks.workunit.client.0.smithi045.stdout:7/830: dwrite d13/d44/d37/d70/f84 [0,4194304] 0 2024-09-18T12:52:31.382 INFO:tasks.workunit.client.0.smithi045.stdout:6/769: creat d9/d56/f108 x:0 0 0 2024-09-18T12:52:31.383 INFO:tasks.workunit.client.0.smithi045.stdout:0/884: unlink d6/d48/d5e/d39/d58/d86/fad 0 2024-09-18T12:52:31.387 INFO:tasks.workunit.client.0.smithi045.stdout:1/974: creat d0/d12/d32/d67/d6d/d9c/d131/f135 x:0 0 0 2024-09-18T12:52:31.393 INFO:tasks.workunit.client.0.smithi045.stdout:6/770: rmdir d9/d56/db3/dd7 0 2024-09-18T12:52:31.395 INFO:tasks.workunit.client.0.smithi045.stdout:1/975: rmdir d0/d12/d32/d67/d6d/d9c/d131/db1 39 2024-09-18T12:52:31.397 INFO:tasks.workunit.client.0.smithi045.stdout:0/885: creat d6/d7/f10b x:0 0 0 2024-09-18T12:52:31.398 INFO:tasks.workunit.client.0.smithi045.stdout:5/966: link d6/db/d54/de2/d2b/d51/d97/cf1 d6/db/d54/de2/c127 0 2024-09-18T12:52:31.399 INFO:tasks.workunit.client.0.smithi045.stdout:5/967: fsync d6/f7 0 2024-09-18T12:52:31.401 INFO:tasks.workunit.client.0.smithi045.stdout:7/831: write d13/d31/d5f/f69 [2501446,51423] 0 2024-09-18T12:52:31.406 INFO:tasks.workunit.client.0.smithi045.stdout:5/968: mknod d6/db/d54/dc2/c128 0 2024-09-18T12:52:31.407 INFO:tasks.workunit.client.0.smithi045.stdout:5/969: readlink d6/db/d19/d92/l57 0 2024-09-18T12:52:31.412 INFO:tasks.workunit.client.0.smithi045.stdout:1/976: getdents d0/d12/d32/d67/d6d/d9c/d131/d132 0 2024-09-18T12:52:31.412 INFO:tasks.workunit.client.0.smithi045.stdout:6/771: dread d9/d1a/d2d/d38/d5b/d67/f79 [0,4194304] 0 2024-09-18T12:52:31.416 INFO:tasks.workunit.client.0.smithi045.stdout:0/886: mkdir d6/d10c 0 2024-09-18T12:52:31.418 INFO:tasks.workunit.client.0.smithi045.stdout:5/970: mknod d6/db/d54/dc2/dfe/c129 0 2024-09-18T12:52:31.421 INFO:tasks.workunit.client.0.smithi045.stdout:7/832: write d13/d31/d33/d64/d78/d90/fb8 [414993,53292] 0 2024-09-18T12:52:31.422 INFO:tasks.workunit.client.0.smithi045.stdout:1/977: rename d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d60/d8f/f129 to d0/d12/d32/d67/d6a/f136 0 2024-09-18T12:52:31.428 INFO:tasks.workunit.client.0.smithi045.stdout:6/772: dwrite d9/d1a/d48/d8f/d98/dab/fe0 [0,4194304] 0 2024-09-18T12:52:31.429 INFO:tasks.workunit.client.0.smithi045.stdout:7/833: mknod d13/d31/d5f/d94/c120 0 2024-09-18T12:52:31.431 INFO:tasks.workunit.client.0.smithi045.stdout:1/978: mkdir d0/d12/d32/d67/d137 0 2024-09-18T12:52:31.433 INFO:tasks.workunit.client.0.smithi045.stdout:1/979: write d0/d12/d32/d67/d6d/d9c/d131/f45 [973202,11609] 0 2024-09-18T12:52:31.437 INFO:tasks.workunit.client.0.smithi045.stdout:5/971: creat d6/db/d54/de2/dcc/f12a x:0 0 0 2024-09-18T12:52:31.439 INFO:tasks.workunit.client.0.smithi045.stdout:7/834: mknod d13/d44/d4c/c121 0 2024-09-18T12:52:31.441 INFO:tasks.workunit.client.0.smithi045.stdout:0/887: mknod d6/d48/d5e/d39/d58/d3b/d65/c10d 0 2024-09-18T12:52:31.442 INFO:tasks.workunit.client.0.smithi045.stdout:5/972: unlink d6/d3e/f9b 0 2024-09-18T12:52:31.444 INFO:tasks.workunit.client.0.smithi045.stdout:1/980: mknod d0/d12/d32/d67/d6d/d9c/d131/d92/c138 0 2024-09-18T12:52:31.446 INFO:tasks.workunit.client.0.smithi045.stdout:5/973: chown d6/db/d54/de2/d2b/d51/d6c/l115 255506792 1 2024-09-18T12:52:31.447 INFO:tasks.workunit.client.0.smithi045.stdout:6/773: link d9/d1a/d2d/d32/f4c d9/d1a/d48/d8f/d98/dab/f109 0 2024-09-18T12:52:31.448 INFO:tasks.workunit.client.0.smithi045.stdout:6/774: chown d9/d1a/d48/d97/f9c 190656 1 2024-09-18T12:52:31.448 INFO:tasks.workunit.client.0.smithi045.stdout:0/888: mknod d6/daa/dee/c10e 0 2024-09-18T12:52:31.449 INFO:tasks.workunit.client.0.smithi045.stdout:7/835: creat d13/d1a/f122 x:0 0 0 2024-09-18T12:52:31.451 INFO:tasks.workunit.client.0.smithi045.stdout:1/981: mkdir d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d139 0 2024-09-18T12:52:31.453 INFO:tasks.workunit.client.0.smithi045.stdout:1/982: chown d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d60/d8f/d104/d12d 154535105 1 2024-09-18T12:52:31.455 INFO:tasks.workunit.client.0.smithi045.stdout:6/775: rename d9/la6 to d9/d1a/d48/dc1/l10a 0 2024-09-18T12:52:31.459 INFO:tasks.workunit.client.0.smithi045.stdout:0/889: truncate d6/daa/dee/df9/d73/fda 887162 0 2024-09-18T12:52:31.462 INFO:tasks.workunit.client.0.smithi045.stdout:1/983: creat d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d61/f13a x:0 0 0 2024-09-18T12:52:31.468 INFO:tasks.workunit.client.0.smithi045.stdout:0/890: truncate d6/d7/d32/f33 718959 0 2024-09-18T12:52:31.468 INFO:tasks.workunit.client.0.smithi045.stdout:5/974: write d6/db/d6a/d77/f63 [203565,32114] 0 2024-09-18T12:52:31.471 INFO:tasks.workunit.client.0.smithi045.stdout:1/984: mkdir d0/d12/d32/d67/d6d/d9c/d131/db1/dc6/d10d/d13b 0 2024-09-18T12:52:31.473 INFO:tasks.workunit.client.0.smithi045.stdout:7/836: write d13/d44/d37/d70/d77/f5c [3836877,23383] 0 2024-09-18T12:52:31.474 INFO:tasks.workunit.client.0.smithi045.stdout:5/975: unlink d6/db/d54/de2/d2b/c9f 0 2024-09-18T12:52:31.478 INFO:tasks.workunit.client.0.smithi045.stdout:0/891: symlink d6/d48/d5e/d39/d58/d3b/d6b/de6/l10f 0 2024-09-18T12:52:31.479 INFO:tasks.workunit.client.0.smithi045.stdout:0/892: read - d6/daa/dee/df9/d69/f107 zero size 2024-09-18T12:52:31.479 INFO:tasks.workunit.client.0.smithi045.stdout:0/893: chown f4 390 1 2024-09-18T12:52:31.486 INFO:tasks.workunit.client.0.smithi045.stdout:5/976: mknod d6/d3e/daa/c12b 0 2024-09-18T12:52:31.487 INFO:tasks.workunit.client.0.smithi045.stdout:5/977: write d6/db/d19/d92/d61/da5/dc9/ffb [991767,29968] 0 2024-09-18T12:52:31.491 INFO:tasks.workunit.client.0.smithi045.stdout:1/985: unlink d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d60/l77 0 2024-09-18T12:52:31.493 INFO:tasks.workunit.client.0.smithi045.stdout:7/837: mkdir d13/d44/d123 0 2024-09-18T12:52:31.495 INFO:tasks.workunit.client.0.smithi045.stdout:0/894: creat d6/d48/d5e/d39/d58/db5/dc8/f110 x:0 0 0 2024-09-18T12:52:31.497 INFO:tasks.workunit.client.0.smithi045.stdout:6/776: mknod d9/d1a/d48/d8f/c10b 0 2024-09-18T12:52:31.499 INFO:tasks.workunit.client.0.smithi045.stdout:7/838: write d13/d44/d37/d6a/fdf [3378730,2761] 0 2024-09-18T12:52:31.499 INFO:tasks.workunit.client.0.smithi045.stdout:7/839: chown d13/d31/d52/d11d 14237 1 2024-09-18T12:52:31.501 INFO:tasks.workunit.client.0.smithi045.stdout:1/986: symlink d0/l13c 0 2024-09-18T12:52:31.506 INFO:tasks.workunit.client.0.smithi045.stdout:7/840: dread d13/d31/d33/d64/d78/dea/dfe/f100 [0,4194304] 0 2024-09-18T12:52:31.506 INFO:tasks.workunit.client.0.smithi045.stdout:6/777: symlink d9/d1a/d2d/d32/db0/ddc/l10c 0 2024-09-18T12:52:31.512 INFO:tasks.workunit.client.0.smithi045.stdout:7/841: symlink d13/d31/d5f/d94/l124 0 2024-09-18T12:52:31.513 INFO:tasks.workunit.client.0.smithi045.stdout:1/987: creat d0/d12/d32/d67/d6d/d9c/d131/d132/f13d x:0 0 0 2024-09-18T12:52:31.514 INFO:tasks.workunit.client.0.smithi045.stdout:0/895: link d6/daa/dee/df9/d73/fda d6/daa/f111 0 2024-09-18T12:52:31.515 INFO:tasks.workunit.client.0.smithi045.stdout:1/988: chown d0/d12/d32/d67/d6d/d9c/d131/d92/fdd 139161214 1 2024-09-18T12:52:31.516 INFO:tasks.workunit.client.0.smithi045.stdout:7/842: dread d13/f8e [0,4194304] 0 2024-09-18T12:52:31.521 INFO:tasks.workunit.client.0.smithi045.stdout:5/978: dwrite d6/db/d54/dc2/dfe/d78/d66/f74 [0,4194304] 0 2024-09-18T12:52:31.521 INFO:tasks.workunit.client.0.smithi045.stdout:1/989: mkdir d0/d12/d32/d67/d6d/ddf/d13e 0 2024-09-18T12:52:31.524 INFO:tasks.workunit.client.0.smithi045.stdout:1/990: write d0/d12/d32/d67/d6d/d9c/d131/f68 [4750216,109037] 0 2024-09-18T12:52:31.525 INFO:tasks.workunit.client.0.smithi045.stdout:6/778: write d9/d74/fa4 [4112914,121622] 0 2024-09-18T12:52:31.527 INFO:tasks.workunit.client.0.smithi045.stdout:1/991: chown d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d61 130678 1 2024-09-18T12:52:31.531 INFO:tasks.workunit.client.0.smithi045.stdout:7/843: symlink d13/d31/d33/d64/d78/dea/dfe/l125 0 2024-09-18T12:52:31.532 INFO:tasks.workunit.client.0.smithi045.stdout:5/979: symlink d6/db/d6a/d77/l12c 0 2024-09-18T12:52:31.537 INFO:tasks.workunit.client.0.smithi045.stdout:7/844: dwrite d13/d44/d37/d6a/fdf [0,4194304] 0 2024-09-18T12:52:31.538 INFO:tasks.workunit.client.0.smithi045.stdout:7/845: chown d13/d31/d33/d64 25105278 1 2024-09-18T12:52:31.539 INFO:tasks.workunit.client.0.smithi045.stdout:1/992: rename d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d60/d8f/f11c to d0/d12/d32/d67/d6d/d9c/d131/d2b/deb/f13f 0 2024-09-18T12:52:31.543 INFO:tasks.workunit.client.0.smithi045.stdout:1/993: chown d0/d12/d32/d67/d6a/fbe 112 1 2024-09-18T12:52:31.548 INFO:tasks.workunit.client.0.smithi045.stdout:0/896: dwrite d6/daa/dee/df9/d73/fda [0,4194304] 0 2024-09-18T12:52:31.548 INFO:tasks.workunit.client.0.smithi045.stdout:7/846: dwrite d13/f10f [0,4194304] 0 2024-09-18T12:52:31.551 INFO:tasks.workunit.client.0.smithi045.stdout:7/847: chown d13/d44/d37/f4d 16368 1 2024-09-18T12:52:31.554 INFO:tasks.workunit.client.0.smithi045.stdout:1/994: truncate d0/d12/d32/d67/d6d/f72 1312820 0 2024-09-18T12:52:31.556 INFO:tasks.workunit.client.0.smithi045.stdout:1/995: write d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d8b/ff3 [870567,118668] 0 2024-09-18T12:52:31.561 INFO:tasks.workunit.client.0.smithi045.stdout:0/897: link d6/d48/d5e/d39/d58/d3b/d65/c10d d6/daa/dee/df9/d69/c112 0 2024-09-18T12:52:31.561 INFO:tasks.workunit.client.0.smithi045.stdout:5/980: write d6/d3e/daa/fb9 [1374500,18779] 0 2024-09-18T12:52:31.563 INFO:tasks.workunit.client.0.smithi045.stdout:1/996: creat d0/d12/d32/d67/d6d/d9c/d131/d92/def/f140 x:0 0 0 2024-09-18T12:52:31.565 INFO:tasks.workunit.client.0.smithi045.stdout:0/898: creat d6/d48/d5e/d39/d58/db5/dc8/f113 x:0 0 0 2024-09-18T12:52:31.565 INFO:tasks.workunit.client.0.smithi045.stdout:5/981: dread d6/db/d19/d92/f25 [0,4194304] 0 2024-09-18T12:52:31.567 INFO:tasks.workunit.client.0.smithi045.stdout:5/982: dread - d6/db/d54/de2/dcc/f12a zero size 2024-09-18T12:52:31.568 INFO:tasks.workunit.client.0.smithi045.stdout:5/983: write d6/db/d19/dbc/f102 [150350,35483] 0 2024-09-18T12:52:31.574 INFO:tasks.workunit.client.0.smithi045.stdout:7/848: dwrite d13/f61 [0,4194304] 0 2024-09-18T12:52:31.580 INFO:tasks.workunit.client.0.smithi045.stdout:0/899: symlink d6/d48/d5e/d39/d58/d3b/d65/d8d/l114 0 2024-09-18T12:52:31.589 INFO:tasks.workunit.client.0.smithi045.stdout:1/997: dwrite d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d8b/d5b/d10e/f123 [0,4194304] 0 2024-09-18T12:52:31.589 INFO:tasks.workunit.client.0.smithi045.stdout:5/984: truncate d6/db/d19/d92/ffd 1734125 0 2024-09-18T12:52:31.591 INFO:tasks.workunit.client.0.smithi045.stdout:1/998: dread - d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d61/f13a zero size 2024-09-18T12:52:31.596 INFO:tasks.workunit.client.0.smithi045.stdout:5/985: fsync d6/db/d19/d92/d5c/f98 0 2024-09-18T12:52:31.597 INFO:tasks.workunit.client.0.smithi045.stdout:7/849: getdents d13/d44/ddb 0 2024-09-18T12:52:31.598 INFO:tasks.workunit.client.0.smithi045.stdout:1/999: creat d0/d12/d32/d67/d6d/d9c/d131/d2b/d30/d40/d61/d116/f141 x:0 0 0 2024-09-18T12:52:31.601 INFO:tasks.workunit.client.0.smithi045.stdout:5/986: read d6/db/d19/d92/d61/da5/fea [646256,30951] 0 2024-09-18T12:52:31.606 INFO:tasks.workunit.client.0.smithi045.stdout:0/900: dwrite d6/d35/f50 [4194304,4194304] 0 2024-09-18T12:52:31.610 INFO:tasks.workunit.client.0.smithi045.stdout:5/987: getdents d6/db/d54/de2/d2b 0 2024-09-18T12:52:31.613 INFO:tasks.workunit.client.0.smithi045.stdout:0/901: read d6/daa/dee/df9/fe2 [35564,98609] 0 2024-09-18T12:52:31.614 INFO:tasks.workunit.client.0.smithi045.stdout:5/988: write d6/db/d19/d92/d61/da5/dc9/ffb [1471592,15353] 0 2024-09-18T12:52:31.622 INFO:tasks.workunit.client.0.smithi045.stdout:5/989: dwrite d6/db/d54/dc2/dfe/d78/d66/de4/f126 [0,4194304] 0 2024-09-18T12:52:31.626 INFO:tasks.workunit.client.0.smithi045.stdout:5/990: mknod d6/db/d19/dbc/ddc/c12d 0 2024-09-18T12:52:31.626 INFO:tasks.workunit.client.0.smithi045.stdout:5/991: fdatasync d6/d3e/f33 0 2024-09-18T12:52:31.628 INFO:tasks.workunit.client.0.smithi045.stdout:0/902: dread d6/f2d [0,4194304] 0 2024-09-18T12:52:31.636 INFO:tasks.workunit.client.0.smithi045.stdout:5/992: write d6/db/d54/de2/f88 [435969,98311] 0 2024-09-18T12:52:31.637 INFO:tasks.workunit.client.0.smithi045.stdout:0/903: write d6/d48/d5e/d39/d58/d3b/fd6 [533986,38261] 0 2024-09-18T12:52:31.640 INFO:tasks.workunit.client.0.smithi045.stdout:5/993: chown d6/db/d19/d92/ffd 13811 1 2024-09-18T12:52:31.642 INFO:tasks.workunit.client.0.smithi045.stdout:0/904: link d6/d48/caf d6/d48/d5e/d39/d58/db5/dc8/c115 0 2024-09-18T12:52:31.649 INFO:tasks.workunit.client.0.smithi045.stdout:0/905: write f4 [2511847,17649] 0 2024-09-18T12:52:31.649 INFO:tasks.workunit.client.0.smithi045.stdout:5/994: dread d6/db/d54/de2/d2b/f4e [0,4194304] 0 2024-09-18T12:52:31.650 INFO:tasks.workunit.client.0.smithi045.stdout:5/995: stat d6/db/d19/dbc/ddc/c12d 0 2024-09-18T12:52:31.651 INFO:tasks.workunit.client.0.smithi045.stdout:0/906: mknod d6/daa/dee/df9/d73/ddc/c116 0 2024-09-18T12:52:31.653 INFO:tasks.workunit.client.0.smithi045.stdout:5/996: creat d6/db/d54/de2/d2b/d51/d6c/f12e x:0 0 0 2024-09-18T12:52:31.653 INFO:tasks.workunit.client.0.smithi045.stdout:0/907: mknod d6/daa/def/c117 0 2024-09-18T12:52:31.657 INFO:tasks.workunit.client.0.smithi045.stdout:0/908: creat d6/d48/d5e/d39/d58/d86/db9/d10a/f118 x:0 0 0 2024-09-18T12:52:31.659 INFO:tasks.workunit.client.0.smithi045.stdout:0/909: readlink d6/l5b 0 2024-09-18T12:52:31.660 INFO:tasks.workunit.client.0.smithi045.stdout:0/910: write f4 [1010359,70194] 0 2024-09-18T12:52:31.664 INFO:tasks.workunit.client.0.smithi045.stdout:0/911: mkdir d6/d35/d92/d109/d119 0 2024-09-18T12:52:31.665 INFO:tasks.workunit.client.0.smithi045.stdout:5/997: truncate d6/db/d54/dc2/dfe/d78/d66/f74 2631010 0 2024-09-18T12:52:31.668 INFO:tasks.workunit.client.0.smithi045.stdout:0/912: rename d6/d48/d5e/d39/d58/d3b/fe8 to d6/d48/d5e/d39/d58/d86/f11a 0 2024-09-18T12:52:31.670 INFO:tasks.workunit.client.0.smithi045.stdout:5/998: rename d6/db/d19/d92/fbd to d6/db/d19/d92/d61/da5/f12f 0 2024-09-18T12:52:31.688 INFO:tasks.workunit.client.0.smithi045.stdout:5/999: write d6/db/d54/de2/d2b/d51/d6c/f71 [231722,11471] 0 2024-09-18T12:52:31.688 INFO:tasks.workunit.client.0.smithi045.stdout:0/913: dwrite d6/d7/f29 [0,4194304] 0 2024-09-18T12:52:31.691 INFO:tasks.workunit.client.0.smithi045.stdout:0/914: fdatasync d6/d48/d5e/d39/d58/d3b/d6b/fac 0 2024-09-18T12:52:31.693 INFO:tasks.workunit.client.0.smithi045.stdout:0/915: write d6/daa/f106 [4894582,17345] 0 2024-09-18T12:52:31.696 INFO:tasks.workunit.client.0.smithi045.stdout:0/916: chown d6/daa/dee/df9/f46 97023901 1 2024-09-18T12:52:31.697 INFO:tasks.workunit.client.0.smithi045.stdout:0/917: mknod d6/d7/d32/d9b/c11b 0 2024-09-18T12:52:31.698 INFO:tasks.workunit.client.0.smithi045.stdout:0/918: chown d6/d7/c10 693933 1 2024-09-18T12:52:31.704 INFO:tasks.workunit.client.0.smithi045.stdout:0/919: write d6/f36 [1389434,87820] 0 2024-09-18T12:52:31.727 INFO:tasks.workunit.client.0.smithi045.stdout:0/920: dread d6/d48/d5e/f24 [0,4194304] 0 2024-09-18T12:52:31.762 INFO:tasks.workunit.client.0.smithi045.stdout:0/921: getdents d6/daa/dee/df9/d73/ddc 0 2024-09-18T12:52:31.764 INFO:tasks.workunit.client.0.smithi045.stdout:0/922: truncate d6/daa/dee/df9/d73/f7f 2152860 0 2024-09-18T12:52:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:31 smithi045 ceph-mon[28315]: pgmap v38: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 74 MiB/s rd, 166 MiB/s wr, 384 op/s 2024-09-18T12:52:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:31 smithi161 ceph-mon[35784]: pgmap v38: 65 pgs: 65 active+clean; 3.6 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 74 MiB/s rd, 166 MiB/s wr, 384 op/s 2024-09-18T12:52:32.302 INFO:tasks.workunit.client.0.smithi045.stdout:2/959: sync 2024-09-18T12:52:32.302 INFO:tasks.workunit.client.0.smithi045.stdout:0/923: sync 2024-09-18T12:52:32.302 INFO:tasks.workunit.client.0.smithi045.stdout:7/850: sync 2024-09-18T12:52:32.302 INFO:tasks.workunit.client.0.smithi045.stdout:8/905: sync 2024-09-18T12:52:32.302 INFO:tasks.workunit.client.0.smithi045.stdout:6/779: sync 2024-09-18T12:52:32.303 INFO:tasks.workunit.client.0.smithi045.stdout:9/728: sync 2024-09-18T12:52:32.303 INFO:tasks.workunit.client.0.smithi045.stdout:3/786: sync 2024-09-18T12:52:32.308 INFO:tasks.workunit.client.0.smithi045.stdout:3/787: dread - d0/d1e/d2c/d3a/d8a/fa4 zero size 2024-09-18T12:52:32.309 INFO:tasks.workunit.client.0.smithi045.stdout:3/788: stat d0/d22/cf7 0 2024-09-18T12:52:32.312 INFO:tasks.workunit.client.0.smithi045.stdout:0/924: mknod d6/d48/d5e/d39/d58/d86/c11c 0 2024-09-18T12:52:32.312 INFO:tasks.workunit.client.0.smithi045.stdout:2/960: dread d5/d5f/da8/d61/dbb/fc0 [0,4194304] 0 2024-09-18T12:52:32.313 INFO:tasks.workunit.client.0.smithi045.stdout:9/729: truncate d0/f4d 1016413 0 2024-09-18T12:52:32.314 INFO:tasks.workunit.client.0.smithi045.stdout:2/961: chown d5/d2c/l2f 7087147 1 2024-09-18T12:52:32.314 INFO:tasks.workunit.client.0.smithi045.stdout:6/780: chown d9/d30/c7c 4 1 2024-09-18T12:52:32.316 INFO:tasks.workunit.client.0.smithi045.stdout:6/781: stat d9/d1a/d2d/f5e 0 2024-09-18T12:52:32.317 INFO:tasks.workunit.client.0.smithi045.stdout:8/906: dwrite d11/d14/f4c [0,4194304] 0 2024-09-18T12:52:32.317 INFO:tasks.workunit.client.0.smithi045.stdout:3/789: rmdir d0/d1e/d2c/d3f 39 2024-09-18T12:52:32.319 INFO:tasks.workunit.client.0.smithi045.stdout:0/925: mkdir d6/daa/db2/d11d 0 2024-09-18T12:52:32.321 INFO:tasks.workunit.client.0.smithi045.stdout:2/962: dwrite d5/d5f/f99 [0,4194304] 0 2024-09-18T12:52:32.323 INFO:tasks.workunit.client.0.smithi045.stdout:7/851: rmdir d13/d31/d52/d81/d110 0 2024-09-18T12:52:32.326 INFO:tasks.workunit.client.0.smithi045.stdout:9/730: dwrite d0/d3/f7 [4194304,4194304] 0 2024-09-18T12:52:32.334 INFO:tasks.workunit.client.0.smithi045.stdout:2/963: rename d5/d2c/d4d/l38 to d5/d2c/dac/d11b/d13c/l13d 0 2024-09-18T12:52:32.337 INFO:tasks.workunit.client.0.smithi045.stdout:0/926: fsync d6/f83 0 2024-09-18T12:52:32.341 INFO:tasks.workunit.client.0.smithi045.stdout:6/782: mkdir d9/d56/d10d 0 2024-09-18T12:52:32.344 INFO:tasks.workunit.client.0.smithi045.stdout:9/731: mknod d0/d3/d6/d10/d26/d2e/d4e/ce3 0 2024-09-18T12:52:32.346 INFO:tasks.workunit.client.0.smithi045.stdout:3/790: creat d0/d29/d5f/f10b x:0 0 0 2024-09-18T12:52:32.347 INFO:tasks.workunit.client.0.smithi045.stdout:3/791: dread - d0/d29/d5f/d73/d87/f106 zero size 2024-09-18T12:52:32.349 INFO:tasks.workunit.client.0.smithi045.stdout:8/907: link d11/d76/da0/da1/ca4 d11/d76/c10d 0 2024-09-18T12:52:32.351 INFO:tasks.workunit.client.0.smithi045.stdout:0/927: dread - d6/d48/fe5 zero size 2024-09-18T12:52:32.351 INFO:tasks.workunit.client.0.smithi045.stdout:7/852: creat d13/d31/d5f/f126 x:0 0 0 2024-09-18T12:52:32.352 INFO:tasks.workunit.client.0.smithi045.stdout:7/853: fdatasync d13/f61 0 2024-09-18T12:52:32.356 INFO:tasks.workunit.client.0.smithi045.stdout:2/964: write d5/d5f/da8/d61/ffc [127684,109439] 0 2024-09-18T12:52:32.358 INFO:tasks.workunit.client.0.smithi045.stdout:3/792: unlink d0/d29/fe3 0 2024-09-18T12:52:32.366 INFO:tasks.workunit.client.0.smithi045.stdout:2/965: unlink d5/d2c/d4d/d76/faf 0 2024-09-18T12:52:32.367 INFO:tasks.workunit.client.0.smithi045.stdout:6/783: dread d9/d1a/f80 [0,4194304] 0 2024-09-18T12:52:32.369 INFO:tasks.workunit.client.0.smithi045.stdout:8/908: mkdir d11/d14/d10e 0 2024-09-18T12:52:32.371 INFO:tasks.workunit.client.0.smithi045.stdout:9/732: creat d0/d3/d6/fe4 x:0 0 0 2024-09-18T12:52:32.373 INFO:tasks.workunit.client.0.smithi045.stdout:7/854: dread d13/d44/d37/d70/d77/d6d/fa2 [0,4194304] 0 2024-09-18T12:52:32.373 INFO:tasks.workunit.client.0.smithi045.stdout:2/966: mkdir d5/d5f/da8/d61/d13e 0 2024-09-18T12:52:32.374 INFO:tasks.workunit.client.0.smithi045.stdout:3/793: creat d0/d1e/d39/da8/dd6/f10c x:0 0 0 2024-09-18T12:52:32.375 INFO:tasks.workunit.client.0.smithi045.stdout:6/784: symlink d9/d1a/d48/d75/l10e 0 2024-09-18T12:52:32.377 INFO:tasks.workunit.client.0.smithi045.stdout:0/928: rename d6/d48/d5e/d39/d58/d3b/d65/d100 to d6/daa/dee/df9/d11e 0 2024-09-18T12:52:32.378 INFO:tasks.workunit.client.0.smithi045.stdout:9/733: mkdir d0/de5 0 2024-09-18T12:52:32.380 INFO:tasks.workunit.client.0.smithi045.stdout:7/855: chown d13/d1a/l3d 5852 1 2024-09-18T12:52:32.380 INFO:tasks.workunit.client.0.smithi045.stdout:2/967: creat d5/d2c/d4d/d76/dd5/f13f x:0 0 0 2024-09-18T12:52:32.385 INFO:tasks.workunit.client.0.smithi045.stdout:3/794: mknod d0/c10d 0 2024-09-18T12:52:32.386 INFO:tasks.workunit.client.0.smithi045.stdout:0/929: dwrite d6/d48/d5e/d39/d58/d66/f101 [0,4194304] 0 2024-09-18T12:52:32.387 INFO:tasks.workunit.client.0.smithi045.stdout:3/795: chown d0/d1e/d39/db7/db1 320303418 1 2024-09-18T12:52:32.387 INFO:tasks.workunit.client.0.smithi045.stdout:7/856: read d13/d1a/f2e [1133605,27425] 0 2024-09-18T12:52:32.388 INFO:tasks.workunit.client.0.smithi045.stdout:6/785: fsync d9/d1a/d2d/f8a 0 2024-09-18T12:52:32.394 INFO:tasks.workunit.client.0.smithi045.stdout:3/796: rmdir d0/d29/d53/dff 39 2024-09-18T12:52:32.401 INFO:tasks.workunit.client.0.smithi045.stdout:6/786: fsync d9/d1a/d48/f6d 0 2024-09-18T12:52:32.401 INFO:tasks.workunit.client.0.smithi045.stdout:8/909: truncate d11/d14/d53/f3e 3003434 0 2024-09-18T12:52:32.403 INFO:tasks.workunit.client.0.smithi045.stdout:8/910: stat d11/d20/d46/df9/l103 0 2024-09-18T12:52:32.405 INFO:tasks.workunit.client.0.smithi045.stdout:0/930: write d6/d35/fbd [166558,21144] 0 2024-09-18T12:52:32.407 INFO:tasks.workunit.client.0.smithi045.stdout:7/857: write d13/d44/d4c/d82/dda/fe3 [461481,33077] 0 2024-09-18T12:52:32.409 INFO:tasks.workunit.client.0.smithi045.stdout:3/797: mknod d0/d29/d5f/c10e 0 2024-09-18T12:52:32.409 INFO:tasks.workunit.client.0.smithi045.stdout:8/911: dread d11/d14/d53/d41/fe5 [0,4194304] 0 2024-09-18T12:52:32.410 INFO:tasks.workunit.client.0.smithi045.stdout:9/734: dwrite d0/d3/d6/d10/d26/d2e/f24 [0,4194304] 0 2024-09-18T12:52:32.410 INFO:tasks.workunit.client.0.smithi045.stdout:7/858: stat d13/d44/d37/d70/d77/d85/f102 0 2024-09-18T12:52:32.411 INFO:tasks.workunit.client.0.smithi045.stdout:6/787: mknod d9/d56/d10d/c10f 0 2024-09-18T12:52:32.412 INFO:tasks.workunit.client.0.smithi045.stdout:8/912: chown d11/d14/d53/d41/f9a 94 1 2024-09-18T12:52:32.413 INFO:tasks.workunit.client.0.smithi045.stdout:3/798: write d0/d1e/d2c/d3a/d45/dbe/fee [3937927,95986] 0 2024-09-18T12:52:32.417 INFO:tasks.workunit.client.0.smithi045.stdout:7/859: mkdir d13/d1a/d106/d127 0 2024-09-18T12:52:32.427 INFO:tasks.workunit.client.0.smithi045.stdout:7/860: creat d13/d31/d33/d64/d78/d90/f128 x:0 0 0 2024-09-18T12:52:32.427 INFO:tasks.workunit.client.0.smithi045.stdout:9/735: write d0/fae [3374802,35289] 0 2024-09-18T12:52:32.430 INFO:tasks.workunit.client.0.smithi045.stdout:3/799: rename d0/d29/d5f/fc7 to d0/d1e/d2c/d3f/d44/d75/f10f 0 2024-09-18T12:52:32.431 INFO:tasks.workunit.client.0.smithi045.stdout:9/736: chown d0/d3/d6/d10/d26/d2e/d6f/da5/dab/lc3 31399 1 2024-09-18T12:52:32.433 INFO:tasks.workunit.client.0.smithi045.stdout:6/788: write d9/d1a/d2d/d38/d5b/fa0 [4160895,32650] 0 2024-09-18T12:52:32.433 INFO:tasks.workunit.client.0.smithi045.stdout:3/800: dread - d0/d22/faf zero size 2024-09-18T12:52:32.436 INFO:tasks.workunit.client.0.smithi045.stdout:0/931: dwrite d6/d48/ffa [0,4194304] 0 2024-09-18T12:52:32.437 INFO:tasks.workunit.client.0.smithi045.stdout:6/789: chown d9/d1a/d48/d7d/dcb/fd8 52727 1 2024-09-18T12:52:32.437 INFO:tasks.workunit.client.0.smithi045.stdout:7/861: symlink d13/d31/d33/d64/l129 0 2024-09-18T12:52:32.438 INFO:tasks.workunit.client.0.smithi045.stdout:6/790: chown d9/d30/f6f 5207220 1 2024-09-18T12:52:32.440 INFO:tasks.workunit.client.0.smithi045.stdout:9/737: unlink d0/d3/d6/d64/d77/fbf 0 2024-09-18T12:52:32.444 INFO:tasks.workunit.client.0.smithi045.stdout:9/738: chown d0/d3/d6/d10/d26/d2e/d4e/d76/d89/cb1 32 1 2024-09-18T12:52:32.444 INFO:tasks.workunit.client.0.smithi045.stdout:8/913: dread d11/d76/fd0 [0,4194304] 0 2024-09-18T12:52:32.446 INFO:tasks.workunit.client.0.smithi045.stdout:6/791: dwrite d9/d74/fa4 [0,4194304] 0 2024-09-18T12:52:32.448 INFO:tasks.workunit.client.0.smithi045.stdout:6/792: dread - d9/d74/ff8 zero size 2024-09-18T12:52:32.450 INFO:tasks.workunit.client.0.smithi045.stdout:6/793: chown d9/d1a/d2d/d38/d5b/d67/c69 3950843 1 2024-09-18T12:52:32.451 INFO:tasks.workunit.client.0.smithi045.stdout:7/862: truncate d13/d44/d37/d70/f9f 583286 0 2024-09-18T12:52:32.452 INFO:tasks.workunit.client.0.smithi045.stdout:3/801: creat d0/d7/de9/f110 x:0 0 0 2024-09-18T12:52:32.452 INFO:tasks.workunit.client.0.smithi045.stdout:9/739: dread d0/d3/f7 [4194304,4194304] 0 2024-09-18T12:52:32.454 INFO:tasks.workunit.client.0.smithi045.stdout:3/802: fsync d0/d1e/d2c/d3a/d45/ffe 0 2024-09-18T12:52:32.454 INFO:tasks.workunit.client.0.smithi045.stdout:9/740: chown d0/d3/d6/d10/d26/c41 60285 1 2024-09-18T12:52:32.456 INFO:tasks.workunit.client.0.smithi045.stdout:7/863: dread d13/d31/d5f/d94/fe2 [0,4194304] 0 2024-09-18T12:52:32.459 INFO:tasks.workunit.client.0.smithi045.stdout:7/864: fsync d13/d44/d4c/f92 0 2024-09-18T12:52:32.460 INFO:tasks.workunit.client.0.smithi045.stdout:0/932: creat d6/daa/dee/df9/f11f x:0 0 0 2024-09-18T12:52:32.463 INFO:tasks.workunit.client.0.smithi045.stdout:8/914: read - d11/d14/d53/d41/d75/fc0 zero size 2024-09-18T12:52:32.464 INFO:tasks.workunit.client.0.smithi045.stdout:9/741: dwrite d0/d3/d6/d9d/fd7 [0,4194304] 0 2024-09-18T12:52:32.466 INFO:tasks.workunit.client.0.smithi045.stdout:3/803: rename d0/d1e/d39/db7/de7/f109 to d0/d1e/d2c/d3a/d8a/f111 0 2024-09-18T12:52:32.467 INFO:tasks.workunit.client.0.smithi045.stdout:8/915: write d11/d14/d53/f6d [2681660,61336] 0 2024-09-18T12:52:32.472 INFO:tasks.workunit.client.0.smithi045.stdout:7/865: symlink d13/d44/d37/d6a/da3/d10a/l12a 0 2024-09-18T12:52:32.474 INFO:tasks.workunit.client.0.smithi045.stdout:7/866: truncate d13/d31/d5f/f10e 810747 0 2024-09-18T12:52:32.476 INFO:tasks.workunit.client.0.smithi045.stdout:9/742: fdatasync d0/d3/d6/f98 0 2024-09-18T12:52:32.483 INFO:tasks.workunit.client.0.smithi045.stdout:6/794: dwrite d9/d56/f8b [0,4194304] 0 2024-09-18T12:52:32.490 INFO:tasks.workunit.client.0.smithi045.stdout:3/804: dread d0/d1e/d2c/d3a/d45/f49 [0,4194304] 0 2024-09-18T12:52:32.490 INFO:tasks.workunit.client.0.smithi045.stdout:7/867: getdents d13/d44/ddb 0 2024-09-18T12:52:32.491 INFO:tasks.workunit.client.0.smithi045.stdout:0/933: write d6/daa/dee/df9/d69/dd9/fec [104116,55121] 0 2024-09-18T12:52:32.493 INFO:tasks.workunit.client.0.smithi045.stdout:6/795: rename d9/d1a/d48/d7d/dcb/de1/l24 to d9/d1a/d48/d8f/d9f/l110 0 2024-09-18T12:52:32.497 INFO:tasks.workunit.client.0.smithi045.stdout:9/743: write d0/d3/d6/d10/d26/d2e/f82 [818587,61193] 0 2024-09-18T12:52:32.498 INFO:tasks.workunit.client.0.smithi045.stdout:3/805: dwrite d0/d29/fa5 [0,4194304] 0 2024-09-18T12:52:32.500 INFO:tasks.workunit.client.0.smithi045.stdout:7/868: mkdir d13/d44/d4c/d82/d12b 0 2024-09-18T12:52:32.501 INFO:tasks.workunit.client.0.smithi045.stdout:3/806: write d0/d1e/d2c/d5c/f60 [4502481,22427] 0 2024-09-18T12:52:32.502 INFO:tasks.workunit.client.0.smithi045.stdout:0/934: symlink d6/de3/l120 0 2024-09-18T12:52:32.503 INFO:tasks.workunit.client.0.smithi045.stdout:9/744: mkdir d0/d3/d6/d64/d77/da9/de6 0 2024-09-18T12:52:32.510 INFO:tasks.workunit.client.0.smithi045.stdout:7/869: mkdir d13/d31/d33/d64/d12c 0 2024-09-18T12:52:32.512 INFO:tasks.workunit.client.0.smithi045.stdout:9/745: symlink d0/d3/d6/d10/d26/d2e/d4e/d76/le7 0 2024-09-18T12:52:32.513 INFO:tasks.workunit.client.0.smithi045.stdout:7/870: chown d13/d31/d33/d64/d78/fa6 1466 1 2024-09-18T12:52:32.513 INFO:tasks.workunit.client.0.smithi045.stdout:6/796: write d9/d1a/d48/d97/f9c [3346524,52713] 0 2024-09-18T12:52:32.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.513+0000 7f3bd0bae640 1 -- 172.21.15.45:0/3430303130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bcc1010f0 msgr2=0x7f3bcc1034e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.513+0000 7f3bd0bae640 1 --2- 172.21.15.45:0/3430303130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bcc1010f0 0x7f3bcc1034e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0097e0 tx=0x7f3bbc02a3f0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.513+0000 7f3bd0bae640 1 -- 172.21.15.45:0/3430303130 shutdown_connections 2024-09-18T12:52:32.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.513+0000 7f3bd0bae640 1 --2- 172.21.15.45:0/3430303130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bcc103a20 0x7f3bcc105e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.513+0000 7f3bd0bae640 1 --2- 172.21.15.45:0/3430303130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bcc1010f0 0x7f3bcc1034e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.513+0000 7f3bd0bae640 1 -- 172.21.15.45:0/3430303130 >> 172.21.15.45:0/3430303130 conn(0x7f3bcc0fb350 msgr2=0x7f3bcc0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:32.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.513+0000 7f3bd0bae640 1 -- 172.21.15.45:0/3430303130 shutdown_connections 2024-09-18T12:52:32.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.513+0000 7f3bd0bae640 1 -- 172.21.15.45:0/3430303130 wait complete. 2024-09-18T12:52:32.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.514+0000 7f3bd0bae640 1 Processor -- start 2024-09-18T12:52:32.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.514+0000 7f3bd0bae640 1 -- start start 2024-09-18T12:52:32.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.515+0000 7f3bd0bae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bcc1010f0 0x7f3bcc197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:32.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.515+0000 7f3bd0bae640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bcc103a20 0x7f3bcc197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:32.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.515+0000 7f3bd0bae640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3bcc109620 con 0x7f3bcc1010f0 2024-09-18T12:52:32.517 INFO:tasks.workunit.client.0.smithi045.stdout:9/746: read d0/fae [2424211,95601] 0 2024-09-18T12:52:32.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.515+0000 7f3bd0bae640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3bcc1094a0 con 0x7f3bcc103a20 2024-09-18T12:52:32.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.515+0000 7f3bc9d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bcc103a20 0x7f3bcc197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:32.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.515+0000 7f3bc9d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bcc103a20 0x7f3bcc197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:53712/0 (socket says 172.21.15.45:53712) 2024-09-18T12:52:32.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.515+0000 7f3bc9d9b640 1 -- 172.21.15.45:0/1081182819 learned_addr learned my addr 172.21.15.45:0/1081182819 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:52:32.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.515+0000 7f3bca59c640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bcc1010f0 0x7f3bcc197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:32.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.516+0000 7f3bc9d9b640 1 -- 172.21.15.45:0/1081182819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bcc1010f0 msgr2=0x7f3bcc197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.516+0000 7f3bc9d9b640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bcc1010f0 0x7f3bcc197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.516+0000 7f3bc9d9b640 1 -- 172.21.15.45:0/1081182819 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bcc1980c0 con 0x7f3bcc103a20 2024-09-18T12:52:32.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.516+0000 7f3bc9d9b640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bcc103a20 0x7f3bcc197a40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000e970 tx=0x7f3bc000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:32.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.516+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/1081182819 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3bc000cac0 con 0x7f3bcc103a20 2024-09-18T12:52:32.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.516+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/1081182819 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3bc00054e0 con 0x7f3bcc103a20 2024-09-18T12:52:32.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.516+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/1081182819 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3bc0004d70 con 0x7f3bcc103a20 2024-09-18T12:52:32.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.516+0000 7f3bd0bae640 1 -- 172.21.15.45:0/1081182819 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bcc103e60 con 0x7f3bcc103a20 2024-09-18T12:52:32.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.516+0000 7f3bd0bae640 1 -- 172.21.15.45:0/1081182819 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bcc1043f0 con 0x7f3bcc103a20 2024-09-18T12:52:32.519 INFO:tasks.workunit.client.0.smithi045.stdout:3/807: dwrite d0/d1e/d2c/d3f/d44/f78 [0,4194304] 0 2024-09-18T12:52:32.520 INFO:tasks.workunit.client.0.smithi045.stdout:6/797: truncate d9/d56/f108 357240 0 2024-09-18T12:52:32.520 INFO:tasks.workunit.client.0.smithi045.stdout:9/747: read - d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/fd4 zero size 2024-09-18T12:52:32.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.518+0000 7f3bd0bae640 1 -- 172.21.15.45:0/1081182819 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bcc1014d0 con 0x7f3bcc103a20 2024-09-18T12:52:32.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.519+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/1081182819 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f3bc0004f90 con 0x7f3bcc103a20 2024-09-18T12:52:32.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.519+0000 7f3bbb7fe640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f3bb4074ad0 0x7f3bb4076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:32.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.520+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/1081182819 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f3bc0096930 con 0x7f3bcc103a20 2024-09-18T12:52:32.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.520+0000 7f3bca59c640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f3bb4074ad0 0x7f3bb4076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:32.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.521+0000 7f3bca59c640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f3bb4074ad0 0x7f3bb4076f90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0097b0 tx=0x7f3bbc030890 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:32.524 INFO:tasks.workunit.client.0.smithi045.stdout:3/808: truncate d0/f1a 964909 0 2024-09-18T12:52:32.525 INFO:tasks.workunit.client.0.smithi045.stdout:3/809: write d0/d29/ff3 [703727,60878] 0 2024-09-18T12:52:32.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.527+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/1081182819 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f3bc0061ea0 con 0x7f3bcc103a20 2024-09-18T12:52:32.532 INFO:tasks.workunit.client.0.smithi045.stdout:3/810: truncate d0/d1e/d2c/d3a/d8a/f9b 377656 0 2024-09-18T12:52:32.533 INFO:tasks.workunit.client.0.smithi045.stdout:3/811: fdatasync d0/d29/f67 0 2024-09-18T12:52:32.537 INFO:tasks.workunit.client.0.smithi045.stdout:7/871: dwrite d13/d44/d37/d70/d77/d6d/f115 [0,4194304] 0 2024-09-18T12:52:32.545 INFO:tasks.workunit.client.0.smithi045.stdout:7/872: read d13/d44/d37/d70/f79 [2984647,15325] 0 2024-09-18T12:52:32.547 INFO:tasks.workunit.client.0.smithi045.stdout:3/812: getdents d0/d1e/d2c/d3a/ddf 0 2024-09-18T12:52:32.549 INFO:tasks.workunit.client.0.smithi045.stdout:7/873: write d13/d31/d33/fcb [3770497,73605] 0 2024-09-18T12:52:32.549 INFO:tasks.workunit.client.0.smithi045.stdout:6/798: dwrite d9/d1a/d2d/d38/f82 [0,4194304] 0 2024-09-18T12:52:32.553 INFO:tasks.workunit.client.0.smithi045.stdout:9/748: dread d0/d3/d6/d10/f1b [0,4194304] 0 2024-09-18T12:52:32.556 INFO:tasks.workunit.client.0.smithi045.stdout:7/874: rmdir d13/d44/d4c/d82 39 2024-09-18T12:52:32.560 INFO:tasks.workunit.client.0.smithi045.stdout:9/749: link d0/d3/d6/d64/d88/dc0/fdd d0/d3/d6/d10/d26/d2e/d6f/fe8 0 2024-09-18T12:52:32.564 INFO:tasks.workunit.client.0.smithi045.stdout:6/799: write d9/d1a/d48/d8f/d98/dab/fe9 [252676,93733] 0 2024-09-18T12:52:32.566 INFO:tasks.workunit.client.0.smithi045.stdout:7/875: write d13/d44/d37/d70/d77/f3c [4506648,44412] 0 2024-09-18T12:52:32.570 INFO:tasks.workunit.client.0.smithi045.stdout:3/813: dwrite d0/d1e/d2c/d3a/d8a/fc8 [0,4194304] 0 2024-09-18T12:52:32.570 INFO:tasks.workunit.client.0.smithi045.stdout:3/814: readlink d0/l31 0 2024-09-18T12:52:32.573 INFO:tasks.workunit.client.0.smithi045.stdout:3/815: write d0/d1e/d2c/d3a/ddf/fe2 [220280,96789] 0 2024-09-18T12:52:32.575 INFO:tasks.workunit.client.0.smithi045.stdout:9/750: write d0/d3/d6/d10/d26/d2e/d4e/f67 [1068850,111274] 0 2024-09-18T12:52:32.581 INFO:tasks.workunit.client.0.smithi045.stdout:3/816: mkdir d0/d1e/d2c/d3a/d45/dbe/dd5/d112 0 2024-09-18T12:52:32.583 INFO:tasks.workunit.client.0.smithi045.stdout:9/751: dwrite d0/f61 [0,4194304] 0 2024-09-18T12:52:32.585 INFO:tasks.workunit.client.0.smithi045.stdout:7/876: creat d13/d44/d37/d70/d77/f12d x:0 0 0 2024-09-18T12:52:32.587 INFO:tasks.workunit.client.0.smithi045.stdout:3/817: creat d0/d1e/d2c/d3a/d8a/df1/f113 x:0 0 0 2024-09-18T12:52:32.589 INFO:tasks.workunit.client.0.smithi045.stdout:7/877: fsync d13/d44/d37/d70/d77/ffd 0 2024-09-18T12:52:32.592 INFO:tasks.workunit.client.0.smithi045.stdout:6/800: dwrite d9/fc [0,4194304] 0 2024-09-18T12:52:32.600 INFO:tasks.workunit.client.0.smithi045.stdout:3/818: mkdir d0/d29/d53/dff/d114 0 2024-09-18T12:52:32.600 INFO:tasks.workunit.client.0.smithi045.stdout:3/819: chown d0/l31 285907 1 2024-09-18T12:52:32.601 INFO:tasks.workunit.client.0.smithi045.stdout:3/820: write d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/ff6 [112294,66275] 0 2024-09-18T12:52:32.602 INFO:tasks.workunit.client.0.smithi045.stdout:7/878: link d13/d31/d33/d64/d78/fa6 d13/d1a/d28/f12e 0 2024-09-18T12:52:32.606 INFO:tasks.workunit.client.0.smithi045.stdout:3/821: creat d0/d29/d53/dff/f115 x:0 0 0 2024-09-18T12:52:32.608 INFO:tasks.workunit.client.0.smithi045.stdout:9/752: dwrite d0/d3/d6/f4f [0,4194304] 0 2024-09-18T12:52:32.614 INFO:tasks.workunit.client.0.smithi045.stdout:9/753: dread d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/fc9 [0,4194304] 0 2024-09-18T12:52:32.618 INFO:tasks.workunit.client.0.smithi045.stdout:9/754: creat d0/d3/d6/d64/d77/da9/de6/fe9 x:0 0 0 2024-09-18T12:52:32.623 INFO:tasks.workunit.client.0.smithi045.stdout:9/755: creat d0/d3/d6/d10/d26/d2e/d4e/db4/fea x:0 0 0 2024-09-18T12:52:32.625 INFO:tasks.workunit.client.0.smithi045.stdout:7/879: dread d13/d44/d37/f8d [0,4194304] 0 2024-09-18T12:52:32.627 INFO:tasks.workunit.client.0.smithi045.stdout:7/880: write d13/d44/d37/d70/f84 [600087,65160] 0 2024-09-18T12:52:32.628 INFO:tasks.workunit.client.0.smithi045.stdout:7/881: read d13/d31/d52/d81/f9d [20155,86878] 0 2024-09-18T12:52:32.629 INFO:tasks.workunit.client.0.smithi045.stdout:9/756: rename d0/fc to d0/d3/d6/d64/d77/dc5/feb 0 2024-09-18T12:52:32.630 INFO:tasks.workunit.client.0.smithi045.stdout:9/757: write d0/f9e [755145,127896] 0 2024-09-18T12:52:32.633 INFO:tasks.workunit.client.0.smithi045.stdout:9/758: chown d0/d3/d6/d10/d26/d2e/d6f/lc7 12105 1 2024-09-18T12:52:32.638 INFO:tasks.workunit.client.0.smithi045.stdout:7/882: dwrite d13/d1a/d28/f104 [0,4194304] 0 2024-09-18T12:52:32.642 INFO:tasks.workunit.client.0.smithi045.stdout:3/822: dwrite d0/d29/d5f/fed [0,4194304] 0 2024-09-18T12:52:32.642 INFO:tasks.workunit.client.0.smithi045.stdout:9/759: truncate d0/d3/d6/d10/d26/d2e/d6f/fe8 199913 0 2024-09-18T12:52:32.645 INFO:tasks.workunit.client.0.smithi045.stdout:3/823: write d0/d1e/d2c/d3f/d44/d75/ffa [796981,104758] 0 2024-09-18T12:52:32.647 INFO:tasks.workunit.client.0.smithi045.stdout:7/883: creat d13/d31/d5f/d94/f12f x:0 0 0 2024-09-18T12:52:32.649 INFO:tasks.workunit.client.0.smithi045.stdout:9/760: readlink d0/d3/d6/d10/d26/d2e/d4e/la2 0 2024-09-18T12:52:32.651 INFO:tasks.workunit.client.0.smithi045.stdout:3/824: mkdir d0/d1e/d2c/d3a/ddf/d116 0 2024-09-18T12:52:32.652 INFO:tasks.workunit.client.0.smithi045.stdout:9/761: read d0/d3/d6/d10/d26/d2e/d4e/d76/fd2 [2473803,90378] 0 2024-09-18T12:52:32.658 INFO:tasks.workunit.client.0.smithi045.stdout:9/762: symlink d0/d3/d6/d10/d26/d2e/d6f/da5/dab/lec 0 2024-09-18T12:52:32.668 INFO:tasks.workunit.client.0.smithi045.stdout:3/825: write d0/d7/fb2 [922975,116052] 0 2024-09-18T12:52:32.672 INFO:tasks.workunit.client.0.smithi045.stdout:3/826: symlink d0/d1e/d2c/d3f/d44/l117 0 2024-09-18T12:52:32.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.827+0000 7f3bd0bae640 1 -- 172.21.15.45:0/1081182819 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3bcc1002b0 con 0x7f3bb4074ad0 2024-09-18T12:52:32.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.829+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/1081182819 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f3bbc04b170 con 0x7f3bb4074ad0 2024-09-18T12:52:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 -- 172.21.15.45:0/1081182819 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f3bb4074ad0 msgr2=0x7f3bb4076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f3bb4074ad0 0x7f3bb4076f90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0097b0 tx=0x7f3bbc030890 comp rx=0 tx=0).stop 2024-09-18T12:52:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 -- 172.21.15.45:0/1081182819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bcc103a20 msgr2=0x7f3bcc197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bcc103a20 0x7f3bcc197a40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000e970 tx=0x7f3bc000ee30 comp rx=0 tx=0).stop 2024-09-18T12:52:32.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 -- 172.21.15.45:0/1081182819 shutdown_connections 2024-09-18T12:52:32.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f3bb4074ad0 0x7f3bb4076f90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bcc103a20 0x7f3bcc197a40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 --2- 172.21.15.45:0/1081182819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bcc1010f0 0x7f3bcc197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 -- 172.21.15.45:0/1081182819 >> 172.21.15.45:0/1081182819 conn(0x7f3bcc0fb350 msgr2=0x7f3bcc0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:32.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 -- 172.21.15.45:0/1081182819 shutdown_connections 2024-09-18T12:52:32.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.831+0000 7f3bd0bae640 1 -- 172.21.15.45:0/1081182819 wait complete. 2024-09-18T12:52:32.845 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:52:32.868 INFO:tasks.workunit.client.0.smithi045.stdout:2/968: sync 2024-09-18T12:52:32.868 INFO:tasks.workunit.client.0.smithi045.stdout:2/969: chown d5/d5f/da8/d61/dbb/cdb 1 1 2024-09-18T12:52:32.872 INFO:tasks.workunit.client.0.smithi045.stdout:2/970: unlink d5/d5f/da8/dde/f104 0 2024-09-18T12:52:32.897 INFO:tasks.workunit.client.0.smithi045.stdout:2/971: dread d5/d46/f86 [0,4194304] 0 2024-09-18T12:52:32.901 INFO:tasks.workunit.client.0.smithi045.stdout:2/972: dread d5/d3a/f132 [0,4194304] 0 2024-09-18T12:52:32.903 INFO:tasks.workunit.client.0.smithi045.stdout:2/973: rmdir d5/d46 39 2024-09-18T12:52:32.903 INFO:tasks.workunit.client.0.smithi045.stdout:2/974: chown d5/d5f/db2/l39 1734 1 2024-09-18T12:52:32.906 INFO:tasks.workunit.client.0.smithi045.stdout:2/975: truncate d5/d2c/d4d/d76/fa7 600778 0 2024-09-18T12:52:32.916 INFO:tasks.workunit.client.0.smithi045.stdout:2/976: write d5/d5f/da8/d61/f96 [273517,42165] 0 2024-09-18T12:52:32.925 INFO:tasks.workunit.client.0.smithi045.stdout:2/977: link d5/d3a/d3e/l4a d5/d3a/d3e/db5/l140 0 2024-09-18T12:52:32.929 INFO:tasks.workunit.client.0.smithi045.stdout:2/978: read d5/d5f/f83 [89363,44157] 0 2024-09-18T12:52:32.932 INFO:tasks.workunit.client.0.smithi045.stdout:2/979: creat d5/d2c/d6f/d9d/f141 x:0 0 0 2024-09-18T12:52:32.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.946+0000 7efd333c4640 1 -- 172.21.15.45:0/2654432984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd2c102490 msgr2=0x7efd2c104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.946+0000 7efd333c4640 1 --2- 172.21.15.45:0/2654432984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd2c102490 0x7efd2c104880 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efd28009880 tx=0x7efd2802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.946+0000 7efd333c4640 1 -- 172.21.15.45:0/2654432984 shutdown_connections 2024-09-18T12:52:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.946+0000 7efd333c4640 1 --2- 172.21.15.45:0/2654432984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd2c104dc0 0x7efd2c1071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.946+0000 7efd333c4640 1 --2- 172.21.15.45:0/2654432984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd2c102490 0x7efd2c104880 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.946+0000 7efd333c4640 1 -- 172.21.15.45:0/2654432984 >> 172.21.15.45:0/2654432984 conn(0x7efd2c0fc010 msgr2=0x7efd2c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.946+0000 7efd333c4640 1 -- 172.21.15.45:0/2654432984 shutdown_connections 2024-09-18T12:52:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.946+0000 7efd333c4640 1 -- 172.21.15.45:0/2654432984 wait complete. 2024-09-18T12:52:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.947+0000 7efd333c4640 1 Processor -- start 2024-09-18T12:52:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.947+0000 7efd333c4640 1 -- start start 2024-09-18T12:52:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.947+0000 7efd333c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd2c102490 0x7efd2c101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.947+0000 7efd333c4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd2c104dc0 0x7efd2c100440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd31160640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd2c102490 0x7efd2c101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd31160640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd2c102490 0x7efd2c101d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39786/0 (socket says 172.21.15.45:39786) 2024-09-18T12:52:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd31160640 1 -- 172.21.15.45:0/1308317564 learned_addr learned my addr 172.21.15.45:0/1308317564 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:52:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd3095f640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd2c104dc0 0x7efd2c100440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c10a7d0 con 0x7efd2c102490 2024-09-18T12:52:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c10a650 con 0x7efd2c104dc0 2024-09-18T12:52:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd31160640 1 -- 172.21.15.45:0/1308317564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd2c104dc0 msgr2=0x7efd2c100440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd31160640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd2c104dc0 0x7efd2c100440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd31160640 1 -- 172.21.15.45:0/1308317564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c19b120 con 0x7efd2c102490 2024-09-18T12:52:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd31160640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd2c102490 0x7efd2c101d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efd28006010 tx=0x7efd28004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.948+0000 7efd227fc640 1 -- 172.21.15.45:0/1308317564 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd2803f070 con 0x7efd2c102490 2024-09-18T12:52:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.949+0000 7efd227fc640 1 -- 172.21.15.45:0/1308317564 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd280049d0 con 0x7efd2c102490 2024-09-18T12:52:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.949+0000 7efd227fc640 1 -- 172.21.15.45:0/1308317564 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd28035030 con 0x7efd2c102490 2024-09-18T12:52:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.949+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c100980 con 0x7efd2c102490 2024-09-18T12:52:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.949+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c100eb0 con 0x7efd2c102490 2024-09-18T12:52:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.950+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2c102870 con 0x7efd2c102490 2024-09-18T12:52:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.950+0000 7efd227fc640 1 -- 172.21.15.45:0/1308317564 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7efd28042070 con 0x7efd2c102490 2024-09-18T12:52:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.951+0000 7efd227fc640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7efd18074ab0 0x7efd18076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.951+0000 7efd227fc640 1 -- 172.21.15.45:0/1308317564 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7efd280b6db0 con 0x7efd2c102490 2024-09-18T12:52:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.951+0000 7efd3095f640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7efd18074ab0 0x7efd18076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:32.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.952+0000 7efd3095f640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7efd18074ab0 0x7efd18076f70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd2c101b00 tx=0x7efd1c005f90 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:32.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:32.956+0000 7efd227fc640 1 -- 172.21.15.45:0/1308317564 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7efd280823a0 con 0x7efd2c102490 2024-09-18T12:52:33.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.168+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efd2c105660 con 0x7efd18074ab0 2024-09-18T12:52:33.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.170+0000 7efd227fc640 1 -- 172.21.15.45:0/1308317564 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7efd2c105660 con 0x7efd18074ab0 2024-09-18T12:52:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7efd18074ab0 msgr2=0x7efd18076f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7efd18074ab0 0x7efd18076f70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd2c101b00 tx=0x7efd1c005f90 comp rx=0 tx=0).stop 2024-09-18T12:52:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd2c102490 msgr2=0x7efd2c101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd2c102490 0x7efd2c101d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efd28006010 tx=0x7efd28004570 comp rx=0 tx=0).stop 2024-09-18T12:52:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 shutdown_connections 2024-09-18T12:52:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7efd18074ab0 0x7efd18076f70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd2c104dc0 0x7efd2c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 --2- 172.21.15.45:0/1308317564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd2c102490 0x7efd2c101d80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 >> 172.21.15.45:0/1308317564 conn(0x7efd2c0fc010 msgr2=0x7efd2c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 shutdown_connections 2024-09-18T12:52:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.172+0000 7efd333c4640 1 -- 172.21.15.45:0/1308317564 wait complete. 2024-09-18T12:52:33.236 INFO:tasks.workunit.client.0.smithi045.stdout:8/916: sync 2024-09-18T12:52:33.236 INFO:tasks.workunit.client.0.smithi045.stdout:6/801: sync 2024-09-18T12:52:33.238 INFO:tasks.workunit.client.0.smithi045.stdout:6/802: write d9/f68 [2020564,35932] 0 2024-09-18T12:52:33.238 INFO:tasks.workunit.client.0.smithi045.stdout:8/917: mkdir d11/d76/da0/da1/d10f 0 2024-09-18T12:52:33.242 INFO:tasks.workunit.client.0.smithi045.stdout:6/803: readlink d9/l27 0 2024-09-18T12:52:33.243 INFO:tasks.workunit.client.0.smithi045.stdout:6/804: write d9/d56/fd3 [16180,12786] 0 2024-09-18T12:52:33.249 INFO:tasks.workunit.client.0.smithi045.stdout:8/918: dread d11/d20/d60/dc3/d98/fb8 [0,4194304] 0 2024-09-18T12:52:33.252 INFO:tasks.workunit.client.0.smithi045.stdout:8/919: fsync d11/d14/f36 0 2024-09-18T12:52:33.254 INFO:tasks.workunit.client.0.smithi045.stdout:6/805: write d9/d1a/d48/d7d/f99 [330037,9465] 0 2024-09-18T12:52:33.259 INFO:tasks.workunit.client.0.smithi045.stdout:8/920: dwrite d11/d20/d60/dc3/f4a [0,4194304] 0 2024-09-18T12:52:33.263 INFO:tasks.workunit.client.0.smithi045.stdout:8/921: creat d11/d76/da0/da1/f110 x:0 0 0 2024-09-18T12:52:33.269 INFO:tasks.workunit.client.0.smithi045.stdout:8/922: mkdir d11/d14/d72/da9/d111 0 2024-09-18T12:52:33.271 INFO:tasks.workunit.client.0.smithi045.stdout:6/806: dwrite d9/d1a/d2d/d38/d5b/d67/f79 [4194304,4194304] 0 2024-09-18T12:52:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.272+0000 7f70a74f2640 1 -- 172.21.15.45:0/3324113411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a010a300 msgr2=0x7f70a010a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.272+0000 7f70a74f2640 1 --2- 172.21.15.45:0/3324113411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a010a300 0x7f70a010a780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7090009880 tx=0x7f709002a4b0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.273+0000 7f70a74f2640 1 -- 172.21.15.45:0/3324113411 shutdown_connections 2024-09-18T12:52:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.273+0000 7f70a74f2640 1 --2- 172.21.15.45:0/3324113411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a010a300 0x7f70a010a780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.273+0000 7f70a74f2640 1 --2- 172.21.15.45:0/3324113411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70a0073220 0x7f70a0073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.273+0000 7f70a74f2640 1 -- 172.21.15.45:0/3324113411 >> 172.21.15.45:0/3324113411 conn(0x7f70a006ea50 msgr2=0x7f70a0070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:33.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.275+0000 7f70a74f2640 1 -- 172.21.15.45:0/3324113411 shutdown_connections 2024-09-18T12:52:33.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.276+0000 7f70a74f2640 1 -- 172.21.15.45:0/3324113411 wait complete. 2024-09-18T12:52:33.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.276+0000 7f70a74f2640 1 Processor -- start 2024-09-18T12:52:33.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.277+0000 7f70a74f2640 1 -- start start 2024-09-18T12:52:33.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.277+0000 7f70a74f2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a0073220 0x7f70a01a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:33.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.277+0000 7f70a74f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70a010a300 0x7f70a01a6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:33.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.277+0000 7f70a74f2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0109c00 con 0x7f70a010a300 2024-09-18T12:52:33.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.277+0000 7f70a74f2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0109a80 con 0x7f70a0073220 2024-09-18T12:52:33.279 INFO:tasks.workunit.client.0.smithi045.stdout:6/807: dwrite d9/d1a/d48/d97/f9c [0,4194304] 0 2024-09-18T12:52:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.278+0000 7f70a4a8d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70a010a300 0x7f70a01a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.278+0000 7f70a4a8d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70a010a300 0x7f70a01a6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39804/0 (socket says 172.21.15.45:39804) 2024-09-18T12:52:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.278+0000 7f70a4a8d640 1 -- 172.21.15.45:0/3526702133 learned_addr learned my addr 172.21.15.45:0/3526702133 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:52:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.278+0000 7f70a528e640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a0073220 0x7f70a01a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.278+0000 7f70a4a8d640 1 -- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a0073220 msgr2=0x7f70a01a6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.278+0000 7f70a4a8d640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a0073220 0x7f70a01a6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.278+0000 7f70a4a8d640 1 -- 172.21.15.45:0/3526702133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a01a6ed0 con 0x7f70a010a300 2024-09-18T12:52:33.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.279+0000 7f70a528e640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a0073220 0x7f70a01a6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:52:33.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.279+0000 7f70a4a8d640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70a010a300 0x7f70a01a6850 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7090009230 tx=0x7f70900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:33.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.280+0000 7f70967fc640 1 -- 172.21.15.45:0/3526702133 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f709003f070 con 0x7f70a010a300 2024-09-18T12:52:33.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.280+0000 7f70967fc640 1 -- 172.21.15.45:0/3526702133 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70900049d0 con 0x7f70a010a300 2024-09-18T12:52:33.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.280+0000 7f70967fc640 1 -- 172.21.15.45:0/3526702133 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7090035030 con 0x7f70a010a300 2024-09-18T12:52:33.282 INFO:tasks.workunit.client.0.smithi045.stdout:8/923: write d11/d20/d46/faf [924644,51347] 0 2024-09-18T12:52:33.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.281+0000 7f70a74f2640 1 -- 172.21.15.45:0/3526702133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a019cb40 con 0x7f70a010a300 2024-09-18T12:52:33.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.281+0000 7f70a74f2640 1 -- 172.21.15.45:0/3526702133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a019d0a0 con 0x7f70a010a300 2024-09-18T12:52:33.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.283+0000 7f70a74f2640 1 -- 172.21.15.45:0/3526702133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a0073620 con 0x7f70a010a300 2024-09-18T12:52:33.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.284+0000 7f70967fc640 1 -- 172.21.15.45:0/3526702133 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f7090042070 con 0x7f70a010a300 2024-09-18T12:52:33.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.285+0000 7f70967fc640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f708c074ad0 0x7f708c076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:33.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.285+0000 7f70967fc640 1 -- 172.21.15.45:0/3526702133 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f70900b6b60 con 0x7f70a010a300 2024-09-18T12:52:33.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.287+0000 7f70a528e640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f708c074ad0 0x7f708c076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:33.289 INFO:tasks.workunit.client.0.smithi045.stdout:8/924: unlink d11/d14/f1e 0 2024-09-18T12:52:33.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.288+0000 7f70a528e640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f708c074ad0 0x7f708c076f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f709c009b50 tx=0x7f709c005f90 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:33.292 INFO:tasks.workunit.client.0.smithi045.stdout:8/925: mkdir d11/d20/d112 0 2024-09-18T12:52:33.294 INFO:tasks.workunit.client.0.smithi045.stdout:8/926: symlink d11/d8c/l113 0 2024-09-18T12:52:33.294 INFO:tasks.workunit.client.0.smithi045.stdout:6/808: link d9/l14 d9/d1a/d48/d75/dc7/de6/l111 0 2024-09-18T12:52:33.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.295+0000 7f70967fc640 1 -- 172.21.15.45:0/3526702133 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f70900820d0 con 0x7f70a010a300 2024-09-18T12:52:33.304 INFO:tasks.workunit.client.0.smithi045.stdout:6/809: link d9/d1a/d2d/d32/l54 d9/d1a/d48/d75/dc7/l112 0 2024-09-18T12:52:33.305 INFO:tasks.workunit.client.0.smithi045.stdout:6/810: fdatasync d9/d1a/d48/d8f/d98/fff 0 2024-09-18T12:52:33.308 INFO:tasks.workunit.client.0.smithi045.stdout:6/811: rmdir d9/d1a/d2d/d38/d5b 39 2024-09-18T12:52:33.312 INFO:tasks.workunit.client.0.smithi045.stdout:6/812: dread d9/d1a/d2d/d38/fe5 [0,4194304] 0 2024-09-18T12:52:33.314 INFO:tasks.workunit.client.0.smithi045.stdout:8/927: dread d11/d14/d53/f6d [0,4194304] 0 2024-09-18T12:52:33.316 INFO:tasks.workunit.client.0.smithi045.stdout:6/813: mknod d9/d1a/d48/d8f/d9f/c113 0 2024-09-18T12:52:33.319 INFO:tasks.workunit.client.0.smithi045.stdout:8/928: rename d11/d14/dd7 to d11/d14/d72/d114 0 2024-09-18T12:52:33.322 INFO:tasks.workunit.client.0.smithi045.stdout:8/929: creat d11/d76/f115 x:0 0 0 2024-09-18T12:52:33.323 INFO:tasks.workunit.client.0.smithi045.stdout:6/814: dwrite d9/d1a/d2d/d32/db0/ffc [0,4194304] 0 2024-09-18T12:52:33.327 INFO:tasks.workunit.client.0.smithi045.stdout:0/935: sync 2024-09-18T12:52:33.330 INFO:tasks.workunit.client.0.smithi045.stdout:6/815: mkdir d9/d74/d114 0 2024-09-18T12:52:33.337 INFO:tasks.workunit.client.0.smithi045.stdout:8/930: rename d11/d8c/lce to d11/d20/d60/dc3/d98/de6/l116 0 2024-09-18T12:52:33.339 INFO:tasks.workunit.client.0.smithi045.stdout:6/816: getdents d9/d1a/d48/d7d/dcb 0 2024-09-18T12:52:33.342 INFO:tasks.workunit.client.0.smithi045.stdout:8/931: mkdir d11/d76/da0/da1/d117 0 2024-09-18T12:52:33.344 INFO:tasks.workunit.client.0.smithi045.stdout:0/936: write d6/d48/d5e/d39/d58/fe7 [381378,98002] 0 2024-09-18T12:52:33.348 INFO:tasks.workunit.client.0.smithi045.stdout:0/937: symlink d6/d35/d92/l121 0 2024-09-18T12:52:33.349 INFO:tasks.workunit.client.0.smithi045.stdout:8/932: dwrite d11/d76/fa2 [0,4194304] 0 2024-09-18T12:52:33.353 INFO:tasks.workunit.client.0.smithi045.stdout:8/933: creat d11/d76/da0/da1/f118 x:0 0 0 2024-09-18T12:52:33.357 INFO:tasks.workunit.client.0.smithi045.stdout:6/817: dwrite d9/d1a/d48/d97/fa8 [0,4194304] 0 2024-09-18T12:52:33.357 INFO:tasks.workunit.client.0.smithi045.stdout:8/934: symlink d11/d20/d60/dc3/dbd/dd5/l119 0 2024-09-18T12:52:33.362 INFO:tasks.workunit.client.0.smithi045.stdout:0/938: truncate d6/daa/f106 4533074 0 2024-09-18T12:52:33.368 INFO:tasks.workunit.client.0.smithi045.stdout:0/939: mkdir d6/d48/d5e/d39/d58/d3b/d122 0 2024-09-18T12:52:33.369 INFO:tasks.workunit.client.0.smithi045.stdout:8/935: getdents d11/d20/d46 0 2024-09-18T12:52:33.370 INFO:tasks.workunit.client.0.smithi045.stdout:6/818: write d9/d1a/d48/d7d/dcb/de1/f4e [3355792,101238] 0 2024-09-18T12:52:33.373 INFO:tasks.workunit.client.0.smithi045.stdout:0/940: dread d6/d7/f29 [0,4194304] 0 2024-09-18T12:52:33.377 INFO:tasks.workunit.client.0.smithi045.stdout:0/941: creat d6/d48/d5e/d39/d58/d3b/d6b/de6/f123 x:0 0 0 2024-09-18T12:52:33.380 INFO:tasks.workunit.client.0.smithi045.stdout:8/936: write d11/d14/d53/d41/fed [415671,3315] 0 2024-09-18T12:52:33.381 INFO:tasks.workunit.client.0.smithi045.stdout:6/819: dwrite d9/d1a/d2d/d38/d5b/fa0 [0,4194304] 0 2024-09-18T12:52:33.383 INFO:tasks.workunit.client.0.smithi045.stdout:8/937: chown d11/d76/lc8 232 1 2024-09-18T12:52:33.385 INFO:tasks.workunit.client.0.smithi045.stdout:6/820: write d9/d56/f8b [1022617,65377] 0 2024-09-18T12:52:33.386 INFO:tasks.workunit.client.0.smithi045.stdout:2/980: sync 2024-09-18T12:52:33.386 INFO:tasks.workunit.client.0.smithi045.stdout:9/763: sync 2024-09-18T12:52:33.386 INFO:tasks.workunit.client.0.smithi045.stdout:7/884: sync 2024-09-18T12:52:33.386 INFO:tasks.workunit.client.0.smithi045.stdout:3/827: sync 2024-09-18T12:52:33.388 INFO:tasks.workunit.client.0.smithi045.stdout:8/938: rename d11/d76/lc8 to d11/d76/l11a 0 2024-09-18T12:52:33.391 INFO:tasks.workunit.client.0.smithi045.stdout:8/939: stat d11/d20/d60/dc3/f4a 0 2024-09-18T12:52:33.394 INFO:tasks.workunit.client.0.smithi045.stdout:7/885: dwrite d13/d44/f80 [0,4194304] 0 2024-09-18T12:52:33.397 INFO:tasks.workunit.client.0.smithi045.stdout:3/828: creat d0/d1e/d39/db7/db1/f118 x:0 0 0 2024-09-18T12:52:33.398 INFO:tasks.workunit.client.0.smithi045.stdout:9/764: mknod d0/d3/d6/d10/d26/d2e/d6f/da5/ced 0 2024-09-18T12:52:33.402 INFO:tasks.workunit.client.0.smithi045.stdout:7/886: truncate d13/d31/d33/fed 7313998 0 2024-09-18T12:52:33.403 INFO:tasks.workunit.client.0.smithi045.stdout:3/829: chown d0/d1e/d2c/d3a/d45/f92 1681892205 1 2024-09-18T12:52:33.404 INFO:tasks.workunit.client.0.smithi045.stdout:9/765: mknod d0/d3/d6/d64/d88/cee 0 2024-09-18T12:52:33.408 INFO:tasks.workunit.client.0.smithi045.stdout:3/830: mkdir d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/d119 0 2024-09-18T12:52:33.408 INFO:tasks.workunit.client.0.smithi045.stdout:3/831: stat d0/d1e/d2c/dd4 0 2024-09-18T12:52:33.411 INFO:tasks.workunit.client.0.smithi045.stdout:8/940: getdents d11/d14/d53/d41 0 2024-09-18T12:52:33.412 INFO:tasks.workunit.client.0.smithi045.stdout:0/942: dread d6/d48/d5e/d39/d58/fd4 [0,4194304] 0 2024-09-18T12:52:33.413 INFO:tasks.workunit.client.0.smithi045.stdout:9/766: creat d0/d3/d6/d64/d88/dc0/fef x:0 0 0 2024-09-18T12:52:33.414 INFO:tasks.workunit.client.0.smithi045.stdout:0/943: truncate d6/daa/dee/df9/ff4 614789 0 2024-09-18T12:52:33.415 INFO:tasks.workunit.client.0.smithi045.stdout:3/832: mkdir d0/d1e/d39/db7/db1/d11a 0 2024-09-18T12:52:33.417 INFO:tasks.workunit.client.0.smithi045.stdout:3/833: write d0/d29/fa5 [4708034,100199] 0 2024-09-18T12:52:33.423 INFO:tasks.workunit.client.0.smithi045.stdout:6/821: dread d9/d1a/d2d/d38/d5b/fb5 [0,4194304] 0 2024-09-18T12:52:33.424 INFO:tasks.workunit.client.0.smithi045.stdout:2/981: truncate d5/d5f/f99 2493329 0 2024-09-18T12:52:33.428 INFO:tasks.workunit.client.0.smithi045.stdout:3/834: dwrite d0/d29/d53/fe0 [8388608,4194304] 0 2024-09-18T12:52:33.430 INFO:tasks.workunit.client.0.smithi045.stdout:6/822: mknod d9/d1a/d48/d75/d106/c115 0 2024-09-18T12:52:33.435 INFO:tasks.workunit.client.0.smithi045.stdout:2/982: symlink d5/d2c/d4d/d76/d93/l142 0 2024-09-18T12:52:33.436 INFO:tasks.workunit.client.0.smithi045.stdout:8/941: dread d11/f17 [0,4194304] 0 2024-09-18T12:52:33.436 INFO:tasks.workunit.client.0.smithi045.stdout:7/887: dwrite d13/d31/d5f/d94/f117 [0,4194304] 0 2024-09-18T12:52:33.441 INFO:tasks.workunit.client.0.smithi045.stdout:6/823: mkdir d9/d1a/d48/d116 0 2024-09-18T12:52:33.441 INFO:tasks.workunit.client.0.smithi045.stdout:7/888: read d13/d44/f2b [1888096,65586] 0 2024-09-18T12:52:33.445 INFO:tasks.workunit.client.0.smithi045.stdout:8/942: fdatasync d11/d14/ddc/ffb 0 2024-09-18T12:52:33.448 INFO:tasks.workunit.client.0.smithi045.stdout:0/944: dwrite d6/d48/d5e/d39/d58/d3b/d6b/fac [0,4194304] 0 2024-09-18T12:52:33.448 INFO:tasks.workunit.client.0.smithi045.stdout:7/889: fsync d13/d1a/d28/f39 0 2024-09-18T12:52:33.458 INFO:tasks.workunit.client.0.smithi045.stdout:0/945: dwrite d6/d48/fe5 [0,4194304] 0 2024-09-18T12:52:33.464 INFO:tasks.workunit.client.0.smithi045.stdout:6/824: rename d9/d1a/d48/d8f/d98/fde to d9/d74/d114/f117 0 2024-09-18T12:52:33.465 INFO:tasks.workunit.client.0.smithi045.stdout:6/825: readlink d9/d56/lbe 0 2024-09-18T12:52:33.465 INFO:tasks.workunit.client.0.smithi045.stdout:6/826: readlink d9/l27 0 2024-09-18T12:52:33.465 INFO:tasks.workunit.client.0.smithi045.stdout:0/946: dread d6/d48/d5e/d39/d58/d66/f101 [0,4194304] 0 2024-09-18T12:52:33.467 INFO:tasks.workunit.client.0.smithi045.stdout:3/835: write d0/d1e/d39/db7/db1/fef [944717,35368] 0 2024-09-18T12:52:33.467 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:33 smithi045 ceph-mon[28315]: pgmap v39: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 100 MiB/s rd, 217 MiB/s wr, 532 op/s 2024-09-18T12:52:33.467 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:33 smithi045 ceph-mon[28315]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:33.470 INFO:tasks.workunit.client.0.smithi045.stdout:2/983: write d5/d3a/d6b/fc3 [845025,109112] 0 2024-09-18T12:52:33.518 INFO:tasks.workunit.client.0.smithi045.stdout:2/984: write d5/d2c/ff2 [2381355,81357] 0 2024-09-18T12:52:33.518 INFO:tasks.workunit.client.0.smithi045.stdout:2/985: read - d5/d2c/d6f/d9d/f141 zero size 2024-09-18T12:52:33.519 INFO:tasks.workunit.client.0.smithi045.stdout:2/986: chown d5/d2c/d6f/f122 29856231 1 2024-09-18T12:52:33.519 INFO:tasks.workunit.client.0.smithi045.stdout:6/827: creat d9/d1a/d48/d75/d106/de2/f118 x:0 0 0 2024-09-18T12:52:33.519 INFO:tasks.workunit.client.0.smithi045.stdout:7/890: write d13/d31/d33/d64/d78/fbb [1023132,89907] 0 2024-09-18T12:52:33.519 INFO:tasks.workunit.client.0.smithi045.stdout:7/891: chown d13/d44/d37/cf1 118 1 2024-09-18T12:52:33.519 INFO:tasks.workunit.client.0.smithi045.stdout:3/836: creat d0/d1e/d2c/d3a/d8a/df1/f11b x:0 0 0 2024-09-18T12:52:33.519 INFO:tasks.workunit.client.0.smithi045.stdout:0/947: write d6/d7/f1f [2318,25751] 0 2024-09-18T12:52:33.520 INFO:tasks.workunit.client.0.smithi045.stdout:3/837: read - d0/d1e/d2c/d3f/d44/f93 zero size 2024-09-18T12:52:33.520 INFO:tasks.workunit.client.0.smithi045.stdout:0/948: dwrite d6/daa/dee/df9/f46 [0,4194304] 0 2024-09-18T12:52:33.520 INFO:tasks.workunit.client.0.smithi045.stdout:8/943: rename d11/d20/d60/dc3/d98/fb8 to d11/d20/f11b 0 2024-09-18T12:52:33.520 INFO:tasks.workunit.client.0.smithi045.stdout:2/987: write d5/d2c/d4d/d76/fb3 [1722293,24765] 0 2024-09-18T12:52:33.520 INFO:tasks.workunit.client.0.smithi045.stdout:2/988: stat d5/d5f/da8/ca2 0 2024-09-18T12:52:33.521 INFO:tasks.workunit.client.0.smithi045.stdout:2/989: stat d5/d2c/d4d 0 2024-09-18T12:52:33.521 INFO:tasks.workunit.client.0.smithi045.stdout:7/892: dwrite d13/d1a/f1b [0,4194304] 0 2024-09-18T12:52:33.521 INFO:tasks.workunit.client.0.smithi045.stdout:6/828: write d9/d74/d114/f117 [1941098,99861] 0 2024-09-18T12:52:33.521 INFO:tasks.workunit.client.0.smithi045.stdout:3/838: dread d0/d1e/d2c/f42 [0,4194304] 0 2024-09-18T12:52:33.521 INFO:tasks.workunit.client.0.smithi045.stdout:2/990: symlink d5/d2c/d4d/d76/dd5/l143 0 2024-09-18T12:52:33.522 INFO:tasks.workunit.client.0.smithi045.stdout:0/949: getdents d6/d48/d5e/d39/d58/d3b/d65/d8d 0 2024-09-18T12:52:33.522 INFO:tasks.workunit.client.0.smithi045.stdout:0/950: read d6/d48/ffa [2350530,3346] 0 2024-09-18T12:52:33.522 INFO:tasks.workunit.client.0.smithi045.stdout:2/991: mknod d5/d3a/c144 0 2024-09-18T12:52:33.523 INFO:tasks.workunit.client.0.smithi045.stdout:3/839: rmdir d0/d29/d53/dff/d103 0 2024-09-18T12:52:33.523 INFO:tasks.workunit.client.0.smithi045.stdout:7/893: write d13/d1a/d28/f34 [3750309,17462] 0 2024-09-18T12:52:33.525 INFO:tasks.workunit.client.0.smithi045.stdout:3/840: write d0/d29/d5f/fed [469312,122198] 0 2024-09-18T12:52:33.527 INFO:tasks.workunit.client.0.smithi045.stdout:0/951: dwrite d6/d48/d5e/d39/d58/d3b/d65/ffc [0,4194304] 0 2024-09-18T12:52:33.531 INFO:tasks.workunit.client.0.smithi045.stdout:2/992: creat d5/d5f/da8/d61/dbb/dc6/f145 x:0 0 0 2024-09-18T12:52:33.532 INFO:tasks.workunit.client.0.smithi045.stdout:6/829: dwrite d9/d1a/d48/d8f/f9b [0,4194304] 0 2024-09-18T12:52:33.533 INFO:tasks.workunit.client.0.smithi045.stdout:8/944: dread d11/d14/d53/d41/d75/fbb [0,4194304] 0 2024-09-18T12:52:33.533 INFO:tasks.workunit.client.0.smithi045.stdout:2/993: chown d5/d2c/cb6 0 1 2024-09-18T12:52:33.536 INFO:tasks.workunit.client.0.smithi045.stdout:7/894: truncate d13/d31/d33/fc9 382550 0 2024-09-18T12:52:33.539 INFO:tasks.workunit.client.0.smithi045.stdout:0/952: getdents d6/daa/dee/df9/d73/ddc 0 2024-09-18T12:52:33.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:33 smithi161 ceph-mon[35784]: pgmap v39: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 100 MiB/s rd, 217 MiB/s wr, 532 op/s 2024-09-18T12:52:33.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:33 smithi161 ceph-mon[35784]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:33.542 INFO:tasks.workunit.client.0.smithi045.stdout:3/841: creat d0/d1e/d39/db7/db1/d11a/f11c x:0 0 0 2024-09-18T12:52:33.543 INFO:tasks.workunit.client.0.smithi045.stdout:2/994: creat d5/d5f/da8/d61/dbb/dc6/df1/f146 x:0 0 0 2024-09-18T12:52:33.543 INFO:tasks.workunit.client.0.smithi045.stdout:0/953: truncate d6/d7/f14 4577606 0 2024-09-18T12:52:33.544 INFO:tasks.workunit.client.0.smithi045.stdout:7/895: read d13/d1a/f59 [211232,76548] 0 2024-09-18T12:52:33.546 INFO:tasks.workunit.client.0.smithi045.stdout:7/896: stat d13/d31/d33/fcb 0 2024-09-18T12:52:33.548 INFO:tasks.workunit.client.0.smithi045.stdout:2/995: creat d5/d2c/dac/d11b/dce/f147 x:0 0 0 2024-09-18T12:52:33.549 INFO:tasks.workunit.client.0.smithi045.stdout:3/842: rename d0/d22/l30 to d0/d1e/d2c/d3a/d45/dbe/dcc/l11d 0 2024-09-18T12:52:33.551 INFO:tasks.workunit.client.0.smithi045.stdout:3/843: stat d0/d1e/d2c/f63 0 2024-09-18T12:52:33.552 INFO:tasks.workunit.client.0.smithi045.stdout:7/897: symlink d13/d44/d37/l130 0 2024-09-18T12:52:33.555 INFO:tasks.workunit.client.0.smithi045.stdout:3/844: chown d0/d1e/d2c/d3a/d45/dbe/dcc 379270116 1 2024-09-18T12:52:33.555 INFO:tasks.workunit.client.0.smithi045.stdout:2/996: creat d5/d2c/f148 x:0 0 0 2024-09-18T12:52:33.557 INFO:tasks.workunit.client.0.smithi045.stdout:8/945: dwrite d11/f16 [0,4194304] 0 2024-09-18T12:52:33.558 INFO:tasks.workunit.client.0.smithi045.stdout:3/845: readlink d0/d1e/d2c/d3a/l9d 0 2024-09-18T12:52:33.559 INFO:tasks.workunit.client.0.smithi045.stdout:6/830: dwrite d9/d1a/d48/ff7 [0,4194304] 0 2024-09-18T12:52:33.562 INFO:tasks.workunit.client.0.smithi045.stdout:0/954: rename d6/d35/d92/cc7 to d6/daa/db2/d11d/c124 0 2024-09-18T12:52:33.565 INFO:tasks.workunit.client.0.smithi045.stdout:6/831: symlink d9/d1a/d48/d7d/l119 0 2024-09-18T12:52:33.567 INFO:tasks.workunit.client.0.smithi045.stdout:8/946: creat d11/d76/da0/f11c x:0 0 0 2024-09-18T12:52:33.568 INFO:tasks.workunit.client.0.smithi045.stdout:3/846: dread d0/d1e/d2c/d3f/d44/f78 [0,4194304] 0 2024-09-18T12:52:33.570 INFO:tasks.workunit.client.0.smithi045.stdout:2/997: dwrite d5/d2c/ff2 [0,4194304] 0 2024-09-18T12:52:33.572 INFO:tasks.workunit.client.0.smithi045.stdout:7/898: creat d13/d31/d5f/f131 x:0 0 0 2024-09-18T12:52:33.574 INFO:tasks.workunit.client.0.smithi045.stdout:0/955: readlink d6/l84 0 2024-09-18T12:52:33.582 INFO:tasks.workunit.client.0.smithi045.stdout:3/847: mkdir d0/d1e/d2c/d3a/d8a/df1/d11e 0 2024-09-18T12:52:33.587 INFO:tasks.workunit.client.0.smithi045.stdout:0/956: unlink d6/d48/d5e/d39/d58/d3b/d6b/de6/f123 0 2024-09-18T12:52:33.588 INFO:tasks.workunit.client.0.smithi045.stdout:8/947: symlink d11/d14/d10e/l11d 0 2024-09-18T12:52:33.589 INFO:tasks.workunit.client.0.smithi045.stdout:8/948: write d11/d14/f1b [4364688,8795] 0 2024-09-18T12:52:33.590 INFO:tasks.workunit.client.0.smithi045.stdout:3/848: symlink d0/d29/d53/dff/l11f 0 2024-09-18T12:52:33.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.624+0000 7f70a74f2640 1 -- 172.21.15.45:0/3526702133 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f70a0062630 con 0x7f708c074ad0 2024-09-18T12:52:33.627 INFO:tasks.workunit.client.0.smithi045.stdout:8/949: write d11/d20/d60/da3/fb5 [2727956,28498] 0 2024-09-18T12:52:33.627 INFO:tasks.workunit.client.0.smithi045.stdout:0/957: creat d6/d35/d92/d109/f125 x:0 0 0 2024-09-18T12:52:33.629 INFO:tasks.workunit.client.0.smithi045.stdout:3/849: fsync d0/d29/d5f/d73/d87/f106 0 2024-09-18T12:52:33.630 INFO:tasks.workunit.client.0.smithi045.stdout:2/998: rename d5/d2c/d4d/f8a to d5/f149 0 2024-09-18T12:52:33.630 INFO:tasks.workunit.client.0.smithi045.stdout:0/958: stat d6/d7/fc5 0 2024-09-18T12:52:33.633 INFO:tasks.workunit.client.0.smithi045.stdout:2/999: read - d5/d2c/d4d/d76/dd5/f13f zero size 2024-09-18T12:52:33.634 INFO:tasks.workunit.client.0.smithi045.stdout:3/850: creat d0/d1e/d2c/d3a/d8a/f120 x:0 0 0 2024-09-18T12:52:33.634 INFO:tasks.workunit.client.0.smithi045.stdout:6/832: dwrite d9/d1a/d48/d7d/dcb/de1/f5a [0,4194304] 0 2024-09-18T12:52:33.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.634+0000 7f70967fc640 1 -- 172.21.15.45:0/3526702133 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f70a0062630 con 0x7f708c074ad0 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (7m) 64s ago 8m 26.9M - 0.25.0 c8568f914cd2 de7ae4bc8025 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 starting - - - - 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 starting - - - - 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (8m) 64s ago 8m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (7m) 68s ago 7m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (6m) 64s ago 8m 78.3M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (3m) 64s ago 3m 115M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (3m) 64s ago 3m 127M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (3m) 68s ago 3m 13.8M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:52:33.636 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (3m) 68s ago 3m 12.2M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:9283,8765,8443 running (9m) 64s ago 9m 210M - 19.1.1-330-gc2ddf972 ebb0615149de 84d721f8241b 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (93s) 68s ago 7m 491M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 0fb3c7114540 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (9m) 64s ago 9m 54.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (7m) 68s ago 7m 41.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (8m) 64s ago 8m 17.0M - 1.5.0 0da6a335fe13 39666fd05306 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (7m) 68s ago 7m 16.6M - 1.5.0 0da6a335fe13 ed4fe4d74f39 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (6m) 64s ago 6m 81.5M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (5m) 64s ago 6m 85.3M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (5m) 64s ago 5m 71.4M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (5m) 68s ago 5m 77.4M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (4m) 68s ago 4m 80.0M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (4m) 68s ago 4m 75.4M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:52:33.637 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 starting - - - - 2024-09-18T12:52:33.638 INFO:tasks.workunit.client.0.smithi045.stdout:8/950: rename d11/d76/da0/le3 to d11/d20/d60/l11e 0 2024-09-18T12:52:33.638 INFO:tasks.workunit.client.0.smithi045.stdout:8/951: chown d11/d14/c44 102 1 2024-09-18T12:52:33.638 INFO:tasks.workunit.client.0.smithi045.stdout:0/959: truncate d6/d7/ff 1809750 0 2024-09-18T12:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.637+0000 7f70a74f2640 1 -- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f708c074ad0 msgr2=0x7f708c076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.637+0000 7f70a74f2640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f708c074ad0 0x7f708c076f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f709c009b50 tx=0x7f709c005f90 comp rx=0 tx=0).stop 2024-09-18T12:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.637+0000 7f70a74f2640 1 -- 172.21.15.45:0/3526702133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70a010a300 msgr2=0x7f70a01a6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.637+0000 7f70a74f2640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70a010a300 0x7f70a01a6850 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7090009230 tx=0x7f70900045e0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.637+0000 7f70a74f2640 1 -- 172.21.15.45:0/3526702133 shutdown_connections 2024-09-18T12:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.637+0000 7f70a74f2640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f708c074ad0 0x7f708c076f90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.637+0000 7f70a74f2640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70a010a300 0x7f70a01a6850 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.637+0000 7f70a74f2640 1 --2- 172.21.15.45:0/3526702133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70a0073220 0x7f70a01a6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.637+0000 7f70a74f2640 1 -- 172.21.15.45:0/3526702133 >> 172.21.15.45:0/3526702133 conn(0x7f70a006ea50 msgr2=0x7f70a010b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:33.640 INFO:tasks.workunit.client.0.smithi045.stdout:3/851: unlink d0/d1e/d2c/d3a/d8a/f111 0 2024-09-18T12:52:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.638+0000 7f70a74f2640 1 -- 172.21.15.45:0/3526702133 shutdown_connections 2024-09-18T12:52:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.638+0000 7f70a74f2640 1 -- 172.21.15.45:0/3526702133 wait complete. 2024-09-18T12:52:33.641 INFO:tasks.workunit.client.0.smithi045.stdout:3/852: dread - d0/d1e/d2c/d3a/d45/dbe/dcc/ffb zero size 2024-09-18T12:52:33.644 INFO:tasks.workunit.client.0.smithi045.stdout:8/952: symlink d11/d20/d60/da3/l11f 0 2024-09-18T12:52:33.646 INFO:tasks.workunit.client.0.smithi045.stdout:0/960: mkdir d6/d48/d5e/d39/d58/d86/db9/d10a/d126 0 2024-09-18T12:52:33.648 INFO:tasks.workunit.client.0.smithi045.stdout:0/961: chown d6/d48/d5e/d39/d58/d3b/d65/ffc 7224 1 2024-09-18T12:52:33.653 INFO:tasks.workunit.client.0.smithi045.stdout:0/962: rmdir d6/daa/dee/df9 39 2024-09-18T12:52:33.654 INFO:tasks.workunit.client.0.smithi045.stdout:3/853: dread d0/d29/d5f/f65 [0,4194304] 0 2024-09-18T12:52:33.661 INFO:tasks.workunit.client.0.smithi045.stdout:0/963: dwrite d6/d35/d92/d109/f125 [0,4194304] 0 2024-09-18T12:52:33.668 INFO:tasks.workunit.client.0.smithi045.stdout:3/854: mkdir d0/d121 0 2024-09-18T12:52:33.671 INFO:tasks.workunit.client.0.smithi045.stdout:8/953: link d11/d14/c1f d11/c120 0 2024-09-18T12:52:33.674 INFO:tasks.workunit.client.0.smithi045.stdout:0/964: unlink d6/d48/d5e/c94 0 2024-09-18T12:52:33.675 INFO:tasks.workunit.client.0.smithi045.stdout:6/833: dwrite d9/d1a/d48/f8d [0,4194304] 0 2024-09-18T12:52:33.678 INFO:tasks.workunit.client.0.smithi045.stdout:8/954: mkdir d11/d14/ddc/d121 0 2024-09-18T12:52:33.685 INFO:tasks.workunit.client.0.smithi045.stdout:3/855: symlink d0/d7/l122 0 2024-09-18T12:52:33.685 INFO:tasks.workunit.client.0.smithi045.stdout:6/834: dwrite d9/d56/f108 [0,4194304] 0 2024-09-18T12:52:33.695 INFO:tasks.workunit.client.0.smithi045.stdout:6/835: readlink d9/d30/l9a 0 2024-09-18T12:52:33.698 INFO:tasks.workunit.client.0.smithi045.stdout:8/955: creat d11/d20/d112/f122 x:0 0 0 2024-09-18T12:52:33.699 INFO:tasks.workunit.client.0.smithi045.stdout:3/856: getdents d0/d121 0 2024-09-18T12:52:33.699 INFO:tasks.workunit.client.0.smithi045.stdout:6/836: dread - d9/d1a/d48/d7d/dcb/de1/f84 zero size 2024-09-18T12:52:33.702 INFO:tasks.workunit.client.0.smithi045.stdout:3/857: truncate d0/d1e/d2c/d3a/d8a/df1/f11b 807509 0 2024-09-18T12:52:33.703 INFO:tasks.workunit.client.0.smithi045.stdout:6/837: creat d9/d1a/d48/dc1/f11a x:0 0 0 2024-09-18T12:52:33.703 INFO:tasks.workunit.client.0.smithi045.stdout:8/956: dread d11/d14/d53/d41/d75/fbb [0,4194304] 0 2024-09-18T12:52:33.704 INFO:tasks.workunit.client.0.smithi045.stdout:6/838: chown d9/d1a/d2d/f8a 3 1 2024-09-18T12:52:33.705 INFO:tasks.workunit.client.0.smithi045.stdout:0/965: write d6/d7/d32/f33 [1331982,99869] 0 2024-09-18T12:52:33.708 INFO:tasks.workunit.client.0.smithi045.stdout:8/957: fsync d11/f17 0 2024-09-18T12:52:33.708 INFO:tasks.workunit.client.0.smithi045.stdout:0/966: truncate d6/d48/d5e/d39/d58/d3b/d65/fdf 5029890 0 2024-09-18T12:52:33.713 INFO:tasks.workunit.client.0.smithi045.stdout:0/967: unlink d6/d35/d92/d109/f125 0 2024-09-18T12:52:33.715 INFO:tasks.workunit.client.0.smithi045.stdout:3/858: link d0/d1e/d2c/d3f/d44/c108 d0/d1e/d2c/d3a/ddf/d116/c123 0 2024-09-18T12:52:33.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.761+0000 7f9e04135640 1 -- 172.21.15.45:0/295323851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dfc102470 msgr2=0x7f9dfc104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:33.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.761+0000 7f9e04135640 1 --2- 172.21.15.45:0/295323851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dfc102470 0x7f9dfc104860 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009880 tx=0x7f9df802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.761+0000 7f9e04135640 1 -- 172.21.15.45:0/295323851 shutdown_connections 2024-09-18T12:52:33.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.761+0000 7f9e04135640 1 --2- 172.21.15.45:0/295323851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dfc104da0 0x7f9dfc107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.761+0000 7f9e04135640 1 --2- 172.21.15.45:0/295323851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dfc102470 0x7f9dfc104860 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.761+0000 7f9e04135640 1 -- 172.21.15.45:0/295323851 >> 172.21.15.45:0/295323851 conn(0x7f9dfc0fc010 msgr2=0x7f9dfc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:33.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.761+0000 7f9e04135640 1 -- 172.21.15.45:0/295323851 shutdown_connections 2024-09-18T12:52:33.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.761+0000 7f9e04135640 1 -- 172.21.15.45:0/295323851 wait complete. 2024-09-18T12:52:33.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.761+0000 7f9e04135640 1 Processor -- start 2024-09-18T12:52:33.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e04135640 1 -- start start 2024-09-18T12:52:33.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e04135640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dfc102470 0x7f9dfc197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:33.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e04135640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dfc104da0 0x7f9dfc197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:33.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e04135640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc10a7b0 con 0x7f9dfc102470 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e04135640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc10a630 con 0x7f9dfc104da0 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e01ed1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dfc102470 0x7f9dfc197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e016d0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dfc104da0 0x7f9dfc197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e016d0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dfc104da0 0x7f9dfc197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:53770/0 (socket says 172.21.15.45:53770) 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e016d0640 1 -- 172.21.15.45:0/1640385015 learned_addr learned my addr 172.21.15.45:0/1640385015 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e016d0640 1 -- 172.21.15.45:0/1640385015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dfc102470 msgr2=0x7f9dfc197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e016d0640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dfc102470 0x7f9dfc197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e016d0640 1 -- 172.21.15.45:0/1640385015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc1980c0 con 0x7f9dfc104da0 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.762+0000 7f9e01ed1640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dfc102470 0x7f9dfc197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.763+0000 7f9e016d0640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dfc104da0 0x7f9dfc197a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00e940 tx=0x7f9dec00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.763+0000 7f9df2ffd640 1 -- 172.21.15.45:0/1640385015 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dec00cac0 con 0x7f9dfc104da0 2024-09-18T12:52:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.763+0000 7f9e04135640 1 -- 172.21.15.45:0/1640385015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc19cb00 con 0x7f9dfc104da0 2024-09-18T12:52:33.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.763+0000 7f9df2ffd640 1 -- 172.21.15.45:0/1640385015 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9dec0054e0 con 0x7f9dfc104da0 2024-09-18T12:52:33.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.763+0000 7f9df2ffd640 1 -- 172.21.15.45:0/1640385015 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dec004e40 con 0x7f9dfc104da0 2024-09-18T12:52:33.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.763+0000 7f9e04135640 1 -- 172.21.15.45:0/1640385015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc19d090 con 0x7f9dfc104da0 2024-09-18T12:52:33.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.764+0000 7f9e04135640 1 -- 172.21.15.45:0/1640385015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dfc102850 con 0x7f9dfc104da0 2024-09-18T12:52:33.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.765+0000 7f9df2ffd640 1 -- 172.21.15.45:0/1640385015 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f9dec004fe0 con 0x7f9dfc104da0 2024-09-18T12:52:33.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.765+0000 7f9df2ffd640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f9de8074a30 0x7f9de8076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.766+0000 7f9e01ed1640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f9de8074a30 0x7f9de8076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.766+0000 7f9df2ffd640 1 -- 172.21.15.45:0/1640385015 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f9dec0968e0 con 0x7f9dfc104da0 2024-09-18T12:52:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.766+0000 7f9e01ed1640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f9de8074a30 0x7f9de8076ef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9df8000c00 tx=0x7f9df80058d0 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:33.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:33.770+0000 7f9df2ffd640 1 -- 172.21.15.45:0/1640385015 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f9dec061e70 con 0x7f9dfc104da0 2024-09-18T12:52:33.796 INFO:tasks.workunit.client.0.smithi045.stdout:3/859: stat d0/d7/de9 0 2024-09-18T12:52:33.796 INFO:tasks.workunit.client.0.smithi045.stdout:0/968: read d6/daa/f111 [1799323,129505] 0 2024-09-18T12:52:33.870 INFO:tasks.workunit.client.0.smithi045.stdout:8/958: link d11/d20/d60/f70 d11/d20/d60/dc3/f123 0 2024-09-18T12:52:33.873 INFO:tasks.workunit.client.0.smithi045.stdout:3/860: unlink d0/d29/d53/f7e 0 2024-09-18T12:52:33.875 INFO:tasks.workunit.client.0.smithi045.stdout:0/969: dwrite d6/d7/d32/f33 [0,4194304] 0 2024-09-18T12:52:33.880 INFO:tasks.workunit.client.0.smithi045.stdout:0/970: stat d6/d48/d5e/d39/d58/d3b/d6b/de6/l10f 0 2024-09-18T12:52:33.883 INFO:tasks.workunit.client.0.smithi045.stdout:8/959: rename d11/d14/ddc/fe2 to d11/d14/ddc/f124 0 2024-09-18T12:52:33.888 INFO:tasks.workunit.client.0.smithi045.stdout:3/861: mkdir d0/d1e/d2c/d3a/d45/dbe/dd5/d112/d124 0 2024-09-18T12:52:33.896 INFO:tasks.workunit.client.0.smithi045.stdout:3/862: dwrite d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/ff6 [0,4194304] 0 2024-09-18T12:52:33.901 INFO:tasks.workunit.client.0.smithi045.stdout:0/971: link d6/daa/def/f102 d6/daa/db2/f127 0 2024-09-18T12:52:33.903 INFO:tasks.workunit.client.0.smithi045.stdout:8/960: creat d11/d76/da0/da1/d117/f125 x:0 0 0 2024-09-18T12:52:33.908 INFO:tasks.workunit.client.0.smithi045.stdout:0/972: fsync d6/fdb 0 2024-09-18T12:52:33.911 INFO:tasks.workunit.client.0.smithi045.stdout:8/961: fdatasync d11/d76/da0/f8e 0 2024-09-18T12:52:33.914 INFO:tasks.workunit.client.0.smithi045.stdout:3/863: unlink d0/d1e/d91/l99 0 2024-09-18T12:52:33.919 INFO:tasks.workunit.client.0.smithi045.stdout:0/973: rmdir d6/d48/d5e/d39/d58/d3b/d65 39 2024-09-18T12:52:33.920 INFO:tasks.workunit.client.0.smithi045.stdout:0/974: readlink d6/d48/d5e/le9 0 2024-09-18T12:52:33.923 INFO:tasks.workunit.client.0.smithi045.stdout:3/864: dwrite d0/d1e/d2c/dd4/f107 [0,4194304] 0 2024-09-18T12:52:33.925 INFO:tasks.workunit.client.0.smithi045.stdout:8/962: rmdir d11/d14/d72/da9/dc5 39 2024-09-18T12:52:33.926 INFO:tasks.workunit.client.0.smithi045.stdout:0/975: mknod d6/d35/d92/d109/c128 0 2024-09-18T12:52:33.928 INFO:tasks.workunit.client.0.smithi045.stdout:8/963: dread - d11/d76/ff1 zero size 2024-09-18T12:52:33.930 INFO:tasks.workunit.client.0.smithi045.stdout:3/865: dread d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/ff6 [0,4194304] 0 2024-09-18T12:52:33.942 INFO:tasks.workunit.client.0.smithi045.stdout:9/767: sync 2024-09-18T12:52:33.965 INFO:tasks.workunit.client.0.smithi045.stdout:9/768: creat d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/ff0 x:0 0 0 2024-09-18T12:52:33.967 INFO:tasks.workunit.client.0.smithi045.stdout:3/866: truncate d0/d1e/d39/fdc 2916094 0 2024-09-18T12:52:33.970 INFO:tasks.workunit.client.0.smithi045.stdout:3/867: write d0/d1e/d39/db7/f9f [446519,31684] 0 2024-09-18T12:52:33.973 INFO:tasks.workunit.client.0.smithi045.stdout:9/769: dwrite d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/ff0 [0,4194304] 0 2024-09-18T12:52:33.975 INFO:tasks.workunit.client.0.smithi045.stdout:3/868: mkdir d0/d1e/d2c/d3a/d8a/d125 0 2024-09-18T12:52:33.979 INFO:tasks.workunit.client.0.smithi045.stdout:3/869: creat d0/d1e/d2c/d5c/f126 x:0 0 0 2024-09-18T12:52:33.980 INFO:tasks.workunit.client.0.smithi045.stdout:3/870: dread - d0/d1e/d39/db7/db1/d11a/f11c zero size 2024-09-18T12:52:33.980 INFO:tasks.workunit.client.0.smithi045.stdout:9/770: creat d0/d3/d6/d10/d26/d2e/ff1 x:0 0 0 2024-09-18T12:52:33.983 INFO:tasks.workunit.client.0.smithi045.stdout:9/771: read d0/d3/f2b [1728901,11654] 0 2024-09-18T12:52:33.985 INFO:tasks.workunit.client.0.smithi045.stdout:9/772: creat d0/d3/d6/d10/d2c/d63/ff2 x:0 0 0 2024-09-18T12:52:34.006 INFO:tasks.workunit.client.0.smithi045.stdout:0/976: rename d6/d35/d92 to d6/daa/dee/df9/d73/d129 0 2024-09-18T12:52:34.008 INFO:tasks.workunit.client.0.smithi045.stdout:0/977: mknod d6/d7/d32/c12a 0 2024-09-18T12:52:34.009 INFO:tasks.workunit.client.0.smithi045.stdout:0/978: chown d6/d48/d5e/d39/d58/d3b/cb6 876 1 2024-09-18T12:52:34.011 INFO:tasks.workunit.client.0.smithi045.stdout:0/979: unlink d6/daa/dee/df9/d73/d129/f104 0 2024-09-18T12:52:34.061 INFO:tasks.workunit.client.0.smithi045.stdout:8/964: creat d11/d20/d60/dc3/dbd/f126 x:0 0 0 2024-09-18T12:52:34.063 INFO:tasks.workunit.client.0.smithi045.stdout:8/965: write d11/d76/da0/da1/f118 [461302,102249] 0 2024-09-18T12:52:34.065 INFO:tasks.workunit.client.0.smithi045.stdout:8/966: mkdir d11/d8c/d127 0 2024-09-18T12:52:34.066 INFO:tasks.workunit.client.0.smithi045.stdout:8/967: chown d11/d20/d46/df9/fb6 2025619758 1 2024-09-18T12:52:34.067 INFO:tasks.workunit.client.0.smithi045.stdout:8/968: dread - d11/d76/fd6 zero size 2024-09-18T12:52:34.069 INFO:tasks.workunit.client.0.smithi045.stdout:8/969: rmdir d11/d20/d60/dc3 39 2024-09-18T12:52:34.072 INFO:tasks.workunit.client.0.smithi045.stdout:8/970: mknod d11/d20/d60/dc3/dbd/c128 0 2024-09-18T12:52:34.077 INFO:tasks.workunit.client.0.smithi045.stdout:3/871: dwrite d0/d22/f71 [0,4194304] 0 2024-09-18T12:52:34.082 INFO:tasks.workunit.client.0.smithi045.stdout:3/872: mknod d0/d1e/d91/c127 0 2024-09-18T12:52:34.082 INFO:tasks.workunit.client.0.smithi045.stdout:9/773: dwrite d0/d3/d6/d10/d26/f62 [0,4194304] 0 2024-09-18T12:52:34.084 INFO:tasks.workunit.client.0.smithi045.stdout:8/971: dwrite d11/f16 [0,4194304] 0 2024-09-18T12:52:34.092 INFO:tasks.workunit.client.0.smithi045.stdout:3/873: rename d0/d1e/d2c/d5c/f126 to d0/d1e/d39/da8/dd6/dfc/f128 0 2024-09-18T12:52:34.093 INFO:tasks.workunit.client.0.smithi045.stdout:8/972: mknod d11/d14/d72/da9/c129 0 2024-09-18T12:52:34.095 INFO:tasks.workunit.client.0.smithi045.stdout:7/899: sync 2024-09-18T12:52:34.102 INFO:tasks.workunit.client.0.smithi045.stdout:8/973: dwrite d11/d76/da0/da1/d117/f125 [0,4194304] 0 2024-09-18T12:52:34.106 INFO:tasks.workunit.client.0.smithi045.stdout:0/980: dwrite d6/daa/f106 [0,4194304] 0 2024-09-18T12:52:34.106 INFO:tasks.workunit.client.0.smithi045.stdout:8/974: write fd [2756325,124431] 0 2024-09-18T12:52:34.114 INFO:tasks.workunit.client.0.smithi045.stdout:8/975: unlink d11/d76/fa2 0 2024-09-18T12:52:34.118 INFO:tasks.workunit.client.0.smithi045.stdout:8/976: stat d11/d14/d53/d41/d75/lcd 0 2024-09-18T12:52:34.119 INFO:tasks.workunit.client.0.smithi045.stdout:0/981: dwrite d6/d48/d5e/d39/d58/d3b/d65/f7a [0,4194304] 0 2024-09-18T12:52:34.121 INFO:tasks.workunit.client.0.smithi045.stdout:8/977: creat d11/d20/d46/f12a x:0 0 0 2024-09-18T12:52:34.125 INFO:tasks.workunit.client.0.smithi045.stdout:8/978: fdatasync d11/d14/d72/da9/fab 0 2024-09-18T12:52:34.129 INFO:tasks.workunit.client.0.smithi045.stdout:8/979: creat d11/d14/d72/da9/dc5/d10b/f12b x:0 0 0 2024-09-18T12:52:34.132 INFO:tasks.workunit.client.0.smithi045.stdout:8/980: creat d11/d14/ddc/d10c/f12c x:0 0 0 2024-09-18T12:52:34.133 INFO:tasks.workunit.client.0.smithi045.stdout:7/900: dread d13/d1a/d28/f12e [0,4194304] 0 2024-09-18T12:52:34.133 INFO:tasks.workunit.client.0.smithi045.stdout:8/981: chown d11/d8c/l113 325909 1 2024-09-18T12:52:34.134 INFO:tasks.workunit.client.0.smithi045.stdout:7/901: chown d13/d31/d33/d64/d78/dea/dfe 713387268 1 2024-09-18T12:52:34.136 INFO:tasks.workunit.client.0.smithi045.stdout:7/902: mknod d13/d44/ddb/c132 0 2024-09-18T12:52:34.137 INFO:tasks.workunit.client.0.smithi045.stdout:8/982: dread d11/d14/d72/da9/fb0 [0,4194304] 0 2024-09-18T12:52:34.140 INFO:tasks.workunit.client.0.smithi045.stdout:7/903: dread d13/d44/d37/f8d [0,4194304] 0 2024-09-18T12:52:34.140 INFO:tasks.workunit.client.0.smithi045.stdout:8/983: mkdir d11/d76/da0/da1/d10f/d12d 0 2024-09-18T12:52:34.141 INFO:tasks.workunit.client.0.smithi045.stdout:8/984: stat d11/d14/d53/d41/f7c 0 2024-09-18T12:52:34.142 INFO:tasks.workunit.client.0.smithi045.stdout:8/985: chown d11/d76/fd6 41 1 2024-09-18T12:52:34.143 INFO:tasks.workunit.client.0.smithi045.stdout:8/986: dread - d11/d8c/f91 zero size 2024-09-18T12:52:34.145 INFO:tasks.workunit.client.0.smithi045.stdout:8/987: write d11/d20/d60/dc3/f4a [2244751,92135] 0 2024-09-18T12:52:34.145 INFO:tasks.workunit.client.0.smithi045.stdout:7/904: dread d13/d44/d37/d70/d77/fc8 [0,4194304] 0 2024-09-18T12:52:34.149 INFO:tasks.workunit.client.0.smithi045.stdout:8/988: mknod d11/d20/d60/dc3/dbd/c12e 0 2024-09-18T12:52:34.150 INFO:tasks.workunit.client.0.smithi045.stdout:7/905: symlink d13/d44/d37/d70/d77/d6d/l133 0 2024-09-18T12:52:34.154 INFO:tasks.workunit.client.0.smithi045.stdout:8/989: dread d11/d20/d60/dc3/f123 [0,4194304] 0 2024-09-18T12:52:34.157 INFO:tasks.workunit.client.0.smithi045.stdout:7/906: mkdir d13/d31/d33/d64/d78/d134 0 2024-09-18T12:52:34.158 INFO:tasks.workunit.client.0.smithi045.stdout:9/774: dwrite d0/f5c [0,4194304] 0 2024-09-18T12:52:34.159 INFO:tasks.workunit.client.0.smithi045.stdout:7/907: readlink d13/d31/d52/d81/lfb 0 2024-09-18T12:52:34.161 INFO:tasks.workunit.client.0.smithi045.stdout:9/775: stat d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0 0 2024-09-18T12:52:34.164 INFO:tasks.workunit.client.0.smithi045.stdout:9/776: chown d0/d3/fe 6257393 1 2024-09-18T12:52:34.165 INFO:tasks.workunit.client.0.smithi045.stdout:8/990: creat d11/d20/d60/dc3/f12f x:0 0 0 2024-09-18T12:52:34.169 INFO:tasks.workunit.client.0.smithi045.stdout:8/991: creat d11/d76/f130 x:0 0 0 2024-09-18T12:52:34.170 INFO:tasks.workunit.client.0.smithi045.stdout:8/992: chown d11/d20/d60/dc3/f4a 1 1 2024-09-18T12:52:34.173 INFO:tasks.workunit.client.0.smithi045.stdout:7/908: rename d13/d44/d37/d70/d77/f60 to d13/d44/f135 0 2024-09-18T12:52:34.180 INFO:tasks.workunit.client.0.smithi045.stdout:7/909: rename d13/d31/ccc to d13/d31/d33/d64/d78/d90/c136 0 2024-09-18T12:52:34.182 INFO:tasks.workunit.client.0.smithi045.stdout:0/982: dwrite d6/d48/f6f [0,4194304] 0 2024-09-18T12:52:34.187 INFO:tasks.workunit.client.0.smithi045.stdout:7/910: write d13/d31/d33/d64/d78/fa6 [3117559,85446] 0 2024-09-18T12:52:34.188 INFO:tasks.workunit.client.0.smithi045.stdout:0/983: chown d6/d48/d5e/d39/d58/d3b/d6b/cbb 3 1 2024-09-18T12:52:34.189 INFO:tasks.workunit.client.0.smithi045.stdout:0/984: chown d6/d48/d5e/d39/d58/ca3 19 1 2024-09-18T12:52:34.192 INFO:tasks.workunit.client.0.smithi045.stdout:7/911: write d13/d31/d33/d64/d78/d90/fb9 [2354239,128178] 0 2024-09-18T12:52:34.200 INFO:tasks.workunit.client.0.smithi045.stdout:0/985: getdents d6/d48 0 2024-09-18T12:52:34.201 INFO:tasks.workunit.client.0.smithi045.stdout:7/912: creat d13/d31/d33/d64/f137 x:0 0 0 2024-09-18T12:52:34.205 INFO:tasks.workunit.client.0.smithi045.stdout:0/986: getdents d6/d48/d5e/d39/d58/db5/dc8 0 2024-09-18T12:52:34.206 INFO:tasks.workunit.client.0.smithi045.stdout:0/987: chown d6/d48/d5e/f78 135467 1 2024-09-18T12:52:34.208 INFO:tasks.workunit.client.0.smithi045.stdout:7/913: dwrite d13/d31/f11b [0,4194304] 0 2024-09-18T12:52:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.208+0000 7f9e04135640 1 -- 172.21.15.45:0/1640385015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9dfc19d910 con 0x7f9dfc104da0 2024-09-18T12:52:34.210 INFO:tasks.workunit.client.0.smithi045.stdout:9/777: write d0/d3/d6/d10/d2c/f57 [2746930,105175] 0 2024-09-18T12:52:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.209+0000 7f9df2ffd640 1 -- 172.21.15.45:0/1640385015 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f9dec066d20 con 0x7f9dfc104da0 2024-09-18T12:52:34.210 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:52:34.210 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:52:34.211 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:52:34.212 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13, 2024-09-18T12:52:34.212 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:52:34.212 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:52:34.212 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:52:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 -- 172.21.15.45:0/1640385015 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f9de8074a30 msgr2=0x7f9de8076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f9de8074a30 0x7f9de8076ef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9df8000c00 tx=0x7f9df80058d0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 -- 172.21.15.45:0/1640385015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dfc104da0 msgr2=0x7f9dfc197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dfc104da0 0x7f9dfc197a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00e940 tx=0x7f9dec00ee00 comp rx=0 tx=0).stop 2024-09-18T12:52:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 -- 172.21.15.45:0/1640385015 shutdown_connections 2024-09-18T12:52:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7f9de8074a30 0x7f9de8076ef0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dfc104da0 0x7f9dfc197a40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 --2- 172.21.15.45:0/1640385015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dfc102470 0x7f9dfc197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 -- 172.21.15.45:0/1640385015 >> 172.21.15.45:0/1640385015 conn(0x7f9dfc0fc010 msgr2=0x7f9dfc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 -- 172.21.15.45:0/1640385015 shutdown_connections 2024-09-18T12:52:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.213+0000 7f9e04135640 1 -- 172.21.15.45:0/1640385015 wait complete. 2024-09-18T12:52:34.216 INFO:tasks.workunit.client.0.smithi045.stdout:9/778: truncate d0/d3/d6/d10/f29 3709663 0 2024-09-18T12:52:34.218 INFO:tasks.workunit.client.0.smithi045.stdout:9/779: mkdir d0/d3/d6/d10/d26/d2e/d6f/df3 0 2024-09-18T12:52:34.226 INFO:tasks.workunit.client.0.smithi045.stdout:7/914: dread d13/d44/d37/d70/d77/f5c [0,4194304] 0 2024-09-18T12:52:34.228 INFO:tasks.workunit.client.0.smithi045.stdout:7/915: write d13/d31/f11b [4931893,38034] 0 2024-09-18T12:52:34.232 INFO:tasks.workunit.client.0.smithi045.stdout:9/780: truncate d0/d3/d6/d10/d26/d2e/f48 2989201 0 2024-09-18T12:52:34.234 INFO:tasks.workunit.client.0.smithi045.stdout:9/781: truncate d0/d3/d6/d9d/fd7 4516667 0 2024-09-18T12:52:34.236 INFO:tasks.workunit.client.0.smithi045.stdout:9/782: mkdir d0/d3/d6/d64/d88/dc0/df4 0 2024-09-18T12:52:34.236 INFO:tasks.workunit.client.0.smithi045.stdout:7/916: link d13/d44/f87 d13/d1a/d106/d127/f138 0 2024-09-18T12:52:34.238 INFO:tasks.workunit.client.0.smithi045.stdout:9/783: mknod d0/d3/d6/d10/d2c/cf5 0 2024-09-18T12:52:34.240 INFO:tasks.workunit.client.0.smithi045.stdout:7/917: rename d13/d1a/d28 to d13/d31/d5f/d94/d139 0 2024-09-18T12:52:34.240 INFO:tasks.workunit.client.0.smithi045.stdout:9/784: write d0/d3/d6/d10/d2c/f57 [4935261,76234] 0 2024-09-18T12:52:34.241 INFO:tasks.workunit.client.0.smithi045.stdout:7/918: write d13/d31/d33/d64/f137 [680997,125703] 0 2024-09-18T12:52:34.245 INFO:tasks.workunit.client.0.smithi045.stdout:7/919: rmdir d13/d44/d37/d70/d77/d85 39 2024-09-18T12:52:34.248 INFO:tasks.workunit.client.0.smithi045.stdout:9/785: dwrite d0/d3/d6/d10/d26/d2e/f24 [4194304,4194304] 0 2024-09-18T12:52:34.253 INFO:tasks.workunit.client.0.smithi045.stdout:9/786: creat d0/d3/d6/d10/d26/ff6 x:0 0 0 2024-09-18T12:52:34.258 INFO:tasks.workunit.client.0.smithi045.stdout:9/787: mkdir d0/d3/d6/d10/df7 0 2024-09-18T12:52:34.259 INFO:tasks.workunit.client.0.smithi045.stdout:9/788: write d0/d3/d6/fb7 [7516582,123651] 0 2024-09-18T12:52:34.264 INFO:tasks.workunit.client.0.smithi045.stdout:7/920: dread d13/d31/d33/fcb [0,4194304] 0 2024-09-18T12:52:34.264 INFO:tasks.workunit.client.0.smithi045.stdout:9/789: unlink d0/d3/d6/d10/d26/d2e/d4e/c93 0 2024-09-18T12:52:34.266 INFO:tasks.workunit.client.0.smithi045.stdout:7/921: dread - d13/d44/d37/d70/fd5 zero size 2024-09-18T12:52:34.268 INFO:tasks.workunit.client.0.smithi045.stdout:9/790: rename d0/d3/d6/d64/d77/d9a to d0/d3/d6/d64/d77/dd5/df8 0 2024-09-18T12:52:34.269 INFO:tasks.workunit.client.0.smithi045.stdout:9/791: readlink d0/d3/d6/d64/d88/le0 0 2024-09-18T12:52:34.271 INFO:tasks.workunit.client.0.smithi045.stdout:7/922: symlink d13/d1a/l13a 0 2024-09-18T12:52:34.273 INFO:tasks.workunit.client.0.smithi045.stdout:9/792: truncate d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/ff0 4773077 0 2024-09-18T12:52:34.286 INFO:tasks.workunit.client.0.smithi045.stdout:7/923: write d13/d44/d37/d70/d77/fc8 [469440,62054] 0 2024-09-18T12:52:34.286 INFO:tasks.workunit.client.0.smithi045.stdout:9/793: write d0/d3/f7 [6841108,27991] 0 2024-09-18T12:52:34.289 INFO:tasks.workunit.client.0.smithi045.stdout:7/924: symlink d13/d31/d33/d64/d78/d90/l13b 0 2024-09-18T12:52:34.290 INFO:tasks.workunit.client.0.smithi045.stdout:9/794: symlink d0/d3/d6/d10/d26/d2e/d6f/da5/dab/lf9 0 2024-09-18T12:52:34.295 INFO:tasks.workunit.client.0.smithi045.stdout:9/795: dread d0/d3/d6/d10/d26/d2e/d4e/f67 [0,4194304] 0 2024-09-18T12:52:34.296 INFO:tasks.workunit.client.0.smithi045.stdout:9/796: write d0/f61 [4443693,84603] 0 2024-09-18T12:52:34.304 INFO:tasks.workunit.client.0.smithi045.stdout:9/797: write d0/d3/d6/d10/f29 [4483330,445] 0 2024-09-18T12:52:34.305 INFO:tasks.workunit.client.0.smithi045.stdout:7/925: dread f2 [0,4194304] 0 2024-09-18T12:52:34.307 INFO:tasks.workunit.client.0.smithi045.stdout:7/926: chown d13/d31/d33/d64/f112 9336 1 2024-09-18T12:52:34.311 INFO:tasks.workunit.client.0.smithi045.stdout:9/798: truncate d0/d3/d6/d10/d26/d2e/f48 2968953 0 2024-09-18T12:52:34.312 INFO:tasks.workunit.client.0.smithi045.stdout:9/799: stat d0/d3/d6/d10/d26/c41 0 2024-09-18T12:52:34.312 INFO:tasks.workunit.client.0.smithi045.stdout:7/927: unlink d13/d44/d37/d70/d77/d6d/l133 0 2024-09-18T12:52:34.313 INFO:tasks.workunit.client.0.smithi045.stdout:9/800: read d0/f50 [3067612,14433] 0 2024-09-18T12:52:34.318 INFO:tasks.workunit.client.0.smithi045.stdout:7/928: dwrite d13/d31/d5f/d94/d139/f104 [0,4194304] 0 2024-09-18T12:52:34.319 INFO:tasks.workunit.client.0.smithi045.stdout:7/929: stat d13/d44/d4c/f62 0 2024-09-18T12:52:34.324 INFO:tasks.workunit.client.0.smithi045.stdout:7/930: creat d13/d44/d37/f13c x:0 0 0 2024-09-18T12:52:34.325 INFO:tasks.workunit.client.0.smithi045.stdout:7/931: chown d13/d44/ddb 0 1 2024-09-18T12:52:34.326 INFO:tasks.workunit.client.0.smithi045.stdout:9/801: write d0/d3/d6/f98 [966750,29400] 0 2024-09-18T12:52:34.331 INFO:tasks.workunit.client.0.smithi045.stdout:7/932: creat d13/d44/d4c/d82/d12b/f13d x:0 0 0 2024-09-18T12:52:34.334 INFO:tasks.workunit.client.0.smithi045.stdout:7/933: mkdir d13/d1a/d13e 0 2024-09-18T12:52:34.336 INFO:tasks.workunit.client.0.smithi045.stdout:9/802: getdents d0/d3/d6/d64/d77/dd5 0 2024-09-18T12:52:34.337 INFO:tasks.workunit.client.0.smithi045.stdout:7/934: creat d13/d44/d37/d70/f13f x:0 0 0 2024-09-18T12:52:34.339 INFO:tasks.workunit.client.0.smithi045.stdout:9/803: mknod d0/d3/d6/d10/d26/d2e/d6f/da5/dab/cfa 0 2024-09-18T12:52:34.342 INFO:tasks.workunit.client.0.smithi045.stdout:7/935: truncate d13/d44/d37/d70/d77/fe1 3330696 0 2024-09-18T12:52:34.343 INFO:tasks.workunit.client.0.smithi045.stdout:7/936: stat d13/d1a/f2e 0 2024-09-18T12:52:34.343 INFO:tasks.workunit.client.0.smithi045.stdout:7/937: fdatasync d13/f10f 0 2024-09-18T12:52:34.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.343+0000 7fbf37b9b640 1 -- 172.21.15.45:0/1370780216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf301023f0 msgr2=0x7fbf301047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:34.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.343+0000 7fbf37b9b640 1 --2- 172.21.15.45:0/1370780216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf301023f0 0x7fbf301047e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0098b0 tx=0x7fbf2c02a4d0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.343+0000 7fbf37b9b640 1 -- 172.21.15.45:0/1370780216 shutdown_connections 2024-09-18T12:52:34.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.343+0000 7fbf37b9b640 1 --2- 172.21.15.45:0/1370780216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf30104d20 0x7fbf30107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.343+0000 7fbf37b9b640 1 --2- 172.21.15.45:0/1370780216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf301023f0 0x7fbf301047e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.343+0000 7fbf37b9b640 1 -- 172.21.15.45:0/1370780216 >> 172.21.15.45:0/1370780216 conn(0x7fbf300fc010 msgr2=0x7fbf300fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.344+0000 7fbf37b9b640 1 -- 172.21.15.45:0/1370780216 shutdown_connections 2024-09-18T12:52:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.344+0000 7fbf37b9b640 1 -- 172.21.15.45:0/1370780216 wait complete. 2024-09-18T12:52:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.344+0000 7fbf37b9b640 1 Processor -- start 2024-09-18T12:52:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.345+0000 7fbf37b9b640 1 -- start start 2024-09-18T12:52:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.345+0000 7fbf37b9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf301023f0 0x7fbf30197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.345+0000 7fbf37b9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf30104d20 0x7fbf30197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.345+0000 7fbf37b9b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3010a7e0 con 0x7fbf30104d20 2024-09-18T12:52:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.345+0000 7fbf37b9b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3010a660 con 0x7fbf301023f0 2024-09-18T12:52:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.345+0000 7fbf35937640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf301023f0 0x7fbf30197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.345+0000 7fbf35937640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf301023f0 0x7fbf30197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:53788/0 (socket says 172.21.15.45:53788) 2024-09-18T12:52:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.345+0000 7fbf35937640 1 -- 172.21.15.45:0/3226468083 learned_addr learned my addr 172.21.15.45:0/3226468083 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:52:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.345+0000 7fbf35136640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf30104d20 0x7fbf30197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.346+0000 7fbf35937640 1 -- 172.21.15.45:0/3226468083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf30104d20 msgr2=0x7fbf30197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.346+0000 7fbf35937640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf30104d20 0x7fbf30197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.346+0000 7fbf35937640 1 -- 172.21.15.45:0/3226468083 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf301980c0 con 0x7fbf301023f0 2024-09-18T12:52:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.346+0000 7fbf35136640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf30104d20 0x7fbf30197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:52:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.346+0000 7fbf35937640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf301023f0 0x7fbf30197500 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0099d0 tx=0x7fbf2c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.347+0000 7fbf26ffd640 1 -- 172.21.15.45:0/3226468083 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf2c03f070 con 0x7fbf301023f0 2024-09-18T12:52:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.347+0000 7fbf37b9b640 1 -- 172.21.15.45:0/3226468083 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3019caa0 con 0x7fbf301023f0 2024-09-18T12:52:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.347+0000 7fbf26ffd640 1 -- 172.21.15.45:0/3226468083 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbf2c0049d0 con 0x7fbf301023f0 2024-09-18T12:52:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.347+0000 7fbf26ffd640 1 -- 172.21.15.45:0/3226468083 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf2c035030 con 0x7fbf301023f0 2024-09-18T12:52:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.347+0000 7fbf37b9b640 1 -- 172.21.15.45:0/3226468083 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3019cf70 con 0x7fbf301023f0 2024-09-18T12:52:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.348+0000 7fbf37b9b640 1 -- 172.21.15.45:0/3226468083 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf301027d0 con 0x7fbf301023f0 2024-09-18T12:52:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.349+0000 7fbf26ffd640 1 -- 172.21.15.45:0/3226468083 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fbf2c042070 con 0x7fbf301023f0 2024-09-18T12:52:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.350+0000 7fbf26ffd640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fbf1c074a80 0x7fbf1c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:52:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.350+0000 7fbf26ffd640 1 -- 172.21.15.45:0/3226468083 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7fbf2c0b6e60 con 0x7fbf301023f0 2024-09-18T12:52:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.350+0000 7fbf35136640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fbf1c074a80 0x7fbf1c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:52:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.351+0000 7fbf35136640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fbf1c074a80 0x7fbf1c076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbf301989b0 tx=0x7fbf20005f90 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:52:34.356 INFO:tasks.workunit.client.0.smithi045.stdout:7/938: getdents d13/d31/d5f/d94/d139 0 2024-09-18T12:52:34.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.355+0000 7fbf26ffd640 1 -- 172.21.15.45:0/3226468083 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fbf2c0823d0 con 0x7fbf301023f0 2024-09-18T12:52:34.357 INFO:tasks.workunit.client.0.smithi045.stdout:9/804: dread d0/d3/d6/d10/f1b [0,4194304] 0 2024-09-18T12:52:34.359 INFO:tasks.workunit.client.0.smithi045.stdout:7/939: mknod d13/d31/d33/d64/d78/c140 0 2024-09-18T12:52:34.363 INFO:tasks.workunit.client.0.smithi045.stdout:9/805: unlink d0/d3/d6/d10/d26/d2e/f3c 0 2024-09-18T12:52:34.370 INFO:tasks.workunit.client.0.smithi045.stdout:9/806: dwrite d0/d3/d6/d64/d77/dd5/df8/fcf [0,4194304] 0 2024-09-18T12:52:34.374 INFO:tasks.workunit.client.0.smithi045.stdout:9/807: unlink d0/d3/d6/d9d/lcd 0 2024-09-18T12:52:34.378 INFO:tasks.workunit.client.0.smithi045.stdout:9/808: write d0/d3/d6/d10/d26/d2e/d4e/f9f [8585280,2968] 0 2024-09-18T12:52:34.378 INFO:tasks.workunit.client.0.smithi045.stdout:7/940: write d13/d31/d5f/d94/d139/fcd [885771,72415] 0 2024-09-18T12:52:34.387 INFO:tasks.workunit.client.0.smithi045.stdout:9/809: mknod d0/d3/d6/d10/d26/d2e/d4e/cfb 0 2024-09-18T12:52:34.397 INFO:tasks.workunit.client.0.smithi045.stdout:7/941: dwrite d13/d44/f87 [0,4194304] 0 2024-09-18T12:52:34.397 INFO:tasks.workunit.client.0.smithi045.stdout:7/942: chown d13/d44/d37/d70 120151141 1 2024-09-18T12:52:34.401 INFO:tasks.workunit.client.0.smithi045.stdout:7/943: creat d13/f141 x:0 0 0 2024-09-18T12:52:34.403 INFO:tasks.workunit.client.0.smithi045.stdout:7/944: write d13/d44/f80 [3561054,70918] 0 2024-09-18T12:52:34.405 INFO:tasks.workunit.client.0.smithi045.stdout:7/945: fdatasync d13/d31/d33/d64/d78/fbb 0 2024-09-18T12:52:34.406 INFO:tasks.workunit.client.0.smithi045.stdout:9/810: dread d0/d3/f1f [0,4194304] 0 2024-09-18T12:52:34.409 INFO:tasks.workunit.client.0.smithi045.stdout:7/946: mknod d13/d44/d37/d6a/da3/d10a/c142 0 2024-09-18T12:52:34.412 INFO:tasks.workunit.client.0.smithi045.stdout:7/947: dread d13/d31/d33/fc9 [0,4194304] 0 2024-09-18T12:52:34.413 INFO:tasks.workunit.client.0.smithi045.stdout:7/948: fdatasync d13/d31/fd4 0 2024-09-18T12:52:34.418 INFO:tasks.workunit.client.0.smithi045.stdout:7/949: dread d13/d44/d37/fce [0,4194304] 0 2024-09-18T12:52:34.419 INFO:tasks.workunit.client.0.smithi045.stdout:7/950: write d13/d31/d5f/f126 [368880,124545] 0 2024-09-18T12:52:34.425 INFO:tasks.workunit.client.0.smithi045.stdout:9/811: truncate d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/fc9 1614896 0 2024-09-18T12:52:34.426 INFO:tasks.workunit.client.0.smithi045.stdout:7/951: creat d13/d31/d33/d64/f143 x:0 0 0 2024-09-18T12:52:34.428 INFO:tasks.workunit.client.0.smithi045.stdout:9/812: symlink d0/d3/d6/d10/d26/da4/lfc 0 2024-09-18T12:52:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:9/813: write d0/d3/d6/d10/d26/d2e/d4e/fbb [2619510,96074] 0 2024-09-18T12:52:34.440 INFO:tasks.workunit.client.0.smithi045.stdout:9/814: write d0/d3/d6/d10/d26/d2e/ff1 [79190,10693] 0 2024-09-18T12:52:34.443 INFO:tasks.workunit.client.0.smithi045.stdout:7/952: dwrite d13/d1a/f2e [4194304,4194304] 0 2024-09-18T12:52:34.448 INFO:tasks.workunit.client.0.smithi045.stdout:7/953: unlink d13/d31/d33/d64/d78/c7a 0 2024-09-18T12:52:34.449 INFO:tasks.workunit.client.0.smithi045.stdout:9/815: getdents d0/d3/d6/d10/d26/d2e/d4e/db4 0 2024-09-18T12:52:34.450 INFO:tasks.workunit.client.0.smithi045.stdout:9/816: stat d0/d3/d6/fe4 0 2024-09-18T12:52:34.450 INFO:tasks.workunit.client.0.smithi045.stdout:7/954: fsync d13/d44/d37/d70/f96 0 2024-09-18T12:52:34.451 INFO:tasks.workunit.client.0.smithi045.stdout:7/955: readlink d13/d1a/l3d 0 2024-09-18T12:52:34.455 INFO:tasks.workunit.client.0.smithi045.stdout:7/956: chown d13/d44/d37/d70/d77/d85/l97 6550 1 2024-09-18T12:52:34.459 INFO:tasks.workunit.client.0.smithi045.stdout:7/957: mknod d13/d44/d37/d6a/da3/d10a/c144 0 2024-09-18T12:52:34.461 INFO:tasks.workunit.client.0.smithi045.stdout:9/817: truncate d0/d3/d6/d10/d26/d2e/f24 4739068 0 2024-09-18T12:52:34.463 INFO:tasks.workunit.client.0.smithi045.stdout:7/958: creat d13/d44/f145 x:0 0 0 2024-09-18T12:52:34.463 INFO:tasks.workunit.client.0.smithi045.stdout:9/818: fdatasync d0/d3/d6/d10/d2c/f44 0 2024-09-18T12:52:34.464 INFO:tasks.workunit.client.0.smithi045.stdout:7/959: stat d13/d44/d37/d70/d77/d85/c113 0 2024-09-18T12:52:34.470 INFO:tasks.workunit.client.0.smithi045.stdout:9/819: fdatasync d0/d3/d6/d10/d26/d2e/d4e/d76/fd2 0 2024-09-18T12:52:34.471 INFO:tasks.workunit.client.0.smithi045.stdout:7/960: dwrite d13/d31/d33/d64/d78/d90/fb9 [0,4194304] 0 2024-09-18T12:52:34.473 INFO:tasks.workunit.client.0.smithi045.stdout:7/961: chown fc 27 1 2024-09-18T12:52:34.474 INFO:tasks.workunit.client.0.smithi045.stdout:7/962: read - d13/d44/f145 zero size 2024-09-18T12:52:34.476 INFO:tasks.workunit.client.0.smithi045.stdout:9/820: truncate d0/d3/d6/d64/fa0 620770 0 2024-09-18T12:52:34.478 INFO:tasks.workunit.client.0.smithi045.stdout:7/963: creat d13/d44/d37/d70/d77/d6d/f146 x:0 0 0 2024-09-18T12:52:34.482 INFO:tasks.workunit.client.0.smithi045.stdout:9/821: unlink d0/d3/d6/d10/d26/d2e/d4e/cfb 0 2024-09-18T12:52:34.483 INFO:tasks.workunit.client.0.smithi045.stdout:9/822: write d0/f9e [608036,74977] 0 2024-09-18T12:52:34.484 INFO:tasks.workunit.client.0.smithi045.stdout:9/823: fsync d0/f2 0 2024-09-18T12:52:34.486 INFO:tasks.workunit.client.0.smithi045.stdout:9/824: creat d0/d3/d6/d64/dc1/ffd x:0 0 0 2024-09-18T12:52:34.489 INFO:tasks.workunit.client.0.smithi045.stdout:9/825: getdents d0/de5 0 2024-09-18T12:52:34.491 INFO:tasks.workunit.client.0.smithi045.stdout:9/826: rmdir d0/d3/d6/d10/d26/d2e/d4e/d76 39 2024-09-18T12:52:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.623+0000 7fbf37b9b640 1 -- 172.21.15.45:0/3226468083 --> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbf30105680 con 0x7fbf1c074a80 2024-09-18T12:52:34.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.625+0000 7fbf26ffd640 1 -- 172.21.15.45:0/3226468083 <== mgr.24401 v2:172.21.15.161:6828/243368146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fbf30105680 con 0x7fbf1c074a80 2024-09-18T12:52:34.626 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:52:34.626 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:52:34.627 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:52:34.627 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:52:34.627 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [], 2024-09-18T12:52:34.627 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "1/2 daemons upgraded", 2024-09-18T12:52:34.627 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T12:52:34.627 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:52:34.627 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:52:34.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 -- 172.21.15.45:0/3226468083 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fbf1c074a80 msgr2=0x7fbf1c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fbf1c074a80 0x7fbf1c076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbf301989b0 tx=0x7fbf20005f90 comp rx=0 tx=0).stop 2024-09-18T12:52:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 -- 172.21.15.45:0/3226468083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf301023f0 msgr2=0x7fbf30197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:52:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf301023f0 0x7fbf30197500 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0099d0 tx=0x7fbf2c0045e0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 -- 172.21.15.45:0/3226468083 shutdown_connections 2024-09-18T12:52:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.161:6828/243368146,v1:172.21.15.161:6829/243368146] conn(0x7fbf1c074a80 0x7fbf1c076f40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf30104d20 0x7fbf30197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 --2- 172.21.15.45:0/3226468083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf301023f0 0x7fbf30197500 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:52:34.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 -- 172.21.15.45:0/3226468083 >> 172.21.15.45:0/3226468083 conn(0x7fbf300fc010 msgr2=0x7fbf300fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:52:34.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 -- 172.21.15.45:0/3226468083 shutdown_connections 2024-09-18T12:52:34.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:52:34.627+0000 7fbf37b9b640 1 -- 172.21.15.45:0/3226468083 wait complete. 2024-09-18T12:52:34.746 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:34 smithi161 ceph-mon[35784]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:34.746 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:34 smithi161 ceph-mon[35784]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:34.746 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:34 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1640385015' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:34.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:34 smithi045 ceph-mon[28315]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:34.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:34 smithi045 ceph-mon[28315]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:34.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:34 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1640385015' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:52:34.915 INFO:tasks.workunit.client.0.smithi045.stdout:6/839: sync 2024-09-18T12:52:34.915 INFO:tasks.workunit.client.0.smithi045.stdout:3/874: sync 2024-09-18T12:52:34.917 INFO:tasks.workunit.client.0.smithi045.stdout:6/840: readlink d9/d1a/d48/d75/dc7/lda 0 2024-09-18T12:52:34.921 INFO:tasks.workunit.client.0.smithi045.stdout:3/875: symlink d0/d1e/d2c/l129 0 2024-09-18T12:52:34.924 INFO:tasks.workunit.client.0.smithi045.stdout:6/841: rename d9/d1a/d48/d75/d106/de2 to d9/d1a/d2d/d32/db0/d11b 0 2024-09-18T12:52:34.926 INFO:tasks.workunit.client.0.smithi045.stdout:3/876: creat d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/d119/f12a x:0 0 0 2024-09-18T12:52:34.928 INFO:tasks.workunit.client.0.smithi045.stdout:3/877: truncate d0/fca 959341 0 2024-09-18T12:52:34.929 INFO:tasks.workunit.client.0.smithi045.stdout:3/878: truncate d0/d7/de9/f110 201508 0 2024-09-18T12:52:34.930 INFO:tasks.workunit.client.0.smithi045.stdout:3/879: chown d0/d1e/d2c/d3a/d45 7 1 2024-09-18T12:52:34.941 INFO:tasks.workunit.client.0.smithi045.stdout:3/880: dread d0/d1e/d2c/d3a/d45/f49 [0,4194304] 0 2024-09-18T12:52:34.941 INFO:tasks.workunit.client.0.smithi045.stdout:3/881: readlink d0/d29/d5f/d73/l7d 0 2024-09-18T12:52:34.949 INFO:tasks.workunit.client.0.smithi045.stdout:3/882: dwrite d0/d29/d5f/d73/f7a [0,4194304] 0 2024-09-18T12:52:34.955 INFO:tasks.workunit.client.0.smithi045.stdout:3/883: mkdir d0/d1e/d39/da8/d12b 0 2024-09-18T12:52:34.958 INFO:tasks.workunit.client.0.smithi045.stdout:6/842: write d9/d1a/d48/d7d/dcb/de1/f84 [629216,77301] 0 2024-09-18T12:52:34.959 INFO:tasks.workunit.client.0.smithi045.stdout:6/843: stat d9/d1a/d48/d7d/l119 0 2024-09-18T12:52:34.966 INFO:tasks.workunit.client.0.smithi045.stdout:3/884: link d0/d29/f67 d0/d29/f12c 0 2024-09-18T12:52:34.971 INFO:tasks.workunit.client.0.smithi045.stdout:3/885: mknod d0/d1e/d2c/d3f/d44/d75/c12d 0 2024-09-18T12:52:34.974 INFO:tasks.workunit.client.0.smithi045.stdout:6/844: mkdir d9/d1a/d48/d8f/d98/dab/dec/dfe/d11c 0 2024-09-18T12:52:34.975 INFO:tasks.workunit.client.0.smithi045.stdout:6/845: chown d9/d1a/d48/d7d/dcb/de1/l4d 138 1 2024-09-18T12:52:34.976 INFO:tasks.workunit.client.0.smithi045.stdout:3/886: rename d0/d1e/d2c/d3a/ddf/d116 to d0/d1e/d2c/d3f/d12e 0 2024-09-18T12:52:34.983 INFO:tasks.workunit.client.0.smithi045.stdout:6/846: dwrite d9/d1a/d48/d97/f9c [0,4194304] 0 2024-09-18T12:52:34.991 INFO:tasks.workunit.client.0.smithi045.stdout:3/887: creat d0/d29/d5f/d73/da0/f12f x:0 0 0 2024-09-18T12:52:35.000 INFO:tasks.workunit.client.0.smithi045.stdout:3/888: creat d0/d7/f130 x:0 0 0 2024-09-18T12:52:35.002 INFO:tasks.workunit.client.0.smithi045.stdout:3/889: truncate d0/d29/d5f/d73/d87/f106 1040720 0 2024-09-18T12:52:35.020 INFO:tasks.workunit.client.0.smithi045.stdout:6/847: write d9/d1a/d2d/f8a [786397,102719] 0 2024-09-18T12:52:35.021 INFO:tasks.workunit.client.0.smithi045.stdout:6/848: chown d9/d74 603 1 2024-09-18T12:52:35.027 INFO:tasks.workunit.client.0.smithi045.stdout:6/849: dread d9/d56/f108 [0,4194304] 0 2024-09-18T12:52:35.030 INFO:tasks.workunit.client.0.smithi045.stdout:3/890: dwrite d0/d1e/d2c/d3a/d45/dbe/fc9 [0,4194304] 0 2024-09-18T12:52:35.034 INFO:tasks.workunit.client.0.smithi045.stdout:6/850: creat d9/d1a/d48/d75/d106/f11d x:0 0 0 2024-09-18T12:52:35.038 INFO:tasks.workunit.client.0.smithi045.stdout:3/891: truncate d0/d1e/d2c/d3f/d44/f78 1241608 0 2024-09-18T12:52:35.042 INFO:tasks.workunit.client.0.smithi045.stdout:3/892: rename d0/d1e/d39/db7 to d0/d29/d5f/d73/da0/d131 0 2024-09-18T12:52:35.045 INFO:tasks.workunit.client.0.smithi045.stdout:3/893: fdatasync d0/d29/d5f/f65 0 2024-09-18T12:52:35.048 INFO:tasks.workunit.client.0.smithi045.stdout:3/894: creat d0/d7/de9/f132 x:0 0 0 2024-09-18T12:52:35.049 INFO:tasks.workunit.client.0.smithi045.stdout:6/851: dread d9/d74/d114/f117 [0,4194304] 0 2024-09-18T12:52:35.051 INFO:tasks.workunit.client.0.smithi045.stdout:6/852: stat d9/d1a/d48/d116 0 2024-09-18T12:52:35.054 INFO:tasks.workunit.client.0.smithi045.stdout:3/895: rename d0/fcd to d0/d1e/d2c/d3a/d45/f133 0 2024-09-18T12:52:35.063 INFO:tasks.workunit.client.0.smithi045.stdout:3/896: creat d0/d29/d5f/d73/d87/f134 x:0 0 0 2024-09-18T12:52:35.066 INFO:tasks.workunit.client.0.smithi045.stdout:3/897: mknod d0/d29/d5f/d73/da0/d131/de7/c135 0 2024-09-18T12:52:35.074 INFO:tasks.workunit.client.0.smithi045.stdout:6/853: getdents d9/d30/d6c 0 2024-09-18T12:52:35.080 INFO:tasks.workunit.client.0.smithi045.stdout:3/898: dread d0/f83 [0,4194304] 0 2024-09-18T12:52:35.084 INFO:tasks.workunit.client.0.smithi045.stdout:6/854: rename d9/d1a/d48/d8f/d98/dab/fae to d9/d1a/d2d/d32/db0/ddc/f11e 0 2024-09-18T12:52:35.088 INFO:tasks.workunit.client.0.smithi045.stdout:3/899: creat d0/d7/d89/dd2/f136 x:0 0 0 2024-09-18T12:52:35.093 INFO:tasks.workunit.client.0.smithi045.stdout:6/855: link d9/d56/db3/fb8 d9/d30/d6c/f11f 0 2024-09-18T12:52:35.096 INFO:tasks.workunit.client.0.smithi045.stdout:6/856: creat d9/d1a/d2d/ddf/f120 x:0 0 0 2024-09-18T12:52:35.096 INFO:tasks.workunit.client.0.smithi045.stdout:3/900: getdents d0/d29/d5f/d73/da0/d131/db1 0 2024-09-18T12:52:35.100 INFO:tasks.workunit.client.0.smithi045.stdout:6/857: rename d9/d74/d114 to d9/d1a/d2d/d38/d5b/d121 0 2024-09-18T12:52:35.101 INFO:tasks.workunit.client.0.smithi045.stdout:6/858: fsync d9/d1a/d48/d97/f9c 0 2024-09-18T12:52:35.105 INFO:tasks.workunit.client.0.smithi045.stdout:6/859: creat d9/d56/d10d/f122 x:0 0 0 2024-09-18T12:52:35.109 INFO:tasks.workunit.client.0.smithi045.stdout:3/901: dwrite d0/d7/fda [0,4194304] 0 2024-09-18T12:52:35.109 INFO:tasks.workunit.client.0.smithi045.stdout:6/860: read d9/d1a/d2d/d32/db0/ddc/f11e [268958,64208] 0 2024-09-18T12:52:35.110 INFO:tasks.workunit.client.0.smithi045.stdout:3/902: readlink d0/d7/l122 0 2024-09-18T12:52:35.111 INFO:tasks.workunit.client.0.smithi045.stdout:3/903: chown d0/d7/fda 72 1 2024-09-18T12:52:35.115 INFO:tasks.workunit.client.0.smithi045.stdout:3/904: rename d0/d1e/d91 to d0/d29/d5f/d73/da0/d131/db1/d137 0 2024-09-18T12:52:35.116 INFO:tasks.workunit.client.0.smithi045.stdout:6/861: symlink d9/l123 0 2024-09-18T12:52:35.121 INFO:tasks.workunit.client.0.smithi045.stdout:6/862: unlink d9/ff 0 2024-09-18T12:52:35.125 INFO:tasks.workunit.client.0.smithi045.stdout:6/863: mknod d9/d1a/d48/d8f/d98/dab/dec/dfe/c124 0 2024-09-18T12:52:35.131 INFO:tasks.workunit.client.0.smithi045.stdout:3/905: dread d0/d1e/d2c/d3a/f4a [0,4194304] 0 2024-09-18T12:52:35.134 INFO:tasks.workunit.client.0.smithi045.stdout:3/906: mkdir d0/d1e/d39/da8/d138 0 2024-09-18T12:52:35.137 INFO:tasks.workunit.client.0.smithi045.stdout:3/907: mkdir d0/d29/d53/dd8/d139 0 2024-09-18T12:52:35.137 INFO:tasks.workunit.client.0.smithi045.stdout:3/908: dread - d0/d29/d53/dff/f115 zero size 2024-09-18T12:52:35.138 INFO:tasks.workunit.client.0.smithi045.stdout:3/909: stat d0/d1e/d2c/d3a/d45/dbe/dcc/feb 0 2024-09-18T12:52:35.140 INFO:tasks.workunit.client.0.smithi045.stdout:6/864: dread d9/d1a/d2d/f4a [0,4194304] 0 2024-09-18T12:52:35.145 INFO:tasks.workunit.client.0.smithi045.stdout:6/865: dread d9/d1a/d48/d97/f9c [0,4194304] 0 2024-09-18T12:52:35.158 INFO:tasks.workunit.client.0.smithi045.stdout:3/910: write d0/d1e/d2c/d3a/d45/dbe/fd0 [561865,5549] 0 2024-09-18T12:52:35.163 INFO:tasks.workunit.client.0.smithi045.stdout:3/911: dread d0/fe [0,4194304] 0 2024-09-18T12:52:35.167 INFO:tasks.workunit.client.0.smithi045.stdout:3/912: rename d0/d1e/d2c/d3f to d0/d29/d53/dff/d13a 0 2024-09-18T12:52:35.173 INFO:tasks.workunit.client.0.smithi045.stdout:3/913: dwrite d0/d7/f130 [0,4194304] 0 2024-09-18T12:52:35.175 INFO:tasks.workunit.client.0.smithi045.stdout:3/914: read d0/d29/d5f/d73/fbb [2451899,48750] 0 2024-09-18T12:52:35.183 INFO:tasks.workunit.client.0.smithi045.stdout:3/915: dwrite d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/ff8 [0,4194304] 0 2024-09-18T12:52:35.190 INFO:tasks.workunit.client.0.smithi045.stdout:3/916: dwrite d0/d1e/d2c/d3a/d45/dbe/fee [0,4194304] 0 2024-09-18T12:52:35.192 INFO:tasks.workunit.client.0.smithi045.stdout:3/917: write d0/d29/d53/dff/f115 [622860,125438] 0 2024-09-18T12:52:35.193 INFO:tasks.workunit.client.0.smithi045.stdout:3/918: chown d0/d1e/d39/f43 65374013 1 2024-09-18T12:52:35.202 INFO:tasks.workunit.client.0.smithi045.stdout:3/919: dwrite d0/d29/d53/dff/d13a/d44/d75/f10f [0,4194304] 0 2024-09-18T12:52:35.206 INFO:tasks.workunit.client.0.smithi045.stdout:3/920: symlink d0/d1e/d2c/d3a/l13b 0 2024-09-18T12:52:35.208 INFO:tasks.workunit.client.0.smithi045.stdout:3/921: rmdir d0/d1e/d39 39 2024-09-18T12:52:35.212 INFO:tasks.workunit.client.0.smithi045.stdout:3/922: creat d0/d29/f13c x:0 0 0 2024-09-18T12:52:35.216 INFO:tasks.workunit.client.0.smithi045.stdout:3/923: getdents d0/d1e/d2c 0 2024-09-18T12:52:35.221 INFO:tasks.workunit.client.0.smithi045.stdout:3/924: dwrite d0/d29/f13c [0,4194304] 0 2024-09-18T12:52:35.226 INFO:tasks.workunit.client.0.smithi045.stdout:3/925: symlink d0/d29/d5f/d73/l13d 0 2024-09-18T12:52:35.226 INFO:tasks.workunit.client.0.smithi045.stdout:3/926: stat d0 0 2024-09-18T12:52:35.227 INFO:tasks.workunit.client.0.smithi045.stdout:3/927: write d0/d29/d5f/d73/da0/f12f [1001169,65798] 0 2024-09-18T12:52:35.234 INFO:tasks.workunit.client.0.smithi045.stdout:3/928: dwrite d0/d29/d5f/d73/da0/f12f [0,4194304] 0 2024-09-18T12:52:35.235 INFO:tasks.workunit.client.0.smithi045.stdout:3/929: read d0/d1e/d2c/d3a/f6d [490227,33976] 0 2024-09-18T12:52:35.237 INFO:tasks.workunit.client.0.smithi045.stdout:3/930: chown d0/d7/c70 1 1 2024-09-18T12:52:35.238 INFO:tasks.workunit.client.0.smithi045.stdout:3/931: chown d0/d7/c20 34160 1 2024-09-18T12:52:35.352 INFO:tasks.workunit.client.0.smithi045.stdout:3/932: unlink d0/d1e/d2c/d3a/d8a/df1/ff2 0 2024-09-18T12:52:35.354 INFO:tasks.workunit.client.0.smithi045.stdout:3/933: mknod d0/d1e/d2c/c13e 0 2024-09-18T12:52:35.357 INFO:tasks.workunit.client.0.smithi045.stdout:3/934: fdatasync d0/d29/d53/dff/d13a/d44/f78 0 2024-09-18T12:52:35.358 INFO:tasks.workunit.client.0.smithi045.stdout:3/935: chown d0/f3e 26309 1 2024-09-18T12:52:35.360 INFO:tasks.workunit.client.0.smithi045.stdout:3/936: readlink d0/d29/d53/dff/d13a/d44/l5d 0 2024-09-18T12:52:35.366 INFO:tasks.workunit.client.0.smithi045.stdout:3/937: rename d0/d1e/d2c/d3a/d45/f92 to d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/d119/f13f 0 2024-09-18T12:52:35.375 INFO:tasks.workunit.client.0.smithi045.stdout:3/938: dread d0/f3e [0,4194304] 0 2024-09-18T12:52:35.377 INFO:tasks.workunit.client.0.smithi045.stdout:3/939: chown d0/d1e/d39/f88 612713069 1 2024-09-18T12:52:35.389 INFO:tasks.workunit.client.0.smithi045.stdout:3/940: write d0/d22/f26 [3897440,102051] 0 2024-09-18T12:52:35.392 INFO:tasks.workunit.client.0.smithi045.stdout:3/941: creat d0/d1e/d2c/d3a/d45/dbe/dcc/f140 x:0 0 0 2024-09-18T12:52:35.395 INFO:tasks.workunit.client.0.smithi045.stdout:8/993: sync 2024-09-18T12:52:35.398 INFO:tasks.workunit.client.0.smithi045.stdout:8/994: write d11/d20/d60/dc3/f4a [4264848,81639] 0 2024-09-18T12:52:35.400 INFO:tasks.workunit.client.0.smithi045.stdout:3/942: dwrite d0/d1e/d2c/d3a/d8a/df1/f113 [0,4194304] 0 2024-09-18T12:52:35.405 INFO:tasks.workunit.client.0.smithi045.stdout:8/995: mknod d11/d76/c131 0 2024-09-18T12:52:35.406 INFO:tasks.workunit.client.0.smithi045.stdout:3/943: rename d0/d1e/d39/l97 to d0/d1e/d2c/d3a/d45/l141 0 2024-09-18T12:52:35.411 INFO:tasks.workunit.client.0.smithi045.stdout:3/944: fdatasync d0/d29/d53/dff/d13a/fbd 0 2024-09-18T12:52:35.411 INFO:tasks.workunit.client.0.smithi045.stdout:8/996: read d11/d14/d72/da9/dc5/d10b/f9d [4262869,11476] 0 2024-09-18T12:52:35.413 INFO:tasks.workunit.client.0.smithi045.stdout:3/945: write d0/d1e/d2c/d3a/d45/dbe/fee [3995946,22363] 0 2024-09-18T12:52:35.414 INFO:tasks.workunit.client.0.smithi045.stdout:8/997: rmdir d11/d14 39 2024-09-18T12:52:35.420 INFO:tasks.workunit.client.0.smithi045.stdout:3/946: rename d0/l31 to d0/d1e/d2c/l142 0 2024-09-18T12:52:35.422 INFO:tasks.workunit.client.0.smithi045.stdout:8/998: rename d11/d76/da0/da1/c101 to d11/d20/d60/da3/c132 0 2024-09-18T12:52:35.425 INFO:tasks.workunit.client.0.smithi045.stdout:3/947: dread d0/d7/fb2 [0,4194304] 0 2024-09-18T12:52:35.428 INFO:tasks.workunit.client.0.smithi045.stdout:3/948: rename d0/d29/d53 to d0/d1e/d39/da8/dd6/d143 0 2024-09-18T12:52:35.430 INFO:tasks.workunit.client.0.smithi045.stdout:8/999: truncate d11/d14/d53/f4f 4034187 0 2024-09-18T12:52:35.431 INFO:tasks.workunit.client.0.smithi045.stdout:3/949: write d0/d1e/d39/da8/dd6/d143/dff/d13a/d44/d75/ffa [421715,123558] 0 2024-09-18T12:52:35.434 INFO:tasks.workunit.client.0.smithi045.stdout:3/950: stat d0/fca 0 2024-09-18T12:52:35.440 INFO:tasks.workunit.client.0.smithi045.stdout:3/951: creat d0/d1e/d39/da8/dd6/d143/f144 x:0 0 0 2024-09-18T12:52:35.445 INFO:tasks.workunit.client.0.smithi045.stdout:3/952: unlink d0/d1e/d2c/d3a/d45/l94 0 2024-09-18T12:52:35.446 INFO:tasks.workunit.client.0.smithi045.stdout:3/953: truncate d0/d22/f2e 6757677 0 2024-09-18T12:52:35.451 INFO:tasks.workunit.client.0.smithi045.stdout:3/954: dread d0/d1e/d2c/d3a/fbc [0,4194304] 0 2024-09-18T12:52:35.455 INFO:tasks.workunit.client.0.smithi045.stdout:3/955: symlink d0/d1e/d2c/dd4/l145 0 2024-09-18T12:52:35.457 INFO:tasks.workunit.client.0.smithi045.stdout:3/956: write d0/d1e/d39/da8/dd6/d143/f144 [705899,23622] 0 2024-09-18T12:52:35.463 INFO:tasks.workunit.client.0.smithi045.stdout:3/957: creat d0/f146 x:0 0 0 2024-09-18T12:52:35.468 INFO:tasks.workunit.client.0.smithi045.stdout:3/958: dread d0/d1e/d2c/d3a/d45/f6c [0,4194304] 0 2024-09-18T12:52:35.470 INFO:tasks.workunit.client.0.smithi045.stdout:3/959: dread - d0/d29/d5f/d73/da0/d131/db1/f118 zero size 2024-09-18T12:52:35.474 INFO:tasks.workunit.client.0.smithi045.stdout:3/960: link d0/d1e/d39/da8/dd6/d143/f144 d0/d1e/d39/da8/dd6/f147 0 2024-09-18T12:52:35.483 INFO:tasks.workunit.client.0.smithi045.stdout:3/961: dwrite d0/d29/f13c [4194304,4194304] 0 2024-09-18T12:52:35.485 INFO:tasks.workunit.client.0.smithi045.stdout:3/962: dread d0/fca [0,4194304] 0 2024-09-18T12:52:35.489 INFO:tasks.workunit.client.0.smithi045.stdout:3/963: symlink d0/d1e/d39/da8/dd6/d143/dff/d13a/d12e/l148 0 2024-09-18T12:52:35.493 INFO:tasks.workunit.client.0.smithi045.stdout:3/964: mknod d0/d1e/d39/da8/c149 0 2024-09-18T12:52:35.497 INFO:tasks.workunit.client.0.smithi045.stdout:3/965: rename d0/d1e/d2c/d3a/d8a/d125 to d0/d1e/d39/da8/dd6/d14a 0 2024-09-18T12:52:35.497 INFO:tasks.workunit.client.0.smithi045.stdout:3/966: chown d0/d1e/d2c/d3a/c86 229485408 1 2024-09-18T12:52:35.499 INFO:tasks.workunit.client.0.smithi045.stdout:3/967: chown d0/d1e/d39/da8/dd6/d143/dff/d13a/d44/d75/l8f 377539 1 2024-09-18T12:52:35.500 INFO:tasks.workunit.client.0.smithi045.stdout:0/988: sync 2024-09-18T12:52:35.502 INFO:tasks.workunit.client.0.smithi045.stdout:3/968: symlink d0/l14b 0 2024-09-18T12:52:35.506 INFO:tasks.workunit.client.0.smithi045.stdout:3/969: symlink d0/d29/d5f/d73/da0/d131/de7/l14c 0 2024-09-18T12:52:35.508 INFO:tasks.workunit.client.0.smithi045.stdout:0/989: getdents d6/d48 0 2024-09-18T12:52:35.514 INFO:tasks.workunit.client.0.smithi045.stdout:3/970: link d0/d29/d5f/d73/da0/d131/cc5 d0/d22/c14d 0 2024-09-18T12:52:35.516 INFO:tasks.workunit.client.0.smithi045.stdout:0/990: mkdir d6/d48/d5e/d39/d58/d86/db9/d10a/d126/d12b 0 2024-09-18T12:52:35.517 INFO:tasks.workunit.client.0.smithi045.stdout:3/971: chown d0/d7/c1b 2813 1 2024-09-18T12:52:35.520 INFO:tasks.workunit.client.0.smithi045.stdout:3/972: dread - d0/d29/d5f/d73/da0/d131/db1/d137/fba zero size 2024-09-18T12:52:35.528 INFO:tasks.workunit.client.0.smithi045.stdout:3/973: link d0/d1e/d2c/dd4/f107 d0/d29/d5f/d73/f14e 0 2024-09-18T12:52:35.529 INFO:tasks.workunit.client.0.smithi045.stdout:3/974: chown d0/d7/de9/f110 98 1 2024-09-18T12:52:35.532 INFO:tasks.workunit.client.0.smithi045.stdout:0/991: dwrite d6/d48/d5e/d39/d58/d86/fc3 [0,4194304] 0 2024-09-18T12:52:35.540 INFO:tasks.workunit.client.0.smithi045.stdout:3/975: dwrite d0/d1e/d39/da8/dd6/dfc/f128 [0,4194304] 0 2024-09-18T12:52:35.544 INFO:tasks.workunit.client.0.smithi045.stdout:3/976: truncate d0/d22/f8e 337828 0 2024-09-18T12:52:35.546 INFO:tasks.workunit.client.0.smithi045.stdout:3/977: stat d0/d1e/d39/da8/dd6/f147 0 2024-09-18T12:52:35.552 INFO:tasks.workunit.client.0.smithi045.stdout:3/978: dread d0/d29/d5f/d73/da0/d131/db1/d137/fad [0,4194304] 0 2024-09-18T12:52:35.554 INFO:tasks.workunit.client.0.smithi045.stdout:0/992: dread d6/d48/d5e/d39/d58/d3b/d6b/fac [0,4194304] 0 2024-09-18T12:52:35.557 INFO:tasks.workunit.client.0.smithi045.stdout:0/993: creat d6/d7/d32/f12c x:0 0 0 2024-09-18T12:52:35.558 INFO:tasks.workunit.client.0.smithi045.stdout:3/979: dwrite d0/d22/f2e [4194304,4194304] 0 2024-09-18T12:52:35.558 INFO:tasks.workunit.client.0.smithi045.stdout:0/994: fsync d6/d48/d5e/d39/d58/fe7 0 2024-09-18T12:52:35.560 INFO:tasks.workunit.client.0.smithi045.stdout:3/980: fdatasync d0/d1e/d2c/d3a/d8a/df1/f113 0 2024-09-18T12:52:35.566 INFO:tasks.workunit.client.0.smithi045.stdout:6/866: sync 2024-09-18T12:52:35.566 INFO:tasks.workunit.client.0.smithi045.stdout:7/964: sync 2024-09-18T12:52:35.566 INFO:tasks.workunit.client.0.smithi045.stdout:9/827: sync 2024-09-18T12:52:35.569 INFO:tasks.workunit.client.0.smithi045.stdout:3/981: dwrite d0/d1e/d2c/d3a/ddf/fe2 [0,4194304] 0 2024-09-18T12:52:35.571 INFO:tasks.workunit.client.0.smithi045.stdout:3/982: fdatasync d0/d29/d5f/d73/da0/d131/db1/d11a/f11c 0 2024-09-18T12:52:35.572 INFO:tasks.workunit.client.0.smithi045.stdout:0/995: dread d6/daa/db2/fc9 [0,4194304] 0 2024-09-18T12:52:35.575 INFO:tasks.workunit.client.0.smithi045.stdout:6/867: stat d9/d56/db3/le3 0 2024-09-18T12:52:35.582 INFO:tasks.workunit.client.0.smithi045.stdout:6/868: dread d9/d56/fd3 [0,4194304] 0 2024-09-18T12:52:35.583 INFO:tasks.workunit.client.0.smithi045.stdout:6/869: chown d9/d1a/d2d/c41 499 1 2024-09-18T12:52:35.584 INFO:tasks.workunit.client.0.smithi045.stdout:3/983: unlink d0/d1e/d2c/d3a/fbc 0 2024-09-18T12:52:35.585 INFO:tasks.workunit.client.0.smithi045.stdout:6/870: write d9/d1a/d2d/ddf/f120 [378582,124181] 0 2024-09-18T12:52:35.588 INFO:tasks.workunit.client.0.smithi045.stdout:7/965: dread d13/d44/f135 [0,4194304] 0 2024-09-18T12:52:35.595 INFO:tasks.workunit.client.0.smithi045.stdout:6/871: chown d9/d30/ca9 208188 1 2024-09-18T12:52:35.597 INFO:tasks.workunit.client.0.smithi045.stdout:0/996: getdents d6/daa/dee/df9/d11e 0 2024-09-18T12:52:35.603 INFO:tasks.workunit.client.0.smithi045.stdout:7/966: dread d13/d1a/f2e [0,4194304] 0 2024-09-18T12:52:35.604 INFO:tasks.workunit.client.0.smithi045.stdout:6/872: symlink d9/d1a/d48/d8f/l125 0 2024-09-18T12:52:35.607 INFO:tasks.workunit.client.0.smithi045.stdout:7/967: symlink d13/d44/d4c/d82/d12b/l147 0 2024-09-18T12:52:35.610 INFO:tasks.workunit.client.0.smithi045.stdout:7/968: write d13/d31/d5f/d94/f117 [3337983,112579] 0 2024-09-18T12:52:35.611 INFO:tasks.workunit.client.0.smithi045.stdout:6/873: dwrite d9/d1a/d48/d7d/dcb/de1/f4e [4194304,4194304] 0 2024-09-18T12:52:35.618 INFO:tasks.workunit.client.0.smithi045.stdout:6/874: symlink d9/d1a/d48/d75/d106/l126 0 2024-09-18T12:52:35.619 INFO:tasks.workunit.client.0.smithi045.stdout:9/828: write d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/fc9 [262565,112847] 0 2024-09-18T12:52:35.627 INFO:tasks.workunit.client.0.smithi045.stdout:6/875: dread d9/d1a/d2d/d38/fe5 [0,4194304] 0 2024-09-18T12:52:35.628 INFO:tasks.workunit.client.0.smithi045.stdout:7/969: dwrite d13/d44/d37/d70/d77/f12d [0,4194304] 0 2024-09-18T12:52:35.629 INFO:tasks.workunit.client.0.smithi045.stdout:3/984: dwrite d0/d1e/d2c/f42 [0,4194304] 0 2024-09-18T12:52:35.639 INFO:tasks.workunit.client.0.smithi045.stdout:3/985: stat d0/d1e/d2c/d5c/f60 0 2024-09-18T12:52:35.642 INFO:tasks.workunit.client.0.smithi045.stdout:9/829: rename d0/d3/d6/d10/d26/d2e/d6f/da5/fb2 to d0/d3/ffe 0 2024-09-18T12:52:35.645 INFO:tasks.workunit.client.0.smithi045.stdout:7/970: mknod d13/d1a/d106/d127/c148 0 2024-09-18T12:52:35.646 INFO:tasks.workunit.client.0.smithi045.stdout:7/971: stat d13/d44/d37/d6a/lbe 0 2024-09-18T12:52:35.646 INFO:tasks.workunit.client.0.smithi045.stdout:3/986: symlink d0/d1e/d2c/d3a/d45/dbe/dd5/d112/l14f 0 2024-09-18T12:52:35.648 INFO:tasks.workunit.client.0.smithi045.stdout:9/830: symlink d0/d3/d6/d10/d2c/d63/lff 0 2024-09-18T12:52:35.648 INFO:tasks.workunit.client.0.smithi045.stdout:3/987: chown d0/d1e/d2c/d3a/d45/ffe 2 1 2024-09-18T12:52:35.654 INFO:tasks.workunit.client.0.smithi045.stdout:3/988: read d0/d1e/d39/fdc [2685380,127885] 0 2024-09-18T12:52:35.657 INFO:tasks.workunit.client.0.smithi045.stdout:6/876: write d9/d1a/f37 [743363,43019] 0 2024-09-18T12:52:35.658 INFO:tasks.workunit.client.0.smithi045.stdout:9/831: creat d0/db6/f100 x:0 0 0 2024-09-18T12:52:35.660 INFO:tasks.workunit.client.0.smithi045.stdout:3/989: rmdir d0/d1e/d2c/d3a/d45/dbe/dcc/dc4/d119 39 2024-09-18T12:52:35.662 INFO:tasks.workunit.client.0.smithi045.stdout:3/990: chown d0/d1e/d39/da8/dd6/d143/dff/d13a/d44/f78 9 1 2024-09-18T12:52:35.664 INFO:tasks.workunit.client.0.smithi045.stdout:7/972: write d13/d44/d37/fce [1939318,26603] 0 2024-09-18T12:52:35.669 INFO:tasks.workunit.client.0.smithi045.stdout:3/991: dwrite d0/d1e/d2c/d3a/d8a/df1/f11b [0,4194304] 0 2024-09-18T12:52:35.670 INFO:tasks.workunit.client.0.smithi045.stdout:9/832: symlink d0/d3/d6/d10/d26/d2e/l101 0 2024-09-18T12:52:35.671 INFO:tasks.workunit.client.0.smithi045.stdout:7/973: creat d13/d31/d5f/d94/f149 x:0 0 0 2024-09-18T12:52:35.677 INFO:tasks.workunit.client.0.smithi045.stdout:3/992: rename d0/d29/d5f/f10b to d0/d7/de9/f150 0 2024-09-18T12:52:35.678 INFO:tasks.workunit.client.0.smithi045.stdout:3/993: truncate d0/d29/f13c 9165648 0 2024-09-18T12:52:35.678 INFO:tasks.workunit.client.0.smithi045.stdout:9/833: rmdir d0/d3/d6/d10 39 2024-09-18T12:52:35.680 INFO:tasks.workunit.client.0.smithi045.stdout:3/994: write d0/d29/d5f/d73/da0/d131/db1/d11a/f11c [817361,26419] 0 2024-09-18T12:52:35.681 INFO:tasks.workunit.client.0.smithi045.stdout:7/974: mknod d13/d1a/d106/c14a 0 2024-09-18T12:52:35.682 INFO:tasks.workunit.client.0.smithi045.stdout:6/877: getdents d9/d1a/d2d/d32/db0 0 2024-09-18T12:52:35.684 INFO:tasks.workunit.client.0.smithi045.stdout:7/975: symlink d13/d1a/d106/d127/l14b 0 2024-09-18T12:52:35.686 INFO:tasks.workunit.client.0.smithi045.stdout:3/995: creat d0/d121/f151 x:0 0 0 2024-09-18T12:52:35.687 INFO:tasks.workunit.client.0.smithi045.stdout:9/834: creat d0/d3/d6/d10/d26/d2e/d6f/da5/dab/f102 x:0 0 0 2024-09-18T12:52:35.689 INFO:tasks.workunit.client.0.smithi045.stdout:7/976: unlink c12 0 2024-09-18T12:52:35.696 INFO:tasks.workunit.client.0.smithi045.stdout:6/878: dwrite d9/d56/fd9 [0,4194304] 0 2024-09-18T12:52:35.698 INFO:tasks.workunit.client.0.smithi045.stdout:7/977: link d13/d44/d4c/f62 d13/d1a/f14c 0 2024-09-18T12:52:35.702 INFO:tasks.workunit.client.0.smithi045.stdout:6/879: creat d9/d1a/d2d/ddf/f127 x:0 0 0 2024-09-18T12:52:35.703 INFO:tasks.workunit.client.0.smithi045.stdout:3/996: link d0/d1e/d2c/f63 d0/d1e/f152 0 2024-09-18T12:52:35.704 INFO:tasks.workunit.client.0.smithi045.stdout:6/880: chown d9/d30/l9a 10636 1 2024-09-18T12:52:35.706 INFO:tasks.workunit.client.0.smithi045.stdout:7/978: getdents d13/d1a/d106/d127 0 2024-09-18T12:52:35.709 INFO:tasks.workunit.client.0.smithi045.stdout:9/835: dwrite d0/d3/d6/d10/d26/d2e/f48 [0,4194304] 0 2024-09-18T12:52:35.709 INFO:tasks.workunit.client.0.smithi045.stdout:6/881: truncate d9/d1a/d48/dc1/fe4 75780 0 2024-09-18T12:52:35.715 INFO:tasks.workunit.client.0.smithi045.stdout:7/979: symlink d13/d44/d4c/l14d 0 2024-09-18T12:52:35.718 INFO:tasks.workunit.client.0.smithi045.stdout:9/836: mknod d0/d3/d6/d10/d26/d2e/d4e/db4/c103 0 2024-09-18T12:52:35.719 INFO:tasks.workunit.client.0.smithi045.stdout:3/997: dwrite d0/d29/d5f/d73/d87/f134 [0,4194304] 0 2024-09-18T12:52:35.721 INFO:tasks.workunit.client.0.smithi045.stdout:7/980: creat d13/d1a/d9b/f14e x:0 0 0 2024-09-18T12:52:35.725 INFO:tasks.workunit.client.0.smithi045.stdout:7/981: rmdir d13/d31 39 2024-09-18T12:52:35.726 INFO:tasks.workunit.client.0.smithi045.stdout:6/882: dwrite d9/d1a/d48/d7d/dcb/de1/f4e [4194304,4194304] 0 2024-09-18T12:52:35.733 INFO:tasks.workunit.client.0.smithi045.stdout:9/837: dwrite d0/d3/d6/d64/d77/da9/de6/fe9 [0,4194304] 0 2024-09-18T12:52:35.735 INFO:tasks.workunit.client.0.smithi045.stdout:6/883: rmdir d9/d1a/df3 39 2024-09-18T12:52:35.744 INFO:tasks.workunit.client.0.smithi045.stdout:6/884: mknod d9/c128 0 2024-09-18T12:52:35.745 INFO:tasks.workunit.client.0.smithi045.stdout:6/885: dread - d9/d1a/d48/dc1/f107 zero size 2024-09-18T12:52:35.747 INFO:tasks.workunit.client.0.smithi045.stdout:6/886: write d9/d1a/d48/dc1/f11a [128662,92319] 0 2024-09-18T12:52:35.748 INFO:tasks.workunit.client.0.smithi045.stdout:7/982: getdents d13/d31/d52 0 2024-09-18T12:52:35.751 INFO:tasks.workunit.client.0.smithi045.stdout:7/983: chown d13/d44/d37/d70/d77/d6d/fa2 45556 1 2024-09-18T12:52:35.754 INFO:tasks.workunit.client.0.smithi045.stdout:3/998: dwrite d0/d1e/d2c/d3a/d8a/f9b [0,4194304] 0 2024-09-18T12:52:35.757 INFO:tasks.workunit.client.0.smithi045.stdout:6/887: rename d9/d1a/d48/d7d to d9/d1a/d2d/d129 0 2024-09-18T12:52:35.757 INFO:tasks.workunit.client.0.smithi045.stdout:9/838: truncate d0/d3/d6/d10/d26/d2e/d4e/f67 597849 0 2024-09-18T12:52:35.759 INFO:tasks.workunit.client.0.smithi045.stdout:7/984: dread d13/d44/d37/d70/d77/f3c [4194304,4194304] 0 2024-09-18T12:52:35.765 INFO:tasks.workunit.client.0.smithi045.stdout:3/999: getdents d0/d1e/d2c/d3a/d8a 0 2024-09-18T12:52:35.776 INFO:tasks.workunit.client.0.smithi045.stdout:6/888: truncate d9/d1a/f37 1033258 0 2024-09-18T12:52:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:35 smithi045 ceph-mon[28315]: pgmap v40: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 49 MiB/s rd, 112 MiB/s wr, 299 op/s 2024-09-18T12:52:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:35 smithi045 ceph-mon[28315]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:35 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:35 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi045.brvbvl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:52:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:35 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi045.brvbvl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:52:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:35 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:52:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:35 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:35.785 INFO:tasks.workunit.client.0.smithi045.stdout:9/839: dwrite d0/d3/d6/d64/fa0 [0,4194304] 0 2024-09-18T12:52:35.786 INFO:tasks.workunit.client.0.smithi045.stdout:7/985: dwrite d13/d44/d37/d70/fd5 [0,4194304] 0 2024-09-18T12:52:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:35 smithi161 ceph-mon[35784]: pgmap v40: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 49 MiB/s rd, 112 MiB/s wr, 299 op/s 2024-09-18T12:52:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:35 smithi161 ceph-mon[35784]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:52:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:35 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:35 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi045.brvbvl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:52:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:35 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi045.brvbvl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:52:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:35 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:52:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:35 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:35.794 INFO:tasks.workunit.client.0.smithi045.stdout:7/986: dwrite d13/d31/d5f/f126 [0,4194304] 0 2024-09-18T12:52:35.804 INFO:tasks.workunit.client.0.smithi045.stdout:7/987: fdatasync d13/d31/d5f/d94/d139/f89 0 2024-09-18T12:52:35.813 INFO:tasks.workunit.client.0.smithi045.stdout:6/889: dread d9/d1a/d48/ff7 [0,4194304] 0 2024-09-18T12:52:35.850 INFO:tasks.workunit.client.0.smithi045.stdout:6/890: rename d9/d1a/d48/dc1/f107 to d9/d1a/d48/d8f/f12a 0 2024-09-18T12:52:35.851 INFO:tasks.workunit.client.0.smithi045.stdout:7/988: getdents d13/d31/d33 0 2024-09-18T12:52:35.853 INFO:tasks.workunit.client.0.smithi045.stdout:7/989: fsync d13/d31/d5f/f101 0 2024-09-18T12:52:35.856 INFO:tasks.workunit.client.0.smithi045.stdout:6/891: rename d9/d1a/d2d/ddf/f127 to d9/d1a/d48/d75/d81/f12b 0 2024-09-18T12:52:35.858 INFO:tasks.workunit.client.0.smithi045.stdout:7/990: write d13/d31/d33/fcb [3551174,82074] 0 2024-09-18T12:52:35.860 INFO:tasks.workunit.client.0.smithi045.stdout:7/991: chown d13/d44/f80 9 1 2024-09-18T12:52:35.861 INFO:tasks.workunit.client.0.smithi045.stdout:7/992: dread - d13/d44/d37/d70/d77/d6d/f146 zero size 2024-09-18T12:52:35.863 INFO:tasks.workunit.client.0.smithi045.stdout:7/993: creat d13/d31/d5f/d94/d139/f14f x:0 0 0 2024-09-18T12:52:35.865 INFO:tasks.workunit.client.0.smithi045.stdout:7/994: rmdir d13/d44 39 2024-09-18T12:52:35.879 INFO:tasks.workunit.client.0.smithi045.stdout:6/892: truncate d9/d1a/d2d/d129/f99 144960 0 2024-09-18T12:52:35.879 INFO:tasks.workunit.client.0.smithi045.stdout:6/893: chown d9/d56/ff5 627341 1 2024-09-18T12:52:35.881 INFO:tasks.workunit.client.0.smithi045.stdout:6/894: unlink d9/d56/db3/lbc 0 2024-09-18T12:52:35.882 INFO:tasks.workunit.client.0.smithi045.stdout:6/895: chown d9/d1a/d48/d75/dc7 0 1 2024-09-18T12:52:35.882 INFO:tasks.workunit.client.0.smithi045.stdout:7/995: write d13/d31/d33/fed [5729799,83292] 0 2024-09-18T12:52:35.885 INFO:tasks.workunit.client.0.smithi045.stdout:7/996: symlink d13/d1a/d9b/l150 0 2024-09-18T12:52:35.886 INFO:tasks.workunit.client.0.smithi045.stdout:6/896: creat d9/d1a/d2d/d32/db0/ddc/f12c x:0 0 0 2024-09-18T12:52:35.888 INFO:tasks.workunit.client.0.smithi045.stdout:6/897: dread - d9/d56/db3/fb8 zero size 2024-09-18T12:52:35.889 INFO:tasks.workunit.client.0.smithi045.stdout:7/997: mknod d13/d44/d4c/d82/d12b/c151 0 2024-09-18T12:52:35.893 INFO:tasks.workunit.client.0.smithi045.stdout:7/998: creat d13/d31/d52/d81/f152 x:0 0 0 2024-09-18T12:52:35.903 INFO:tasks.workunit.client.0.smithi045.stdout:7/999: dwrite d13/f10f [0,4194304] 0 2024-09-18T12:52:35.911 INFO:tasks.workunit.client.0.smithi045.stdout:6/898: dread d9/f13 [0,4194304] 0 2024-09-18T12:52:35.913 INFO:tasks.workunit.client.0.smithi045.stdout:6/899: dread - d9/d1a/d2d/d32/f105 zero size 2024-09-18T12:52:35.914 INFO:tasks.workunit.client.0.smithi045.stdout:6/900: chown d9/d1a/f80 88305026 1 2024-09-18T12:52:35.923 INFO:tasks.workunit.client.0.smithi045.stdout:6/901: getdents d9/d1a/d48/d8f/d9f 0 2024-09-18T12:52:35.930 INFO:tasks.workunit.client.0.smithi045.stdout:6/902: dread d9/d1a/d2d/d129/dcb/de1/f25 [0,4194304] 0 2024-09-18T12:52:35.934 INFO:tasks.workunit.client.0.smithi045.stdout:6/903: chown d9/d74/ff8 7256 1 2024-09-18T12:52:35.935 INFO:tasks.workunit.client.0.smithi045.stdout:6/904: stat d9/d30/lba 0 2024-09-18T12:52:35.936 INFO:tasks.workunit.client.0.smithi045.stdout:6/905: write d9/d1a/d2d/d38/f82 [5027033,14411] 0 2024-09-18T12:52:35.940 INFO:tasks.workunit.client.0.smithi045.stdout:6/906: chown d9/d1a/d2d/ddf/f120 0 1 2024-09-18T12:52:35.941 INFO:tasks.workunit.client.0.smithi045.stdout:6/907: write d9/d1a/d2d/d32/db0/d11b/f118 [319607,1395] 0 2024-09-18T12:52:35.942 INFO:tasks.workunit.client.0.smithi045.stdout:6/908: symlink d9/d1a/d48/d116/l12d 0 2024-09-18T12:52:35.947 INFO:tasks.workunit.client.0.smithi045.stdout:6/909: creat d9/d1a/d2d/d38/d5b/f12e x:0 0 0 2024-09-18T12:52:35.950 INFO:tasks.workunit.client.0.smithi045.stdout:6/910: fsync d9/d1a/d48/d75/d81/f12b 0 2024-09-18T12:52:35.952 INFO:tasks.workunit.client.0.smithi045.stdout:6/911: creat d9/d1a/d2d/d38/d5b/f12f x:0 0 0 2024-09-18T12:52:35.955 INFO:tasks.workunit.client.0.smithi045.stdout:6/912: creat d9/d1a/d48/d8f/d98/dab/dec/dfe/d11c/f130 x:0 0 0 2024-09-18T12:52:35.976 INFO:tasks.workunit.client.0.smithi045.stdout:0/997: sync 2024-09-18T12:52:35.978 INFO:tasks.workunit.client.0.smithi045.stdout:0/998: dread - d6/daa/fed zero size 2024-09-18T12:52:35.980 INFO:tasks.workunit.client.0.smithi045.stdout:0/999: symlink d6/d48/d5e/d39/d58/d3b/d65/l12d 0 2024-09-18T12:52:35.985 INFO:tasks.workunit.client.0.smithi045.stdout:6/913: write d9/d1a/d2d/f4a [120892,116393] 0 2024-09-18T12:52:35.996 INFO:tasks.workunit.client.0.smithi045.stdout:6/914: dread d9/d1a/d2d/d38/f3d [0,4194304] 0 2024-09-18T12:52:35.998 INFO:tasks.workunit.client.0.smithi045.stdout:6/915: mkdir d9/d1a/d48/dc1/d131 0 2024-09-18T12:52:36.000 INFO:tasks.workunit.client.0.smithi045.stdout:6/916: rename d9/l123 to d9/d1a/d2d/ddf/l132 0 2024-09-18T12:52:36.002 INFO:tasks.workunit.client.0.smithi045.stdout:6/917: mknod d9/d1a/d48/d75/dc7/c133 0 2024-09-18T12:52:36.005 INFO:tasks.workunit.client.0.smithi045.stdout:6/918: creat d9/d56/db3/f134 x:0 0 0 2024-09-18T12:52:36.011 INFO:tasks.workunit.client.0.smithi045.stdout:6/919: write d9/d1a/d48/fb9 [308577,109385] 0 2024-09-18T12:52:36.014 INFO:tasks.workunit.client.0.smithi045.stdout:6/920: symlink d9/d1a/d2d/d32/l135 0 2024-09-18T12:52:36.015 INFO:tasks.workunit.client.0.smithi045.stdout:6/921: readlink d9/d1a/d2d/d38/l55 0 2024-09-18T12:52:36.021 INFO:tasks.workunit.client.0.smithi045.stdout:6/922: dwrite d9/d1a/d2d/d129/dcb/de1/f5a [0,4194304] 0 2024-09-18T12:52:36.021 INFO:tasks.workunit.client.0.smithi045.stdout:6/923: stat d9/d74/fa4 0 2024-09-18T12:52:36.022 INFO:tasks.workunit.client.0.smithi045.stdout:6/924: fdatasync d9/d1a/d48/d97/fa8 0 2024-09-18T12:52:36.031 INFO:tasks.workunit.client.0.smithi045.stdout:6/925: write d9/d56/f57 [628998,59955] 0 2024-09-18T12:52:36.035 INFO:tasks.workunit.client.0.smithi045.stdout:6/926: dread d9/d1a/d2d/d129/dcb/de1/f84 [0,4194304] 0 2024-09-18T12:52:36.037 INFO:tasks.workunit.client.0.smithi045.stdout:6/927: symlink d9/d1a/d48/d75/d81/dbb/l136 0 2024-09-18T12:52:36.039 INFO:tasks.workunit.client.0.smithi045.stdout:6/928: creat d9/d1a/d48/dc1/f137 x:0 0 0 2024-09-18T12:52:36.042 INFO:tasks.workunit.client.0.smithi045.stdout:6/929: mkdir d9/d1a/d2d/d32/db0/d11b/d138 0 2024-09-18T12:52:36.043 INFO:tasks.workunit.client.0.smithi045.stdout:6/930: write d9/d1a/d48/d75/d106/f11d [701932,122556] 0 2024-09-18T12:52:36.044 INFO:tasks.workunit.client.0.smithi045.stdout:6/931: chown d9/d56/c58 4857688 1 2024-09-18T12:52:36.046 INFO:tasks.workunit.client.0.smithi045.stdout:6/932: unlink d9/d1a/d2d/d129/dcb/cce 0 2024-09-18T12:52:36.048 INFO:tasks.workunit.client.0.smithi045.stdout:6/933: write d9/d1a/d48/d75/d81/fa3 [2250906,127129] 0 2024-09-18T12:52:36.050 INFO:tasks.workunit.client.0.smithi045.stdout:6/934: dread d9/d1a/d2d/d129/dcb/de1/f84 [0,4194304] 0 2024-09-18T12:52:36.052 INFO:tasks.workunit.client.0.smithi045.stdout:6/935: unlink d9/d1a/d2d/d129/dcb/de1/l4d 0 2024-09-18T12:52:36.053 INFO:tasks.workunit.client.0.smithi045.stdout:6/936: fdatasync d9/d1a/d48/fb9 0 2024-09-18T12:52:36.057 INFO:tasks.workunit.client.0.smithi045.stdout:6/937: mknod d9/d1a/d2d/d38/d5b/d67/c139 0 2024-09-18T12:52:36.057 INFO:tasks.workunit.client.0.smithi045.stdout:6/938: stat d9/d1a/d48/d8f/d98/dab/fe0 0 2024-09-18T12:52:36.059 INFO:tasks.workunit.client.0.smithi045.stdout:6/939: write d9/d1a/d48/dc1/f11a [865695,79609] 0 2024-09-18T12:52:36.070 INFO:tasks.workunit.client.0.smithi045.stdout:6/940: dwrite d9/d1a/d48/d8f/d98/dab/f100 [0,4194304] 0 2024-09-18T12:52:36.074 INFO:tasks.workunit.client.0.smithi045.stdout:6/941: symlink d9/d1a/d48/d75/dc7/l13a 0 2024-09-18T12:52:36.079 INFO:tasks.workunit.client.0.smithi045.stdout:6/942: getdents d9/d56 0 2024-09-18T12:52:36.080 INFO:tasks.workunit.client.0.smithi045.stdout:6/943: mkdir d9/d56/d13b 0 2024-09-18T12:52:36.097 INFO:tasks.workunit.client.0.smithi045.stdout:6/944: rename d9/d56/db3/f134 to d9/d56/db3/f13c 0 2024-09-18T12:52:36.102 INFO:tasks.workunit.client.0.smithi045.stdout:6/945: write d9/d1a/d2d/d32/db0/ddc/f11e [1930790,106448] 0 2024-09-18T12:52:36.105 INFO:tasks.workunit.client.0.smithi045.stdout:6/946: dread d9/d56/fd3 [0,4194304] 0 2024-09-18T12:52:36.107 INFO:tasks.workunit.client.0.smithi045.stdout:6/947: unlink d9/d56/db3/le3 0 2024-09-18T12:52:36.109 INFO:tasks.workunit.client.0.smithi045.stdout:6/948: mknod d9/d56/c13d 0 2024-09-18T12:52:36.111 INFO:tasks.workunit.client.0.smithi045.stdout:6/949: getdents d9/d1a/d2d/d32/db0/d11b/d138 0 2024-09-18T12:52:36.122 INFO:tasks.workunit.client.0.smithi045.stdout:6/950: write d9/d1a/d48/d75/fc8 [184216,61354] 0 2024-09-18T12:52:36.128 INFO:tasks.workunit.client.0.smithi045.stdout:6/951: link d9/d1a/df3/fd6 d9/d1a/d2d/d38/f13e 0 2024-09-18T12:52:36.130 INFO:tasks.workunit.client.0.smithi045.stdout:6/952: write d9/d1a/d2d/d38/d5b/d67/ff2 [1161496,12280] 0 2024-09-18T12:52:36.132 INFO:tasks.workunit.client.0.smithi045.stdout:6/953: readlink d9/d1a/d48/d8f/d9f/le7 0 2024-09-18T12:52:36.135 INFO:tasks.workunit.client.0.smithi045.stdout:6/954: dread d9/d1a/d48/fb1 [4194304,4194304] 0 2024-09-18T12:52:36.136 INFO:tasks.workunit.client.0.smithi045.stdout:6/955: chown d9/d1a/d48/fb1 30283 1 2024-09-18T12:52:36.141 INFO:tasks.workunit.client.0.smithi045.stdout:6/956: link d9/d56/d10d/c10f d9/d56/c13f 0 2024-09-18T12:52:36.142 INFO:tasks.workunit.client.0.smithi045.stdout:6/957: stat d9/d30/d6c/f11f 0 2024-09-18T12:52:36.144 INFO:tasks.workunit.client.0.smithi045.stdout:6/958: creat d9/d1a/d48/d116/f140 x:0 0 0 2024-09-18T12:52:36.186 INFO:tasks.workunit.client.0.smithi045.stdout:9/840: sync 2024-09-18T12:52:36.187 INFO:tasks.workunit.client.0.smithi045.stdout:9/841: chown d0/l18 80392 1 2024-09-18T12:52:36.188 INFO:tasks.workunit.client.0.smithi045.stdout:9/842: chown d0/d3/d6/d10/d2c/d63/f7e 4 1 2024-09-18T12:52:36.189 INFO:tasks.workunit.client.0.smithi045.stdout:9/843: fsync d0/d3/d6/d10/d26/d2e/f48 0 2024-09-18T12:52:36.191 INFO:tasks.workunit.client.0.smithi045.stdout:9/844: fdatasync d0/d3/d6/d10/d26/d2e/d6f/da5/fbc 0 2024-09-18T12:52:36.202 INFO:tasks.workunit.client.0.smithi045.stdout:9/845: dread d0/d3/d6/d9d/fd7 [0,4194304] 0 2024-09-18T12:52:36.333 INFO:tasks.workunit.client.0.smithi045.stdout:9/846: symlink d0/de5/l104 0 2024-09-18T12:52:36.335 INFO:tasks.workunit.client.0.smithi045.stdout:9/847: read d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/ff0 [1241976,2626] 0 2024-09-18T12:52:36.344 INFO:tasks.workunit.client.0.smithi045.stdout:9/848: dwrite d0/d3/f90 [0,4194304] 0 2024-09-18T12:52:36.348 INFO:tasks.workunit.client.0.smithi045.stdout:9/849: truncate d0/f50 2905087 0 2024-09-18T12:52:36.393 INFO:tasks.workunit.client.0.smithi045.stdout:9/850: dread d0/d3/d6/d10/d2c/d63/f7e [0,4194304] 0 2024-09-18T12:52:36.409 INFO:tasks.workunit.client.0.smithi045.stdout:9/851: dread d0/d3/d6/d10/d2c/f80 [0,4194304] 0 2024-09-18T12:52:36.410 INFO:tasks.workunit.client.0.smithi045.stdout:9/852: mknod d0/d3/d6/d10/d2c/c105 0 2024-09-18T12:52:36.420 INFO:tasks.workunit.client.0.smithi045.stdout:9/853: write d0/f59 [365816,34445] 0 2024-09-18T12:52:36.420 INFO:tasks.workunit.client.0.smithi045.stdout:9/854: readlink d0/l18 0 2024-09-18T12:52:36.426 INFO:tasks.workunit.client.0.smithi045.stdout:9/855: dwrite d0/d3/d6/f98 [0,4194304] 0 2024-09-18T12:52:36.428 INFO:tasks.workunit.client.0.smithi045.stdout:9/856: write d0/d3/d6/f4f [1477518,34265] 0 2024-09-18T12:52:36.441 INFO:tasks.workunit.client.0.smithi045.stdout:9/857: write d0/d3/f1f [542391,128791] 0 2024-09-18T12:52:36.444 INFO:tasks.workunit.client.0.smithi045.stdout:9/858: mkdir d0/d3/d6/d64/d77/da9/d106 0 2024-09-18T12:52:36.445 INFO:tasks.workunit.client.0.smithi045.stdout:9/859: chown d0/d3/d6/d10/d26/d2e/d4e/f9f 1996418 1 2024-09-18T12:52:36.451 INFO:tasks.workunit.client.0.smithi045.stdout:9/860: dwrite d0/d3/d6/d64/fa0 [0,4194304] 0 2024-09-18T12:52:36.462 INFO:tasks.workunit.client.0.smithi045.stdout:9/861: dread d0/d3/d6/d10/d26/d2e/d4e/d76/fd2 [0,4194304] 0 2024-09-18T12:52:36.465 INFO:tasks.workunit.client.0.smithi045.stdout:9/862: fdatasync d0/d3/d6/d10/d26/f60 0 2024-09-18T12:52:36.468 INFO:tasks.workunit.client.0.smithi045.stdout:9/863: mkdir d0/d3/d6/d64/d77/dd5/df8/d107 0 2024-09-18T12:52:36.468 INFO:tasks.workunit.client.0.smithi045.stdout:9/864: read - d0/d3/d6/fe4 zero size 2024-09-18T12:52:36.473 INFO:tasks.workunit.client.0.smithi045.stdout:9/865: rename d0/d3/d6/d10/d26/d2e/d4e/d76/d89/cb1 to d0/c108 0 2024-09-18T12:52:36.478 INFO:tasks.workunit.client.0.smithi045.stdout:9/866: link d0/d3/d6/d10/d2c/d63/f87 d0/d3/d6/d64/d77/dc5/f109 0 2024-09-18T12:52:36.479 INFO:tasks.workunit.client.0.smithi045.stdout:9/867: dread - d0/d3/d6/d10/d26/ff6 zero size 2024-09-18T12:52:36.482 INFO:tasks.workunit.client.0.smithi045.stdout:9/868: getdents d0/d3/d6/d10/df7 0 2024-09-18T12:52:36.483 INFO:tasks.workunit.client.0.smithi045.stdout:9/869: fsync d0/d3/d6/d10/d26/d2e/f48 0 2024-09-18T12:52:36.486 INFO:tasks.workunit.client.0.smithi045.stdout:9/870: rmdir d0/d3/d6/d10/d26/d2e/d4e/d76/d89 39 2024-09-18T12:52:36.487 INFO:tasks.workunit.client.0.smithi045.stdout:9/871: fsync d0/d3/d6/d10/d26/d2e/d4e/d76/f8b 0 2024-09-18T12:52:36.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:36 smithi045 ceph-mon[28315]: Upgrade: Updating mgr.smithi045.brvbvl 2024-09-18T12:52:36.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:36 smithi045 ceph-mon[28315]: Deploying daemon mgr.smithi045.brvbvl on smithi045 2024-09-18T12:52:36.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:36 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:36.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:36 smithi161 ceph-mon[35784]: Upgrade: Updating mgr.smithi045.brvbvl 2024-09-18T12:52:36.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:36 smithi161 ceph-mon[35784]: Deploying daemon mgr.smithi045.brvbvl on smithi045 2024-09-18T12:52:36.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:36 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:36.857 INFO:tasks.workunit.client.0.smithi045.stdout:6/959: sync 2024-09-18T12:52:36.857 INFO:tasks.workunit.client.0.smithi045.stdout:6/960: stat d9/d1a/d2d/d38/ld1 0 2024-09-18T12:52:36.858 INFO:tasks.workunit.client.0.smithi045.stdout:6/961: dread - d9/d1a/d48/d116/f140 zero size 2024-09-18T12:52:36.881 INFO:tasks.workunit.client.0.smithi045.stdout:6/962: unlink d9/d1a/d2d/d129/dcb/de1/f25 0 2024-09-18T12:52:36.883 INFO:tasks.workunit.client.0.smithi045.stdout:6/963: truncate d9/d1a/d2d/d38/d5b/d67/f79 9223677 0 2024-09-18T12:52:36.884 INFO:tasks.workunit.client.0.smithi045.stdout:6/964: truncate d9/d1a/d48/d8f/d98/fff 193840 0 2024-09-18T12:52:36.886 INFO:tasks.workunit.client.0.smithi045.stdout:6/965: rmdir d9/d1a/d2d/d38/d5b 39 2024-09-18T12:52:36.892 INFO:tasks.workunit.client.0.smithi045.stdout:6/966: link d9/d56/c58 d9/d56/c141 0 2024-09-18T12:52:36.921 INFO:tasks.workunit.client.0.smithi045.stdout:9/872: sync 2024-09-18T12:52:36.941 INFO:tasks.workunit.client.0.smithi045.stdout:6/967: dwrite d9/d1a/d2d/ddf/ff0 [0,4194304] 0 2024-09-18T12:52:36.952 INFO:tasks.workunit.client.0.smithi045.stdout:6/968: creat d9/d1a/d2d/d38/d5b/d67/f142 x:0 0 0 2024-09-18T12:52:36.956 INFO:tasks.workunit.client.0.smithi045.stdout:6/969: chown d9/l60 317973 1 2024-09-18T12:52:36.963 INFO:tasks.workunit.client.0.smithi045.stdout:6/970: dwrite d9/d1a/d2d/f4a [4194304,4194304] 0 2024-09-18T12:52:36.968 INFO:tasks.workunit.client.0.smithi045.stdout:6/971: write d9/d1a/d2d/d129/dcb/de1/f5a [1060138,117031] 0 2024-09-18T12:52:36.983 INFO:tasks.workunit.client.0.smithi045.stdout:6/972: write d9/d1a/d2d/d32/f62 [2123785,82080] 0 2024-09-18T12:52:36.985 INFO:tasks.workunit.client.0.smithi045.stdout:6/973: creat d9/d1a/d48/d8f/d98/dab/f143 x:0 0 0 2024-09-18T12:52:36.991 INFO:tasks.workunit.client.0.smithi045.stdout:6/974: dwrite d9/d1a/d48/d97/fa8 [0,4194304] 0 2024-09-18T12:52:37.007 INFO:tasks.workunit.client.0.smithi045.stdout:6/975: dread d9/d1a/d2d/d38/d5b/d121/f117 [0,4194304] 0 2024-09-18T12:52:37.011 INFO:tasks.workunit.client.0.smithi045.stdout:6/976: creat d9/d1a/d2d/d38/f144 x:0 0 0 2024-09-18T12:52:37.021 INFO:tasks.workunit.client.0.smithi045.stdout:6/977: dread d9/d1a/d2d/d32/f62 [0,4194304] 0 2024-09-18T12:52:37.028 INFO:tasks.workunit.client.0.smithi045.stdout:6/978: dwrite d9/d1a/d2d/d129/dcb/de1/f84 [0,4194304] 0 2024-09-18T12:52:37.040 INFO:tasks.workunit.client.0.smithi045.stdout:6/979: write d9/d1a/d48/d8f/d98/dab/fe0 [3941257,957] 0 2024-09-18T12:52:37.048 INFO:tasks.workunit.client.0.smithi045.stdout:6/980: write d9/d1a/d2d/d38/d5b/f86 [856746,27617] 0 2024-09-18T12:52:37.049 INFO:tasks.workunit.client.0.smithi045.stdout:6/981: fdatasync d9/d1a/d48/d8f/d98/dab/dec/dfe/d11c/f130 0 2024-09-18T12:52:37.050 INFO:tasks.workunit.client.0.smithi045.stdout:6/982: chown d9/d1a/d2d/d32/f105 805292711 1 2024-09-18T12:52:37.052 INFO:tasks.workunit.client.0.smithi045.stdout:6/983: mknod d9/d1a/d2d/d32/db0/d11b/c145 0 2024-09-18T12:52:37.053 INFO:tasks.workunit.client.0.smithi045.stdout:6/984: dread - d9/d56/db3/f13c zero size 2024-09-18T12:52:37.057 INFO:tasks.workunit.client.0.smithi045.stdout:6/985: mknod d9/d30/d6c/c146 0 2024-09-18T12:52:37.059 INFO:tasks.workunit.client.0.smithi045.stdout:6/986: dread d9/d1a/d48/d8f/d98/fff [0,4194304] 0 2024-09-18T12:52:37.060 INFO:tasks.workunit.client.0.smithi045.stdout:6/987: mknod d9/d1a/df3/c147 0 2024-09-18T12:52:37.061 INFO:tasks.workunit.client.0.smithi045.stdout:6/988: symlink d9/d1a/d2d/d129/l148 0 2024-09-18T12:52:37.063 INFO:tasks.workunit.client.0.smithi045.stdout:6/989: creat d9/d56/f149 x:0 0 0 2024-09-18T12:52:37.067 INFO:tasks.workunit.client.0.smithi045.stdout:6/990: link d9/d1a/d48/d8f/d98/cb4 d9/d1a/d2d/d129/dcb/de1/c14a 0 2024-09-18T12:52:37.070 INFO:tasks.workunit.client.0.smithi045.stdout:6/991: creat d9/d1a/d48/d8f/d98/dab/dec/dfe/d11c/f14b x:0 0 0 2024-09-18T12:52:37.089 INFO:tasks.workunit.client.0.smithi045.stdout:6/992: write d9/d1a/d2d/d38/f44 [1643863,124314] 0 2024-09-18T12:52:37.092 INFO:tasks.workunit.client.0.smithi045.stdout:6/993: creat d9/d1a/d48/d75/d81/f14c x:0 0 0 2024-09-18T12:52:37.096 INFO:tasks.workunit.client.0.smithi045.stdout:9/873: sync 2024-09-18T12:52:37.098 INFO:tasks.workunit.client.0.smithi045.stdout:6/994: dwrite d9/d1a/d48/d8f/d98/dab/f143 [0,4194304] 0 2024-09-18T12:52:37.100 INFO:tasks.workunit.client.0.smithi045.stdout:6/995: write d9/d1a/d2d/f4a [9337457,106699] 0 2024-09-18T12:52:37.102 INFO:tasks.workunit.client.0.smithi045.stdout:6/996: chown d9/d1a/d48/d8f/d98/cca 0 1 2024-09-18T12:52:37.109 INFO:tasks.workunit.client.0.smithi045.stdout:6/997: mknod d9/d1a/d2d/d38/d5b/c14d 0 2024-09-18T12:52:37.116 INFO:tasks.workunit.client.0.smithi045.stdout:6/998: creat d9/d1a/d2d/f14e x:0 0 0 2024-09-18T12:52:37.118 INFO:tasks.workunit.client.0.smithi045.stdout:6/999: stat d9/d1a/d2d/d129/dcb/de1/c14a 0 2024-09-18T12:52:37.118 INFO:tasks.workunit.client.0.smithi045.stdout:9/874: write d0/d3/d6/fb7 [3253330,65985] 0 2024-09-18T12:52:37.126 INFO:tasks.workunit.client.0.smithi045.stdout:9/875: dwrite d0/d3/d6/d9d/fd7 [0,4194304] 0 2024-09-18T12:52:37.132 INFO:tasks.workunit.client.0.smithi045.stdout:9/876: dwrite d0/d3/d6/f98 [0,4194304] 0 2024-09-18T12:52:37.133 INFO:tasks.workunit.client.0.smithi045.stdout:9/877: chown d0/f1a 19 1 2024-09-18T12:52:37.136 INFO:tasks.workunit.client.0.smithi045.stdout:9/878: write d0/d3/d6/d64/dc1/fe2 [3152320,42963] 0 2024-09-18T12:52:37.139 INFO:tasks.workunit.client.0.smithi045.stdout:9/879: creat d0/d3/d6/d64/f10a x:0 0 0 2024-09-18T12:52:37.140 INFO:tasks.workunit.client.0.smithi045.stdout:9/880: chown d0/d3/d6/d64/d77/dd5/df8 2434938 1 2024-09-18T12:52:37.143 INFO:tasks.workunit.client.0.smithi045.stdout:9/881: mkdir d0/d3/d6/d10/d26/d2e/d10b 0 2024-09-18T12:52:37.147 INFO:tasks.workunit.client.0.smithi045.stdout:9/882: rename d0/d3/d6/d10/d26/ff6 to d0/db6/f10c 0 2024-09-18T12:52:37.148 INFO:tasks.workunit.client.0.smithi045.stdout:9/883: dread - d0/d3/f31 zero size 2024-09-18T12:52:37.150 INFO:tasks.workunit.client.0.smithi045.stdout:9/884: mkdir d0/d3/d6/d64/d88/dc0/df4/d10d 0 2024-09-18T12:52:37.151 INFO:tasks.workunit.client.0.smithi045.stdout:9/885: readlink d0/d3/d6/d64/d88/lad 0 2024-09-18T12:52:37.152 INFO:tasks.workunit.client.0.smithi045.stdout:9/886: mkdir d0/d3/d6/d10/d26/da4/d10e 0 2024-09-18T12:52:37.164 INFO:tasks.workunit.client.0.smithi045.stdout:9/887: write d0/f66 [3122498,19409] 0 2024-09-18T12:52:37.167 INFO:tasks.workunit.client.0.smithi045.stdout:9/888: mknod d0/d3/d6/d10/df7/c10f 0 2024-09-18T12:52:37.171 INFO:tasks.workunit.client.0.smithi045.stdout:9/889: rename d0/d3/d6/d64/f9c to d0/d3/d6/d10/d26/d2e/f110 0 2024-09-18T12:52:37.172 INFO:tasks.workunit.client.0.smithi045.stdout:9/890: stat d0/d3/d6/d10/d26/d2e/d4e 0 2024-09-18T12:52:37.176 INFO:tasks.workunit.client.0.smithi045.stdout:9/891: rename d0/d3/d6/d10/d2c/f57 to d0/d3/d6/d64/d77/da9/f111 0 2024-09-18T12:52:37.194 INFO:tasks.workunit.client.0.smithi045.stdout:9/892: dwrite d0/d3/d6/d10/d26/f60 [0,4194304] 0 2024-09-18T12:52:37.196 INFO:tasks.workunit.client.0.smithi045.stdout:9/893: readlink d0/d3/d6/d10/d26/d2e/d4e/la2 0 2024-09-18T12:52:37.211 INFO:tasks.workunit.client.0.smithi045.stdout:9/894: dread d0/d3/d6/d64/d77/dd5/df8/fb8 [0,4194304] 0 2024-09-18T12:52:37.234 INFO:tasks.workunit.client.0.smithi045.stdout:9/895: dwrite d0/d3/d6/d10/d26/d2e/d4e/f5a [4194304,4194304] 0 2024-09-18T12:52:37.238 INFO:tasks.workunit.client.0.smithi045.stdout:9/896: mknod d0/d3/d6/d64/d88/dc0/df4/c112 0 2024-09-18T12:52:37.256 INFO:tasks.workunit.client.0.smithi045.stdout:9/897: dwrite d0/d3/d6/d10/d2c/f49 [0,4194304] 0 2024-09-18T12:52:37.270 INFO:tasks.workunit.client.0.smithi045.stdout:9/898: dread d0/d3/d6/d10/d26/f62 [0,4194304] 0 2024-09-18T12:52:37.271 INFO:tasks.workunit.client.0.smithi045.stdout:9/899: chown d0/d3/d6/d64/d88/dc0/df4/d10d 308036 1 2024-09-18T12:52:37.272 INFO:tasks.workunit.client.0.smithi045.stdout:9/900: fdatasync d0/d3/d6/d10/d26/d2e/d4e/d76/f8b 0 2024-09-18T12:52:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:37 smithi045 ceph-mon[28315]: pgmap v41: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 61 MiB/s rd, 140 MiB/s wr, 405 op/s 2024-09-18T12:52:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:37 smithi161 ceph-mon[35784]: pgmap v41: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 61 MiB/s rd, 140 MiB/s wr, 405 op/s 2024-09-18T12:52:37.871 INFO:tasks.workunit.client.0.smithi045.stdout:9/901: sync 2024-09-18T12:52:37.872 INFO:tasks.workunit.client.0.smithi045.stdout:9/902: chown d0/d3/d6/d10/d26/d2e/d6f/l84 1743 1 2024-09-18T12:52:37.876 INFO:tasks.workunit.client.0.smithi045.stdout:9/903: mknod d0/d3/d6/d10/d26/d2e/d6f/df3/c113 0 2024-09-18T12:52:37.877 INFO:tasks.workunit.client.0.smithi045.stdout:9/904: write d0/d3/d6/f2d [203452,104358] 0 2024-09-18T12:52:37.879 INFO:tasks.workunit.client.0.smithi045.stdout:9/905: fsync d0/d3/f31 0 2024-09-18T12:52:37.880 INFO:tasks.workunit.client.0.smithi045.stdout:9/906: fsync d0/f61 0 2024-09-18T12:52:37.884 INFO:tasks.workunit.client.0.smithi045.stdout:9/907: chown d0/d3/d6/d10/d26/d2e/d4e/f67 1199 1 2024-09-18T12:52:37.885 INFO:tasks.workunit.client.0.smithi045.stdout:9/908: chown d0/d3/d6/d64/d77/da9/d106 6 1 2024-09-18T12:52:37.888 INFO:tasks.workunit.client.0.smithi045.stdout:9/909: dread d0/d3/d6/d10/d26/da4/fb3 [0,4194304] 0 2024-09-18T12:52:37.889 INFO:tasks.workunit.client.0.smithi045.stdout:9/910: write d0/d3/d6/f4f [4403342,74078] 0 2024-09-18T12:52:37.893 INFO:tasks.workunit.client.0.smithi045.stdout:9/911: truncate d0/d3/d6/d9d/fb5 3167617 0 2024-09-18T12:52:37.924 INFO:tasks.workunit.client.0.smithi045.stdout:9/912: dwrite d0/d3/f2b [0,4194304] 0 2024-09-18T12:52:37.932 INFO:tasks.workunit.client.0.smithi045.stdout:9/913: mkdir d0/d3/d6/d9d/d114 0 2024-09-18T12:52:37.953 INFO:tasks.workunit.client.0.smithi045.stdout:9/914: truncate d0/f50 1312026 0 2024-09-18T12:52:37.957 INFO:tasks.workunit.client.0.smithi045.stdout:9/915: symlink d0/d3/d6/d64/d88/dc0/df4/l115 0 2024-09-18T12:52:37.959 INFO:tasks.workunit.client.0.smithi045.stdout:9/916: write d0/d3/d6/d10/d2c/f49 [6548504,49198] 0 2024-09-18T12:52:37.962 INFO:tasks.workunit.client.0.smithi045.stdout:9/917: creat d0/d3/d6/d10/d26/f116 x:0 0 0 2024-09-18T12:52:37.976 INFO:tasks.workunit.client.0.smithi045.stdout:9/918: getdents d0/d3/d6 0 2024-09-18T12:52:37.978 INFO:tasks.workunit.client.0.smithi045.stdout:9/919: write d0/d3/d6/d10/d26/d2e/f6a [94444,21262] 0 2024-09-18T12:52:38.394 INFO:tasks.workunit.client.0.smithi045.stdout:9/920: sync 2024-09-18T12:52:38.400 INFO:tasks.workunit.client.0.smithi045.stdout:9/921: dwrite d0/d3/d6/d64/fa0 [0,4194304] 0 2024-09-18T12:52:38.413 INFO:tasks.workunit.client.0.smithi045.stdout:9/922: truncate d0/d3/d6/d10/d26/d2e/d4e/f9f 12346265 0 2024-09-18T12:52:38.429 INFO:tasks.workunit.client.0.smithi045.stdout:9/923: dread d0/d3/d6/d10/d26/d2e/f32 [0,4194304] 0 2024-09-18T12:52:38.430 INFO:tasks.workunit.client.0.smithi045.stdout:9/924: chown d0/d3/laa 0 1 2024-09-18T12:52:38.433 INFO:tasks.workunit.client.0.smithi045.stdout:9/925: mknod d0/d3/d6/d64/d77/da9/d106/c117 0 2024-09-18T12:52:38.438 INFO:tasks.workunit.client.0.smithi045.stdout:9/926: dwrite d0/f59 [0,4194304] 0 2024-09-18T12:52:38.444 INFO:tasks.workunit.client.0.smithi045.stdout:9/927: rename d0/db6 to d0/d3/d6/d10/d26/d2e/d6f/da5/dab/d118 0 2024-09-18T12:52:38.446 INFO:tasks.workunit.client.0.smithi045.stdout:9/928: mknod d0/d3/d6/c119 0 2024-09-18T12:52:38.463 INFO:tasks.workunit.client.0.smithi045.stdout:9/929: chown d0/d3/d6/d64/d77/dc5/f109 31 1 2024-09-18T12:52:38.465 INFO:tasks.workunit.client.0.smithi045.stdout:9/930: chown d0/d3/d6/d10/d26/d2e/d6f/df3/c113 3143886 1 2024-09-18T12:52:38.468 INFO:tasks.workunit.client.0.smithi045.stdout:9/931: rename d0/d3/d6/d10/d26/c38 to d0/d3/d6/d64/dc1/c11a 0 2024-09-18T12:52:38.470 INFO:tasks.workunit.client.0.smithi045.stdout:9/932: truncate d0/d3/d6/d10/d26/f116 413993 0 2024-09-18T12:52:38.481 INFO:tasks.workunit.client.0.smithi045.stdout:9/933: dwrite d0/d3/d6/d10/d26/da4/fb3 [0,4194304] 0 2024-09-18T12:52:38.482 INFO:tasks.workunit.client.0.smithi045.stdout:9/934: chown d0/d3/d6/d10/f29 2 1 2024-09-18T12:52:38.484 INFO:tasks.workunit.client.0.smithi045.stdout:9/935: chown d0/d3/d6/d10/d26/d2e/d4e/d76/fd2 7736457 1 2024-09-18T12:52:38.488 INFO:tasks.workunit.client.0.smithi045.stdout:9/936: symlink d0/d3/d6/d10/d26/d2e/d10b/l11b 0 2024-09-18T12:52:38.491 INFO:tasks.workunit.client.0.smithi045.stdout:9/937: truncate d0/d3/d6/d10/d26/d2e/d6f/da5/dab/f102 694030 0 2024-09-18T12:52:38.502 INFO:tasks.workunit.client.0.smithi045.stdout:9/938: dwrite d0/d3/d6/d10/d26/d2e/f82 [0,4194304] 0 2024-09-18T12:52:38.504 INFO:tasks.workunit.client.0.smithi045.stdout:9/939: chown d0/d3/d6/d10/d26/d2e/d6f/ca7 22734 1 2024-09-18T12:52:38.508 INFO:tasks.workunit.client.0.smithi045.stdout:9/940: creat d0/d3/d6/d10/d26/d2e/d4e/d76/f11c x:0 0 0 2024-09-18T12:52:38.523 INFO:tasks.workunit.client.0.smithi045.stdout:9/941: dwrite d0/d3/d6/d10/d26/f8f [0,4194304] 0 2024-09-18T12:52:38.528 INFO:tasks.workunit.client.0.smithi045.stdout:9/942: write d0/d3/d6/d10/d26/f8f [3280104,81985] 0 2024-09-18T12:52:38.529 INFO:tasks.workunit.client.0.smithi045.stdout:9/943: stat d0/d3/d6/d10/d26/d2e/d4e/db4 0 2024-09-18T12:52:38.536 INFO:tasks.workunit.client.0.smithi045.stdout:9/944: dwrite d0/d3/d6/d10/d26/d2e/d6f/da5/dab/f102 [0,4194304] 0 2024-09-18T12:52:38.543 INFO:tasks.workunit.client.0.smithi045.stdout:9/945: dread d0/d3/d6/d9d/fd7 [0,4194304] 0 2024-09-18T12:52:38.547 INFO:tasks.workunit.client.0.smithi045.stdout:9/946: dread d0/d3/d6/d10/d2c/d63/f87 [0,4194304] 0 2024-09-18T12:52:38.551 INFO:tasks.workunit.client.0.smithi045.stdout:9/947: dread d0/d3/d6/d10/d2c/f80 [0,4194304] 0 2024-09-18T12:52:38.561 INFO:tasks.workunit.client.0.smithi045.stdout:9/948: write d0/d3/d6/d10/d26/d2e/d4e/f9f [6968542,39410] 0 2024-09-18T12:52:38.569 INFO:tasks.workunit.client.0.smithi045.stdout:9/949: dwrite d0/f59 [4194304,4194304] 0 2024-09-18T12:52:38.574 INFO:tasks.workunit.client.0.smithi045.stdout:9/950: creat d0/d3/d6/d64/d77/da9/de6/f11d x:0 0 0 2024-09-18T12:52:38.578 INFO:tasks.workunit.client.0.smithi045.stdout:9/951: creat d0/d3/d6/d10/d26/d2e/d6f/df3/f11e x:0 0 0 2024-09-18T12:52:38.579 INFO:tasks.workunit.client.0.smithi045.stdout:9/952: write d0/d3/d6/d10/d26/d2e/f82 [2219411,92377] 0 2024-09-18T12:52:38.586 INFO:tasks.workunit.client.0.smithi045.stdout:9/953: getdents d0/d3/d6/d64/dc1 0 2024-09-18T12:52:38.588 INFO:tasks.workunit.client.0.smithi045.stdout:9/954: fsync d0/d3/d6/d10/f1b 0 2024-09-18T12:52:38.591 INFO:tasks.workunit.client.0.smithi045.stdout:9/955: creat d0/d3/d6/d10/f11f x:0 0 0 2024-09-18T12:52:38.599 INFO:tasks.workunit.client.0.smithi045.stdout:9/956: mkdir d0/d3/d6/d120 0 2024-09-18T12:52:38.604 INFO:tasks.workunit.client.0.smithi045.stdout:9/957: creat d0/d3/d6/d64/d77/da9/f121 x:0 0 0 2024-09-18T12:52:38.606 INFO:tasks.workunit.client.0.smithi045.stdout:9/958: readlink d0/d3/d6/d10/d26/d2e/l46 0 2024-09-18T12:52:38.620 INFO:tasks.workunit.client.0.smithi045.stdout:9/959: dread d0/f5c [0,4194304] 0 2024-09-18T12:52:38.621 INFO:tasks.workunit.client.0.smithi045.stdout:9/960: chown d0/d3/d6/d64/d77/dd5/df8/fcf 18657446 1 2024-09-18T12:52:38.627 INFO:tasks.workunit.client.0.smithi045.stdout:9/961: dwrite d0/d3/d6/d64/d88/dc0/fef [0,4194304] 0 2024-09-18T12:52:38.629 INFO:tasks.workunit.client.0.smithi045.stdout:9/962: symlink d0/d3/d6/d10/df7/l122 0 2024-09-18T12:52:38.635 INFO:tasks.workunit.client.0.smithi045.stdout:9/963: creat d0/d3/d6/d9d/d114/f123 x:0 0 0 2024-09-18T12:52:38.638 INFO:tasks.workunit.client.0.smithi045.stdout:9/964: symlink d0/d3/d6/d10/d26/da4/l124 0 2024-09-18T12:52:38.648 INFO:tasks.workunit.client.0.smithi045.stdout:9/965: dwrite d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/fc9 [0,4194304] 0 2024-09-18T12:52:38.650 INFO:tasks.workunit.client.0.smithi045.stdout:9/966: mkdir d0/d3/d6/d9d/d125 0 2024-09-18T12:52:38.653 INFO:tasks.workunit.client.0.smithi045.stdout:9/967: stat d0/d3/d6/d10/d26/da4/fd1 0 2024-09-18T12:52:38.654 INFO:tasks.workunit.client.0.smithi045.stdout:9/968: stat d0/d3/d6/d10/l65 0 2024-09-18T12:52:38.656 INFO:tasks.workunit.client.0.smithi045.stdout:9/969: chown d0/d3/d6/d10/d26/d2e/d6f/l84 1879686 1 2024-09-18T12:52:38.657 INFO:tasks.workunit.client.0.smithi045.stdout:9/970: chown d0/lce 41962992 1 2024-09-18T12:52:38.658 INFO:tasks.workunit.client.0.smithi045.stdout:9/971: chown d0/d3/d6/d10/d26/d2e/l58 210087566 1 2024-09-18T12:52:38.663 INFO:tasks.workunit.client.0.smithi045.stdout:9/972: mkdir d0/d3/d6/d64/d77/da9/de6/d126 0 2024-09-18T12:52:38.663 INFO:tasks.workunit.client.0.smithi045.stdout:9/973: chown d0/f5c 5 1 2024-09-18T12:52:38.667 INFO:tasks.workunit.client.0.smithi045.stdout:9/974: unlink d0/d3/d6/d10/cac 0 2024-09-18T12:52:38.671 INFO:tasks.workunit.client.0.smithi045.stdout:9/975: truncate d0/d3/d6/f99 2319430 0 2024-09-18T12:52:38.672 INFO:tasks.workunit.client.0.smithi045.stdout:9/976: readlink d0/d3/d6/d10/d26/d2e/d6f/lc7 0 2024-09-18T12:52:38.676 INFO:tasks.workunit.client.0.smithi045.stdout:9/977: rename d0/d3/d6/d10/d26/d2e/d6f/da5/dab/d118/f10c to d0/d3/d6/d120/f127 0 2024-09-18T12:52:38.677 INFO:tasks.workunit.client.0.smithi045.stdout:9/978: fdatasync d0/d3/d6/d64/d88/dc0/fef 0 2024-09-18T12:52:38.679 INFO:tasks.workunit.client.0.smithi045.stdout:9/979: symlink d0/d3/d6/d10/d26/d2e/d4e/d76/l128 0 2024-09-18T12:52:38.682 INFO:tasks.workunit.client.0.smithi045.stdout:9/980: mkdir d0/d3/d6/d10/d26/d2e/d6f/da5/d129 0 2024-09-18T12:52:38.687 INFO:tasks.workunit.client.0.smithi045.stdout:9/981: dwrite d0/f59 [4194304,4194304] 0 2024-09-18T12:52:38.695 INFO:tasks.workunit.client.0.smithi045.stdout:9/982: dwrite d0/f59 [0,4194304] 0 2024-09-18T12:52:38.699 INFO:tasks.workunit.client.0.smithi045.stdout:9/983: read d0/f61 [3989996,113908] 0 2024-09-18T12:52:38.701 INFO:tasks.workunit.client.0.smithi045.stdout:9/984: chown d0/d3/d6/d10/d26/f62 20178934 1 2024-09-18T12:52:38.703 INFO:tasks.workunit.client.0.smithi045.stdout:9/985: symlink d0/d3/d6/d64/l12a 0 2024-09-18T12:52:38.706 INFO:tasks.workunit.client.0.smithi045.stdout:9/986: creat d0/de5/f12b x:0 0 0 2024-09-18T12:52:38.720 INFO:tasks.workunit.client.0.smithi045.stdout:9/987: write d0/d3/d6/d10/d26/d2e/d4e/d76/d89/db0/fd4 [837582,43327] 0 2024-09-18T12:52:38.726 INFO:tasks.workunit.client.0.smithi045.stdout:9/988: creat d0/d3/d6/d10/d26/d2e/f12c x:0 0 0 2024-09-18T12:52:38.729 INFO:tasks.workunit.client.0.smithi045.stdout:9/989: mkdir d0/d3/d6/d64/d77/dd5/df8/d107/d12d 0 2024-09-18T12:52:38.730 INFO:tasks.workunit.client.0.smithi045.stdout:9/990: rmdir d0/d3/d6/d10/d26/d2e/d4e/db4 39 2024-09-18T12:52:38.732 INFO:tasks.workunit.client.0.smithi045.stdout:9/991: creat d0/d3/d6/d10/d26/da4/f12e x:0 0 0 2024-09-18T12:52:38.736 INFO:tasks.workunit.client.0.smithi045.stdout:9/992: dread d0/d3/d6/d10/d26/d2e/d4e/f67 [0,4194304] 0 2024-09-18T12:52:38.739 INFO:tasks.workunit.client.0.smithi045.stdout:9/993: creat d0/d3/d6/d10/d26/d2e/d6f/da5/dab/f12f x:0 0 0 2024-09-18T12:52:38.741 INFO:tasks.workunit.client.0.smithi045.stdout:9/994: mknod d0/d3/d6/d64/d88/dc0/df4/c130 0 2024-09-18T12:52:38.742 INFO:tasks.workunit.client.0.smithi045.stdout:9/995: chown d0/d3/d6/d10/d26/d2e/d6f/da5/dab/d118 30670 1 2024-09-18T12:52:38.744 INFO:tasks.workunit.client.0.smithi045.stdout:9/996: fsync d0/d3/d6/d10/d26/da4/fb3 0 2024-09-18T12:52:38.749 INFO:tasks.workunit.client.0.smithi045.stdout:9/997: link d0/d3/d6/d10/d26/f8f d0/d3/d6/d10/d26/d2e/d6f/f131 0 2024-09-18T12:52:38.751 INFO:tasks.workunit.client.0.smithi045.stdout:9/998: fsync d0/d3/d6/d10/d26/f42 0 2024-09-18T12:52:38.752 INFO:tasks.workunit.client.0.smithi045.stdout:9/999: write d0/f61 [186812,6836] 0 2024-09-18T12:52:38.757 INFO:tasks.workunit.client.0.smithi045.stderr:+ rm -rf -- ./tmp.Byz9CSsVFD 2024-09-18T12:52:39.776 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:39 smithi045 ceph-mon[28315]: pgmap v42: 65 pgs: 65 active+clean; 3.1 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 52 MiB/s rd, 117 MiB/s wr, 353 op/s 2024-09-18T12:52:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:39 smithi161 ceph-mon[35784]: pgmap v42: 65 pgs: 65 active+clean; 3.1 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 52 MiB/s rd, 117 MiB/s wr, 353 op/s 2024-09-18T12:52:41.608 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T12:52:41.608 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-18T12:52:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:41 smithi045 ceph-mon[28315]: pgmap v43: 65 pgs: 65 active+clean; 3.1 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 41 MiB/s rd, 87 MiB/s wr, 267 op/s 2024-09-18T12:52:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:41 smithi161 ceph-mon[35784]: pgmap v43: 65 pgs: 65 active+clean; 3.1 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 41 MiB/s rd, 87 MiB/s wr, 267 op/s 2024-09-18T12:52:42.762 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:42 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:42.763 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:42 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:42.763 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:42 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:43.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:42 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:43.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:42 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:43.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:42 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:44.017 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:43 smithi161 ceph-mon[35784]: pgmap v44: 65 pgs: 65 active+clean; 2.4 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 44 MiB/s rd, 96 MiB/s wr, 346 op/s 2024-09-18T12:52:44.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:43 smithi045 ceph-mon[28315]: pgmap v44: 65 pgs: 65 active+clean; 2.4 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 44 MiB/s rd, 96 MiB/s wr, 346 op/s 2024-09-18T12:52:45.347 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:45 smithi045 ceph-mon[28315]: pgmap v45: 65 pgs: 65 active+clean; 2.4 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 18 MiB/s rd, 45 MiB/s wr, 197 op/s 2024-09-18T12:52:45.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:45 smithi161 ceph-mon[35784]: pgmap v45: 65 pgs: 65 active+clean; 2.4 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 18 MiB/s rd, 45 MiB/s wr, 197 op/s 2024-09-18T12:52:46.776 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:46 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:46.776 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:46 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:46.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:46 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:46.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:46 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:47.739 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:47 smithi161 ceph-mon[35784]: pgmap v46: 65 pgs: 65 active+clean; 1.7 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 18 MiB/s rd, 45 MiB/s wr, 257 op/s 2024-09-18T12:52:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:47 smithi045 ceph-mon[28315]: pgmap v46: 65 pgs: 65 active+clean; 1.7 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 18 MiB/s rd, 45 MiB/s wr, 257 op/s 2024-09-18T12:52:48.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:48 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:48.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:48 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:48.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:48 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:48.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:48 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:48.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:48 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:48.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:48 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:48.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:48 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:48.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:48 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:49 smithi161 ceph-mon[35784]: pgmap v47: 65 pgs: 65 active+clean; 1.5 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 6.2 MiB/s rd, 18 MiB/s wr, 159 op/s 2024-09-18T12:52:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:49 smithi161 ceph-mon[35784]: Standby manager daemon smithi045.brvbvl restarted 2024-09-18T12:52:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:49 smithi161 ceph-mon[35784]: Standby manager daemon smithi045.brvbvl started 2024-09-18T12:52:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:49 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi045.brvbvl/crt"}]: dispatch 2024-09-18T12:52:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:49 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:52:49.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:49 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi045.brvbvl/key"}]: dispatch 2024-09-18T12:52:49.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:49 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:52:49.981 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:49 smithi045 ceph-mon[28315]: pgmap v47: 65 pgs: 65 active+clean; 1.5 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 6.2 MiB/s rd, 18 MiB/s wr, 159 op/s 2024-09-18T12:52:49.981 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:49 smithi045 ceph-mon[28315]: Standby manager daemon smithi045.brvbvl restarted 2024-09-18T12:52:49.981 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:49 smithi045 ceph-mon[28315]: Standby manager daemon smithi045.brvbvl started 2024-09-18T12:52:49.981 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:49 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi045.brvbvl/crt"}]: dispatch 2024-09-18T12:52:49.981 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:49 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:52:49.981 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:49 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi045.brvbvl/key"}]: dispatch 2024-09-18T12:52:49.981 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:49 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:52:50.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:50 smithi161 ceph-mon[35784]: mgrmap e26: smithi161.yoflkm(active, since 89s), standbys: smithi045.brvbvl 2024-09-18T12:52:51.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:50 smithi045 ceph-mon[28315]: mgrmap e26: smithi161.yoflkm(active, since 89s), standbys: smithi045.brvbvl 2024-09-18T12:52:51.678 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:51 smithi045 ceph-mon[28315]: pgmap v48: 65 pgs: 65 active+clean; 1.5 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 3.5 MiB/s rd, 9.3 MiB/s wr, 145 op/s 2024-09-18T12:52:51.678 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:51 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:52.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:51 smithi161 ceph-mon[35784]: pgmap v48: 65 pgs: 65 active+clean; 1.5 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 3.5 MiB/s rd, 9.3 MiB/s wr, 145 op/s 2024-09-18T12:52:52.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:51 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:53.509 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:53.509 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:53.509 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:53.509 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:53.509 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:53.509 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:53.509 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mgr fail", "who": "smithi161.yoflkm"}]: dispatch 2024-09-18T12:52:53.509 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mgr fail", "who": "smithi161.yoflkm"}]: dispatch 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: Activating manager daemon smithi045.brvbvl 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd='[{"prefix": "mgr fail", "who": "smithi161.yoflkm"}]': finished 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: mgrmap e27: smithi045.brvbvl(active, starting, since 0.00817851s) 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.gzqgyu"}]: dispatch 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"}]: dispatch 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.maxdew"}]: dispatch 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.xoxpyp"}]: dispatch 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi045.brvbvl", "id": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:52:53.510 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: Manager daemon smithi045.brvbvl is now available 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:52:53.511 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/trash_purge_schedule"}]: dispatch 2024-09-18T12:52:53.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:53.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:53.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:52:53.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:52:53.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' 2024-09-18T12:52:53.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:53.517 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.24401 172.21.15.161:0/2413105569' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mgr fail", "who": "smithi161.yoflkm"}]: dispatch 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "mgr fail", "who": "smithi161.yoflkm"}]: dispatch 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: Activating manager daemon smithi045.brvbvl 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.24401 ' entity='mgr.smithi161.yoflkm' cmd='[{"prefix": "mgr fail", "who": "smithi161.yoflkm"}]': finished 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: mgrmap e27: smithi045.brvbvl(active, starting, since 0.00817851s) 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.gzqgyu"}]: dispatch 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"}]: dispatch 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.maxdew"}]: dispatch 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.xoxpyp"}]: dispatch 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi045.brvbvl", "id": "smithi045.brvbvl"}]: dispatch 2024-09-18T12:52:53.518 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: Manager daemon smithi045.brvbvl is now available 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:52:53.519 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/mirror_snapshot_schedule"}]: dispatch 2024-09-18T12:52:53.520 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi045.brvbvl/trash_purge_schedule"}]: dispatch 2024-09-18T12:52:54.156 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:54 smithi045 ceph-mon[28315]: mgrmap e28: smithi045.brvbvl(active, since 1.01515s) 2024-09-18T12:52:54.156 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:54 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:52:54.156 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:54 smithi045 ceph-mon[28315]: pgmap v3: 65 pgs: 65 active+clean; 790 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-18T12:52:54.478 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:54 smithi161 ceph-mon[35784]: mgrmap e28: smithi045.brvbvl(active, since 1.01515s) 2024-09-18T12:52:54.478 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:54 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:52:54.478 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:54 smithi161 ceph-mon[35784]: pgmap v3: 65 pgs: 65 active+clean; 790 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-18T12:52:55.423 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T12:52:55.424 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-18T12:52:55.440 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:55 smithi045 ceph-mon[28315]: pgmap v4: 65 pgs: 65 active+clean; 790 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-18T12:52:55.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:55 smithi161 ceph-mon[35784]: pgmap v4: 65 pgs: 65 active+clean; 790 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-18T12:52:56.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:56 smithi045 ceph-mon[28315]: [18/Sep/2024:12:52:54] ENGINE Bus STARTING 2024-09-18T12:52:56.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:56 smithi045 ceph-mon[28315]: [18/Sep/2024:12:52:54] ENGINE Serving on http://172.21.15.45:8765 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:56 smithi045 ceph-mon[28315]: [18/Sep/2024:12:52:54] ENGINE Serving on https://172.21.15.45:7150 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:56 smithi045 ceph-mon[28315]: [18/Sep/2024:12:52:54] ENGINE Bus STARTED 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:56 smithi045 ceph-mon[28315]: [18/Sep/2024:12:52:54] ENGINE Error in HTTPServer.serve 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Traceback (most recent call last): 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._run(expiration_interval) 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:52:56.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:52:56.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: s = self.context.wrap_socket( 2024-09-18T12:52:56.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:52:56.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: return self.sslsocket_class._create( 2024-09-18T12:52:56.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:52:56.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self.do_handshake() 2024-09-18T12:52:56.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:52:56.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: self._sslobj.do_handshake() 2024-09-18T12:52:56.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:52:56.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:56 smithi045 ceph-mon[28315]: mgrmap e29: smithi045.brvbvl(active, since 3s) 2024-09-18T12:52:56.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:56 smithi161 ceph-mon[35784]: [18/Sep/2024:12:52:54] ENGINE Bus STARTING 2024-09-18T12:52:56.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:56 smithi161 ceph-mon[35784]: [18/Sep/2024:12:52:54] ENGINE Serving on http://172.21.15.45:8765 2024-09-18T12:52:56.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:56 smithi161 ceph-mon[35784]: [18/Sep/2024:12:52:54] ENGINE Serving on https://172.21.15.45:7150 2024-09-18T12:52:56.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:56 smithi161 ceph-mon[35784]: [18/Sep/2024:12:52:54] ENGINE Bus STARTED 2024-09-18T12:52:56.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:56 smithi161 ceph-mon[35784]: [18/Sep/2024:12:52:54] ENGINE Error in HTTPServer.serve 2024-09-18T12:52:56.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Traceback (most recent call last): 2024-09-18T12:52:56.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self._connections.run(self.expiration_interval) 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self._run(expiration_interval) 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: s = self.context.wrap_socket( 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: return self.sslsocket_class._create( 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T12:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self.do_handshake() 2024-09-18T12:52:56.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T12:52:56.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: self._sslobj.do_handshake() 2024-09-18T12:52:56.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T12:52:56.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:56 smithi161 ceph-mon[35784]: mgrmap e29: smithi045.brvbvl(active, since 3s) 2024-09-18T12:52:57.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:57 smithi045 ceph-mon[28315]: pgmap v5: 65 pgs: 65 active+clean; 790 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-18T12:52:57.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:57 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:52:57.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:57 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:52:57.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:57 smithi161 ceph-mon[35784]: pgmap v5: 65 pgs: 65 active+clean; 790 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-18T12:52:57.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:57 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:52:57.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:57 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:52:58.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:58 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:52:58.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:58 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:52:58.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:58 smithi161 ceph-mon[35784]: Standby manager daemon smithi161.yoflkm started 2024-09-18T12:52:58.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:58 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/3830087297' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/crt"}]: dispatch 2024-09-18T12:52:58.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:58 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/3830087297' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:52:58.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:58 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/3830087297' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/key"}]: dispatch 2024-09-18T12:52:58.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:58 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/3830087297' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:52:58.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:58 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:52:58.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:58 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:52:58.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:58 smithi045 ceph-mon[28315]: Standby manager daemon smithi161.yoflkm started 2024-09-18T12:52:58.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:58 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/3830087297' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/crt"}]: dispatch 2024-09-18T12:52:58.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:58 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/3830087297' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:52:58.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:58 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/3830087297' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/key"}]: dispatch 2024-09-18T12:52:58.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:58 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/3830087297' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:52:59.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:59 smithi045 ceph-mon[28315]: pgmap v6: 65 pgs: 65 active+clean; 790 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-18T12:52:59.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:59 smithi045 ceph-mon[28315]: mgrmap e30: smithi045.brvbvl(active, since 6s), standbys: smithi161.yoflkm 2024-09-18T12:52:59.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:52:59 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi161.yoflkm", "id": "smithi161.yoflkm"}]: dispatch 2024-09-18T12:52:59.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:59 smithi161 ceph-mon[35784]: pgmap v6: 65 pgs: 65 active+clean; 790 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-18T12:52:59.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:59 smithi161 ceph-mon[35784]: mgrmap e30: smithi045.brvbvl(active, since 6s), standbys: smithi161.yoflkm 2024-09-18T12:52:59.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:52:59 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr metadata", "who": "smithi161.yoflkm", "id": "smithi161.yoflkm"}]: dispatch 2024-09-18T12:53:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:01 smithi045 ceph-mon[28315]: pgmap v7: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 92 op/s 2024-09-18T12:53:01.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:01 smithi161 ceph-mon[35784]: pgmap v7: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 92 op/s 2024-09-18T12:53:03.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:03 smithi045 ceph-mon[28315]: pgmap v8: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 885 KiB/s rd, 988 KiB/s wr, 71 op/s 2024-09-18T12:53:03.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:03 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:03.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:03 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:03.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:03 smithi161 ceph-mon[35784]: pgmap v8: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 885 KiB/s rd, 988 KiB/s wr, 71 op/s 2024-09-18T12:53:03.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:03 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:03.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:03 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:04.734 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:04 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:04.734 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:04 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:04.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.732+0000 7f8a86b5e640 1 -- 172.21.15.45:0/499374307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a80104d20 msgr2=0x7f8a80107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:04.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.732+0000 7f8a86b5e640 1 --2- 172.21.15.45:0/499374307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a80104d20 0x7f8a80107110 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8a700098b0 tx=0x7f8a7002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.732+0000 7f8a86b5e640 1 -- 172.21.15.45:0/499374307 shutdown_connections 2024-09-18T12:53:04.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.732+0000 7f8a86b5e640 1 --2- 172.21.15.45:0/499374307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a80104d20 0x7f8a80107110 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.732+0000 7f8a86b5e640 1 --2- 172.21.15.45:0/499374307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a801023f0 0x7f8a801047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.732+0000 7f8a86b5e640 1 -- 172.21.15.45:0/499374307 >> 172.21.15.45:0/499374307 conn(0x7f8a800fc010 msgr2=0x7f8a800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.732+0000 7f8a86b5e640 1 -- 172.21.15.45:0/499374307 shutdown_connections 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.732+0000 7f8a86b5e640 1 -- 172.21.15.45:0/499374307 wait complete. 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.733+0000 7f8a86b5e640 1 Processor -- start 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.733+0000 7f8a86b5e640 1 -- start start 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.733+0000 7f8a86b5e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a801023f0 0x7f8a80197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.733+0000 7f8a86b5e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a80104d20 0x7f8a80197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.733+0000 7f8a86b5e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8010a7b0 con 0x7f8a801023f0 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.733+0000 7f8a86b5e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8010a630 con 0x7f8a80104d20 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.733+0000 7f8a848fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a801023f0 0x7f8a80197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.733+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a80104d20 0x7f8a80197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:04.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.733+0000 7f8a848fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a801023f0 0x7f8a80197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34530/0 (socket says 172.21.15.45:34530) 2024-09-18T12:53:04.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.734+0000 7f8a848fa640 1 -- 172.21.15.45:0/1390139409 learned_addr learned my addr 172.21.15.45:0/1390139409 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:53:04.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.734+0000 7f8a77fff640 1 -- 172.21.15.45:0/1390139409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a801023f0 msgr2=0x7f8a80197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:04.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.734+0000 7f8a77fff640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a801023f0 0x7f8a80197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:04.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.734+0000 7f8a77fff640 1 -- 172.21.15.45:0/1390139409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a801980f0 con 0x7f8a80104d20 2024-09-18T12:53:04.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.734+0000 7f8a848fa640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a801023f0 0x7f8a80197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:53:04.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.734+0000 7f8a77fff640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a80104d20 0x7f8a80197a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a7002a9f0 tx=0x7f8a700045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:04.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.734+0000 7f8a75ffb640 1 -- 172.21.15.45:0/1390139409 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a7003f070 con 0x7f8a80104d20 2024-09-18T12:53:04.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.734+0000 7f8a86b5e640 1 -- 172.21.15.45:0/1390139409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8019cad0 con 0x7f8a80104d20 2024-09-18T12:53:04.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.734+0000 7f8a75ffb640 1 -- 172.21.15.45:0/1390139409 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a700049d0 con 0x7f8a80104d20 2024-09-18T12:53:04.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.734+0000 7f8a75ffb640 1 -- 172.21.15.45:0/1390139409 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a70035030 con 0x7f8a80104d20 2024-09-18T12:53:04.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.735+0000 7f8a86b5e640 1 -- 172.21.15.45:0/1390139409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8019d030 con 0x7f8a80104d20 2024-09-18T12:53:04.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.736+0000 7f8a86b5e640 1 -- 172.21.15.45:0/1390139409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a801027d0 con 0x7f8a80104d20 2024-09-18T12:53:04.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.737+0000 7f8a75ffb640 1 -- 172.21.15.45:0/1390139409 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 30) ==== 103422+0+0 (secure 0 0 0) 0x7f8a70042070 con 0x7f8a80104d20 2024-09-18T12:53:04.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.737+0000 7f8a75ffb640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8a6807b0a0 0x7f8a6807d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:04.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.737+0000 7f8a75ffb640 1 -- 172.21.15.45:0/1390139409 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f8a700bea60 con 0x7f8a80104d20 2024-09-18T12:53:04.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.738+0000 7f8a848fa640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8a6807b0a0 0x7f8a6807d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:04.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.738+0000 7f8a848fa640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8a6807b0a0 0x7f8a6807d560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c011500 tx=0x7f8a7c005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:04.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:04.742+0000 7f8a75ffb640 1 -- 172.21.15.45:0/1390139409 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f8a70089f10 con 0x7f8a80104d20 2024-09-18T12:53:04.747 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:04 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:04.748 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:04 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.018+0000 7f8a86b5e640 1 -- 172.21.15.45:0/1390139409 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8a80105780 con 0x7f8a6807b0a0 2024-09-18T12:53:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.020+0000 7f8a75ffb640 1 -- 172.21.15.45:0/1390139409 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f8a80105780 con 0x7f8a6807b0a0 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.023+0000 7f8a86b5e640 1 -- 172.21.15.45:0/1390139409 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8a6807b0a0 msgr2=0x7f8a6807d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.023+0000 7f8a86b5e640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8a6807b0a0 0x7f8a6807d560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c011500 tx=0x7f8a7c005f90 comp rx=0 tx=0).stop 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.023+0000 7f8a86b5e640 1 -- 172.21.15.45:0/1390139409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a80104d20 msgr2=0x7f8a80197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.023+0000 7f8a86b5e640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a80104d20 0x7f8a80197a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a7002a9f0 tx=0x7f8a700045e0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.023+0000 7f8a86b5e640 1 -- 172.21.15.45:0/1390139409 shutdown_connections 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.023+0000 7f8a86b5e640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8a6807b0a0 0x7f8a6807d560 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.023+0000 7f8a86b5e640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a80104d20 0x7f8a80197a70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.023+0000 7f8a86b5e640 1 --2- 172.21.15.45:0/1390139409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a801023f0 0x7f8a80197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.023+0000 7f8a86b5e640 1 -- 172.21.15.45:0/1390139409 >> 172.21.15.45:0/1390139409 conn(0x7f8a800fc010 msgr2=0x7f8a800fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.024+0000 7f8a86b5e640 1 -- 172.21.15.45:0/1390139409 shutdown_connections 2024-09-18T12:53:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.024+0000 7f8a86b5e640 1 -- 172.21.15.45:0/1390139409 wait complete. 2024-09-18T12:53:05.037 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:53:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.157+0000 7f317b583640 1 -- 172.21.15.45:0/2337716189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3174101a60 msgr2=0x7f3174101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.157+0000 7f317b583640 1 --2- 172.21.15.45:0/2337716189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3174101a60 0x7f3174101ee0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3164009880 tx=0x7f316402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.157+0000 7f317b583640 1 -- 172.21.15.45:0/2337716189 shutdown_connections 2024-09-18T12:53:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.157+0000 7f317b583640 1 --2- 172.21.15.45:0/2337716189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3174101a60 0x7f3174101ee0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.157+0000 7f317b583640 1 --2- 172.21.15.45:0/2337716189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174100860 0x7f3174100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.157+0000 7f317b583640 1 -- 172.21.15.45:0/2337716189 >> 172.21.15.45:0/2337716189 conn(0x7f31740fc010 msgr2=0x7f31740fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.157+0000 7f317b583640 1 -- 172.21.15.45:0/2337716189 shutdown_connections 2024-09-18T12:53:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.157+0000 7f317b583640 1 -- 172.21.15.45:0/2337716189 wait complete. 2024-09-18T12:53:05.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.158+0000 7f317b583640 1 Processor -- start 2024-09-18T12:53:05.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.158+0000 7f317b583640 1 -- start start 2024-09-18T12:53:05.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.158+0000 7f317b583640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174100860 0x7f3174197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.158+0000 7f317b583640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3174101a60 0x7f3174197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.158+0000 7f317b583640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3174109680 con 0x7f3174101a60 2024-09-18T12:53:05.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.158+0000 7f317b583640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3174109500 con 0x7f3174100860 2024-09-18T12:53:05.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f3178b1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3174101a60 0x7f3174197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f317931f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174100860 0x7f3174197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f317931f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174100860 0x7f3174197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:59616/0 (socket says 172.21.15.45:59616) 2024-09-18T12:53:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f3178b1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3174101a60 0x7f3174197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34558/0 (socket says 172.21.15.45:34558) 2024-09-18T12:53:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f317931f640 1 -- 172.21.15.45:0/1457453233 learned_addr learned my addr 172.21.15.45:0/1457453233 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:53:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f317931f640 1 -- 172.21.15.45:0/1457453233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3174101a60 msgr2=0x7f3174197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f317931f640 1 --2- 172.21.15.45:0/1457453233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3174101a60 0x7f3174197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f317931f640 1 -- 172.21.15.45:0/1457453233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31741980e0 con 0x7f3174100860 2024-09-18T12:53:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f317931f640 1 --2- 172.21.15.45:0/1457453233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174100860 0x7f3174197520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f317000e940 tx=0x7f317000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f316a7fc640 1 -- 172.21.15.45:0/1457453233 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f317000cac0 con 0x7f3174100860 2024-09-18T12:53:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.159+0000 7f316a7fc640 1 -- 172.21.15.45:0/1457453233 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f317000cc60 con 0x7f3174100860 2024-09-18T12:53:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.160+0000 7f317b583640 1 -- 172.21.15.45:0/1457453233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317419cb20 con 0x7f3174100860 2024-09-18T12:53:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.160+0000 7f316a7fc640 1 -- 172.21.15.45:0/1457453233 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3170003de0 con 0x7f3174100860 2024-09-18T12:53:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.160+0000 7f317b583640 1 -- 172.21.15.45:0/1457453233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317419d080 con 0x7f3174100860 2024-09-18T12:53:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.161+0000 7f317b583640 1 -- 172.21.15.45:0/1457453233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3174100c60 con 0x7f3174100860 2024-09-18T12:53:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.162+0000 7f316a7fc640 1 -- 172.21.15.45:0/1457453233 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 30) ==== 103422+0+0 (secure 0 0 0) 0x7f3170003fe0 con 0x7f3174100860 2024-09-18T12:53:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.162+0000 7f316a7fc640 1 --2- 172.21.15.45:0/1457453233 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f316007b050 0x7f316007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.162+0000 7f316a7fc640 1 -- 172.21.15.45:0/1457453233 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f317009e980 con 0x7f3174100860 2024-09-18T12:53:05.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.162+0000 7f3178b1e640 1 --2- 172.21.15.45:0/1457453233 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f316007b050 0x7f316007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.163+0000 7f3178b1e640 1 --2- 172.21.15.45:0/1457453233 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f316007b050 0x7f316007d510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3164000c00 tx=0x7f31640058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.167+0000 7f316a7fc640 1 -- 172.21.15.45:0/1457453233 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f3170069d50 con 0x7f3174100860 2024-09-18T12:53:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.434+0000 7f317b583640 1 -- 172.21.15.45:0/1457453233 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f317406a460 con 0x7f316007b050 2024-09-18T12:53:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.436+0000 7f316a7fc640 1 -- 172.21.15.45:0/1457453233 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f317406a460 con 0x7f316007b050 2024-09-18T12:53:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.438+0000 7f317b583640 1 -- 172.21.15.45:0/1457453233 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f316007b050 msgr2=0x7f316007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.438+0000 7f317b583640 1 --2- 172.21.15.45:0/1457453233 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f316007b050 0x7f316007d510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3164000c00 tx=0x7f31640058d0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.438+0000 7f317b583640 1 -- 172.21.15.45:0/1457453233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174100860 msgr2=0x7f3174197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.438+0000 7f317b583640 1 --2- 172.21.15.45:0/1457453233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174100860 0x7f3174197520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f317000e940 tx=0x7f317000ee00 comp rx=0 tx=0).stop 2024-09-18T12:53:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.438+0000 7f317b583640 1 -- 172.21.15.45:0/1457453233 shutdown_connections 2024-09-18T12:53:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.438+0000 7f317b583640 1 --2- 172.21.15.45:0/1457453233 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f316007b050 0x7f316007d510 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.438+0000 7f317b583640 1 --2- 172.21.15.45:0/1457453233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3174101a60 0x7f3174197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.438+0000 7f317b583640 1 --2- 172.21.15.45:0/1457453233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3174100860 0x7f3174197520 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.438+0000 7f317b583640 1 -- 172.21.15.45:0/1457453233 >> 172.21.15.45:0/1457453233 conn(0x7f31740fc010 msgr2=0x7f3174069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.439+0000 7f317b583640 1 -- 172.21.15.45:0/1457453233 shutdown_connections 2024-09-18T12:53:05.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.439+0000 7f317b583640 1 -- 172.21.15.45:0/1457453233 wait complete. 2024-09-18T12:53:05.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.540+0000 7efe84da8640 1 -- 172.21.15.45:0/1710369296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe80102470 msgr2=0x7efe80104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.540+0000 7efe84da8640 1 --2- 172.21.15.45:0/1710369296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe80102470 0x7efe80104860 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efe70009880 tx=0x7efe7002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.540+0000 7efe84da8640 1 -- 172.21.15.45:0/1710369296 shutdown_connections 2024-09-18T12:53:05.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.540+0000 7efe84da8640 1 --2- 172.21.15.45:0/1710369296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe80104da0 0x7efe80107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.540+0000 7efe84da8640 1 --2- 172.21.15.45:0/1710369296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe80102470 0x7efe80104860 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.540+0000 7efe84da8640 1 -- 172.21.15.45:0/1710369296 >> 172.21.15.45:0/1710369296 conn(0x7efe800fc010 msgr2=0x7efe800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.540+0000 7efe84da8640 1 -- 172.21.15.45:0/1710369296 shutdown_connections 2024-09-18T12:53:05.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.540+0000 7efe84da8640 1 -- 172.21.15.45:0/1710369296 wait complete. 2024-09-18T12:53:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.541+0000 7efe84da8640 1 Processor -- start 2024-09-18T12:53:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.541+0000 7efe84da8640 1 -- start start 2024-09-18T12:53:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.541+0000 7efe84da8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe80102470 0x7efe80197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.541+0000 7efe84da8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe80104da0 0x7efe80197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.541+0000 7efe84da8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efe8010a820 con 0x7efe80104da0 2024-09-18T12:53:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.541+0000 7efe84da8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7efe8010a6a0 con 0x7efe80102470 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe7dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe80104da0 0x7efe80197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe7dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe80104da0 0x7efe80197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34566/0 (socket says 172.21.15.45:34566) 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe7dd9b640 1 -- 172.21.15.45:0/1476040473 learned_addr learned my addr 172.21.15.45:0/1476040473 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe7e59c640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe80102470 0x7efe80197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe7dd9b640 1 -- 172.21.15.45:0/1476040473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe80102470 msgr2=0x7efe80197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe7dd9b640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe80102470 0x7efe80197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe7dd9b640 1 -- 172.21.15.45:0/1476040473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe80198130 con 0x7efe80104da0 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe7dd9b640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe80104da0 0x7efe80197ab0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efe7400b3d0 tx=0x7efe7400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe6f7fe640 1 -- 172.21.15.45:0/1476040473 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe74015020 con 0x7efe80104da0 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe84da8640 1 -- 172.21.15.45:0/1476040473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe8019cb70 con 0x7efe80104da0 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe6f7fe640 1 -- 172.21.15.45:0/1476040473 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe74011af0 con 0x7efe80104da0 2024-09-18T12:53:05.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe6f7fe640 1 -- 172.21.15.45:0/1476040473 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe74010d30 con 0x7efe80104da0 2024-09-18T12:53:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.542+0000 7efe84da8640 1 -- 172.21.15.45:0/1476040473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe8019d180 con 0x7efe80104da0 2024-09-18T12:53:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.543+0000 7efe84da8640 1 -- 172.21.15.45:0/1476040473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe80102850 con 0x7efe80104da0 2024-09-18T12:53:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.544+0000 7efe6f7fe640 1 -- 172.21.15.45:0/1476040473 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 30) ==== 103422+0+0 (secure 0 0 0) 0x7efe74018020 con 0x7efe80104da0 2024-09-18T12:53:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.544+0000 7efe6f7fe640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efe6807b050 0x7efe6807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.544+0000 7efe6f7fe640 1 -- 172.21.15.45:0/1476040473 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7efe7409db90 con 0x7efe80104da0 2024-09-18T12:53:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.545+0000 7efe7e59c640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efe6807b050 0x7efe6807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.545+0000 7efe7e59c640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efe6807b050 0x7efe6807d510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efe70000c00 tx=0x7efe700058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:05.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.549+0000 7efe6f7fe640 1 -- 172.21.15.45:0/1476040473 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7efe7401f020 con 0x7efe80104da0 2024-09-18T12:53:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:05 smithi045 ceph-mon[28315]: pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-18T12:53:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:05 smithi161 ceph-mon[35784]: pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-18T12:53:05.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.850+0000 7efe84da8640 1 -- 172.21.15.45:0/1476040473 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7efe8019d410 con 0x7efe6807b050 2024-09-18T12:53:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.868+0000 7efe6f7fe640 1 -- 172.21.15.45:0/1476040473 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7efe8019d410 con 0x7efe6807b050 2024-09-18T12:53:05.870 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:53:05.870 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (7m) 3s ago 9m 27.0M - 0.25.0 c8568f914cd2 de7ae4bc8025 2024-09-18T12:53:05.870 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (77s) 3s ago 9m 8493k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:53:05.870 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (43s) 9s ago 8m 7977k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:53:05.870 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (9m) 3s ago 9m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:53:05.870 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (8m) 9s ago 8m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:53:05.870 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (7m) 3s ago 8m 76.7M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:53:05.870 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (3m) 3s ago 3m 278M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (3m) 3s ago 3m 250M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (3m) 9s ago 3m 15.6M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (3m) 9s ago 3m 14.0M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (24s) 3s ago 10m 487M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (2m) 9s ago 8m 145M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 0fb3c7114540 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (10m) 3s ago 10m 56.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (8m) 9s ago 8m 44.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (9m) 3s ago 9m 17.3M - 1.5.0 0da6a335fe13 39666fd05306 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (8m) 9s ago 8m 16.4M - 1.5.0 0da6a335fe13 ed4fe4d74f39 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (7m) 3s ago 7m 174M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (6m) 3s ago 6m 186M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (6m) 3s ago 6m 151M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (5m) 9s ago 5m 200M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:53:05.871 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (5m) 9s ago 5m 186M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:53:05.872 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (4m) 9s ago 4m 168M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:53:05.872 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (54s) 3s ago 8m 49.4M - 2.43.0 a07b618ecd1d bde354dc9f9e 2024-09-18T12:53:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.871+0000 7efe84da8640 1 -- 172.21.15.45:0/1476040473 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efe6807b050 msgr2=0x7efe6807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.871+0000 7efe84da8640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efe6807b050 0x7efe6807d510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efe70000c00 tx=0x7efe700058d0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.871+0000 7efe84da8640 1 -- 172.21.15.45:0/1476040473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe80104da0 msgr2=0x7efe80197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.871+0000 7efe84da8640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe80104da0 0x7efe80197ab0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efe7400b3d0 tx=0x7efe7400b890 comp rx=0 tx=0).stop 2024-09-18T12:53:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.871+0000 7efe84da8640 1 -- 172.21.15.45:0/1476040473 shutdown_connections 2024-09-18T12:53:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.871+0000 7efe84da8640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efe6807b050 0x7efe6807d510 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.871+0000 7efe84da8640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe80104da0 0x7efe80197ab0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.871+0000 7efe84da8640 1 --2- 172.21.15.45:0/1476040473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe80102470 0x7efe80197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.871+0000 7efe84da8640 1 -- 172.21.15.45:0/1476040473 >> 172.21.15.45:0/1476040473 conn(0x7efe800fc010 msgr2=0x7efe800fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.871+0000 7efe84da8640 1 -- 172.21.15.45:0/1476040473 shutdown_connections 2024-09-18T12:53:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.872+0000 7efe84da8640 1 -- 172.21.15.45:0/1476040473 wait complete. 2024-09-18T12:53:05.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.993+0000 7fb3e7b80640 1 -- 172.21.15.45:0/644219541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e0104d20 msgr2=0x7fb3e0107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.993+0000 7fb3e7b80640 1 --2- 172.21.15.45:0/644219541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e0104d20 0x7fb3e0107110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00098b0 tx=0x7fb3d002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.993+0000 7fb3e7b80640 1 -- 172.21.15.45:0/644219541 shutdown_connections 2024-09-18T12:53:05.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.993+0000 7fb3e7b80640 1 --2- 172.21.15.45:0/644219541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e0104d20 0x7fb3e0107110 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.993+0000 7fb3e7b80640 1 --2- 172.21.15.45:0/644219541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e01023f0 0x7fb3e01047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.993+0000 7fb3e7b80640 1 -- 172.21.15.45:0/644219541 >> 172.21.15.45:0/644219541 conn(0x7fb3e00fc010 msgr2=0x7fb3e00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:05.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.993+0000 7fb3e7b80640 1 -- 172.21.15.45:0/644219541 shutdown_connections 2024-09-18T12:53:05.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.993+0000 7fb3e7b80640 1 -- 172.21.15.45:0/644219541 wait complete. 2024-09-18T12:53:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.994+0000 7fb3e7b80640 1 Processor -- start 2024-09-18T12:53:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.994+0000 7fb3e7b80640 1 -- start start 2024-09-18T12:53:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.994+0000 7fb3e7b80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e01023f0 0x7fb3e0073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.994+0000 7fb3e7b80640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e0104d20 0x7fb3e00737d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.994+0000 7fb3e7b80640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e010a790 con 0x7fb3e01023f0 2024-09-18T12:53:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.994+0000 7fb3e7b80640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e010a610 con 0x7fb3e0104d20 2024-09-18T12:53:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.994+0000 7fb3e511b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e0104d20 0x7fb3e00737d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.994+0000 7fb3e511b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e0104d20 0x7fb3e00737d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:59656/0 (socket says 172.21.15.45:59656) 2024-09-18T12:53:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.994+0000 7fb3e511b640 1 -- 172.21.15.45:0/2857078338 learned_addr learned my addr 172.21.15.45:0/2857078338 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:53:05.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.995+0000 7fb3e591c640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e01023f0 0x7fb3e0073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:05.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.995+0000 7fb3e511b640 1 -- 172.21.15.45:0/2857078338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e01023f0 msgr2=0x7fb3e0073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:05.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.995+0000 7fb3e511b640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e01023f0 0x7fb3e0073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:05.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.995+0000 7fb3e511b640 1 -- 172.21.15.45:0/2857078338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e0073e70 con 0x7fb3e0104d20 2024-09-18T12:53:05.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.995+0000 7fb3e511b640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e0104d20 0x7fb3e00737d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009230 tx=0x7fb3d00045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:05.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.995+0000 7fb3d6ffd640 1 -- 172.21.15.45:0/2857078338 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3d003f070 con 0x7fb3e0104d20 2024-09-18T12:53:05.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.995+0000 7fb3d6ffd640 1 -- 172.21.15.45:0/2857078338 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3d0004a50 con 0x7fb3e0104d20 2024-09-18T12:53:05.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.995+0000 7fb3e7b80640 1 -- 172.21.15.45:0/2857078338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e0100600 con 0x7fb3e0104d20 2024-09-18T12:53:05.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.995+0000 7fb3d6ffd640 1 -- 172.21.15.45:0/2857078338 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3d0035030 con 0x7fb3e0104d20 2024-09-18T12:53:05.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.996+0000 7fb3e7b80640 1 -- 172.21.15.45:0/2857078338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e0100ae0 con 0x7fb3e0104d20 2024-09-18T12:53:05.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.997+0000 7fb3e7b80640 1 -- 172.21.15.45:0/2857078338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e01027d0 con 0x7fb3e0104d20 2024-09-18T12:53:05.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.997+0000 7fb3d6ffd640 1 -- 172.21.15.45:0/2857078338 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 30) ==== 103422+0+0 (secure 0 0 0) 0x7fb3d0042070 con 0x7fb3e0104d20 2024-09-18T12:53:05.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.998+0000 7fb3d6ffd640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb3cc07b050 0x7fb3cc07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:06.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.998+0000 7fb3e591c640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb3cc07b050 0x7fb3cc07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:06.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.998+0000 7fb3d6ffd640 1 -- 172.21.15.45:0/2857078338 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fb3d00bee10 con 0x7fb3e0104d20 2024-09-18T12:53:06.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:05.999+0000 7fb3e591c640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb3cc07b050 0x7fb3cc07d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb3e01004d0 tx=0x7fb3dc00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:06.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.002+0000 7fb3d6ffd640 1 -- 172.21.15.45:0/2857078338 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fb3d008a1a0 con 0x7fb3e0104d20 2024-09-18T12:53:06.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.342+0000 7fb3e7b80640 1 -- 172.21.15.45:0/2857078338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb3e0100fa0 con 0x7fb3e0104d20 2024-09-18T12:53:06.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.343+0000 7fb3d6ffd640 1 -- 172.21.15.45:0/2857078338 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fb3d008f050 con 0x7fb3e0104d20 2024-09-18T12:53:06.344 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:53:06.344 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:53:06.344 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:53:06.344 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:53:06.344 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:53:06.345 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:53:06.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 -- 172.21.15.45:0/2857078338 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb3cc07b050 msgr2=0x7fb3cc07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:06.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb3cc07b050 0x7fb3cc07d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb3e01004d0 tx=0x7fb3dc00b390 comp rx=0 tx=0).stop 2024-09-18T12:53:06.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 -- 172.21.15.45:0/2857078338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e0104d20 msgr2=0x7fb3e00737d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:06.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e0104d20 0x7fb3e00737d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009230 tx=0x7fb3d00045e0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 -- 172.21.15.45:0/2857078338 shutdown_connections 2024-09-18T12:53:06.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb3cc07b050 0x7fb3cc07d510 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e0104d20 0x7fb3e00737d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 --2- 172.21.15.45:0/2857078338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e01023f0 0x7fb3e0073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 -- 172.21.15.45:0/2857078338 >> 172.21.15.45:0/2857078338 conn(0x7fb3e00fc010 msgr2=0x7fb3e00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 -- 172.21.15.45:0/2857078338 shutdown_connections 2024-09-18T12:53:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.346+0000 7fb3e7b80640 1 -- 172.21.15.45:0/2857078338 wait complete. 2024-09-18T12:53:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.451+0000 7fc2e22f5640 1 -- 172.21.15.45:0/3244610178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc100060 msgr2=0x7fc2dc107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.451+0000 7fc2e22f5640 1 --2- 172.21.15.45:0/3244610178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc100060 0x7fc2dc107090 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000dc90 tx=0x7fc2d002e490 comp rx=0 tx=0).stop 2024-09-18T12:53:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.451+0000 7fc2e22f5640 1 -- 172.21.15.45:0/3244610178 shutdown_connections 2024-09-18T12:53:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.451+0000 7fc2e22f5640 1 --2- 172.21.15.45:0/3244610178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc100060 0x7fc2dc107090 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.451+0000 7fc2e22f5640 1 --2- 172.21.15.45:0/3244610178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc0ff720 0x7fc2dc0ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.451+0000 7fc2e22f5640 1 -- 172.21.15.45:0/3244610178 >> 172.21.15.45:0/3244610178 conn(0x7fc2dc0fb350 msgr2=0x7fc2dc0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.451+0000 7fc2e22f5640 1 -- 172.21.15.45:0/3244610178 shutdown_connections 2024-09-18T12:53:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.451+0000 7fc2e22f5640 1 -- 172.21.15.45:0/3244610178 wait complete. 2024-09-18T12:53:06.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.452+0000 7fc2e22f5640 1 Processor -- start 2024-09-18T12:53:06.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.452+0000 7fc2e22f5640 1 -- start start 2024-09-18T12:53:06.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2e22f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0ff720 0x7fc2dc195230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:06.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2e22f5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc100060 0x7fc2dc195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:06.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2e22f5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc108550 con 0x7fc2dc0ff720 2024-09-18T12:53:06.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2e22f5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc1083d0 con 0x7fc2dc100060 2024-09-18T12:53:06.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2dbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0ff720 0x7fc2dc195230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:06.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2dbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0ff720 0x7fc2dc195230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34600/0 (socket says 172.21.15.45:34600) 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2dbfff640 1 -- 172.21.15.45:0/2934535551 learned_addr learned my addr 172.21.15.45:0/2934535551 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2db7fe640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc100060 0x7fc2dc195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2dbfff640 1 -- 172.21.15.45:0/2934535551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc100060 msgr2=0x7fc2dc195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2dbfff640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc100060 0x7fc2dc195770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.453+0000 7fc2dbfff640 1 -- 172.21.15.45:0/2934535551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc195df0 con 0x7fc2dc0ff720 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.454+0000 7fc2dbfff640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0ff720 0x7fc2dc195230 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00d8d0 tx=0x7fc2cc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.454+0000 7fc2d97fa640 1 -- 172.21.15.45:0/2934535551 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2cc017070 con 0x7fc2dc0ff720 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.454+0000 7fc2d97fa640 1 -- 172.21.15.45:0/2934535551 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2cc010460 con 0x7fc2dc0ff720 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.454+0000 7fc2e22f5640 1 -- 172.21.15.45:0/2934535551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2dc19a830 con 0x7fc2dc0ff720 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.454+0000 7fc2d97fa640 1 -- 172.21.15.45:0/2934535551 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2cc00f5f0 con 0x7fc2dc0ff720 2024-09-18T12:53:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.454+0000 7fc2e22f5640 1 -- 172.21.15.45:0/2934535551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2dc19ad90 con 0x7fc2dc0ff720 2024-09-18T12:53:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.455+0000 7fc2e22f5640 1 -- 172.21.15.45:0/2934535551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2dc0ffb20 con 0x7fc2dc0ff720 2024-09-18T12:53:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.456+0000 7fc2d97fa640 1 -- 172.21.15.45:0/2934535551 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 30) ==== 103422+0+0 (secure 0 0 0) 0x7fc2cc009a30 con 0x7fc2dc0ff720 2024-09-18T12:53:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.456+0000 7fc2d97fa640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc2c407b0e0 0x7fc2c407d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.456+0000 7fc2d97fa640 1 -- 172.21.15.45:0/2934535551 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fc2cc09df70 con 0x7fc2dc0ff720 2024-09-18T12:53:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.456+0000 7fc2db7fe640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc2c407b0e0 0x7fc2c407d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.457+0000 7fc2db7fe640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc2c407b0e0 0x7fc2c407d5a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0037040 tx=0x7fc2d0000bc0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:06.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.461+0000 7fc2d97fa640 1 -- 172.21.15.45:0/2934535551 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fc2cc069420 con 0x7fc2dc0ff720 2024-09-18T12:53:06.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.776+0000 7fc2e22f5640 1 -- 172.21.15.45:0/2934535551 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc2dc106960 con 0x7fc2c407b0e0 2024-09-18T12:53:06.777 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:06 smithi045 ceph-mon[28315]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:06.777 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:06 smithi045 ceph-mon[28315]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:06.778 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:06 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2857078338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:06.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.777+0000 7fc2d97fa640 1 -- 172.21.15.45:0/2934535551 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fc2dc106960 con 0x7fc2c407b0e0 2024-09-18T12:53:06.778 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:53:06.778 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:53:06.778 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:53:06.778 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:53:06.779 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:53:06.779 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr" 2024-09-18T12:53:06.779 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:53:06.779 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "2/2 daemons upgraded", 2024-09-18T12:53:06.779 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "", 2024-09-18T12:53:06.779 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:53:06.779 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.779+0000 7fc2e22f5640 1 -- 172.21.15.45:0/2934535551 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc2c407b0e0 msgr2=0x7fc2c407d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.779+0000 7fc2e22f5640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc2c407b0e0 0x7fc2c407d5a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0037040 tx=0x7fc2d0000bc0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.779+0000 7fc2e22f5640 1 -- 172.21.15.45:0/2934535551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0ff720 msgr2=0x7fc2dc195230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.779+0000 7fc2e22f5640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0ff720 0x7fc2dc195230 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00d8d0 tx=0x7fc2cc00dd90 comp rx=0 tx=0).stop 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.780+0000 7fc2e22f5640 1 -- 172.21.15.45:0/2934535551 shutdown_connections 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.780+0000 7fc2e22f5640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc2c407b0e0 0x7fc2c407d5a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.780+0000 7fc2e22f5640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc100060 0x7fc2dc195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.780+0000 7fc2e22f5640 1 --2- 172.21.15.45:0/2934535551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2dc0ff720 0x7fc2dc195230 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.780+0000 7fc2e22f5640 1 -- 172.21.15.45:0/2934535551 >> 172.21.15.45:0/2934535551 conn(0x7fc2dc0fb350 msgr2=0x7fc2dc1051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.780+0000 7fc2e22f5640 1 -- 172.21.15.45:0/2934535551 shutdown_connections 2024-09-18T12:53:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:06.780+0000 7fc2e22f5640 1 -- 172.21.15.45:0/2934535551 wait complete. 2024-09-18T12:53:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:06 smithi161 ceph-mon[35784]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:06 smithi161 ceph-mon[35784]: from='client.24521 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:06 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2857078338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:07 smithi045 ceph-mon[28315]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:07 smithi045 ceph-mon[28315]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 96 op/s 2024-09-18T12:53:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:07 smithi161 ceph-mon[35784]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:07 smithi161 ceph-mon[35784]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 96 op/s 2024-09-18T12:53:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:08 smithi045 ceph-mon[28315]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:08 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:08 smithi161 ceph-mon[35784]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:08 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:09 smithi045 ceph-mon[28315]: pgmap v11: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 96 op/s 2024-09-18T12:53:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:09 smithi161 ceph-mon[35784]: pgmap v11: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 96 op/s 2024-09-18T12:53:11.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:11 smithi045 ceph-mon[28315]: pgmap v12: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 135 op/s 2024-09-18T12:53:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:11 smithi161 ceph-mon[35784]: pgmap v12: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 135 op/s 2024-09-18T12:53:13.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:13 smithi045 ceph-mon[28315]: pgmap v13: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 81 op/s 2024-09-18T12:53:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:13 smithi161 ceph-mon[35784]: pgmap v13: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 81 op/s 2024-09-18T12:53:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:15 smithi045 ceph-mon[28315]: pgmap v14: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 123 op/s 2024-09-18T12:53:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:15 smithi161 ceph-mon[35784]: pgmap v14: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 123 op/s 2024-09-18T12:53:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:17 smithi045 ceph-mon[28315]: pgmap v15: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 80 op/s 2024-09-18T12:53:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:17 smithi161 ceph-mon[35784]: pgmap v15: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 80 op/s 2024-09-18T12:53:19.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:19 smithi045 ceph-mon[28315]: pgmap v16: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 87 op/s 2024-09-18T12:53:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:19 smithi161 ceph-mon[35784]: pgmap v16: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 87 op/s 2024-09-18T12:53:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:21 smithi045 ceph-mon[28315]: pgmap v17: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 121 op/s 2024-09-18T12:53:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:21 smithi161 ceph-mon[35784]: pgmap v17: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 121 op/s 2024-09-18T12:53:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:22.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:22 smithi045 ceph-mon[28315]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-18T12:53:22.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:22 smithi045 ceph-mon[28315]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-18T12:53:22.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:22 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:22.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:22 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:22.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:22 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:22.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:22 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:22.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:22 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:22.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:22 smithi161 ceph-mon[35784]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-18T12:53:22.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:22 smithi161 ceph-mon[35784]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-18T12:53:22.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:22 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:22.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:22 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:22.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:22 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:22.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:22 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:22.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:22 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:23.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:23 smithi045 ceph-mon[28315]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:23.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:23 smithi045 ceph-mon[28315]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:23.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:23 smithi045 ceph-mon[28315]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:23.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:23 smithi045 ceph-mon[28315]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:23.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:23 smithi045 ceph-mon[28315]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:23.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:23 smithi045 ceph-mon[28315]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:23.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:23 smithi045 ceph-mon[28315]: pgmap v18: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 83 op/s 2024-09-18T12:53:23.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:23 smithi045 ceph-mon[28315]: Reconfiguring prometheus.smithi045 (dependencies changed)... 2024-09-18T12:53:23.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:23 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:23 smithi161 ceph-mon[35784]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:23 smithi161 ceph-mon[35784]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T12:53:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:23 smithi161 ceph-mon[35784]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:23 smithi161 ceph-mon[35784]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-18T12:53:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:23 smithi161 ceph-mon[35784]: Updating smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:23.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:23 smithi161 ceph-mon[35784]: Updating smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T12:53:23.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:23 smithi161 ceph-mon[35784]: pgmap v18: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 83 op/s 2024-09-18T12:53:23.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:23 smithi161 ceph-mon[35784]: Reconfiguring prometheus.smithi045 (dependencies changed)... 2024-09-18T12:53:23.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:23 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:24.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:24 smithi045 ceph-mon[28315]: Reconfiguring daemon prometheus.smithi045 on smithi045 2024-09-18T12:53:24.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:24 smithi161 ceph-mon[35784]: Reconfiguring daemon prometheus.smithi045 on smithi045 2024-09-18T12:53:25.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:25 smithi045 ceph-mon[28315]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 407 op/s 2024-09-18T12:53:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:25 smithi161 ceph-mon[35784]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 407 op/s 2024-09-18T12:53:27.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:27 smithi045 ceph-mon[28315]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 364 op/s 2024-09-18T12:53:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:27 smithi161 ceph-mon[35784]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 364 op/s 2024-09-18T12:53:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:29 smithi045 ceph-mon[28315]: pgmap v21: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 429 op/s 2024-09-18T12:53:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:29 smithi161 ceph-mon[35784]: pgmap v21: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 429 op/s 2024-09-18T12:53:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:31 smithi045 ceph-mon[28315]: pgmap v22: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 615 op/s 2024-09-18T12:53:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:31 smithi161 ceph-mon[35784]: pgmap v22: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 615 op/s 2024-09-18T12:53:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:33 smithi045 ceph-mon[28315]: pgmap v23: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 582 op/s 2024-09-18T12:53:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:33 smithi161 ceph-mon[35784]: pgmap v23: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 582 op/s 2024-09-18T12:53:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:35 smithi045 ceph-mon[28315]: pgmap v24: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 676 op/s 2024-09-18T12:53:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:35 smithi161 ceph-mon[35784]: pgmap v24: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 676 op/s 2024-09-18T12:53:36.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.907+0000 7fe184d74640 1 -- 172.21.15.45:0/1775427043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1801001e0 msgr2=0x7fe1801005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.907+0000 7fe184d74640 1 --2- 172.21.15.45:0/1775427043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1801001e0 0x7fe1801005e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe170009880 tx=0x7fe17002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.907+0000 7fe184d74640 1 -- 172.21.15.45:0/1775427043 shutdown_connections 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.907+0000 7fe184d74640 1 --2- 172.21.15.45:0/1775427043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe180100b20 0x7fe180100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.907+0000 7fe184d74640 1 --2- 172.21.15.45:0/1775427043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1801001e0 0x7fe1801005e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.907+0000 7fe184d74640 1 -- 172.21.15.45:0/1775427043 >> 172.21.15.45:0/1775427043 conn(0x7fe1800fc010 msgr2=0x7fe1800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.907+0000 7fe184d74640 1 -- 172.21.15.45:0/1775427043 shutdown_connections 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.907+0000 7fe184d74640 1 -- 172.21.15.45:0/1775427043 wait complete. 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.907+0000 7fe184d74640 1 Processor -- start 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.908+0000 7fe184d74640 1 -- start start 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.908+0000 7fe184d74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1801001e0 0x7fe180199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.908+0000 7fe184d74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe180100b20 0x7fe180199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.908+0000 7fe184d74640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe18010c970 con 0x7fe180100b20 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.908+0000 7fe184d74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe18010c7f0 con 0x7fe1801001e0 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.908+0000 7fe177fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe180100b20 0x7fe180199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.908+0000 7fe177fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe180100b20 0x7fe180199ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60502/0 (socket says 172.21.15.45:60502) 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.908+0000 7fe177fff640 1 -- 172.21.15.45:0/1847763871 learned_addr learned my addr 172.21.15.45:0/1847763871 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.908+0000 7fe17e59c640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1801001e0 0x7fe180199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.909+0000 7fe177fff640 1 -- 172.21.15.45:0/1847763871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1801001e0 msgr2=0x7fe180199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.909+0000 7fe177fff640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1801001e0 0x7fe180199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.909+0000 7fe177fff640 1 -- 172.21.15.45:0/1847763871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18019a220 con 0x7fe180100b20 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.909+0000 7fe177fff640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe180100b20 0x7fe180199ba0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe16800e970 tx=0x7fe16800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.909+0000 7fe1777fe640 1 -- 172.21.15.45:0/1847763871 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe16800cac0 con 0x7fe180100b20 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.909+0000 7fe184d74640 1 -- 172.21.15.45:0/1847763871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18019ec60 con 0x7fe180100b20 2024-09-18T12:53:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.909+0000 7fe1777fe640 1 -- 172.21.15.45:0/1847763871 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe16800cc60 con 0x7fe180100b20 2024-09-18T12:53:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.909+0000 7fe1777fe640 1 -- 172.21.15.45:0/1847763871 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe168018720 con 0x7fe180100b20 2024-09-18T12:53:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.909+0000 7fe184d74640 1 -- 172.21.15.45:0/1847763871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18019f1a0 con 0x7fe180100b20 2024-09-18T12:53:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.911+0000 7fe184d74640 1 -- 172.21.15.45:0/1847763871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1801005e0 con 0x7fe180100b20 2024-09-18T12:53:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.911+0000 7fe1777fe640 1 -- 172.21.15.45:0/1847763871 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 30) ==== 103422+0+0 (secure 0 0 0) 0x7fe168010430 con 0x7fe180100b20 2024-09-18T12:53:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.912+0000 7fe1777fe640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe16c07b0a0 0x7fe16c07d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.912+0000 7fe17e59c640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe16c07b0a0 0x7fe16c07d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.912+0000 7fe1777fe640 1 -- 172.21.15.45:0/1847763871 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fe16809e730 con 0x7fe180100b20 2024-09-18T12:53:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.913+0000 7fe17e59c640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe16c07b0a0 0x7fe16c07d560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe170000c00 tx=0x7fe170005a20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:36.916+0000 7fe1777fe640 1 -- 172.21.15.45:0/1847763871 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe168069be0 con 0x7fe180100b20 2024-09-18T12:53:37.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.279+0000 7fe184d74640 1 -- 172.21.15.45:0/1847763871 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe1800626f0 con 0x7fe16c07b0a0 2024-09-18T12:53:37.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.281+0000 7fe1777fe640 1 -- 172.21.15.45:0/1847763871 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7fe1800626f0 con 0x7fe16c07b0a0 2024-09-18T12:53:37.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.285+0000 7fe184d74640 1 -- 172.21.15.45:0/1847763871 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe16c07b0a0 msgr2=0x7fe16c07d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.285+0000 7fe184d74640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe16c07b0a0 0x7fe16c07d560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe170000c00 tx=0x7fe170005a20 comp rx=0 tx=0).stop 2024-09-18T12:53:37.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.285+0000 7fe184d74640 1 -- 172.21.15.45:0/1847763871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe180100b20 msgr2=0x7fe180199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.285+0000 7fe184d74640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe180100b20 0x7fe180199ba0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe16800e970 tx=0x7fe16800ee30 comp rx=0 tx=0).stop 2024-09-18T12:53:37.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.285+0000 7fe184d74640 1 -- 172.21.15.45:0/1847763871 shutdown_connections 2024-09-18T12:53:37.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.285+0000 7fe184d74640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe16c07b0a0 0x7fe16c07d560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.285+0000 7fe184d74640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe180100b20 0x7fe180199ba0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.285+0000 7fe184d74640 1 --2- 172.21.15.45:0/1847763871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1801001e0 0x7fe180199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.285+0000 7fe184d74640 1 -- 172.21.15.45:0/1847763871 >> 172.21.15.45:0/1847763871 conn(0x7fe1800fc010 msgr2=0x7fe180108a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:37.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.286+0000 7fe184d74640 1 -- 172.21.15.45:0/1847763871 shutdown_connections 2024-09-18T12:53:37.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.286+0000 7fe184d74640 1 -- 172.21.15.45:0/1847763871 wait complete. 2024-09-18T12:53:37.298 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:53:37.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.385+0000 7f51a5422640 1 -- 172.21.15.45:0/60814909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a0104d20 msgr2=0x7f51a0107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.385+0000 7f51a5422640 1 --2- 172.21.15.45:0/60814909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a0104d20 0x7f51a0107110 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f51940098b0 tx=0x7f519402a4d0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.386+0000 7f51a5422640 1 -- 172.21.15.45:0/60814909 shutdown_connections 2024-09-18T12:53:37.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.386+0000 7f51a5422640 1 --2- 172.21.15.45:0/60814909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a0104d20 0x7f51a0107110 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.386+0000 7f51a5422640 1 --2- 172.21.15.45:0/60814909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51a01023f0 0x7f51a01047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.386+0000 7f51a5422640 1 -- 172.21.15.45:0/60814909 >> 172.21.15.45:0/60814909 conn(0x7f51a00fc010 msgr2=0x7f51a00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:37.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.386+0000 7f51a5422640 1 -- 172.21.15.45:0/60814909 shutdown_connections 2024-09-18T12:53:37.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.386+0000 7f51a5422640 1 -- 172.21.15.45:0/60814909 wait complete. 2024-09-18T12:53:37.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.386+0000 7f51a5422640 1 Processor -- start 2024-09-18T12:53:37.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f51a5422640 1 -- start start 2024-09-18T12:53:37.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f51a5422640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a01023f0 0x7f51a0197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f51a5422640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51a0104d20 0x7f51a0197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f51a5422640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f51a010a790 con 0x7f51a01023f0 2024-09-18T12:53:37.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f51a5422640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f51a010a610 con 0x7f51a0104d20 2024-09-18T12:53:37.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f519effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a01023f0 0x7f51a0197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f519effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a01023f0 0x7f51a0197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60528/0 (socket says 172.21.15.45:60528) 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f519effd640 1 -- 172.21.15.45:0/2905874822 learned_addr learned my addr 172.21.15.45:0/2905874822 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f519e7fc640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51a0104d20 0x7f51a0197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f519effd640 1 -- 172.21.15.45:0/2905874822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51a0104d20 msgr2=0x7f51a0197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f519effd640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51a0104d20 0x7f51a0197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.387+0000 7f519effd640 1 -- 172.21.15.45:0/2905874822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a01980d0 con 0x7f51a01023f0 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.388+0000 7f519effd640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a01023f0 0x7f51a0197510 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f519000d8d0 tx=0x7f519000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.388+0000 7f5187fff640 1 -- 172.21.15.45:0/2905874822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5190017070 con 0x7f51a01023f0 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.388+0000 7f51a5422640 1 -- 172.21.15.45:0/2905874822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a019cb10 con 0x7f51a01023f0 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.388+0000 7f5187fff640 1 -- 172.21.15.45:0/2905874822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5190010460 con 0x7f51a01023f0 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.388+0000 7f5187fff640 1 -- 172.21.15.45:0/2905874822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f519000f5f0 con 0x7f51a01023f0 2024-09-18T12:53:37.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.388+0000 7f51a5422640 1 -- 172.21.15.45:0/2905874822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a019d070 con 0x7f51a01023f0 2024-09-18T12:53:37.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.389+0000 7f51a5422640 1 -- 172.21.15.45:0/2905874822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a01027d0 con 0x7f51a01023f0 2024-09-18T12:53:37.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.390+0000 7f5187fff640 1 -- 172.21.15.45:0/2905874822 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 30) ==== 103422+0+0 (secure 0 0 0) 0x7f5190009a30 con 0x7f51a01023f0 2024-09-18T12:53:37.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.391+0000 7f5187fff640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f518807b050 0x7f518807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.391+0000 7f5187fff640 1 -- 172.21.15.45:0/2905874822 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f519009e100 con 0x7f51a01023f0 2024-09-18T12:53:37.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.391+0000 7f519e7fc640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f518807b050 0x7f518807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.392+0000 7f519e7fc640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f518807b050 0x7f518807d510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5194009880 tx=0x7f51940058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:37.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.397+0000 7f5187fff640 1 -- 172.21.15.45:0/2905874822 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f5190069490 con 0x7f51a01023f0 2024-09-18T12:53:37.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:37 smithi045 ceph-mon[28315]: pgmap v25: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 352 op/s 2024-09-18T12:53:37.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:37 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:37.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:37 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:37.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:37 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:53:37.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:37 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:37.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.650+0000 7f51a5422640 1 -- 172.21.15.45:0/2905874822 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f51a0105780 con 0x7f518807b050 2024-09-18T12:53:37.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.651+0000 7f5187fff640 1 -- 172.21.15.45:0/2905874822 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f51a0105780 con 0x7f518807b050 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 -- 172.21.15.45:0/2905874822 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f518807b050 msgr2=0x7f518807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f518807b050 0x7f518807d510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5194009880 tx=0x7f51940058d0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 -- 172.21.15.45:0/2905874822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a01023f0 msgr2=0x7f51a0197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a01023f0 0x7f51a0197510 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f519000d8d0 tx=0x7f519000dd90 comp rx=0 tx=0).stop 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 -- 172.21.15.45:0/2905874822 shutdown_connections 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f518807b050 0x7f518807d510 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51a0104d20 0x7f51a0197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 --2- 172.21.15.45:0/2905874822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a01023f0 0x7f51a0197510 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 -- 172.21.15.45:0/2905874822 >> 172.21.15.45:0/2905874822 conn(0x7f51a00fc010 msgr2=0x7f51a00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 -- 172.21.15.45:0/2905874822 shutdown_connections 2024-09-18T12:53:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.653+0000 7f51a5422640 1 -- 172.21.15.45:0/2905874822 wait complete. 2024-09-18T12:53:37.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.767+0000 7fbc21e41640 1 -- 172.21.15.45:0/2672851568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc1c100860 msgr2=0x7fbc1c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.767+0000 7fbc21e41640 1 --2- 172.21.15.45:0/2672851568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc1c100860 0x7fbc1c100c60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c009880 tx=0x7fbc0c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.767+0000 7fbc21e41640 1 -- 172.21.15.45:0/2672851568 shutdown_connections 2024-09-18T12:53:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.767+0000 7fbc21e41640 1 --2- 172.21.15.45:0/2672851568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc1c101a60 0x7fbc1c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.767+0000 7fbc21e41640 1 --2- 172.21.15.45:0/2672851568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc1c100860 0x7fbc1c100c60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.767+0000 7fbc21e41640 1 -- 172.21.15.45:0/2672851568 >> 172.21.15.45:0/2672851568 conn(0x7fbc1c0fc010 msgr2=0x7fbc1c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.767+0000 7fbc21e41640 1 -- 172.21.15.45:0/2672851568 shutdown_connections 2024-09-18T12:53:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.767+0000 7fbc21e41640 1 -- 172.21.15.45:0/2672851568 wait complete. 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.768+0000 7fbc21e41640 1 Processor -- start 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.768+0000 7fbc21e41640 1 -- start start 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.768+0000 7fbc21e41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc1c100860 0x7fbc1c104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.768+0000 7fbc21e41640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc1c101a60 0x7fbc1c102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.768+0000 7fbc21e41640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c109680 con 0x7fbc1c100860 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.768+0000 7fbc21e41640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c109500 con 0x7fbc1c101a60 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.768+0000 7fbc1b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc1c100860 0x7fbc1c104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.768+0000 7fbc1b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc1c100860 0x7fbc1c104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60546/0 (socket says 172.21.15.45:60546) 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.768+0000 7fbc1b7fe640 1 -- 172.21.15.45:0/1898504258 learned_addr learned my addr 172.21.15.45:0/1898504258 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.768+0000 7fbc1affd640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc1c101a60 0x7fbc1c102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.769+0000 7fbc1b7fe640 1 -- 172.21.15.45:0/1898504258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc1c101a60 msgr2=0x7fbc1c102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.769+0000 7fbc1b7fe640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc1c101a60 0x7fbc1c102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.769+0000 7fbc1b7fe640 1 -- 172.21.15.45:0/1898504258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1c103380 con 0x7fbc1c100860 2024-09-18T12:53:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.769+0000 7fbc1affd640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc1c101a60 0x7fbc1c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:53:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.769+0000 7fbc1b7fe640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc1c100860 0x7fbc1c104780 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c006010 tx=0x7fbc0c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.769+0000 7fbc18ff9640 1 -- 172.21.15.45:0/1898504258 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc0c03f070 con 0x7fbc1c100860 2024-09-18T12:53:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.769+0000 7fbc18ff9640 1 -- 172.21.15.45:0/1898504258 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc0c0049d0 con 0x7fbc1c100860 2024-09-18T12:53:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.769+0000 7fbc18ff9640 1 -- 172.21.15.45:0/1898504258 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc0c035030 con 0x7fbc1c100860 2024-09-18T12:53:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.769+0000 7fbc21e41640 1 -- 172.21.15.45:0/1898504258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1c103610 con 0x7fbc1c100860 2024-09-18T12:53:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.769+0000 7fbc21e41640 1 -- 172.21.15.45:0/1898504258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc1c103b40 con 0x7fbc1c100860 2024-09-18T12:53:37.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.770+0000 7fbc21e41640 1 -- 172.21.15.45:0/1898504258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc1c100c60 con 0x7fbc1c100860 2024-09-18T12:53:37.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.771+0000 7fbc18ff9640 1 -- 172.21.15.45:0/1898504258 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 30) ==== 103422+0+0 (secure 0 0 0) 0x7fbc0c042070 con 0x7fbc1c100860 2024-09-18T12:53:37.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.772+0000 7fbc18ff9640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc0407b0b0 0x7fbc0407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:37.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.772+0000 7fbc18ff9640 1 -- 172.21.15.45:0/1898504258 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fbc0c0bec30 con 0x7fbc1c100860 2024-09-18T12:53:37.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.772+0000 7fbc1affd640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc0407b0b0 0x7fbc0407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:37.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.773+0000 7fbc1affd640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc0407b0b0 0x7fbc0407d570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c104500 tx=0x7fbc10005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:37.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:37.776+0000 7fbc18ff9640 1 -- 172.21.15.45:0/1898504258 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fbc0c08a0e0 con 0x7fbc1c100860 2024-09-18T12:53:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:37 smithi161 ceph-mon[35784]: pgmap v25: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 352 op/s 2024-09-18T12:53:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:37 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:37 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:37 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:53:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:37 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:38.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.090+0000 7fbc21e41640 1 -- 172.21.15.45:0/1898504258 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbc1c06a3e0 con 0x7fbc0407b0b0 2024-09-18T12:53:38.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.100+0000 7fbc18ff9640 1 -- 172.21.15.45:0/1898504258 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fbc1c06a3e0 con 0x7fbc0407b0b0 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (8m) 35s ago 9m 27.0M - 0.25.0 c8568f914cd2 de7ae4bc8025 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (110s) 35s ago 9m 8493k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (75s) 41s ago 8m 7977k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (9m) 35s ago 9m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (8m) 41s ago 8m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (8m) 35s ago 9m 76.7M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (4m) 35s ago 4m 278M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (4m) 35s ago 4m 250M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (4m) 41s ago 4m 15.6M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (4m) 41s ago 4m 14.0M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:53:38.103 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (56s) 35s ago 10m 487M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (2m) 41s ago 8m 145M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 0fb3c7114540 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (10m) 35s ago 11m 56.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (8m) 41s ago 8m 44.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (9m) 35s ago 9m 17.3M - 1.5.0 0da6a335fe13 39666fd05306 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (8m) 41s ago 8m 16.4M - 1.5.0 0da6a335fe13 ed4fe4d74f39 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (7m) 35s ago 7m 174M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (6m) 35s ago 7m 186M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (6m) 35s ago 6m 151M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (6m) 41s ago 6m 200M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (5m) 41s ago 5m 186M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (5m) 41s ago 5m 168M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:53:38.104 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 starting - - - - 2024-09-18T12:53:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.102+0000 7fbc21e41640 1 -- 172.21.15.45:0/1898504258 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc0407b0b0 msgr2=0x7fbc0407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.102+0000 7fbc21e41640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc0407b0b0 0x7fbc0407d570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c104500 tx=0x7fbc10005f90 comp rx=0 tx=0).stop 2024-09-18T12:53:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.102+0000 7fbc21e41640 1 -- 172.21.15.45:0/1898504258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc1c100860 msgr2=0x7fbc1c104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.102+0000 7fbc21e41640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc1c100860 0x7fbc1c104780 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c006010 tx=0x7fbc0c0045e0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.102+0000 7fbc21e41640 1 -- 172.21.15.45:0/1898504258 shutdown_connections 2024-09-18T12:53:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.102+0000 7fbc21e41640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc0407b0b0 0x7fbc0407d570 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.102+0000 7fbc21e41640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc1c101a60 0x7fbc1c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.102+0000 7fbc21e41640 1 --2- 172.21.15.45:0/1898504258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc1c100860 0x7fbc1c104780 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.102+0000 7fbc21e41640 1 -- 172.21.15.45:0/1898504258 >> 172.21.15.45:0/1898504258 conn(0x7fbc1c0fc010 msgr2=0x7fbc1c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.103+0000 7fbc21e41640 1 -- 172.21.15.45:0/1898504258 shutdown_connections 2024-09-18T12:53:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.103+0000 7fbc21e41640 1 -- 172.21.15.45:0/1898504258 wait complete. 2024-09-18T12:53:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.197+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3011305216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87c8102b30 msgr2=0x7f87c8104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.197+0000 7f87ce6e5640 1 --2- 172.21.15.45:0/3011305216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87c8102b30 0x7f87c8104fa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009880 tx=0x7f87bc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.197+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3011305216 shutdown_connections 2024-09-18T12:53:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.197+0000 7f87ce6e5640 1 --2- 172.21.15.45:0/3011305216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87c8102b30 0x7f87c8104fa0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.197+0000 7f87ce6e5640 1 --2- 172.21.15.45:0/3011305216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87c81001e0 0x7f87c81025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.197+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3011305216 >> 172.21.15.45:0/3011305216 conn(0x7f87c80fbff0 msgr2=0x7f87c80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.197+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3011305216 shutdown_connections 2024-09-18T12:53:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.197+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3011305216 wait complete. 2024-09-18T12:53:38.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.198+0000 7f87ce6e5640 1 Processor -- start 2024-09-18T12:53:38.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.198+0000 7f87ce6e5640 1 -- start start 2024-09-18T12:53:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.198+0000 7f87ce6e5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87c81001e0 0x7f87c819dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.198+0000 7f87ce6e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87c8102b30 0x7f87c819dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.198+0000 7f87ce6e5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f87c8110d90 con 0x7f87c8102b30 2024-09-18T12:53:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.198+0000 7f87ce6e5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f87c8110c10 con 0x7f87c81001e0 2024-09-18T12:53:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.198+0000 7f87c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87c8102b30 0x7f87c819dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.198+0000 7f87c7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87c81001e0 0x7f87c819dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:38.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.198+0000 7f87c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87c8102b30 0x7f87c819dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60554/0 (socket says 172.21.15.45:60554) 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.198+0000 7f87c77fe640 1 -- 172.21.15.45:0/3070111763 learned_addr learned my addr 172.21.15.45:0/3070111763 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.199+0000 7f87c7fff640 1 -- 172.21.15.45:0/3070111763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87c8102b30 msgr2=0x7f87c819dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.199+0000 7f87c7fff640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87c8102b30 0x7f87c819dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.199+0000 7f87c7fff640 1 -- 172.21.15.45:0/3070111763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c819e670 con 0x7f87c81001e0 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.199+0000 7f87c77fe640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87c8102b30 0x7f87c819dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.199+0000 7f87c7fff640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87c81001e0 0x7f87c819dab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87b800d6a0 tx=0x7f87b800db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.199+0000 7f87c57fa640 1 -- 172.21.15.45:0/3070111763 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87b8017070 con 0x7f87c81001e0 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.199+0000 7f87c57fa640 1 -- 172.21.15.45:0/3070111763 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f87b80054e0 con 0x7f87c81001e0 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.199+0000 7f87c57fa640 1 -- 172.21.15.45:0/3070111763 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87b8004af0 con 0x7f87c81001e0 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.199+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3070111763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c81a30b0 con 0x7f87c81001e0 2024-09-18T12:53:38.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.199+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3070111763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c81a3640 con 0x7f87c81001e0 2024-09-18T12:53:38.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.200+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3070111763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c81005e0 con 0x7f87c81001e0 2024-09-18T12:53:38.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.201+0000 7f87c57fa640 1 -- 172.21.15.45:0/3070111763 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 30) ==== 103422+0+0 (secure 0 0 0) 0x7f87b80097c0 con 0x7f87c81001e0 2024-09-18T12:53:38.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.202+0000 7f87c57fa640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f87b007b050 0x7f87b007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:38.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.202+0000 7f87c57fa640 1 -- 172.21.15.45:0/3070111763 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f87b809de40 con 0x7f87c81001e0 2024-09-18T12:53:38.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.202+0000 7f87c77fe640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f87b007b050 0x7f87b007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:38.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.202+0000 7f87c77fe640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f87b007b050 0x7f87b007d510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0096c0 tx=0x7f87bc005a40 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:38.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.206+0000 7f87c57fa640 1 -- 172.21.15.45:0/3070111763 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f87b80691d0 con 0x7f87c81001e0 2024-09-18T12:53:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.586+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3070111763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f87c81a3f90 con 0x7f87c81001e0 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.586+0000 7f87c57fa640 1 -- 172.21.15.45:0/3070111763 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f87b806e080 con 0x7f87c81001e0 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:53:38.589 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:53:38.590 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:53:38.590 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:53:38.590 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:53:38.590 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:53:38.590 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:53:38.590 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:53:38.590 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:53:38.590 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:53:38.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3070111763 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f87b007b050 msgr2=0x7f87b007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:38.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f87b007b050 0x7f87b007d510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0096c0 tx=0x7f87bc005a40 comp rx=0 tx=0).stop 2024-09-18T12:53:38.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3070111763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87c81001e0 msgr2=0x7f87c819dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:38.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87c81001e0 0x7f87c819dab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87b800d6a0 tx=0x7f87b800db60 comp rx=0 tx=0).stop 2024-09-18T12:53:38.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3070111763 shutdown_connections 2024-09-18T12:53:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f87b007b050 0x7f87b007d510 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87c8102b30 0x7f87c819dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 --2- 172.21.15.45:0/3070111763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87c81001e0 0x7f87c819dab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3070111763 >> 172.21.15.45:0/3070111763 conn(0x7f87c80fbff0 msgr2=0x7f87c80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3070111763 shutdown_connections 2024-09-18T12:53:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.589+0000 7f87ce6e5640 1 -- 172.21.15.45:0/3070111763 wait complete. 2024-09-18T12:53:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.693+0000 7f1c2c410640 1 -- 172.21.15.45:0/2616457739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c24102470 msgr2=0x7f1c24104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.693+0000 7f1c2c410640 1 --2- 172.21.15.45:0/2616457739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c24102470 0x7f1c24104860 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009880 tx=0x7f1c2002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.693+0000 7f1c2c410640 1 -- 172.21.15.45:0/2616457739 shutdown_connections 2024-09-18T12:53:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.693+0000 7f1c2c410640 1 --2- 172.21.15.45:0/2616457739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c24104da0 0x7f1c24107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.693+0000 7f1c2c410640 1 --2- 172.21.15.45:0/2616457739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c24102470 0x7f1c24104860 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.693+0000 7f1c2c410640 1 -- 172.21.15.45:0/2616457739 >> 172.21.15.45:0/2616457739 conn(0x7f1c240fc010 msgr2=0x7f1c240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.693+0000 7f1c2c410640 1 -- 172.21.15.45:0/2616457739 shutdown_connections 2024-09-18T12:53:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.693+0000 7f1c2c410640 1 -- 172.21.15.45:0/2616457739 wait complete. 2024-09-18T12:53:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c2c410640 1 Processor -- start 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c2c410640 1 -- start start 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c2c410640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c24102470 0x7f1c24101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c2c410640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c24104da0 0x7f1c24100420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c2c410640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2410a7d0 con 0x7f1c24104da0 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c2c410640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2410a650 con 0x7f1c24102470 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c299ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c24104da0 0x7f1c24100420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c2a1ac640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c24102470 0x7f1c24101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c299ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c24104da0 0x7f1c24100420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60574/0 (socket says 172.21.15.45:60574) 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c299ab640 1 -- 172.21.15.45:0/1235070698 learned_addr learned my addr 172.21.15.45:0/1235070698 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.694+0000 7f1c2a1ac640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c24102470 0x7f1c24101d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:56650/0 (socket says 172.21.15.45:56650) 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.695+0000 7f1c299ab640 1 -- 172.21.15.45:0/1235070698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c24102470 msgr2=0x7f1c24101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.695+0000 7f1c299ab640 1 --2- 172.21.15.45:0/1235070698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c24102470 0x7f1c24101d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.695+0000 7f1c299ab640 1 -- 172.21.15.45:0/1235070698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c24100960 con 0x7f1c24104da0 2024-09-18T12:53:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.695+0000 7f1c299ab640 1 --2- 172.21.15.45:0/1235070698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c24104da0 0x7f1c24100420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e970 tx=0x7f1c1400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.695+0000 7f1c1b7fe640 1 -- 172.21.15.45:0/1235070698 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c1400cac0 con 0x7f1c24104da0 2024-09-18T12:53:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.695+0000 7f1c2c410640 1 -- 172.21.15.45:0/1235070698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c24100c50 con 0x7f1c24104da0 2024-09-18T12:53:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.695+0000 7f1c2c410640 1 -- 172.21.15.45:0/1235070698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c241011e0 con 0x7f1c24104da0 2024-09-18T12:53:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.695+0000 7f1c1b7fe640 1 -- 172.21.15.45:0/1235070698 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c140054e0 con 0x7f1c24104da0 2024-09-18T12:53:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.695+0000 7f1c1b7fe640 1 -- 172.21.15.45:0/1235070698 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c14010430 con 0x7f1c24104da0 2024-09-18T12:53:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.697+0000 7f1c2c410640 1 -- 172.21.15.45:0/1235070698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c080052c0 con 0x7f1c24104da0 2024-09-18T12:53:38.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.698+0000 7f1c1b7fe640 1 -- 172.21.15.45:0/1235070698 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 30) ==== 103422+0+0 (secure 0 0 0) 0x7f1c140046c0 con 0x7f1c24104da0 2024-09-18T12:53:38.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.698+0000 7f1c1b7fe640 1 --2- 172.21.15.45:0/1235070698 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1c1007b0a0 0x7f1c1007d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:53:38.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.699+0000 7f1c1b7fe640 1 -- 172.21.15.45:0/1235070698 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f1c1409e720 con 0x7f1c24104da0 2024-09-18T12:53:38.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.699+0000 7f1c2a1ac640 1 --2- 172.21.15.45:0/1235070698 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1c1007b0a0 0x7f1c1007d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:53:38.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.699+0000 7f1c2a1ac640 1 --2- 172.21.15.45:0/1235070698 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1c1007b0a0 0x7f1c1007d560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1c20000c00 tx=0x7f1c20005a20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:53:38.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:38.703+0000 7f1c1b7fe640 1 -- 172.21.15.45:0/1235070698 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f1c14069bd0 con 0x7f1c24104da0 2024-09-18T12:53:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:38 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:53:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:38 smithi045 ceph-mon[28315]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:38 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:38 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:53:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:38 smithi161 ceph-mon[35784]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:38 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:39.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.024+0000 7f1c2c410640 1 -- 172.21.15.45:0/1235070698 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1c08000bf0 con 0x7f1c1007b0a0 2024-09-18T12:53:39.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.026+0000 7f1c1b7fe640 1 -- 172.21.15.45:0/1235070698 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f1c08000bf0 con 0x7f1c1007b0a0 2024-09-18T12:53:39.029 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:53:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:53:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:53:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:53:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:53:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr" 2024-09-18T12:53:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:53:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "2/2 daemons upgraded", 2024-09-18T12:53:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T12:53:39.030 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:53:39.030 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:53:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.031+0000 7f1c2c410640 1 -- 172.21.15.45:0/1235070698 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1c1007b0a0 msgr2=0x7f1c1007d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.031+0000 7f1c2c410640 1 --2- 172.21.15.45:0/1235070698 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1c1007b0a0 0x7f1c1007d560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1c20000c00 tx=0x7f1c20005a20 comp rx=0 tx=0).stop 2024-09-18T12:53:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.031+0000 7f1c2c410640 1 -- 172.21.15.45:0/1235070698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c24104da0 msgr2=0x7f1c24100420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:53:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.031+0000 7f1c2c410640 1 --2- 172.21.15.45:0/1235070698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c24104da0 0x7f1c24100420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e970 tx=0x7f1c1400ee30 comp rx=0 tx=0).stop 2024-09-18T12:53:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.032+0000 7f1c2c410640 1 -- 172.21.15.45:0/1235070698 shutdown_connections 2024-09-18T12:53:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.032+0000 7f1c2c410640 1 --2- 172.21.15.45:0/1235070698 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1c1007b0a0 0x7f1c1007d560 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.032+0000 7f1c2c410640 1 --2- 172.21.15.45:0/1235070698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c24104da0 0x7f1c24100420 secure :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400e970 tx=0x7f1c1400ee30 comp rx=0 tx=0).stop 2024-09-18T12:53:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.032+0000 7f1c2c410640 1 --2- 172.21.15.45:0/1235070698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c24102470 0x7f1c24101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:53:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.032+0000 7f1c2c410640 1 -- 172.21.15.45:0/1235070698 >> 172.21.15.45:0/1235070698 conn(0x7f1c240fc010 msgr2=0x7f1c240fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:53:39.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.034+0000 7f1c2c410640 1 -- 172.21.15.45:0/1235070698 shutdown_connections 2024-09-18T12:53:39.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:53:39.034+0000 7f1c2c410640 1 -- 172.21.15.45:0/1235070698 wait complete. 2024-09-18T12:53:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:39 smithi045 ceph-mon[28315]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:39 smithi045 ceph-mon[28315]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:39 smithi045 ceph-mon[28315]: pgmap v26: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2024-09-18T12:53:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:39 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3070111763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:39 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.yoflkm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:53:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:39 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:53:39.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:39 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:39 smithi161 ceph-mon[35784]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:39 smithi161 ceph-mon[35784]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:39 smithi161 ceph-mon[35784]: pgmap v26: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2024-09-18T12:53:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:39 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3070111763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:39 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.yoflkm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T12:53:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:39 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T12:53:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:39 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:40.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:40 smithi045 ceph-mon[28315]: Upgrade: Updating mgr.smithi161.yoflkm 2024-09-18T12:53:40.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:40 smithi045 ceph-mon[28315]: Deploying daemon mgr.smithi161.yoflkm on smithi161 2024-09-18T12:53:40.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:40 smithi045 ceph-mon[28315]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:40.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:40 smithi161 ceph-mon[35784]: Upgrade: Updating mgr.smithi161.yoflkm 2024-09-18T12:53:40.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:40 smithi161 ceph-mon[35784]: Deploying daemon mgr.smithi161.yoflkm on smithi161 2024-09-18T12:53:40.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:40 smithi161 ceph-mon[35784]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:53:41.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:41 smithi045 ceph-mon[28315]: pgmap v27: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 401 op/s 2024-09-18T12:53:41.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:41 smithi161 ceph-mon[35784]: pgmap v27: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 401 op/s 2024-09-18T12:53:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:43 smithi045 ceph-mon[28315]: pgmap v28: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 207 op/s 2024-09-18T12:53:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:43 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:43.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:43 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:43.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:43 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:43.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:43 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:43.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:43 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:43 smithi161 ceph-mon[35784]: pgmap v28: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 207 op/s 2024-09-18T12:53:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:43 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:43 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:43 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:43 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:43 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:45 smithi045 ceph-mon[28315]: pgmap v29: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 323 op/s 2024-09-18T12:53:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:45 smithi161 ceph-mon[35784]: pgmap v29: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 323 op/s 2024-09-18T12:53:46.930 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:46.931 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:46.931 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:46 smithi161 ceph-mon[35784]: pgmap v30: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-09-18T12:53:46.931 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:46.931 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:47.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:47.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:47.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:46 smithi045 ceph-mon[28315]: pgmap v30: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-09-18T12:53:47.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:47.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:49.515 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:49 smithi161 ceph-mon[35784]: pgmap v31: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 240 op/s 2024-09-18T12:53:49.515 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:49 smithi161 ceph-mon[35784]: Standby manager daemon smithi161.yoflkm restarted 2024-09-18T12:53:49.515 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:49 smithi161 ceph-mon[35784]: Standby manager daemon smithi161.yoflkm started 2024-09-18T12:53:49.515 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:49 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/1943680774' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/crt"}]: dispatch 2024-09-18T12:53:49.515 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:49 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/1943680774' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:53:49.515 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:49 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/1943680774' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/key"}]: dispatch 2024-09-18T12:53:49.516 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:49 smithi161 ceph-mon[35784]: from='mgr.? 172.21.15.161:0/1943680774' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:53:49.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:49 smithi045 ceph-mon[28315]: pgmap v31: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 240 op/s 2024-09-18T12:53:49.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:49 smithi045 ceph-mon[28315]: Standby manager daemon smithi161.yoflkm restarted 2024-09-18T12:53:49.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:49 smithi045 ceph-mon[28315]: Standby manager daemon smithi161.yoflkm started 2024-09-18T12:53:49.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:49 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/1943680774' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/crt"}]: dispatch 2024-09-18T12:53:49.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:49 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/1943680774' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T12:53:49.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:49 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/1943680774' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.yoflkm/key"}]: dispatch 2024-09-18T12:53:49.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:49 smithi045 ceph-mon[28315]: from='mgr.? 172.21.15.161:0/1943680774' entity='mgr.smithi161.yoflkm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T12:53:50.467 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:50 smithi161 ceph-mon[35784]: mgrmap e31: smithi045.brvbvl(active, since 57s), standbys: smithi161.yoflkm 2024-09-18T12:53:50.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:50 smithi045 ceph-mon[28315]: mgrmap e31: smithi045.brvbvl(active, since 57s), standbys: smithi161.yoflkm 2024-09-18T12:53:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:51 smithi045 ceph-mon[28315]: pgmap v32: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 280 op/s 2024-09-18T12:53:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:51 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:51 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:51 smithi161 ceph-mon[35784]: pgmap v32: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 280 op/s 2024-09-18T12:53:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:51 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:51 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi045.brvbvl"}]: dispatch 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi045.brvbvl"}]': finished 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.yoflkm"}]: dispatch 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.yoflkm"}]': finished 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:52 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:53:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:53:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi045.brvbvl"}]: dispatch 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi045.brvbvl"}]': finished 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.yoflkm"}]: dispatch 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.yoflkm"}]': finished 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:52.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:53:52.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:52 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:53:53.284 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-18T12:53:53.288 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-18T12:53:53.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:53 smithi161 ceph-mon[35784]: Upgrade: Setting container_image for all mgr 2024-09-18T12:53:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:53 smithi161 ceph-mon[35784]: Upgrade: Setting container_image for all rgw 2024-09-18T12:53:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:53 smithi161 ceph-mon[35784]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T12:53:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:53 smithi161 ceph-mon[35784]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-18T12:53:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:53 smithi161 ceph-mon[35784]: Upgrade: Setting container_image for all iscsi 2024-09-18T12:53:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:53 smithi161 ceph-mon[35784]: Upgrade: Setting container_image for all nfs 2024-09-18T12:53:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:53 smithi161 ceph-mon[35784]: Upgrade: Setting container_image for all nvmeof 2024-09-18T12:53:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:53 smithi161 ceph-mon[35784]: pgmap v33: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 188 op/s 2024-09-18T12:53:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:53.582 DEBUG:teuthology.parallel:result is None 2024-09-18T12:53:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:53 smithi045 ceph-mon[28315]: Upgrade: Setting container_image for all mgr 2024-09-18T12:53:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:53 smithi045 ceph-mon[28315]: Upgrade: Setting container_image for all rgw 2024-09-18T12:53:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:53 smithi045 ceph-mon[28315]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T12:53:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:53 smithi045 ceph-mon[28315]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-18T12:53:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:53 smithi045 ceph-mon[28315]: Upgrade: Setting container_image for all iscsi 2024-09-18T12:53:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:53 smithi045 ceph-mon[28315]: Upgrade: Setting container_image for all nfs 2024-09-18T12:53:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:53 smithi045 ceph-mon[28315]: Upgrade: Setting container_image for all nvmeof 2024-09-18T12:53:53.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:53 smithi045 ceph-mon[28315]: pgmap v33: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 188 op/s 2024-09-18T12:53:53.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:53:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:55 smithi045 ceph-mon[28315]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 265 op/s 2024-09-18T12:53:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:55 smithi161 ceph-mon[35784]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 265 op/s 2024-09-18T12:53:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:57 smithi045 ceph-mon[28315]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-18T12:53:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:57 smithi161 ceph-mon[35784]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-18T12:53:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:59 smithi045 ceph-mon[28315]: pgmap v36: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 160 op/s 2024-09-18T12:53:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:59 smithi045 ceph-mon[28315]: Upgrade: Updating node-exporter.smithi045 (1/2) 2024-09-18T12:53:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:53:59 smithi045 ceph-mon[28315]: Deploying daemon node-exporter.smithi045 on smithi045 2024-09-18T12:53:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:59 smithi161 ceph-mon[35784]: pgmap v36: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 160 op/s 2024-09-18T12:53:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:59 smithi161 ceph-mon[35784]: Upgrade: Updating node-exporter.smithi045 (1/2) 2024-09-18T12:53:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:53:59 smithi161 ceph-mon[35784]: Deploying daemon node-exporter.smithi045 on smithi045 2024-09-18T12:54:00.765 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-18T12:54:00.766 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-18T12:54:01.095 DEBUG:teuthology.parallel:result is None 2024-09-18T12:54:01.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T12:54:01.130 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T12:54:01.131 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-18T12:54:01.169 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-18T12:54:01.169 DEBUG:teuthology.parallel:result is None 2024-09-18T12:54:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:01 smithi045 ceph-mon[28315]: pgmap v37: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 215 op/s 2024-09-18T12:54:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:01 smithi161 ceph-mon[35784]: pgmap v37: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 215 op/s 2024-09-18T12:54:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:03 smithi045 ceph-mon[28315]: pgmap v38: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-09-18T12:54:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:03 smithi161 ceph-mon[35784]: pgmap v38: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-09-18T12:54:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:05 smithi045 ceph-mon[28315]: pgmap v39: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 215 op/s 2024-09-18T12:54:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:05 smithi161 ceph-mon[35784]: pgmap v39: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 215 op/s 2024-09-18T12:54:07.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:06 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:07.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:06 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:07.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:06 smithi045 ceph-mon[28315]: pgmap v40: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 759 KiB/s rd, 683 KiB/s wr, 138 op/s 2024-09-18T12:54:07.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:06 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:07.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:06 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:07.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:06 smithi161 ceph-mon[35784]: pgmap v40: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 759 KiB/s rd, 683 KiB/s wr, 138 op/s 2024-09-18T12:54:07.688 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:07 smithi161 ceph-mon[35784]: Upgrade: Updating node-exporter.smithi161 (2/2) 2024-09-18T12:54:07.689 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:07 smithi161 ceph-mon[35784]: Deploying daemon node-exporter.smithi161 on smithi161 2024-09-18T12:54:08.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:07 smithi045 ceph-mon[28315]: Upgrade: Updating node-exporter.smithi161 (2/2) 2024-09-18T12:54:08.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:07 smithi045 ceph-mon[28315]: Deploying daemon node-exporter.smithi161 on smithi161 2024-09-18T12:54:09.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:08 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:54:09.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:08 smithi045 ceph-mon[28315]: pgmap v41: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 759 KiB/s rd, 683 KiB/s wr, 139 op/s 2024-09-18T12:54:09.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:08 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:54:09.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:08 smithi161 ceph-mon[35784]: pgmap v41: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 759 KiB/s rd, 683 KiB/s wr, 139 op/s 2024-09-18T12:54:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.142+0000 7f18c3e21640 1 -- 172.21.15.45:0/2446791938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18bc076220 msgr2=0x7f18bc074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.142+0000 7f18c3e21640 1 --2- 172.21.15.45:0/2446791938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18bc076220 0x7f18bc074680 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009880 tx=0x7f18b802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.142+0000 7f18c3e21640 1 -- 172.21.15.45:0/2446791938 shutdown_connections 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.142+0000 7f18c3e21640 1 --2- 172.21.15.45:0/2446791938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18bc074c50 0x7f18bc0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.142+0000 7f18c3e21640 1 --2- 172.21.15.45:0/2446791938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18bc076220 0x7f18bc074680 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.142+0000 7f18c3e21640 1 -- 172.21.15.45:0/2446791938 >> 172.21.15.45:0/2446791938 conn(0x7f18bc0fd0f0 msgr2=0x7f18bc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.142+0000 7f18c3e21640 1 -- 172.21.15.45:0/2446791938 shutdown_connections 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.142+0000 7f18c3e21640 1 -- 172.21.15.45:0/2446791938 wait complete. 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.142+0000 7f18c3e21640 1 Processor -- start 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.142+0000 7f18c3e21640 1 -- start start 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c3e21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18bc074c50 0x7f18bc1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c3e21640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18bc076220 0x7f18bc199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c3e21640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc10c9a0 con 0x7f18bc074c50 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c3e21640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc10c820 con 0x7f18bc076220 2024-09-18T12:54:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c1bbd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18bc074c50 0x7f18bc1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c1bbd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18bc074c50 0x7f18bc1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60802/0 (socket says 172.21.15.45:60802) 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c1bbd640 1 -- 172.21.15.45:0/216136812 learned_addr learned my addr 172.21.15.45:0/216136812 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c13bc640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18bc076220 0x7f18bc199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c1bbd640 1 -- 172.21.15.45:0/216136812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18bc076220 msgr2=0x7f18bc199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c1bbd640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18bc076220 0x7f18bc199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c1bbd640 1 -- 172.21.15.45:0/216136812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18bc19a2a0 con 0x7f18bc074c50 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.143+0000 7f18c1bbd640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18bc074c50 0x7f18bc1996e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f18b8006010 tx=0x7f18b80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.144+0000 7f18b2ffd640 1 -- 172.21.15.45:0/216136812 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18b803f070 con 0x7f18bc074c50 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.144+0000 7f18c3e21640 1 -- 172.21.15.45:0/216136812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18bc19ec80 con 0x7f18bc074c50 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.144+0000 7f18b2ffd640 1 -- 172.21.15.45:0/216136812 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18b8004a50 con 0x7f18bc074c50 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.144+0000 7f18b2ffd640 1 -- 172.21.15.45:0/216136812 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18b8035030 con 0x7f18bc074c50 2024-09-18T12:54:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.144+0000 7f18c3e21640 1 -- 172.21.15.45:0/216136812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18bc19f1c0 con 0x7f18bc074c50 2024-09-18T12:54:09.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.145+0000 7f18c3e21640 1 -- 172.21.15.45:0/216136812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18bc0750b0 con 0x7f18bc074c50 2024-09-18T12:54:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.145+0000 7f18b2ffd640 1 -- 172.21.15.45:0/216136812 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f18b8042070 con 0x7f18bc074c50 2024-09-18T12:54:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.146+0000 7f18b2ffd640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f18a807b050 0x7f18a807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.146+0000 7f18b2ffd640 1 -- 172.21.15.45:0/216136812 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f18b80bed00 con 0x7f18bc074c50 2024-09-18T12:54:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.146+0000 7f18c13bc640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f18a807b050 0x7f18a807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.147+0000 7f18c13bc640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f18a807b050 0x7f18a807d510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f18bc19ab90 tx=0x7f18ac00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.151+0000 7f18b2ffd640 1 -- 172.21.15.45:0/216136812 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f18b80c3070 con 0x7f18bc074c50 2024-09-18T12:54:09.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.358+0000 7f18c3e21640 1 -- 172.21.15.45:0/216136812 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f18bc062630 con 0x7f18a807b050 2024-09-18T12:54:09.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.359+0000 7f18b2ffd640 1 -- 172.21.15.45:0/216136812 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f18bc062630 con 0x7f18a807b050 2024-09-18T12:54:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 -- 172.21.15.45:0/216136812 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f18a807b050 msgr2=0x7f18a807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f18a807b050 0x7f18a807d510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f18bc19ab90 tx=0x7f18ac00b390 comp rx=0 tx=0).stop 2024-09-18T12:54:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 -- 172.21.15.45:0/216136812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18bc074c50 msgr2=0x7f18bc1996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18bc074c50 0x7f18bc1996e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f18b8006010 tx=0x7f18b80045e0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 -- 172.21.15.45:0/216136812 shutdown_connections 2024-09-18T12:54:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f18a807b050 0x7f18a807d510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18bc076220 0x7f18bc199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 --2- 172.21.15.45:0/216136812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18bc074c50 0x7f18bc1996e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 -- 172.21.15.45:0/216136812 >> 172.21.15.45:0/216136812 conn(0x7f18bc0fd0f0 msgr2=0x7f18bc1079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 -- 172.21.15.45:0/216136812 shutdown_connections 2024-09-18T12:54:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.361+0000 7f18c3e21640 1 -- 172.21.15.45:0/216136812 wait complete. 2024-09-18T12:54:09.371 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:54:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.446+0000 7f515c10c640 1 -- 172.21.15.45:0/3790608741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5154104d20 msgr2=0x7f5154107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.446+0000 7f515c10c640 1 --2- 172.21.15.45:0/3790608741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5154104d20 0x7f5154107110 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f51480098b0 tx=0x7f514802a4d0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.446+0000 7f515c10c640 1 -- 172.21.15.45:0/3790608741 shutdown_connections 2024-09-18T12:54:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.446+0000 7f515c10c640 1 --2- 172.21.15.45:0/3790608741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5154104d20 0x7f5154107110 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.446+0000 7f515c10c640 1 --2- 172.21.15.45:0/3790608741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51541023f0 0x7f51541047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.446+0000 7f515c10c640 1 -- 172.21.15.45:0/3790608741 >> 172.21.15.45:0/3790608741 conn(0x7f51540fc010 msgr2=0x7f51540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.447+0000 7f515c10c640 1 -- 172.21.15.45:0/3790608741 shutdown_connections 2024-09-18T12:54:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.447+0000 7f515c10c640 1 -- 172.21.15.45:0/3790608741 wait complete. 2024-09-18T12:54:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.447+0000 7f515c10c640 1 Processor -- start 2024-09-18T12:54:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.447+0000 7f515c10c640 1 -- start start 2024-09-18T12:54:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.447+0000 7f515c10c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51541023f0 0x7f5154101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.447+0000 7f515c10c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5154104d20 0x7f51541003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.447+0000 7f515c10c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f515410a7b0 con 0x7f5154104d20 2024-09-18T12:54:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.447+0000 7f515c10c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f515410a630 con 0x7f51541023f0 2024-09-18T12:54:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f51596a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5154104d20 0x7f51541003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f51596a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5154104d20 0x7f51541003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60816/0 (socket says 172.21.15.45:60816) 2024-09-18T12:54:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f51596a7640 1 -- 172.21.15.45:0/2177058111 learned_addr learned my addr 172.21.15.45:0/2177058111 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:54:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f5159ea8640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51541023f0 0x7f5154101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f51596a7640 1 -- 172.21.15.45:0/2177058111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51541023f0 msgr2=0x7f5154101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f51596a7640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51541023f0 0x7f5154101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f51596a7640 1 -- 172.21.15.45:0/2177058111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51541008e0 con 0x7f5154104d20 2024-09-18T12:54:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f51596a7640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5154104d20 0x7f51541003a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5148009230 tx=0x7f51480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f5152ffd640 1 -- 172.21.15.45:0/2177058111 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f514803f070 con 0x7f5154104d20 2024-09-18T12:54:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f5152ffd640 1 -- 172.21.15.45:0/2177058111 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5148004a50 con 0x7f5154104d20 2024-09-18T12:54:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f515c10c640 1 -- 172.21.15.45:0/2177058111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5154100b70 con 0x7f5154104d20 2024-09-18T12:54:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f5152ffd640 1 -- 172.21.15.45:0/2177058111 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5148035030 con 0x7f5154104d20 2024-09-18T12:54:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.448+0000 7f515c10c640 1 -- 172.21.15.45:0/2177058111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51541010a0 con 0x7f5154104d20 2024-09-18T12:54:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.449+0000 7f515c10c640 1 -- 172.21.15.45:0/2177058111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51541027d0 con 0x7f5154104d20 2024-09-18T12:54:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.450+0000 7f5152ffd640 1 -- 172.21.15.45:0/2177058111 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f5148042070 con 0x7f5154104d20 2024-09-18T12:54:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.451+0000 7f5152ffd640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f513c07b050 0x7f513c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.451+0000 7f5152ffd640 1 -- 172.21.15.45:0/2177058111 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f51480bed80 con 0x7f5154104d20 2024-09-18T12:54:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.451+0000 7f5159ea8640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f513c07b050 0x7f513c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.451+0000 7f5159ea8640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f513c07b050 0x7f513c07d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f514c005fd0 tx=0x7f514c00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.457+0000 7f5152ffd640 1 -- 172.21.15.45:0/2177058111 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f514808a1b0 con 0x7f5154104d20 2024-09-18T12:54:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.657+0000 7f515c10c640 1 -- 172.21.15.45:0/2177058111 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5154105780 con 0x7f513c07b050 2024-09-18T12:54:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.658+0000 7f5152ffd640 1 -- 172.21.15.45:0/2177058111 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f5154105780 con 0x7f513c07b050 2024-09-18T12:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.660+0000 7f515c10c640 1 -- 172.21.15.45:0/2177058111 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f513c07b050 msgr2=0x7f513c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.660+0000 7f515c10c640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f513c07b050 0x7f513c07d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f514c005fd0 tx=0x7f514c00b390 comp rx=0 tx=0).stop 2024-09-18T12:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.660+0000 7f515c10c640 1 -- 172.21.15.45:0/2177058111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5154104d20 msgr2=0x7f51541003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.660+0000 7f515c10c640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5154104d20 0x7f51541003a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5148009230 tx=0x7f51480045e0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.660+0000 7f515c10c640 1 -- 172.21.15.45:0/2177058111 shutdown_connections 2024-09-18T12:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.660+0000 7f515c10c640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f513c07b050 0x7f513c07d510 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.661+0000 7f515c10c640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5154104d20 0x7f51541003a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.661+0000 7f515c10c640 1 --2- 172.21.15.45:0/2177058111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51541023f0 0x7f5154101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.661+0000 7f515c10c640 1 -- 172.21.15.45:0/2177058111 >> 172.21.15.45:0/2177058111 conn(0x7f51540fc010 msgr2=0x7f51540fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.661+0000 7f515c10c640 1 -- 172.21.15.45:0/2177058111 shutdown_connections 2024-09-18T12:54:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.661+0000 7f515c10c640 1 -- 172.21.15.45:0/2177058111 wait complete. 2024-09-18T12:54:09.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.746+0000 7fd1db66a640 1 -- 172.21.15.45:0/4291154977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1d4102450 msgr2=0x7fd1d4104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.746+0000 7fd1db66a640 1 --2- 172.21.15.45:0/4291154977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1d4102450 0x7fd1d4104840 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009880 tx=0x7fd1d002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.746+0000 7fd1db66a640 1 -- 172.21.15.45:0/4291154977 shutdown_connections 2024-09-18T12:54:09.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.746+0000 7fd1db66a640 1 --2- 172.21.15.45:0/4291154977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4104d80 0x7fd1d4107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.746+0000 7fd1db66a640 1 --2- 172.21.15.45:0/4291154977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1d4102450 0x7fd1d4104840 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.746+0000 7fd1db66a640 1 -- 172.21.15.45:0/4291154977 >> 172.21.15.45:0/4291154977 conn(0x7fd1d40fc010 msgr2=0x7fd1d40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.748 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:09 smithi045 ceph-mon[28315]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:09.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.746+0000 7fd1db66a640 1 -- 172.21.15.45:0/4291154977 shutdown_connections 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.746+0000 7fd1db66a640 1 -- 172.21.15.45:0/4291154977 wait complete. 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1db66a640 1 Processor -- start 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1db66a640 1 -- start start 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1db66a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1d4102450 0x7fd1d4197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1db66a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4104d80 0x7fd1d4197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1db66a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d410a750 con 0x7fd1d4102450 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1db66a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d410a5d0 con 0x7fd1d4104d80 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1d9406640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1d4102450 0x7fd1d4197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1d9406640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1d4102450 0x7fd1d4197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60838/0 (socket says 172.21.15.45:60838) 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1d9406640 1 -- 172.21.15.45:0/3641419609 learned_addr learned my addr 172.21.15.45:0/3641419609 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1d8c05640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4104d80 0x7fd1d4197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1d9406640 1 -- 172.21.15.45:0/3641419609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4104d80 msgr2=0x7fd1d4197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1d9406640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4104d80 0x7fd1d4197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.747+0000 7fd1d9406640 1 -- 172.21.15.45:0/3641419609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d4198010 con 0x7fd1d4102450 2024-09-18T12:54:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.748+0000 7fd1d9406640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1d4102450 0x7fd1d4197450 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0006010 tx=0x7fd1d0004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.748+0000 7fd1ca7fc640 1 -- 172.21.15.45:0/3641419609 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1d003f070 con 0x7fd1d4102450 2024-09-18T12:54:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.748+0000 7fd1ca7fc640 1 -- 172.21.15.45:0/3641419609 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1d00049d0 con 0x7fd1d4102450 2024-09-18T12:54:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.748+0000 7fd1db66a640 1 -- 172.21.15.45:0/3641419609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d419ca50 con 0x7fd1d4102450 2024-09-18T12:54:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.748+0000 7fd1ca7fc640 1 -- 172.21.15.45:0/3641419609 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1d0035030 con 0x7fd1d4102450 2024-09-18T12:54:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.748+0000 7fd1db66a640 1 -- 172.21.15.45:0/3641419609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d419cfe0 con 0x7fd1d4102450 2024-09-18T12:54:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.749+0000 7fd1db66a640 1 -- 172.21.15.45:0/3641419609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d4102830 con 0x7fd1d4102450 2024-09-18T12:54:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.750+0000 7fd1ca7fc640 1 -- 172.21.15.45:0/3641419609 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7fd1d0042070 con 0x7fd1d4102450 2024-09-18T12:54:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.750+0000 7fd1ca7fc640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1c007b050 0x7fd1c007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.750+0000 7fd1ca7fc640 1 -- 172.21.15.45:0/3641419609 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fd1d00beda0 con 0x7fd1d4102450 2024-09-18T12:54:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.750+0000 7fd1d8c05640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1c007b050 0x7fd1c007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.751+0000 7fd1d8c05640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1c007b050 0x7fd1c007d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4198900 tx=0x7fd1c4005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:09.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.755+0000 7fd1ca7fc640 1 -- 172.21.15.45:0/3641419609 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fd1d008a1d0 con 0x7fd1d4102450 2024-09-18T12:54:09.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.946+0000 7fd1db66a640 1 -- 172.21.15.45:0/3641419609 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd1d4105640 con 0x7fd1c007b050 2024-09-18T12:54:09.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.955+0000 7fd1ca7fc640 1 -- 172.21.15.45:0/3641419609 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fd1d4105640 con 0x7fd1c007b050 2024-09-18T12:54:09.957 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:54:09.957 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (8m) 18s ago 10m 26.7M - 0.25.0 c8568f914cd2 de7ae4bc8025 2024-09-18T12:54:09.957 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (2m) 18s ago 10m 8623k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:54:09.957 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (107s) 24s ago 9m 8108k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:54:09.957 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (10m) 18s ago 10m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:54:09.957 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (9m) 24s ago 9m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:54:09.957 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (8m) 18s ago 9m 75.9M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:54:09.957 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (4m) 18s ago 4m 167M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:54:09.957 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (4m) 18s ago 4m 194M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (4m) 24s ago 4m 16.1M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (4m) 24s ago 4m 14.5M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (88s) 18s ago 11m 506M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (27s) 24s ago 9m 66.7M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (11m) 18s ago 11m 57.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (9m) 24s ago 9m 46.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 starting - - - - 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (9m) 24s ago 9m 16.1M - 1.5.0 0da6a335fe13 ed4fe4d74f39 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (8m) 18s ago 8m 197M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (7m) 18s ago 7m 215M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (7m) 18s ago 7m 176M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (6m) 24s ago 6m 235M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (6m) 24s ago 6m 211M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:54:09.958 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (5m) 24s ago 5m 191M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:54:09.959 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (34s) 18s ago 9m 42.5M - 2.43.0 a07b618ecd1d f0e9e5995a7b 2024-09-18T12:54:09.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.957+0000 7fd1db66a640 1 -- 172.21.15.45:0/3641419609 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1c007b050 msgr2=0x7fd1c007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.957+0000 7fd1db66a640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1c007b050 0x7fd1c007d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4198900 tx=0x7fd1c4005f90 comp rx=0 tx=0).stop 2024-09-18T12:54:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.957+0000 7fd1db66a640 1 -- 172.21.15.45:0/3641419609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1d4102450 msgr2=0x7fd1d4197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.957+0000 7fd1db66a640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1d4102450 0x7fd1d4197450 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0006010 tx=0x7fd1d0004570 comp rx=0 tx=0).stop 2024-09-18T12:54:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.958+0000 7fd1db66a640 1 -- 172.21.15.45:0/3641419609 shutdown_connections 2024-09-18T12:54:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.958+0000 7fd1db66a640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1c007b050 0x7fd1c007d510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.958+0000 7fd1db66a640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4104d80 0x7fd1d4197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.958+0000 7fd1db66a640 1 --2- 172.21.15.45:0/3641419609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1d4102450 0x7fd1d4197450 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.958+0000 7fd1db66a640 1 -- 172.21.15.45:0/3641419609 >> 172.21.15.45:0/3641419609 conn(0x7fd1d40fc010 msgr2=0x7fd1d40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.958+0000 7fd1db66a640 1 -- 172.21.15.45:0/3641419609 shutdown_connections 2024-09-18T12:54:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:09.958+0000 7fd1db66a640 1 -- 172.21.15.45:0/3641419609 wait complete. 2024-09-18T12:54:10.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:09 smithi161 ceph-mon[35784]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:10.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.041+0000 7fc7a7955640 1 -- 172.21.15.45:0/3056308827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a01023f0 msgr2=0x7fc7a01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.041+0000 7fc7a7955640 1 --2- 172.21.15.45:0/3056308827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a01023f0 0x7fc7a01047e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0098b0 tx=0x7fc79c02a4d0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.041+0000 7fc7a7955640 1 -- 172.21.15.45:0/3056308827 shutdown_connections 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.041+0000 7fc7a7955640 1 --2- 172.21.15.45:0/3056308827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7a0104d20 0x7fc7a0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.041+0000 7fc7a7955640 1 --2- 172.21.15.45:0/3056308827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a01023f0 0x7fc7a01047e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.041+0000 7fc7a7955640 1 -- 172.21.15.45:0/3056308827 >> 172.21.15.45:0/3056308827 conn(0x7fc7a00fc010 msgr2=0x7fc7a00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.041+0000 7fc7a7955640 1 -- 172.21.15.45:0/3056308827 shutdown_connections 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.041+0000 7fc7a7955640 1 -- 172.21.15.45:0/3056308827 wait complete. 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.041+0000 7fc7a7955640 1 Processor -- start 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.041+0000 7fc7a7955640 1 -- start start 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a7955640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a01023f0 0x7fc7a01975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a7955640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7a0104d20 0x7fc7a0197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a7955640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a010a830 con 0x7fc7a01023f0 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a7955640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a010a6b0 con 0x7fc7a0104d20 2024-09-18T12:54:10.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a56f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a01023f0 0x7fc7a01975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a56f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a01023f0 0x7fc7a01975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60854/0 (socket says 172.21.15.45:60854) 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a56f1640 1 -- 172.21.15.45:0/2949961686 learned_addr learned my addr 172.21.15.45:0/2949961686 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a4ef0640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7a0104d20 0x7fc7a0197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a56f1640 1 -- 172.21.15.45:0/2949961686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7a0104d20 msgr2=0x7fc7a0197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a56f1640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7a0104d20 0x7fc7a0197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a56f1640 1 -- 172.21.15.45:0/2949961686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a0198180 con 0x7fc7a01023f0 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a4ef0640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7a0104d20 0x7fc7a0197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7a56f1640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a01023f0 0x7fc7a01975c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0099d0 tx=0x7fc79c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7967fc640 1 -- 172.21.15.45:0/2949961686 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc79c03f070 con 0x7fc7a01023f0 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7967fc640 1 -- 172.21.15.45:0/2949961686 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc79c004c70 con 0x7fc7a01023f0 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.042+0000 7fc7967fc640 1 -- 172.21.15.45:0/2949961686 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc79c035030 con 0x7fc7a01023f0 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.043+0000 7fc7a7955640 1 -- 172.21.15.45:0/2949961686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a019cb60 con 0x7fc7a01023f0 2024-09-18T12:54:10.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.043+0000 7fc7a7955640 1 -- 172.21.15.45:0/2949961686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a019d0f0 con 0x7fc7a01023f0 2024-09-18T12:54:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.044+0000 7fc7a7955640 1 -- 172.21.15.45:0/2949961686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a01027d0 con 0x7fc7a01023f0 2024-09-18T12:54:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.044+0000 7fc7967fc640 1 -- 172.21.15.45:0/2949961686 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7fc79c042070 con 0x7fc7a01023f0 2024-09-18T12:54:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.045+0000 7fc7967fc640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc78c07b0b0 0x7fc78c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.045+0000 7fc7967fc640 1 -- 172.21.15.45:0/2949961686 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fc79c0bee50 con 0x7fc7a01023f0 2024-09-18T12:54:10.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.045+0000 7fc7a4ef0640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc78c07b0b0 0x7fc78c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.045+0000 7fc7a4ef0640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc78c07b0b0 0x7fc78c07d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc790006fd0 tx=0x7fc790008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:10.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.049+0000 7fc7967fc640 1 -- 172.21.15.45:0/2949961686 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fc79c08a300 con 0x7fc7a01023f0 2024-09-18T12:54:10.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.309+0000 7fc7a7955640 1 -- 172.21.15.45:0/2949961686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc7a019d510 con 0x7fc7a01023f0 2024-09-18T12:54:10.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.310+0000 7fc7967fc640 1 -- 172.21.15.45:0/2949961686 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fc79c08f1b0 con 0x7fc7a01023f0 2024-09-18T12:54:10.311 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:54:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:54:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:54:10.313 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:54:10.313 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:10.313 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:54:10.313 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:54:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 -- 172.21.15.45:0/2949961686 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc78c07b0b0 msgr2=0x7fc78c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc78c07b0b0 0x7fc78c07d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc790006fd0 tx=0x7fc790008040 comp rx=0 tx=0).stop 2024-09-18T12:54:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 -- 172.21.15.45:0/2949961686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a01023f0 msgr2=0x7fc7a01975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a01023f0 0x7fc7a01975c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0099d0 tx=0x7fc79c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 -- 172.21.15.45:0/2949961686 shutdown_connections 2024-09-18T12:54:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc78c07b0b0 0x7fc78c07d570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7a0104d20 0x7fc7a0197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 --2- 172.21.15.45:0/2949961686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a01023f0 0x7fc7a01975c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 -- 172.21.15.45:0/2949961686 >> 172.21.15.45:0/2949961686 conn(0x7fc7a00fc010 msgr2=0x7fc7a00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 -- 172.21.15.45:0/2949961686 shutdown_connections 2024-09-18T12:54:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.312+0000 7fc7a7955640 1 -- 172.21.15.45:0/2949961686 wait complete. 2024-09-18T12:54:10.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.397+0000 7f7a0f272640 1 -- 172.21.15.45:0/3715623565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a08101960 msgr2=0x7f7a08101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.397+0000 7f7a0f272640 1 --2- 172.21.15.45:0/3715623565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a08101960 0x7f7a08101d60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009880 tx=0x7f7a0402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.397+0000 7f7a0f272640 1 -- 172.21.15.45:0/3715623565 shutdown_connections 2024-09-18T12:54:10.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.397+0000 7f7a0f272640 1 --2- 172.21.15.45:0/3715623565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a08102b60 0x7f7a08102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.397+0000 7f7a0f272640 1 --2- 172.21.15.45:0/3715623565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a08101960 0x7f7a08101d60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.397+0000 7f7a0f272640 1 -- 172.21.15.45:0/3715623565 >> 172.21.15.45:0/3715623565 conn(0x7f7a080fd0f0 msgr2=0x7f7a080ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:10.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.397+0000 7f7a0f272640 1 -- 172.21.15.45:0/3715623565 shutdown_connections 2024-09-18T12:54:10.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.397+0000 7f7a0f272640 1 -- 172.21.15.45:0/3715623565 wait complete. 2024-09-18T12:54:10.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.397+0000 7f7a0f272640 1 Processor -- start 2024-09-18T12:54:10.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0f272640 1 -- start start 2024-09-18T12:54:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0f272640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a08101960 0x7f7a08075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0f272640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a08102b60 0x7f7a080745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0f272640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0810a7a0 con 0x7f7a08101960 2024-09-18T12:54:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0f272640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0810a620 con 0x7f7a08102b60 2024-09-18T12:54:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0d00e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a08101960 0x7f7a08075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0d00e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a08101960 0x7f7a08075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60864/0 (socket says 172.21.15.45:60864) 2024-09-18T12:54:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0d00e640 1 -- 172.21.15.45:0/4219508376 learned_addr learned my addr 172.21.15.45:0/4219508376 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:54:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0c80d640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a08102b60 0x7f7a080745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0d00e640 1 -- 172.21.15.45:0/4219508376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a08102b60 msgr2=0x7f7a080745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0d00e640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a08102b60 0x7f7a080745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0d00e640 1 -- 172.21.15.45:0/4219508376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a08074b20 con 0x7f7a08101960 2024-09-18T12:54:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.398+0000 7f7a0d00e640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a08101960 0x7f7a08075f20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009230 tx=0x7f7a040045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.399+0000 7f79fe7fc640 1 -- 172.21.15.45:0/4219508376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a0403f070 con 0x7f7a08101960 2024-09-18T12:54:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.399+0000 7f79fe7fc640 1 -- 172.21.15.45:0/4219508376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a04004a50 con 0x7f7a08101960 2024-09-18T12:54:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.399+0000 7f7a0f272640 1 -- 172.21.15.45:0/4219508376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a08074db0 con 0x7f7a08101960 2024-09-18T12:54:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.399+0000 7f79fe7fc640 1 -- 172.21.15.45:0/4219508376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a04035030 con 0x7f7a08101960 2024-09-18T12:54:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.399+0000 7f7a0f272640 1 -- 172.21.15.45:0/4219508376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a080752e0 con 0x7f7a08101960 2024-09-18T12:54:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.400+0000 7f7a0f272640 1 -- 172.21.15.45:0/4219508376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a08101d60 con 0x7f7a08101960 2024-09-18T12:54:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.400+0000 7f79fe7fc640 1 -- 172.21.15.45:0/4219508376 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f7a04042070 con 0x7f7a08101960 2024-09-18T12:54:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.401+0000 7f79fe7fc640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79f407b050 0x7f79f407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.401+0000 7f79fe7fc640 1 -- 172.21.15.45:0/4219508376 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f7a040bee60 con 0x7f7a08101960 2024-09-18T12:54:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.401+0000 7f7a0c80d640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79f407b050 0x7f79f407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.401+0000 7f7a0c80d640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79f407b050 0x7f79f407d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7a08075ca0 tx=0x7f79f800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:10.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.405+0000 7f79fe7fc640 1 -- 172.21.15.45:0/4219508376 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f7a0408a290 con 0x7f7a08101960 2024-09-18T12:54:10.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.612+0000 7f7a0f272640 1 -- 172.21.15.45:0/4219508376 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7a08062630 con 0x7f79f407b050 2024-09-18T12:54:10.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.614+0000 7f79fe7fc640 1 -- 172.21.15.45:0/4219508376 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f7a08062630 con 0x7f79f407b050 2024-09-18T12:54:10.615 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:54:10.615 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:54:10.615 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:54:10.616 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:54:10.616 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:54:10.616 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr" 2024-09-18T12:54:10.616 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:54:10.616 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "2/2 daemons upgraded", 2024-09-18T12:54:10.616 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-18T12:54:10.616 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:54:10.616 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.616+0000 7f7a0f272640 1 -- 172.21.15.45:0/4219508376 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79f407b050 msgr2=0x7f79f407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.616+0000 7f7a0f272640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79f407b050 0x7f79f407d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7a08075ca0 tx=0x7f79f800b390 comp rx=0 tx=0).stop 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.616+0000 7f7a0f272640 1 -- 172.21.15.45:0/4219508376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a08101960 msgr2=0x7f7a08075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.616+0000 7f7a0f272640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a08101960 0x7f7a08075f20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009230 tx=0x7f7a040045c0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.616+0000 7f7a0f272640 1 -- 172.21.15.45:0/4219508376 shutdown_connections 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.616+0000 7f7a0f272640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79f407b050 0x7f79f407d510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.616+0000 7f7a0f272640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a08102b60 0x7f7a080745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.616+0000 7f7a0f272640 1 --2- 172.21.15.45:0/4219508376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a08101960 0x7f7a08075f20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.616+0000 7f7a0f272640 1 -- 172.21.15.45:0/4219508376 >> 172.21.15.45:0/4219508376 conn(0x7f7a080fd0f0 msgr2=0x7f7a08106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.616+0000 7f7a0f272640 1 -- 172.21.15.45:0/4219508376 shutdown_connections 2024-09-18T12:54:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:10.617+0000 7f7a0f272640 1 -- 172.21.15.45:0/4219508376 wait complete. 2024-09-18T12:54:11.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:10 smithi045 ceph-mon[28315]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:11.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:10 smithi045 ceph-mon[28315]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:11.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:10 smithi045 ceph-mon[28315]: pgmap v42: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 747 KiB/s rd, 719 KiB/s wr, 133 op/s 2024-09-18T12:54:11.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:10 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2949961686' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:11.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:10 smithi161 ceph-mon[35784]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:11.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:10 smithi161 ceph-mon[35784]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:11.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:10 smithi161 ceph-mon[35784]: pgmap v42: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 747 KiB/s rd, 719 KiB/s wr, 133 op/s 2024-09-18T12:54:11.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:10 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2949961686' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:12.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:11 smithi045 ceph-mon[28315]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:12.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:11 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:12.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:11 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:12.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:11 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:54:12.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:11 smithi161 ceph-mon[35784]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:12.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:11 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:12.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:11 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:12.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:11 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:54:12.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:12 smithi045 ceph-mon[28315]: pgmap v43: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 330 KiB/s rd, 308 KiB/s wr, 66 op/s 2024-09-18T12:54:13.028 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:12 smithi161 ceph-mon[35784]: pgmap v43: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 330 KiB/s rd, 308 KiB/s wr, 66 op/s 2024-09-18T12:54:15.226 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:15 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:15.226 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:15 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:15.226 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:15 smithi161 ceph-mon[35784]: pgmap v44: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 330 KiB/s rd, 308 KiB/s wr, 68 op/s 2024-09-18T12:54:15.226 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:15 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:15.227 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:15 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:15.383 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:15 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:15.383 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:15 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:15.383 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:15 smithi045 ceph-mon[28315]: pgmap v44: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 330 KiB/s rd, 308 KiB/s wr, 68 op/s 2024-09-18T12:54:15.384 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:15 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:15.384 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:15 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:17.466 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:17 smithi161 ceph-mon[35784]: pgmap v45: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-09-18T12:54:17.467 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:17 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:17.467 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:17 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:17 smithi045 ceph-mon[28315]: pgmap v45: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-09-18T12:54:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:17 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:17 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:18.766 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:18 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:18.766 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:18 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:18.766 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:18 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:18.766 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:18 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:18.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:18 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:18.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:18 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:18.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:18 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:18.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:18 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:19.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:19 smithi045 ceph-mon[28315]: pgmap v46: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-09-18T12:54:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:19 smithi161 ceph-mon[35784]: pgmap v46: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-09-18T12:54:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: pgmap v47: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-09-18T12:54:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:21 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: pgmap v47: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-09-18T12:54:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:21.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:23 smithi045 ceph-mon[28315]: Upgrade: Updating prometheus.smithi045 2024-09-18T12:54:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:23 smithi045 ceph-mon[28315]: pgmap v48: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-18T12:54:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:23 smithi045 ceph-mon[28315]: Deploying daemon prometheus.smithi045 on smithi045 2024-09-18T12:54:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:23 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:54:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:23 smithi161 ceph-mon[35784]: Upgrade: Updating prometheus.smithi045 2024-09-18T12:54:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:23 smithi161 ceph-mon[35784]: pgmap v48: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-18T12:54:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:23 smithi161 ceph-mon[35784]: Deploying daemon prometheus.smithi045 on smithi045 2024-09-18T12:54:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:23 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:54:24.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:24 smithi045 ceph-mon[28315]: mgrmap e32: smithi045.brvbvl(active, since 91s), standbys: smithi161.yoflkm 2024-09-18T12:54:24.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:24 smithi161 ceph-mon[35784]: mgrmap e32: smithi045.brvbvl(active, since 91s), standbys: smithi161.yoflkm 2024-09-18T12:54:25.685 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:25 smithi045 ceph-mon[28315]: pgmap v49: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-18T12:54:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:25 smithi161 ceph-mon[35784]: pgmap v49: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-18T12:54:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:27 smithi045 ceph-mon[28315]: pgmap v50: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-18T12:54:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:27 smithi161 ceph-mon[35784]: pgmap v50: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-18T12:54:29.667 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:29 smithi045 ceph-mon[28315]: pgmap v51: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-18T12:54:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:29 smithi161 ceph-mon[35784]: pgmap v51: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-18T12:54:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:31 smithi045 ceph-mon[28315]: pgmap v52: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-18T12:54:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:31 smithi161 ceph-mon[35784]: pgmap v52: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-18T12:54:33.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:33 smithi045 ceph-mon[28315]: pgmap v53: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-18T12:54:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:33 smithi161 ceph-mon[35784]: pgmap v53: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-18T12:54:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:35 smithi045 ceph-mon[28315]: pgmap v54: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-18T12:54:35.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:35 smithi161 ceph-mon[35784]: pgmap v54: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-18T12:54:37.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:37 smithi045 ceph-mon[28315]: pgmap v55: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-18T12:54:37.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:37 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:37.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:37 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:37.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:37 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:54:37.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:37 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:37.714 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:37 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:37 smithi161 ceph-mon[35784]: pgmap v55: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-18T12:54:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:37 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:37 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:37 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:54:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:37 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:37 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:38.760 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:38 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:54:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:38 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:54:39.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:39 smithi045 ceph-mon[28315]: pgmap v56: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-18T12:54:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:39 smithi161 ceph-mon[35784]: pgmap v56: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-18T12:54:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.705+0000 7fd2e25cc640 1 -- 172.21.15.45:0/1153651913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2dc1001e0 msgr2=0x7fd2dc1005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.705+0000 7fd2e25cc640 1 --2- 172.21.15.45:0/1153651913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2dc1001e0 0x7fd2dc1005e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009c20 tx=0x7fd2d402a970 comp rx=0 tx=0).stop 2024-09-18T12:54:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.706+0000 7fd2e25cc640 1 -- 172.21.15.45:0/1153651913 shutdown_connections 2024-09-18T12:54:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.706+0000 7fd2e25cc640 1 --2- 172.21.15.45:0/1153651913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2dc100b20 0x7fd2dc100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.706+0000 7fd2e25cc640 1 --2- 172.21.15.45:0/1153651913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2dc1001e0 0x7fd2dc1005e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.706+0000 7fd2e25cc640 1 -- 172.21.15.45:0/1153651913 >> 172.21.15.45:0/1153651913 conn(0x7fd2dc0fc010 msgr2=0x7fd2dc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.706+0000 7fd2e25cc640 1 -- 172.21.15.45:0/1153651913 shutdown_connections 2024-09-18T12:54:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.706+0000 7fd2e25cc640 1 -- 172.21.15.45:0/1153651913 wait complete. 2024-09-18T12:54:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.706+0000 7fd2e25cc640 1 Processor -- start 2024-09-18T12:54:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2e25cc640 1 -- start start 2024-09-18T12:54:40.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2e25cc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2dc1001e0 0x7fd2dc199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:40.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2e25cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2dc100b20 0x7fd2dc199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:40.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2e25cc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc10c970 con 0x7fd2dc100b20 2024-09-18T12:54:40.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2e25cc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc10c7f0 con 0x7fd2dc1001e0 2024-09-18T12:54:40.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2dc100b20 0x7fd2dc199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:40.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2dc100b20 0x7fd2dc199ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57470/0 (socket says 172.21.15.45:57470) 2024-09-18T12:54:40.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2db7fe640 1 -- 172.21.15.45:0/2339042657 learned_addr learned my addr 172.21.15.45:0/2339042657 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:54:40.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2dbfff640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2dc1001e0 0x7fd2dc199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:40.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2db7fe640 1 -- 172.21.15.45:0/2339042657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2dc1001e0 msgr2=0x7fd2dc199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:40.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2db7fe640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2dc1001e0 0x7fd2dc199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:40.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2db7fe640 1 -- 172.21.15.45:0/2339042657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2dc19a220 con 0x7fd2dc100b20 2024-09-18T12:54:40.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.707+0000 7fd2dbfff640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2dc1001e0 0x7fd2dc199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:54:40.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.708+0000 7fd2db7fe640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2dc100b20 0x7fd2dc199ba0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000d8d0 tx=0x7fd2d000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:40.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.708+0000 7fd2d97fa640 1 -- 172.21.15.45:0/2339042657 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2d0017070 con 0x7fd2dc100b20 2024-09-18T12:54:40.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.708+0000 7fd2d97fa640 1 -- 172.21.15.45:0/2339042657 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2d0010460 con 0x7fd2dc100b20 2024-09-18T12:54:40.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.708+0000 7fd2d97fa640 1 -- 172.21.15.45:0/2339042657 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2d000f5f0 con 0x7fd2dc100b20 2024-09-18T12:54:40.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.708+0000 7fd2e25cc640 1 -- 172.21.15.45:0/2339042657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2dc19ec60 con 0x7fd2dc100b20 2024-09-18T12:54:40.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.708+0000 7fd2e25cc640 1 -- 172.21.15.45:0/2339042657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2dc19f220 con 0x7fd2dc100b20 2024-09-18T12:54:40.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.709+0000 7fd2e25cc640 1 -- 172.21.15.45:0/2339042657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2dc1005e0 con 0x7fd2dc100b20 2024-09-18T12:54:40.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.710+0000 7fd2d97fa640 1 -- 172.21.15.45:0/2339042657 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fd2d0009a30 con 0x7fd2dc100b20 2024-09-18T12:54:40.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.711+0000 7fd2d97fa640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd2c407af80 0x7fd2c407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:40.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.711+0000 7fd2d97fa640 1 -- 172.21.15.45:0/2339042657 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fd2d009ddf0 con 0x7fd2dc100b20 2024-09-18T12:54:40.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.711+0000 7fd2dbfff640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd2c407af80 0x7fd2c407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:40.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.711+0000 7fd2dbfff640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd2c407af80 0x7fd2c407d440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd2d402fa30 tx=0x7fd2d4005ef0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:40.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.719+0000 7fd2d97fa640 1 -- 172.21.15.45:0/2339042657 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fd2d00694c0 con 0x7fd2dc100b20 2024-09-18T12:54:40.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.926+0000 7fd2e25cc640 1 -- 172.21.15.45:0/2339042657 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd2dc0626f0 con 0x7fd2c407af80 2024-09-18T12:54:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.928+0000 7fd2d97fa640 1 -- 172.21.15.45:0/2339042657 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7fd2dc0626f0 con 0x7fd2c407af80 2024-09-18T12:54:40.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 -- 172.21.15.45:0/2339042657 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd2c407af80 msgr2=0x7fd2c407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:40.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd2c407af80 0x7fd2c407d440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd2d402fa30 tx=0x7fd2d4005ef0 comp rx=0 tx=0).stop 2024-09-18T12:54:40.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 -- 172.21.15.45:0/2339042657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2dc100b20 msgr2=0x7fd2dc199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:40.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2dc100b20 0x7fd2dc199ba0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000d8d0 tx=0x7fd2d000dd90 comp rx=0 tx=0).stop 2024-09-18T12:54:40.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 -- 172.21.15.45:0/2339042657 shutdown_connections 2024-09-18T12:54:40.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd2c407af80 0x7fd2c407d440 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:40.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2dc100b20 0x7fd2dc199ba0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:40.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 --2- 172.21.15.45:0/2339042657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2dc1001e0 0x7fd2dc199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:40.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 -- 172.21.15.45:0/2339042657 >> 172.21.15.45:0/2339042657 conn(0x7fd2dc0fc010 msgr2=0x7fd2dc108a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:40.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 -- 172.21.15.45:0/2339042657 shutdown_connections 2024-09-18T12:54:40.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:40.930+0000 7fd2e25cc640 1 -- 172.21.15.45:0/2339042657 wait complete. 2024-09-18T12:54:40.940 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:54:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.016+0000 7fbe29dd7640 1 -- 172.21.15.45:0/1009724929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe24101a60 msgr2=0x7fbe24101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.016+0000 7fbe29dd7640 1 --2- 172.21.15.45:0/1009724929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe24101a60 0x7fbe24101ee0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009880 tx=0x7fbe0c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.016+0000 7fbe29dd7640 1 -- 172.21.15.45:0/1009724929 shutdown_connections 2024-09-18T12:54:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.016+0000 7fbe29dd7640 1 --2- 172.21.15.45:0/1009724929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe24101a60 0x7fbe24101ee0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.016+0000 7fbe29dd7640 1 --2- 172.21.15.45:0/1009724929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe24100860 0x7fbe24100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.016+0000 7fbe29dd7640 1 -- 172.21.15.45:0/1009724929 >> 172.21.15.45:0/1009724929 conn(0x7fbe240fc010 msgr2=0x7fbe240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.016+0000 7fbe29dd7640 1 -- 172.21.15.45:0/1009724929 shutdown_connections 2024-09-18T12:54:41.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.016+0000 7fbe29dd7640 1 -- 172.21.15.45:0/1009724929 wait complete. 2024-09-18T12:54:41.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.017+0000 7fbe29dd7640 1 Processor -- start 2024-09-18T12:54:41.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.017+0000 7fbe29dd7640 1 -- start start 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.017+0000 7fbe29dd7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe24100860 0x7fbe241963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.017+0000 7fbe29dd7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe24101a60 0x7fbe24196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.017+0000 7fbe29dd7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbe241096a0 con 0x7fbe24101a60 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.017+0000 7fbe29dd7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24109520 con 0x7fbe24100860 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe22ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe24101a60 0x7fbe24196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe22ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe24101a60 0x7fbe24196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57494/0 (socket says 172.21.15.45:57494) 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe22ffd640 1 -- 172.21.15.45:0/34713632 learned_addr learned my addr 172.21.15.45:0/34713632 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe237fe640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe24100860 0x7fbe241963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe22ffd640 1 -- 172.21.15.45:0/34713632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe24100860 msgr2=0x7fbe241963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe22ffd640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe24100860 0x7fbe241963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe22ffd640 1 -- 172.21.15.45:0/34713632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe24196fa0 con 0x7fbe24101a60 2024-09-18T12:54:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe22ffd640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe24101a60 0x7fbe24196920 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c006010 tx=0x7fbe0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:41.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe20ff9640 1 -- 172.21.15.45:0/34713632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe0c035070 con 0x7fbe24101a60 2024-09-18T12:54:41.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe29dd7640 1 -- 172.21.15.45:0/34713632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe24069ca0 con 0x7fbe24101a60 2024-09-18T12:54:41.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe20ff9640 1 -- 172.21.15.45:0/34713632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe0c004a40 con 0x7fbe24101a60 2024-09-18T12:54:41.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe20ff9640 1 -- 172.21.15.45:0/34713632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe0c031970 con 0x7fbe24101a60 2024-09-18T12:54:41.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.018+0000 7fbe29dd7640 1 -- 172.21.15.45:0/34713632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2406a230 con 0x7fbe24101a60 2024-09-18T12:54:41.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.019+0000 7fbe29dd7640 1 -- 172.21.15.45:0/34713632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe24100c60 con 0x7fbe24101a60 2024-09-18T12:54:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.020+0000 7fbe20ff9640 1 -- 172.21.15.45:0/34713632 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fbe0c003cd0 con 0x7fbe24101a60 2024-09-18T12:54:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.021+0000 7fbe20ff9640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbe1007af80 0x7fbe1007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.021+0000 7fbe20ff9640 1 -- 172.21.15.45:0/34713632 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fbe0c03e070 con 0x7fbe24101a60 2024-09-18T12:54:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.021+0000 7fbe237fe640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbe1007af80 0x7fbe1007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.021+0000 7fbe237fe640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbe1007af80 0x7fbe1007d440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbe14005fd0 tx=0x7fbe1400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.025+0000 7fbe20ff9640 1 -- 172.21.15.45:0/34713632 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fbe0c004bf0 con 0x7fbe24101a60 2024-09-18T12:54:41.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.245+0000 7fbe29dd7640 1 -- 172.21.15.45:0/34713632 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbe2406a5a0 con 0x7fbe1007af80 2024-09-18T12:54:41.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.246+0000 7fbe20ff9640 1 -- 172.21.15.45:0/34713632 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7fbe2406a5a0 con 0x7fbe1007af80 2024-09-18T12:54:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.248+0000 7fbe29dd7640 1 -- 172.21.15.45:0/34713632 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbe1007af80 msgr2=0x7fbe1007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.248+0000 7fbe29dd7640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbe1007af80 0x7fbe1007d440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbe14005fd0 tx=0x7fbe1400b390 comp rx=0 tx=0).stop 2024-09-18T12:54:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.248+0000 7fbe29dd7640 1 -- 172.21.15.45:0/34713632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe24101a60 msgr2=0x7fbe24196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.248+0000 7fbe29dd7640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe24101a60 0x7fbe24196920 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c006010 tx=0x7fbe0c0046c0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.249+0000 7fbe29dd7640 1 -- 172.21.15.45:0/34713632 shutdown_connections 2024-09-18T12:54:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.249+0000 7fbe29dd7640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbe1007af80 0x7fbe1007d440 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.249+0000 7fbe29dd7640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe24101a60 0x7fbe24196920 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.249+0000 7fbe29dd7640 1 --2- 172.21.15.45:0/34713632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe24100860 0x7fbe241963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.249+0000 7fbe29dd7640 1 -- 172.21.15.45:0/34713632 >> 172.21.15.45:0/34713632 conn(0x7fbe240fc010 msgr2=0x7fbe24104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.249+0000 7fbe29dd7640 1 -- 172.21.15.45:0/34713632 shutdown_connections 2024-09-18T12:54:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.249+0000 7fbe29dd7640 1 -- 172.21.15.45:0/34713632 wait complete. 2024-09-18T12:54:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.349+0000 7fd1a046f640 1 -- 172.21.15.45:0/1977838645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd198100860 msgr2=0x7fd198100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.349+0000 7fd1a046f640 1 --2- 172.21.15.45:0/1977838645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd198100860 0x7fd198100c60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd194009880 tx=0x7fd19402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 -- 172.21.15.45:0/1977838645 shutdown_connections 2024-09-18T12:54:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 --2- 172.21.15.45:0/1977838645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd198101a60 0x7fd198101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 --2- 172.21.15.45:0/1977838645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd198100860 0x7fd198100c60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 -- 172.21.15.45:0/1977838645 >> 172.21.15.45:0/1977838645 conn(0x7fd1980fc010 msgr2=0x7fd1980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 -- 172.21.15.45:0/1977838645 shutdown_connections 2024-09-18T12:54:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 -- 172.21.15.45:0/1977838645 wait complete. 2024-09-18T12:54:41.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 Processor -- start 2024-09-18T12:54:41.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 -- start start 2024-09-18T12:54:41.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd198100860 0x7fd1981974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd198101a60 0x7fd198197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd198109680 con 0x7fd198100860 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.350+0000 7fd1a046f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd198109500 con 0x7fd198101a60 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.351+0000 7fd19e20b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd198100860 0x7fd1981974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.351+0000 7fd19e20b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd198100860 0x7fd1981974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57512/0 (socket says 172.21.15.45:57512) 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.351+0000 7fd19e20b640 1 -- 172.21.15.45:0/4033282681 learned_addr learned my addr 172.21.15.45:0/4033282681 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.351+0000 7fd19da0a640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd198101a60 0x7fd198197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.351+0000 7fd19e20b640 1 -- 172.21.15.45:0/4033282681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd198101a60 msgr2=0x7fd198197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.351+0000 7fd19e20b640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd198101a60 0x7fd198197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.351+0000 7fd19e20b640 1 -- 172.21.15.45:0/4033282681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1981980b0 con 0x7fd198100860 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.351+0000 7fd19e20b640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd198100860 0x7fd1981974f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd194009230 tx=0x7fd1940045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.351+0000 7fd18f7fe640 1 -- 172.21.15.45:0/4033282681 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd19403f070 con 0x7fd198100860 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.352+0000 7fd18f7fe640 1 -- 172.21.15.45:0/4033282681 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd194004a50 con 0x7fd198100860 2024-09-18T12:54:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.352+0000 7fd18f7fe640 1 -- 172.21.15.45:0/4033282681 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd194035030 con 0x7fd198100860 2024-09-18T12:54:41.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.352+0000 7fd1a046f640 1 -- 172.21.15.45:0/4033282681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd19819ca90 con 0x7fd198100860 2024-09-18T12:54:41.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.352+0000 7fd1a046f640 1 -- 172.21.15.45:0/4033282681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd19819d020 con 0x7fd198100860 2024-09-18T12:54:41.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.353+0000 7fd1a046f640 1 -- 172.21.15.45:0/4033282681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd198100c60 con 0x7fd198100860 2024-09-18T12:54:41.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.353+0000 7fd18f7fe640 1 -- 172.21.15.45:0/4033282681 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fd194042070 con 0x7fd198100860 2024-09-18T12:54:41.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.354+0000 7fd18f7fe640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd18407af40 0x7fd18407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.354+0000 7fd18f7fe640 1 -- 172.21.15.45:0/4033282681 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fd1940bebe0 con 0x7fd198100860 2024-09-18T12:54:41.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.354+0000 7fd19da0a640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd18407af40 0x7fd18407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.355+0000 7fd19da0a640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd18407af40 0x7fd18407d400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd1981989a0 tx=0x7fd18800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:41.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.360+0000 7fd18f7fe640 1 -- 172.21.15.45:0/4033282681 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fd19408a230 con 0x7fd198100860 2024-09-18T12:54:41.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.563+0000 7fd1a046f640 1 -- 172.21.15.45:0/4033282681 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd19806a400 con 0x7fd18407af40 2024-09-18T12:54:41.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.582+0000 7fd18f7fe640 1 -- 172.21.15.45:0/4033282681 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd19806a400 con 0x7fd18407af40 2024-09-18T12:54:41.583 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (9m) 0s ago 10m 26.8M - 0.25.0 c8568f914cd2 de7ae4bc8025 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (2m) 0s ago 10m 8690k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (2m) 27s ago 10m 8144k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (10m) 0s ago 10m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (9m) 27s ago 9m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (9m) 0s ago 10m 77.6M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (5m) 0s ago 5m 91.6M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (5m) 0s ago 5m 150M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (5m) 27s ago 5m 16.3M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (5m) 27s ago 5m 14.7M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (2m) 0s ago 12m 513M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:54:41.584 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (59s) 27s ago 9m 454M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (12m) 0s ago 12m 58.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (9m) 27s ago 9m 48.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (36s) 0s ago 10m 9705k - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (30s) 27s ago 9m 3338k - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (8m) 0s ago 8m 205M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (7m) 0s ago 8m 223M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (7m) 0s ago 7m 185M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (7m) 27s ago 7m 239M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (6m) 27s ago 6m 213M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (6m) 27s ago 6m 197M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:54:41.585 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (7s) 0s ago 10m 41.5M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:54:41.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.584+0000 7fd1a046f640 1 -- 172.21.15.45:0/4033282681 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd18407af40 msgr2=0x7fd18407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.584+0000 7fd1a046f640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd18407af40 0x7fd18407d400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd1981989a0 tx=0x7fd18800b390 comp rx=0 tx=0).stop 2024-09-18T12:54:41.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.584+0000 7fd1a046f640 1 -- 172.21.15.45:0/4033282681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd198100860 msgr2=0x7fd1981974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.584+0000 7fd1a046f640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd198100860 0x7fd1981974f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd194009230 tx=0x7fd1940045c0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.585+0000 7fd1a046f640 1 -- 172.21.15.45:0/4033282681 shutdown_connections 2024-09-18T12:54:41.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.585+0000 7fd1a046f640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd18407af40 0x7fd18407d400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.585+0000 7fd1a046f640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd198101a60 0x7fd198197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.585+0000 7fd1a046f640 1 --2- 172.21.15.45:0/4033282681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd198100860 0x7fd1981974f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.585+0000 7fd1a046f640 1 -- 172.21.15.45:0/4033282681 >> 172.21.15.45:0/4033282681 conn(0x7fd1980fc010 msgr2=0x7fd198069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.585+0000 7fd1a046f640 1 -- 172.21.15.45:0/4033282681 shutdown_connections 2024-09-18T12:54:41.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.585+0000 7fd1a046f640 1 -- 172.21.15.45:0/4033282681 wait complete. 2024-09-18T12:54:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.672+0000 7efee7271640 1 -- 172.21.15.45:0/1803035247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee01023f0 msgr2=0x7efee01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.672+0000 7efee7271640 1 --2- 172.21.15.45:0/1803035247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee01023f0 0x7efee01047e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efedc0098b0 tx=0x7efedc02a4d0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.672+0000 7efee7271640 1 -- 172.21.15.45:0/1803035247 shutdown_connections 2024-09-18T12:54:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.672+0000 7efee7271640 1 --2- 172.21.15.45:0/1803035247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee0104d20 0x7efee0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.672+0000 7efee7271640 1 --2- 172.21.15.45:0/1803035247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee01023f0 0x7efee01047e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.672+0000 7efee7271640 1 -- 172.21.15.45:0/1803035247 >> 172.21.15.45:0/1803035247 conn(0x7efee00fc010 msgr2=0x7efee00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.674 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:41 smithi045 ceph-mon[28315]: pgmap v57: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-18T12:54:41.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.672+0000 7efee7271640 1 -- 172.21.15.45:0/1803035247 shutdown_connections 2024-09-18T12:54:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.672+0000 7efee7271640 1 -- 172.21.15.45:0/1803035247 wait complete. 2024-09-18T12:54:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee7271640 1 Processor -- start 2024-09-18T12:54:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee7271640 1 -- start start 2024-09-18T12:54:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee7271640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee01023f0 0x7efee0101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee7271640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee0104d20 0x7efee01003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee7271640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efee010a7c0 con 0x7efee0104d20 2024-09-18T12:54:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee7271640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7efee010a640 con 0x7efee01023f0 2024-09-18T12:54:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee480c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee0104d20 0x7efee01003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee480c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee0104d20 0x7efee01003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57524/0 (socket says 172.21.15.45:57524) 2024-09-18T12:54:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee480c640 1 -- 172.21.15.45:0/1375503144 learned_addr learned my addr 172.21.15.45:0/1375503144 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:54:41.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee500d640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee01023f0 0x7efee0101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee480c640 1 -- 172.21.15.45:0/1375503144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee01023f0 msgr2=0x7efee0101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee480c640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee01023f0 0x7efee0101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.673+0000 7efee480c640 1 -- 172.21.15.45:0/1375503144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee01008e0 con 0x7efee0104d20 2024-09-18T12:54:41.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.674+0000 7efee480c640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee0104d20 0x7efee01003a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efed000d6f0 tx=0x7efed000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:41.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.674+0000 7efed67fc640 1 -- 172.21.15.45:0/1375503144 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efed0017070 con 0x7efee0104d20 2024-09-18T12:54:41.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.674+0000 7efee7271640 1 -- 172.21.15.45:0/1375503144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee0100bd0 con 0x7efee0104d20 2024-09-18T12:54:41.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.674+0000 7efed67fc640 1 -- 172.21.15.45:0/1375503144 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efed000de00 con 0x7efee0104d20 2024-09-18T12:54:41.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.674+0000 7efee7271640 1 -- 172.21.15.45:0/1375503144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee0101160 con 0x7efee0104d20 2024-09-18T12:54:41.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.674+0000 7efed67fc640 1 -- 172.21.15.45:0/1375503144 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efed0010dd0 con 0x7efee0104d20 2024-09-18T12:54:41.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.675+0000 7efee7271640 1 -- 172.21.15.45:0/1375503144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee01027d0 con 0x7efee0104d20 2024-09-18T12:54:41.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.676+0000 7efed67fc640 1 -- 172.21.15.45:0/1375503144 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7efed001a070 con 0x7efee0104d20 2024-09-18T12:54:41.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.677+0000 7efed67fc640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efecc07af30 0x7efecc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:41.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.677+0000 7efed67fc640 1 -- 172.21.15.45:0/1375503144 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7efed009dd70 con 0x7efee0104d20 2024-09-18T12:54:41.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.677+0000 7efee500d640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efecc07af30 0x7efecc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:41.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.677+0000 7efee500d640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efecc07af30 0x7efecc07d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efedc006010 tx=0x7efedc0058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:41.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.681+0000 7efed67fc640 1 -- 172.21.15.45:0/1375503144 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7efed0021020 con 0x7efee0104d20 2024-09-18T12:54:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:41 smithi161 ceph-mon[35784]: pgmap v57: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-18T12:54:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.960+0000 7efee7271640 1 -- 172.21.15.45:0/1375503144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efee019fba0 con 0x7efee0104d20 2024-09-18T12:54:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.961+0000 7efed67fc640 1 -- 172.21.15.45:0/1375503144 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7efed0069320 con 0x7efee0104d20 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:54:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:54:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:54:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:54:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:54:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:54:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 -- 172.21.15.45:0/1375503144 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efecc07af30 msgr2=0x7efecc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efecc07af30 0x7efecc07d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efedc006010 tx=0x7efedc0058d0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 -- 172.21.15.45:0/1375503144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee0104d20 msgr2=0x7efee01003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee0104d20 0x7efee01003a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efed000d6f0 tx=0x7efed000dbb0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 -- 172.21.15.45:0/1375503144 shutdown_connections 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efecc07af30 0x7efecc07d3f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee0104d20 0x7efee01003a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 --2- 172.21.15.45:0/1375503144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee01023f0 0x7efee0101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 -- 172.21.15.45:0/1375503144 >> 172.21.15.45:0/1375503144 conn(0x7efee00fc010 msgr2=0x7efee00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 -- 172.21.15.45:0/1375503144 shutdown_connections 2024-09-18T12:54:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:41.963+0000 7efee7271640 1 -- 172.21.15.45:0/1375503144 wait complete. 2024-09-18T12:54:42.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.050+0000 7f083c450640 1 -- 172.21.15.45:0/1259797498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0834101960 msgr2=0x7f0834101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.050+0000 7f083c450640 1 --2- 172.21.15.45:0/1259797498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0834101960 0x7f0834101d60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f082c009880 tx=0x7f082c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.050+0000 7f083c450640 1 -- 172.21.15.45:0/1259797498 shutdown_connections 2024-09-18T12:54:42.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.050+0000 7f083c450640 1 --2- 172.21.15.45:0/1259797498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0834102b60 0x7f0834102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.050+0000 7f083c450640 1 --2- 172.21.15.45:0/1259797498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0834101960 0x7f0834101d60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.050+0000 7f083c450640 1 -- 172.21.15.45:0/1259797498 >> 172.21.15.45:0/1259797498 conn(0x7f08340fd0f0 msgr2=0x7f08340ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:42.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.050+0000 7f083c450640 1 -- 172.21.15.45:0/1259797498 shutdown_connections 2024-09-18T12:54:42.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.050+0000 7f083c450640 1 -- 172.21.15.45:0/1259797498 wait complete. 2024-09-18T12:54:42.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f083c450640 1 Processor -- start 2024-09-18T12:54:42.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f083c450640 1 -- start start 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f083c450640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0834101960 0x7f0834197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f083c450640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0834102b60 0x7f0834197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f083c450640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f083410a800 con 0x7f0834101960 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f083c450640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f083410a680 con 0x7f0834102b60 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f083a1ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0834101960 0x7f0834197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f083a1ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0834101960 0x7f0834197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57542/0 (socket says 172.21.15.45:57542) 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f083a1ec640 1 -- 172.21.15.45:0/3385161863 learned_addr learned my addr 172.21.15.45:0/3385161863 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f08399eb640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0834102b60 0x7f0834197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.051+0000 7f083a1ec640 1 -- 172.21.15.45:0/3385161863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0834102b60 msgr2=0x7f0834197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.052+0000 7f083a1ec640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0834102b60 0x7f0834197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.052+0000 7f083a1ec640 1 -- 172.21.15.45:0/3385161863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08341980d0 con 0x7f0834101960 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.052+0000 7f083a1ec640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0834101960 0x7f0834197510 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f082c006010 tx=0x7f082c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:42.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.052+0000 7f08337fe640 1 -- 172.21.15.45:0/3385161863 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f082c03f070 con 0x7f0834101960 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.052+0000 7f08337fe640 1 -- 172.21.15.45:0/3385161863 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f082c0044d0 con 0x7f0834101960 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.052+0000 7f083c450640 1 -- 172.21.15.45:0/3385161863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083419cab0 con 0x7f0834101960 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.052+0000 7f08337fe640 1 -- 172.21.15.45:0/3385161863 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f082c035030 con 0x7f0834101960 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.052+0000 7f083c450640 1 -- 172.21.15.45:0/3385161863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f083419d040 con 0x7f0834101960 2024-09-18T12:54:42.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.053+0000 7f083c450640 1 -- 172.21.15.45:0/3385161863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0834101d60 con 0x7f0834101960 2024-09-18T12:54:42.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.054+0000 7f08337fe640 1 -- 172.21.15.45:0/3385161863 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f082c042070 con 0x7f0834101960 2024-09-18T12:54:42.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.055+0000 7f08337fe640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f081c07af80 0x7f081c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:54:42.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.055+0000 7f08337fe640 1 -- 172.21.15.45:0/3385161863 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f082c0bef00 con 0x7f0834101960 2024-09-18T12:54:42.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.055+0000 7f08399eb640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f081c07af80 0x7f081c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:54:42.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.055+0000 7f08399eb640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f081c07af80 0x7f081c07d440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08341989c0 tx=0x7f0828009110 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:54:42.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.060+0000 7f08337fe640 1 -- 172.21.15.45:0/3385161863 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f082c08a670 con 0x7f0834101960 2024-09-18T12:54:42.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.275+0000 7f083c450640 1 -- 172.21.15.45:0/3385161863 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f08340626f0 con 0x7f081c07af80 2024-09-18T12:54:42.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.276+0000 7f08337fe640 1 -- 172.21.15.45:0/3385161863 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7f08340626f0 con 0x7f081c07af80 2024-09-18T12:54:42.277 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:54:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:54:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:54:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:54:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:54:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr" 2024-09-18T12:54:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:54:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "2/2 daemons upgraded", 2024-09-18T12:54:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-18T12:54:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:54:42.278 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:54:42.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 -- 172.21.15.45:0/3385161863 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f081c07af80 msgr2=0x7f081c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f081c07af80 0x7f081c07d440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08341989c0 tx=0x7f0828009110 comp rx=0 tx=0).stop 2024-09-18T12:54:42.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 -- 172.21.15.45:0/3385161863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0834101960 msgr2=0x7f0834197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:54:42.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0834101960 0x7f0834197510 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f082c006010 tx=0x7f082c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 -- 172.21.15.45:0/3385161863 shutdown_connections 2024-09-18T12:54:42.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f081c07af80 0x7f081c07d440 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0834102b60 0x7f0834197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 --2- 172.21.15.45:0/3385161863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0834101960 0x7f0834197510 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:54:42.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 -- 172.21.15.45:0/3385161863 >> 172.21.15.45:0/3385161863 conn(0x7f08340fd0f0 msgr2=0x7f0834105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:54:42.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 -- 172.21.15.45:0/3385161863 shutdown_connections 2024-09-18T12:54:42.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:54:42.279+0000 7f083c450640 1 -- 172.21.15.45:0/3385161863 wait complete. 2024-09-18T12:54:42.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:42 smithi045 ceph-mon[28315]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:42.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:42 smithi045 ceph-mon[28315]: from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:42.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:42 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:42.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:42 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:42.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:42 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/1375503144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:42.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:42 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:42.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:42 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:42.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:42 smithi161 ceph-mon[35784]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:42.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:42 smithi161 ceph-mon[35784]: from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:42.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:42 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:42.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:42 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:42.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:42 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/1375503144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:42.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:42 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:42.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:42 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:43.752 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:43 smithi161 ceph-mon[35784]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:43.752 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:43 smithi161 ceph-mon[35784]: pgmap v58: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:43.753 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:43 smithi161 ceph-mon[35784]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:43 smithi045 ceph-mon[28315]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:43 smithi045 ceph-mon[28315]: pgmap v58: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:43.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:43 smithi045 ceph-mon[28315]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:54:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:45 smithi045 ceph-mon[28315]: pgmap v59: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:54:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:45 smithi161 ceph-mon[35784]: pgmap v59: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:54:46.758 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:46.758 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:46.758 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:46.759 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:46.760 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:46.760 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:46.760 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:46 smithi045 ceph-mon[28315]: pgmap v60: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:47.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:47.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:54:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:46 smithi161 ceph-mon[35784]: pgmap v60: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:47 smithi045 ceph-mon[28315]: Upgrade: Updating alertmanager.smithi045 2024-09-18T12:54:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:47 smithi045 ceph-mon[28315]: Deploying daemon alertmanager.smithi045 on smithi045 2024-09-18T12:54:47.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:47 smithi161 ceph-mon[35784]: Upgrade: Updating alertmanager.smithi045 2024-09-18T12:54:47.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:47 smithi161 ceph-mon[35784]: Deploying daemon alertmanager.smithi045 on smithi045 2024-09-18T12:54:48.955 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:48 smithi161 ceph-mon[35784]: pgmap v61: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:49.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:48 smithi045 ceph-mon[28315]: pgmap v61: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:51.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:51 smithi045 ceph-mon[28315]: pgmap v62: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:54:51.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:51 smithi161 ceph-mon[35784]: pgmap v62: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:54:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:53 smithi045 ceph-mon[28315]: pgmap v63: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:54:53.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:53 smithi161 ceph-mon[35784]: pgmap v63: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:53.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:54:55.331 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:55 smithi045 ceph-mon[28315]: pgmap v64: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:54:55.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:55 smithi161 ceph-mon[35784]: pgmap v64: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:54:57.131 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:56 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:57.131 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:56 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:57.131 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:56 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:54:57.131 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:56 smithi045 ceph-mon[28315]: pgmap v65: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:57.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:56 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:57.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:56 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:54:57.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:56 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:54:57.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:56 smithi161 ceph-mon[35784]: pgmap v65: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:59.495 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:54:59 smithi045 ceph-mon[28315]: pgmap v66: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:54:59.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:54:59 smithi161 ceph-mon[35784]: pgmap v66: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:01 smithi045 ceph-mon[28315]: pgmap v67: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:01 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:01 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:01.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:01 smithi161 ceph-mon[35784]: pgmap v67: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:01.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:01 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:01.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:01 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:02 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:02 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:02 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:02 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:03 smithi045 ceph-mon[28315]: pgmap v68: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:03 smithi161 ceph-mon[35784]: pgmap v68: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:05.721 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: pgmap v69: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.722 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.723 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:05 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: pgmap v69: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:05.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:05 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:06 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:55:07.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:06 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T12:55:08.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:07 smithi045 ceph-mon[28315]: Upgrade: Updating grafana.smithi045 2024-09-18T12:55:08.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:07 smithi045 ceph-mon[28315]: Deploying daemon grafana.smithi045 on smithi045 2024-09-18T12:55:08.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:07 smithi045 ceph-mon[28315]: pgmap v70: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:08.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:07 smithi161 ceph-mon[35784]: Upgrade: Updating grafana.smithi045 2024-09-18T12:55:08.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:07 smithi161 ceph-mon[35784]: Deploying daemon grafana.smithi045 on smithi045 2024-09-18T12:55:08.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:07 smithi161 ceph-mon[35784]: pgmap v70: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:09.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:08 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:55:09.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:08 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:55:10.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:09 smithi045 ceph-mon[28315]: pgmap v71: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:10.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:09 smithi161 ceph-mon[35784]: pgmap v71: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:12.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:11 smithi045 ceph-mon[28315]: pgmap v72: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:12.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:11 smithi161 ceph-mon[35784]: pgmap v72: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.386+0000 7f24ca365640 1 -- 172.21.15.45:0/3526564556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c4100860 msgr2=0x7f24c4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.386+0000 7f24ca365640 1 --2- 172.21.15.45:0/3526564556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c4100860 0x7f24c4100c60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009880 tx=0x7f24b402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.386+0000 7f24ca365640 1 -- 172.21.15.45:0/3526564556 shutdown_connections 2024-09-18T12:55:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.386+0000 7f24ca365640 1 --2- 172.21.15.45:0/3526564556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c4101a60 0x7f24c4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.386+0000 7f24ca365640 1 --2- 172.21.15.45:0/3526564556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c4100860 0x7f24c4100c60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.386+0000 7f24ca365640 1 -- 172.21.15.45:0/3526564556 >> 172.21.15.45:0/3526564556 conn(0x7f24c40fc010 msgr2=0x7f24c40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.386+0000 7f24ca365640 1 -- 172.21.15.45:0/3526564556 shutdown_connections 2024-09-18T12:55:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.386+0000 7f24ca365640 1 -- 172.21.15.45:0/3526564556 wait complete. 2024-09-18T12:55:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.387+0000 7f24ca365640 1 Processor -- start 2024-09-18T12:55:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.387+0000 7f24ca365640 1 -- start start 2024-09-18T12:55:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.387+0000 7f24ca365640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c4100860 0x7f24c406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.387+0000 7f24ca365640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c4101a60 0x7f24c419c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.387+0000 7f24ca365640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f24c41096a0 con 0x7f24c4101a60 2024-09-18T12:55:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.387+0000 7f24ca365640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f24c4109520 con 0x7f24c4100860 2024-09-18T12:55:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.387+0000 7f24c37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c4101a60 0x7f24c419c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.387+0000 7f24c37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c4101a60 0x7f24c419c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56984/0 (socket says 172.21.15.45:56984) 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.387+0000 7f24c37fe640 1 -- 172.21.15.45:0/2719370906 learned_addr learned my addr 172.21.15.45:0/2719370906 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.387+0000 7f24c3fff640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c4100860 0x7f24c406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.388+0000 7f24c37fe640 1 -- 172.21.15.45:0/2719370906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c4100860 msgr2=0x7f24c406a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.388+0000 7f24c37fe640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c4100860 0x7f24c406a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.388+0000 7f24c37fe640 1 -- 172.21.15.45:0/2719370906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c419c7e0 con 0x7f24c4101a60 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.388+0000 7f24c3fff640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c4100860 0x7f24c406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.388+0000 7f24c37fe640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c4101a60 0x7f24c419c1f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f24b800e970 tx=0x7f24b800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.388+0000 7f24c17fa640 1 -- 172.21.15.45:0/2719370906 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24b800cac0 con 0x7f24c4101a60 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.388+0000 7f24c17fa640 1 -- 172.21.15.45:0/2719370906 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24b80054e0 con 0x7f24c4101a60 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.388+0000 7f24ca365640 1 -- 172.21.15.45:0/2719370906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c419cad0 con 0x7f24c4101a60 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.389+0000 7f24ca365640 1 -- 172.21.15.45:0/2719370906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c419d060 con 0x7f24c4101a60 2024-09-18T12:55:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.389+0000 7f24c17fa640 1 -- 172.21.15.45:0/2719370906 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24b8010430 con 0x7f24c4101a60 2024-09-18T12:55:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.390+0000 7f24ca365640 1 -- 172.21.15.45:0/2719370906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b00052c0 con 0x7f24c4101a60 2024-09-18T12:55:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.391+0000 7f24c17fa640 1 -- 172.21.15.45:0/2719370906 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f24b800cc60 con 0x7f24c4101a60 2024-09-18T12:55:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.391+0000 7f24c17fa640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f24ac07af90 0x7f24ac07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.392+0000 7f24c17fa640 1 -- 172.21.15.45:0/2719370906 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f24b809e570 con 0x7f24c4101a60 2024-09-18T12:55:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.392+0000 7f24c3fff640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f24ac07af90 0x7f24ac07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.392+0000 7f24c3fff640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f24ac07af90 0x7f24ac07d450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f24b4006010 tx=0x7f24b4005a20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.398+0000 7f24c17fa640 1 -- 172.21.15.45:0/2719370906 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f24b8069bb0 con 0x7f24c4101a60 2024-09-18T12:55:12.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.674+0000 7f24ca365640 1 -- 172.21.15.45:0/2719370906 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f24b0000bf0 con 0x7f24ac07af90 2024-09-18T12:55:12.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.675+0000 7f24c17fa640 1 -- 172.21.15.45:0/2719370906 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f24b0000bf0 con 0x7f24ac07af90 2024-09-18T12:55:12.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 -- 172.21.15.45:0/2719370906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f24ac07af90 msgr2=0x7f24ac07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:12.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f24ac07af90 0x7f24ac07d450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f24b4006010 tx=0x7f24b4005a20 comp rx=0 tx=0).stop 2024-09-18T12:55:12.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 -- 172.21.15.45:0/2719370906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c4101a60 msgr2=0x7f24c419c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c4101a60 0x7f24c419c1f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f24b800e970 tx=0x7f24b800ed70 comp rx=0 tx=0).stop 2024-09-18T12:55:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 -- 172.21.15.45:0/2719370906 shutdown_connections 2024-09-18T12:55:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f24ac07af90 0x7f24ac07d450 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c4101a60 0x7f24c419c1f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 --2- 172.21.15.45:0/2719370906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24c4100860 0x7f24c406a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 -- 172.21.15.45:0/2719370906 >> 172.21.15.45:0/2719370906 conn(0x7f24c40fc010 msgr2=0x7f24c4104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 -- 172.21.15.45:0/2719370906 shutdown_connections 2024-09-18T12:55:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.678+0000 7f24ca365640 1 -- 172.21.15.45:0/2719370906 wait complete. 2024-09-18T12:55:12.689 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:55:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.785+0000 7fbc6ecba640 1 -- 172.21.15.45:0/3990024280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc68101a80 msgr2=0x7fbc68101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.785+0000 7fbc6ecba640 1 --2- 172.21.15.45:0/3990024280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc68101a80 0x7fbc68101f00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009880 tx=0x7fbc5802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.785+0000 7fbc6ecba640 1 -- 172.21.15.45:0/3990024280 shutdown_connections 2024-09-18T12:55:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.785+0000 7fbc6ecba640 1 --2- 172.21.15.45:0/3990024280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc68101a80 0x7fbc68101f00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.785+0000 7fbc6ecba640 1 --2- 172.21.15.45:0/3990024280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc68100880 0x7fbc68100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.785+0000 7fbc6ecba640 1 -- 172.21.15.45:0/3990024280 >> 172.21.15.45:0/3990024280 conn(0x7fbc680fc010 msgr2=0x7fbc680fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.786+0000 7fbc6ecba640 1 -- 172.21.15.45:0/3990024280 shutdown_connections 2024-09-18T12:55:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.786+0000 7fbc6ecba640 1 -- 172.21.15.45:0/3990024280 wait complete. 2024-09-18T12:55:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.786+0000 7fbc6ecba640 1 Processor -- start 2024-09-18T12:55:12.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.786+0000 7fbc6ecba640 1 -- start start 2024-09-18T12:55:12.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc6ecba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc68100880 0x7fbc6806afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:12.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc6ecba640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc68101a80 0x7fbc6819c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:12.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc6ecba640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbc681096c0 con 0x7fbc68100880 2024-09-18T12:55:12.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc6ecba640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbc68109540 con 0x7fbc68101a80 2024-09-18T12:55:12.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc6ca56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc68100880 0x7fbc6806afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc6ca56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc68100880 0x7fbc6806afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38618/0 (socket says 172.21.15.45:38618) 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc6ca56640 1 -- 172.21.15.45:0/738190912 learned_addr learned my addr 172.21.15.45:0/738190912 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc5ffff640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc68101a80 0x7fbc6819c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc6ca56640 1 -- 172.21.15.45:0/738190912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc68101a80 msgr2=0x7fbc6819c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc6ca56640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc68101a80 0x7fbc6819c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.787+0000 7fbc6ca56640 1 -- 172.21.15.45:0/738190912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6819c820 con 0x7fbc68100880 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.788+0000 7fbc6ca56640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc68100880 0x7fbc6806afa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400d8d0 tx=0x7fbc6400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.788+0000 7fbc5dffb640 1 -- 172.21.15.45:0/738190912 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc64017070 con 0x7fbc68100880 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.788+0000 7fbc5dffb640 1 -- 172.21.15.45:0/738190912 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc6400be10 con 0x7fbc68100880 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.788+0000 7fbc6ecba640 1 -- 172.21.15.45:0/738190912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6819cb10 con 0x7fbc68100880 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.788+0000 7fbc5dffb640 1 -- 172.21.15.45:0/738190912 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc6400f3c0 con 0x7fbc68100880 2024-09-18T12:55:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.788+0000 7fbc6ecba640 1 -- 172.21.15.45:0/738190912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6819d0a0 con 0x7fbc68100880 2024-09-18T12:55:12.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.789+0000 7fbc6ecba640 1 -- 172.21.15.45:0/738190912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc68100c80 con 0x7fbc68100880 2024-09-18T12:55:12.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.790+0000 7fbc5dffb640 1 -- 172.21.15.45:0/738190912 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fbc6401a070 con 0x7fbc68100880 2024-09-18T12:55:12.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.791+0000 7fbc5dffb640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc5007af30 0x7fbc5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.791+0000 7fbc5dffb640 1 -- 172.21.15.45:0/738190912 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fbc6409dbf0 con 0x7fbc68100880 2024-09-18T12:55:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.791+0000 7fbc5ffff640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc5007af30 0x7fbc5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.792+0000 7fbc5ffff640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc5007af30 0x7fbc5007d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbc6806ad20 tx=0x7fbc58005a20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:12.797+0000 7fbc5dffb640 1 -- 172.21.15.45:0/738190912 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fbc64069240 con 0x7fbc68100880 2024-09-18T12:55:13.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.013+0000 7fbc6ecba640 1 -- 172.21.15.45:0/738190912 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbc680626f0 con 0x7fbc5007af30 2024-09-18T12:55:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.014+0000 7fbc5dffb640 1 -- 172.21.15.45:0/738190912 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7fbc680626f0 con 0x7fbc5007af30 2024-09-18T12:55:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.016+0000 7fbc6ecba640 1 -- 172.21.15.45:0/738190912 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc5007af30 msgr2=0x7fbc5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.016+0000 7fbc6ecba640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc5007af30 0x7fbc5007d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbc6806ad20 tx=0x7fbc58005a20 comp rx=0 tx=0).stop 2024-09-18T12:55:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.016+0000 7fbc6ecba640 1 -- 172.21.15.45:0/738190912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc68100880 msgr2=0x7fbc6806afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.016+0000 7fbc6ecba640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc68100880 0x7fbc6806afa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400d8d0 tx=0x7fbc6400dd90 comp rx=0 tx=0).stop 2024-09-18T12:55:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.016+0000 7fbc6ecba640 1 -- 172.21.15.45:0/738190912 shutdown_connections 2024-09-18T12:55:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.016+0000 7fbc6ecba640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbc5007af30 0x7fbc5007d3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.016+0000 7fbc6ecba640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc68101a80 0x7fbc6819c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.016+0000 7fbc6ecba640 1 --2- 172.21.15.45:0/738190912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc68100880 0x7fbc6806afa0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.016+0000 7fbc6ecba640 1 -- 172.21.15.45:0/738190912 >> 172.21.15.45:0/738190912 conn(0x7fbc680fc010 msgr2=0x7fbc68104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.017+0000 7fbc6ecba640 1 -- 172.21.15.45:0/738190912 shutdown_connections 2024-09-18T12:55:13.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.017+0000 7fbc6ecba640 1 -- 172.21.15.45:0/738190912 wait complete. 2024-09-18T12:55:13.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.102+0000 7f2aade55640 1 -- 172.21.15.45:0/4125594613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aa8101a80 msgr2=0x7f2aa8101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.102+0000 7f2aade55640 1 --2- 172.21.15.45:0/4125594613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aa8101a80 0x7f2aa8101f00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009880 tx=0x7f2a9c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.102+0000 7f2aade55640 1 -- 172.21.15.45:0/4125594613 shutdown_connections 2024-09-18T12:55:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.102+0000 7f2aade55640 1 --2- 172.21.15.45:0/4125594613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aa8101a80 0x7f2aa8101f00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.102+0000 7f2aade55640 1 --2- 172.21.15.45:0/4125594613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa8100880 0x7f2aa8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.102+0000 7f2aade55640 1 -- 172.21.15.45:0/4125594613 >> 172.21.15.45:0/4125594613 conn(0x7f2aa80fc030 msgr2=0x7f2aa80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.102+0000 7f2aade55640 1 -- 172.21.15.45:0/4125594613 shutdown_connections 2024-09-18T12:55:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.103+0000 7f2aade55640 1 -- 172.21.15.45:0/4125594613 wait complete. 2024-09-18T12:55:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.103+0000 7f2aade55640 1 Processor -- start 2024-09-18T12:55:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.103+0000 7f2aade55640 1 -- start start 2024-09-18T12:55:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.103+0000 7f2aade55640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aa8100880 0x7f2aa806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.103+0000 7f2aade55640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa8101a80 0x7f2aa819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.103+0000 7f2aade55640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa81096c0 con 0x7f2aa8100880 2024-09-18T12:55:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.103+0000 7f2aade55640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa8109540 con 0x7f2aa8101a80 2024-09-18T12:55:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.104+0000 7f2aa77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aa8100880 0x7f2aa806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.104+0000 7f2aa77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aa8100880 0x7f2aa806aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38634/0 (socket says 172.21.15.45:38634) 2024-09-18T12:55:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.104+0000 7f2aa77fe640 1 -- 172.21.15.45:0/3844205732 learned_addr learned my addr 172.21.15.45:0/3844205732 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.104+0000 7f2aa6ffd640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa8101a80 0x7f2aa819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.104+0000 7f2aa77fe640 1 -- 172.21.15.45:0/3844205732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa8101a80 msgr2=0x7f2aa819c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.104+0000 7f2aa77fe640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa8101a80 0x7f2aa819c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.104+0000 7f2aa77fe640 1 -- 172.21.15.45:0/3844205732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa819c820 con 0x7f2aa8100880 2024-09-18T12:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.104+0000 7f2aa77fe640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aa8100880 0x7f2aa806aff0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800d8d0 tx=0x7f2a9800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.105+0000 7f2aa4ff9640 1 -- 172.21.15.45:0/3844205732 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a98017070 con 0x7f2aa8100880 2024-09-18T12:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.105+0000 7f2aa4ff9640 1 -- 172.21.15.45:0/3844205732 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a9800be10 con 0x7f2aa8100880 2024-09-18T12:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.105+0000 7f2aade55640 1 -- 172.21.15.45:0/3844205732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa819cb10 con 0x7f2aa8100880 2024-09-18T12:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.105+0000 7f2aa4ff9640 1 -- 172.21.15.45:0/3844205732 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a9800f3c0 con 0x7f2aa8100880 2024-09-18T12:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.105+0000 7f2aade55640 1 -- 172.21.15.45:0/3844205732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa819d070 con 0x7f2aa8100880 2024-09-18T12:55:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.106+0000 7f2aade55640 1 -- 172.21.15.45:0/3844205732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa8100c80 con 0x7f2aa8100880 2024-09-18T12:55:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.107+0000 7f2aa4ff9640 1 -- 172.21.15.45:0/3844205732 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f2a9801a070 con 0x7f2aa8100880 2024-09-18T12:55:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.107+0000 7f2aa4ff9640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a9007afe0 0x7f2a9007d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.108+0000 7f2aa4ff9640 1 -- 172.21.15.45:0/3844205732 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f2a9809dac0 con 0x7f2aa8100880 2024-09-18T12:55:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.108+0000 7f2aa6ffd640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a9007afe0 0x7f2a9007d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.108+0000 7f2aa6ffd640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a9007afe0 0x7f2a9007d4a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c000c00 tx=0x7f2a9c005a20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:13.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.112+0000 7f2aa4ff9640 1 -- 172.21.15.45:0/3844205732 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f2a98069120 con 0x7f2aa8100880 2024-09-18T12:55:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.309+0000 7f2aade55640 1 -- 172.21.15.45:0/3844205732 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2aa8106030 con 0x7f2a9007afe0 2024-09-18T12:55:13.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.319+0000 7f2aa4ff9640 1 -- 172.21.15.45:0/3844205732 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2aa8106030 con 0x7f2a9007afe0 2024-09-18T12:55:13.321 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:55:13.321 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (18s) 12s ago 11m 17.0M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T12:55:13.321 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (3m) 12s ago 11m 8715k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:55:13.321 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (2m) 59s ago 10m 8144k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:55:13.321 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (11m) 12s ago 11m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:55:13.321 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (10m) 59s ago 10m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:55:13.321 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (9m) 12s ago 10m 77.6M - 9.4.12 2bacad6d85d8 8ae1efbe19ab 2024-09-18T12:55:13.321 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (5m) 12s ago 5m 91.9M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (5m) 12s ago 5m 150M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (5m) 59s ago 5m 16.3M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (5m) 59s ago 5m 14.7M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (2m) 12s ago 12m 514M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (91s) 59s ago 10m 454M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (12m) 12s ago 12m 58.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (10m) 59s ago 10m 48.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (68s) 12s ago 11m 9395k - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (62s) 59s ago 10m 3338k - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (9m) 12s ago 9m 205M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (8m) 12s ago 8m 223M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (8m) 12s ago 8m 185M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (7m) 59s ago 7m 239M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (7m) 59s ago 7m 213M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (6m) 59s ago 6m 197M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:55:13.322 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (39s) 12s ago 10m 44.1M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:55:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 -- 172.21.15.45:0/3844205732 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a9007afe0 msgr2=0x7f2a9007d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a9007afe0 0x7f2a9007d4a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c000c00 tx=0x7f2a9c005a20 comp rx=0 tx=0).stop 2024-09-18T12:55:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 -- 172.21.15.45:0/3844205732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aa8100880 msgr2=0x7f2aa806aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aa8100880 0x7f2aa806aff0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800d8d0 tx=0x7f2a9800dd90 comp rx=0 tx=0).stop 2024-09-18T12:55:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 -- 172.21.15.45:0/3844205732 shutdown_connections 2024-09-18T12:55:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a9007afe0 0x7f2a9007d4a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa8101a80 0x7f2aa819c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 --2- 172.21.15.45:0/3844205732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aa8100880 0x7f2aa806aff0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 -- 172.21.15.45:0/3844205732 >> 172.21.15.45:0/3844205732 conn(0x7f2aa80fc030 msgr2=0x7f2aa80fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 -- 172.21.15.45:0/3844205732 shutdown_connections 2024-09-18T12:55:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.322+0000 7f2aade55640 1 -- 172.21.15.45:0/3844205732 wait complete. 2024-09-18T12:55:13.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.404+0000 7f8ef4c78640 1 -- 172.21.15.45:0/1178178816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef01023f0 msgr2=0x7f8ef01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.404+0000 7f8ef4c78640 1 --2- 172.21.15.45:0/1178178816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef01023f0 0x7f8ef01047e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00098b0 tx=0x7f8ee002a4d0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.405+0000 7f8ef4c78640 1 -- 172.21.15.45:0/1178178816 shutdown_connections 2024-09-18T12:55:13.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.405+0000 7f8ef4c78640 1 --2- 172.21.15.45:0/1178178816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ef0104d20 0x7f8ef0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.405+0000 7f8ef4c78640 1 --2- 172.21.15.45:0/1178178816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef01023f0 0x7f8ef01047e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.405+0000 7f8ef4c78640 1 -- 172.21.15.45:0/1178178816 >> 172.21.15.45:0/1178178816 conn(0x7f8ef00fc010 msgr2=0x7f8ef00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:13.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.405+0000 7f8ef4c78640 1 -- 172.21.15.45:0/1178178816 shutdown_connections 2024-09-18T12:55:13.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.405+0000 7f8ef4c78640 1 -- 172.21.15.45:0/1178178816 wait complete. 2024-09-18T12:55:13.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.405+0000 7f8ef4c78640 1 Processor -- start 2024-09-18T12:55:13.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.405+0000 7f8ef4c78640 1 -- start start 2024-09-18T12:55:13.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8ef4c78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef01023f0 0x7f8ef0197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8ef4c78640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ef0104d20 0x7f8ef0197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8ef4c78640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef010a7c0 con 0x7f8ef01023f0 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8ef4c78640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef010a640 con 0x7f8ef0104d20 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8eee59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef01023f0 0x7f8ef0197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8eee59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef01023f0 0x7f8ef0197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38662/0 (socket says 172.21.15.45:38662) 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8eee59c640 1 -- 172.21.15.45:0/667844972 learned_addr learned my addr 172.21.15.45:0/667844972 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8eedd9b640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ef0104d20 0x7f8ef0197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8eee59c640 1 -- 172.21.15.45:0/667844972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ef0104d20 msgr2=0x7f8ef0197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8eee59c640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ef0104d20 0x7f8ef0197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8eee59c640 1 -- 172.21.15.45:0/667844972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef0198110 con 0x7f8ef01023f0 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8eee59c640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef01023f0 0x7f8ef0197550 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00099d0 tx=0x7f8ee00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8edf7fe640 1 -- 172.21.15.45:0/667844972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ee003f070 con 0x7f8ef01023f0 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8edf7fe640 1 -- 172.21.15.45:0/667844972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ee0004c70 con 0x7f8ef01023f0 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.406+0000 7f8ef4c78640 1 -- 172.21.15.45:0/667844972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef019caf0 con 0x7f8ef01023f0 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.407+0000 7f8edf7fe640 1 -- 172.21.15.45:0/667844972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ee0035030 con 0x7f8ef01023f0 2024-09-18T12:55:13.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.407+0000 7f8ef4c78640 1 -- 172.21.15.45:0/667844972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef019d080 con 0x7f8ef01023f0 2024-09-18T12:55:13.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.408+0000 7f8ef4c78640 1 -- 172.21.15.45:0/667844972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef01027d0 con 0x7f8ef01023f0 2024-09-18T12:55:13.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.408+0000 7f8edf7fe640 1 -- 172.21.15.45:0/667844972 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f8ee0042070 con 0x7f8ef01023f0 2024-09-18T12:55:13.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.409+0000 7f8edf7fe640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8ed807af30 0x7f8ed807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.409+0000 7f8edf7fe640 1 -- 172.21.15.45:0/667844972 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f8ee00bebe0 con 0x7f8ef01023f0 2024-09-18T12:55:13.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.409+0000 7f8eedd9b640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8ed807af30 0x7f8ed807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.409+0000 7f8eedd9b640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8ed807af30 0x7f8ed807d3f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0198a00 tx=0x7f8ee400a2d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:13.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.414+0000 7f8edf7fe640 1 -- 172.21.15.45:0/667844972 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f8ee008a230 con 0x7f8ef01023f0 2024-09-18T12:55:13.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.668+0000 7f8ef4c78640 1 -- 172.21.15.45:0/667844972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8ef019d370 con 0x7f8ef01023f0 2024-09-18T12:55:13.670 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:13 smithi045 ceph-mon[28315]: pgmap v73: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:13.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.669+0000 7f8edf7fe640 1 -- 172.21.15.45:0/667844972 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f8ee008f0e0 con 0x7f8ef01023f0 2024-09-18T12:55:13.670 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:55:13.671 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:55:13.672 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:55:13.672 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:55:13.672 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:55:13.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 -- 172.21.15.45:0/667844972 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8ed807af30 msgr2=0x7f8ed807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8ed807af30 0x7f8ed807d3f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0198a00 tx=0x7f8ee400a2d0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 -- 172.21.15.45:0/667844972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef01023f0 msgr2=0x7f8ef0197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef01023f0 0x7f8ef0197550 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00099d0 tx=0x7f8ee00048f0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 -- 172.21.15.45:0/667844972 shutdown_connections 2024-09-18T12:55:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8ed807af30 0x7f8ed807d3f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ef0104d20 0x7f8ef0197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 --2- 172.21.15.45:0/667844972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef01023f0 0x7f8ef0197550 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 -- 172.21.15.45:0/667844972 >> 172.21.15.45:0/667844972 conn(0x7f8ef00fc010 msgr2=0x7f8ef00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 -- 172.21.15.45:0/667844972 shutdown_connections 2024-09-18T12:55:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.671+0000 7f8ef4c78640 1 -- 172.21.15.45:0/667844972 wait complete. 2024-09-18T12:55:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.762+0000 7f4997938640 1 -- 172.21.15.45:0/3023558786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4990100860 msgr2=0x7f4990100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.762+0000 7f4997938640 1 --2- 172.21.15.45:0/3023558786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4990100860 0x7f4990100c60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4980009880 tx=0x7f498002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.762+0000 7f4997938640 1 -- 172.21.15.45:0/3023558786 shutdown_connections 2024-09-18T12:55:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.762+0000 7f4997938640 1 --2- 172.21.15.45:0/3023558786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4990101a60 0x7f4990101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.762+0000 7f4997938640 1 --2- 172.21.15.45:0/3023558786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4990100860 0x7f4990100c60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.762+0000 7f4997938640 1 -- 172.21.15.45:0/3023558786 >> 172.21.15.45:0/3023558786 conn(0x7f49900fc010 msgr2=0x7f49900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.762+0000 7f4997938640 1 -- 172.21.15.45:0/3023558786 shutdown_connections 2024-09-18T12:55:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.762+0000 7f4997938640 1 -- 172.21.15.45:0/3023558786 wait complete. 2024-09-18T12:55:13.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4997938640 1 Processor -- start 2024-09-18T12:55:13.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4997938640 1 -- start start 2024-09-18T12:55:13.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4997938640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4990100860 0x7f4990197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4997938640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4990101a60 0x7f4990197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4997938640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4990109700 con 0x7f4990101a60 2024-09-18T12:55:13.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4997938640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f4990109580 con 0x7f4990100860 2024-09-18T12:55:13.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4994ed3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4990101a60 0x7f4990197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4994ed3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4990101a60 0x7f4990197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38688/0 (socket says 172.21.15.45:38688) 2024-09-18T12:55:13.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4994ed3640 1 -- 172.21.15.45:0/2490958370 learned_addr learned my addr 172.21.15.45:0/2490958370 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f49956d4640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4990100860 0x7f4990197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4994ed3640 1 -- 172.21.15.45:0/2490958370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4990100860 msgr2=0x7f4990197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4994ed3640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4990100860 0x7f4990197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f4994ed3640 1 -- 172.21.15.45:0/2490958370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4990198130 con 0x7f4990101a60 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.763+0000 7f49956d4640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4990100860 0x7f4990197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.764+0000 7f4994ed3640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4990101a60 0x7f4990197ab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f498400b420 tx=0x7f498400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.764+0000 7f498e7fc640 1 -- 172.21.15.45:0/2490958370 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4984011630 con 0x7f4990101a60 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.764+0000 7f498e7fc640 1 -- 172.21.15.45:0/2490958370 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4984016070 con 0x7f4990101a60 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.764+0000 7f4997938640 1 -- 172.21.15.45:0/2490958370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499019cb70 con 0x7f4990101a60 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.764+0000 7f498e7fc640 1 -- 172.21.15.45:0/2490958370 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4984010d40 con 0x7f4990101a60 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.764+0000 7f4997938640 1 -- 172.21.15.45:0/2490958370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499019d180 con 0x7f4990101a60 2024-09-18T12:55:13.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.765+0000 7f4997938640 1 -- 172.21.15.45:0/2490958370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4990100c60 con 0x7f4990101a60 2024-09-18T12:55:13.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.766+0000 7f498e7fc640 1 -- 172.21.15.45:0/2490958370 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f498401b460 con 0x7f4990101a60 2024-09-18T12:55:13.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.766+0000 7f498e7fc640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f497807af80 0x7f497807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:13.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.766+0000 7f498e7fc640 1 -- 172.21.15.45:0/2490958370 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f498409d6e0 con 0x7f4990101a60 2024-09-18T12:55:13.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.766+0000 7f49956d4640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f497807af80 0x7f497807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:13.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.767+0000 7f49956d4640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f497807af80 0x7f497807d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4980000c00 tx=0x7f4980005a20 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:13.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.771+0000 7f498e7fc640 1 -- 172.21.15.45:0/2490958370 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f4984068db0 con 0x7f4990101a60 2024-09-18T12:55:13.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.973+0000 7f4997938640 1 -- 172.21.15.45:0/2490958370 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f499006a460 con 0x7f497807af80 2024-09-18T12:55:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.974+0000 7f498e7fc640 1 -- 172.21.15.45:0/2490958370 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f499006a460 con 0x7f497807af80 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr" 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "2/2 daemons upgraded", 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading grafana daemons", 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:55:13.976 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.976+0000 7f4997938640 1 -- 172.21.15.45:0/2490958370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f497807af80 msgr2=0x7f497807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.976+0000 7f4997938640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f497807af80 0x7f497807d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4980000c00 tx=0x7f4980005a20 comp rx=0 tx=0).stop 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.976+0000 7f4997938640 1 -- 172.21.15.45:0/2490958370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4990101a60 msgr2=0x7f4990197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.976+0000 7f4997938640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4990101a60 0x7f4990197ab0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f498400b420 tx=0x7f498400b8e0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.976+0000 7f4997938640 1 -- 172.21.15.45:0/2490958370 shutdown_connections 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.976+0000 7f4997938640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f497807af80 0x7f497807d440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.976+0000 7f4997938640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4990101a60 0x7f4990197ab0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.976+0000 7f4997938640 1 --2- 172.21.15.45:0/2490958370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4990100860 0x7f4990197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.976+0000 7f4997938640 1 -- 172.21.15.45:0/2490958370 >> 172.21.15.45:0/2490958370 conn(0x7f49900fc010 msgr2=0x7f4990069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.977+0000 7f4997938640 1 -- 172.21.15.45:0/2490958370 shutdown_connections 2024-09-18T12:55:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:13.977+0000 7f4997938640 1 -- 172.21.15.45:0/2490958370 wait complete. 2024-09-18T12:55:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:13 smithi161 ceph-mon[35784]: pgmap v73: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:14.828 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:14 smithi045 ceph-mon[28315]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:14.828 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:14 smithi045 ceph-mon[28315]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:14.828 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:14 smithi045 ceph-mon[28315]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:14.828 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:14 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/667844972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:15.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:14 smithi161 ceph-mon[35784]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:15.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:14 smithi161 ceph-mon[35784]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:15.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:14 smithi161 ceph-mon[35784]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:15.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:14 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/667844972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:15.852 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:15 smithi161 ceph-mon[35784]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:15.852 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:15 smithi161 ceph-mon[35784]: pgmap v74: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:15.900 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:15 smithi045 ceph-mon[28315]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:15.900 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:15 smithi045 ceph-mon[28315]: pgmap v74: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:17.780 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:17 smithi045 ceph-mon[28315]: pgmap v75: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:17 smithi161 ceph-mon[35784]: pgmap v75: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:19.426 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:19 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:19.426 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:19 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:19.426 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:19 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:19.426 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:19 smithi045 ceph-mon[28315]: pgmap v76: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:19.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:19 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:19.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:19 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:19.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:19 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:19.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:19 smithi161 ceph-mon[35784]: pgmap v76: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:21.508 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:21 smithi045 ceph-mon[28315]: pgmap v77: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:21 smithi161 ceph-mon[35784]: pgmap v77: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:23.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:23 smithi045 ceph-mon[28315]: pgmap v78: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:23.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:23 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:55:23.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:23 smithi161 ceph-mon[35784]: pgmap v78: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:23.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:23 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:55:24.584 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:24 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:24.584 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:24 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:24.584 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:24 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:24.585 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:24 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:24.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:24 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:24.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:24 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:24.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:24 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:24.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:24 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:25.662 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:25 smithi045 ceph-mon[28315]: pgmap v79: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:25 smithi161 ceph-mon[35784]: pgmap v79: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:27.473 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: pgmap v80: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:27.473 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:27.473 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:27.473 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:55:27.473 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:55:27.473 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:27.473 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:55:27.473 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:27.473 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.474 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.475 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-18T12:55:27.476 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T12:55:27.477 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:27.477 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:55:27.477 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:55:27.477 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:27 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:27.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: pgmap v80: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:27.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:27.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:27.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:55:27.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:55:27.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:27.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T12:55:27.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T12:55:27.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-18T12:55:27.797 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T12:55:27.797 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:27.797 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:55:27.797 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:55:27.797 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:27 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:28.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:28 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:55:28.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:28 smithi045 ceph-mon[28315]: Upgrade: Finalizing container_image settings 2024-09-18T12:55:28.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:28 smithi045 ceph-mon[28315]: Upgrade: Complete! 2024-09-18T12:55:28.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:28 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:28.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:28 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:55:28.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:28 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:55:28.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:28 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:28.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:28 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:28 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T12:55:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:28 smithi161 ceph-mon[35784]: Upgrade: Finalizing container_image settings 2024-09-18T12:55:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:28 smithi161 ceph-mon[35784]: Upgrade: Complete! 2024-09-18T12:55:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:28 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:28 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:55:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:28 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:55:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:28 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:28 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:29 smithi045 ceph-mon[28315]: pgmap v81: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:29 smithi161 ceph-mon[35784]: pgmap v81: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:31 smithi045 ceph-mon[28315]: pgmap v82: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:31 smithi161 ceph-mon[35784]: pgmap v82: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:33 smithi045 ceph-mon[28315]: pgmap v83: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:33 smithi161 ceph-mon[35784]: pgmap v83: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:35 smithi045 ceph-mon[28315]: pgmap v84: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:35 smithi161 ceph-mon[35784]: pgmap v84: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:37 smithi045 ceph-mon[28315]: pgmap v85: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:37 smithi161 ceph-mon[35784]: pgmap v85: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:38 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:55:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:38 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:55:39.468 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:39 smithi045 ceph-mon[28315]: pgmap v86: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:39 smithi161 ceph-mon[35784]: pgmap v86: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:41 smithi161 ceph-mon[35784]: pgmap v87: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:41 smithi045 ceph-mon[28315]: pgmap v87: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:43 smithi045 ceph-mon[28315]: pgmap v88: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:43 smithi161 ceph-mon[35784]: pgmap v88: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.074+0000 7f96ce9ec640 1 -- 172.21.15.45:0/1820772107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c8104d80 msgr2=0x7f96c8107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.074+0000 7f96ce9ec640 1 --2- 172.21.15.45:0/1820772107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c8104d80 0x7f96c8107170 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009880 tx=0x7f96bc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.075+0000 7f96ce9ec640 1 -- 172.21.15.45:0/1820772107 shutdown_connections 2024-09-18T12:55:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.075+0000 7f96ce9ec640 1 --2- 172.21.15.45:0/1820772107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c8104d80 0x7f96c8107170 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.075+0000 7f96ce9ec640 1 --2- 172.21.15.45:0/1820772107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96c8102450 0x7f96c8104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.075+0000 7f96ce9ec640 1 -- 172.21.15.45:0/1820772107 >> 172.21.15.45:0/1820772107 conn(0x7f96c80fc010 msgr2=0x7f96c80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.075+0000 7f96ce9ec640 1 -- 172.21.15.45:0/1820772107 shutdown_connections 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.075+0000 7f96ce9ec640 1 -- 172.21.15.45:0/1820772107 wait complete. 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.075+0000 7f96ce9ec640 1 Processor -- start 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.075+0000 7f96ce9ec640 1 -- start start 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96ce9ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96c8102450 0x7f96c81974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96ce9ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c8104d80 0x7f96c81979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96ce9ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f96c810a720 con 0x7f96c8104d80 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96ce9ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f96c810a5a0 con 0x7f96c8102450 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c8104d80 0x7f96c81979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c8104d80 0x7f96c81979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59758/0 (socket says 172.21.15.45:59758) 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96c77fe640 1 -- 172.21.15.45:0/2618608668 learned_addr learned my addr 172.21.15.45:0/2618608668 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96c7fff640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96c8102450 0x7f96c81974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96c77fe640 1 -- 172.21.15.45:0/2618608668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96c8102450 msgr2=0x7f96c81974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96c77fe640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96c8102450 0x7f96c81974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96c77fe640 1 -- 172.21.15.45:0/2618608668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c8197fd0 con 0x7f96c8104d80 2024-09-18T12:55:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.076+0000 7f96c77fe640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c8104d80 0x7f96c81979e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f96bc006010 tx=0x7f96bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.077+0000 7f96c57fa640 1 -- 172.21.15.45:0/2618608668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96bc03f070 con 0x7f96c8104d80 2024-09-18T12:55:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.077+0000 7f96c57fa640 1 -- 172.21.15.45:0/2618608668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96bc0044d0 con 0x7f96c8104d80 2024-09-18T12:55:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.077+0000 7f96c57fa640 1 -- 172.21.15.45:0/2618608668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96bc035030 con 0x7f96c8104d80 2024-09-18T12:55:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.077+0000 7f96ce9ec640 1 -- 172.21.15.45:0/2618608668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c819ca40 con 0x7f96c8104d80 2024-09-18T12:55:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.077+0000 7f96ce9ec640 1 -- 172.21.15.45:0/2618608668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c819cfa0 con 0x7f96c8104d80 2024-09-18T12:55:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.078+0000 7f96ce9ec640 1 -- 172.21.15.45:0/2618608668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c8102830 con 0x7f96c8104d80 2024-09-18T12:55:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.079+0000 7f96c57fa640 1 -- 172.21.15.45:0/2618608668 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f96bc042070 con 0x7f96c8104d80 2024-09-18T12:55:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.079+0000 7f96c57fa640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f96b007af80 0x7f96b007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.080+0000 7f96c57fa640 1 -- 172.21.15.45:0/2618608668 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f96bc0bebd0 con 0x7f96c8104d80 2024-09-18T12:55:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.080+0000 7f96c7fff640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f96b007af80 0x7f96b007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.080+0000 7f96c7fff640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f96b007af80 0x7f96b007d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005e10 tx=0x7f96b8005da0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:44.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.084+0000 7f96c57fa640 1 -- 172.21.15.45:0/2618608668 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f96bc08a200 con 0x7f96c8104d80 2024-09-18T12:55:44.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.292+0000 7f96ce9ec640 1 -- 172.21.15.45:0/2618608668 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f96c8105780 con 0x7f96b007af80 2024-09-18T12:55:44.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.293+0000 7f96c57fa640 1 -- 172.21.15.45:0/2618608668 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f96c8105780 con 0x7f96b007af80 2024-09-18T12:55:44.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.295+0000 7f96ce9ec640 1 -- 172.21.15.45:0/2618608668 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f96b007af80 msgr2=0x7f96b007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:44.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.295+0000 7f96ce9ec640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f96b007af80 0x7f96b007d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005e10 tx=0x7f96b8005da0 comp rx=0 tx=0).stop 2024-09-18T12:55:44.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.295+0000 7f96ce9ec640 1 -- 172.21.15.45:0/2618608668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c8104d80 msgr2=0x7f96c81979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:44.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.295+0000 7f96ce9ec640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c8104d80 0x7f96c81979e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f96bc006010 tx=0x7f96bc0048f0 comp rx=0 tx=0).stop 2024-09-18T12:55:44.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.295+0000 7f96ce9ec640 1 -- 172.21.15.45:0/2618608668 shutdown_connections 2024-09-18T12:55:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.295+0000 7f96ce9ec640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f96b007af80 0x7f96b007d440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.295+0000 7f96ce9ec640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c8104d80 0x7f96c81979e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.295+0000 7f96ce9ec640 1 --2- 172.21.15.45:0/2618608668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96c8102450 0x7f96c81974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.295+0000 7f96ce9ec640 1 -- 172.21.15.45:0/2618608668 >> 172.21.15.45:0/2618608668 conn(0x7f96c80fc010 msgr2=0x7f96c80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.296+0000 7f96ce9ec640 1 -- 172.21.15.45:0/2618608668 shutdown_connections 2024-09-18T12:55:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:44.296+0000 7f96ce9ec640 1 -- 172.21.15.45:0/2618608668 wait complete. 2024-09-18T12:55:45.627 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:45 smithi045 ceph-mon[28315]: pgmap v89: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:45.628 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:45 smithi045 ceph-mon[28315]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:45.663 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-18T12:55:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:45 smithi161 ceph-mon[35784]: pgmap v89: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:45 smithi161 ceph-mon[35784]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:45.973 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:55:46.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.421+0000 7f16ac18b640 1 -- 172.21.15.45:0/2388091954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a41033f0 msgr2=0x7f16a410b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.421+0000 7f16ac18b640 1 --2- 172.21.15.45:0/2388091954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a41033f0 0x7f16a410b8e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1694009880 tx=0x7f169402a530 comp rx=0 tx=0).stop 2024-09-18T12:55:46.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.422+0000 7f16ac18b640 1 -- 172.21.15.45:0/2388091954 shutdown_connections 2024-09-18T12:55:46.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.422+0000 7f16ac18b640 1 --2- 172.21.15.45:0/2388091954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a41033f0 0x7f16a410b8e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.422+0000 7f16ac18b640 1 --2- 172.21.15.45:0/2388091954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a4102ad0 0x7f16a4102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.422+0000 7f16ac18b640 1 -- 172.21.15.45:0/2388091954 >> 172.21.15.45:0/2388091954 conn(0x7f16a40fc510 msgr2=0x7f16a40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.422+0000 7f16ac18b640 1 -- 172.21.15.45:0/2388091954 shutdown_connections 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.422+0000 7f16ac18b640 1 -- 172.21.15.45:0/2388091954 wait complete. 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16ac18b640 1 Processor -- start 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16ac18b640 1 -- start start 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16ac18b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a4102ad0 0x7f16a419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16ac18b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a41033f0 0x7f16a419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16ac18b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410ee00 con 0x7f16a4102ad0 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16ac18b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410ec80 con 0x7f16a41033f0 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16a9f27640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a4102ad0 0x7f16a419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16a9f27640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a4102ad0 0x7f16a419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59770/0 (socket says 172.21.15.45:59770) 2024-09-18T12:55:46.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16a9f27640 1 -- 172.21.15.45:0/2206111109 learned_addr learned my addr 172.21.15.45:0/2206111109 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:46.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16a9726640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a41033f0 0x7f16a419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:46.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16a9f27640 1 -- 172.21.15.45:0/2206111109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a41033f0 msgr2=0x7f16a419dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.423+0000 7f16a9f27640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a41033f0 0x7f16a419dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.424+0000 7f16a9f27640 1 -- 172.21.15.45:0/2206111109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a41977f0 con 0x7f16a4102ad0 2024-09-18T12:55:46.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.424+0000 7f16a9f27640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a4102ad0 0x7f16a419d670 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f16a000d6f0 tx=0x7f16a000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:46.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.424+0000 7f169affd640 1 -- 172.21.15.45:0/2206111109 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16a0017070 con 0x7f16a4102ad0 2024-09-18T12:55:46.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.424+0000 7f16ac18b640 1 -- 172.21.15.45:0/2206111109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a4197ae0 con 0x7f16a4102ad0 2024-09-18T12:55:46.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.424+0000 7f169affd640 1 -- 172.21.15.45:0/2206111109 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16a000de00 con 0x7f16a4102ad0 2024-09-18T12:55:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.424+0000 7f169affd640 1 -- 172.21.15.45:0/2206111109 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16a0004bb0 con 0x7f16a4102ad0 2024-09-18T12:55:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.424+0000 7f16ac18b640 1 -- 172.21.15.45:0/2206111109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a4198040 con 0x7f16a4102ad0 2024-09-18T12:55:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.425+0000 7f16ac18b640 1 -- 172.21.15.45:0/2206111109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a406ada0 con 0x7f16a4102ad0 2024-09-18T12:55:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.426+0000 7f169affd640 1 -- 172.21.15.45:0/2206111109 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f16a0004e60 con 0x7f16a4102ad0 2024-09-18T12:55:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.426+0000 7f169affd640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f169007af40 0x7f169007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.426+0000 7f169affd640 1 -- 172.21.15.45:0/2206111109 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f16a009dc00 con 0x7f16a4102ad0 2024-09-18T12:55:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.426+0000 7f16a9726640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f169007af40 0x7f169007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.427+0000 7f16a9726640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f169007af40 0x7f169007d400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16a4198b40 tx=0x7f16940095c0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.431+0000 7f169affd640 1 -- 172.21.15.45:0/2206111109 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f16a00a3020 con 0x7f16a4102ad0 2024-09-18T12:55:46.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.694+0000 7f16ac18b640 1 -- 172.21.15.45:0/2206111109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f16a4105f70 con 0x7f16a4102ad0 2024-09-18T12:55:46.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.695+0000 7f169affd640 1 -- 172.21.15.45:0/2206111109 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f16a0069250 con 0x7f16a4102ad0 2024-09-18T12:55:46.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 -- 172.21.15.45:0/2206111109 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f169007af40 msgr2=0x7f169007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f169007af40 0x7f169007d400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16a4198b40 tx=0x7f16940095c0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 -- 172.21.15.45:0/2206111109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a4102ad0 msgr2=0x7f16a419d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a4102ad0 0x7f16a419d670 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f16a000d6f0 tx=0x7f16a000dbb0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 -- 172.21.15.45:0/2206111109 shutdown_connections 2024-09-18T12:55:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f169007af40 0x7f169007d400 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16a41033f0 0x7f16a419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 --2- 172.21.15.45:0/2206111109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a4102ad0 0x7f16a419d670 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 -- 172.21.15.45:0/2206111109 >> 172.21.15.45:0/2206111109 conn(0x7f16a40fc510 msgr2=0x7f16a4108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 -- 172.21.15.45:0/2206111109 shutdown_connections 2024-09-18T12:55:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:46.697+0000 7f16ac18b640 1 -- 172.21.15.45:0/2206111109 wait complete. 2024-09-18T12:55:46.707 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:55:47.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-18T12:55:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:55:47.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:47 smithi045 ceph-mon[28315]: pgmap v90: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:47.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:47 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2206111109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:47 smithi161 ceph-mon[35784]: pgmap v90: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:47 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2206111109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.943+0000 7f5b13147640 1 -- 172.21.15.45:0/2613206279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b0c106800 msgr2=0x7f5b0c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.943+0000 7f5b13147640 1 --2- 172.21.15.45:0/2613206279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b0c106800 0x7f5b0c106be0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009880 tx=0x7f5b0002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.943+0000 7f5b13147640 1 -- 172.21.15.45:0/2613206279 shutdown_connections 2024-09-18T12:55:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.943+0000 7f5b13147640 1 --2- 172.21.15.45:0/2613206279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b0c100800 0x7f5b0c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.943+0000 7f5b13147640 1 --2- 172.21.15.45:0/2613206279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b0c106800 0x7f5b0c106be0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.943+0000 7f5b13147640 1 -- 172.21.15.45:0/2613206279 >> 172.21.15.45:0/2613206279 conn(0x7f5b0c0fc520 msgr2=0x7f5b0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.943+0000 7f5b13147640 1 -- 172.21.15.45:0/2613206279 shutdown_connections 2024-09-18T12:55:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.943+0000 7f5b13147640 1 -- 172.21.15.45:0/2613206279 wait complete. 2024-09-18T12:55:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.944+0000 7f5b13147640 1 Processor -- start 2024-09-18T12:55:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.944+0000 7f5b13147640 1 -- start start 2024-09-18T12:55:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.944+0000 7f5b13147640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b0c100800 0x7f5b0c107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.944+0000 7f5b13147640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b0c106800 0x7f5b0c107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.944+0000 7f5b13147640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c10dcb0 con 0x7f5b0c100800 2024-09-18T12:55:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.944+0000 7f5b13147640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c10db30 con 0x7f5b0c106800 2024-09-18T12:55:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.944+0000 7f5b10ee3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b0c100800 0x7f5b0c107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.944+0000 7f5b10ee3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b0c100800 0x7f5b0c107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59794/0 (socket says 172.21.15.45:59794) 2024-09-18T12:55:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.944+0000 7f5b10ee3640 1 -- 172.21.15.45:0/154187318 learned_addr learned my addr 172.21.15.45:0/154187318 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.945+0000 7f5b0bfff640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b0c106800 0x7f5b0c107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.945+0000 7f5b10ee3640 1 -- 172.21.15.45:0/154187318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b0c106800 msgr2=0x7f5b0c107c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.945+0000 7f5b10ee3640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b0c106800 0x7f5b0c107c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.945+0000 7f5b10ee3640 1 -- 172.21.15.45:0/154187318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c1081b0 con 0x7f5b0c100800 2024-09-18T12:55:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.945+0000 7f5b10ee3640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b0c100800 0x7f5b0c107730 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5b00031460 tx=0x7f5b000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.945+0000 7f5b09ffb640 1 -- 172.21.15.45:0/154187318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b0003f070 con 0x7f5b0c100800 2024-09-18T12:55:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.945+0000 7f5b09ffb640 1 -- 172.21.15.45:0/154187318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b00004cf0 con 0x7f5b0c100800 2024-09-18T12:55:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.945+0000 7f5b13147640 1 -- 172.21.15.45:0/154187318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0c108440 con 0x7f5b0c100800 2024-09-18T12:55:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.945+0000 7f5b09ffb640 1 -- 172.21.15.45:0/154187318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b00035030 con 0x7f5b0c100800 2024-09-18T12:55:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.945+0000 7f5b13147640 1 -- 172.21.15.45:0/154187318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0c1a3db0 con 0x7f5b0c100800 2024-09-18T12:55:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.946+0000 7f5b13147640 1 -- 172.21.15.45:0/154187318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0c101f40 con 0x7f5b0c100800 2024-09-18T12:55:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.947+0000 7f5b09ffb640 1 -- 172.21.15.45:0/154187318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f5b00042070 con 0x7f5b0c100800 2024-09-18T12:55:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.948+0000 7f5b09ffb640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5afc07af80 0x7f5afc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.948+0000 7f5b09ffb640 1 -- 172.21.15.45:0/154187318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f5b000bea40 con 0x7f5b0c100800 2024-09-18T12:55:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.948+0000 7f5b0bfff640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5afc07af80 0x7f5afc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.948+0000 7f5b0bfff640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5afc07af80 0x7f5afc07d440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5af8005e10 tx=0x7f5af8005da0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:47.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:47.952+0000 7f5b09ffb640 1 -- 172.21.15.45:0/154187318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f5b0008a070 con 0x7f5b0c100800 2024-09-18T12:55:48.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.209+0000 7f5b13147640 1 -- 172.21.15.45:0/154187318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5b0c1a4010 con 0x7f5b0c100800 2024-09-18T12:55:48.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.210+0000 7f5b09ffb640 1 -- 172.21.15.45:0/154187318 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f5b0008ef20 con 0x7f5b0c100800 2024-09-18T12:55:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 -- 172.21.15.45:0/154187318 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5afc07af80 msgr2=0x7f5afc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5afc07af80 0x7f5afc07d440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5af8005e10 tx=0x7f5af8005da0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 -- 172.21.15.45:0/154187318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b0c100800 msgr2=0x7f5b0c107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b0c100800 0x7f5b0c107730 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5b00031460 tx=0x7f5b000048f0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 -- 172.21.15.45:0/154187318 shutdown_connections 2024-09-18T12:55:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5afc07af80 0x7f5afc07d440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b0c106800 0x7f5b0c107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 --2- 172.21.15.45:0/154187318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b0c100800 0x7f5b0c107730 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 -- 172.21.15.45:0/154187318 >> 172.21.15.45:0/154187318 conn(0x7f5b0c0fc520 msgr2=0x7f5b0c06a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 -- 172.21.15.45:0/154187318 shutdown_connections 2024-09-18T12:55:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:48.212+0000 7f5b13147640 1 -- 172.21.15.45:0/154187318 wait complete. 2024-09-18T12:55:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)" 2024-09-18T12:55:48.472 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:48 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/154187318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:48.693 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:48 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/154187318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:48.822 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-18T12:55:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:55:49.447 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:49 smithi045 ceph-mon[28315]: pgmap v91: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.528+0000 7efc3d1ee640 1 -- 172.21.15.45:0/942473936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc38100800 msgr2=0x7efc38100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.528+0000 7efc3d1ee640 1 --2- 172.21.15.45:0/942473936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc38100800 0x7efc38100c60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7efc20009880 tx=0x7efc2002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.528+0000 7efc3d1ee640 1 -- 172.21.15.45:0/942473936 shutdown_connections 2024-09-18T12:55:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.528+0000 7efc3d1ee640 1 --2- 172.21.15.45:0/942473936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc38100800 0x7efc38100c60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.528+0000 7efc3d1ee640 1 --2- 172.21.15.45:0/942473936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc38106800 0x7efc38106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.528+0000 7efc3d1ee640 1 -- 172.21.15.45:0/942473936 >> 172.21.15.45:0/942473936 conn(0x7efc380fc520 msgr2=0x7efc380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.528+0000 7efc3d1ee640 1 -- 172.21.15.45:0/942473936 shutdown_connections 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.528+0000 7efc3d1ee640 1 -- 172.21.15.45:0/942473936 wait complete. 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.529+0000 7efc3d1ee640 1 Processor -- start 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.529+0000 7efc3d1ee640 1 -- start start 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.529+0000 7efc3d1ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc38100800 0x7efc380fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.529+0000 7efc3d1ee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc38106800 0x7efc380fd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.529+0000 7efc3d1ee640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efc3810dcb0 con 0x7efc38100800 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.529+0000 7efc3d1ee640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7efc3810db30 con 0x7efc38106800 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.529+0000 7efc36d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc38100800 0x7efc380fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc36d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc38100800 0x7efc380fcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59806/0 (socket says 172.21.15.45:59806) 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc36d9d640 1 -- 172.21.15.45:0/2778144874 learned_addr learned my addr 172.21.15.45:0/2778144874 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc3659c640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc38106800 0x7efc380fd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc36d9d640 1 -- 172.21.15.45:0/2778144874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc38106800 msgr2=0x7efc380fd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc36d9d640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc38106800 0x7efc380fd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc36d9d640 1 -- 172.21.15.45:0/2778144874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc380fd630 con 0x7efc38100800 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc36d9d640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc38100800 0x7efc380fcbb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efc3000c810 tx=0x7efc3000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc2ffff640 1 -- 172.21.15.45:0/2778144874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc30004020 con 0x7efc38100800 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc2ffff640 1 -- 172.21.15.45:0/2778144874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efc300041c0 con 0x7efc38100800 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc3d1ee640 1 -- 172.21.15.45:0/2778144874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc380fd920 con 0x7efc38100800 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc2ffff640 1 -- 172.21.15.45:0/2778144874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc300047a0 con 0x7efc38100800 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.530+0000 7efc3d1ee640 1 -- 172.21.15.45:0/2778144874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc381a3e60 con 0x7efc38100800 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.531+0000 7efc3d1ee640 1 -- 172.21.15.45:0/2778144874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc38101f40 con 0x7efc38100800 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.532+0000 7efc2ffff640 1 -- 172.21.15.45:0/2778144874 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7efc300079b0 con 0x7efc38100800 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.533+0000 7efc2ffff640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efc2407af30 0x7efc2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.533+0000 7efc3659c640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efc2407af30 0x7efc2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.533+0000 7efc2ffff640 1 -- 172.21.15.45:0/2778144874 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7efc3009dec0 con 0x7efc38100800 2024-09-18T12:55:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.533+0000 7efc3659c640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efc2407af30 0x7efc2407d3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efc380fe640 tx=0x7efc20031420 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.537+0000 7efc2ffff640 1 -- 172.21.15.45:0/2778144874 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7efc30014030 con 0x7efc38100800 2024-09-18T12:55:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:49 smithi161 ceph-mon[35784]: pgmap v91: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:49.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.796+0000 7efc3d1ee640 1 -- 172.21.15.45:0/2778144874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efc38109da0 con 0x7efc38100800 2024-09-18T12:55:49.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.796+0000 7efc2ffff640 1 -- 172.21.15.45:0/2778144874 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7efc30069510 con 0x7efc38100800 2024-09-18T12:55:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.798+0000 7efc3d1ee640 1 -- 172.21.15.45:0/2778144874 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efc2407af30 msgr2=0x7efc2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.798+0000 7efc3d1ee640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efc2407af30 0x7efc2407d3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efc380fe640 tx=0x7efc20031420 comp rx=0 tx=0).stop 2024-09-18T12:55:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.798+0000 7efc3d1ee640 1 -- 172.21.15.45:0/2778144874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc38100800 msgr2=0x7efc380fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.798+0000 7efc3d1ee640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc38100800 0x7efc380fcbb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efc3000c810 tx=0x7efc3000ccd0 comp rx=0 tx=0).stop 2024-09-18T12:55:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.798+0000 7efc3d1ee640 1 -- 172.21.15.45:0/2778144874 shutdown_connections 2024-09-18T12:55:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.798+0000 7efc3d1ee640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efc2407af30 0x7efc2407d3f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.798+0000 7efc3d1ee640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc38106800 0x7efc380fd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.798+0000 7efc3d1ee640 1 --2- 172.21.15.45:0/2778144874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc38100800 0x7efc380fcbb0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.798+0000 7efc3d1ee640 1 -- 172.21.15.45:0/2778144874 >> 172.21.15.45:0/2778144874 conn(0x7efc380fc520 msgr2=0x7efc3806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.799+0000 7efc3d1ee640 1 -- 172.21.15.45:0/2778144874 shutdown_connections 2024-09-18T12:55:49.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:49.799+0000 7efc3d1ee640 1 -- 172.21.15.45:0/2778144874 wait complete. 2024-09-18T12:55:49.809 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:55:50.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-18T12:55:50.681 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:55:50.698 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:50 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2778144874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:50.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:50 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2778144874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:55:51.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.124+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/556000455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1b4100640 msgr2=0x7fd1b4100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:51.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.124+0000 7fd1bb2e8640 1 --2- 172.21.15.45:0/556000455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1b4100640 0x7fd1b4100a20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009880 tx=0x7fd1b002a490 comp rx=0 tx=0).stop 2024-09-18T12:55:51.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.124+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/556000455 shutdown_connections 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.124+0000 7fd1bb2e8640 1 --2- 172.21.15.45:0/556000455 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1b4100ff0 0x7fd1b410dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.124+0000 7fd1bb2e8640 1 --2- 172.21.15.45:0/556000455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1b4100640 0x7fd1b4100a20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.124+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/556000455 >> 172.21.15.45:0/556000455 conn(0x7fd1b40fc550 msgr2=0x7fd1b40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.124+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/556000455 shutdown_connections 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.124+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/556000455 wait complete. 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1bb2e8640 1 Processor -- start 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1bb2e8640 1 -- start start 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1bb2e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1b4100640 0x7fd1b419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1bb2e8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1b4100ff0 0x7fd1b419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1bb2e8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4110ff0 con 0x7fd1b4100640 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1bb2e8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4110e70 con 0x7fd1b4100ff0 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1b9084640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1b4100640 0x7fd1b419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:51.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1b9084640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1b4100640 0x7fd1b419f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59812/0 (socket says 172.21.15.45:59812) 2024-09-18T12:55:51.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1b9084640 1 -- 172.21.15.45:0/2043368890 learned_addr learned my addr 172.21.15.45:0/2043368890 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:51.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1b8883640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1b4100ff0 0x7fd1b419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:51.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1b9084640 1 -- 172.21.15.45:0/2043368890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1b4100ff0 msgr2=0x7fd1b419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:51.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1b9084640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1b4100ff0 0x7fd1b419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:51.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.125+0000 7fd1b9084640 1 -- 172.21.15.45:0/2043368890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b4199a20 con 0x7fd1b4100640 2024-09-18T12:55:51.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.126+0000 7fd1b9084640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1b4100640 0x7fd1b419f860 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0031460 tx=0x7fd1b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:51.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.126+0000 7fd1aa7fc640 1 -- 172.21.15.45:0/2043368890 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1b003f070 con 0x7fd1b4100640 2024-09-18T12:55:51.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.126+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/2043368890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b4199cb0 con 0x7fd1b4100640 2024-09-18T12:55:51.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.126+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/2043368890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b419a240 con 0x7fd1b4100640 2024-09-18T12:55:51.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.126+0000 7fd1aa7fc640 1 -- 172.21.15.45:0/2043368890 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1b0004cf0 con 0x7fd1b4100640 2024-09-18T12:55:51.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.126+0000 7fd1aa7fc640 1 -- 172.21.15.45:0/2043368890 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1b0035030 con 0x7fd1b4100640 2024-09-18T12:55:51.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.127+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/2043368890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd198005290 con 0x7fd1b4100640 2024-09-18T12:55:51.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.128+0000 7fd1aa7fc640 1 -- 172.21.15.45:0/2043368890 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fd1b0042070 con 0x7fd1b4100640 2024-09-18T12:55:51.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.128+0000 7fd1aa7fc640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1a007af80 0x7fd1a007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:51.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.128+0000 7fd1aa7fc640 1 -- 172.21.15.45:0/2043368890 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fd1b00be960 con 0x7fd1b4100640 2024-09-18T12:55:51.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.128+0000 7fd1b8883640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1a007af80 0x7fd1a007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:51.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.129+0000 7fd1b8883640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1a007af80 0x7fd1a007d440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40fefb0 tx=0x7fd1a4008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:51.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.133+0000 7fd1aa7fc640 1 -- 172.21.15.45:0/2043368890 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fd1b008a030 con 0x7fd1b4100640 2024-09-18T12:55:51.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:51.338+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/2043368890 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}) -- 0x7fd198000c60 con 0x7fd1a007af80 2024-09-18T12:55:51.717 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:51 smithi045 ceph-mon[28315]: pgmap v92: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:51 smithi161 ceph-mon[35784]: pgmap v92: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:52.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:52 smithi045 ceph-mon[28315]: from='client.14924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:52.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:52 smithi161 ceph-mon[35784]: from='client.14924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:53.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.223+0000 7fd1aa7fc640 1 -- 172.21.15.45:0/2043368890 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7fd198000c60 con 0x7fd1a007af80 2024-09-18T12:55:53.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/2043368890 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1a007af80 msgr2=0x7fd1a007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:53.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1a007af80 0x7fd1a007d440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40fefb0 tx=0x7fd1a4008040 comp rx=0 tx=0).stop 2024-09-18T12:55:53.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/2043368890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1b4100640 msgr2=0x7fd1b419f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:53.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1b4100640 0x7fd1b419f860 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0031460 tx=0x7fd1b00048f0 comp rx=0 tx=0).stop 2024-09-18T12:55:53.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/2043368890 shutdown_connections 2024-09-18T12:55:53.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd1a007af80 0x7fd1a007d440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:53.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1b4100ff0 0x7fd1b419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:53.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 --2- 172.21.15.45:0/2043368890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1b4100640 0x7fd1b419f860 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:53.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/2043368890 >> 172.21.15.45:0/2043368890 conn(0x7fd1b40fc550 msgr2=0x7fd1b40fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:53.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/2043368890 shutdown_connections 2024-09-18T12:55:53.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:53.226+0000 7fd1bb2e8640 1 -- 172.21.15.45:0/2043368890 wait complete. 2024-09-18T12:55:53.237 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:55:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:53 smithi045 ceph-mon[28315]: pgmap v93: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:53 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:55:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:53 smithi161 ceph-mon[35784]: pgmap v93: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:53 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:55:53.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch ps' 2024-09-18T12:55:54.155 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:55:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.623+0000 7f7a0181a640 1 -- 172.21.15.45:0/3721615059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79fc1067f0 msgr2=0x7f79fc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.623+0000 7f7a0181a640 1 --2- 172.21.15.45:0/3721615059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79fc1067f0 0x7f79fc106bd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009c20 tx=0x7f79ec02a970 comp rx=0 tx=0).stop 2024-09-18T12:55:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.623+0000 7f7a0181a640 1 -- 172.21.15.45:0/3721615059 shutdown_connections 2024-09-18T12:55:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.623+0000 7f7a0181a640 1 --2- 172.21.15.45:0/3721615059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79fc1007f0 0x7f79fc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.623+0000 7f7a0181a640 1 --2- 172.21.15.45:0/3721615059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79fc1067f0 0x7f79fc106bd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.623+0000 7f7a0181a640 1 -- 172.21.15.45:0/3721615059 >> 172.21.15.45:0/3721615059 conn(0x7f79fc0fc4d0 msgr2=0x7f79fc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.623+0000 7f7a0181a640 1 -- 172.21.15.45:0/3721615059 shutdown_connections 2024-09-18T12:55:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.623+0000 7f7a0181a640 1 -- 172.21.15.45:0/3721615059 wait complete. 2024-09-18T12:55:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f7a0181a640 1 Processor -- start 2024-09-18T12:55:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f7a0181a640 1 -- start start 2024-09-18T12:55:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f7a0181a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79fc1007f0 0x7f79fc19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f7a0181a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79fc1067f0 0x7f79fc19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f7a0181a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc10dca0 con 0x7f79fc1067f0 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f7a0181a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc10db20 con 0x7f79fc1007f0 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f79fa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79fc1067f0 0x7f79fc19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f79fa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79fc1067f0 0x7f79fc19cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51462/0 (socket says 172.21.15.45:51462) 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f79fa7fc640 1 -- 172.21.15.45:0/3595572093 learned_addr learned my addr 172.21.15.45:0/3595572093 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f79faffd640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79fc1007f0 0x7f79fc19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f79fa7fc640 1 -- 172.21.15.45:0/3595572093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79fc1007f0 msgr2=0x7f79fc19c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f79fa7fc640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79fc1007f0 0x7f79fc19c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.624+0000 7f79fa7fc640 1 -- 172.21.15.45:0/3595572093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc1966d0 con 0x7f79fc1067f0 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.625+0000 7f79fa7fc640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79fc1067f0 0x7f79fc19cb40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f79f000d8d0 tx=0x7f79f000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.625+0000 7f7a00818640 1 -- 172.21.15.45:0/3595572093 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79f0017070 con 0x7f79fc1067f0 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.625+0000 7f7a0181a640 1 -- 172.21.15.45:0/3595572093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79fc1969c0 con 0x7f79fc1067f0 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.625+0000 7f7a00818640 1 -- 172.21.15.45:0/3595572093 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79f0010460 con 0x7f79fc1067f0 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.625+0000 7f7a0181a640 1 -- 172.21.15.45:0/3595572093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79fc196f20 con 0x7f79fc1067f0 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.625+0000 7f7a00818640 1 -- 172.21.15.45:0/3595572093 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79f0020060 con 0x7f79fc1067f0 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.626+0000 7f7a0181a640 1 -- 172.21.15.45:0/3595572093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79fc101f30 con 0x7f79fc1067f0 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.627+0000 7f7a00818640 1 -- 172.21.15.45:0/3595572093 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f79f0009a30 con 0x7f79fc1067f0 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.627+0000 7f7a00818640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79e407af30 0x7f79e407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.627+0000 7f79faffd640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79e407af30 0x7f79e407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.627+0000 7f7a00818640 1 -- 172.21.15.45:0/3595572093 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f79f009df20 con 0x7f79fc1067f0 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.628+0000 7f79faffd640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79e407af30 0x7f79e407d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009430 tx=0x7f79ec03c040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:54.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.632+0000 7f7a00818640 1 -- 172.21.15.45:0/3595572093 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f79f0069570 con 0x7f79fc1067f0 2024-09-18T12:55:54.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.823+0000 7f7a0181a640 1 -- 172.21.15.45:0/3595572093 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f79fc1971d0 con 0x7f79e407af30 2024-09-18T12:55:54.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.834+0000 7f7a00818640 1 -- 172.21.15.45:0/3595572093 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f79fc1971d0 con 0x7f79e407af30 2024-09-18T12:55:54.836 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:55:54.836 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (59s) 31s ago 11m 17.2M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T12:55:54.836 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (4m) 31s ago 12m 8740k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:55:54.836 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (3m) 100s ago 11m 8144k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:55:54.836 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (12m) 31s ago 12m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:55:54.836 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (11m) 100s ago 11m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:55:54.836 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (37s) 31s ago 11m 49.9M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (6m) 31s ago 6m 91.9M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (6m) 31s ago 6m 151M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (6m) 100s ago 6m 16.3M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (6m) 100s ago 6m 14.7M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (3m) 31s ago 13m 522M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (2m) 100s ago 11m 454M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (13m) 31s ago 13m 59.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (11m) 100s ago 10m 48.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (109s) 31s ago 11m 9470k - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (103s) 100s ago 11m 3338k - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (9m) 31s ago 9m 205M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (9m) 31s ago 9m 224M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (8m) 31s ago 8m 185M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:55:54.837 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (8m) 100s ago 8m 239M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:55:54.838 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (8m) 100s ago 7m 213M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:55:54.838 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (7m) 100s ago 7m 197M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:55:54.838 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (80s) 31s ago 11m 45.3M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 -- 172.21.15.45:0/3595572093 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79e407af30 msgr2=0x7f79e407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79e407af30 0x7f79e407d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009430 tx=0x7f79ec03c040 comp rx=0 tx=0).stop 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 -- 172.21.15.45:0/3595572093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79fc1067f0 msgr2=0x7f79fc19cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79fc1067f0 0x7f79fc19cb40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f79f000d8d0 tx=0x7f79f000dd90 comp rx=0 tx=0).stop 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 -- 172.21.15.45:0/3595572093 shutdown_connections 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f79e407af30 0x7f79e407d3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79fc1067f0 0x7f79fc19cb40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 --2- 172.21.15.45:0/3595572093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79fc1007f0 0x7f79fc19c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 -- 172.21.15.45:0/3595572093 >> 172.21.15.45:0/3595572093 conn(0x7f79fc0fc4d0 msgr2=0x7f79fc0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 -- 172.21.15.45:0/3595572093 shutdown_connections 2024-09-18T12:55:54.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:54.837+0000 7f7a0181a640 1 -- 172.21.15.45:0/3595572093 wait complete. 2024-09-18T12:55:55.510 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:55:55.511 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:55:55.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-18T12:55:55.537 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:55 smithi045 ceph-mon[28315]: pgmap v94: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:55.773 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:55:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:55 smithi161 ceph-mon[35784]: pgmap v94: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:56.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.235+0000 7f55cf14f640 1 -- 172.21.15.45:0/3101634656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55c8106800 msgr2=0x7f55c8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.235+0000 7f55cf14f640 1 --2- 172.21.15.45:0/3101634656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55c8106800 0x7f55c8106be0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009880 tx=0x7f55bc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.235+0000 7f55cf14f640 1 -- 172.21.15.45:0/3101634656 shutdown_connections 2024-09-18T12:55:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.235+0000 7f55cf14f640 1 --2- 172.21.15.45:0/3101634656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55c8100800 0x7f55c8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.235+0000 7f55cf14f640 1 --2- 172.21.15.45:0/3101634656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55c8106800 0x7f55c8106be0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.235+0000 7f55cf14f640 1 -- 172.21.15.45:0/3101634656 >> 172.21.15.45:0/3101634656 conn(0x7f55c80fc520 msgr2=0x7f55c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.235+0000 7f55cf14f640 1 -- 172.21.15.45:0/3101634656 shutdown_connections 2024-09-18T12:55:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.235+0000 7f55cf14f640 1 -- 172.21.15.45:0/3101634656 wait complete. 2024-09-18T12:55:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.236+0000 7f55cf14f640 1 Processor -- start 2024-09-18T12:55:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.236+0000 7f55cf14f640 1 -- start start 2024-09-18T12:55:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.236+0000 7f55cf14f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55c8100800 0x7f55c819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.236+0000 7f55cf14f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55c8106800 0x7f55c819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.236+0000 7f55cf14f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f55c810dcb0 con 0x7f55c8106800 2024-09-18T12:55:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.236+0000 7f55cf14f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f55c810db30 con 0x7f55c8100800 2024-09-18T12:55:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.236+0000 7f55c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55c8106800 0x7f55c819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.236+0000 7f55c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55c8106800 0x7f55c819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51486/0 (socket says 172.21.15.45:51486) 2024-09-18T12:55:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.236+0000 7f55c7fff640 1 -- 172.21.15.45:0/2023703529 learned_addr learned my addr 172.21.15.45:0/2023703529 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.237+0000 7f55cceeb640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55c8100800 0x7f55c819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.237+0000 7f55c7fff640 1 -- 172.21.15.45:0/2023703529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55c8100800 msgr2=0x7f55c819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.237+0000 7f55c7fff640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55c8100800 0x7f55c819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.237+0000 7f55c7fff640 1 -- 172.21.15.45:0/2023703529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c81977e0 con 0x7f55c8106800 2024-09-18T12:55:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.237+0000 7f55c7fff640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55c8106800 0x7f55c819dba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f55b400c8a0 tx=0x7f55b400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.237+0000 7f55c5ffb640 1 -- 172.21.15.45:0/2023703529 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f55b40079b0 con 0x7f55c8106800 2024-09-18T12:55:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.237+0000 7f55c5ffb640 1 -- 172.21.15.45:0/2023703529 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55b4007b50 con 0x7f55c8106800 2024-09-18T12:55:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.237+0000 7f55cf14f640 1 -- 172.21.15.45:0/2023703529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c8197ad0 con 0x7f55c8106800 2024-09-18T12:55:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.237+0000 7f55c5ffb640 1 -- 172.21.15.45:0/2023703529 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f55b4018700 con 0x7f55c8106800 2024-09-18T12:55:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.237+0000 7f55cf14f640 1 -- 172.21.15.45:0/2023703529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c8198060 con 0x7f55c8106800 2024-09-18T12:55:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.238+0000 7f55cf14f640 1 -- 172.21.15.45:0/2023703529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c8101f40 con 0x7f55c8106800 2024-09-18T12:55:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.239+0000 7f55c5ffb640 1 -- 172.21.15.45:0/2023703529 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f55b4007d00 con 0x7f55c8106800 2024-09-18T12:55:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.239+0000 7f55c5ffb640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f55b807af40 0x7f55b807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.239+0000 7f55c5ffb640 1 -- 172.21.15.45:0/2023703529 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f55b409e270 con 0x7f55c8106800 2024-09-18T12:55:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.239+0000 7f55cceeb640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f55b807af40 0x7f55b807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.240+0000 7f55cceeb640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f55b807af40 0x7f55b807d400 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f55bc000c00 tx=0x7f55bc031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.244+0000 7f55c5ffb640 1 -- 172.21.15.45:0/2023703529 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f55b4014030 con 0x7f55c8106800 2024-09-18T12:55:56.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.430+0000 7f55cf14f640 1 -- 172.21.15.45:0/2023703529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7f55c8198370 con 0x7f55c8106800 2024-09-18T12:55:56.432 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:56 smithi045 ceph-mon[28315]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:56.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.433+0000 7f55c5ffb640 1 -- 172.21.15.45:0/2023703529 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v66)=0 v66) ==== 125+0+0 (secure 0 0 0) 0x7f55b4069820 con 0x7f55c8106800 2024-09-18T12:55:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 -- 172.21.15.45:0/2023703529 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f55b807af40 msgr2=0x7f55b807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f55b807af40 0x7f55b807d400 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f55bc000c00 tx=0x7f55bc031400 comp rx=0 tx=0).stop 2024-09-18T12:55:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 -- 172.21.15.45:0/2023703529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55c8106800 msgr2=0x7f55c819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55c8106800 0x7f55c819dba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f55b400c8a0 tx=0x7f55b400cd60 comp rx=0 tx=0).stop 2024-09-18T12:55:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 -- 172.21.15.45:0/2023703529 shutdown_connections 2024-09-18T12:55:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f55b807af40 0x7f55b807d400 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55c8106800 0x7f55c819dba0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 --2- 172.21.15.45:0/2023703529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55c8100800 0x7f55c819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 -- 172.21.15.45:0/2023703529 >> 172.21.15.45:0/2023703529 conn(0x7f55c80fc520 msgr2=0x7f55c806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 -- 172.21.15.45:0/2023703529 shutdown_connections 2024-09-18T12:55:56.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:56.436+0000 7f55cf14f640 1 -- 172.21.15.45:0/2023703529 wait complete. 2024-09-18T12:55:56.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:56 smithi161 ceph-mon[35784]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:55:57.077 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:55:57.078 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:55:57.078 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-18T12:55:57.382 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:55:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:57 smithi045 ceph-mon[28315]: pgmap v95: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:57 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/2023703529' entity='client.admin' 2024-09-18T12:55:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:57 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:57.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:57 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:55:57.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:57 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:55:57.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:57 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:57.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:57 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:55:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:57 smithi161 ceph-mon[35784]: pgmap v95: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:55:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:57 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/2023703529' entity='client.admin' 2024-09-18T12:55:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:57 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:55:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:57 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:55:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:57 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:55:57.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:57 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:55:57.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:57 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:55:57.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.877+0000 7f101d9b8640 1 -- 172.21.15.45:0/1186345084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1018100800 msgr2=0x7f1018100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:57.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.877+0000 7f101d9b8640 1 --2- 172.21.15.45:0/1186345084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1018100800 0x7f1018100c60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f100c009880 tx=0x7f100c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:57.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.877+0000 7f101d9b8640 1 -- 172.21.15.45:0/1186345084 shutdown_connections 2024-09-18T12:55:57.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.877+0000 7f101d9b8640 1 --2- 172.21.15.45:0/1186345084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1018100800 0x7f1018100c60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:57.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.877+0000 7f101d9b8640 1 --2- 172.21.15.45:0/1186345084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1018106800 0x7f1018106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:57.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.877+0000 7f101d9b8640 1 -- 172.21.15.45:0/1186345084 >> 172.21.15.45:0/1186345084 conn(0x7f10180fc520 msgr2=0x7f10180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:57.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.877+0000 7f101d9b8640 1 -- 172.21.15.45:0/1186345084 shutdown_connections 2024-09-18T12:55:57.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.877+0000 7f101d9b8640 1 -- 172.21.15.45:0/1186345084 wait complete. 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.877+0000 7f101d9b8640 1 Processor -- start 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.877+0000 7f101d9b8640 1 -- start start 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f101d9b8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1018100800 0x7f10181023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f101d9b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1018106800 0x7f1018102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f101d9b8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f101810dd30 con 0x7f1018106800 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f101d9b8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f101810dbb0 con 0x7f1018100800 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f10167fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1018106800 0x7f1018102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f10167fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1018106800 0x7f1018102910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51506/0 (socket says 172.21.15.45:51506) 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f10167fc640 1 -- 172.21.15.45:0/1829310869 learned_addr learned my addr 172.21.15.45:0/1829310869 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f1016ffd640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1018100800 0x7f10181023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f10167fc640 1 -- 172.21.15.45:0/1829310869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1018100800 msgr2=0x7f10181023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f10167fc640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1018100800 0x7f10181023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:57.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f10167fc640 1 -- 172.21.15.45:0/1829310869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1018102e50 con 0x7f1018106800 2024-09-18T12:55:57.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f10167fc640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1018106800 0x7f1018102910 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f100c031460 tx=0x7f100c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:57.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.878+0000 7f101c9b6640 1 -- 172.21.15.45:0/1829310869 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f100c03f070 con 0x7f1018106800 2024-09-18T12:55:57.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.879+0000 7f101d9b8640 1 -- 172.21.15.45:0/1829310869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10181030e0 con 0x7f1018106800 2024-09-18T12:55:57.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.879+0000 7f101c9b6640 1 -- 172.21.15.45:0/1829310869 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f100c004cf0 con 0x7f1018106800 2024-09-18T12:55:57.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.879+0000 7f101c9b6640 1 -- 172.21.15.45:0/1829310869 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f100c035030 con 0x7f1018106800 2024-09-18T12:55:57.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.879+0000 7f101d9b8640 1 -- 172.21.15.45:0/1829310869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10181a3de0 con 0x7f1018106800 2024-09-18T12:55:57.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.880+0000 7f101d9b8640 1 -- 172.21.15.45:0/1829310869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1018101f40 con 0x7f1018106800 2024-09-18T12:55:57.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.880+0000 7f101c9b6640 1 -- 172.21.15.45:0/1829310869 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f100c042070 con 0x7f1018106800 2024-09-18T12:55:57.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.881+0000 7f101c9b6640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f100007af30 0x7f100007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:57.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.881+0000 7f1016ffd640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f100007af30 0x7f100007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:57.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.881+0000 7f101c9b6640 1 -- 172.21.15.45:0/1829310869 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f100c0beab0 con 0x7f1018106800 2024-09-18T12:55:57.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.882+0000 7f1016ffd640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f100007af30 0x7f100007d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f100800a810 tx=0x7f1008008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:57.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:57.886+0000 7f101c9b6640 1 -- 172.21.15.45:0/1829310869 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f100c08a100 con 0x7f1018106800 2024-09-18T12:55:58.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.068+0000 7f101d9b8640 1 -- 172.21.15.45:0/1829310869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f10181a4150 con 0x7f1018106800 2024-09-18T12:55:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.068+0000 7f101c9b6640 1 -- 172.21.15.45:0/1829310869 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v66)=0 v66) ==== 155+0+0 (secure 0 0 0) 0x7f100c08efb0 con 0x7f1018106800 2024-09-18T12:55:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 -- 172.21.15.45:0/1829310869 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f100007af30 msgr2=0x7f100007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f100007af30 0x7f100007d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f100800a810 tx=0x7f1008008040 comp rx=0 tx=0).stop 2024-09-18T12:55:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 -- 172.21.15.45:0/1829310869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1018106800 msgr2=0x7f1018102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1018106800 0x7f1018102910 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f100c031460 tx=0x7f100c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:55:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 -- 172.21.15.45:0/1829310869 shutdown_connections 2024-09-18T12:55:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f100007af30 0x7f100007d3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1018106800 0x7f1018102910 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 --2- 172.21.15.45:0/1829310869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1018100800 0x7f10181023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 -- 172.21.15.45:0/1829310869 >> 172.21.15.45:0/1829310869 conn(0x7f10180fc520 msgr2=0x7f10181045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 -- 172.21.15.45:0/1829310869 shutdown_connections 2024-09-18T12:55:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:58.071+0000 7f101d9b8640 1 -- 172.21.15.45:0/1829310869 wait complete. 2024-09-18T12:55:58.719 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:58 smithi045 ceph-mon[28315]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:55:58.754 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-18T12:55:58.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:58 smithi161 ceph-mon[35784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:55:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:55:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.434+0000 7f09433aa640 1 -- 172.21.15.45:0/2089901430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093c107900 msgr2=0x7f093c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.434+0000 7f09433aa640 1 --2- 172.21.15.45:0/2089901430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093c107900 0x7f093c107ce0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0938009880 tx=0x7f093802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:55:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.434+0000 7f09433aa640 1 -- 172.21.15.45:0/2089901430 shutdown_connections 2024-09-18T12:55:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.434+0000 7f09433aa640 1 --2- 172.21.15.45:0/2089901430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093c101900 0x7f093c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.434+0000 7f09433aa640 1 --2- 172.21.15.45:0/2089901430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093c107900 0x7f093c107ce0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.434+0000 7f09433aa640 1 -- 172.21.15.45:0/2089901430 >> 172.21.15.45:0/2089901430 conn(0x7f093c0fd600 msgr2=0x7f093c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.434+0000 7f09433aa640 1 -- 172.21.15.45:0/2089901430 shutdown_connections 2024-09-18T12:55:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.434+0000 7f09433aa640 1 -- 172.21.15.45:0/2089901430 wait complete. 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.435+0000 7f09433aa640 1 Processor -- start 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.435+0000 7f09433aa640 1 -- start start 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f09433aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093c101900 0x7f093c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f09433aa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093c107900 0x7f093c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f09433aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f093c10ee30 con 0x7f093c101900 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f09433aa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f093c10ecb0 con 0x7f093c107900 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f0941146640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093c101900 0x7f093c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f0941146640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093c101900 0x7f093c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51522/0 (socket says 172.21.15.45:51522) 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f0941146640 1 -- 172.21.15.45:0/2371240106 learned_addr learned my addr 172.21.15.45:0/2371240106 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f0941146640 1 -- 172.21.15.45:0/2371240106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093c107900 msgr2=0x7f093c19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f0940945640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093c107900 0x7f093c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f0941146640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093c107900 0x7f093c19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f0941146640 1 -- 172.21.15.45:0/2371240106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093c197840 con 0x7f093c101900 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f0940945640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093c107900 0x7f093c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f0941146640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093c101900 0x7f093c19d6c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0938031460 tx=0x7f09380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f09327fc640 1 -- 172.21.15.45:0/2371240106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f093803f070 con 0x7f093c101900 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f09327fc640 1 -- 172.21.15.45:0/2371240106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0938004cf0 con 0x7f093c101900 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f09433aa640 1 -- 172.21.15.45:0/2371240106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093c197ad0 con 0x7f093c101900 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.436+0000 7f09327fc640 1 -- 172.21.15.45:0/2371240106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0938035030 con 0x7f093c101900 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.437+0000 7f09433aa640 1 -- 172.21.15.45:0/2371240106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f093c198000 con 0x7f093c101900 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.438+0000 7f09433aa640 1 -- 172.21.15.45:0/2371240106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f093c103040 con 0x7f093c101900 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.438+0000 7f09327fc640 1 -- 172.21.15.45:0/2371240106 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f0938042070 con 0x7f093c101900 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.439+0000 7f09327fc640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f092807af30 0x7f092807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.439+0000 7f09327fc640 1 -- 172.21.15.45:0/2371240106 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f09380beab0 con 0x7f093c101900 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.439+0000 7f0940945640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f092807af30 0x7f092807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:55:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.439+0000 7f0940945640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f092807af30 0x7f092807d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f092c006fd0 tx=0x7f092c008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:55:59.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.443+0000 7f09327fc640 1 -- 172.21.15.45:0/2371240106 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f093808a100 con 0x7f093c101900 2024-09-18T12:55:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.630+0000 7f09433aa640 1 -- 172.21.15.45:0/2371240106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f093c109e70 con 0x7f093c101900 2024-09-18T12:55:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.630+0000 7f09327fc640 1 -- 172.21.15.45:0/2371240106 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v66)=0 v66) ==== 163+0+0 (secure 0 0 0) 0x7f093808efb0 con 0x7f093c101900 2024-09-18T12:55:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.632+0000 7f09433aa640 1 -- 172.21.15.45:0/2371240106 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f092807af30 msgr2=0x7f092807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.632+0000 7f09433aa640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f092807af30 0x7f092807d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f092c006fd0 tx=0x7f092c008040 comp rx=0 tx=0).stop 2024-09-18T12:55:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.632+0000 7f09433aa640 1 -- 172.21.15.45:0/2371240106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093c101900 msgr2=0x7f093c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:55:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.632+0000 7f09433aa640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093c101900 0x7f093c19d6c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0938031460 tx=0x7f09380048f0 comp rx=0 tx=0).stop 2024-09-18T12:55:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.633+0000 7f09433aa640 1 -- 172.21.15.45:0/2371240106 shutdown_connections 2024-09-18T12:55:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.633+0000 7f09433aa640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f092807af30 0x7f092807d3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.633+0000 7f09433aa640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093c107900 0x7f093c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:59.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.633+0000 7f09433aa640 1 --2- 172.21.15.45:0/2371240106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093c101900 0x7f093c19d6c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:55:59.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.633+0000 7f09433aa640 1 -- 172.21.15.45:0/2371240106 >> 172.21.15.45:0/2371240106 conn(0x7f093c0fd600 msgr2=0x7f093c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:55:59.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.633+0000 7f09433aa640 1 -- 172.21.15.45:0/2371240106 shutdown_connections 2024-09-18T12:55:59.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:55:59.633+0000 7f09433aa640 1 -- 172.21.15.45:0/2371240106 wait complete. 2024-09-18T12:55:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:55:59 smithi045 ceph-mon[28315]: pgmap v96: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:55:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:55:59 smithi161 ceph-mon[35784]: pgmap v96: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:00.224 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-18T12:56:00.492 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:56:00.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.941+0000 7fc01e913640 1 -- 172.21.15.45:0/603672065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc018107900 msgr2=0x7fc018107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:00.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.941+0000 7fc01e913640 1 --2- 172.21.15.45:0/603672065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc018107900 0x7fc018107ce0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc008009880 tx=0x7fc00802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:00.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.941+0000 7fc01e913640 1 -- 172.21.15.45:0/603672065 shutdown_connections 2024-09-18T12:56:00.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.941+0000 7fc01e913640 1 --2- 172.21.15.45:0/603672065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc018101900 0x7fc018101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:00.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.941+0000 7fc01e913640 1 --2- 172.21.15.45:0/603672065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc018107900 0x7fc018107ce0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.941+0000 7fc01e913640 1 -- 172.21.15.45:0/603672065 >> 172.21.15.45:0/603672065 conn(0x7fc0180fd600 msgr2=0x7fc0180ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.941+0000 7fc01e913640 1 -- 172.21.15.45:0/603672065 shutdown_connections 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.941+0000 7fc01e913640 1 -- 172.21.15.45:0/603672065 wait complete. 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.941+0000 7fc01e913640 1 Processor -- start 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc01e913640 1 -- start start 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc01e913640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc018101900 0x7fc0180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc01e913640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc018107900 0x7fc018074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc01e913640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc01810edd0 con 0x7fc018107900 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc01e913640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc01810ec50 con 0x7fc018101900 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc0177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc018107900 0x7fc018074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc0177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc018107900 0x7fc018074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51532/0 (socket says 172.21.15.45:51532) 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc0177fe640 1 -- 172.21.15.45:0/4096647355 learned_addr learned my addr 172.21.15.45:0/4096647355 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc017fff640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc018101900 0x7fc0180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:00.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc0177fe640 1 -- 172.21.15.45:0/4096647355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc018101900 msgr2=0x7fc0180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc0177fe640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc018101900 0x7fc0180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.942+0000 7fc0177fe640 1 -- 172.21.15.45:0/4096647355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc018074f70 con 0x7fc018107900 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.943+0000 7fc0177fe640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc018107900 0x7fc018074a30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c8f0 tx=0x7fc00c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.943+0000 7fc0157fa640 1 -- 172.21.15.45:0/4096647355 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc00c0079b0 con 0x7fc018107900 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.943+0000 7fc0157fa640 1 -- 172.21.15.45:0/4096647355 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc00c0054e0 con 0x7fc018107900 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.943+0000 7fc01e913640 1 -- 172.21.15.45:0/4096647355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc018075260 con 0x7fc018107900 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.943+0000 7fc0157fa640 1 -- 172.21.15.45:0/4096647355 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc00c004dd0 con 0x7fc018107900 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.943+0000 7fc01e913640 1 -- 172.21.15.45:0/4096647355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0181a3e80 con 0x7fc018107900 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.944+0000 7fc01e913640 1 -- 172.21.15.45:0/4096647355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc018103040 con 0x7fc018107900 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.944+0000 7fc0157fa640 1 -- 172.21.15.45:0/4096647355 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fc00c005020 con 0x7fc018107900 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.945+0000 7fc0157fa640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc00007aed0 0x7fc00007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.945+0000 7fc0157fa640 1 -- 172.21.15.45:0/4096647355 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fc00c09ded0 con 0x7fc018107900 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.945+0000 7fc017fff640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc00007aed0 0x7fc00007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.946+0000 7fc017fff640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc00007aed0 0x7fc00007d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc008000c00 tx=0x7fc008031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:00.950+0000 7fc0157fa640 1 -- 172.21.15.45:0/4096647355 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fc00c014030 con 0x7fc018107900 2024-09-18T12:56:01.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.134+0000 7fc01e913640 1 -- 172.21.15.45:0/4096647355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7fc018109e70 con 0x7fc018107900 2024-09-18T12:56:01.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.134+0000 7fc0157fa640 1 -- 172.21.15.45:0/4096647355 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v66)=0 v66) ==== 135+0+0 (secure 0 0 0) 0x7fc00c069520 con 0x7fc018107900 2024-09-18T12:56:01.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.136+0000 7fc01e913640 1 -- 172.21.15.45:0/4096647355 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc00007aed0 msgr2=0x7fc00007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:01.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.136+0000 7fc01e913640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc00007aed0 0x7fc00007d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc008000c00 tx=0x7fc008031400 comp rx=0 tx=0).stop 2024-09-18T12:56:01.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.136+0000 7fc01e913640 1 -- 172.21.15.45:0/4096647355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc018107900 msgr2=0x7fc018074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:01.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.136+0000 7fc01e913640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc018107900 0x7fc018074a30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00c8f0 tx=0x7fc00c00cdb0 comp rx=0 tx=0).stop 2024-09-18T12:56:01.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.137+0000 7fc01e913640 1 -- 172.21.15.45:0/4096647355 shutdown_connections 2024-09-18T12:56:01.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.137+0000 7fc01e913640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc00007aed0 0x7fc00007d390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:01.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.137+0000 7fc01e913640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc018107900 0x7fc018074a30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:01.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.137+0000 7fc01e913640 1 --2- 172.21.15.45:0/4096647355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc018101900 0x7fc0180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:01.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.137+0000 7fc01e913640 1 -- 172.21.15.45:0/4096647355 >> 172.21.15.45:0/4096647355 conn(0x7fc0180fd600 msgr2=0x7fc0180fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:01.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.137+0000 7fc01e913640 1 -- 172.21.15.45:0/4096647355 shutdown_connections 2024-09-18T12:56:01.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:01.137+0000 7fc01e913640 1 -- 172.21.15.45:0/4096647355 wait complete. 2024-09-18T12:56:01.742 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:01 smithi045 ceph-mon[28315]: pgmap v97: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:01.773 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-18T12:56:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:01 smithi161 ceph-mon[35784]: pgmap v97: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:56:02.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.481+0000 7f2a947dd640 1 -- 172.21.15.45:0/3475073690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c102ab0 msgr2=0x7f2a8c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.481+0000 7f2a947dd640 1 --2- 172.21.15.45:0/3475073690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c102ab0 0x7f2a8c102e90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009880 tx=0x7f2a8802a530 comp rx=0 tx=0).stop 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.481+0000 7f2a947dd640 1 -- 172.21.15.45:0/3475073690 shutdown_connections 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.481+0000 7f2a947dd640 1 --2- 172.21.15.45:0/3475073690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a8c1033d0 0x7f2a8c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.481+0000 7f2a947dd640 1 --2- 172.21.15.45:0/3475073690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c102ab0 0x7f2a8c102e90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.481+0000 7f2a947dd640 1 -- 172.21.15.45:0/3475073690 >> 172.21.15.45:0/3475073690 conn(0x7f2a8c0fc550 msgr2=0x7f2a8c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.481+0000 7f2a947dd640 1 -- 172.21.15.45:0/3475073690 shutdown_connections 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.481+0000 7f2a947dd640 1 -- 172.21.15.45:0/3475073690 wait complete. 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a947dd640 1 Processor -- start 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a947dd640 1 -- start start 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a947dd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a8c102ab0 0x7f2a8c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a947dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c1033d0 0x7f2a8c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a947dd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c10ee40 con 0x7f2a8c1033d0 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a947dd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c10ecc0 con 0x7f2a8c102ab0 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a91d78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c1033d0 0x7f2a8c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a91d78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c1033d0 0x7f2a8c100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39706/0 (socket says 172.21.15.45:39706) 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a91d78640 1 -- 172.21.15.45:0/298694456 learned_addr learned my addr 172.21.15.45:0/298694456 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a92579640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a8c102ab0 0x7f2a8c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a91d78640 1 -- 172.21.15.45:0/298694456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a8c102ab0 msgr2=0x7f2a8c100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a91d78640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a8c102ab0 0x7f2a8c100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a91d78640 1 -- 172.21.15.45:0/298694456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c101190 con 0x7f2a8c1033d0 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.482+0000 7f2a92579640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a8c102ab0 0x7f2a8c100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:56:02.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.483+0000 7f2a91d78640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c1033d0 0x7f2a8c100c50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00b370 tx=0x7f2a7c00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:02.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.483+0000 7f2a837fe640 1 -- 172.21.15.45:0/298694456 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a7c015020 con 0x7f2a8c1033d0 2024-09-18T12:56:02.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.483+0000 7f2a947dd640 1 -- 172.21.15.45:0/298694456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8c101480 con 0x7f2a8c1033d0 2024-09-18T12:56:02.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.483+0000 7f2a837fe640 1 -- 172.21.15.45:0/298694456 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a7c011af0 con 0x7f2a8c1033d0 2024-09-18T12:56:02.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.483+0000 7f2a837fe640 1 -- 172.21.15.45:0/298694456 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a7c010d60 con 0x7f2a8c1033d0 2024-09-18T12:56:02.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.483+0000 7f2a947dd640 1 -- 172.21.15.45:0/298694456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a8c1a3e90 con 0x7f2a8c1033d0 2024-09-18T12:56:02.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.484+0000 7f2a947dd640 1 -- 172.21.15.45:0/298694456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a8c06a580 con 0x7f2a8c1033d0 2024-09-18T12:56:02.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.485+0000 7f2a837fe640 1 -- 172.21.15.45:0/298694456 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f2a7c018020 con 0x7f2a8c1033d0 2024-09-18T12:56:02.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.485+0000 7f2a837fe640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a7807af30 0x7f2a7807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:02.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.485+0000 7f2a837fe640 1 -- 172.21.15.45:0/298694456 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f2a7c09d920 con 0x7f2a8c1033d0 2024-09-18T12:56:02.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.485+0000 7f2a92579640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a7807af30 0x7f2a7807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:02.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.486+0000 7f2a92579640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a7807af30 0x7f2a7807d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2a88000c00 tx=0x7f2a88031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:02.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.490+0000 7f2a837fe640 1 -- 172.21.15.45:0/298694456 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f2a7c01f020 con 0x7f2a8c1033d0 2024-09-18T12:56:02.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.692+0000 7f2a947dd640 1 -- 172.21.15.45:0/298694456 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}) -- 0x7f2a8c062630 con 0x7f2a7807af30 2024-09-18T12:56:02.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.697+0000 7f2a837fe640 1 -- 172.21.15.45:0/298694456 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f2a8c062630 con 0x7f2a7807af30 2024-09-18T12:56:02.698 INFO:teuthology.orchestra.run.smithi045.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:56:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.699+0000 7f2a947dd640 1 -- 172.21.15.45:0/298694456 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a7807af30 msgr2=0x7f2a7807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.699+0000 7f2a947dd640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a7807af30 0x7f2a7807d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2a88000c00 tx=0x7f2a88031400 comp rx=0 tx=0).stop 2024-09-18T12:56:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.699+0000 7f2a947dd640 1 -- 172.21.15.45:0/298694456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c1033d0 msgr2=0x7f2a8c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.699+0000 7f2a947dd640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c1033d0 0x7f2a8c100c50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00b370 tx=0x7f2a7c00b830 comp rx=0 tx=0).stop 2024-09-18T12:56:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.700+0000 7f2a947dd640 1 -- 172.21.15.45:0/298694456 shutdown_connections 2024-09-18T12:56:02.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.700+0000 7f2a947dd640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2a7807af30 0x7f2a7807d3f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.700+0000 7f2a947dd640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c1033d0 0x7f2a8c100c50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.700+0000 7f2a947dd640 1 --2- 172.21.15.45:0/298694456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a8c102ab0 0x7f2a8c100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:02.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.700+0000 7f2a947dd640 1 -- 172.21.15.45:0/298694456 >> 172.21.15.45:0/298694456 conn(0x7f2a8c0fc550 msgr2=0x7f2a8c108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:02.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.700+0000 7f2a947dd640 1 -- 172.21.15.45:0/298694456 shutdown_connections 2024-09-18T12:56:02.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:02.700+0000 7f2a947dd640 1 -- 172.21.15.45:0/298694456 wait complete. 2024-09-18T12:56:03.354 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T12:56:03.354 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T12:56:03.355 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-18T12:56:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T12:56:03.753 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:03 smithi045 ceph-mon[28315]: pgmap v98: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:03.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:03 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:03.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:03 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:56:03.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:03 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:56:03.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:03 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:56:03.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:03 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:03 smithi161 ceph-mon[35784]: pgmap v98: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:03 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:03 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:56:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:03 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:56:03.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:03 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:56:03.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:03 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:04.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.289+0000 7f1d21f12640 1 -- 172.21.15.45:0/1730795313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c106800 msgr2=0x7f1d1c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.289+0000 7f1d21f12640 1 --2- 172.21.15.45:0/1730795313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c106800 0x7f1d1c106be0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009880 tx=0x7f1d0c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.289+0000 7f1d21f12640 1 -- 172.21.15.45:0/1730795313 shutdown_connections 2024-09-18T12:56:04.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.289+0000 7f1d21f12640 1 --2- 172.21.15.45:0/1730795313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d1c100800 0x7f1d1c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.289+0000 7f1d21f12640 1 --2- 172.21.15.45:0/1730795313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c106800 0x7f1d1c106be0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.289+0000 7f1d21f12640 1 -- 172.21.15.45:0/1730795313 >> 172.21.15.45:0/1730795313 conn(0x7f1d1c0fc520 msgr2=0x7f1d1c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.289+0000 7f1d21f12640 1 -- 172.21.15.45:0/1730795313 shutdown_connections 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.289+0000 7f1d21f12640 1 -- 172.21.15.45:0/1730795313 wait complete. 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d21f12640 1 Processor -- start 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d21f12640 1 -- start start 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d21f12640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c100800 0x7f1d1c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d21f12640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d1c106800 0x7f1d1c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d21f12640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c10dcb0 con 0x7f1d1c100800 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d21f12640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c10db30 con 0x7f1d1c106800 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d1b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c100800 0x7f1d1c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d1b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c100800 0x7f1d1c19c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39718/0 (socket says 172.21.15.45:39718) 2024-09-18T12:56:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d1b7fe640 1 -- 172.21.15.45:0/3386506906 learned_addr learned my addr 172.21.15.45:0/3386506906 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d1b7fe640 1 -- 172.21.15.45:0/3386506906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d1c106800 msgr2=0x7f1d1c19cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d1b7fe640 1 --2- 172.21.15.45:0/3386506906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d1c106800 0x7f1d1c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.290+0000 7f1d1b7fe640 1 -- 172.21.15.45:0/3386506906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c1966a0 con 0x7f1d1c100800 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.291+0000 7f1d1b7fe640 1 --2- 172.21.15.45:0/3386506906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c100800 0x7f1d1c19c5d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c031460 tx=0x7f1d0c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.291+0000 7f1d18ff9640 1 -- 172.21.15.45:0/3386506906 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d0c03f070 con 0x7f1d1c100800 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.291+0000 7f1d21f12640 1 -- 172.21.15.45:0/3386506906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1c196930 con 0x7f1d1c100800 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.291+0000 7f1d18ff9640 1 -- 172.21.15.45:0/3386506906 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d0c004cf0 con 0x7f1d1c100800 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.291+0000 7f1d18ff9640 1 -- 172.21.15.45:0/3386506906 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d0c035030 con 0x7f1d1c100800 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.291+0000 7f1d21f12640 1 -- 172.21.15.45:0/3386506906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1c196e30 con 0x7f1d1c100800 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.292+0000 7f1d21f12640 1 -- 172.21.15.45:0/3386506906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1c101f40 con 0x7f1d1c100800 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.292+0000 7f1d18ff9640 1 -- 172.21.15.45:0/3386506906 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f1d0c042070 con 0x7f1d1c100800 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.293+0000 7f1d18ff9640 1 --2- 172.21.15.45:0/3386506906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1d0407af30 0x7f1d0407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.293+0000 7f1d18ff9640 1 -- 172.21.15.45:0/3386506906 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f1d0c0bead0 con 0x7f1d1c100800 2024-09-18T12:56:04.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.293+0000 7f1d1affd640 1 --2- 172.21.15.45:0/3386506906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1d0407af30 0x7f1d0407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.293+0000 7f1d1affd640 1 --2- 172.21.15.45:0/3386506906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1d0407af30 0x7f1d0407d3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c197ef0 tx=0x7f1d10005bf0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:04.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.298+0000 7f1d18ff9640 1 -- 172.21.15.45:0/3386506906 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f1d0c08a0c0 con 0x7f1d1c100800 2024-09-18T12:56:04.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.509+0000 7f1d21f12640 1 -- 172.21.15.45:0/3386506906 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1d1c1971a0 con 0x7f1d0407af30 2024-09-18T12:56:04.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.510+0000 7f1d18ff9640 1 -- 172.21.15.45:0/3386506906 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f1d1c1971a0 con 0x7f1d0407af30 2024-09-18T12:56:04.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.512+0000 7f1d21f12640 1 -- 172.21.15.45:0/3386506906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1d0407af30 msgr2=0x7f1d0407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.512+0000 7f1d21f12640 1 --2- 172.21.15.45:0/3386506906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1d0407af30 0x7f1d0407d3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c197ef0 tx=0x7f1d10005bf0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.512+0000 7f1d21f12640 1 -- 172.21.15.45:0/3386506906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c100800 msgr2=0x7f1d1c19c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.512+0000 7f1d21f12640 1 --2- 172.21.15.45:0/3386506906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c100800 0x7f1d1c19c5d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c031460 tx=0x7f1d0c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.512+0000 7f1d21f12640 1 -- 172.21.15.45:0/3386506906 shutdown_connections 2024-09-18T12:56:04.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.512+0000 7f1d21f12640 1 --2- 172.21.15.45:0/3386506906 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1d0407af30 0x7f1d0407d3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.512+0000 7f1d21f12640 1 --2- 172.21.15.45:0/3386506906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d1c106800 0x7f1d1c19cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.512+0000 7f1d21f12640 1 --2- 172.21.15.45:0/3386506906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c100800 0x7f1d1c19c5d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.512+0000 7f1d21f12640 1 -- 172.21.15.45:0/3386506906 >> 172.21.15.45:0/3386506906 conn(0x7f1d1c0fc520 msgr2=0x7f1d1c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:04.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.513+0000 7f1d21f12640 1 -- 172.21.15.45:0/3386506906 shutdown_connections 2024-09-18T12:56:04.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.513+0000 7f1d21f12640 1 -- 172.21.15.45:0/3386506906 wait complete. 2024-09-18T12:56:04.523 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:56:04.569 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:04 smithi045 ceph-mon[28315]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:04.569 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:04 smithi045 ceph-mon[28315]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:56:04.569 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:04 smithi045 ceph-mon[28315]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:56:04.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.600+0000 7f92473eb640 1 -- 172.21.15.45:0/749444173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92401067f0 msgr2=0x7f9240106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.600+0000 7f92473eb640 1 --2- 172.21.15.45:0/749444173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92401067f0 0x7f9240106bd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f923c009880 tx=0x7f923c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.601+0000 7f92473eb640 1 -- 172.21.15.45:0/749444173 shutdown_connections 2024-09-18T12:56:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.601+0000 7f92473eb640 1 --2- 172.21.15.45:0/749444173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92401007f0 0x7f9240100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.601+0000 7f92473eb640 1 --2- 172.21.15.45:0/749444173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92401067f0 0x7f9240106bd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.601+0000 7f92473eb640 1 -- 172.21.15.45:0/749444173 >> 172.21.15.45:0/749444173 conn(0x7f92400fc550 msgr2=0x7f92400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.601+0000 7f92473eb640 1 -- 172.21.15.45:0/749444173 shutdown_connections 2024-09-18T12:56:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.601+0000 7f92473eb640 1 -- 172.21.15.45:0/749444173 wait complete. 2024-09-18T12:56:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.601+0000 7f92473eb640 1 Processor -- start 2024-09-18T12:56:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.601+0000 7f92473eb640 1 -- start start 2024-09-18T12:56:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f92473eb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92401007f0 0x7f924019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f92473eb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92401067f0 0x7f924019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f92473eb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f924010dca0 con 0x7f92401067f0 2024-09-18T12:56:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f92473eb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f924010db20 con 0x7f92401007f0 2024-09-18T12:56:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f9244986640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92401067f0 0x7f924019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f9244986640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92401067f0 0x7f924019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39736/0 (socket says 172.21.15.45:39736) 2024-09-18T12:56:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f9244986640 1 -- 172.21.15.45:0/2734226198 learned_addr learned my addr 172.21.15.45:0/2734226198 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f9245187640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92401007f0 0x7f924019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f9244986640 1 -- 172.21.15.45:0/2734226198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92401007f0 msgr2=0x7f924019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f9244986640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92401007f0 0x7f924019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f9244986640 1 -- 172.21.15.45:0/2734226198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9240197750 con 0x7f92401067f0 2024-09-18T12:56:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f9245187640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92401007f0 0x7f924019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:56:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f9244986640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92401067f0 0x7f924019dbc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f923000c8a0 tx=0x7f923000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f92367fc640 1 -- 172.21.15.45:0/2734226198 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92300079b0 con 0x7f92401067f0 2024-09-18T12:56:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f92367fc640 1 -- 172.21.15.45:0/2734226198 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9230007b50 con 0x7f92401067f0 2024-09-18T12:56:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f92473eb640 1 -- 172.21.15.45:0/2734226198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9240197a40 con 0x7f92401067f0 2024-09-18T12:56:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.602+0000 7f92367fc640 1 -- 172.21.15.45:0/2734226198 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9230018700 con 0x7f92401067f0 2024-09-18T12:56:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.603+0000 7f92473eb640 1 -- 172.21.15.45:0/2734226198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9240197fd0 con 0x7f92401067f0 2024-09-18T12:56:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.604+0000 7f92473eb640 1 -- 172.21.15.45:0/2734226198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9240101f30 con 0x7f92401067f0 2024-09-18T12:56:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.604+0000 7f92367fc640 1 -- 172.21.15.45:0/2734226198 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f9230007d00 con 0x7f92401067f0 2024-09-18T12:56:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.605+0000 7f92367fc640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f922c07af80 0x7f922c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.605+0000 7f9245187640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f922c07af80 0x7f922c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.605+0000 7f92367fc640 1 -- 172.21.15.45:0/2734226198 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f923009e200 con 0x7f92401067f0 2024-09-18T12:56:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.605+0000 7f9245187640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f922c07af80 0x7f922c07d440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f923c031460 tx=0x7f923c009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:04.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.609+0000 7f92367fc640 1 -- 172.21.15.45:0/2734226198 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f9230014030 con 0x7f92401067f0 2024-09-18T12:56:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:04 smithi161 ceph-mon[35784]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:04.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:04 smithi161 ceph-mon[35784]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:56:04.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:04 smithi161 ceph-mon[35784]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e 2024-09-18T12:56:04.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.812+0000 7f92473eb640 1 -- 172.21.15.45:0/2734226198 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f92401982e0 con 0x7f922c07af80 2024-09-18T12:56:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.813+0000 7f92367fc640 1 -- 172.21.15.45:0/2734226198 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f92401982e0 con 0x7f922c07af80 2024-09-18T12:56:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 -- 172.21.15.45:0/2734226198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f922c07af80 msgr2=0x7f922c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f922c07af80 0x7f922c07d440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f923c031460 tx=0x7f923c009560 comp rx=0 tx=0).stop 2024-09-18T12:56:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 -- 172.21.15.45:0/2734226198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92401067f0 msgr2=0x7f924019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92401067f0 0x7f924019dbc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f923000c8a0 tx=0x7f923000cd60 comp rx=0 tx=0).stop 2024-09-18T12:56:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 -- 172.21.15.45:0/2734226198 shutdown_connections 2024-09-18T12:56:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f922c07af80 0x7f922c07d440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92401067f0 0x7f924019dbc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 --2- 172.21.15.45:0/2734226198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92401007f0 0x7f924019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 -- 172.21.15.45:0/2734226198 >> 172.21.15.45:0/2734226198 conn(0x7f92400fc550 msgr2=0x7f9240069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 -- 172.21.15.45:0/2734226198 shutdown_connections 2024-09-18T12:56:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.816+0000 7f92473eb640 1 -- 172.21.15.45:0/2734226198 wait complete. 2024-09-18T12:56:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.901+0000 7fa585c90640 1 -- 172.21.15.45:0/404651971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5801033d0 msgr2=0x7fa58010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.901+0000 7fa585c90640 1 --2- 172.21.15.45:0/404651971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5801033d0 0x7fa58010b8c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa574009880 tx=0x7fa57402a530 comp rx=0 tx=0).stop 2024-09-18T12:56:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.901+0000 7fa585c90640 1 -- 172.21.15.45:0/404651971 shutdown_connections 2024-09-18T12:56:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.901+0000 7fa585c90640 1 --2- 172.21.15.45:0/404651971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5801033d0 0x7fa58010b8c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.901+0000 7fa585c90640 1 --2- 172.21.15.45:0/404651971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa580102ab0 0x7fa580102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.901+0000 7fa585c90640 1 -- 172.21.15.45:0/404651971 >> 172.21.15.45:0/404651971 conn(0x7fa5800fc550 msgr2=0x7fa5800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.901+0000 7fa585c90640 1 -- 172.21.15.45:0/404651971 shutdown_connections 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.901+0000 7fa585c90640 1 -- 172.21.15.45:0/404651971 wait complete. 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.901+0000 7fa585c90640 1 Processor -- start 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa585c90640 1 -- start start 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa585c90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa580102ab0 0x7fa580100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa585c90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5801033d0 0x7fa580100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa585c90640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa58010ede0 con 0x7fa5801033d0 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa585c90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa58010ec60 con 0x7fa580102ab0 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa57effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5801033d0 0x7fa580100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa57effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5801033d0 0x7fa580100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39742/0 (socket says 172.21.15.45:39742) 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa57effd640 1 -- 172.21.15.45:0/2509774710 learned_addr learned my addr 172.21.15.45:0/2509774710 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa57f7fe640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa580102ab0 0x7fa580100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa57effd640 1 -- 172.21.15.45:0/2509774710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa580102ab0 msgr2=0x7fa580100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa57effd640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa580102ab0 0x7fa580100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa57effd640 1 -- 172.21.15.45:0/2509774710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa580101190 con 0x7fa5801033d0 2024-09-18T12:56:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.902+0000 7fa57effd640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5801033d0 0x7fa580100c50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa574031460 tx=0x7fa574004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.903+0000 7fa57cff9640 1 -- 172.21.15.45:0/2509774710 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa57403f070 con 0x7fa5801033d0 2024-09-18T12:56:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.903+0000 7fa57cff9640 1 -- 172.21.15.45:0/2509774710 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa5740035f0 con 0x7fa5801033d0 2024-09-18T12:56:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.903+0000 7fa585c90640 1 -- 172.21.15.45:0/2509774710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa580101420 con 0x7fa5801033d0 2024-09-18T12:56:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.903+0000 7fa57cff9640 1 -- 172.21.15.45:0/2509774710 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa574035030 con 0x7fa5801033d0 2024-09-18T12:56:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.903+0000 7fa585c90640 1 -- 172.21.15.45:0/2509774710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5801a3dd0 con 0x7fa5801033d0 2024-09-18T12:56:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.904+0000 7fa585c90640 1 -- 172.21.15.45:0/2509774710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58006a580 con 0x7fa5801033d0 2024-09-18T12:56:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.904+0000 7fa57cff9640 1 -- 172.21.15.45:0/2509774710 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fa574042070 con 0x7fa5801033d0 2024-09-18T12:56:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.905+0000 7fa57cff9640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa56807af30 0x7fa56807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.905+0000 7fa57cff9640 1 -- 172.21.15.45:0/2509774710 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fa5740be8b0 con 0x7fa5801033d0 2024-09-18T12:56:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.905+0000 7fa57f7fe640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa56807af30 0x7fa56807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.906+0000 7fa57f7fe640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa56807af30 0x7fa56807d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa570005fd0 tx=0x7fa57000b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:04.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:04.910+0000 7fa57cff9640 1 -- 172.21.15.45:0/2509774710 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fa574089f00 con 0x7fa5801033d0 2024-09-18T12:56:05.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.104+0000 7fa585c90640 1 -- 172.21.15.45:0/2509774710 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa580062630 con 0x7fa56807af30 2024-09-18T12:56:05.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.115+0000 7fa57cff9640 1 -- 172.21.15.45:0/2509774710 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa580062630 con 0x7fa56807af30 2024-09-18T12:56:05.117 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:56:05.117 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (69s) 41s ago 12m 17.2M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T12:56:05.117 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (4m) 41s ago 12m 8740k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:56:05.117 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (3m) 110s ago 11m 8144k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:56:05.117 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (12m) 41s ago 12m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:56:05.117 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (11m) 110s ago 11m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:56:05.117 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (47s) 41s ago 11m 49.9M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (6m) 41s ago 6m 91.9M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (6m) 41s ago 6m 151M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (6m) 110s ago 6m 16.3M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (6m) 110s ago 6m 14.7M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (3m) 41s ago 13m 522M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (2m) 110s ago 11m 454M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (13m) 41s ago 13m 59.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b2c8b9524366 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (11m) 110s ago 11m 48.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 34d6a3464162 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (119s) 41s ago 12m 9470k - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (114s) 110s ago 11m 3338k - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (10m) 41s ago 10m 205M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (9m) 41s ago 9m 224M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:56:05.118 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (9m) 41s ago 9m 185M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:56:05.119 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (8m) 110s ago 8m 239M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:56:05.119 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (8m) 110s ago 8m 213M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:56:05.119 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (7m) 110s ago 7m 197M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:56:05.119 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (90s) 41s ago 11m 45.3M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 -- 172.21.15.45:0/2509774710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa56807af30 msgr2=0x7fa56807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa56807af30 0x7fa56807d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa570005fd0 tx=0x7fa57000b390 comp rx=0 tx=0).stop 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 -- 172.21.15.45:0/2509774710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5801033d0 msgr2=0x7fa580100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5801033d0 0x7fa580100c50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa574031460 tx=0x7fa574004530 comp rx=0 tx=0).stop 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 -- 172.21.15.45:0/2509774710 shutdown_connections 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa56807af30 0x7fa56807d3f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5801033d0 0x7fa580100c50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 --2- 172.21.15.45:0/2509774710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa580102ab0 0x7fa580100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 -- 172.21.15.45:0/2509774710 >> 172.21.15.45:0/2509774710 conn(0x7fa5800fc550 msgr2=0x7fa580108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 -- 172.21.15.45:0/2509774710 shutdown_connections 2024-09-18T12:56:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.118+0000 7fa585c90640 1 -- 172.21.15.45:0/2509774710 wait complete. 2024-09-18T12:56:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.201+0000 7f6e65f24640 1 -- 172.21.15.45:0/4048436521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e60102ab0 msgr2=0x7f6e60102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.201+0000 7f6e65f24640 1 --2- 172.21.15.45:0/4048436521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e60102ab0 0x7f6e60102e90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009880 tx=0x7f6e5002a530 comp rx=0 tx=0).stop 2024-09-18T12:56:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.201+0000 7f6e65f24640 1 -- 172.21.15.45:0/4048436521 shutdown_connections 2024-09-18T12:56:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.201+0000 7f6e65f24640 1 --2- 172.21.15.45:0/4048436521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e601033d0 0x7f6e6010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.201+0000 7f6e65f24640 1 --2- 172.21.15.45:0/4048436521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e60102ab0 0x7f6e60102e90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.201+0000 7f6e65f24640 1 -- 172.21.15.45:0/4048436521 >> 172.21.15.45:0/4048436521 conn(0x7f6e600fc550 msgr2=0x7f6e600fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.201+0000 7f6e65f24640 1 -- 172.21.15.45:0/4048436521 shutdown_connections 2024-09-18T12:56:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.201+0000 7f6e65f24640 1 -- 172.21.15.45:0/4048436521 wait complete. 2024-09-18T12:56:05.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.201+0000 7f6e65f24640 1 Processor -- start 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e65f24640 1 -- start start 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e65f24640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e60102ab0 0x7f6e6019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e65f24640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e601033d0 0x7f6e6019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e65f24640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6010edc0 con 0x7f6e60102ab0 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e65f24640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6010ec40 con 0x7f6e601033d0 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e5f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e60102ab0 0x7f6e6019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e5f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e60102ab0 0x7f6e6019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39746/0 (socket says 172.21.15.45:39746) 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e5f7fe640 1 -- 172.21.15.45:0/3226088611 learned_addr learned my addr 172.21.15.45:0/3226088611 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e56ffd640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e601033d0 0x7f6e6019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e5f7fe640 1 -- 172.21.15.45:0/3226088611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e601033d0 msgr2=0x7f6e6019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e5f7fe640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e601033d0 0x7f6e6019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.202+0000 7f6e5f7fe640 1 -- 172.21.15.45:0/3226088611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e601977b0 con 0x7f6e60102ab0 2024-09-18T12:56:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.203+0000 7f6e5f7fe640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e60102ab0 0x7f6e6019d630 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6e50031460 tx=0x7f6e500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.203+0000 7f6e5d7fa640 1 -- 172.21.15.45:0/3226088611 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e5003f070 con 0x7f6e60102ab0 2024-09-18T12:56:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.203+0000 7f6e65f24640 1 -- 172.21.15.45:0/3226088611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e60197a40 con 0x7f6e60102ab0 2024-09-18T12:56:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.203+0000 7f6e5d7fa640 1 -- 172.21.15.45:0/3226088611 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e500035f0 con 0x7f6e60102ab0 2024-09-18T12:56:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.203+0000 7f6e5d7fa640 1 -- 172.21.15.45:0/3226088611 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e50035030 con 0x7f6e60102ab0 2024-09-18T12:56:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.203+0000 7f6e65f24640 1 -- 172.21.15.45:0/3226088611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e60197f70 con 0x7f6e60102ab0 2024-09-18T12:56:05.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.204+0000 7f6e65f24640 1 -- 172.21.15.45:0/3226088611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6006a580 con 0x7f6e60102ab0 2024-09-18T12:56:05.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.205+0000 7f6e5d7fa640 1 -- 172.21.15.45:0/3226088611 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f6e50042070 con 0x7f6e60102ab0 2024-09-18T12:56:05.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.205+0000 7f6e5d7fa640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6e4c07af30 0x7f6e4c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:05.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.206+0000 7f6e5d7fa640 1 -- 172.21.15.45:0/3226088611 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f6e500be9d0 con 0x7f6e60102ab0 2024-09-18T12:56:05.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.206+0000 7f6e56ffd640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6e4c07af30 0x7f6e4c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:05.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.206+0000 7f6e56ffd640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6e4c07af30 0x7f6e4c07d3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e480058c0 tx=0x7f6e48005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:05.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.210+0000 7f6e5d7fa640 1 -- 172.21.15.45:0/3226088611 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f6e5008a020 con 0x7f6e60102ab0 2024-09-18T12:56:05.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.482+0000 7f6e65f24640 1 -- 172.21.15.45:0/3226088611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6e60105f80 con 0x7f6e60102ab0 2024-09-18T12:56:05.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.483+0000 7f6e5d7fa640 1 -- 172.21.15.45:0/3226088611 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f6e500be2f0 con 0x7f6e60102ab0 2024-09-18T12:56:05.484 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:56:05.484 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:56:05.484 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:56:05.485 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-18T12:56:05.486 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:05.486 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:56:05.486 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.485+0000 7f6e65f24640 1 -- 172.21.15.45:0/3226088611 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6e4c07af30 msgr2=0x7f6e4c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.485+0000 7f6e65f24640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6e4c07af30 0x7f6e4c07d3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e480058c0 tx=0x7f6e48005850 comp rx=0 tx=0).stop 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.485+0000 7f6e65f24640 1 -- 172.21.15.45:0/3226088611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e60102ab0 msgr2=0x7f6e6019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.485+0000 7f6e65f24640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e60102ab0 0x7f6e6019d630 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6e50031460 tx=0x7f6e500045e0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.485+0000 7f6e65f24640 1 -- 172.21.15.45:0/3226088611 shutdown_connections 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.485+0000 7f6e65f24640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6e4c07af30 0x7f6e4c07d3f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.485+0000 7f6e65f24640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e601033d0 0x7f6e6019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.485+0000 7f6e65f24640 1 --2- 172.21.15.45:0/3226088611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e60102ab0 0x7f6e6019d630 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.485+0000 7f6e65f24640 1 -- 172.21.15.45:0/3226088611 >> 172.21.15.45:0/3226088611 conn(0x7f6e600fc550 msgr2=0x7f6e60108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.486+0000 7f6e65f24640 1 -- 172.21.15.45:0/3226088611 shutdown_connections 2024-09-18T12:56:05.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.486+0000 7f6e65f24640 1 -- 172.21.15.45:0/3226088611 wait complete. 2024-09-18T12:56:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.571+0000 7f4fe29a5640 1 -- 172.21.15.45:0/1631940484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fdc1033d0 msgr2=0x7f4fdc10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.571+0000 7f4fe29a5640 1 --2- 172.21.15.45:0/1631940484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fdc1033d0 0x7f4fdc10b8c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009880 tx=0x7f4fd002a540 comp rx=0 tx=0).stop 2024-09-18T12:56:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.571+0000 7f4fe29a5640 1 -- 172.21.15.45:0/1631940484 shutdown_connections 2024-09-18T12:56:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.571+0000 7f4fe29a5640 1 --2- 172.21.15.45:0/1631940484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fdc1033d0 0x7f4fdc10b8c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.571+0000 7f4fe29a5640 1 --2- 172.21.15.45:0/1631940484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102ab0 0x7f4fdc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.571+0000 7f4fe29a5640 1 -- 172.21.15.45:0/1631940484 >> 172.21.15.45:0/1631940484 conn(0x7f4fdc0fc550 msgr2=0x7f4fdc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.571+0000 7f4fe29a5640 1 -- 172.21.15.45:0/1631940484 shutdown_connections 2024-09-18T12:56:05.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.571+0000 7f4fe29a5640 1 -- 172.21.15.45:0/1631940484 wait complete. 2024-09-18T12:56:05.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.572+0000 7f4fe29a5640 1 Processor -- start 2024-09-18T12:56:05.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.572+0000 7f4fe29a5640 1 -- start start 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.572+0000 7f4fe29a5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102ab0 0x7f4fdc19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.572+0000 7f4fe29a5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fdc1033d0 0x7f4fdc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.572+0000 7f4fe29a5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10edc0 con 0x7f4fdc1033d0 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.572+0000 7f4fe29a5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10ec40 con 0x7f4fdc102ab0 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fdb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fdc1033d0 0x7f4fdc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fdb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fdc1033d0 0x7f4fdc19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39756/0 (socket says 172.21.15.45:39756) 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fdb7fe640 1 -- 172.21.15.45:0/3060916731 learned_addr learned my addr 172.21.15.45:0/3060916731 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fdbfff640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102ab0 0x7f4fdc19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fdb7fe640 1 -- 172.21.15.45:0/3060916731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102ab0 msgr2=0x7f4fdc19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fdb7fe640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102ab0 0x7f4fdc19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fdb7fe640 1 -- 172.21.15.45:0/3060916731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc1a03f0 con 0x7f4fdc1033d0 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fdb7fe640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fdc1033d0 0x7f4fdc19fd40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0031460 tx=0x7f4fd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fd97fa640 1 -- 172.21.15.45:0/3060916731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fd003f070 con 0x7f4fdc1033d0 2024-09-18T12:56:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fd97fa640 1 -- 172.21.15.45:0/3060916731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fd0004ac0 con 0x7f4fdc1033d0 2024-09-18T12:56:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fe29a5640 1 -- 172.21.15.45:0/3060916731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc199a80 con 0x7f4fdc1033d0 2024-09-18T12:56:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.573+0000 7f4fe29a5640 1 -- 172.21.15.45:0/3060916731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc199f80 con 0x7f4fdc1033d0 2024-09-18T12:56:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.574+0000 7f4fd97fa640 1 -- 172.21.15.45:0/3060916731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fd0049060 con 0x7f4fdc1033d0 2024-09-18T12:56:05.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.575+0000 7f4fe29a5640 1 -- 172.21.15.45:0/3060916731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc06a580 con 0x7f4fdc1033d0 2024-09-18T12:56:05.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.575+0000 7f4fd97fa640 1 -- 172.21.15.45:0/3060916731 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f4fd0042070 con 0x7f4fdc1033d0 2024-09-18T12:56:05.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.576+0000 7f4fd97fa640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4fc407af30 0x7f4fc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:05.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.576+0000 7f4fd97fa640 1 -- 172.21.15.45:0/3060916731 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f4fd00bed50 con 0x7f4fdc1033d0 2024-09-18T12:56:05.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.576+0000 7f4fdbfff640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4fc407af30 0x7f4fc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:05.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.577+0000 7f4fdbfff640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4fc407af30 0x7f4fc407d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc19ab00 tx=0x7f4fcc00a2d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.584+0000 7f4fd97fa640 1 -- 172.21.15.45:0/3060916731 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f4fd008a420 con 0x7f4fdc1033d0 2024-09-18T12:56:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:05 smithi045 ceph-mon[28315]: pgmap v99: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:05 smithi045 ceph-mon[28315]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:05 smithi161 ceph-mon[35784]: pgmap v99: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:05 smithi161 ceph-mon[35784]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.815+0000 7f4fe29a5640 1 -- 172.21.15.45:0/3060916731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4fdc102e90 con 0x7f4fdc1033d0 2024-09-18T12:56:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.816+0000 7f4fd97fa640 1 -- 172.21.15.45:0/3060916731 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2046 (secure 0 0 0) 0x7f4fdc102e90 con 0x7f4fdc1033d0 2024-09-18T12:56:05.817 INFO:teuthology.orchestra.run.smithi045.stdout:e16 2024-09-18T12:56:05.817 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T12:49:30:966010+0000 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 14 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T12:49:28.960615+0000 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T12:56:05.818 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=14566} 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T12:56:05.819 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 14566 members: 14566 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:56:05.820 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T12:56:05.821 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:56:05.821 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:05.821 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 -- 172.21.15.45:0/3060916731 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4fc407af30 msgr2=0x7f4fc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4fc407af30 0x7f4fc407d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc19ab00 tx=0x7f4fcc00a2d0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 -- 172.21.15.45:0/3060916731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fdc1033d0 msgr2=0x7f4fdc19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fdc1033d0 0x7f4fdc19fd40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0031460 tx=0x7f4fd00046c0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 -- 172.21.15.45:0/3060916731 shutdown_connections 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4fc407af30 0x7f4fc407d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fdc1033d0 0x7f4fdc19fd40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 --2- 172.21.15.45:0/3060916731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fdc102ab0 0x7f4fdc19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 -- 172.21.15.45:0/3060916731 >> 172.21.15.45:0/3060916731 conn(0x7f4fdc0fc550 msgr2=0x7f4fdc100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 -- 172.21.15.45:0/3060916731 shutdown_connections 2024-09-18T12:56:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.818+0000 7f4fe29a5640 1 -- 172.21.15.45:0/3060916731 wait complete. 2024-09-18T12:56:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.903+0000 7f56453c8640 1 -- 172.21.15.45:0/1981198783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5640107900 msgr2=0x7f5640107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.903+0000 7f56453c8640 1 --2- 172.21.15.45:0/1981198783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5640107900 0x7f5640107ce0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5630009880 tx=0x7f563002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.903+0000 7f56453c8640 1 -- 172.21.15.45:0/1981198783 shutdown_connections 2024-09-18T12:56:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.903+0000 7f56453c8640 1 --2- 172.21.15.45:0/1981198783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5640101900 0x7f5640101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.904+0000 7f56453c8640 1 --2- 172.21.15.45:0/1981198783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5640107900 0x7f5640107ce0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.904+0000 7f56453c8640 1 -- 172.21.15.45:0/1981198783 >> 172.21.15.45:0/1981198783 conn(0x7f56400fd5e0 msgr2=0x7f56400ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.904+0000 7f56453c8640 1 -- 172.21.15.45:0/1981198783 shutdown_connections 2024-09-18T12:56:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.904+0000 7f56453c8640 1 -- 172.21.15.45:0/1981198783 wait complete. 2024-09-18T12:56:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.904+0000 7f56453c8640 1 Processor -- start 2024-09-18T12:56:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.904+0000 7f56453c8640 1 -- start start 2024-09-18T12:56:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f56453c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5640101900 0x7f56400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f56453c8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5640107900 0x7f5640074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f56453c8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f564010edd0 con 0x7f5640101900 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f56453c8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f564010ec50 con 0x7f5640107900 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f563effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5640101900 0x7f56400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f563effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5640101900 0x7f56400744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39762/0 (socket says 172.21.15.45:39762) 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f563effd640 1 -- 172.21.15.45:0/400845659 learned_addr learned my addr 172.21.15.45:0/400845659 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f563e7fc640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5640107900 0x7f5640074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f563effd640 1 -- 172.21.15.45:0/400845659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5640107900 msgr2=0x7f5640074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f563effd640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5640107900 0x7f5640074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f563effd640 1 -- 172.21.15.45:0/400845659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5640074f70 con 0x7f5640101900 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f563effd640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5640101900 0x7f56400744f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5630031460 tx=0x7f56300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f5627fff640 1 -- 172.21.15.45:0/400845659 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f563003f070 con 0x7f5640101900 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f5627fff640 1 -- 172.21.15.45:0/400845659 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56300035f0 con 0x7f5640101900 2024-09-18T12:56:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f56453c8640 1 -- 172.21.15.45:0/400845659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5640075200 con 0x7f5640101900 2024-09-18T12:56:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f5627fff640 1 -- 172.21.15.45:0/400845659 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5630035030 con 0x7f5640101900 2024-09-18T12:56:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.905+0000 7f56453c8640 1 -- 172.21.15.45:0/400845659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56401a3d80 con 0x7f5640101900 2024-09-18T12:56:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.906+0000 7f56453c8640 1 -- 172.21.15.45:0/400845659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5640103040 con 0x7f5640101900 2024-09-18T12:56:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.907+0000 7f5627fff640 1 -- 172.21.15.45:0/400845659 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f5630042070 con 0x7f5640101900 2024-09-18T12:56:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.908+0000 7f5627fff640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f562807af30 0x7f562807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.908+0000 7f5627fff640 1 -- 172.21.15.45:0/400845659 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f56300bea30 con 0x7f5640101900 2024-09-18T12:56:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.908+0000 7f563e7fc640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f562807af30 0x7f562807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.908+0000 7f563e7fc640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f562807af30 0x7f562807d3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5634005fd0 tx=0x7f5634005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:05.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:05.912+0000 7f5627fff640 1 -- 172.21.15.45:0/400845659 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f563008a020 con 0x7f5640101900 2024-09-18T12:56:06.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.116+0000 7f56453c8640 1 -- 172.21.15.45:0/400845659 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5640062630 con 0x7f562807af30 2024-09-18T12:56:06.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.118+0000 7f5627fff640 1 -- 172.21.15.45:0/400845659 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f5640062630 con 0x7f562807af30 2024-09-18T12:56:06.119 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:56:06.119 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:56:06.119 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:56:06.119 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:56:06.119 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:56:06.119 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr" 2024-09-18T12:56:06.120 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:56:06.120 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "2/23 daemons upgraded", 2024-09-18T12:56:06.120 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading mon daemons", 2024-09-18T12:56:06.120 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:56:06.120 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:56:06.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 -- 172.21.15.45:0/400845659 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f562807af30 msgr2=0x7f562807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:06.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f562807af30 0x7f562807d3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5634005fd0 tx=0x7f5634005850 comp rx=0 tx=0).stop 2024-09-18T12:56:06.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 -- 172.21.15.45:0/400845659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5640101900 msgr2=0x7f56400744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:06.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5640101900 0x7f56400744f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5630031460 tx=0x7f56300045e0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 -- 172.21.15.45:0/400845659 shutdown_connections 2024-09-18T12:56:06.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f562807af30 0x7f562807d3f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5640107900 0x7f5640074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 --2- 172.21.15.45:0/400845659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5640101900 0x7f56400744f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 -- 172.21.15.45:0/400845659 >> 172.21.15.45:0/400845659 conn(0x7f56400fd5e0 msgr2=0x7f56400fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:06.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 -- 172.21.15.45:0/400845659 shutdown_connections 2024-09-18T12:56:06.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.120+0000 7f56453c8640 1 -- 172.21.15.45:0/400845659 wait complete. 2024-09-18T12:56:06.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.211+0000 7fd5511fe640 1 -- 172.21.15.45:0/4186112704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c102b20 msgr2=0x7fd54c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:06.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.211+0000 7fd5511fe640 1 --2- 172.21.15.45:0/4186112704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c102b20 0x7fd54c102f00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0098b0 tx=0x7fd53c02a560 comp rx=0 tx=0).stop 2024-09-18T12:56:06.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.211+0000 7fd5511fe640 1 -- 172.21.15.45:0/4186112704 shutdown_connections 2024-09-18T12:56:06.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.211+0000 7fd5511fe640 1 --2- 172.21.15.45:0/4186112704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c103440 0x7fd54c10b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.211+0000 7fd5511fe640 1 --2- 172.21.15.45:0/4186112704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c102b20 0x7fd54c102f00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.211+0000 7fd5511fe640 1 -- 172.21.15.45:0/4186112704 >> 172.21.15.45:0/4186112704 conn(0x7fd54c0fc520 msgr2=0x7fd54c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.211+0000 7fd5511fe640 1 -- 172.21.15.45:0/4186112704 shutdown_connections 2024-09-18T12:56:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.211+0000 7fd5511fe640 1 -- 172.21.15.45:0/4186112704 wait complete. 2024-09-18T12:56:06.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.211+0000 7fd5511fe640 1 Processor -- start 2024-09-18T12:56:06.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd5511fe640 1 -- start start 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd5511fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c102b20 0x7fd54c100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd5511fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c103440 0x7fd54c100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd5511fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c10edd0 con 0x7fd54c102b20 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd5511fe640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c10ec50 con 0x7fd54c103440 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd54ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c102b20 0x7fd54c100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd54ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c102b20 0x7fd54c100780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39774/0 (socket says 172.21.15.45:39774) 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd54ad9d640 1 -- 172.21.15.45:0/4047138066 learned_addr learned my addr 172.21.15.45:0/4047138066 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd54a59c640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c103440 0x7fd54c100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd54ad9d640 1 -- 172.21.15.45:0/4047138066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c103440 msgr2=0x7fd54c100cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd54ad9d640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c103440 0x7fd54c100cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.212+0000 7fd54ad9d640 1 -- 172.21.15.45:0/4047138066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c101200 con 0x7fd54c102b20 2024-09-18T12:56:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.213+0000 7fd54ad9d640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c102b20 0x7fd54c100780 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd53c031460 tx=0x7fd53c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:06.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.213+0000 7fd533fff640 1 -- 172.21.15.45:0/4047138066 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd53c03f070 con 0x7fd54c102b20 2024-09-18T12:56:06.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.213+0000 7fd533fff640 1 -- 172.21.15.45:0/4047138066 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd53c0044d0 con 0x7fd54c102b20 2024-09-18T12:56:06.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.213+0000 7fd5511fe640 1 -- 172.21.15.45:0/4047138066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c101490 con 0x7fd54c102b20 2024-09-18T12:56:06.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.213+0000 7fd533fff640 1 -- 172.21.15.45:0/4047138066 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd53c035030 con 0x7fd54c102b20 2024-09-18T12:56:06.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.213+0000 7fd5511fe640 1 -- 172.21.15.45:0/4047138066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c1a3d50 con 0x7fd54c102b20 2024-09-18T12:56:06.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.214+0000 7fd5511fe640 1 -- 172.21.15.45:0/4047138066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c06aa30 con 0x7fd54c102b20 2024-09-18T12:56:06.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.215+0000 7fd533fff640 1 -- 172.21.15.45:0/4047138066 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fd53c042070 con 0x7fd54c102b20 2024-09-18T12:56:06.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.216+0000 7fd533fff640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd53407af80 0x7fd53407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:06.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.216+0000 7fd533fff640 1 -- 172.21.15.45:0/4047138066 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7fd53c0be910 con 0x7fd54c102b20 2024-09-18T12:56:06.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.216+0000 7fd54a59c640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd53407af80 0x7fd53407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.216+0000 7fd54a59c640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd53407af80 0x7fd53407d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd54c102210 tx=0x7fd54000a2d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.220+0000 7fd533fff640 1 -- 172.21.15.45:0/4047138066 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fd53c089fe0 con 0x7fd54c102b20 2024-09-18T12:56:06.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.479+0000 7fd5511fe640 1 -- 172.21.15.45:0/4047138066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd54c105f80 con 0x7fd54c102b20 2024-09-18T12:56:06.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.480+0000 7fd533fff640 1 -- 172.21.15.45:0/4047138066 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fd53c08ee90 con 0x7fd54c102b20 2024-09-18T12:56:06.482 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:06.482 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:06.482 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:56:06.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 -- 172.21.15.45:0/4047138066 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd53407af80 msgr2=0x7fd53407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:06.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd53407af80 0x7fd53407d440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd54c102210 tx=0x7fd54000a2d0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 -- 172.21.15.45:0/4047138066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c102b20 msgr2=0x7fd54c100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c102b20 0x7fd54c100780 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd53c031460 tx=0x7fd53c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 -- 172.21.15.45:0/4047138066 shutdown_connections 2024-09-18T12:56:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd53407af80 0x7fd53407d440 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd54c103440 0x7fd54c100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 --2- 172.21.15.45:0/4047138066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54c102b20 0x7fd54c100780 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 -- 172.21.15.45:0/4047138066 >> 172.21.15.45:0/4047138066 conn(0x7fd54c0fc520 msgr2=0x7fd54c108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 -- 172.21.15.45:0/4047138066 shutdown_connections 2024-09-18T12:56:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:06.483+0000 7fd5511fe640 1 -- 172.21.15.45:0/4047138066 wait complete. 2024-09-18T12:56:06.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: from='client.14956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:06.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:06.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:06.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: Upgrade: Target is version 19.3.0-4983-ge7fb7b56 (squid) 2024-09-18T12:56:06.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9'] 2024-09-18T12:56:06.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:56:06.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:56:06.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: Upgrade: Setting container_image for all mgr 2024-09-18T12:56:06.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:06.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T12:56:06.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3226088611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:56:06.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:06 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/3060916731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:56:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: from='client.14956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: Upgrade: Target is version 19.3.0-4983-ge7fb7b56 (squid) 2024-09-18T12:56:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9'] 2024-09-18T12:56:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:56:06.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:56:06.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: Upgrade: Setting container_image for all mgr 2024-09-18T12:56:06.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:06.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T12:56:06.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3226088611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:56:06.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:06 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/3060916731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T12:56:07.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:07 smithi045 ceph-mon[28315]: from='client.14972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:07.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:07 smithi045 ceph-mon[28315]: pgmap v100: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:07.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:07 smithi045 ceph-mon[28315]: from='client.? 172.21.15.45:0/4047138066' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:56:07.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:07 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:07.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:07 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:56:07.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:07 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:56:07.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:07 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:56:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:07 smithi161 ceph-mon[35784]: from='client.14972 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:07 smithi161 ceph-mon[35784]: pgmap v100: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:07 smithi161 ceph-mon[35784]: from='client.? 172.21.15.45:0/4047138066' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T12:56:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:07 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:07 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:56:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:07 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:56:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:07 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:56:08.768 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:08 smithi045 ceph-mon[28315]: Upgrade: Updating mon.smithi045 2024-09-18T12:56:08.768 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:08 smithi045 ceph-mon[28315]: Deploying daemon mon.smithi045 on smithi045 2024-09-18T12:56:08.768 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:08 smithi045 ceph-mon[28315]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:56:08.768 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:08 smithi045 systemd[1]: Stopping Ceph mon.smithi045 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:56:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:08 smithi161 ceph-mon[35784]: Upgrade: Updating mon.smithi045 2024-09-18T12:56:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:08 smithi161 ceph-mon[35784]: Deploying daemon mon.smithi045 on smithi045 2024-09-18T12:56:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:08 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:56:09.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:08 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045[28311]: 2024-09-18T12:56:08.765+0000 7f68e2d2e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi045 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:56:09.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:08 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045[28311]: 2024-09-18T12:56:08.765+0000 7f68e2d2e640 -1 mon.smithi045@0(leader) e2 *** Got Signal Terminated *** 2024-09-18T12:56:09.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:08 smithi045 podman[108956]: 2024-09-18 12:56:08.939988226 +0000 UTC m=+0.277849566 container died b2c8b9524366c919d136da33858df1aaa2c8c83f6be16e34470266b54a52337a (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:09.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:09 smithi045 podman[108956]: 2024-09-18 12:56:09.358009118 +0000 UTC m=+0.695870448 container cleanup b2c8b9524366c919d136da33858df1aaa2c8c83f6be16e34470266b54a52337a (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-18T12:56:09.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:09 smithi045 bash[108956]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045 2024-09-18T12:56:10.027 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:09 smithi045 podman[108982]: 2024-09-18 12:56:09.567520333 +0000 UTC m=+0.620116644 container remove b2c8b9524366c919d136da33858df1aaa2c8c83f6be16e34470266b54a52337a (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-18T12:56:10.027 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:09 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi045.service: Deactivated successfully. 2024-09-18T12:56:10.028 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:09 smithi045 systemd[1]: Stopped Ceph mon.smithi045 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:56:10.028 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:09 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi045.service: Consumed 14.592s CPU time. 2024-09-18T12:56:10.241 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 systemd[1]: Starting Ceph mon.smithi045 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:56:10.241 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 podman[109110]: 2024-09-18 12:56:10.142347879 +0000 UTC m=+0.016767279 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:10.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 podman[109110]: 2024-09-18 12:56:10.251904774 +0000 UTC m=+0.126324161 container create d134d17dcc9926d60c6d2c78b084f875e9d262a23e4355a2ec72eb6ad6616b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:56:10.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 podman[109110]: 2024-09-18 12:56:10.504852543 +0000 UTC m=+0.379271937 container init d134d17dcc9926d60c6d2c78b084f875e9d262a23e4355a2ec72eb6ad6616b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-18T12:56:10.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 podman[109110]: 2024-09-18 12:56:10.508639101 +0000 UTC m=+0.383058494 container start d134d17dcc9926d60c6d2c78b084f875e9d262a23e4355a2ec72eb6ad6616b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-18T12:56:10.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T12:56:10.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev), process ceph-mon, pid 2 2024-09-18T12:56:10.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: pidfile_write: ignore empty --pid-file 2024-09-18T12:56:10.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: load: jerasure load: lrc 2024-09-18T12:56:10.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: RocksDB version: 7.9.2 2024-09-18T12:56:10.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Git sha 0 2024-09-18T12:56:10.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Compile date 2024-09-17 15:59:30 2024-09-18T12:56:10.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: DB SUMMARY 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: DB Session ID: HNNT3R24165SLWGTAZR1 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: CURRENT file: CURRENT 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1519 Bytes 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi045/store.db dir, Total Num: 1, files: 000032.sst 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi045/store.db: 000030.log size: 2135111 ; 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.error_if_exists: 0 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.create_if_missing: 0 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.paranoid_checks: 1 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T12:56:10.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.env: 0x5605bc880120 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.info_log: 0x5605bef678e0 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.statistics: (nil) 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.use_fsync: 0 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_log_file_size: 0 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.allow_fallocate: 1 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T12:56:10.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.use_direct_reads: 0 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.db_log_dir: 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.wal_dir: 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T12:56:10.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.write_buffer_manager: 0x5605bef6bb80 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.unordered_write: 0 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T12:56:10.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.row_cache: None 2024-09-18T12:56:10.791 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.wal_filter: None 2024-09-18T12:56:10.791 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T12:56:10.791 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T12:56:10.791 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.two_write_queues: 0 2024-09-18T12:56:10.791 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T12:56:10.791 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.wal_compression: 0 2024-09-18T12:56:10.791 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.atomic_flush: 0 2024-09-18T12:56:10.792 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T12:56:10.792 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T12:56:10.792 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T12:56:10.792 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.log_readahead_size: 0 2024-09-18T12:56:10.792 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T12:56:10.792 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T12:56:10.792 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T12:56:10.792 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T12:56:10.792 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_background_jobs: 2 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_background_compactions: -1 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_subcompactions: 1 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T12:56:10.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_open_files: -1 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_background_flushes: -1 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Compression algorithms supported: 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: kZSTD supported: 0 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: kXpressCompression supported: 0 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: kBZip2Compression supported: 0 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: kLZ4Compression supported: 1 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: kZlibCompression supported: 1 2024-09-18T12:56:10.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: kSnappyCompression supported: 1 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi045/store.db/MANIFEST-000015 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.merge_operator: 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_filter: None 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T12:56:10.795 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5605bef67540) 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: cache_index_and_filter_blocks: 1 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: pin_top_level_index_and_filter: 1 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: index_type: 0 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: data_block_index_type: 0 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: index_shortening: 1 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: checksum: 4 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: no_block_cache: 0 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_cache: 0x5605bef5b610 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_cache_name: BinnedLRUCache 2024-09-18T12:56:10.796 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_cache_options: 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: capacity : 536870912 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: num_shard_bits : 4 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: strict_capacity_limit : 0 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: high_pri_pool_ratio: 0.000 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_cache_compressed: (nil) 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: persistent_cache: (nil) 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_size: 4096 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_size_deviation: 10 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_restart_interval: 16 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: index_block_restart_interval: 1 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: metadata_block_size: 4096 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: partition_filters: 0 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: use_delta_encoding: 1 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: filter_policy: bloomfilter 2024-09-18T12:56:10.797 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: whole_key_filtering: 1 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: verify_compression: 0 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: read_amp_bytes_per_bit: 0 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: format_version: 5 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: enable_index_compression: 1 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: block_align: 0 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: max_auto_readahead_size: 262144 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: prepopulate_block_cache: 0 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: initial_auto_readahead_size: 8192 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compression: NoCompression 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T12:56:10.798 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.num_levels: 7 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:56:10.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T12:56:10.800 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T12:56:10.801 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:56:10.802 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:56:10.803 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.ttl: 2592000 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:56:10.804 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi045/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12067, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 581d8cf1-85ad-4934-9ce5-71aad0cb895e 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664170535318, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664170542568, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 1883588, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12068, "largest_seqno": 13663, "table_properties": {"data_size": 1876064, "index_size": 4690, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1797, "raw_key_size": 16591, "raw_average_key_size": 23, "raw_value_size": 1860865, "raw_average_value_size": 2617, "num_data_blocks": 215, "num_entries": 711, "num_filter_entries": 711, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726664170, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "581d8cf1-85ad-4934-9ce5-71aad0cb895e", "db_session_id": "HNNT3R24165SLWGTAZR1", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664170542687, "job": 1, "event": "recovery_finished"} 2024-09-18T12:56:10.805 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi045/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5605bef8ae00 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: DB pointer 0x5605bf08c000 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ** DB Stats ** 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:56:10.806 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ** Compaction Stats [default] ** 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: L0 1/0 1.80 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 495.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: L6 1/0 7.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Sum 2/0 8.97 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 495.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 495.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ** Compaction Stats [default] ** 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:56:10.807 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 495.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Cumulative compaction: 0.00 GB write, 185.04 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Interval compaction: 0.00 GB write, 185.04 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:56:10.808 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Block cache BinnedLRUCache@0x5605bef5b610#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: starting mon.smithi045 rank 0 at public addrs [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] at bind addrs [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi045 fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: mon.smithi045@-1(???) e2 preinit fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: mon.smithi045@-1(???).mds e16 new map 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: mon.smithi045@-1(???).mds e16 print_map 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: e16 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: btime 2024-09-18T12:49:30:966010+0000 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: legacy client fscid: 1 2024-09-18T12:56:10.809 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Filesystem 'cephfs' (1) 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: fs_name cephfs 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: epoch 14 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: modified 2024-09-18T12:49:28.960615+0000 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: tableserver 0 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: root 0 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: session_timeout 60 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: session_autoclose 300 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: max_file_size 1099511627776 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: max_xattr_size 65536 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: required_client_features {} 2024-09-18T12:56:10.810 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: last_failure 0 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: last_failure_osd_epoch 0 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: max_mds 1 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: in 0 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: up {0=14566} 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: failed 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: damaged 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: stopped 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: data_pools [3] 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: metadata_pool 2 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: inline_data enabled 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: balancer 2024-09-18T12:56:10.811 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: bal_rank_mask -1 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: standby_count_wanted 1 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: qdb_cluster leader: 14566 members: 14566 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: [mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: [mds.cephfs.smithi045.favmzs{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: Standby daemons: 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: [mds.cephfs.smithi161.maxdew{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout: [mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: mon.smithi045@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: mon.smithi045@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:56:10.812 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: mon.smithi045@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:56:10.813 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: mon.smithi045@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:56:10.813 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 ceph-mon[109129]: mon.smithi045@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-18T12:56:10.813 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 bash[109110]: d134d17dcc9926d60c6d2c78b084f875e9d262a23e4355a2ec72eb6ad6616b79 2024-09-18T12:56:10.813 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:10 smithi045 systemd[1]: Started Ceph mon.smithi045 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:56:12.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:56:12.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: pgmap v102: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: mon.smithi045 calling monitor election 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: mon.smithi045 is new leader, mons smithi045,smithi161 in quorum (ranks 0,1) 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: monmap epoch 2 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: last_changed 2024-09-18T12:44:54.970577+0000 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: created 2024-09-18T12:42:31.142831+0000 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: min_mon_release 19 (squid) 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: election_strategy: 1 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.smithi045 2024-09-18T12:56:12.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: 1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.smithi161 2024-09-18T12:56:12.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:56:12.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T12:56:12.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: mgrmap e32: smithi045.brvbvl(active, since 3m), standbys: smithi161.yoflkm 2024-09-18T12:56:12.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:12.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:12.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:56:12.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: from='mgr.14774 ' entity='' 2024-09-18T12:56:12.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:12.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:12 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:56:12.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi045"}]: dispatch 2024-09-18T12:56:12.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-09-18T12:56:12.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:56:12.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:56:12.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: pgmap v102: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: mon.smithi045 calling monitor election 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: mon.smithi045 is new leader, mons smithi045,smithi161 in quorum (ranks 0,1) 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: monmap epoch 2 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: last_changed 2024-09-18T12:44:54.970577+0000 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: created 2024-09-18T12:42:31.142831+0000 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: min_mon_release 19 (squid) 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: election_strategy: 1 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.smithi045 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: 1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.smithi161 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: mgrmap e32: smithi045.brvbvl(active, since 3m), standbys: smithi161.yoflkm 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:12.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:56:12.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: from='mgr.14774 ' entity='' 2024-09-18T12:56:12.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:12.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:12 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:56:13.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:13 smithi045 ceph-mon[109129]: pgmap v103: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:13.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:13 smithi161 ceph-mon[35784]: pgmap v103: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:15.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:15 smithi045 ceph-mon[109129]: pgmap v104: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:15.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:15 smithi161 ceph-mon[35784]: pgmap v104: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:17 smithi045 ceph-mon[109129]: pgmap v105: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:17 smithi045 ceph-mon[109129]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:17.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:17 smithi045 ceph-mon[109129]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:17.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:17 smithi161 ceph-mon[35784]: pgmap v105: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:17.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:17 smithi161 ceph-mon[35784]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:17.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:17 smithi161 ceph-mon[35784]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:18.924 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:18 smithi045 ceph-mon[109129]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:18.924 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:18 smithi045 ceph-mon[109129]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:18.925 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:18 smithi045 ceph-mon[109129]: pgmap v106: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:18 smithi161 ceph-mon[35784]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:18 smithi161 ceph-mon[35784]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:18 smithi161 ceph-mon[35784]: pgmap v106: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:21.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:21 smithi045 ceph-mon[109129]: pgmap v107: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:21.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:21 smithi045 ceph-mon[109129]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:21.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:21 smithi045 ceph-mon[109129]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:21.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:21 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:56:21.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:21 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:56:21.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:21 smithi045 ceph-mon[109129]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:21.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:21 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:56:21.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:21 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:56:21.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:21 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T12:56:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:21 smithi161 ceph-mon[35784]: pgmap v107: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:21 smithi161 ceph-mon[35784]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:21 smithi161 ceph-mon[35784]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:56:21.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T12:56:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:21 smithi161 ceph-mon[35784]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T12:56:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T12:56:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:21 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T12:56:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:23 smithi045 ceph-mon[109129]: pgmap v108: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:23 smithi045 ceph-mon[109129]: Upgrade: Updating mon.smithi161 2024-09-18T12:56:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:23 smithi045 ceph-mon[109129]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:56:23.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:56:23.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:56:23.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:23 smithi045 ceph-mon[109129]: Deploying daemon mon.smithi161 on smithi161 2024-09-18T12:56:23.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:56:23.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:23 smithi161 ceph-mon[35784]: pgmap v108: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:23.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:23 smithi161 ceph-mon[35784]: Upgrade: Updating mon.smithi161 2024-09-18T12:56:23.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:23 smithi161 ceph-mon[35784]: from='mgr.14774 ' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:23.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:23 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T12:56:23.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:23 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T12:56:23.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:23 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T12:56:23.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:23 smithi161 ceph-mon[35784]: Deploying daemon mon.smithi161 on smithi161 2024-09-18T12:56:23.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:23 smithi161 ceph-mon[35784]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T12:56:24.395 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:24 smithi161 systemd[1]: Stopping Ceph mon.smithi161 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:56:24.395 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:24 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161[35780]: 2024-09-18T12:56:24.291+0000 7f294614d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi161 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:56:24.395 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:24 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161[35780]: 2024-09-18T12:56:24.291+0000 7f294614d640 -1 mon.smithi161@1(peon) e2 *** Got Signal Terminated *** 2024-09-18T12:56:24.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:24 smithi161 podman[80131]: 2024-09-18 12:56:24.394980796 +0000 UTC m=+0.182462669 container died 34d6a3464162a729e8e8c147ce3c5ee1e52895c8da5666407d112accd00fb3da (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:56:25.026 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:24 smithi161 podman[80131]: 2024-09-18 12:56:24.758169452 +0000 UTC m=+0.545651319 container cleanup 34d6a3464162a729e8e8c147ce3c5ee1e52895c8da5666407d112accd00fb3da (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-18T12:56:25.027 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:24 smithi161 bash[80131]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161 2024-09-18T12:56:25.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 podman[80144]: 2024-09-18 12:56:25.026375341 +0000 UTC m=+0.629468605 container remove 34d6a3464162a729e8e8c147ce3c5ee1e52895c8da5666407d112accd00fb3da (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97) 2024-09-18T12:56:25.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi161.service: Deactivated successfully. 2024-09-18T12:56:25.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 systemd[1]: Stopped Ceph mon.smithi161 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:56:25.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi161.service: Consumed 7.056s CPU time. 2024-09-18T12:56:25.691 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 systemd[1]: Starting Ceph mon.smithi161 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:56:25.691 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 podman[80273]: 2024-09-18 12:56:25.585880641 +0000 UTC m=+0.106916678 container create e25ec626c0557998d5029369964d18fa99798fc62a83c9caca6cc56453b95bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:56:25.691 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 podman[80273]: 2024-09-18 12:56:25.494826516 +0000 UTC m=+0.015862522 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 podman[80273]: 2024-09-18 12:56:25.81312381 +0000 UTC m=+0.334159810 container init e25ec626c0557998d5029369964d18fa99798fc62a83c9caca6cc56453b95bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0) 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 podman[80273]: 2024-09-18 12:56:25.816476662 +0000 UTC m=+0.337512658 container start e25ec626c0557998d5029369964d18fa99798fc62a83c9caca6cc56453b95bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev), process ceph-mon, pid 2 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: pidfile_write: ignore empty --pid-file 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: load: jerasure load: lrc 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: RocksDB version: 7.9.2 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Git sha 0 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Compile date 2024-09-17 15:59:30 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: DB SUMMARY 2024-09-18T12:56:26.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: DB Session ID: NG3BES0CIFKP2QZPUL4X 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: CURRENT file: CURRENT 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1412 Bytes 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi161/store.db dir, Total Num: 1, files: 000027.sst 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi161/store.db: 000025.log size: 3761088 ; 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.error_if_exists: 0 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.create_if_missing: 0 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.paranoid_checks: 1 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.env: 0x562f9f58d120 2024-09-18T12:56:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.info_log: 0x562fa1dd18e0 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.statistics: (nil) 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.use_fsync: 0 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_log_file_size: 0 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.allow_fallocate: 1 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T12:56:26.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.use_direct_reads: 0 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.db_log_dir: 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.wal_dir: 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.write_buffer_manager: 0x562fa1dd5b80 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T12:56:26.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.unordered_write: 0 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.row_cache: None 2024-09-18T12:56:26.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.wal_filter: None 2024-09-18T12:56:26.049 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T12:56:26.049 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T12:56:26.049 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.two_write_queues: 0 2024-09-18T12:56:26.049 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T12:56:26.049 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.wal_compression: 0 2024-09-18T12:56:26.049 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.atomic_flush: 0 2024-09-18T12:56:26.049 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T12:56:26.049 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T12:56:26.049 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.log_readahead_size: 0 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_background_jobs: 2 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_background_compactions: -1 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_subcompactions: 1 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T12:56:26.050 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_open_files: -1 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_background_flushes: -1 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Compression algorithms supported: 2024-09-18T12:56:26.051 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: kZSTD supported: 0 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: kXpressCompression supported: 0 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: kBZip2Compression supported: 0 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: kLZ4Compression supported: 1 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: kZlibCompression supported: 1 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: kSnappyCompression supported: 1 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000010 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T12:56:26.052 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.merge_operator: 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_filter: None 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562fa1dd1540) 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: cache_index_and_filter_blocks: 1 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: pin_top_level_index_and_filter: 1 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_type: 0 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_block_index_type: 0 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_shortening: 1 2024-09-18T12:56:26.053 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: checksum: 4 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: no_block_cache: 0 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache: 0x562fa1dc5610 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_name: BinnedLRUCache 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_options: 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: capacity : 536870912 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: num_shard_bits : 4 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: strict_capacity_limit : 0 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: high_pri_pool_ratio: 0.000 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_compressed: (nil) 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: persistent_cache: (nil) 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_size: 4096 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_size_deviation: 10 2024-09-18T12:56:26.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_restart_interval: 16 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_block_restart_interval: 1 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: metadata_block_size: 4096 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: partition_filters: 0 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: use_delta_encoding: 1 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: filter_policy: bloomfilter 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: whole_key_filtering: 1 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: verify_compression: 0 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: read_amp_bytes_per_bit: 0 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: format_version: 5 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: enable_index_compression: 1 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_align: 0 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_auto_readahead_size: 262144 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: prepopulate_block_cache: 0 2024-09-18T12:56:26.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: initial_auto_readahead_size: 8192 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compression: NoCompression 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.num_levels: 7 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T12:56:26.056 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T12:56:26.057 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T12:56:26.058 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T12:56:26.059 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.inplace_update_support: 0 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.bloom_locality: 0 2024-09-18T12:56:26.060 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.max_successive_merges: 0 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.ttl: 2592000 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.enable_blob_files: false 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.min_blob_size: 0 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T12:56:26.061 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12285, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c5b14271-9da6-43ab-9834-34b7fa2680ed 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664185842946, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664185852158, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2192245, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12290, "largest_seqno": 14334, "table_properties": {"data_size": 2183617, "index_size": 5470, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2117, "raw_key_size": 19177, "raw_average_key_size": 23, "raw_value_size": 2166020, "raw_average_value_size": 2641, "num_data_blocks": 251, "num_entries": 820, "num_filter_entries": 820, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726664185, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c5b14271-9da6-43ab-9834-34b7fa2680ed", "db_session_id": "NG3BES0CIFKP2QZPUL4X", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-18T12:56:26.062 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726664185852344, "job": 1, "event": "recovery_finished"} 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi161/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562fa1df4e00 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: DB pointer 0x562fa1ef6000 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** DB Stats ** 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:56:26.063 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: L0 1/0 2.09 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 559.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: L6 1/0 7.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Sum 2/0 9.27 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 559.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 559.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T12:56:26.064 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 559.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative compaction: 0.00 GB write, 175.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval compaction: 0.00 GB write, 175.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T12:56:26.065 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Block cache BinnedLRUCache@0x562fa1dc5610#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: starting mon.smithi161 rank 1 at public addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] at bind addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi161 fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: mon.smithi161@-1(???) e2 preinit fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: mon.smithi161@-1(???).mds e16 new map 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: mon.smithi161@-1(???).mds e16 print_map 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: e16 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: btime 2024-09-18T12:49:30:966010+0000 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: legacy client fscid: 1 2024-09-18T12:56:26.066 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Filesystem 'cephfs' (1) 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: fs_name cephfs 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: epoch 14 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: modified 2024-09-18T12:49:28.960615+0000 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: tableserver 0 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: root 0 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: session_timeout 60 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: session_autoclose 300 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_file_size 1099511627776 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_xattr_size 65536 2024-09-18T12:56:26.067 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: required_client_features {} 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: last_failure 0 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: last_failure_osd_epoch 0 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_mds 1 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: in 0 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: up {0=14566} 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: failed 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: damaged 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: stopped 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_pools [3] 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: metadata_pool 2 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: inline_data enabled 2024-09-18T12:56:26.068 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: balancer 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: bal_rank_mask -1 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: standby_count_wanted 1 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: qdb_cluster leader: 14566 members: 14566 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi045.favmzs{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Standby daemons: 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi161.maxdew{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: mon.smithi161@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: mon.smithi161@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: mon.smithi161@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:56:26.069 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: mon.smithi161@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T12:56:26.070 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 ceph-mon[80292]: mon.smithi161@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-18T12:56:26.070 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 bash[80273]: e25ec626c0557998d5029369964d18fa99798fc62a83c9caca6cc56453b95bc2 2024-09-18T12:56:26.070 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:25 smithi161 systemd[1]: Started Ceph mon.smithi161 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:56:27.210 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:56:27.210 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: mon.smithi161 calling monitor election 2024-09-18T12:56:27.210 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: mon.smithi045 calling monitor election 2024-09-18T12:56:27.210 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: mon.smithi045 is new leader, mons smithi045,smithi161 in quorum (ranks 0,1) 2024-09-18T12:56:27.210 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: monmap epoch 2 2024-09-18T12:56:27.210 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: last_changed 2024-09-18T12:44:54.970577+0000 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: created 2024-09-18T12:42:31.142831+0000 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: min_mon_release 19 (squid) 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: election_strategy: 1 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.smithi045 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: 1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.smithi161 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: mgrmap e32: smithi045.brvbvl(active, since 3m), standbys: smithi161.yoflkm 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:27.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:27.212 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:27.212 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:26 smithi161 ceph-mon[80292]: pgmap v110: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:27.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: mon.smithi161 calling monitor election 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: mon.smithi045 calling monitor election 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: mon.smithi045 is new leader, mons smithi045,smithi161 in quorum (ranks 0,1) 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: monmap epoch 2 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: fsid 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: last_changed 2024-09-18T12:44:54.970577+0000 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: created 2024-09-18T12:42:31.142831+0000 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: min_mon_release 19 (squid) 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: election_strategy: 1 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.smithi045 2024-09-18T12:56:27.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: 1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.smithi161 2024-09-18T12:56:27.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T12:56:27.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T12:56:27.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: mgrmap e32: smithi045.brvbvl(active, since 3m), standbys: smithi161.yoflkm 2024-09-18T12:56:27.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:27.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:27.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:56:27.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:27.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:27.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:27.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:26 smithi045 ceph-mon[109129]: pgmap v110: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:29.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:29 smithi045 ceph-mon[109129]: pgmap v111: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:29.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:29.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:29.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:29.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:29 smithi161 ceph-mon[80292]: pgmap v111: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:31.537 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:31 smithi045 ceph-mon[109129]: pgmap v112: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:31.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:31 smithi161 ceph-mon[80292]: pgmap v112: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:33.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: pgmap v113: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:33.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:33.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:33.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:33.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:33.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:33.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:33.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:33.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:33.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: Upgrade: Setting container_image for all mon 2024-09-18T12:56:33.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:33.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi045"} : dispatch 2024-09-18T12:56:33.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi045"}]': finished 2024-09-18T12:56:33.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"} : dispatch 2024-09-18T12:56:33.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"}]': finished 2024-09-18T12:56:33.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: pgmap v113: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:33.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:33.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:33.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: Upgrade: Setting container_image for all mon 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi045"} : dispatch 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi045"}]': finished 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"} : dispatch 2024-09-18T12:56:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"}]': finished 2024-09-18T12:56:35.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:34 smithi045 ceph-mon[109129]: Upgrade: Updating crash.smithi045 (1/2) 2024-09-18T12:56:35.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:34 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:35.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:34 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi045", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:56:35.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:34 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:35.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:34 smithi045 ceph-mon[109129]: Deploying daemon crash.smithi045 on smithi045 2024-09-18T12:56:35.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:34 smithi045 ceph-mon[109129]: pgmap v114: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:34 smithi161 ceph-mon[80292]: Upgrade: Updating crash.smithi045 (1/2) 2024-09-18T12:56:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:34 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:34 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi045", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:56:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:34 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:34 smithi161 ceph-mon[80292]: Deploying daemon crash.smithi045 on smithi045 2024-09-18T12:56:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:34 smithi161 ceph-mon[80292]: pgmap v114: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:36.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.588+0000 7f7e5579a640 1 -- 172.21.15.45:0/1387799702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e50102ad0 msgr2=0x7f7e50102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.588+0000 7f7e5579a640 1 --2- 172.21.15.45:0/1387799702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e50102ad0 0x7f7e50102eb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009880 tx=0x7f7e4002a530 comp rx=0 tx=0).stop 2024-09-18T12:56:36.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.588+0000 7f7e5579a640 1 -- 172.21.15.45:0/1387799702 shutdown_connections 2024-09-18T12:56:36.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.588+0000 7f7e5579a640 1 --2- 172.21.15.45:0/1387799702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e501033f0 0x7f7e5010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.588+0000 7f7e5579a640 1 --2- 172.21.15.45:0/1387799702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e50102ad0 0x7f7e50102eb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.588+0000 7f7e5579a640 1 -- 172.21.15.45:0/1387799702 >> 172.21.15.45:0/1387799702 conn(0x7f7e500fc510 msgr2=0x7f7e500fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.588+0000 7f7e5579a640 1 -- 172.21.15.45:0/1387799702 shutdown_connections 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.588+0000 7f7e5579a640 1 -- 172.21.15.45:0/1387799702 wait complete. 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.589+0000 7f7e5579a640 1 Processor -- start 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.589+0000 7f7e5579a640 1 -- start start 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.589+0000 7f7e5579a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e50102ad0 0x7f7e50100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.589+0000 7f7e5579a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e501033f0 0x7f7e50100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.589+0000 7f7e5579a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5010ee00 con 0x7f7e501033f0 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.589+0000 7f7e5579a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5010ec80 con 0x7f7e50102ad0 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.589+0000 7f7e4e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e501033f0 0x7f7e50100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.589+0000 7f7e4e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e501033f0 0x7f7e50100c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49654/0 (socket says 172.21.15.45:49654) 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.589+0000 7f7e4e7fc640 1 -- 172.21.15.45:0/320000642 learned_addr learned my addr 172.21.15.45:0/320000642 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:36.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.590+0000 7f7e4effd640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e50102ad0 0x7f7e50100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.590+0000 7f7e4e7fc640 1 -- 172.21.15.45:0/320000642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e50102ad0 msgr2=0x7f7e50100730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.590+0000 7f7e4e7fc640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e50102ad0 0x7f7e50100730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.590+0000 7f7e4e7fc640 1 -- 172.21.15.45:0/320000642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e501011b0 con 0x7f7e501033f0 2024-09-18T12:56:36.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.590+0000 7f7e4e7fc640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e501033f0 0x7f7e50100c70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400c8f0 tx=0x7f7e4400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:36.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.590+0000 7f7e37fff640 1 -- 172.21.15.45:0/320000642 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e4400ae50 con 0x7f7e501033f0 2024-09-18T12:56:36.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.590+0000 7f7e5579a640 1 -- 172.21.15.45:0/320000642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e501014a0 con 0x7f7e501033f0 2024-09-18T12:56:36.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.590+0000 7f7e37fff640 1 -- 172.21.15.45:0/320000642 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7e44005020 con 0x7f7e501033f0 2024-09-18T12:56:36.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.590+0000 7f7e5579a640 1 -- 172.21.15.45:0/320000642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e501a3e90 con 0x7f7e501033f0 2024-09-18T12:56:36.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.590+0000 7f7e37fff640 1 -- 172.21.15.45:0/320000642 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e44004d70 con 0x7f7e501033f0 2024-09-18T12:56:36.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.591+0000 7f7e5579a640 1 -- 172.21.15.45:0/320000642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e5006ada0 con 0x7f7e501033f0 2024-09-18T12:56:36.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.593+0000 7f7e37fff640 1 -- 172.21.15.45:0/320000642 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f7e440051d0 con 0x7f7e501033f0 2024-09-18T12:56:36.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.593+0000 7f7e37fff640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7e3807b130 0x7f7e3807d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.593+0000 7f7e37fff640 1 -- 172.21.15.45:0/320000642 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f7e4409dca0 con 0x7f7e501033f0 2024-09-18T12:56:36.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.593+0000 7f7e4effd640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7e3807b130 0x7f7e3807d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.594+0000 7f7e4effd640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7e3807b130 0x7f7e3807d5f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7e40000c00 tx=0x7f7e40031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:36.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.600+0000 7f7e37fff640 1 -- 172.21.15.45:0/320000642 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7e440a2070 con 0x7f7e501033f0 2024-09-18T12:56:36.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.815+0000 7f7e5579a640 1 -- 172.21.15.45:0/320000642 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7e50062630 con 0x7f7e3807b130 2024-09-18T12:56:36.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.817+0000 7f7e37fff640 1 -- 172.21.15.45:0/320000642 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f7e50062630 con 0x7f7e3807b130 2024-09-18T12:56:36.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 -- 172.21.15.45:0/320000642 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7e3807b130 msgr2=0x7f7e3807d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7e3807b130 0x7f7e3807d5f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7e40000c00 tx=0x7f7e40031400 comp rx=0 tx=0).stop 2024-09-18T12:56:36.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 -- 172.21.15.45:0/320000642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e501033f0 msgr2=0x7f7e50100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e501033f0 0x7f7e50100c70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400c8f0 tx=0x7f7e4400cdb0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 -- 172.21.15.45:0/320000642 shutdown_connections 2024-09-18T12:56:36.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7e3807b130 0x7f7e3807d5f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e501033f0 0x7f7e50100c70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 --2- 172.21.15.45:0/320000642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e50102ad0 0x7f7e50100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 -- 172.21.15.45:0/320000642 >> 172.21.15.45:0/320000642 conn(0x7f7e500fc510 msgr2=0x7f7e50108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:36.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 -- 172.21.15.45:0/320000642 shutdown_connections 2024-09-18T12:56:36.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.819+0000 7f7e5579a640 1 -- 172.21.15.45:0/320000642 wait complete. 2024-09-18T12:56:36.830 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:56:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.910+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1113878315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f84101050 msgr2=0x7f0f8410dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.910+0000 7f0f8bfde640 1 --2- 172.21.15.45:0/1113878315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f84101050 0x7f0f8410dd10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009880 tx=0x7f0f7802a490 comp rx=0 tx=0).stop 2024-09-18T12:56:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.910+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1113878315 shutdown_connections 2024-09-18T12:56:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.910+0000 7f0f8bfde640 1 --2- 172.21.15.45:0/1113878315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f84101050 0x7f0f8410dd10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.910+0000 7f0f8bfde640 1 --2- 172.21.15.45:0/1113878315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f841006a0 0x7f0f84100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.910+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1113878315 >> 172.21.15.45:0/1113878315 conn(0x7f0f840fc550 msgr2=0x7f0f840fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.910+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1113878315 shutdown_connections 2024-09-18T12:56:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.910+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1113878315 wait complete. 2024-09-18T12:56:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.911+0000 7f0f8bfde640 1 Processor -- start 2024-09-18T12:56:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.911+0000 7f0f8bfde640 1 -- start start 2024-09-18T12:56:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.911+0000 7f0f8bfde640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f841006a0 0x7f0f8419f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.911+0000 7f0f8bfde640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f84101050 0x7f0f8419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.911+0000 7f0f8bfde640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84110f30 con 0x7f0f84101050 2024-09-18T12:56:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.911+0000 7f0f8bfde640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84110db0 con 0x7f0f841006a0 2024-09-18T12:56:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.911+0000 7f0f89579640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f84101050 0x7f0f8419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.911+0000 7f0f89579640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f84101050 0x7f0f8419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49676/0 (socket says 172.21.15.45:49676) 2024-09-18T12:56:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.911+0000 7f0f89579640 1 -- 172.21.15.45:0/1198303997 learned_addr learned my addr 172.21.15.45:0/1198303997 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.911+0000 7f0f89d7a640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f841006a0 0x7f0f8419f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.912+0000 7f0f89579640 1 -- 172.21.15.45:0/1198303997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f841006a0 msgr2=0x7f0f8419f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.912+0000 7f0f89579640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f841006a0 0x7f0f8419f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.912+0000 7f0f89579640 1 -- 172.21.15.45:0/1198303997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f84199940 con 0x7f0f84101050 2024-09-18T12:56:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.912+0000 7f0f89579640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f84101050 0x7f0f8419fcc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0f78031460 tx=0x7f0f780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.912+0000 7f0f82ffd640 1 -- 172.21.15.45:0/1198303997 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f7803f070 con 0x7f0f84101050 2024-09-18T12:56:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.912+0000 7f0f82ffd640 1 -- 172.21.15.45:0/1198303997 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f78004b10 con 0x7f0f84101050 2024-09-18T12:56:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.912+0000 7f0f82ffd640 1 -- 172.21.15.45:0/1198303997 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f78035030 con 0x7f0f84101050 2024-09-18T12:56:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.912+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1198303997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f84199c30 con 0x7f0f84101050 2024-09-18T12:56:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.913+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1198303997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8419a160 con 0x7f0f84101050 2024-09-18T12:56:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.914+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1198303997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8406a520 con 0x7f0f84101050 2024-09-18T12:56:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.914+0000 7f0f82ffd640 1 -- 172.21.15.45:0/1198303997 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f0f78042070 con 0x7f0f84101050 2024-09-18T12:56:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.915+0000 7f0f82ffd640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0f6c07b0a0 0x7f0f6c07d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.915+0000 7f0f82ffd640 1 -- 172.21.15.45:0/1198303997 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f0f780be7d0 con 0x7f0f84101050 2024-09-18T12:56:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.915+0000 7f0f89d7a640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0f6c07b0a0 0x7f0f6c07d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.916+0000 7f0f89d7a640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0f6c07b0a0 0x7f0f6c07d560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f8419aa80 tx=0x7f0f7c00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:36.920+0000 7f0f82ffd640 1 -- 172.21.15.45:0/1198303997 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0f78089e80 con 0x7f0f84101050 2024-09-18T12:56:37.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.136+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1198303997 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0f8419ae70 con 0x7f0f6c07b0a0 2024-09-18T12:56:37.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.137+0000 7f0f82ffd640 1 -- 172.21.15.45:0/1198303997 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f0f8419ae70 con 0x7f0f6c07b0a0 2024-09-18T12:56:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.139+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1198303997 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0f6c07b0a0 msgr2=0x7f0f6c07d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.139+0000 7f0f8bfde640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0f6c07b0a0 0x7f0f6c07d560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f8419aa80 tx=0x7f0f7c00b390 comp rx=0 tx=0).stop 2024-09-18T12:56:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.139+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1198303997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f84101050 msgr2=0x7f0f8419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.139+0000 7f0f8bfde640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f84101050 0x7f0f8419fcc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0f78031460 tx=0x7f0f780045e0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.140+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1198303997 shutdown_connections 2024-09-18T12:56:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.140+0000 7f0f8bfde640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0f6c07b0a0 0x7f0f6c07d560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.140+0000 7f0f8bfde640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f84101050 0x7f0f8419fcc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.140+0000 7f0f8bfde640 1 --2- 172.21.15.45:0/1198303997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f841006a0 0x7f0f8419f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.140+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1198303997 >> 172.21.15.45:0/1198303997 conn(0x7f0f840fc550 msgr2=0x7f0f840fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.140+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1198303997 shutdown_connections 2024-09-18T12:56:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.140+0000 7f0f8bfde640 1 -- 172.21.15.45:0/1198303997 wait complete. 2024-09-18T12:56:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.224+0000 7f07caaca640 1 -- 172.21.15.45:0/3292401701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4107900 msgr2=0x7f07c4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.224+0000 7f07caaca640 1 --2- 172.21.15.45:0/3292401701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4107900 0x7f07c4107ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009880 tx=0x7f07c002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.224+0000 7f07caaca640 1 -- 172.21.15.45:0/3292401701 shutdown_connections 2024-09-18T12:56:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.224+0000 7f07caaca640 1 --2- 172.21.15.45:0/3292401701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07c4101900 0x7f07c4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.224+0000 7f07caaca640 1 --2- 172.21.15.45:0/3292401701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4107900 0x7f07c4107ce0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.224+0000 7f07caaca640 1 -- 172.21.15.45:0/3292401701 >> 172.21.15.45:0/3292401701 conn(0x7f07c40fd600 msgr2=0x7f07c40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.224+0000 7f07caaca640 1 -- 172.21.15.45:0/3292401701 shutdown_connections 2024-09-18T12:56:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.224+0000 7f07caaca640 1 -- 172.21.15.45:0/3292401701 wait complete. 2024-09-18T12:56:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.225+0000 7f07caaca640 1 Processor -- start 2024-09-18T12:56:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.225+0000 7f07caaca640 1 -- start start 2024-09-18T12:56:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07caaca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07c4101900 0x7f07c419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07caaca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4107900 0x7f07c419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07caaca640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f07c410ee30 con 0x7f07c4107900 2024-09-18T12:56:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07caaca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f07c410ecb0 con 0x7f07c4101900 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4107900 0x7f07c419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4107900 0x7f07c419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49698/0 (socket says 172.21.15.45:49698) 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07bbfff640 1 -- 172.21.15.45:0/4273267615 learned_addr learned my addr 172.21.15.45:0/4273267615 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07c8866640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07c4101900 0x7f07c419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07bbfff640 1 -- 172.21.15.45:0/4273267615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07c4101900 msgr2=0x7f07c419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07bbfff640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07c4101900 0x7f07c419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07bbfff640 1 -- 172.21.15.45:0/4273267615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c4197860 con 0x7f07c4107900 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07bbfff640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4107900 0x7f07c419dbe0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07b400b420 tx=0x7f07b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.226+0000 7f07b9ffb640 1 -- 172.21.15.45:0/4273267615 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07b4011630 con 0x7f07c4107900 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.227+0000 7f07caaca640 1 -- 172.21.15.45:0/4273267615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c4197b50 con 0x7f07c4107900 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.227+0000 7f07b9ffb640 1 -- 172.21.15.45:0/4273267615 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07b4016070 con 0x7f07c4107900 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.227+0000 7f07b9ffb640 1 -- 172.21.15.45:0/4273267615 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07b4010d40 con 0x7f07c4107900 2024-09-18T12:56:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.227+0000 7f07caaca640 1 -- 172.21.15.45:0/4273267615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c41980e0 con 0x7f07c4107900 2024-09-18T12:56:37.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.228+0000 7f07caaca640 1 -- 172.21.15.45:0/4273267615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c4103040 con 0x7f07c4107900 2024-09-18T12:56:37.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.228+0000 7f07b9ffb640 1 -- 172.21.15.45:0/4273267615 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f07b401b460 con 0x7f07c4107900 2024-09-18T12:56:37.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.229+0000 7f07b9ffb640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f07ac07af30 0x7f07ac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:37.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.229+0000 7f07b9ffb640 1 -- 172.21.15.45:0/4273267615 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f07b409d670 con 0x7f07c4107900 2024-09-18T12:56:37.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.229+0000 7f07c8866640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f07ac07af30 0x7f07ac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:37.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.229+0000 7f07c8866640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f07ac07af30 0x7f07ac07d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f07c0000c00 tx=0x7f07c0031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:37.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.233+0000 7f07b9ffb640 1 -- 172.21.15.45:0/4273267615 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f07b4068cc0 con 0x7f07c4107900 2024-09-18T12:56:37.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.431+0000 7f07caaca640 1 -- 172.21.15.45:0/4273267615 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f07c4198d90 con 0x7f07ac07af30 2024-09-18T12:56:37.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.450+0000 7f07b9ffb640 1 -- 172.21.15.45:0/4273267615 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f07c4198d90 con 0x7f07ac07af30 2024-09-18T12:56:37.453 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:56:37.453 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (102s) 20s ago 12m 20.0M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T12:56:37.453 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (4m) 20s ago 12m 8816k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:56:37.453 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (4m) 8s ago 11m 8321k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:56:37.453 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (12m) 20s ago 12m 6899k - 19.1.1-330-gc2ddf972 ebb0615149de 1ca618be824f 2024-09-18T12:56:37.453 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (11m) 8s ago 11m 6903k - 19.1.1-330-gc2ddf972 ebb0615149de afefd285d85b 2024-09-18T12:56:37.453 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (79s) 20s ago 12m 75.6M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T12:56:37.453 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (7m) 20s ago 7m 91.9M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (7m) 20s ago 7m 151M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (7m) 8s ago 7m 17.3M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (7m) 8s ago 7m 15.8M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (3m) 20s ago 13m 522M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (2m) 8s ago 11m 457M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (27s) 20s ago 14m 23.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (11s) 8s ago 11m 20.8M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (2m) 20s ago 12m 11.2M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (2m) 8s ago 11m 10.4M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (10m) 20s ago 10m 206M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 0b771fac9ae6 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (9m) 20s ago 10m 224M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (9m) 20s ago 9m 186M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:56:37.454 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (9m) 8s ago 9m 242M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:56:37.455 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (8m) 8s ago 8m 214M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:56:37.455 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (8m) 8s ago 8m 199M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:56:37.455 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (2m) 20s ago 12m 47.5M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:56:37.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 -- 172.21.15.45:0/4273267615 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f07ac07af30 msgr2=0x7f07ac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f07ac07af30 0x7f07ac07d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f07c0000c00 tx=0x7f07c0031400 comp rx=0 tx=0).stop 2024-09-18T12:56:37.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 -- 172.21.15.45:0/4273267615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4107900 msgr2=0x7f07c419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4107900 0x7f07c419dbe0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07b400b420 tx=0x7f07b400b8e0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 -- 172.21.15.45:0/4273267615 shutdown_connections 2024-09-18T12:56:37.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f07ac07af30 0x7f07ac07d3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4107900 0x7f07c419dbe0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 --2- 172.21.15.45:0/4273267615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07c4101900 0x7f07c419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 -- 172.21.15.45:0/4273267615 >> 172.21.15.45:0/4273267615 conn(0x7f07c40fd600 msgr2=0x7f07c40fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:37.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 -- 172.21.15.45:0/4273267615 shutdown_connections 2024-09-18T12:56:37.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.453+0000 7f07caaca640 1 -- 172.21.15.45:0/4273267615 wait complete. 2024-09-18T12:56:37.496 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:37 smithi045 ceph-mon[109129]: pgmap v115: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:37.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:37 smithi161 ceph-mon[80292]: pgmap v115: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:37.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.541+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3945020607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b24103430 msgr2=0x7f5b2410b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.541+0000 7f5b29e0e640 1 --2- 172.21.15.45:0/3945020607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b24103430 0x7f5b2410b920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b180098b0 tx=0x7f5b1802a560 comp rx=0 tx=0).stop 2024-09-18T12:56:37.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.542+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3945020607 shutdown_connections 2024-09-18T12:56:37.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.542+0000 7f5b29e0e640 1 --2- 172.21.15.45:0/3945020607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b24103430 0x7f5b2410b920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.542+0000 7f5b29e0e640 1 --2- 172.21.15.45:0/3945020607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b24102b10 0x7f5b24102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.542+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3945020607 >> 172.21.15.45:0/3945020607 conn(0x7f5b240fc550 msgr2=0x7f5b240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:37.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.542+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3945020607 shutdown_connections 2024-09-18T12:56:37.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.542+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3945020607 wait complete. 2024-09-18T12:56:37.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.542+0000 7f5b29e0e640 1 Processor -- start 2024-09-18T12:56:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.542+0000 7f5b29e0e640 1 -- start start 2024-09-18T12:56:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b29e0e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b24102b10 0x7f5b2419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b29e0e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b24103430 0x7f5b2419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b29e0e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2410edc0 con 0x7f5b24103430 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b29e0e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2410ec40 con 0x7f5b24102b10 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b22ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b24103430 0x7f5b2419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b22ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b24103430 0x7f5b2419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49736/0 (socket says 172.21.15.45:49736) 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b22ffd640 1 -- 172.21.15.45:0/3331744842 learned_addr learned my addr 172.21.15.45:0/3331744842 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b237fe640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b24102b10 0x7f5b2419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b22ffd640 1 -- 172.21.15.45:0/3331744842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b24102b10 msgr2=0x7f5b2419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b22ffd640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b24102b10 0x7f5b2419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b22ffd640 1 -- 172.21.15.45:0/3331744842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b241977f0 con 0x7f5b24103430 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b22ffd640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b24103430 0x7f5b2419dbb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b18031460 tx=0x7f5b180045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.543+0000 7f5b20ff9640 1 -- 172.21.15.45:0/3331744842 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b1803f070 con 0x7f5b24103430 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.544+0000 7f5b20ff9640 1 -- 172.21.15.45:0/3331744842 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b180035f0 con 0x7f5b24103430 2024-09-18T12:56:37.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.544+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3331744842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b24197a80 con 0x7f5b24103430 2024-09-18T12:56:37.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.544+0000 7f5b20ff9640 1 -- 172.21.15.45:0/3331744842 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b18035030 con 0x7f5b24103430 2024-09-18T12:56:37.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.544+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3331744842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b24197fb0 con 0x7f5b24103430 2024-09-18T12:56:37.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.545+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3331744842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2406a520 con 0x7f5b24103430 2024-09-18T12:56:37.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.545+0000 7f5b20ff9640 1 -- 172.21.15.45:0/3331744842 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f5b18042070 con 0x7f5b24103430 2024-09-18T12:56:37.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.546+0000 7f5b20ff9640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5b0c07af80 0x7f5b0c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:37.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.546+0000 7f5b20ff9640 1 -- 172.21.15.45:0/3331744842 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f5b180be7c0 con 0x7f5b24103430 2024-09-18T12:56:37.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.546+0000 7f5b237fe640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5b0c07af80 0x7f5b0c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:37.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.546+0000 7f5b237fe640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5b0c07af80 0x7f5b0c07d440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400bbe0 tx=0x7f5b1400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:37.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.551+0000 7f5b20ff9640 1 -- 172.21.15.45:0/3331744842 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5b18089e90 con 0x7f5b24103430 2024-09-18T12:56:37.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.808+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3331744842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5b24105fa0 con 0x7f5b24103430 2024-09-18T12:56:37.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.809+0000 7f5b20ff9640 1 -- 172.21.15.45:0/3331744842 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7f5b1808ed40 con 0x7f5b24103430 2024-09-18T12:56:37.811 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:56:37.811 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:56:37.812 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 10, 2024-09-18T12:56:37.813 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:56:37.813 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:56:37.813 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:56:37.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3331744842 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5b0c07af80 msgr2=0x7f5b0c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5b0c07af80 0x7f5b0c07d440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400bbe0 tx=0x7f5b1400b390 comp rx=0 tx=0).stop 2024-09-18T12:56:37.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3331744842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b24103430 msgr2=0x7f5b2419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b24103430 0x7f5b2419dbb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b18031460 tx=0x7f5b180045c0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3331744842 shutdown_connections 2024-09-18T12:56:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5b0c07af80 0x7f5b0c07d440 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b24103430 0x7f5b2419dbb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 --2- 172.21.15.45:0/3331744842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b24102b10 0x7f5b2419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3331744842 >> 172.21.15.45:0/3331744842 conn(0x7f5b240fc550 msgr2=0x7f5b24103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3331744842 shutdown_connections 2024-09-18T12:56:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.811+0000 7f5b29e0e640 1 -- 172.21.15.45:0/3331744842 wait complete. 2024-09-18T12:56:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.895+0000 7f3f612cd640 1 -- 172.21.15.45:0/2667912346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c100800 msgr2=0x7f3f5c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.895+0000 7f3f612cd640 1 --2- 172.21.15.45:0/2667912346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c100800 0x7f3f5c100c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009880 tx=0x7f3f5002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.895+0000 7f3f612cd640 1 -- 172.21.15.45:0/2667912346 shutdown_connections 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.895+0000 7f3f612cd640 1 --2- 172.21.15.45:0/2667912346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c100800 0x7f3f5c100c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.895+0000 7f3f612cd640 1 --2- 172.21.15.45:0/2667912346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f5c106800 0x7f3f5c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.895+0000 7f3f612cd640 1 -- 172.21.15.45:0/2667912346 >> 172.21.15.45:0/2667912346 conn(0x7f3f5c0fc520 msgr2=0x7f3f5c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.895+0000 7f3f612cd640 1 -- 172.21.15.45:0/2667912346 shutdown_connections 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.895+0000 7f3f612cd640 1 -- 172.21.15.45:0/2667912346 wait complete. 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.896+0000 7f3f612cd640 1 Processor -- start 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.896+0000 7f3f612cd640 1 -- start start 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.896+0000 7f3f612cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c100800 0x7f3f5c0fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.896+0000 7f3f612cd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f5c106800 0x7f3f5c0fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.896+0000 7f3f612cd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c10dcd0 con 0x7f3f5c100800 2024-09-18T12:56:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.896+0000 7f3f612cd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c10db50 con 0x7f3f5c106800 2024-09-18T12:56:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.896+0000 7f3f5affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c100800 0x7f3f5c0fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.896+0000 7f3f5affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c100800 0x7f3f5c0fcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49758/0 (socket says 172.21.15.45:49758) 2024-09-18T12:56:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.896+0000 7f3f5affd640 1 -- 172.21.15.45:0/973577037 learned_addr learned my addr 172.21.15.45:0/973577037 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.896+0000 7f3f5a7fc640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f5c106800 0x7f3f5c0fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.897+0000 7f3f5affd640 1 -- 172.21.15.45:0/973577037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f5c106800 msgr2=0x7f3f5c0fd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.897+0000 7f3f5affd640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f5c106800 0x7f3f5c0fd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.897+0000 7f3f5affd640 1 -- 172.21.15.45:0/973577037 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5c0fd6f0 con 0x7f3f5c100800 2024-09-18T12:56:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.897+0000 7f3f5a7fc640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f5c106800 0x7f3f5c0fd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:56:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.897+0000 7f3f5affd640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c100800 0x7f3f5c0fcc70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00d6f0 tx=0x7f3f4c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:37.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.897+0000 7f3f43fff640 1 -- 172.21.15.45:0/973577037 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f4c017070 con 0x7f3f5c100800 2024-09-18T12:56:37.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.897+0000 7f3f43fff640 1 -- 172.21.15.45:0/973577037 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f4c00de00 con 0x7f3f5c100800 2024-09-18T12:56:37.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.897+0000 7f3f612cd640 1 -- 172.21.15.45:0/973577037 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5c0fd9e0 con 0x7f3f5c100800 2024-09-18T12:56:37.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.897+0000 7f3f43fff640 1 -- 172.21.15.45:0/973577037 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f4c004bb0 con 0x7f3f5c100800 2024-09-18T12:56:37.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.897+0000 7f3f612cd640 1 -- 172.21.15.45:0/973577037 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f5c1a3e70 con 0x7f3f5c100800 2024-09-18T12:56:37.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.898+0000 7f3f612cd640 1 -- 172.21.15.45:0/973577037 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f5c101f40 con 0x7f3f5c100800 2024-09-18T12:56:37.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.899+0000 7f3f43fff640 1 -- 172.21.15.45:0/973577037 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f3f4c004e60 con 0x7f3f5c100800 2024-09-18T12:56:37.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.899+0000 7f3f43fff640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4407af40 0x7f3f4407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:37.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.900+0000 7f3f5a7fc640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4407af40 0x7f3f4407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:37.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.900+0000 7f3f43fff640 1 -- 172.21.15.45:0/973577037 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f3f4c09dbe0 con 0x7f3f5c100800 2024-09-18T12:56:37.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.900+0000 7f3f5a7fc640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4407af40 0x7f3f4407d400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0fe700 tx=0x7f3f50031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:37.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:37.904+0000 7f3f43fff640 1 -- 172.21.15.45:0/973577037 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3f4c069230 con 0x7f3f5c100800 2024-09-18T12:56:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.127+0000 7f3f612cd640 1 -- 172.21.15.45:0/973577037 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3f5c109d80 con 0x7f3f5c100800 2024-09-18T12:56:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.128+0000 7f3f43fff640 1 -- 172.21.15.45:0/973577037 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2046 (secure 0 0 0) 0x7f3f4c06e0e0 con 0x7f3f5c100800 2024-09-18T12:56:38.130 INFO:teuthology.orchestra.run.smithi045.stdout:e16 2024-09-18T12:56:38.130 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T12:49:30:966010+0000 2024-09-18T12:56:38.130 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 14 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T12:49:28.960615+0000 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T12:56:38.131 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=14566} 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T12:56:38.132 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 14566 members: 14566 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:38.133 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:56:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2024-09-18T12:56:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 -- 172.21.15.45:0/973577037 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4407af40 msgr2=0x7f3f4407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4407af40 0x7f3f4407d400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0fe700 tx=0x7f3f50031400 comp rx=0 tx=0).stop 2024-09-18T12:56:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 -- 172.21.15.45:0/973577037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c100800 msgr2=0x7f3f5c0fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c100800 0x7f3f5c0fcc70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00d6f0 tx=0x7f3f4c00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 -- 172.21.15.45:0/973577037 shutdown_connections 2024-09-18T12:56:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4407af40 0x7f3f4407d400 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f5c106800 0x7f3f5c0fd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 --2- 172.21.15.45:0/973577037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f5c100800 0x7f3f5c0fcc70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 -- 172.21.15.45:0/973577037 >> 172.21.15.45:0/973577037 conn(0x7f3f5c0fc520 msgr2=0x7f3f5c06a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 -- 172.21.15.45:0/973577037 shutdown_connections 2024-09-18T12:56:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.131+0000 7f3f612cd640 1 -- 172.21.15.45:0/973577037 wait complete. 2024-09-18T12:56:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.218+0000 7f94272fa640 1 -- 172.21.15.45:0/2601129486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9420101900 msgr2=0x7f9420101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.218+0000 7f94272fa640 1 --2- 172.21.15.45:0/2601129486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9420101900 0x7f9420101d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9410009880 tx=0x7f941002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.218+0000 7f94272fa640 1 -- 172.21.15.45:0/2601129486 shutdown_connections 2024-09-18T12:56:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.218+0000 7f94272fa640 1 --2- 172.21.15.45:0/2601129486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9420101900 0x7f9420101d60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.218+0000 7f94272fa640 1 --2- 172.21.15.45:0/2601129486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9420107900 0x7f9420107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.218+0000 7f94272fa640 1 -- 172.21.15.45:0/2601129486 >> 172.21.15.45:0/2601129486 conn(0x7f94200fd600 msgr2=0x7f94200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:38.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.218+0000 7f94272fa640 1 -- 172.21.15.45:0/2601129486 shutdown_connections 2024-09-18T12:56:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.218+0000 7f94272fa640 1 -- 172.21.15.45:0/2601129486 wait complete. 2024-09-18T12:56:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.219+0000 7f94272fa640 1 Processor -- start 2024-09-18T12:56:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.219+0000 7f94272fa640 1 -- start start 2024-09-18T12:56:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.219+0000 7f94272fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9420101900 0x7f94200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.219+0000 7f94272fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9420107900 0x7f9420074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.219+0000 7f94272fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f942010edb0 con 0x7f9420101900 2024-09-18T12:56:38.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.219+0000 7f94272fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f942010ec30 con 0x7f9420107900 2024-09-18T12:56:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.219+0000 7f9425096640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9420101900 0x7f94200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.219+0000 7f9425096640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9420101900 0x7f94200744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49786/0 (socket says 172.21.15.45:49786) 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.219+0000 7f9425096640 1 -- 172.21.15.45:0/2160264061 learned_addr learned my addr 172.21.15.45:0/2160264061 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.220+0000 7f9424895640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9420107900 0x7f9420074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.220+0000 7f9425096640 1 -- 172.21.15.45:0/2160264061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9420107900 msgr2=0x7f9420074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.220+0000 7f9425096640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9420107900 0x7f9420074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.220+0000 7f9425096640 1 -- 172.21.15.45:0/2160264061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9420074f70 con 0x7f9420101900 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.220+0000 7f9425096640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9420101900 0x7f94200744f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f941c00ea30 tx=0x7f941c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.220+0000 7f94167fc640 1 -- 172.21.15.45:0/2160264061 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f941c00cbe0 con 0x7f9420101900 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.220+0000 7f94272fa640 1 -- 172.21.15.45:0/2160264061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9420075260 con 0x7f9420101900 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.220+0000 7f94167fc640 1 -- 172.21.15.45:0/2160264061 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f941c00cd80 con 0x7f9420101900 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.220+0000 7f94167fc640 1 -- 172.21.15.45:0/2160264061 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f941c01a920 con 0x7f9420101900 2024-09-18T12:56:38.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.220+0000 7f94272fa640 1 -- 172.21.15.45:0/2160264061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94201a3e50 con 0x7f9420101900 2024-09-18T12:56:38.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.221+0000 7f94272fa640 1 -- 172.21.15.45:0/2160264061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9420103040 con 0x7f9420101900 2024-09-18T12:56:38.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.222+0000 7f94167fc640 1 -- 172.21.15.45:0/2160264061 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f941c01abd0 con 0x7f9420101900 2024-09-18T12:56:38.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.222+0000 7f94167fc640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f940c07af40 0x7f940c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.223+0000 7f9424895640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f940c07af40 0x7f940c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.223+0000 7f94167fc640 1 -- 172.21.15.45:0/2160264061 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f941c09e670 con 0x7f9420101900 2024-09-18T12:56:38.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.223+0000 7f9424895640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f940c07af40 0x7f940c07d400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9420075f80 tx=0x7f94100095c0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:38.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.227+0000 7f94167fc640 1 -- 172.21.15.45:0/2160264061 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f941c016030 con 0x7f9420101900 2024-09-18T12:56:38.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.428+0000 7f94272fa640 1 -- 172.21.15.45:0/2160264061 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9420062630 con 0x7f940c07af40 2024-09-18T12:56:38.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.429+0000 7f94167fc640 1 -- 172.21.15.45:0/2160264061 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f9420062630 con 0x7f940c07af40 2024-09-18T12:56:38.434 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:56:38.434 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:56:38.434 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:56:38.434 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:56:38.435 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:56:38.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr", 2024-09-18T12:56:38.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon" 2024-09-18T12:56:38.435 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:56:38.435 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "4/23 daemons upgraded", 2024-09-18T12:56:38.435 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading crash daemons", 2024-09-18T12:56:38.435 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:56:38.435 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:56:38.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.431+0000 7f94272fa640 1 -- 172.21.15.45:0/2160264061 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f940c07af40 msgr2=0x7f940c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:38.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.431+0000 7f94272fa640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f940c07af40 0x7f940c07d400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9420075f80 tx=0x7f94100095c0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.431+0000 7f94272fa640 1 -- 172.21.15.45:0/2160264061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9420101900 msgr2=0x7f94200744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:38.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.431+0000 7f94272fa640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9420101900 0x7f94200744f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f941c00ea30 tx=0x7f941c00eef0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.432+0000 7f94272fa640 1 -- 172.21.15.45:0/2160264061 shutdown_connections 2024-09-18T12:56:38.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.432+0000 7f94272fa640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f940c07af40 0x7f940c07d400 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.432+0000 7f94272fa640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9420107900 0x7f9420074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.432+0000 7f94272fa640 1 --2- 172.21.15.45:0/2160264061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9420101900 0x7f94200744f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.432+0000 7f94272fa640 1 -- 172.21.15.45:0/2160264061 >> 172.21.15.45:0/2160264061 conn(0x7f94200fd600 msgr2=0x7f94200fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:38.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.432+0000 7f94272fa640 1 -- 172.21.15.45:0/2160264061 shutdown_connections 2024-09-18T12:56:38.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.432+0000 7f94272fa640 1 -- 172.21.15.45:0/2160264061 wait complete. 2024-09-18T12:56:38.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 -- 172.21.15.45:0/1422761877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8914100c00 msgr2=0x7f8914104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:38.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 --2- 172.21.15.45:0/1422761877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8914100c00 0x7f8914104c50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f890400a990 tx=0x7f890402b7d0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 -- 172.21.15.45:0/1422761877 shutdown_connections 2024-09-18T12:56:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 --2- 172.21.15.45:0/1422761877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8914100c00 0x7f8914104c50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 --2- 172.21.15.45:0/1422761877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8914100250 0x7f8914100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 -- 172.21.15.45:0/1422761877 >> 172.21.15.45:0/1422761877 conn(0x7f89140fbc90 msgr2=0x7f89140fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 -- 172.21.15.45:0/1422761877 shutdown_connections 2024-09-18T12:56:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 -- 172.21.15.45:0/1422761877 wait complete. 2024-09-18T12:56:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 Processor -- start 2024-09-18T12:56:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 -- start start 2024-09-18T12:56:38.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.517+0000 7f891bd3a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8914100250 0x7f891419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:38.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f891bd3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8914100c00 0x7f891419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:38.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f891bd3a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f891410cbd0 con 0x7f8914100c00 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f891bd3a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f891410ca50 con 0x7f8914100250 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f89192d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8914100c00 0x7f891419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f8919ad6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8914100250 0x7f891419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f89192d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8914100c00 0x7f891419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49808/0 (socket says 172.21.15.45:49808) 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f89192d5640 1 -- 172.21.15.45:0/4174199914 learned_addr learned my addr 172.21.15.45:0/4174199914 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f89192d5640 1 -- 172.21.15.45:0/4174199914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8914100250 msgr2=0x7f891419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f89192d5640 1 --2- 172.21.15.45:0/4174199914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8914100250 0x7f891419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f89192d5640 1 -- 172.21.15.45:0/4174199914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89141977d0 con 0x7f8914100c00 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f89192d5640 1 --2- 172.21.15.45:0/4174199914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8914100c00 0x7f891419db90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8904006010 tx=0x7f8904004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f890affd640 1 -- 172.21.15.45:0/4174199914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8904008e90 con 0x7f8914100c00 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f891bd3a640 1 -- 172.21.15.45:0/4174199914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8914197a60 con 0x7f8914100c00 2024-09-18T12:56:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f890affd640 1 -- 172.21.15.45:0/4174199914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8904045070 con 0x7f8914100c00 2024-09-18T12:56:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.518+0000 7f890affd640 1 -- 172.21.15.45:0/4174199914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89040035f0 con 0x7f8914100c00 2024-09-18T12:56:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.519+0000 7f891bd3a640 1 -- 172.21.15.45:0/4174199914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8914197f90 con 0x7f8914100c00 2024-09-18T12:56:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.519+0000 7f891bd3a640 1 -- 172.21.15.45:0/4174199914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8914101730 con 0x7f8914100c00 2024-09-18T12:56:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.520+0000 7f890affd640 1 -- 172.21.15.45:0/4174199914 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f8904032070 con 0x7f8914100c00 2024-09-18T12:56:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.521+0000 7f890affd640 1 --2- 172.21.15.45:0/4174199914 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f890007af30 0x7f890007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:56:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.521+0000 7f890affd640 1 -- 172.21.15.45:0/4174199914 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6070+0+0 (secure 0 0 0) 0x7f8904008030 con 0x7f8914100c00 2024-09-18T12:56:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.521+0000 7f8919ad6640 1 --2- 172.21.15.45:0/4174199914 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f890007af30 0x7f890007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:56:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.521+0000 7f8919ad6640 1 --2- 172.21.15.45:0/4174199914 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f890007af30 0x7f890007d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8910005fd0 tx=0x7f891000b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:56:38.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.525+0000 7f890affd640 1 -- 172.21.15.45:0/4174199914 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f890408a3e0 con 0x7f8914100c00 2024-09-18T12:56:38.754 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:38 smithi161 ceph-mon[80292]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:38.754 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:38 smithi161 ceph-mon[80292]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:38.754 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:38 smithi161 ceph-mon[80292]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:38.754 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:38.754 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:38.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:38 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3331744842' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:38.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:38.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:38 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/973577037' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:56:38.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.781+0000 7f891bd3a640 1 -- 172.21.15.45:0/4174199914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f8914198d00 con 0x7f8914100c00 2024-09-18T12:56:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:38 smithi045 ceph-mon[109129]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:38 smithi045 ceph-mon[109129]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:38 smithi045 ceph-mon[109129]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:38 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3331744842' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:38 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/973577037' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:56:38.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.782+0000 7f890affd640 1 -- 172.21.15.45:0/4174199914 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f890408f290 con 0x7f8914100c00 2024-09-18T12:56:38.786 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:38.786 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:56:38.786 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:56:38.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.784+0000 7f891bd3a640 1 -- 172.21.15.45:0/4174199914 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f890007af30 msgr2=0x7f890007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:38.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.784+0000 7f891bd3a640 1 --2- 172.21.15.45:0/4174199914 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f890007af30 0x7f890007d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8910005fd0 tx=0x7f891000b390 comp rx=0 tx=0).stop 2024-09-18T12:56:38.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.784+0000 7f891bd3a640 1 -- 172.21.15.45:0/4174199914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8914100c00 msgr2=0x7f891419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:56:38.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.784+0000 7f891bd3a640 1 --2- 172.21.15.45:0/4174199914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8914100c00 0x7f891419db90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8904006010 tx=0x7f8904004270 comp rx=0 tx=0).stop 2024-09-18T12:56:38.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.784+0000 7f891bd3a640 1 -- 172.21.15.45:0/4174199914 shutdown_connections 2024-09-18T12:56:38.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.784+0000 7f891bd3a640 1 --2- 172.21.15.45:0/4174199914 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f890007af30 0x7f890007d3f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.784+0000 7f891bd3a640 1 --2- 172.21.15.45:0/4174199914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8914100c00 0x7f891419db90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.784+0000 7f891bd3a640 1 --2- 172.21.15.45:0/4174199914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8914100250 0x7f891419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:56:38.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.784+0000 7f891bd3a640 1 -- 172.21.15.45:0/4174199914 >> 172.21.15.45:0/4174199914 conn(0x7f89140fbc90 msgr2=0x7f89140fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:56:38.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.785+0000 7f891bd3a640 1 -- 172.21.15.45:0/4174199914 shutdown_connections 2024-09-18T12:56:38.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:56:38.785+0000 7f891bd3a640 1 -- 172.21.15.45:0/4174199914 wait complete. 2024-09-18T12:56:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:39 smithi045 ceph-mon[109129]: pgmap v116: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:39 smithi045 ceph-mon[109129]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:56:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:39 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/4174199914' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:56:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:39 smithi161 ceph-mon[80292]: pgmap v116: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:39 smithi161 ceph-mon[80292]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:56:39.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:39.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-18T12:56:39.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:39.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:39 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/4174199914' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:56:40.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:40 smithi045 ceph-mon[109129]: Upgrade: Updating crash.smithi161 (2/2) 2024-09-18T12:56:40.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:40 smithi045 ceph-mon[109129]: Deploying daemon crash.smithi161 on smithi161 2024-09-18T12:56:40.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:40 smithi161 ceph-mon[80292]: Upgrade: Updating crash.smithi161 (2/2) 2024-09-18T12:56:40.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:40 smithi161 ceph-mon[80292]: Deploying daemon crash.smithi161 on smithi161 2024-09-18T12:56:41.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:41 smithi045 ceph-mon[109129]: pgmap v117: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:41 smithi161 ceph-mon[80292]: pgmap v117: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:43.501 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:43 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:43.501 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:43 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:43.502 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:43 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:43.502 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:43 smithi045 ceph-mon[109129]: pgmap v118: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:43.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:43 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:43.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:43 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:43.530 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:43 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:43.530 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:43 smithi161 ceph-mon[80292]: pgmap v118: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:45.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:45 smithi045 ceph-mon[109129]: pgmap v119: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:45.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:45 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:45.444 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:45 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:45.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:45 smithi161 ceph-mon[80292]: pgmap v119: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:45.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:45 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:45.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:45 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:46.692 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:46 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:46.693 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:46 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:46.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:46 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:46.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:46 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:47.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:47 smithi161 ceph-mon[80292]: pgmap v120: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:47.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:47.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:47 smithi045 ceph-mon[109129]: pgmap v120: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:48.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:48 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:48.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:48 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:48.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:48 smithi161 ceph-mon[80292]: pgmap v121: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:48.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:48 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:48.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:48 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:49.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:48 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:49.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:48 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:49.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:48 smithi045 ceph-mon[109129]: pgmap v121: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:49.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:48 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:49.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:48 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:51.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: pgmap v122: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:51.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:51.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:51.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi045"} : dispatch 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi045"}]': finished 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"} : dispatch 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"}]': finished 2024-09-18T12:56:51.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:51 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-18T12:56:51.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: pgmap v122: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:51.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:51.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:51.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:51.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi045"} : dispatch 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi045"}]': finished 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"} : dispatch 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"}]': finished 2024-09-18T12:56:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:51 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-18T12:56:52.463 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:52 smithi045 ceph-mon[109129]: Upgrade: Setting container_image for all crash 2024-09-18T12:56:52.463 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:52 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-18T12:56:52.463 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:52 smithi045 ceph-mon[109129]: Upgrade: osd.0 is safe to restart 2024-09-18T12:56:52.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:52 smithi161 ceph-mon[80292]: Upgrade: Setting container_image for all crash 2024-09-18T12:56:52.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:52 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-18T12:56:52.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:52 smithi161 ceph-mon[80292]: Upgrade: osd.0 is safe to restart 2024-09-18T12:56:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:53 smithi045 ceph-mon[109129]: pgmap v123: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:53 smithi045 ceph-mon[109129]: Upgrade: Updating osd.0 2024-09-18T12:56:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-18T12:56:53.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:53.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:53 smithi045 ceph-mon[109129]: Deploying daemon osd.0 on smithi045 2024-09-18T12:56:53.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:53 smithi161 ceph-mon[80292]: pgmap v123: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:53 smithi161 ceph-mon[80292]: Upgrade: Updating osd.0 2024-09-18T12:56:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:56:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-18T12:56:53.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:56:53.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:53 smithi161 ceph-mon[80292]: Deploying daemon osd.0 on smithi045 2024-09-18T12:56:53.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:56:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:55 smithi045 ceph-mon[109129]: pgmap v124: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:55.785 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:55 smithi045 systemd[1]: Stopping Ceph osd.0 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:56:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:55 smithi161 ceph-mon[80292]: pgmap v124: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:56:56.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:55 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[49078]: 2024-09-18T12:56:55.855+0000 7f6bad30f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:56:56.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:55 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[49078]: 2024-09-18T12:56:55.855+0000 7f6bad30f640 -1 osd.0 46 *** Got signal Terminated *** 2024-09-18T12:56:56.285 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:55 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[49078]: 2024-09-18T12:56:55.855+0000 7f6bad30f640 -1 osd.0 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:56:56.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:56 smithi045 ceph-mon[109129]: osd.0 marked itself down and dead 2024-09-18T12:56:56.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:56 smithi161 ceph-mon[80292]: osd.0 marked itself down and dead 2024-09-18T12:56:57.183 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:56 smithi045 podman[117679]: 2024-09-18 12:56:56.910159145 +0000 UTC m=+1.142986412 container died 0b771fac9ae61e6a71bba4ec0fafea2b8885521f5d9ff4186709216d9d013c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-18T12:56:57.441 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:57 smithi045 podman[117679]: 2024-09-18 12:56:57.280833887 +0000 UTC m=+1.513661150 container cleanup 0b771fac9ae61e6a71bba4ec0fafea2b8885521f5d9ff4186709216d9d013c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-09-18T12:56:57.441 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:57 smithi045 bash[117679]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0 2024-09-18T12:56:57.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:57 smithi045 podman[117697]: 2024-09-18 12:56:57.440371452 +0000 UTC m=+0.527823603 container remove 0b771fac9ae61e6a71bba4ec0fafea2b8885521f5d9ff4186709216d9d013c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-18T12:56:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:57 smithi045 ceph-mon[109129]: pgmap v125: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:57 smithi045 ceph-mon[109129]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:56:57.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:57 smithi045 ceph-mon[109129]: osdmap e47: 6 total, 5 up, 6 in 2024-09-18T12:56:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:57 smithi161 ceph-mon[80292]: pgmap v125: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:56:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:57 smithi161 ceph-mon[80292]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:56:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:57 smithi161 ceph-mon[80292]: osdmap e47: 6 total, 5 up, 6 in 2024-09-18T12:56:58.195 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:57 smithi045 podman[117785]: 2024-09-18 12:56:57.766444933 +0000 UTC m=+0.016782890 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:58.195 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:57 smithi045 podman[117785]: 2024-09-18 12:56:57.88324039 +0000 UTC m=+0.133578379 container create 194254ddd1d2219b4918a36f76d9fef738c50ce99923d5b4af8bfc945ade02a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:56:58.195 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:58 smithi045 podman[117785]: 2024-09-18 12:56:58.194600363 +0000 UTC m=+0.444938320 container init 194254ddd1d2219b4918a36f76d9fef738c50ce99923d5b4af8bfc945ade02a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-18T12:56:58.518 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:58 smithi045 podman[117785]: 2024-09-18 12:56:58.199342596 +0000 UTC m=+0.449680543 container start 194254ddd1d2219b4918a36f76d9fef738c50ce99923d5b4af8bfc945ade02a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-18T12:56:58.519 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:58 smithi045 podman[117785]: 2024-09-18 12:56:58.369142892 +0000 UTC m=+0.619480857 container attach 194254ddd1d2219b4918a36f76d9fef738c50ce99923d5b4af8bfc945ade02a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:56:58.519 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:58 smithi045 podman[117785]: 2024-09-18 12:56:58.392687442 +0000 UTC m=+0.643025398 container died 194254ddd1d2219b4918a36f76d9fef738c50ce99923d5b4af8bfc945ade02a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-18T12:56:58.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:58 smithi045 ceph-mon[109129]: osdmap e48: 6 total, 5 up, 6 in 2024-09-18T12:56:58.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:58 smithi161 ceph-mon[80292]: osdmap e48: 6 total, 5 up, 6 in 2024-09-18T12:56:59.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 podman[117808]: 2024-09-18 12:56:59.014487292 +0000 UTC m=+0.612559064 container remove 194254ddd1d2219b4918a36f76d9fef738c50ce99923d5b4af8bfc945ade02a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-18T12:56:59.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-18T12:56:59.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 systemd[1]: Stopped Ceph osd.0 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:56:59.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.0.service: Consumed 55.344s CPU time. 2024-09-18T12:56:59.285 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 systemd[1]: Starting Ceph osd.0 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:56:59.768 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:59 smithi045 ceph-mon[109129]: pgmap v128: 65 pgs: 14 active+undersized, 1 stale+active+clean, 14 active+undersized+degraded, 36 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 38/255 objects degraded (14.902%) 2024-09-18T12:56:59.768 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:56:59 smithi045 ceph-mon[109129]: Health check failed: Degraded data redundancy: 38/255 objects degraded (14.902%), 14 pgs degraded (PG_DEGRADED) 2024-09-18T12:56:59.768 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 podman[117906]: 2024-09-18 12:56:59.371581827 +0000 UTC m=+0.016866674 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:56:59.769 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 podman[117906]: 2024-09-18 12:56:59.473946815 +0000 UTC m=+0.119231695 container create 24547e3d9401fa8135d96709ffa1c943519c4e542bc83c0649cd47ef477502d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-18T12:56:59.769 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 podman[117906]: 2024-09-18 12:56:59.692982256 +0000 UTC m=+0.338267101 container init 24547e3d9401fa8135d96709ffa1c943519c4e542bc83c0649cd47ef477502d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-18T12:56:59.769 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 podman[117906]: 2024-09-18 12:56:59.69644982 +0000 UTC m=+0.341734658 container start 24547e3d9401fa8135d96709ffa1c943519c4e542bc83c0649cd47ef477502d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:56:59.769 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 podman[117906]: 2024-09-18 12:56:59.767879357 +0000 UTC m=+0.413164200 container attach 24547e3d9401fa8135d96709ffa1c943519c4e542bc83c0649cd47ef477502d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:56:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:59 smithi161 ceph-mon[80292]: pgmap v128: 65 pgs: 14 active+undersized, 1 stale+active+clean, 14 active+undersized+degraded, 36 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 38/255 objects degraded (14.902%) 2024-09-18T12:56:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:56:59 smithi161 ceph-mon[80292]: Health check failed: Degraded data redundancy: 38/255 objects degraded (14.902%), 14 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:00.034 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate[117921]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:00.034 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 bash[117906]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:00.034 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate[117921]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:00.034 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:56:59 smithi045 bash[117906]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:01 smithi045 ceph-mon[109129]: pgmap v129: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:01 smithi161 ceph-mon[80292]: pgmap v129: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:02.477 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate[117921]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:02.478 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 bash[117906]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:02.478 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate[117921]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:57:02.478 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 bash[117906]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:57:02.478 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate[117921]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:57:02.478 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 bash[117906]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:57:02.785 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate[117921]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:57:02.785 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 bash[117906]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:57:02.785 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate[117921]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-18T12:57:02.785 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 bash[117906]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-18T12:57:02.785 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate[117921]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:02.785 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 bash[117906]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:57:02.785 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate[117921]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-18T12:57:02.785 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 bash[117906]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-18T12:57:02.786 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:02 smithi045 podman[117906]: 2024-09-18 12:57:02.51356447 +0000 UTC m=+3.158849308 container died 24547e3d9401fa8135d96709ffa1c943519c4e542bc83c0649cd47ef477502d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-18T12:57:03.470 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:03 smithi045 podman[118092]: 2024-09-18 12:57:03.180188902 +0000 UTC m=+0.655750426 container remove 24547e3d9401fa8135d96709ffa1c943519c4e542bc83c0649cd47ef477502d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-18T12:57:03.470 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:03 smithi045 podman[118154]: 2024-09-18 12:57:03.301667907 +0000 UTC m=+0.017056219 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:03.471 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:03 smithi045 podman[118154]: 2024-09-18 12:57:03.40627897 +0000 UTC m=+0.121667265 container create 33c596ec6ae7c8bdc4f913689c3228105b8e9ab4195defd66054eddce28cd33c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-18T12:57:03.725 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:03 smithi045 ceph-mon[109129]: pgmap v130: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:03.725 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:03 smithi045 podman[118154]: 2024-09-18 12:57:03.633417963 +0000 UTC m=+0.348806271 container init 33c596ec6ae7c8bdc4f913689c3228105b8e9ab4195defd66054eddce28cd33c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-18T12:57:03.726 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:03 smithi045 podman[118154]: 2024-09-18 12:57:03.636750866 +0000 UTC m=+0.352139168 container start 33c596ec6ae7c8bdc4f913689c3228105b8e9ab4195defd66054eddce28cd33c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-18T12:57:03.726 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:03 smithi045 ceph-osd[118172]: -- 172.21.15.45:0/4340157 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f446a1a1e0 con 0x55f4469aa000 2024-09-18T12:57:03.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:03 smithi161 ceph-mon[80292]: pgmap v130: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:04.034 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:03 smithi045 bash[118154]: 33c596ec6ae7c8bdc4f913689c3228105b8e9ab4195defd66054eddce28cd33c 2024-09-18T12:57:04.034 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:03 smithi045 systemd[1]: Started Ceph osd.0 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:57:05.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:04 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:05.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:04 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:05.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:04 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:05.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:04 smithi045 ceph-mon[109129]: pgmap v131: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:05.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:04 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:05.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:04 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:05.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:04 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:05.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:04 smithi161 ceph-mon[80292]: pgmap v131: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:05.325 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:05 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[118168]: 2024-09-18T12:57:05.033+0000 7f351d4d6640 -1 Falling back to public interface 2024-09-18T12:57:06.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:05 smithi045 ceph-mon[109129]: Health check update: Degraded data redundancy: 48/255 objects degraded (18.824%), 18 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:06.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:05 smithi161 ceph-mon[80292]: Health check update: Degraded data redundancy: 48/255 objects degraded (18.824%), 18 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:07.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:06 smithi045 ceph-mon[109129]: pgmap v132: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:07.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:06 smithi161 ceph-mon[80292]: pgmap v132: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.881+0000 7f762ef23640 1 -- 172.21.15.45:0/1133045862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76281033d0 msgr2=0x7f762810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.881+0000 7f762ef23640 1 --2- 172.21.15.45:0/1133045862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76281033d0 0x7f762810b8c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7614009880 tx=0x7f761402a530 comp rx=0 tx=0).stop 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.881+0000 7f762ef23640 1 -- 172.21.15.45:0/1133045862 shutdown_connections 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.881+0000 7f762ef23640 1 --2- 172.21.15.45:0/1133045862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76281033d0 0x7f762810b8c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.881+0000 7f762ef23640 1 --2- 172.21.15.45:0/1133045862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7628102ab0 0x7f7628102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.881+0000 7f762ef23640 1 -- 172.21.15.45:0/1133045862 >> 172.21.15.45:0/1133045862 conn(0x7f76280fc4d0 msgr2=0x7f76280fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.881+0000 7f762ef23640 1 -- 172.21.15.45:0/1133045862 shutdown_connections 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.881+0000 7f762ef23640 1 -- 172.21.15.45:0/1133045862 wait complete. 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.882+0000 7f762ef23640 1 Processor -- start 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.882+0000 7f762ef23640 1 -- start start 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.882+0000 7f762ef23640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7628102ab0 0x7f762819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.882+0000 7f762ef23640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76281033d0 0x7f762819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.882+0000 7f762ef23640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f762810edc0 con 0x7f7628102ab0 2024-09-18T12:57:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.882+0000 7f762ef23640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f762810ec40 con 0x7f76281033d0 2024-09-18T12:57:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f762ccbf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7628102ab0 0x7f762819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f762ccbf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7628102ab0 0x7f762819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35736/0 (socket says 172.21.15.45:35736) 2024-09-18T12:57:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f762ccbf640 1 -- 172.21.15.45:0/2902202154 learned_addr learned my addr 172.21.15.45:0/2902202154 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f7627fff640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76281033d0 0x7f762819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f762ccbf640 1 -- 172.21.15.45:0/2902202154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76281033d0 msgr2=0x7f762819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f762ccbf640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76281033d0 0x7f762819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f762ccbf640 1 -- 172.21.15.45:0/2902202154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7628197810 con 0x7f7628102ab0 2024-09-18T12:57:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f762ccbf640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7628102ab0 0x7f762819d690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f761c00d8d0 tx=0x7f761c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f7625ffb640 1 -- 172.21.15.45:0/2902202154 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f761c017070 con 0x7f7628102ab0 2024-09-18T12:57:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f7625ffb640 1 -- 172.21.15.45:0/2902202154 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f761c010460 con 0x7f7628102ab0 2024-09-18T12:57:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.883+0000 7f762ef23640 1 -- 172.21.15.45:0/2902202154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7628197b00 con 0x7f7628102ab0 2024-09-18T12:57:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.884+0000 7f7625ffb640 1 -- 172.21.15.45:0/2902202154 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f761c00f5f0 con 0x7f7628102ab0 2024-09-18T12:57:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.884+0000 7f762ef23640 1 -- 172.21.15.45:0/2902202154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7628198060 con 0x7f7628102ab0 2024-09-18T12:57:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.885+0000 7f762ef23640 1 -- 172.21.15.45:0/2902202154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762806ada0 con 0x7f7628102ab0 2024-09-18T12:57:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.886+0000 7f7625ffb640 1 -- 172.21.15.45:0/2902202154 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f761c009a30 con 0x7f7628102ab0 2024-09-18T12:57:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.886+0000 7f7625ffb640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f761807af30 0x7f761807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.886+0000 7f7625ffb640 1 -- 172.21.15.45:0/2902202154 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7f761c09de00 con 0x7f7628102ab0 2024-09-18T12:57:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.887+0000 7f7627fff640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f761807af30 0x7f761807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.887+0000 7f7627fff640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f761807af30 0x7f761807d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7628198b60 tx=0x7f7614031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:08.892+0000 7f7625ffb640 1 -- 172.21.15.45:0/2902202154 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f761c0693f0 con 0x7f7628102ab0 2024-09-18T12:57:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.102+0000 7f762ef23640 1 -- 172.21.15.45:0/2902202154 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7628198310 con 0x7f761807af30 2024-09-18T12:57:09.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.103+0000 7f7625ffb640 1 -- 172.21.15.45:0/2902202154 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f7628198310 con 0x7f761807af30 2024-09-18T12:57:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.105+0000 7f762ef23640 1 -- 172.21.15.45:0/2902202154 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f761807af30 msgr2=0x7f761807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.105+0000 7f762ef23640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f761807af30 0x7f761807d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7628198b60 tx=0x7f7614031400 comp rx=0 tx=0).stop 2024-09-18T12:57:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.105+0000 7f762ef23640 1 -- 172.21.15.45:0/2902202154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7628102ab0 msgr2=0x7f762819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.105+0000 7f762ef23640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7628102ab0 0x7f762819d690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f761c00d8d0 tx=0x7f761c00dd90 comp rx=0 tx=0).stop 2024-09-18T12:57:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.105+0000 7f762ef23640 1 -- 172.21.15.45:0/2902202154 shutdown_connections 2024-09-18T12:57:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.105+0000 7f762ef23640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f761807af30 0x7f761807d3f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.105+0000 7f762ef23640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76281033d0 0x7f762819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.105+0000 7f762ef23640 1 --2- 172.21.15.45:0/2902202154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7628102ab0 0x7f762819d690 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.105+0000 7f762ef23640 1 -- 172.21.15.45:0/2902202154 >> 172.21.15.45:0/2902202154 conn(0x7f76280fc4d0 msgr2=0x7f7628108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.106+0000 7f762ef23640 1 -- 172.21.15.45:0/2902202154 shutdown_connections 2024-09-18T12:57:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.106+0000 7f762ef23640 1 -- 172.21.15.45:0/2902202154 wait complete. 2024-09-18T12:57:09.116 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:57:09.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.194+0000 7fab8e1a0640 1 -- 172.21.15.45:0/708151038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab88102b10 msgr2=0x7fab88102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.194+0000 7fab8e1a0640 1 --2- 172.21.15.45:0/708151038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab88102b10 0x7fab88102ef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab780098b0 tx=0x7fab7802a560 comp rx=0 tx=0).stop 2024-09-18T12:57:09.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.194+0000 7fab8e1a0640 1 -- 172.21.15.45:0/708151038 shutdown_connections 2024-09-18T12:57:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.194+0000 7fab8e1a0640 1 --2- 172.21.15.45:0/708151038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab88103430 0x7fab8810b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.194+0000 7fab8e1a0640 1 --2- 172.21.15.45:0/708151038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab88102b10 0x7fab88102ef0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.194+0000 7fab8e1a0640 1 -- 172.21.15.45:0/708151038 >> 172.21.15.45:0/708151038 conn(0x7fab880fc550 msgr2=0x7fab880fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.194+0000 7fab8e1a0640 1 -- 172.21.15.45:0/708151038 shutdown_connections 2024-09-18T12:57:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.194+0000 7fab8e1a0640 1 -- 172.21.15.45:0/708151038 wait complete. 2024-09-18T12:57:09.196 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:09.196 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:09.196 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:09 smithi045 ceph-mon[109129]: pgmap v133: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:09.197 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:09.197 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.194+0000 7fab8e1a0640 1 Processor -- start 2024-09-18T12:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab8e1a0640 1 -- start start 2024-09-18T12:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab8e1a0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab88102b10 0x7fab88100770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab8e1a0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab88103430 0x7fab88100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab8e1a0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fab8810edc0 con 0x7fab88103430 2024-09-18T12:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab8e1a0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fab8810ec40 con 0x7fab88102b10 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab86ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab88103430 0x7fab88100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab86ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab88103430 0x7fab88100cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35750/0 (socket says 172.21.15.45:35750) 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab86ffd640 1 -- 172.21.15.45:0/1448872862 learned_addr learned my addr 172.21.15.45:0/1448872862 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab877fe640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab88102b10 0x7fab88100770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab86ffd640 1 -- 172.21.15.45:0/1448872862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab88102b10 msgr2=0x7fab88100770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.195+0000 7fab86ffd640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab88102b10 0x7fab88100770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.196+0000 7fab86ffd640 1 -- 172.21.15.45:0/1448872862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab881011f0 con 0x7fab88103430 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.196+0000 7fab86ffd640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab88103430 0x7fab88100cb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c8a0 tx=0x7fab7c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.196+0000 7fab84ff9640 1 -- 172.21.15.45:0/1448872862 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab7c0079b0 con 0x7fab88103430 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.196+0000 7fab8e1a0640 1 -- 172.21.15.45:0/1448872862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab881014e0 con 0x7fab88103430 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.196+0000 7fab84ff9640 1 -- 172.21.15.45:0/1448872862 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab7c007b50 con 0x7fab88103430 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.196+0000 7fab8e1a0640 1 -- 172.21.15.45:0/1448872862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab881a3df0 con 0x7fab88103430 2024-09-18T12:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.196+0000 7fab84ff9640 1 -- 172.21.15.45:0/1448872862 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab7c018700 con 0x7fab88103430 2024-09-18T12:57:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.197+0000 7fab8e1a0640 1 -- 172.21.15.45:0/1448872862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8806a520 con 0x7fab88103430 2024-09-18T12:57:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.198+0000 7fab84ff9640 1 -- 172.21.15.45:0/1448872862 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fab7c007d00 con 0x7fab88103430 2024-09-18T12:57:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.198+0000 7fab84ff9640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fab7007af40 0x7fab7007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.199+0000 7fab84ff9640 1 -- 172.21.15.45:0/1448872862 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7fab7c09e1f0 con 0x7fab88103430 2024-09-18T12:57:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.199+0000 7fab877fe640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fab7007af40 0x7fab7007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.199+0000 7fab877fe640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fab7007af40 0x7fab7007d400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab78000c00 tx=0x7fab78031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.203+0000 7fab84ff9640 1 -- 172.21.15.45:0/1448872862 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fab7c014030 con 0x7fab88103430 2024-09-18T12:57:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:09 smithi161 ceph-mon[80292]: pgmap v133: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:09.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.422+0000 7fab8e1a0640 1 -- 172.21.15.45:0/1448872862 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fab88104fd0 con 0x7fab7007af40 2024-09-18T12:57:09.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.424+0000 7fab84ff9640 1 -- 172.21.15.45:0/1448872862 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fab78004340 con 0x7fab7007af40 2024-09-18T12:57:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.427+0000 7fab8e1a0640 1 -- 172.21.15.45:0/1448872862 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fab7007af40 msgr2=0x7fab7007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.427+0000 7fab8e1a0640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fab7007af40 0x7fab7007d400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab78000c00 tx=0x7fab78031400 comp rx=0 tx=0).stop 2024-09-18T12:57:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.427+0000 7fab8e1a0640 1 -- 172.21.15.45:0/1448872862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab88103430 msgr2=0x7fab88100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.427+0000 7fab8e1a0640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab88103430 0x7fab88100cb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c8a0 tx=0x7fab7c00cd60 comp rx=0 tx=0).stop 2024-09-18T12:57:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.427+0000 7fab8e1a0640 1 -- 172.21.15.45:0/1448872862 shutdown_connections 2024-09-18T12:57:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.427+0000 7fab8e1a0640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fab7007af40 0x7fab7007d400 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.427+0000 7fab8e1a0640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab88103430 0x7fab88100cb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.427+0000 7fab8e1a0640 1 --2- 172.21.15.45:0/1448872862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab88102b10 0x7fab88100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.427+0000 7fab8e1a0640 1 -- 172.21.15.45:0/1448872862 >> 172.21.15.45:0/1448872862 conn(0x7fab880fc550 msgr2=0x7fab88107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:09.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.428+0000 7fab8e1a0640 1 -- 172.21.15.45:0/1448872862 shutdown_connections 2024-09-18T12:57:09.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.428+0000 7fab8e1a0640 1 -- 172.21.15.45:0/1448872862 wait complete. 2024-09-18T12:57:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.524+0000 7f07542c4640 1 -- 172.21.15.45:0/3979512526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f074c102ab0 msgr2=0x7f074c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.524+0000 7f07542c4640 1 --2- 172.21.15.45:0/3979512526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f074c102ab0 0x7f074c102e90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0748009880 tx=0x7f074802a530 comp rx=0 tx=0).stop 2024-09-18T12:57:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.524+0000 7f07542c4640 1 -- 172.21.15.45:0/3979512526 shutdown_connections 2024-09-18T12:57:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.524+0000 7f07542c4640 1 --2- 172.21.15.45:0/3979512526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f074c1033d0 0x7f074c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.524+0000 7f07542c4640 1 --2- 172.21.15.45:0/3979512526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f074c102ab0 0x7f074c102e90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.524+0000 7f07542c4640 1 -- 172.21.15.45:0/3979512526 >> 172.21.15.45:0/3979512526 conn(0x7f074c0fc550 msgr2=0x7f074c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.524+0000 7f07542c4640 1 -- 172.21.15.45:0/3979512526 shutdown_connections 2024-09-18T12:57:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.524+0000 7f07542c4640 1 -- 172.21.15.45:0/3979512526 wait complete. 2024-09-18T12:57:09.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.525+0000 7f07542c4640 1 Processor -- start 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f07542c4640 1 -- start start 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f07542c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f074c102ab0 0x7f074c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f07542c4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f074c1033d0 0x7f074c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f07542c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f074c10edc0 con 0x7f074c102ab0 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f07542c4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f074c10ec40 con 0x7f074c1033d0 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f0752060640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f074c102ab0 0x7f074c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f0752060640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f074c102ab0 0x7f074c100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35768/0 (socket says 172.21.15.45:35768) 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f0752060640 1 -- 172.21.15.45:0/1737155428 learned_addr learned my addr 172.21.15.45:0/1737155428 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f075185f640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f074c1033d0 0x7f074c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f0752060640 1 -- 172.21.15.45:0/1737155428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f074c1033d0 msgr2=0x7f074c100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.526+0000 7f0752060640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f074c1033d0 0x7f074c100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.527+0000 7f0752060640 1 -- 172.21.15.45:0/1737155428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074c101190 con 0x7f074c102ab0 2024-09-18T12:57:09.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.527+0000 7f0752060640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f074c102ab0 0x7f074c100710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0748031460 tx=0x7f07480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:09.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.527+0000 7f07437fe640 1 -- 172.21.15.45:0/1737155428 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f074803f070 con 0x7f074c102ab0 2024-09-18T12:57:09.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.527+0000 7f07437fe640 1 -- 172.21.15.45:0/1737155428 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07480035f0 con 0x7f074c102ab0 2024-09-18T12:57:09.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.527+0000 7f07542c4640 1 -- 172.21.15.45:0/1737155428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074c101420 con 0x7f074c102ab0 2024-09-18T12:57:09.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.527+0000 7f07437fe640 1 -- 172.21.15.45:0/1737155428 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0748035030 con 0x7f074c102ab0 2024-09-18T12:57:09.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.527+0000 7f07542c4640 1 -- 172.21.15.45:0/1737155428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f074c1a3d70 con 0x7f074c102ab0 2024-09-18T12:57:09.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.528+0000 7f07542c4640 1 -- 172.21.15.45:0/1737155428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074c06a580 con 0x7f074c102ab0 2024-09-18T12:57:09.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.529+0000 7f07437fe640 1 -- 172.21.15.45:0/1737155428 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f0748042070 con 0x7f074c102ab0 2024-09-18T12:57:09.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.530+0000 7f07437fe640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f073807af30 0x7f073807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:09.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.530+0000 7f07437fe640 1 -- 172.21.15.45:0/1737155428 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7f07480bef30 con 0x7f074c102ab0 2024-09-18T12:57:09.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.530+0000 7f075185f640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f073807af30 0x7f073807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:09.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.531+0000 7f075185f640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f073807af30 0x7f073807d3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f074c1021a0 tx=0x7f073c00b2e0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:09.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.537+0000 7f07437fe640 1 -- 172.21.15.45:0/1737155428 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f074808a600 con 0x7f074c102ab0 2024-09-18T12:57:09.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.734+0000 7f07542c4640 1 -- 172.21.15.45:0/1737155428 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f074c105ff0 con 0x7f073807af30 2024-09-18T12:57:09.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.744+0000 7f07437fe640 1 -- 172.21.15.45:0/1737155428 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f073c010bd0 con 0x7f073807af30 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (2m) 1s ago 13m 20.0M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (5m) 1s ago 13m 8879k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (4m) 24s ago 12m 8346k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (32s) 1s ago 13m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (28s) 24s ago 12m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (112s) 1s ago 12m 76.3M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (7m) 1s ago 7m 92.1M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (7m) 1s ago 7m 149M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (7m) 24s ago 7m 17.4M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (7m) 24s ago 7m 15.9M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:57:09.746 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (4m) 1s ago 14m 523M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (3m) 24s ago 12m 457M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (59s) 1s ago 14m 38.9M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (44s) 24s ago 12m 25.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (3m) 1s ago 13m 10.6M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (2m) 24s ago 12m 11.1M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (6s) 1s ago 11m 14.3M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (10m) 1s ago 10m 226M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 168e69ac7e62 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (10m) 1s ago 10m 186M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (9m) 24s ago 9m 243M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (9m) 24s ago 9m 215M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (8m) 24s ago 8m 200M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:57:09.747 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (2m) 1s ago 12m 49.7M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:57:09.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 -- 172.21.15.45:0/1737155428 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f073807af30 msgr2=0x7f073807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f073807af30 0x7f073807d3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f074c1021a0 tx=0x7f073c00b2e0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 -- 172.21.15.45:0/1737155428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f074c102ab0 msgr2=0x7f074c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f074c102ab0 0x7f074c100710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0748031460 tx=0x7f07480045e0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 -- 172.21.15.45:0/1737155428 shutdown_connections 2024-09-18T12:57:09.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f073807af30 0x7f073807d3f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f074c1033d0 0x7f074c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 --2- 172.21.15.45:0/1737155428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f074c102ab0 0x7f074c100710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 -- 172.21.15.45:0/1737155428 >> 172.21.15.45:0/1737155428 conn(0x7f074c0fc550 msgr2=0x7f074c108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:09.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 -- 172.21.15.45:0/1737155428 shutdown_connections 2024-09-18T12:57:09.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.746+0000 7f07542c4640 1 -- 172.21.15.45:0/1737155428 wait complete. 2024-09-18T12:57:09.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.833+0000 7f182460f640 1 -- 172.21.15.45:0/3367449205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f181c1033e0 msgr2=0x7f181c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.833+0000 7f182460f640 1 --2- 172.21.15.45:0/3367449205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f181c1033e0 0x7f181c10b8d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f180c009880 tx=0x7f180c02a530 comp rx=0 tx=0).stop 2024-09-18T12:57:09.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.833+0000 7f182460f640 1 -- 172.21.15.45:0/3367449205 shutdown_connections 2024-09-18T12:57:09.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.833+0000 7f182460f640 1 --2- 172.21.15.45:0/3367449205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f181c1033e0 0x7f181c10b8d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.833+0000 7f182460f640 1 --2- 172.21.15.45:0/3367449205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c102ac0 0x7f181c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.833+0000 7f182460f640 1 -- 172.21.15.45:0/3367449205 >> 172.21.15.45:0/3367449205 conn(0x7f181c0fc520 msgr2=0x7f181c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:09.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.833+0000 7f182460f640 1 -- 172.21.15.45:0/3367449205 shutdown_connections 2024-09-18T12:57:09.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.833+0000 7f182460f640 1 -- 172.21.15.45:0/3367449205 wait complete. 2024-09-18T12:57:09.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.834+0000 7f182460f640 1 Processor -- start 2024-09-18T12:57:09.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.834+0000 7f182460f640 1 -- start start 2024-09-18T12:57:09.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.834+0000 7f182460f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c102ac0 0x7f181c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:09.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.834+0000 7f182460f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f181c1033e0 0x7f181c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:09.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.834+0000 7f182460f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f181c10edf0 con 0x7f181c1033e0 2024-09-18T12:57:09.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.834+0000 7f182460f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f181c10ec70 con 0x7f181c102ac0 2024-09-18T12:57:09.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.834+0000 7f1821baa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f181c1033e0 0x7f181c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:09.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.834+0000 7f1821baa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f181c1033e0 0x7f181c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35786/0 (socket says 172.21.15.45:35786) 2024-09-18T12:57:09.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.834+0000 7f1821baa640 1 -- 172.21.15.45:0/922877545 learned_addr learned my addr 172.21.15.45:0/922877545 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:09.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.835+0000 7f18223ab640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c102ac0 0x7f181c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:09.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.835+0000 7f1821baa640 1 -- 172.21.15.45:0/922877545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c102ac0 msgr2=0x7f181c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:09.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.835+0000 7f1821baa640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c102ac0 0x7f181c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:09.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.835+0000 7f1821baa640 1 -- 172.21.15.45:0/922877545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c197800 con 0x7f181c1033e0 2024-09-18T12:57:09.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.835+0000 7f1821baa640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f181c1033e0 0x7f181c19dbc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f180c031460 tx=0x7f180c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:09.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.835+0000 7f18137fe640 1 -- 172.21.15.45:0/922877545 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f180c03f070 con 0x7f181c1033e0 2024-09-18T12:57:09.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.836+0000 7f18137fe640 1 -- 172.21.15.45:0/922877545 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f180c0035f0 con 0x7f181c1033e0 2024-09-18T12:57:09.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.836+0000 7f182460f640 1 -- 172.21.15.45:0/922877545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181c197a90 con 0x7f181c1033e0 2024-09-18T12:57:09.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.837+0000 7f18137fe640 1 -- 172.21.15.45:0/922877545 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f180c035030 con 0x7f181c1033e0 2024-09-18T12:57:09.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.837+0000 7f182460f640 1 -- 172.21.15.45:0/922877545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181c197ee0 con 0x7f181c1033e0 2024-09-18T12:57:09.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.838+0000 7f182460f640 1 -- 172.21.15.45:0/922877545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181c06aa90 con 0x7f181c1033e0 2024-09-18T12:57:09.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.838+0000 7f18137fe640 1 -- 172.21.15.45:0/922877545 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f180c042070 con 0x7f181c1033e0 2024-09-18T12:57:09.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.839+0000 7f18137fe640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f180807afe0 0x7f180807d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:09.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.839+0000 7f18137fe640 1 -- 172.21.15.45:0/922877545 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7f180c0c6350 con 0x7f181c1033e0 2024-09-18T12:57:09.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.839+0000 7f18223ab640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f180807afe0 0x7f180807d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:09.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.840+0000 7f18223ab640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f180807afe0 0x7f180807d4a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1818009bd0 tx=0x7f1818005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:09.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:09.845+0000 7f18137fe640 1 -- 172.21.15.45:0/922877545 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f180c089330 con 0x7f181c1033e0 2024-09-18T12:57:10.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.113+0000 7f182460f640 1 -- 172.21.15.45:0/922877545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f181c102ea0 con 0x7f181c1033e0 2024-09-18T12:57:10.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.113+0000 7f18137fe640 1 -- 172.21.15.45:0/922877545 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7f180c08e1e0 con 0x7f181c1033e0 2024-09-18T12:57:10.115 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:57:10.115 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:57:10.115 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:10.115 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:57:10.115 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:57:10.115 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:10.115 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:57:10.115 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:57:10.115 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-18T12:57:10.115 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:57:10.116 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:57:10.116 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:57:10.116 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:57:10.116 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:57:10.116 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 9, 2024-09-18T12:57:10.116 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:57:10.116 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:57:10.116 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:57:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.117+0000 7f182460f640 1 -- 172.21.15.45:0/922877545 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f180807afe0 msgr2=0x7f180807d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.117+0000 7f182460f640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f180807afe0 0x7f180807d4a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1818009bd0 tx=0x7f1818005f90 comp rx=0 tx=0).stop 2024-09-18T12:57:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.117+0000 7f182460f640 1 -- 172.21.15.45:0/922877545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f181c1033e0 msgr2=0x7f181c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.117+0000 7f182460f640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f181c1033e0 0x7f181c19dbc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f180c031460 tx=0x7f180c0045e0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.117+0000 7f182460f640 1 -- 172.21.15.45:0/922877545 shutdown_connections 2024-09-18T12:57:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.117+0000 7f182460f640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f180807afe0 0x7f180807d4a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.117+0000 7f182460f640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f181c1033e0 0x7f181c19dbc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.117+0000 7f182460f640 1 --2- 172.21.15.45:0/922877545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c102ac0 0x7f181c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.117+0000 7f182460f640 1 -- 172.21.15.45:0/922877545 >> 172.21.15.45:0/922877545 conn(0x7f181c0fc520 msgr2=0x7f181c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:10.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.118+0000 7f182460f640 1 -- 172.21.15.45:0/922877545 shutdown_connections 2024-09-18T12:57:10.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.118+0000 7f182460f640 1 -- 172.21.15.45:0/922877545 wait complete. 2024-09-18T12:57:10.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.209+0000 7f6b4491e640 1 -- 172.21.15.45:0/1720952296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b40106150 msgr2=0x7f6b40106530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.209+0000 7f6b4491e640 1 --2- 172.21.15.45:0/1720952296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b40106150 0x7f6b40106530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000a990 tx=0x7f6b3002b7d0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.209+0000 7f6b4491e640 1 -- 172.21.15.45:0/1720952296 shutdown_connections 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.209+0000 7f6b4491e640 1 --2- 172.21.15.45:0/1720952296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b401001d0 0x7f6b40100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.209+0000 7f6b4491e640 1 --2- 172.21.15.45:0/1720952296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b40106150 0x7f6b40106530 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.209+0000 7f6b4491e640 1 -- 172.21.15.45:0/1720952296 >> 172.21.15.45:0/1720952296 conn(0x7f6b400771e0 msgr2=0x7f6b400775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.209+0000 7f6b4491e640 1 -- 172.21.15.45:0/1720952296 shutdown_connections 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.209+0000 7f6b4491e640 1 -- 172.21.15.45:0/1720952296 wait complete. 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.210+0000 7f6b4491e640 1 Processor -- start 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.210+0000 7f6b4491e640 1 -- start start 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.210+0000 7f6b4491e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b401001d0 0x7f6b4019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.210+0000 7f6b4491e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b40106150 0x7f6b4019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.210+0000 7f6b4491e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4010cbb0 con 0x7f6b40106150 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.210+0000 7f6b4491e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4010ca30 con 0x7f6b401001d0 2024-09-18T12:57:10.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.211+0000 7f6b3dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b40106150 0x7f6b4019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:10.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.211+0000 7f6b3e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b401001d0 0x7f6b4019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:10.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.211+0000 7f6b3dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b40106150 0x7f6b4019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35812/0 (socket says 172.21.15.45:35812) 2024-09-18T12:57:10.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.211+0000 7f6b3dd9b640 1 -- 172.21.15.45:0/2708935299 learned_addr learned my addr 172.21.15.45:0/2708935299 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:10.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.211+0000 7f6b3e59c640 1 -- 172.21.15.45:0/2708935299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b40106150 msgr2=0x7f6b4019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.211+0000 7f6b3e59c640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b40106150 0x7f6b4019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.211+0000 7f6b3e59c640 1 -- 172.21.15.45:0/2708935299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b401977c0 con 0x7f6b401001d0 2024-09-18T12:57:10.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.211+0000 7f6b3dd9b640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b40106150 0x7f6b4019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:57:10.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.211+0000 7f6b3e59c640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b401001d0 0x7f6b4019d640 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6b30000c00 tx=0x7f6b30004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:10.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.211+0000 7f6b2f7fe640 1 -- 172.21.15.45:0/2708935299 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b30044030 con 0x7f6b401001d0 2024-09-18T12:57:10.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.212+0000 7f6b2f7fe640 1 -- 172.21.15.45:0/2708935299 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b30004b80 con 0x7f6b401001d0 2024-09-18T12:57:10.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.212+0000 7f6b4491e640 1 -- 172.21.15.45:0/2708935299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b40197a50 con 0x7f6b401001d0 2024-09-18T12:57:10.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.212+0000 7f6b2f7fe640 1 -- 172.21.15.45:0/2708935299 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b30005640 con 0x7f6b401001d0 2024-09-18T12:57:10.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.212+0000 7f6b4491e640 1 -- 172.21.15.45:0/2708935299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b40197fe0 con 0x7f6b401001d0 2024-09-18T12:57:10.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.213+0000 7f6b4491e640 1 -- 172.21.15.45:0/2708935299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b401016e0 con 0x7f6b401001d0 2024-09-18T12:57:10.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.214+0000 7f6b2f7fe640 1 -- 172.21.15.45:0/2708935299 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f6b30047070 con 0x7f6b401001d0 2024-09-18T12:57:10.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.215+0000 7f6b2f7fe640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6b2807b0e0 0x7f6b2807d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:10.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.215+0000 7f6b2f7fe640 1 -- 172.21.15.45:0/2708935299 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7f6b30045070 con 0x7f6b401001d0 2024-09-18T12:57:10.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.215+0000 7f6b3dd9b640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6b2807b0e0 0x7f6b2807d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:10.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.215+0000 7f6b3dd9b640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6b2807b0e0 0x7f6b2807d5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6b400ff9a0 tx=0x7f6b34005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:10.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.220+0000 7f6b2f7fe640 1 -- 172.21.15.45:0/2708935299 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6b3008a5f0 con 0x7f6b401001d0 2024-09-18T12:57:10.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:10 smithi045 ceph-mon[109129]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:10.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:10 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:10.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:10 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:10.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:10 smithi045 ceph-mon[109129]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:10.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:10 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/922877545' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:10.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.485+0000 7f6b4491e640 1 -- 172.21.15.45:0/2708935299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6b401052f0 con 0x7f6b401001d0 2024-09-18T12:57:10.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.485+0000 7f6b2f7fe640 1 -- 172.21.15.45:0/2708935299 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2046 (secure 0 0 0) 0x7f6b3008f4a0 con 0x7f6b401001d0 2024-09-18T12:57:10.487 INFO:teuthology.orchestra.run.smithi045.stdout:e16 2024-09-18T12:57:10.488 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T12:49:30:966010+0000 2024-09-18T12:57:10.488 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:57:10.488 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:57:10.488 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T12:57:10.488 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:57:10.489 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:57:10.489 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T12:57:10.489 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 14 2024-09-18T12:57:10.489 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:57:10.489 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:57:10.490 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T12:49:28.960615+0000 2024-09-18T12:57:10.490 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T12:57:10.490 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T12:57:10.490 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T12:57:10.490 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T12:57:10.490 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T12:57:10.491 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T12:57:10.491 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T12:57:10.491 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T12:57:10.491 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-18T12:57:10.491 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:57:10.491 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T12:57:10.492 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T12:57:10.492 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=14566} 2024-09-18T12:57:10.492 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T12:57:10.492 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T12:57:10.492 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T12:57:10.493 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T12:57:10.493 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T12:57:10.493 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T12:57:10.493 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T12:57:10.493 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T12:57:10.493 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T12:57:10.494 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 14566 members: 14566 2024-09-18T12:57:10.494 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:10.494 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:10.494 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:57:10.494 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:57:10.495 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T12:57:10.495 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:57:10.495 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:10.495 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2024-09-18T12:57:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 -- 172.21.15.45:0/2708935299 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6b2807b0e0 msgr2=0x7f6b2807d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6b2807b0e0 0x7f6b2807d5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6b400ff9a0 tx=0x7f6b34005f90 comp rx=0 tx=0).stop 2024-09-18T12:57:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 -- 172.21.15.45:0/2708935299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b401001d0 msgr2=0x7f6b4019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b401001d0 0x7f6b4019d640 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6b30000c00 tx=0x7f6b30004270 comp rx=0 tx=0).stop 2024-09-18T12:57:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 -- 172.21.15.45:0/2708935299 shutdown_connections 2024-09-18T12:57:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6b2807b0e0 0x7f6b2807d5a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b40106150 0x7f6b4019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 --2- 172.21.15.45:0/2708935299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b401001d0 0x7f6b4019d640 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 -- 172.21.15.45:0/2708935299 >> 172.21.15.45:0/2708935299 conn(0x7f6b400771e0 msgr2=0x7f6b4010a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 -- 172.21.15.45:0/2708935299 shutdown_connections 2024-09-18T12:57:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.488+0000 7f6b4491e640 1 -- 172.21.15.45:0/2708935299 wait complete. 2024-09-18T12:57:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:10 smithi161 ceph-mon[80292]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:10 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:10 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:10 smithi161 ceph-mon[80292]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:10 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/922877545' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:10.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.574+0000 7ff378fce640 1 -- 172.21.15.45:0/1198183451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3741067f0 msgr2=0x7ff374106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.574+0000 7ff378fce640 1 --2- 172.21.15.45:0/1198183451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3741067f0 0x7ff374106bd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff364009880 tx=0x7ff36402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.574+0000 7ff378fce640 1 -- 172.21.15.45:0/1198183451 shutdown_connections 2024-09-18T12:57:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.574+0000 7ff378fce640 1 --2- 172.21.15.45:0/1198183451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3741007f0 0x7ff374100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.574+0000 7ff378fce640 1 --2- 172.21.15.45:0/1198183451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3741067f0 0x7ff374106bd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.574+0000 7ff378fce640 1 -- 172.21.15.45:0/1198183451 >> 172.21.15.45:0/1198183451 conn(0x7ff3740fc550 msgr2=0x7ff3740fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.574+0000 7ff378fce640 1 -- 172.21.15.45:0/1198183451 shutdown_connections 2024-09-18T12:57:10.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.574+0000 7ff378fce640 1 -- 172.21.15.45:0/1198183451 wait complete. 2024-09-18T12:57:10.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff378fce640 1 Processor -- start 2024-09-18T12:57:10.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff378fce640 1 -- start start 2024-09-18T12:57:10.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff378fce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3741007f0 0x7ff37419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:10.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff378fce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3741067f0 0x7ff37419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:10.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff378fce640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff37410dcc0 con 0x7ff3741007f0 2024-09-18T12:57:10.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff378fce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff37410db40 con 0x7ff3741067f0 2024-09-18T12:57:10.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff37259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3741007f0 0x7ff37419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff37259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3741007f0 0x7ff37419c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35840/0 (socket says 172.21.15.45:35840) 2024-09-18T12:57:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff37259c640 1 -- 172.21.15.45:0/4263954596 learned_addr learned my addr 172.21.15.45:0/4263954596 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff371d9b640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3741067f0 0x7ff37419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff37259c640 1 -- 172.21.15.45:0/4263954596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3741067f0 msgr2=0x7ff37419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff37259c640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3741067f0 0x7ff37419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.575+0000 7ff37259c640 1 -- 172.21.15.45:0/4263954596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3741966d0 con 0x7ff3741007f0 2024-09-18T12:57:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.576+0000 7ff37259c640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3741007f0 0x7ff37419c600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff364031460 tx=0x7ff3640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.576+0000 7ff3637fe640 1 -- 172.21.15.45:0/4263954596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff36403f070 con 0x7ff3741007f0 2024-09-18T12:57:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.576+0000 7ff3637fe640 1 -- 172.21.15.45:0/4263954596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff364004b10 con 0x7ff3741007f0 2024-09-18T12:57:10.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.576+0000 7ff378fce640 1 -- 172.21.15.45:0/4263954596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff374196960 con 0x7ff3741007f0 2024-09-18T12:57:10.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.576+0000 7ff3637fe640 1 -- 172.21.15.45:0/4263954596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff364035030 con 0x7ff3741007f0 2024-09-18T12:57:10.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.576+0000 7ff378fce640 1 -- 172.21.15.45:0/4263954596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff374196e60 con 0x7ff3741007f0 2024-09-18T12:57:10.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.577+0000 7ff378fce640 1 -- 172.21.15.45:0/4263954596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff374101f30 con 0x7ff3741007f0 2024-09-18T12:57:10.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.578+0000 7ff3637fe640 1 -- 172.21.15.45:0/4263954596 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7ff364042070 con 0x7ff3741007f0 2024-09-18T12:57:10.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.578+0000 7ff3637fe640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35c07af40 0x7ff35c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:10.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.578+0000 7ff371d9b640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35c07af40 0x7ff35c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:10.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.578+0000 7ff3637fe640 1 -- 172.21.15.45:0/4263954596 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7ff3640bea50 con 0x7ff3741007f0 2024-09-18T12:57:10.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.579+0000 7ff371d9b640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35c07af40 0x7ff35c07d400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff374197f20 tx=0x7ff36800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:10.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.583+0000 7ff3637fe640 1 -- 172.21.15.45:0/4263954596 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff36408a0a0 con 0x7ff3741007f0 2024-09-18T12:57:10.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:10 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[118168]: 2024-09-18T12:57:10.452+0000 7f351d4d6640 -1 osd.0 46 log_to_monitors true 2024-09-18T12:57:10.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.787+0000 7ff378fce640 1 -- 172.21.15.45:0/4263954596 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff3741971d0 con 0x7ff35c07af40 2024-09-18T12:57:10.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.788+0000 7ff3637fe640 1 -- 172.21.15.45:0/4263954596 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7ff3741971d0 con 0x7ff35c07af40 2024-09-18T12:57:10.790 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:57:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:57:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:57:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:57:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:57:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr", 2024-09-18T12:57:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: "mon", 2024-09-18T12:57:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: "crash" 2024-09-18T12:57:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:57:10.791 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "7/23 daemons upgraded", 2024-09-18T12:57:10.791 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:57:10.791 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:57:10.791 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:57:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.790+0000 7ff378fce640 1 -- 172.21.15.45:0/4263954596 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35c07af40 msgr2=0x7ff35c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.790+0000 7ff378fce640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35c07af40 0x7ff35c07d400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff374197f20 tx=0x7ff36800b390 comp rx=0 tx=0).stop 2024-09-18T12:57:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.791+0000 7ff378fce640 1 -- 172.21.15.45:0/4263954596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3741007f0 msgr2=0x7ff37419c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.791+0000 7ff378fce640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3741007f0 0x7ff37419c600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff364031460 tx=0x7ff3640045e0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.791+0000 7ff378fce640 1 -- 172.21.15.45:0/4263954596 shutdown_connections 2024-09-18T12:57:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.791+0000 7ff378fce640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35c07af40 0x7ff35c07d400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.791+0000 7ff378fce640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3741067f0 0x7ff37419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.791+0000 7ff378fce640 1 --2- 172.21.15.45:0/4263954596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3741007f0 0x7ff37419c600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.791+0000 7ff378fce640 1 -- 172.21.15.45:0/4263954596 >> 172.21.15.45:0/4263954596 conn(0x7ff3740fc550 msgr2=0x7ff3740fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.791+0000 7ff378fce640 1 -- 172.21.15.45:0/4263954596 shutdown_connections 2024-09-18T12:57:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.791+0000 7ff378fce640 1 -- 172.21.15.45:0/4263954596 wait complete. 2024-09-18T12:57:10.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.876+0000 7fa72e578640 1 -- 172.21.15.45:0/3045964015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7281033e0 msgr2=0x7fa72810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.876+0000 7fa72e578640 1 --2- 172.21.15.45:0/3045964015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7281033e0 0x7fa72810b8d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa710009880 tx=0x7fa71002a530 comp rx=0 tx=0).stop 2024-09-18T12:57:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.876+0000 7fa72e578640 1 -- 172.21.15.45:0/3045964015 shutdown_connections 2024-09-18T12:57:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.876+0000 7fa72e578640 1 --2- 172.21.15.45:0/3045964015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7281033e0 0x7fa72810b8d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.876+0000 7fa72e578640 1 --2- 172.21.15.45:0/3045964015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa728102ac0 0x7fa728102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.876+0000 7fa72e578640 1 -- 172.21.15.45:0/3045964015 >> 172.21.15.45:0/3045964015 conn(0x7fa7280fc520 msgr2=0x7fa7280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.876+0000 7fa72e578640 1 -- 172.21.15.45:0/3045964015 shutdown_connections 2024-09-18T12:57:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.876+0000 7fa72e578640 1 -- 172.21.15.45:0/3045964015 wait complete. 2024-09-18T12:57:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa72e578640 1 Processor -- start 2024-09-18T12:57:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa72e578640 1 -- start start 2024-09-18T12:57:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa72e578640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa728102ac0 0x7fa728100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa72e578640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7281033e0 0x7fa728100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa72e578640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa72810edf0 con 0x7fa728102ac0 2024-09-18T12:57:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa72e578640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa72810ec70 con 0x7fa7281033e0 2024-09-18T12:57:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa727fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa728102ac0 0x7fa728100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa727fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa728102ac0 0x7fa728100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35866/0 (socket says 172.21.15.45:35866) 2024-09-18T12:57:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa727fff640 1 -- 172.21.15.45:0/2942219065 learned_addr learned my addr 172.21.15.45:0/2942219065 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa71ffff640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7281033e0 0x7fa728100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa727fff640 1 -- 172.21.15.45:0/2942219065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7281033e0 msgr2=0x7fa728100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa727fff640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7281033e0 0x7fa728100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.877+0000 7fa727fff640 1 -- 172.21.15.45:0/2942219065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7281011a0 con 0x7fa728102ac0 2024-09-18T12:57:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.878+0000 7fa727fff640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa728102ac0 0x7fa728100720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa71800d6f0 tx=0x7fa71800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.878+0000 7fa725ffb640 1 -- 172.21.15.45:0/2942219065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa718017070 con 0x7fa728102ac0 2024-09-18T12:57:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.878+0000 7fa72e578640 1 -- 172.21.15.45:0/2942219065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa728101490 con 0x7fa728102ac0 2024-09-18T12:57:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.878+0000 7fa725ffb640 1 -- 172.21.15.45:0/2942219065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa71800de00 con 0x7fa728102ac0 2024-09-18T12:57:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.878+0000 7fa725ffb640 1 -- 172.21.15.45:0/2942219065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa718004bb0 con 0x7fa728102ac0 2024-09-18T12:57:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.878+0000 7fa72e578640 1 -- 172.21.15.45:0/2942219065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7281a3e80 con 0x7fa728102ac0 2024-09-18T12:57:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.879+0000 7fa72e578640 1 -- 172.21.15.45:0/2942219065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa72806aa90 con 0x7fa728102ac0 2024-09-18T12:57:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.880+0000 7fa725ffb640 1 -- 172.21.15.45:0/2942219065 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fa718004e60 con 0x7fa728102ac0 2024-09-18T12:57:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.880+0000 7fa725ffb640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa71407af40 0x7fa71407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.880+0000 7fa725ffb640 1 -- 172.21.15.45:0/2942219065 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7fa71809db50 con 0x7fa728102ac0 2024-09-18T12:57:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.880+0000 7fa71ffff640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa71407af40 0x7fa71407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.881+0000 7fa71ffff640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa71407af40 0x7fa71407d400 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7281021b0 tx=0x7fa710031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:10.884+0000 7fa725ffb640 1 -- 172.21.15.45:0/2942219065 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa7180691a0 con 0x7fa728102ac0 2024-09-18T12:57:11.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.169+0000 7fa72e578640 1 -- 172.21.15.45:0/2942219065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa728105f60 con 0x7fa728102ac0 2024-09-18T12:57:11.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.169+0000 7fa725ffb640 1 -- 172.21.15.45:0/2942219065 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1462 (secure 0 0 0) 0x7fa71806e050 con 0x7fa728102ac0 2024-09-18T12:57:11.171 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 48/255 objects degraded (18.824%), 18 pgs degraded 2024-09-18T12:57:11.171 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:57:11.171 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:57:11.172 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-18T12:57:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: osd.0 (root=default,host=smithi045) is down 2024-09-18T12:57:11.172 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 48/255 objects degraded (18.824%), 18 pgs degraded 2024-09-18T12:57:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-18T12:57:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-18T12:57:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-18T12:57:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-18T12:57:11.172 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-18T12:57:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-18T12:57:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-18T12:57:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-18T12:57:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-18T12:57:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-18T12:57:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-18T12:57:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-18T12:57:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-18T12:57:11.174 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-18T12:57:11.174 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-18T12:57:11.174 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-18T12:57:11.174 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-18T12:57:11.174 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-18T12:57:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 -- 172.21.15.45:0/2942219065 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa71407af40 msgr2=0x7fa71407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa71407af40 0x7fa71407d400 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7281021b0 tx=0x7fa710031400 comp rx=0 tx=0).stop 2024-09-18T12:57:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 -- 172.21.15.45:0/2942219065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa728102ac0 msgr2=0x7fa728100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa728102ac0 0x7fa728100720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa71800d6f0 tx=0x7fa71800dbb0 comp rx=0 tx=0).stop 2024-09-18T12:57:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 -- 172.21.15.45:0/2942219065 shutdown_connections 2024-09-18T12:57:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa71407af40 0x7fa71407d400 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7281033e0 0x7fa728100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 --2- 172.21.15.45:0/2942219065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa728102ac0 0x7fa728100720 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 -- 172.21.15.45:0/2942219065 >> 172.21.15.45:0/2942219065 conn(0x7fa7280fc520 msgr2=0x7fa728108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 -- 172.21.15.45:0/2942219065 shutdown_connections 2024-09-18T12:57:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:11.172+0000 7fa72e578640 1 -- 172.21.15.45:0/2942219065 wait complete. 2024-09-18T12:57:11.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:11 smithi045 ceph-mon[109129]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:11.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:11 smithi045 ceph-mon[109129]: pgmap v134: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:11.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:11 smithi045 ceph-mon[109129]: from='osd.0 [v2:172.21.15.45:6802/2040829771,v1:172.21.15.45:6803/2040829771]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-18T12:57:11.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:11 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2708935299' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:11.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:11 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2942219065' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:11.535 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 12:57:11 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[118168]: 2024-09-18T12:57:11.254+0000 7f3515280640 -1 osd.0 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:57:11.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:11 smithi161 ceph-mon[80292]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:11.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:11 smithi161 ceph-mon[80292]: pgmap v134: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:11.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:11 smithi161 ceph-mon[80292]: from='osd.0 [v2:172.21.15.45:6802/2040829771,v1:172.21.15.45:6803/2040829771]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-18T12:57:11.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:11 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2708935299' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:11.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:11 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2942219065' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:12.399 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:12 smithi045 ceph-mon[109129]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:12.400 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:12 smithi045 ceph-mon[109129]: from='osd.0 [v2:172.21.15.45:6802/2040829771,v1:172.21.15.45:6803/2040829771]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:57:12.400 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:12 smithi045 ceph-mon[109129]: osdmap e49: 6 total, 5 up, 6 in 2024-09-18T12:57:12.400 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:12 smithi045 ceph-mon[109129]: from='osd.0 [v2:172.21.15.45:6802/2040829771,v1:172.21.15.45:6803/2040829771]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]} : dispatch 2024-09-18T12:57:12.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:12 smithi161 ceph-mon[80292]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:12.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:12 smithi161 ceph-mon[80292]: from='osd.0 [v2:172.21.15.45:6802/2040829771,v1:172.21.15.45:6803/2040829771]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T12:57:12.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:12 smithi161 ceph-mon[80292]: osdmap e49: 6 total, 5 up, 6 in 2024-09-18T12:57:12.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:12 smithi161 ceph-mon[80292]: from='osd.0 [v2:172.21.15.45:6802/2040829771,v1:172.21.15.45:6803/2040829771]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]} : dispatch 2024-09-18T12:57:13.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: pgmap v136: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:13.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:57:13.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: osd.0 [v2:172.21.15.45:6802/2040829771,v1:172.21.15.45:6803/2040829771] boot 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: osdmap e50: 6 total, 6 up, 6 in 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:57:13.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-18T12:57:13.536 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:13 smithi045 ceph-mon[109129]: osdmap e51: 6 total, 6 up, 6 in 2024-09-18T12:57:13.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: pgmap v136: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 48/255 objects degraded (18.824%) 2024-09-18T12:57:13.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:57:13.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: osd.0 [v2:172.21.15.45:6802/2040829771,v1:172.21.15.45:6803/2040829771] boot 2024-09-18T12:57:13.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: osdmap e50: 6 total, 6 up, 6 in 2024-09-18T12:57:13.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-18T12:57:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:13 smithi161 ceph-mon[80292]: osdmap e51: 6 total, 6 up, 6 in 2024-09-18T12:57:14.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:14 smithi045 ceph-mon[109129]: Health check update: Degraded data redundancy: 6/255 objects degraded (2.353%), 3 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:14.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:14 smithi161 ceph-mon[80292]: Health check update: Degraded data redundancy: 6/255 objects degraded (2.353%), 3 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:15 smithi045 ceph-mon[109129]: pgmap v139: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 6/255 objects degraded (2.353%) 2024-09-18T12:57:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:15 smithi161 ceph-mon[80292]: pgmap v139: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 6/255 objects degraded (2.353%) 2024-09-18T12:57:17.719 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:17 smithi161 ceph-mon[80292]: pgmap v140: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 6/255 objects degraded (2.353%) 2024-09-18T12:57:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:17 smithi045 ceph-mon[109129]: pgmap v140: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 6/255 objects degraded (2.353%) 2024-09-18T12:57:18.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:18 smithi045 ceph-mon[109129]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/255 objects degraded (2.353%), 3 pgs degraded) 2024-09-18T12:57:18.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:18 smithi161 ceph-mon[80292]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/255 objects degraded (2.353%), 3 pgs degraded) 2024-09-18T12:57:19.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:19 smithi045 ceph-mon[109129]: pgmap v141: 65 pgs: 5 peering, 60 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-18T12:57:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:19 smithi161 ceph-mon[80292]: pgmap v141: 65 pgs: 5 peering, 60 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-18T12:57:21.470 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:21 smithi045 ceph-mon[109129]: pgmap v142: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-18T12:57:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:21 smithi161 ceph-mon[80292]: pgmap v142: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-18T12:57:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:23 smithi045 ceph-mon[109129]: pgmap v143: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 923 B/s rd, 1 op/s 2024-09-18T12:57:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:23 smithi161 ceph-mon[80292]: pgmap v143: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 923 B/s rd, 1 op/s 2024-09-18T12:57:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:25.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:25 smithi045 ceph-mon[109129]: pgmap v144: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 839 B/s rd, 1 op/s 2024-09-18T12:57:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:25 smithi161 ceph-mon[80292]: pgmap v144: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 839 B/s rd, 1 op/s 2024-09-18T12:57:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:27 smithi045 ceph-mon[109129]: pgmap v145: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-18T12:57:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:27 smithi161 ceph-mon[80292]: pgmap v145: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-18T12:57:28.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:28 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:57:28.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:28 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:57:28.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:28 smithi045 ceph-mon[109129]: Upgrade: osd.1 is safe to restart 2024-09-18T12:57:28.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:28 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:28 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-18T12:57:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:28 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T12:57:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:28 smithi161 ceph-mon[80292]: Upgrade: osd.1 is safe to restart 2024-09-18T12:57:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:28 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:29.584 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:29 smithi045 ceph-mon[109129]: pgmap v146: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:57:29.584 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:29.584 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-18T12:57:29.584 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:29 smithi161 ceph-mon[80292]: pgmap v146: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:57:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-18T12:57:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:30.682 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:30 smithi045 ceph-mon[109129]: Upgrade: Updating osd.1 2024-09-18T12:57:30.682 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:30 smithi045 ceph-mon[109129]: Deploying daemon osd.1 on smithi045 2024-09-18T12:57:30.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:30 smithi161 ceph-mon[80292]: Upgrade: Updating osd.1 2024-09-18T12:57:30.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:30 smithi161 ceph-mon[80292]: Deploying daemon osd.1 on smithi045 2024-09-18T12:57:31.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:31 smithi045 ceph-mon[109129]: pgmap v147: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:57:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:31 smithi161 ceph-mon[80292]: pgmap v147: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:57:32.259 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:32 smithi045 systemd[1]: Stopping Ceph osd.1 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:57:32.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:32 smithi045 ceph-mon[109129]: osd.1 marked itself down and dead 2024-09-18T12:57:32.534 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:32 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[63069]: 2024-09-18T12:57:32.256+0000 7f65beb41640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:57:32.534 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:32 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[63069]: 2024-09-18T12:57:32.256+0000 7f65beb41640 -1 osd.1 51 *** Got signal Terminated *** 2024-09-18T12:57:32.534 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:32 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[63069]: 2024-09-18T12:57:32.256+0000 7f65beb41640 -1 osd.1 51 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:57:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:32 smithi161 ceph-mon[80292]: osd.1 marked itself down and dead 2024-09-18T12:57:33.034 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:32 smithi045 podman[122873]: 2024-09-18 12:57:32.758049236 +0000 UTC m=+0.603897094 container stop 168e69ac7e62a0184ba9df0160fa6a281bb00cf1cb2ea457cf7b5a080bbb45aa (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-18T12:57:33.034 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:32 smithi045 podman[122873]: 2024-09-18 12:57:32.784223621 +0000 UTC m=+0.630071472 container died 168e69ac7e62a0184ba9df0160fa6a281bb00cf1cb2ea457cf7b5a080bbb45aa (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-18T12:57:33.471 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:33 smithi045 ceph-mon[109129]: pgmap v148: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:57:33.472 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:33 smithi045 ceph-mon[109129]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:57:33.472 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:33 smithi045 ceph-mon[109129]: osdmap e52: 6 total, 5 up, 6 in 2024-09-18T12:57:33.472 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:33 smithi045 podman[122873]: 2024-09-18 12:57:33.298942821 +0000 UTC m=+1.144790668 container cleanup 168e69ac7e62a0184ba9df0160fa6a281bb00cf1cb2ea457cf7b5a080bbb45aa (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:57:33.472 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:33 smithi045 bash[122873]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1 2024-09-18T12:57:33.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:33 smithi045 podman[122890]: 2024-09-18 12:57:33.500365777 +0000 UTC m=+0.735282994 container remove 168e69ac7e62a0184ba9df0160fa6a281bb00cf1cb2ea457cf7b5a080bbb45aa (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-18T12:57:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:33 smithi161 ceph-mon[80292]: pgmap v148: 65 pgs: 65 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:57:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:33 smithi161 ceph-mon[80292]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:57:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:33 smithi161 ceph-mon[80292]: osdmap e52: 6 total, 5 up, 6 in 2024-09-18T12:57:34.238 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:33 smithi045 podman[122978]: 2024-09-18 12:57:33.91780975 +0000 UTC m=+0.109775591 container create ae2acb392aeca464c4fe3b63c16072a51b6110a092c2e766c6d8cd72d550f95e (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:57:34.238 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:33 smithi045 podman[122978]: 2024-09-18 12:57:33.824930035 +0000 UTC m=+0.016895885 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:34.238 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:34 smithi045 podman[122978]: 2024-09-18 12:57:34.161853056 +0000 UTC m=+0.353818903 container init ae2acb392aeca464c4fe3b63c16072a51b6110a092c2e766c6d8cd72d550f95e (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:57:34.238 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:34 smithi045 podman[122978]: 2024-09-18 12:57:34.16537627 +0000 UTC m=+0.357342108 container start ae2acb392aeca464c4fe3b63c16072a51b6110a092c2e766c6d8cd72d550f95e (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-18T12:57:34.238 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:34 smithi045 podman[122978]: 2024-09-18 12:57:34.236679389 +0000 UTC m=+0.428645245 container attach ae2acb392aeca464c4fe3b63c16072a51b6110a092c2e766c6d8cd72d550f95e (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:57:34.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:34 smithi045 ceph-mon[109129]: osdmap e53: 6 total, 5 up, 6 in 2024-09-18T12:57:34.535 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:34 smithi045 podman[122978]: 2024-09-18 12:57:34.369130175 +0000 UTC m=+0.561096031 container died ae2acb392aeca464c4fe3b63c16072a51b6110a092c2e766c6d8cd72d550f95e (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS) 2024-09-18T12:57:34.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:34 smithi161 ceph-mon[80292]: osdmap e53: 6 total, 5 up, 6 in 2024-09-18T12:57:34.960 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:34 smithi045 podman[123001]: 2024-09-18 12:57:34.957376169 +0000 UTC m=+0.582163682 container remove ae2acb392aeca464c4fe3b63c16072a51b6110a092c2e766c6d8cd72d550f95e (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:57:35.284 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:34 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-18T12:57:35.284 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:34 smithi045 systemd[1]: Stopped Ceph osd.1 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:57:35.284 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:34 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 1.251s CPU time. 2024-09-18T12:57:35.284 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:35 smithi045 systemd[1]: Starting Ceph osd.1 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:57:35.661 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:35 smithi045 ceph-mon[109129]: pgmap v151: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-18T12:57:35.662 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:35 smithi045 ceph-mon[109129]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-18T12:57:35.662 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:35 smithi045 podman[123097]: 2024-09-18 12:57:35.416964418 +0000 UTC m=+0.109222533 container create ed02385e4637ce1feb390b76445a647ff5c49ca7d401c853ada847fefae64864 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True) 2024-09-18T12:57:35.662 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:35 smithi045 podman[123097]: 2024-09-18 12:57:35.324138585 +0000 UTC m=+0.016396702 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:35.662 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:35 smithi045 podman[123097]: 2024-09-18 12:57:35.661213939 +0000 UTC m=+0.353472063 container init ed02385e4637ce1feb390b76445a647ff5c49ca7d401c853ada847fefae64864 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-18T12:57:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:35 smithi161 ceph-mon[80292]: pgmap v151: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-18T12:57:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:35 smithi161 ceph-mon[80292]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-18T12:57:36.034 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:35 smithi045 podman[123097]: 2024-09-18 12:57:35.664933946 +0000 UTC m=+0.357192069 container start ed02385e4637ce1feb390b76445a647ff5c49ca7d401c853ada847fefae64864 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-18T12:57:36.035 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:35 smithi045 podman[123097]: 2024-09-18 12:57:35.761016188 +0000 UTC m=+0.453274310 container attach ed02385e4637ce1feb390b76445a647ff5c49ca7d401c853ada847fefae64864 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True) 2024-09-18T12:57:36.035 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:35 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[123112]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:36.035 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:35 smithi045 bash[123097]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:36.035 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:35 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[123112]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:36.035 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:35 smithi045 bash[123097]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:57:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:37 smithi045 ceph-mon[109129]: pgmap v152: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-18T12:57:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:37 smithi161 ceph-mon[80292]: pgmap v152: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-18T12:57:38.458 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[123112]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:38.458 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 bash[123097]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:38.458 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[123112]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:57:38.458 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 bash[123097]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:57:38.458 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[123112]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:57:38.458 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 bash[123097]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:57:38.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[123112]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:57:38.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 bash[123097]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:57:38.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[123112]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-18T12:57:38.785 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 bash[123097]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-18T12:57:38.785 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[123112]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:38.785 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 bash[123097]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:57:38.785 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate[123112]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-18T12:57:38.785 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 bash[123097]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-18T12:57:38.785 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:38 smithi045 podman[123097]: 2024-09-18 12:57:38.494871883 +0000 UTC m=+3.187130000 container died ed02385e4637ce1feb390b76445a647ff5c49ca7d401c853ada847fefae64864 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-18T12:57:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:39 smithi045 ceph-mon[109129]: pgmap v153: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:39 smithi161 ceph-mon[80292]: pgmap v153: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:39.782 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:39 smithi045 podman[123279]: 2024-09-18 12:57:39.440548904 +0000 UTC m=+0.937693398 container remove ed02385e4637ce1feb390b76445a647ff5c49ca7d401c853ada847fefae64864 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-18T12:57:39.782 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:39 smithi045 podman[123342]: 2024-09-18 12:57:39.566242694 +0000 UTC m=+0.017429901 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:57:39.782 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:39 smithi045 podman[123342]: 2024-09-18 12:57:39.674725581 +0000 UTC m=+0.125912818 container create 7d4cd03517258ca543e457fa610a391dc70f672cb26a9253a36f359bdd3f4c10 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-18T12:57:40.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:40 smithi045 ceph-mon[109129]: Health check failed: Degraded data redundancy: 34/255 objects degraded (13.333%), 13 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:40.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:40 smithi045 ceph-mon[109129]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-18T12:57:40.284 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:39 smithi045 podman[123342]: 2024-09-18 12:57:39.876903036 +0000 UTC m=+0.328090242 container init 7d4cd03517258ca543e457fa610a391dc70f672cb26a9253a36f359bdd3f4c10 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-18T12:57:40.285 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:39 smithi045 podman[123342]: 2024-09-18 12:57:39.880306669 +0000 UTC m=+0.331493852 container start 7d4cd03517258ca543e457fa610a391dc70f672cb26a9253a36f359bdd3f4c10 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-18T12:57:40.285 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:39 smithi045 ceph-osd[123361]: -- 172.21.15.45:0/1709467635 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f0d06481e0 con 0x55f0cf7e7c00 2024-09-18T12:57:40.285 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:39 smithi045 bash[123342]: 7d4cd03517258ca543e457fa610a391dc70f672cb26a9253a36f359bdd3f4c10 2024-09-18T12:57:40.285 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:39 smithi045 systemd[1]: Started Ceph osd.1 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:57:40.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:40 smithi161 ceph-mon[80292]: Health check failed: Degraded data redundancy: 34/255 objects degraded (13.333%), 13 pgs degraded (PG_DEGRADED) 2024-09-18T12:57:40.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:40 smithi161 ceph-mon[80292]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-18T12:57:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.261+0000 7f9a54679640 1 -- 172.21.15.45:0/1173041127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a4c102ac0 msgr2=0x7f9a4c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.261+0000 7f9a54679640 1 --2- 172.21.15.45:0/1173041127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a4c102ac0 0x7f9a4c102ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009880 tx=0x7f9a4802a530 comp rx=0 tx=0).stop 2024-09-18T12:57:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.261+0000 7f9a54679640 1 -- 172.21.15.45:0/1173041127 shutdown_connections 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.261+0000 7f9a54679640 1 --2- 172.21.15.45:0/1173041127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4c1033e0 0x7f9a4c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.261+0000 7f9a54679640 1 --2- 172.21.15.45:0/1173041127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a4c102ac0 0x7f9a4c102ea0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.261+0000 7f9a54679640 1 -- 172.21.15.45:0/1173041127 >> 172.21.15.45:0/1173041127 conn(0x7f9a4c0fc520 msgr2=0x7f9a4c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.261+0000 7f9a54679640 1 -- 172.21.15.45:0/1173041127 shutdown_connections 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.261+0000 7f9a54679640 1 -- 172.21.15.45:0/1173041127 wait complete. 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.261+0000 7f9a54679640 1 Processor -- start 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.261+0000 7f9a54679640 1 -- start start 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a54679640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a4c102ac0 0x7f9a4c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a54679640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4c1033e0 0x7f9a4c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a54679640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c10edf0 con 0x7f9a4c102ac0 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a54679640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c10ec70 con 0x7f9a4c1033e0 2024-09-18T12:57:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a52415640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a4c102ac0 0x7f9a4c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a52415640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a4c102ac0 0x7f9a4c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56036/0 (socket says 172.21.15.45:56036) 2024-09-18T12:57:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a52415640 1 -- 172.21.15.45:0/2584817088 learned_addr learned my addr 172.21.15.45:0/2584817088 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a51c14640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4c1033e0 0x7f9a4c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a52415640 1 -- 172.21.15.45:0/2584817088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4c1033e0 msgr2=0x7f9a4c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a52415640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4c1033e0 0x7f9a4c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a52415640 1 -- 172.21.15.45:0/2584817088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c1977c0 con 0x7f9a4c102ac0 2024-09-18T12:57:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.262+0000 7f9a52415640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a4c102ac0 0x7f9a4c19d640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a48031460 tx=0x7f9a480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.263+0000 7f9a437fe640 1 -- 172.21.15.45:0/2584817088 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a4803f070 con 0x7f9a4c102ac0 2024-09-18T12:57:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.263+0000 7f9a54679640 1 -- 172.21.15.45:0/2584817088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4c197a50 con 0x7f9a4c102ac0 2024-09-18T12:57:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.263+0000 7f9a437fe640 1 -- 172.21.15.45:0/2584817088 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a480035f0 con 0x7f9a4c102ac0 2024-09-18T12:57:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.263+0000 7f9a437fe640 1 -- 172.21.15.45:0/2584817088 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a48035030 con 0x7f9a4c102ac0 2024-09-18T12:57:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.263+0000 7f9a54679640 1 -- 172.21.15.45:0/2584817088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4c197f80 con 0x7f9a4c102ac0 2024-09-18T12:57:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.264+0000 7f9a54679640 1 -- 172.21.15.45:0/2584817088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a4c06aa90 con 0x7f9a4c102ac0 2024-09-18T12:57:41.266 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:41.267 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:41.267 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:41.267 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:41 smithi045 ceph-mon[109129]: pgmap v154: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.265+0000 7f9a437fe640 1 -- 172.21.15.45:0/2584817088 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f9a48042070 con 0x7f9a4c102ac0 2024-09-18T12:57:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.265+0000 7f9a437fe640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9a3807af30 0x7f9a3807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.265+0000 7f9a437fe640 1 -- 172.21.15.45:0/2584817088 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6070+0+0 (secure 0 0 0) 0x7f9a480be920 con 0x7f9a4c102ac0 2024-09-18T12:57:41.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.265+0000 7f9a51c14640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9a3807af30 0x7f9a3807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.266+0000 7f9a51c14640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9a3807af30 0x7f9a3807d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c108900 tx=0x7f9a3c00b2e0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.270+0000 7f9a437fe640 1 -- 172.21.15.45:0/2584817088 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9a48089f70 con 0x7f9a4c102ac0 2024-09-18T12:57:41.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:41.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:41.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:41.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:41 smithi161 ceph-mon[80292]: pgmap v154: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:41.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.478+0000 7f9a54679640 1 -- 172.21.15.45:0/2584817088 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9a4c198230 con 0x7f9a3807af30 2024-09-18T12:57:41.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.480+0000 7f9a437fe640 1 -- 172.21.15.45:0/2584817088 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9a4c198230 con 0x7f9a3807af30 2024-09-18T12:57:41.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 -- 172.21.15.45:0/2584817088 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9a3807af30 msgr2=0x7f9a3807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9a3807af30 0x7f9a3807d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c108900 tx=0x7f9a3c00b2e0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 -- 172.21.15.45:0/2584817088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a4c102ac0 msgr2=0x7f9a4c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a4c102ac0 0x7f9a4c19d640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a48031460 tx=0x7f9a480045e0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 -- 172.21.15.45:0/2584817088 shutdown_connections 2024-09-18T12:57:41.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9a3807af30 0x7f9a3807d3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a4c1033e0 0x7f9a4c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 --2- 172.21.15.45:0/2584817088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a4c102ac0 0x7f9a4c19d640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 -- 172.21.15.45:0/2584817088 >> 172.21.15.45:0/2584817088 conn(0x7f9a4c0fc520 msgr2=0x7f9a4c10af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:41.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 -- 172.21.15.45:0/2584817088 shutdown_connections 2024-09-18T12:57:41.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.482+0000 7f9a54679640 1 -- 172.21.15.45:0/2584817088 wait complete. 2024-09-18T12:57:41.492 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:57:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.572+0000 7f8da1d8c640 1 -- 172.21.15.45:0/666666868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d9c1033d0 msgr2=0x7f8d9c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.572+0000 7f8da1d8c640 1 --2- 172.21.15.45:0/666666868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d9c1033d0 0x7f8d9c10b8c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009880 tx=0x7f8d9002a530 comp rx=0 tx=0).stop 2024-09-18T12:57:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.572+0000 7f8da1d8c640 1 -- 172.21.15.45:0/666666868 shutdown_connections 2024-09-18T12:57:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.572+0000 7f8da1d8c640 1 --2- 172.21.15.45:0/666666868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d9c1033d0 0x7f8d9c10b8c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.572+0000 7f8da1d8c640 1 --2- 172.21.15.45:0/666666868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d9c102ab0 0x7f8d9c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.572+0000 7f8da1d8c640 1 -- 172.21.15.45:0/666666868 >> 172.21.15.45:0/666666868 conn(0x7f8d9c0fc4d0 msgr2=0x7f8d9c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.572+0000 7f8da1d8c640 1 -- 172.21.15.45:0/666666868 shutdown_connections 2024-09-18T12:57:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.572+0000 7f8da1d8c640 1 -- 172.21.15.45:0/666666868 wait complete. 2024-09-18T12:57:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.572+0000 7f8da1d8c640 1 Processor -- start 2024-09-18T12:57:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8da1d8c640 1 -- start start 2024-09-18T12:57:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8da1d8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d9c102ab0 0x7f8d9c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8da1d8c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d9c1033d0 0x7f8d9c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8da1d8c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c10edc0 con 0x7f8d9c102ab0 2024-09-18T12:57:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8da1d8c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c10ec40 con 0x7f8d9c1033d0 2024-09-18T12:57:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8d9b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d9c102ab0 0x7f8d9c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8d9b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d9c102ab0 0x7f8d9c19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56046/0 (socket says 172.21.15.45:56046) 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8d9b7fe640 1 -- 172.21.15.45:0/1699616895 learned_addr learned my addr 172.21.15.45:0/1699616895 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8d9affd640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d9c1033d0 0x7f8d9c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8d9b7fe640 1 -- 172.21.15.45:0/1699616895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d9c1033d0 msgr2=0x7f8d9c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8d9b7fe640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d9c1033d0 0x7f8d9c19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.573+0000 7f8d9b7fe640 1 -- 172.21.15.45:0/1699616895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c197810 con 0x7f8d9c102ab0 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.574+0000 7f8d9b7fe640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d9c102ab0 0x7f8d9c19d690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00d8d0 tx=0x7f8d8c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.574+0000 7f8d98ff9640 1 -- 172.21.15.45:0/1699616895 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d8c017070 con 0x7f8d9c102ab0 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.574+0000 7f8d98ff9640 1 -- 172.21.15.45:0/1699616895 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d8c010460 con 0x7f8d9c102ab0 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.574+0000 7f8da1d8c640 1 -- 172.21.15.45:0/1699616895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9c197b00 con 0x7f8d9c102ab0 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.574+0000 7f8d98ff9640 1 -- 172.21.15.45:0/1699616895 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d8c00f5f0 con 0x7f8d9c102ab0 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.574+0000 7f8da1d8c640 1 -- 172.21.15.45:0/1699616895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d9c198060 con 0x7f8d9c102ab0 2024-09-18T12:57:41.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.575+0000 7f8da1d8c640 1 -- 172.21.15.45:0/1699616895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d9c06ada0 con 0x7f8d9c102ab0 2024-09-18T12:57:41.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.576+0000 7f8d98ff9640 1 -- 172.21.15.45:0/1699616895 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f8d8c009a30 con 0x7f8d9c102ab0 2024-09-18T12:57:41.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.576+0000 7f8d98ff9640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8d8407af30 0x7f8d8407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.577+0000 7f8d9affd640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8d8407af30 0x7f8d8407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.577+0000 7f8d98ff9640 1 -- 172.21.15.45:0/1699616895 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6070+0+0 (secure 0 0 0) 0x7f8d8c09df00 con 0x7f8d9c102ab0 2024-09-18T12:57:41.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.577+0000 7f8d9affd640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8d8407af30 0x7f8d8407d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c198b60 tx=0x7f8d90031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:41.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.580+0000 7f8d98ff9640 1 -- 172.21.15.45:0/1699616895 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8d8c0695f0 con 0x7f8d9c102ab0 2024-09-18T12:57:41.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:41 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[123357]: 2024-09-18T12:57:41.517+0000 7f932c6ab640 -1 Falling back to public interface 2024-09-18T12:57:41.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.789+0000 7f8da1d8c640 1 -- 172.21.15.45:0/1699616895 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8d9c198310 con 0x7f8d8407af30 2024-09-18T12:57:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.790+0000 7f8d98ff9640 1 -- 172.21.15.45:0/1699616895 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8d9c198310 con 0x7f8d8407af30 2024-09-18T12:57:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.792+0000 7f8da1d8c640 1 -- 172.21.15.45:0/1699616895 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8d8407af30 msgr2=0x7f8d8407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.792+0000 7f8da1d8c640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8d8407af30 0x7f8d8407d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c198b60 tx=0x7f8d90031400 comp rx=0 tx=0).stop 2024-09-18T12:57:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.792+0000 7f8da1d8c640 1 -- 172.21.15.45:0/1699616895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d9c102ab0 msgr2=0x7f8d9c19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.792+0000 7f8da1d8c640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d9c102ab0 0x7f8d9c19d690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00d8d0 tx=0x7f8d8c00dd90 comp rx=0 tx=0).stop 2024-09-18T12:57:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.792+0000 7f8da1d8c640 1 -- 172.21.15.45:0/1699616895 shutdown_connections 2024-09-18T12:57:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.792+0000 7f8da1d8c640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8d8407af30 0x7f8d8407d3f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.792+0000 7f8da1d8c640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d9c1033d0 0x7f8d9c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.792+0000 7f8da1d8c640 1 --2- 172.21.15.45:0/1699616895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d9c102ab0 0x7f8d9c19d690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.792+0000 7f8da1d8c640 1 -- 172.21.15.45:0/1699616895 >> 172.21.15.45:0/1699616895 conn(0x7f8d9c0fc4d0 msgr2=0x7f8d9c108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.793+0000 7f8da1d8c640 1 -- 172.21.15.45:0/1699616895 shutdown_connections 2024-09-18T12:57:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.793+0000 7f8da1d8c640 1 -- 172.21.15.45:0/1699616895 wait complete. 2024-09-18T12:57:41.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.892+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1607877104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f18102ab0 msgr2=0x7f2f18102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.892+0000 7f2f1ef68640 1 --2- 172.21.15.45:0/1607877104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f18102ab0 0x7f2f18102e90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009880 tx=0x7f2f0c02a540 comp rx=0 tx=0).stop 2024-09-18T12:57:41.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.892+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1607877104 shutdown_connections 2024-09-18T12:57:41.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.892+0000 7f2f1ef68640 1 --2- 172.21.15.45:0/1607877104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f181033d0 0x7f2f1810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.892+0000 7f2f1ef68640 1 --2- 172.21.15.45:0/1607877104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f18102ab0 0x7f2f18102e90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.892+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1607877104 >> 172.21.15.45:0/1607877104 conn(0x7f2f180fc4d0 msgr2=0x7f2f180fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:41.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.892+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1607877104 shutdown_connections 2024-09-18T12:57:41.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.892+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1607877104 wait complete. 2024-09-18T12:57:41.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.892+0000 7f2f1ef68640 1 Processor -- start 2024-09-18T12:57:41.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.892+0000 7f2f1ef68640 1 -- start start 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1ef68640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f18102ab0 0x7f2f1819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1ef68640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f181033d0 0x7f2f1819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1ef68640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1810edc0 con 0x7f2f18102ab0 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1ef68640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1810ec40 con 0x7f2f181033d0 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1cd04640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f18102ab0 0x7f2f1819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1cd04640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f18102ab0 0x7f2f1819f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56056/0 (socket says 172.21.15.45:56056) 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1cd04640 1 -- 172.21.15.45:0/1469533837 learned_addr learned my addr 172.21.15.45:0/1469533837 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f17fff640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f181033d0 0x7f2f1819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1cd04640 1 -- 172.21.15.45:0/1469533837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f181033d0 msgr2=0x7f2f1819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1cd04640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f181033d0 0x7f2f1819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:41.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1cd04640 1 -- 172.21.15.45:0/1469533837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f181999a0 con 0x7f2f18102ab0 2024-09-18T12:57:41.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f17fff640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f181033d0 0x7f2f1819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:57:41.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.893+0000 7f2f1cd04640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f18102ab0 0x7f2f1819f7e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c031460 tx=0x7f2f0c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:41.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.894+0000 7f2f15ffb640 1 -- 172.21.15.45:0/1469533837 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f0c03f070 con 0x7f2f18102ab0 2024-09-18T12:57:41.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.894+0000 7f2f15ffb640 1 -- 172.21.15.45:0/1469533837 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f0c0035f0 con 0x7f2f18102ab0 2024-09-18T12:57:41.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.894+0000 7f2f15ffb640 1 -- 172.21.15.45:0/1469533837 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f0c035030 con 0x7f2f18102ab0 2024-09-18T12:57:41.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.894+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1469533837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f18199c30 con 0x7f2f18102ab0 2024-09-18T12:57:41.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.894+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1469533837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1819a160 con 0x7f2f18102ab0 2024-09-18T12:57:41.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.895+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1469533837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1806ada0 con 0x7f2f18102ab0 2024-09-18T12:57:41.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.896+0000 7f2f15ffb640 1 -- 172.21.15.45:0/1469533837 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f2f0c042070 con 0x7f2f18102ab0 2024-09-18T12:57:41.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.896+0000 7f2f15ffb640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f0807af80 0x7f2f0807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:41.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.897+0000 7f2f15ffb640 1 -- 172.21.15.45:0/1469533837 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6070+0+0 (secure 0 0 0) 0x7f2f0c0be670 con 0x7f2f18102ab0 2024-09-18T12:57:41.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.897+0000 7f2f17fff640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f0807af80 0x7f2f0807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:41.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.897+0000 7f2f17fff640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f0807af80 0x7f2f0807d440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f181026a0 tx=0x7f2f04005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:41.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:41.901+0000 7f2f15ffb640 1 -- 172.21.15.45:0/1469533837 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2f0c089c20 con 0x7f2f18102ab0 2024-09-18T12:57:42.049 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:42 smithi045 ceph-mon[109129]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:42.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.099+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1469533837 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2f1819aed0 con 0x7f2f0807af80 2024-09-18T12:57:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.109+0000 7f2f15ffb640 1 -- 172.21.15.45:0/1469533837 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2f1819aed0 con 0x7f2f0807af80 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (2m) 33s ago 13m 20.0M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (5m) 33s ago 13m 8879k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (5m) 57s ago 13m 8346k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (65s) 33s ago 13m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (60s) 57s ago 12m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (2m) 33s ago 13m 76.3M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (8m) 33s ago 8m 92.1M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (8m) 33s ago 8m 149M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (8m) 57s ago 8m 17.4M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (8m) 57s ago 8m 15.9M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:57:42.111 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (5m) 33s ago 15m 523M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (4m) 57s ago 12m 457M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (91s) 33s ago 15m 38.9M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (76s) 57s ago 12m 25.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (3m) 33s ago 13m 10.6M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (3m) 57s ago 12m 11.1M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (38s) 33s ago 11m 14.3M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 starting - - - 1217M 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (10m) 33s ago 10m 186M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (10m) 57s ago 10m 243M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (9m) 57s ago 9m 215M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (9m) 57s ago 9m 200M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:57:42.112 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (3m) 33s ago 13m 49.7M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:57:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1469533837 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f0807af80 msgr2=0x7f2f0807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f0807af80 0x7f2f0807d440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f181026a0 tx=0x7f2f04005f90 comp rx=0 tx=0).stop 2024-09-18T12:57:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1469533837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f18102ab0 msgr2=0x7f2f1819f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f18102ab0 0x7f2f1819f7e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c031460 tx=0x7f2f0c004530 comp rx=0 tx=0).stop 2024-09-18T12:57:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1469533837 shutdown_connections 2024-09-18T12:57:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f0807af80 0x7f2f0807d440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f181033d0 0x7f2f1819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 --2- 172.21.15.45:0/1469533837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f18102ab0 0x7f2f1819f7e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1469533837 >> 172.21.15.45:0/1469533837 conn(0x7f2f180fc4d0 msgr2=0x7f2f18100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1469533837 shutdown_connections 2024-09-18T12:57:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.112+0000 7f2f1ef68640 1 -- 172.21.15.45:0/1469533837 wait complete. 2024-09-18T12:57:42.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.198+0000 7ff36e32e640 1 -- 172.21.15.45:0/2328409200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3681033e0 msgr2=0x7ff36810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.198+0000 7ff36e32e640 1 --2- 172.21.15.45:0/2328409200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3681033e0 0x7ff36810b8d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff350009880 tx=0x7ff35002a530 comp rx=0 tx=0).stop 2024-09-18T12:57:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.198+0000 7ff36e32e640 1 -- 172.21.15.45:0/2328409200 shutdown_connections 2024-09-18T12:57:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.198+0000 7ff36e32e640 1 --2- 172.21.15.45:0/2328409200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3681033e0 0x7ff36810b8d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.198+0000 7ff36e32e640 1 --2- 172.21.15.45:0/2328409200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff368102ac0 0x7ff368102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.198+0000 7ff36e32e640 1 -- 172.21.15.45:0/2328409200 >> 172.21.15.45:0/2328409200 conn(0x7ff3680fc520 msgr2=0x7ff3680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.198+0000 7ff36e32e640 1 -- 172.21.15.45:0/2328409200 shutdown_connections 2024-09-18T12:57:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.198+0000 7ff36e32e640 1 -- 172.21.15.45:0/2328409200 wait complete. 2024-09-18T12:57:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.198+0000 7ff36e32e640 1 Processor -- start 2024-09-18T12:57:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff36e32e640 1 -- start start 2024-09-18T12:57:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff36e32e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff368102ac0 0x7ff36819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff36e32e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3681033e0 0x7ff36819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff36e32e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff36810edf0 con 0x7ff3681033e0 2024-09-18T12:57:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff36e32e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff36810ec70 con 0x7ff368102ac0 2024-09-18T12:57:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff35ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3681033e0 0x7ff36819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff35ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3681033e0 0x7ff36819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56086/0 (socket says 172.21.15.45:56086) 2024-09-18T12:57:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff35ffff640 1 -- 172.21.15.45:0/2650526606 learned_addr learned my addr 172.21.15.45:0/2650526606 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff367fff640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff368102ac0 0x7ff36819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff35ffff640 1 -- 172.21.15.45:0/2650526606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff368102ac0 msgr2=0x7ff36819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff35ffff640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff368102ac0 0x7ff36819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.199+0000 7ff35ffff640 1 -- 172.21.15.45:0/2650526606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff368197800 con 0x7ff3681033e0 2024-09-18T12:57:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.200+0000 7ff35ffff640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3681033e0 0x7ff36819dbc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff350031460 tx=0x7ff3500045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.200+0000 7ff365ffb640 1 -- 172.21.15.45:0/2650526606 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff35003f070 con 0x7ff3681033e0 2024-09-18T12:57:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.200+0000 7ff365ffb640 1 -- 172.21.15.45:0/2650526606 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3500035f0 con 0x7ff3681033e0 2024-09-18T12:57:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.200+0000 7ff36e32e640 1 -- 172.21.15.45:0/2650526606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff368197a90 con 0x7ff3681033e0 2024-09-18T12:57:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.200+0000 7ff365ffb640 1 -- 172.21.15.45:0/2650526606 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff350035030 con 0x7ff3681033e0 2024-09-18T12:57:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.200+0000 7ff36e32e640 1 -- 172.21.15.45:0/2650526606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff368197fc0 con 0x7ff3681033e0 2024-09-18T12:57:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.201+0000 7ff36e32e640 1 -- 172.21.15.45:0/2650526606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36806aa90 con 0x7ff3681033e0 2024-09-18T12:57:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.202+0000 7ff365ffb640 1 -- 172.21.15.45:0/2650526606 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7ff350042070 con 0x7ff3681033e0 2024-09-18T12:57:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.202+0000 7ff365ffb640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35407af30 0x7ff35407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:42.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.202+0000 7ff367fff640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35407af30 0x7ff35407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:42.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.202+0000 7ff365ffb640 1 -- 172.21.15.45:0/2650526606 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6070+0+0 (secure 0 0 0) 0x7ff3500be790 con 0x7ff3681033e0 2024-09-18T12:57:42.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.203+0000 7ff367fff640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35407af30 0x7ff35407d3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff358009bd0 tx=0x7ff358005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:42.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.207+0000 7ff365ffb640 1 -- 172.21.15.45:0/2650526606 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff350089de0 con 0x7ff3681033e0 2024-09-18T12:57:42.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:42 smithi161 ceph-mon[80292]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.470+0000 7ff36e32e640 1 -- 172.21.15.45:0/2650526606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff368105f60 con 0x7ff3681033e0 2024-09-18T12:57:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.471+0000 7ff365ffb640 1 -- 172.21.15.45:0/2650526606 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7ff35008ec90 con 0x7ff3681033e0 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4, 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:57:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:57:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:57:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:57:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:57:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8, 2024-09-18T12:57:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 5 2024-09-18T12:57:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:57:42.474 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 -- 172.21.15.45:0/2650526606 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35407af30 msgr2=0x7ff35407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35407af30 0x7ff35407d3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff358009bd0 tx=0x7ff358005f90 comp rx=0 tx=0).stop 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 -- 172.21.15.45:0/2650526606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3681033e0 msgr2=0x7ff36819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3681033e0 0x7ff36819dbc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff350031460 tx=0x7ff3500045c0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 -- 172.21.15.45:0/2650526606 shutdown_connections 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff35407af30 0x7ff35407d3f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3681033e0 0x7ff36819dbc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 --2- 172.21.15.45:0/2650526606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff368102ac0 0x7ff36819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 -- 172.21.15.45:0/2650526606 >> 172.21.15.45:0/2650526606 conn(0x7ff3680fc520 msgr2=0x7ff368108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 -- 172.21.15.45:0/2650526606 shutdown_connections 2024-09-18T12:57:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.473+0000 7ff36e32e640 1 -- 172.21.15.45:0/2650526606 wait complete. 2024-09-18T12:57:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.557+0000 7fe6adf7b640 1 -- 172.21.15.45:0/1975904308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a8106800 msgr2=0x7fe6a8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.557+0000 7fe6adf7b640 1 --2- 172.21.15.45:0/1975904308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a8106800 0x7fe6a8106be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe698009880 tx=0x7fe69802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.557+0000 7fe6adf7b640 1 -- 172.21.15.45:0/1975904308 shutdown_connections 2024-09-18T12:57:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.557+0000 7fe6adf7b640 1 --2- 172.21.15.45:0/1975904308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a8100800 0x7fe6a8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.557+0000 7fe6adf7b640 1 --2- 172.21.15.45:0/1975904308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a8106800 0x7fe6a8106be0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.557+0000 7fe6adf7b640 1 -- 172.21.15.45:0/1975904308 >> 172.21.15.45:0/1975904308 conn(0x7fe6a80fc520 msgr2=0x7fe6a80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.557+0000 7fe6adf7b640 1 -- 172.21.15.45:0/1975904308 shutdown_connections 2024-09-18T12:57:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.557+0000 7fe6adf7b640 1 -- 172.21.15.45:0/1975904308 wait complete. 2024-09-18T12:57:42.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.558+0000 7fe6adf7b640 1 Processor -- start 2024-09-18T12:57:42.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.558+0000 7fe6adf7b640 1 -- start start 2024-09-18T12:57:42.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.558+0000 7fe6adf7b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a8100800 0x7fe6a819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:42.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.558+0000 7fe6adf7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a8106800 0x7fe6a819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:42.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.558+0000 7fe6adf7b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a810edf0 con 0x7fe6a8106800 2024-09-18T12:57:42.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.558+0000 7fe6adf7b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a810ec70 con 0x7fe6a8100800 2024-09-18T12:57:42.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a8106800 0x7fe6a819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:42.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a8106800 0x7fe6a819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56640/0 (socket says 172.21.15.45:56640) 2024-09-18T12:57:42.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a6ffd640 1 -- 172.21.15.45:0/2853831852 learned_addr learned my addr 172.21.15.45:0/2853831852 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:42.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a77fe640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a8100800 0x7fe6a819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:42.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a6ffd640 1 -- 172.21.15.45:0/2853831852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a8100800 msgr2=0x7fe6a819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a6ffd640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a8100800 0x7fe6a819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a6ffd640 1 -- 172.21.15.45:0/2853831852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a81977f0 con 0x7fe6a8106800 2024-09-18T12:57:42.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a6ffd640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a8106800 0x7fe6a819dbb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00d6f0 tx=0x7fe69c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:42.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a4ff9640 1 -- 172.21.15.45:0/2853831852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe69c017070 con 0x7fe6a8106800 2024-09-18T12:57:42.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a4ff9640 1 -- 172.21.15.45:0/2853831852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe69c00de00 con 0x7fe6a8106800 2024-09-18T12:57:42.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6adf7b640 1 -- 172.21.15.45:0/2853831852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a8197ae0 con 0x7fe6a8106800 2024-09-18T12:57:42.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6a4ff9640 1 -- 172.21.15.45:0/2853831852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe69c004bb0 con 0x7fe6a8106800 2024-09-18T12:57:42.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.559+0000 7fe6adf7b640 1 -- 172.21.15.45:0/2853831852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a8198070 con 0x7fe6a8106800 2024-09-18T12:57:42.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.560+0000 7fe6adf7b640 1 -- 172.21.15.45:0/2853831852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a8101f40 con 0x7fe6a8106800 2024-09-18T12:57:42.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.561+0000 7fe6a4ff9640 1 -- 172.21.15.45:0/2853831852 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fe69c009a30 con 0x7fe6a8106800 2024-09-18T12:57:42.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.562+0000 7fe6a4ff9640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe69007af80 0x7fe69007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:42.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.562+0000 7fe6a4ff9640 1 -- 172.21.15.45:0/2853831852 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6070+0+0 (secure 0 0 0) 0x7fe69c09db20 con 0x7fe6a8106800 2024-09-18T12:57:42.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.562+0000 7fe6a77fe640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe69007af80 0x7fe69007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:42.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.562+0000 7fe6a77fe640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe69007af80 0x7fe69007d440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe6980096c0 tx=0x7fe698031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:42.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.566+0000 7fe6a4ff9640 1 -- 172.21.15.45:0/2853831852 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe69c0691f0 con 0x7fe6a8106800 2024-09-18T12:57:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.803+0000 7fe6adf7b640 1 -- 172.21.15.45:0/2853831852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe6a8108d70 con 0x7fe6a8106800 2024-09-18T12:57:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.804+0000 7fe6a4ff9640 1 -- 172.21.15.45:0/2853831852 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2046 (secure 0 0 0) 0x7fe69c06e0a0 con 0x7fe6a8106800 2024-09-18T12:57:42.805 INFO:teuthology.orchestra.run.smithi045.stdout:e16 2024-09-18T12:57:42.805 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T12:49:30:966010+0000 2024-09-18T12:57:42.805 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 14 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T12:49:28.960615+0000 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T12:57:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=14566} 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T12:57:42.807 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 14566 members: 14566 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T12:57:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:57:42.809 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:42.809 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.806+0000 7fe6adf7b640 1 -- 172.21.15.45:0/2853831852 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe69007af80 msgr2=0x7fe69007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.806+0000 7fe6adf7b640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe69007af80 0x7fe69007d440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe6980096c0 tx=0x7fe698031400 comp rx=0 tx=0).stop 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.806+0000 7fe6adf7b640 1 -- 172.21.15.45:0/2853831852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a8106800 msgr2=0x7fe6a819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.806+0000 7fe6adf7b640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a8106800 0x7fe6a819dbb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00d6f0 tx=0x7fe69c00dbb0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.807+0000 7fe6adf7b640 1 -- 172.21.15.45:0/2853831852 shutdown_connections 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.807+0000 7fe6adf7b640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe69007af80 0x7fe69007d440 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.807+0000 7fe6adf7b640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a8106800 0x7fe6a819dbb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.807+0000 7fe6adf7b640 1 --2- 172.21.15.45:0/2853831852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6a8100800 0x7fe6a819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.807+0000 7fe6adf7b640 1 -- 172.21.15.45:0/2853831852 >> 172.21.15.45:0/2853831852 conn(0x7fe6a80fc520 msgr2=0x7fe6a80fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.807+0000 7fe6adf7b640 1 -- 172.21.15.45:0/2853831852 shutdown_connections 2024-09-18T12:57:42.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.807+0000 7fe6adf7b640 1 -- 172.21.15.45:0/2853831852 wait complete. 2024-09-18T12:57:42.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.893+0000 7f9991b2f640 1 -- 172.21.15.45:0/2013200135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f998c101900 msgr2=0x7f998c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.893+0000 7f9991b2f640 1 --2- 172.21.15.45:0/2013200135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f998c101900 0x7f998c101d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9974009880 tx=0x7f997402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.893+0000 7f9991b2f640 1 -- 172.21.15.45:0/2013200135 shutdown_connections 2024-09-18T12:57:42.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.893+0000 7f9991b2f640 1 --2- 172.21.15.45:0/2013200135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f998c101900 0x7f998c101d60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.893+0000 7f9991b2f640 1 --2- 172.21.15.45:0/2013200135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998c107900 0x7f998c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.893+0000 7f9991b2f640 1 -- 172.21.15.45:0/2013200135 >> 172.21.15.45:0/2013200135 conn(0x7f998c0fd5e0 msgr2=0x7f998c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:42.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.893+0000 7f9991b2f640 1 -- 172.21.15.45:0/2013200135 shutdown_connections 2024-09-18T12:57:42.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.893+0000 7f9991b2f640 1 -- 172.21.15.45:0/2013200135 wait complete. 2024-09-18T12:57:42.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.893+0000 7f9991b2f640 1 Processor -- start 2024-09-18T12:57:42.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.893+0000 7f9991b2f640 1 -- start start 2024-09-18T12:57:42.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f9991b2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f998c101900 0x7f998c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f9991b2f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998c107900 0x7f998c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f9991b2f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f998c10ee30 con 0x7f998c101900 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f9991b2f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f998c10ecb0 con 0x7f998c107900 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f998b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f998c101900 0x7f998c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f998b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f998c101900 0x7f998c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56662/0 (socket says 172.21.15.45:56662) 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f998b7fe640 1 -- 172.21.15.45:0/2873549699 learned_addr learned my addr 172.21.15.45:0/2873549699 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f9982ffd640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998c107900 0x7f998c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f998b7fe640 1 -- 172.21.15.45:0/2873549699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998c107900 msgr2=0x7f998c19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f998b7fe640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998c107900 0x7f998c19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f998b7fe640 1 -- 172.21.15.45:0/2873549699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998c197880 con 0x7f998c101900 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f9982ffd640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998c107900 0x7f998c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:57:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.894+0000 7f998b7fe640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f998c101900 0x7f998c19d6c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f997c00b420 tx=0x7f997c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:42.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.895+0000 7f99897fa640 1 -- 172.21.15.45:0/2873549699 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f997c011630 con 0x7f998c101900 2024-09-18T12:57:42.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.895+0000 7f9991b2f640 1 -- 172.21.15.45:0/2873549699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998c197b70 con 0x7f998c101900 2024-09-18T12:57:42.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.895+0000 7f99897fa640 1 -- 172.21.15.45:0/2873549699 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f997c016070 con 0x7f998c101900 2024-09-18T12:57:42.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.895+0000 7f99897fa640 1 -- 172.21.15.45:0/2873549699 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f997c010d40 con 0x7f998c101900 2024-09-18T12:57:42.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.895+0000 7f9991b2f640 1 -- 172.21.15.45:0/2873549699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f998c198100 con 0x7f998c101900 2024-09-18T12:57:42.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.896+0000 7f9991b2f640 1 -- 172.21.15.45:0/2873549699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998c103040 con 0x7f998c101900 2024-09-18T12:57:42.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.896+0000 7f99897fa640 1 -- 172.21.15.45:0/2873549699 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f997c01b460 con 0x7f998c101900 2024-09-18T12:57:42.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.897+0000 7f99897fa640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f997807af40 0x7f997807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:42.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.897+0000 7f9982ffd640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f997807af40 0x7f997807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:42.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.897+0000 7f99897fa640 1 -- 172.21.15.45:0/2873549699 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6070+0+0 (secure 0 0 0) 0x7f997c09d760 con 0x7f998c101900 2024-09-18T12:57:42.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.898+0000 7f9982ffd640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f997807af40 0x7f997807d400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9974031460 tx=0x7f9974004280 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:42.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:42.902+0000 7f99897fa640 1 -- 172.21.15.45:0/2873549699 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f997c021250 con 0x7f998c101900 2024-09-18T12:57:43.071 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:43 smithi045 ceph-mon[109129]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:43.071 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:43 smithi045 ceph-mon[109129]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:43.071 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:43 smithi045 ceph-mon[109129]: pgmap v155: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:43.071 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:43 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2650526606' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:43.071 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:43 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2853831852' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:43.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.109+0000 7f9991b2f640 1 -- 172.21.15.45:0/2873549699 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f998c198db0 con 0x7f997807af40 2024-09-18T12:57:43.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.111+0000 7f99897fa640 1 -- 172.21.15.45:0/2873549699 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f998c198db0 con 0x7f997807af40 2024-09-18T12:57:43.112 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:57:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:57:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:57:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:57:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:57:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr", 2024-09-18T12:57:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "mon", 2024-09-18T12:57:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "crash" 2024-09-18T12:57:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:57:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "7/23 daemons upgraded", 2024-09-18T12:57:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:57:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:57:43.113 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 -- 172.21.15.45:0/2873549699 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f997807af40 msgr2=0x7f997807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f997807af40 0x7f997807d400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9974031460 tx=0x7f9974004280 comp rx=0 tx=0).stop 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 -- 172.21.15.45:0/2873549699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f998c101900 msgr2=0x7f998c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f998c101900 0x7f998c19d6c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f997c00b420 tx=0x7f997c00b8e0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 -- 172.21.15.45:0/2873549699 shutdown_connections 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f997807af40 0x7f997807d400 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f998c107900 0x7f998c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 --2- 172.21.15.45:0/2873549699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f998c101900 0x7f998c19d6c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 -- 172.21.15.45:0/2873549699 >> 172.21.15.45:0/2873549699 conn(0x7f998c0fd5e0 msgr2=0x7f998c0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 -- 172.21.15.45:0/2873549699 shutdown_connections 2024-09-18T12:57:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.113+0000 7f9991b2f640 1 -- 172.21.15.45:0/2873549699 wait complete. 2024-09-18T12:57:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.200+0000 7fe937d7c640 1 -- 172.21.15.45:0/2965308767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe930101900 msgr2=0x7fe930101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.200+0000 7fe937d7c640 1 --2- 172.21.15.45:0/2965308767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe930101900 0x7fe930101d60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe920009880 tx=0x7fe92002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.200+0000 7fe937d7c640 1 -- 172.21.15.45:0/2965308767 shutdown_connections 2024-09-18T12:57:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.200+0000 7fe937d7c640 1 --2- 172.21.15.45:0/2965308767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe930101900 0x7fe930101d60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.200+0000 7fe937d7c640 1 --2- 172.21.15.45:0/2965308767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe930107900 0x7fe930107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.200+0000 7fe937d7c640 1 -- 172.21.15.45:0/2965308767 >> 172.21.15.45:0/2965308767 conn(0x7fe9300fd600 msgr2=0x7fe9300ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.201+0000 7fe937d7c640 1 -- 172.21.15.45:0/2965308767 shutdown_connections 2024-09-18T12:57:43.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.201+0000 7fe937d7c640 1 -- 172.21.15.45:0/2965308767 wait complete. 2024-09-18T12:57:43.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.201+0000 7fe937d7c640 1 Processor -- start 2024-09-18T12:57:43.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.201+0000 7fe937d7c640 1 -- start start 2024-09-18T12:57:43.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.201+0000 7fe937d7c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe930101900 0x7fe9300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:43.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.201+0000 7fe937d7c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe930107900 0x7fe930074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:43.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.201+0000 7fe937d7c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe93010edd0 con 0x7fe930107900 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.201+0000 7fe937d7c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe93010ec50 con 0x7fe930101900 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe935317640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe930107900 0x7fe930074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe935317640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe930107900 0x7fe930074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56688/0 (socket says 172.21.15.45:56688) 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe935317640 1 -- 172.21.15.45:0/3786356804 learned_addr learned my addr 172.21.15.45:0/3786356804 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe935b18640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe930101900 0x7fe9300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe935317640 1 -- 172.21.15.45:0/3786356804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe930101900 msgr2=0x7fe9300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe935317640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe930101900 0x7fe9300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe935317640 1 -- 172.21.15.45:0/3786356804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe930074f70 con 0x7fe930107900 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe935b18640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe930101900 0x7fe9300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe935317640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe930107900 0x7fe930074a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe920031460 tx=0x7fe920004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe926ffd640 1 -- 172.21.15.45:0/3786356804 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe92003f070 con 0x7fe930107900 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe926ffd640 1 -- 172.21.15.45:0/3786356804 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9200035f0 con 0x7fe930107900 2024-09-18T12:57:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe926ffd640 1 -- 172.21.15.45:0/3786356804 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe920035030 con 0x7fe930107900 2024-09-18T12:57:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe937d7c640 1 -- 172.21.15.45:0/3786356804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe930075200 con 0x7fe930107900 2024-09-18T12:57:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.202+0000 7fe937d7c640 1 -- 172.21.15.45:0/3786356804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9301a3dc0 con 0x7fe930107900 2024-09-18T12:57:43.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.204+0000 7fe937d7c640 1 -- 172.21.15.45:0/3786356804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe930103040 con 0x7fe930107900 2024-09-18T12:57:43.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.204+0000 7fe926ffd640 1 -- 172.21.15.45:0/3786356804 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fe920042070 con 0x7fe930107900 2024-09-18T12:57:43.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.205+0000 7fe926ffd640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe91c07af30 0x7fe91c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:57:43.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.205+0000 7fe926ffd640 1 -- 172.21.15.45:0/3786356804 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6070+0+0 (secure 0 0 0) 0x7fe9200be960 con 0x7fe930107900 2024-09-18T12:57:43.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.205+0000 7fe935b18640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe91c07af30 0x7fe91c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:57:43.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.206+0000 7fe935b18640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe91c07af30 0x7fe91c07d3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe92c009c20 tx=0x7fe92c005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:57:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.210+0000 7fe926ffd640 1 -- 172.21.15.45:0/3786356804 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe920089fb0 con 0x7fe930107900 2024-09-18T12:57:43.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:43 smithi161 ceph-mon[80292]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:43 smithi161 ceph-mon[80292]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:43 smithi161 ceph-mon[80292]: pgmap v155: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:43 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2650526606' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:43 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2853831852' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:57:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.474+0000 7fe937d7c640 1 -- 172.21.15.45:0/3786356804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe930109e70 con 0x7fe930107900 2024-09-18T12:57:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.474+0000 7fe926ffd640 1 -- 172.21.15.45:0/3786356804 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1182 (secure 0 0 0) 0x7fe92008ee60 con 0x7fe930107900 2024-09-18T12:57:43.476 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 34/255 objects degraded (13.333%), 13 pgs degraded 2024-09-18T12:57:43.476 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:57:43.476 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:57:43.476 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-18T12:57:43.476 INFO:teuthology.orchestra.run.smithi045.stdout: osd.1 (root=default,host=smithi045) is down 2024-09-18T12:57:43.476 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 34/255 objects degraded (13.333%), 13 pgs degraded 2024-09-18T12:57:43.476 INFO:teuthology.orchestra.run.smithi045.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-18T12:57:43.476 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-18T12:57:43.476 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-18T12:57:43.477 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-18T12:57:43.477 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-18T12:57:43.477 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-18T12:57:43.477 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-18T12:57:43.477 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-18T12:57:43.477 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-18T12:57:43.477 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-18T12:57:43.477 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-18T12:57:43.477 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-18T12:57:43.477 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-18T12:57:43.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 -- 172.21.15.45:0/3786356804 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe91c07af30 msgr2=0x7fe91c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:43.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe91c07af30 0x7fe91c07d3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe92c009c20 tx=0x7fe92c005f90 comp rx=0 tx=0).stop 2024-09-18T12:57:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 -- 172.21.15.45:0/3786356804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe930107900 msgr2=0x7fe930074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:57:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe930107900 0x7fe930074a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe920031460 tx=0x7fe920004530 comp rx=0 tx=0).stop 2024-09-18T12:57:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 -- 172.21.15.45:0/3786356804 shutdown_connections 2024-09-18T12:57:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe91c07af30 0x7fe91c07d3f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe930107900 0x7fe930074a30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 --2- 172.21.15.45:0/3786356804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe930101900 0x7fe9300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:57:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 -- 172.21.15.45:0/3786356804 >> 172.21.15.45:0/3786356804 conn(0x7fe9300fd600 msgr2=0x7fe9300fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:57:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 -- 172.21.15.45:0/3786356804 shutdown_connections 2024-09-18T12:57:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:57:43.477+0000 7fe937d7c640 1 -- 172.21.15.45:0/3786356804 wait complete. 2024-09-18T12:57:44.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:44 smithi045 ceph-mon[109129]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:44.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:44 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3786356804' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:44.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:44 smithi161 ceph-mon[80292]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:57:44.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:44 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3786356804' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:57:45.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:45 smithi045 ceph-mon[109129]: pgmap v156: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:45.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:45 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:45.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:45 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:45.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:45 smithi161 ceph-mon[80292]: pgmap v156: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:45.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:45 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:45.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:45 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:46.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:46 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:46.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:46 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:47.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:46 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:47.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:46 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:47.534 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:47 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[123357]: 2024-09-18T12:57:47.254+0000 7f932c6ab640 -1 osd.1 51 log_to_monitors true 2024-09-18T12:57:48.028 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 12:57:47 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[123357]: 2024-09-18T12:57:47.592+0000 7f932044d640 -1 osd.1 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:57:48.029 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:47 smithi045 ceph-mon[109129]: pgmap v157: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:48.029 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:47 smithi045 ceph-mon[109129]: from='osd.1 [v2:172.21.15.45:6810/1700971609,v1:172.21.15.45:6811/1700971609]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-18T12:57:48.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:47 smithi161 ceph-mon[80292]: pgmap v157: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:48.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:47 smithi161 ceph-mon[80292]: from='osd.1 [v2:172.21.15.45:6810/1700971609,v1:172.21.15.45:6811/1700971609]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-18T12:57:48.683 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:48 smithi045 ceph-mon[109129]: from='osd.1 [v2:172.21.15.45:6810/1700971609,v1:172.21.15.45:6811/1700971609]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:57:48.683 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:48 smithi045 ceph-mon[109129]: osdmap e54: 6 total, 5 up, 6 in 2024-09-18T12:57:48.683 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:48 smithi045 ceph-mon[109129]: from='osd.1 [v2:172.21.15.45:6810/1700971609,v1:172.21.15.45:6811/1700971609]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]} : dispatch 2024-09-18T12:57:49.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:48 smithi161 ceph-mon[80292]: from='osd.1 [v2:172.21.15.45:6810/1700971609,v1:172.21.15.45:6811/1700971609]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T12:57:49.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:48 smithi161 ceph-mon[80292]: osdmap e54: 6 total, 5 up, 6 in 2024-09-18T12:57:49.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:48 smithi161 ceph-mon[80292]: from='osd.1 [v2:172.21.15.45:6810/1700971609,v1:172.21.15.45:6811/1700971609]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]} : dispatch 2024-09-18T12:57:50.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: pgmap v159: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:50.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:57:50.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: osd.1 [v2:172.21.15.45:6810/1700971609,v1:172.21.15.45:6811/1700971609] boot 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: osdmap e55: 6 total, 6 up, 6 in 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:50.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:57:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: pgmap v159: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:57:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: osd.1 [v2:172.21.15.45:6810/1700971609,v1:172.21.15.45:6811/1700971609] boot 2024-09-18T12:57:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: osdmap e55: 6 total, 6 up, 6 in 2024-09-18T12:57:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-18T12:57:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:57:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:57:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:57:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:57:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:57:51.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:50 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:57:51.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:50 smithi045 ceph-mon[109129]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-18T12:57:51.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:50 smithi045 ceph-mon[109129]: osdmap e56: 6 total, 6 up, 6 in 2024-09-18T12:57:51.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:50 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:57:51.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:50 smithi161 ceph-mon[80292]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-18T12:57:51.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:50 smithi161 ceph-mon[80292]: osdmap e56: 6 total, 6 up, 6 in 2024-09-18T12:57:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:51 smithi045 ceph-mon[109129]: pgmap v162: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:51.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:51 smithi161 ceph-mon[80292]: pgmap v162: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:54.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:53 smithi045 ceph-mon[109129]: pgmap v163: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:54.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:54.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:53 smithi161 ceph-mon[80292]: pgmap v163: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/255 objects degraded (13.333%) 2024-09-18T12:57:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:57:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:57:54.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:54 smithi045 ceph-mon[109129]: pgmap v164: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-18T12:57:54.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:54 smithi045 ceph-mon[109129]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/255 objects degraded (13.333%), 13 pgs degraded) 2024-09-18T12:57:55.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:54 smithi161 ceph-mon[80292]: pgmap v164: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-18T12:57:55.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:54 smithi161 ceph-mon[80292]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/255 objects degraded (13.333%), 13 pgs degraded) 2024-09-18T12:57:57.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:57 smithi161 ceph-mon[80292]: pgmap v165: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-18T12:57:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:57 smithi045 ceph-mon[109129]: pgmap v165: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-18T12:57:59.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:57:59 smithi161 ceph-mon[80292]: pgmap v166: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-18T12:57:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:57:59 smithi045 ceph-mon[109129]: pgmap v166: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-18T12:58:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:01 smithi045 ceph-mon[109129]: pgmap v167: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 961 B/s rd, 1 op/s 2024-09-18T12:58:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:01 smithi161 ceph-mon[80292]: pgmap v167: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 961 B/s rd, 1 op/s 2024-09-18T12:58:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:03 smithi045 ceph-mon[109129]: pgmap v168: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:58:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:03 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:03 smithi161 ceph-mon[80292]: pgmap v168: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:58:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:03 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:04.496 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:04 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:58:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:04 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-18T12:58:05.741 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:05 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:58:05.741 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:05 smithi045 ceph-mon[109129]: Upgrade: osd.2 is safe to restart 2024-09-18T12:58:05.741 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:05 smithi045 ceph-mon[109129]: pgmap v169: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:58:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:05 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T12:58:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:05 smithi161 ceph-mon[80292]: Upgrade: osd.2 is safe to restart 2024-09-18T12:58:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:05 smithi161 ceph-mon[80292]: pgmap v169: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:58:06.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:06 smithi045 ceph-mon[109129]: Upgrade: Updating osd.2 2024-09-18T12:58:06.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:06 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:06.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:06 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-18T12:58:06.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:06 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:06.755 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:06 smithi045 ceph-mon[109129]: Deploying daemon osd.2 on smithi045 2024-09-18T12:58:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:06 smithi161 ceph-mon[80292]: Upgrade: Updating osd.2 2024-09-18T12:58:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:06 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:06 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-18T12:58:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:06 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:06 smithi161 ceph-mon[80292]: Deploying daemon osd.2 on smithi045 2024-09-18T12:58:07.621 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:07 smithi045 ceph-mon[109129]: pgmap v170: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:58:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:07 smithi161 ceph-mon[80292]: pgmap v170: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:58:08.609 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:08 smithi045 systemd[1]: Stopping Ceph osd.2 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:58:09.011 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:08 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[64773]: 2024-09-18T12:58:08.607+0000 7f4f46288640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:58:09.011 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:08 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[64773]: 2024-09-18T12:58:08.607+0000 7f4f46288640 -1 osd.2 56 *** Got signal Terminated *** 2024-09-18T12:58:09.011 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:08 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[64773]: 2024-09-18T12:58:08.607+0000 7f4f46288640 -1 osd.2 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:58:09.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:09.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:09.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:09 smithi045 ceph-mon[109129]: pgmap v171: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:58:09.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:09 smithi045 ceph-mon[109129]: osd.2 marked itself down and dead 2024-09-18T12:58:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:09 smithi161 ceph-mon[80292]: pgmap v171: 65 pgs: 65 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:58:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:09 smithi161 ceph-mon[80292]: osd.2 marked itself down and dead 2024-09-18T12:58:09.776 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:09 smithi045 podman[128074]: 2024-09-18 12:58:09.456864316 +0000 UTC m=+0.963250317 container died 4e35b9d08e6751ecd1a5c5e68859d077262dc4818673bf30f956452d85822877 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-18T12:58:10.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:10 smithi045 ceph-mon[109129]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:58:10.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:10 smithi045 ceph-mon[109129]: osdmap e57: 6 total, 5 up, 6 in 2024-09-18T12:58:10.034 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:09 smithi045 podman[128074]: 2024-09-18 12:58:09.974743149 +0000 UTC m=+1.481129205 container cleanup 4e35b9d08e6751ecd1a5c5e68859d077262dc4818673bf30f956452d85822877 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-18T12:58:10.034 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:09 smithi045 bash[128074]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2 2024-09-18T12:58:10.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:10 smithi161 ceph-mon[80292]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:58:10.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:10 smithi161 ceph-mon[80292]: osdmap e57: 6 total, 5 up, 6 in 2024-09-18T12:58:10.534 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:10 smithi045 podman[128095]: 2024-09-18 12:58:10.209980084 +0000 UTC m=+0.754372363 container remove 4e35b9d08e6751ecd1a5c5e68859d077262dc4818673bf30f956452d85822877 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2) 2024-09-18T12:58:10.910 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:10 smithi045 podman[128182]: 2024-09-18 12:58:10.560476143 +0000 UTC m=+0.016633280 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:58:10.910 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:10 smithi045 podman[128182]: 2024-09-18 12:58:10.669137964 +0000 UTC m=+0.125295097 container create 832ba6977ddf468b7cbedbde2f07034dd8dad34c3c3d4bf043b0810df70ae289 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-18T12:58:10.910 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:10 smithi045 podman[128182]: 2024-09-18 12:58:10.905112658 +0000 UTC m=+0.361269785 container init 832ba6977ddf468b7cbedbde2f07034dd8dad34c3c3d4bf043b0810df70ae289 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-18T12:58:10.910 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:10 smithi045 podman[128182]: 2024-09-18 12:58:10.909592836 +0000 UTC m=+0.365749963 container start 832ba6977ddf468b7cbedbde2f07034dd8dad34c3c3d4bf043b0810df70ae289 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:58:11.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:11 smithi045 ceph-mon[109129]: osdmap e58: 6 total, 5 up, 6 in 2024-09-18T12:58:11.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:11 smithi045 ceph-mon[109129]: pgmap v174: 65 pgs: 9 stale+active+clean, 56 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:58:11.284 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:11 smithi045 podman[128182]: 2024-09-18 12:58:11.013234787 +0000 UTC m=+0.469391924 container attach 832ba6977ddf468b7cbedbde2f07034dd8dad34c3c3d4bf043b0810df70ae289 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, ceph=True) 2024-09-18T12:58:11.285 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:11 smithi045 podman[128182]: 2024-09-18 12:58:11.102122226 +0000 UTC m=+0.558279363 container died 832ba6977ddf468b7cbedbde2f07034dd8dad34c3c3d4bf043b0810df70ae289 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-18T12:58:11.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:11 smithi161 ceph-mon[80292]: osdmap e58: 6 total, 5 up, 6 in 2024-09-18T12:58:11.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:11 smithi161 ceph-mon[80292]: pgmap v174: 65 pgs: 9 stale+active+clean, 56 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:58:12.277 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:11 smithi045 podman[128205]: 2024-09-18 12:58:11.816736369 +0000 UTC m=+0.708835640 container remove 832ba6977ddf468b7cbedbde2f07034dd8dad34c3c3d4bf043b0810df70ae289 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-18T12:58:12.277 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:11 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-18T12:58:12.277 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:11 smithi045 systemd[1]: Stopped Ceph osd.2 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:58:12.278 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:11 smithi045 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.2.service: Consumed 49.045s CPU time. 2024-09-18T12:58:12.278 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:12 smithi045 systemd[1]: Starting Ceph osd.2 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:58:12.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:12 smithi045 ceph-mon[109129]: Health check failed: Degraded data redundancy: 9/255 objects degraded (3.529%), 4 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:12.534 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:12 smithi045 podman[128302]: 2024-09-18 12:58:12.276382365 +0000 UTC m=+0.111944581 container create cc3cbf1f8dc37fd0de9758345713ffc56c1d53951b3cef2c7e812fa8e1820e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-18T12:58:12.535 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:12 smithi045 podman[128302]: 2024-09-18 12:58:12.181166455 +0000 UTC m=+0.016728681 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:58:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:12 smithi161 ceph-mon[80292]: Health check failed: Degraded data redundancy: 9/255 objects degraded (3.529%), 4 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:13.034 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:12 smithi045 podman[128302]: 2024-09-18 12:58:12.554324995 +0000 UTC m=+0.389887210 container init cc3cbf1f8dc37fd0de9758345713ffc56c1d53951b3cef2c7e812fa8e1820e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731) 2024-09-18T12:58:13.034 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:12 smithi045 podman[128302]: 2024-09-18 12:58:12.557780452 +0000 UTC m=+0.393342665 container start cc3cbf1f8dc37fd0de9758345713ffc56c1d53951b3cef2c7e812fa8e1820e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-18T12:58:13.034 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:12 smithi045 podman[128302]: 2024-09-18 12:58:12.645889288 +0000 UTC m=+0.481451508 container attach cc3cbf1f8dc37fd0de9758345713ffc56c1d53951b3cef2c7e812fa8e1820e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-18T12:58:13.035 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:12 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate[128318]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:58:13.035 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:12 smithi045 bash[128302]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:58:13.035 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:12 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate[128318]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:58:13.035 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:12 smithi045 bash[128302]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:58:13.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.569+0000 7fc66e320640 1 -- 172.21.15.45:0/1061910955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6681067f0 msgr2=0x7fc668106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.569+0000 7fc66e320640 1 --2- 172.21.15.45:0/1061910955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6681067f0 0x7fc668106bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc658009880 tx=0x7fc65802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.569+0000 7fc66e320640 1 -- 172.21.15.45:0/1061910955 shutdown_connections 2024-09-18T12:58:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.569+0000 7fc66e320640 1 --2- 172.21.15.45:0/1061910955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6681007f0 0x7fc668100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.569+0000 7fc66e320640 1 --2- 172.21.15.45:0/1061910955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6681067f0 0x7fc668106bd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.569+0000 7fc66e320640 1 -- 172.21.15.45:0/1061910955 >> 172.21.15.45:0/1061910955 conn(0x7fc6680fc550 msgr2=0x7fc6680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.569+0000 7fc66e320640 1 -- 172.21.15.45:0/1061910955 shutdown_connections 2024-09-18T12:58:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.569+0000 7fc66e320640 1 -- 172.21.15.45:0/1061910955 wait complete. 2024-09-18T12:58:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc66e320640 1 Processor -- start 2024-09-18T12:58:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc66e320640 1 -- start start 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc66e320640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6681007f0 0x7fc66819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc66e320640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6681067f0 0x7fc66819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc66e320640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc66810dca0 con 0x7fc6681067f0 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc66e320640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc66810db20 con 0x7fc6681007f0 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc65ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6681067f0 0x7fc66819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc65ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6681067f0 0x7fc66819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49952/0 (socket says 172.21.15.45:49952) 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc65ffff640 1 -- 172.21.15.45:0/3831110370 learned_addr learned my addr 172.21.15.45:0/3831110370 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc667fff640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6681007f0 0x7fc66819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc65ffff640 1 -- 172.21.15.45:0/3831110370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6681007f0 msgr2=0x7fc66819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc65ffff640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6681007f0 0x7fc66819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc65ffff640 1 -- 172.21.15.45:0/3831110370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc668197750 con 0x7fc6681067f0 2024-09-18T12:58:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.570+0000 7fc667fff640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6681007f0 0x7fc66819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:58:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.571+0000 7fc65ffff640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6681067f0 0x7fc66819dbc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc65000c8a0 tx=0x7fc65000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.571+0000 7fc665ffb640 1 -- 172.21.15.45:0/3831110370 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6500079b0 con 0x7fc6681067f0 2024-09-18T12:58:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.571+0000 7fc665ffb640 1 -- 172.21.15.45:0/3831110370 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc650007b50 con 0x7fc6681067f0 2024-09-18T12:58:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.571+0000 7fc66e320640 1 -- 172.21.15.45:0/3831110370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc668197a40 con 0x7fc6681067f0 2024-09-18T12:58:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.571+0000 7fc665ffb640 1 -- 172.21.15.45:0/3831110370 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc650018700 con 0x7fc6681067f0 2024-09-18T12:58:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.571+0000 7fc66e320640 1 -- 172.21.15.45:0/3831110370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc668197fd0 con 0x7fc6681067f0 2024-09-18T12:58:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.572+0000 7fc66e320640 1 -- 172.21.15.45:0/3831110370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc668101f30 con 0x7fc6681067f0 2024-09-18T12:58:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.572+0000 7fc665ffb640 1 -- 172.21.15.45:0/3831110370 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fc650007d00 con 0x7fc6681067f0 2024-09-18T12:58:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.573+0000 7fc665ffb640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc65407af40 0x7fc65407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.573+0000 7fc665ffb640 1 -- 172.21.15.45:0/3831110370 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6070+0+0 (secure 0 0 0) 0x7fc65009e230 con 0x7fc6681067f0 2024-09-18T12:58:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.573+0000 7fc667fff640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc65407af40 0x7fc65407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.573+0000 7fc667fff640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc65407af40 0x7fc65407d400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc658031460 tx=0x7fc658004280 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.577+0000 7fc665ffb640 1 -- 172.21.15.45:0/3831110370 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc650014030 con 0x7fc6681067f0 2024-09-18T12:58:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:13 smithi045 ceph-mon[109129]: pgmap v175: 65 pgs: 4 active+undersized, 6 stale+active+clean, 4 active+undersized+degraded, 51 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 9/255 objects degraded (3.529%) 2024-09-18T12:58:13.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.784+0000 7fc66e320640 1 -- 172.21.15.45:0/3831110370 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc668198340 con 0x7fc65407af40 2024-09-18T12:58:13.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.785+0000 7fc665ffb640 1 -- 172.21.15.45:0/3831110370 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fc668198340 con 0x7fc65407af40 2024-09-18T12:58:13.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.787+0000 7fc66e320640 1 -- 172.21.15.45:0/3831110370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc65407af40 msgr2=0x7fc65407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:13.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.787+0000 7fc66e320640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc65407af40 0x7fc65407d400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc658031460 tx=0x7fc658004280 comp rx=0 tx=0).stop 2024-09-18T12:58:13.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.787+0000 7fc66e320640 1 -- 172.21.15.45:0/3831110370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6681067f0 msgr2=0x7fc66819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:13.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.787+0000 7fc66e320640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6681067f0 0x7fc66819dbc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc65000c8a0 tx=0x7fc65000cd60 comp rx=0 tx=0).stop 2024-09-18T12:58:13.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.788+0000 7fc66e320640 1 -- 172.21.15.45:0/3831110370 shutdown_connections 2024-09-18T12:58:13.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.788+0000 7fc66e320640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc65407af40 0x7fc65407d400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.788+0000 7fc66e320640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6681067f0 0x7fc66819dbc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.788+0000 7fc66e320640 1 --2- 172.21.15.45:0/3831110370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6681007f0 0x7fc66819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.788+0000 7fc66e320640 1 -- 172.21.15.45:0/3831110370 >> 172.21.15.45:0/3831110370 conn(0x7fc6680fc550 msgr2=0x7fc668069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:13.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.788+0000 7fc66e320640 1 -- 172.21.15.45:0/3831110370 shutdown_connections 2024-09-18T12:58:13.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.788+0000 7fc66e320640 1 -- 172.21.15.45:0/3831110370 wait complete. 2024-09-18T12:58:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:13 smithi161 ceph-mon[80292]: pgmap v175: 65 pgs: 4 active+undersized, 6 stale+active+clean, 4 active+undersized+degraded, 51 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 9/255 objects degraded (3.529%) 2024-09-18T12:58:13.798 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:58:13.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.873+0000 7f78afab3640 1 -- 172.21.15.45:0/2109292782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8100800 msgr2=0x7f78a8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:13.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.873+0000 7f78afab3640 1 --2- 172.21.15.45:0/2109292782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8100800 0x7f78a8100c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f789c009880 tx=0x7f789c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.873+0000 7f78afab3640 1 -- 172.21.15.45:0/2109292782 shutdown_connections 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.873+0000 7f78afab3640 1 --2- 172.21.15.45:0/2109292782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8100800 0x7f78a8100c60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.873+0000 7f78afab3640 1 --2- 172.21.15.45:0/2109292782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78a8106800 0x7f78a8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.873+0000 7f78afab3640 1 -- 172.21.15.45:0/2109292782 >> 172.21.15.45:0/2109292782 conn(0x7f78a80fc520 msgr2=0x7f78a80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.873+0000 7f78afab3640 1 -- 172.21.15.45:0/2109292782 shutdown_connections 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.873+0000 7f78afab3640 1 -- 172.21.15.45:0/2109292782 wait complete. 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78afab3640 1 Processor -- start 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78afab3640 1 -- start start 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78afab3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78a8100800 0x7f78a819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78afab3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8106800 0x7f78a819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78afab3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78a810dd30 con 0x7f78a8106800 2024-09-18T12:58:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78afab3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f78a810dbb0 con 0x7f78a8100800 2024-09-18T12:58:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78ad04e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8106800 0x7f78a819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78ad04e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8106800 0x7f78a819dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49974/0 (socket says 172.21.15.45:49974) 2024-09-18T12:58:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78ad04e640 1 -- 172.21.15.45:0/3500824052 learned_addr learned my addr 172.21.15.45:0/3500824052 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78ad84f640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78a8100800 0x7f78a819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78ad04e640 1 -- 172.21.15.45:0/3500824052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78a8100800 msgr2=0x7f78a819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78ad04e640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78a8100800 0x7f78a819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.874+0000 7f78ad04e640 1 -- 172.21.15.45:0/3500824052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a8197850 con 0x7f78a8106800 2024-09-18T12:58:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.875+0000 7f78ad04e640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8106800 0x7f78a819dc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f789c031460 tx=0x7f789c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.875+0000 7f789affd640 1 -- 172.21.15.45:0/3500824052 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f789c03f070 con 0x7f78a8106800 2024-09-18T12:58:13.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.875+0000 7f78afab3640 1 -- 172.21.15.45:0/3500824052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a8197ae0 con 0x7f78a8106800 2024-09-18T12:58:13.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.875+0000 7f789affd640 1 -- 172.21.15.45:0/3500824052 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f789c004cf0 con 0x7f78a8106800 2024-09-18T12:58:13.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.875+0000 7f789affd640 1 -- 172.21.15.45:0/3500824052 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f789c035030 con 0x7f78a8106800 2024-09-18T12:58:13.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.875+0000 7f78afab3640 1 -- 172.21.15.45:0/3500824052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a8198010 con 0x7f78a8106800 2024-09-18T12:58:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.876+0000 7f78afab3640 1 -- 172.21.15.45:0/3500824052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a8101f40 con 0x7f78a8106800 2024-09-18T12:58:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.876+0000 7f789affd640 1 -- 172.21.15.45:0/3500824052 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f789c042070 con 0x7f78a8106800 2024-09-18T12:58:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.877+0000 7f789affd640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f789407af30 0x7f789407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.877+0000 7f789affd640 1 -- 172.21.15.45:0/3500824052 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6070+0+0 (secure 0 0 0) 0x7f789c0beb50 con 0x7f78a8106800 2024-09-18T12:58:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.877+0000 7f78ad84f640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f789407af30 0x7f789407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.877+0000 7f78ad84f640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f789407af30 0x7f789407d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78a400a810 tx=0x7f78a4008040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:13.881+0000 7f789affd640 1 -- 172.21.15.45:0/3500824052 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f789c08a100 con 0x7f78a8106800 2024-09-18T12:58:14.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.092+0000 7f78afab3640 1 -- 172.21.15.45:0/3500824052 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f78a81982c0 con 0x7f789407af30 2024-09-18T12:58:14.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.093+0000 7f789affd640 1 -- 172.21.15.45:0/3500824052 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f78a81982c0 con 0x7f789407af30 2024-09-18T12:58:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.095+0000 7f78afab3640 1 -- 172.21.15.45:0/3500824052 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f789407af30 msgr2=0x7f789407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.095+0000 7f78afab3640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f789407af30 0x7f789407d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78a400a810 tx=0x7f78a4008040 comp rx=0 tx=0).stop 2024-09-18T12:58:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.095+0000 7f78afab3640 1 -- 172.21.15.45:0/3500824052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8106800 msgr2=0x7f78a819dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.095+0000 7f78afab3640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8106800 0x7f78a819dc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f789c031460 tx=0x7f789c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.096+0000 7f78afab3640 1 -- 172.21.15.45:0/3500824052 shutdown_connections 2024-09-18T12:58:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.096+0000 7f78afab3640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f789407af30 0x7f789407d3f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.096+0000 7f78afab3640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8106800 0x7f78a819dc10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.096+0000 7f78afab3640 1 --2- 172.21.15.45:0/3500824052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78a8100800 0x7f78a819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.096+0000 7f78afab3640 1 -- 172.21.15.45:0/3500824052 >> 172.21.15.45:0/3500824052 conn(0x7f78a80fc520 msgr2=0x7f78a806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:14.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.096+0000 7f78afab3640 1 -- 172.21.15.45:0/3500824052 shutdown_connections 2024-09-18T12:58:14.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.096+0000 7f78afab3640 1 -- 172.21.15.45:0/3500824052 wait complete. 2024-09-18T12:58:14.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.180+0000 7fe77afeb640 1 -- 172.21.15.45:0/281753772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe774103470 msgr2=0x7fe77410b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.180+0000 7fe77afeb640 1 --2- 172.21.15.45:0/281753772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe774103470 0x7fe77410b960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe764009880 tx=0x7fe76402a530 comp rx=0 tx=0).stop 2024-09-18T12:58:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.180+0000 7fe77afeb640 1 -- 172.21.15.45:0/281753772 shutdown_connections 2024-09-18T12:58:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.180+0000 7fe77afeb640 1 --2- 172.21.15.45:0/281753772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe774103470 0x7fe77410b960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.180+0000 7fe77afeb640 1 --2- 172.21.15.45:0/281753772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe774102b50 0x7fe774102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.180+0000 7fe77afeb640 1 -- 172.21.15.45:0/281753772 >> 172.21.15.45:0/281753772 conn(0x7fe7740fc550 msgr2=0x7fe7740fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.180+0000 7fe77afeb640 1 -- 172.21.15.45:0/281753772 shutdown_connections 2024-09-18T12:58:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.180+0000 7fe77afeb640 1 -- 172.21.15.45:0/281753772 wait complete. 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe77afeb640 1 Processor -- start 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe77afeb640 1 -- start start 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe77afeb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe774102b50 0x7fe77419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe77afeb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe774103470 0x7fe77419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe77afeb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe77410edc0 con 0x7fe774103470 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe77afeb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe77410ec40 con 0x7fe774102b50 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe76bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe774103470 0x7fe77419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe76bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe774103470 0x7fe77419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49982/0 (socket says 172.21.15.45:49982) 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe76bfff640 1 -- 172.21.15.45:0/3970389637 learned_addr learned my addr 172.21.15.45:0/3970389637 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe778d87640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe774102b50 0x7fe77419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe76bfff640 1 -- 172.21.15.45:0/3970389637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe774102b50 msgr2=0x7fe77419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe76bfff640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe774102b50 0x7fe77419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.181+0000 7fe76bfff640 1 -- 172.21.15.45:0/3970389637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe774197790 con 0x7fe774103470 2024-09-18T12:58:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.182+0000 7fe76bfff640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe774103470 0x7fe77419db50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe764004f90 tx=0x7fe7640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.182+0000 7fe769ffb640 1 -- 172.21.15.45:0/3970389637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe76403f070 con 0x7fe774103470 2024-09-18T12:58:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.182+0000 7fe769ffb640 1 -- 172.21.15.45:0/3970389637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe764004cf0 con 0x7fe774103470 2024-09-18T12:58:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.182+0000 7fe769ffb640 1 -- 172.21.15.45:0/3970389637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe764035030 con 0x7fe774103470 2024-09-18T12:58:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.182+0000 7fe77afeb640 1 -- 172.21.15.45:0/3970389637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe774197a20 con 0x7fe774103470 2024-09-18T12:58:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.182+0000 7fe77afeb640 1 -- 172.21.15.45:0/3970389637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe774197f50 con 0x7fe774103470 2024-09-18T12:58:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.183+0000 7fe77afeb640 1 -- 172.21.15.45:0/3970389637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77406a4e0 con 0x7fe774103470 2024-09-18T12:58:14.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.185+0000 7fe769ffb640 1 -- 172.21.15.45:0/3970389637 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fe764042070 con 0x7fe774103470 2024-09-18T12:58:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.185+0000 7fe769ffb640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe75c07af30 0x7fe75c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.186+0000 7fe769ffb640 1 -- 172.21.15.45:0/3970389637 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6070+0+0 (secure 0 0 0) 0x7fe7640bf0d0 con 0x7fe774103470 2024-09-18T12:58:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.186+0000 7fe778d87640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe75c07af30 0x7fe75c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:14.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.186+0000 7fe778d87640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe75c07af30 0x7fe75c07d3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7700058c0 tx=0x7fe77000a4c0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.189+0000 7fe769ffb640 1 -- 172.21.15.45:0/3970389637 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe76408a7a0 con 0x7fe774103470 2024-09-18T12:58:14.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.384+0000 7fe77afeb640 1 -- 172.21.15.45:0/3970389637 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe774198270 con 0x7fe75c07af30 2024-09-18T12:58:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.394+0000 7fe769ffb640 1 -- 172.21.15.45:0/3970389637 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fe774198270 con 0x7fe75c07af30 2024-09-18T12:58:14.395 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (3m) 29s ago 14m 20.0M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (6m) 29s ago 14m 8925k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (5m) 89s ago 13m 8346k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (97s) 29s ago 14m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (92s) 89s ago 13m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (2m) 29s ago 13m 79.3M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (8m) 29s ago 8m 92.1M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (8m) 29s ago 8m 149M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (8m) 89s ago 8m 17.4M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (8m) 89s ago 8m 15.9M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (5m) 29s ago 15m 523M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (4m) 89s ago 13m 457M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:58:14.396 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (2m) 29s ago 15m 41.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T12:58:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (108s) 89s ago 13m 25.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T12:58:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (4m) 29s ago 14m 11.3M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:58:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (4m) 89s ago 13m 11.1M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:58:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (71s) 29s ago 12m 84.0M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T12:58:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (34s) 29s ago 11m 14.5M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 7d4cd0351725 2024-09-18T12:58:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (11m) 29s ago 11m 186M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 4e35b9d08e67 2024-09-18T12:58:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (10m) 89s ago 10m 243M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:58:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (10m) 89s ago 10m 215M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:58:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (9m) 89s ago 9m 200M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:58:14.397 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (3m) 29s ago 13m 49.8M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:58:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 -- 172.21.15.45:0/3970389637 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe75c07af30 msgr2=0x7fe75c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe75c07af30 0x7fe75c07d3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7700058c0 tx=0x7fe77000a4c0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 -- 172.21.15.45:0/3970389637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe774103470 msgr2=0x7fe77419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe774103470 0x7fe77419db50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe764004f90 tx=0x7fe7640048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 -- 172.21.15.45:0/3970389637 shutdown_connections 2024-09-18T12:58:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe75c07af30 0x7fe75c07d3f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe774103470 0x7fe77419db50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 --2- 172.21.15.45:0/3970389637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe774102b50 0x7fe77419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 -- 172.21.15.45:0/3970389637 >> 172.21.15.45:0/3970389637 conn(0x7fe7740fc550 msgr2=0x7fe774108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:14.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 -- 172.21.15.45:0/3970389637 shutdown_connections 2024-09-18T12:58:14.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.397+0000 7fe77afeb640 1 -- 172.21.15.45:0/3970389637 wait complete. 2024-09-18T12:58:14.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.481+0000 7f82f1288640 1 -- 172.21.15.45:0/4250601469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82ec106860 msgr2=0x7f82ec106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.481+0000 7f82f1288640 1 --2- 172.21.15.45:0/4250601469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82ec106860 0x7f82ec106c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009880 tx=0x7f82dc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.481+0000 7f82f1288640 1 -- 172.21.15.45:0/4250601469 shutdown_connections 2024-09-18T12:58:14.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.481+0000 7f82f1288640 1 --2- 172.21.15.45:0/4250601469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82ec100860 0x7f82ec100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.481+0000 7f82f1288640 1 --2- 172.21.15.45:0/4250601469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82ec106860 0x7f82ec106c40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.481+0000 7f82f1288640 1 -- 172.21.15.45:0/4250601469 >> 172.21.15.45:0/4250601469 conn(0x7f82ec0fc580 msgr2=0x7f82ec0fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:14.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.481+0000 7f82f1288640 1 -- 172.21.15.45:0/4250601469 shutdown_connections 2024-09-18T12:58:14.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.481+0000 7f82f1288640 1 -- 172.21.15.45:0/4250601469 wait complete. 2024-09-18T12:58:14.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.482+0000 7f82f1288640 1 Processor -- start 2024-09-18T12:58:14.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.482+0000 7f82f1288640 1 -- start start 2024-09-18T12:58:14.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.482+0000 7f82f1288640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82ec100860 0x7f82ec196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:14.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.482+0000 7f82f1288640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82ec106860 0x7f82ec196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:14.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.482+0000 7f82f1288640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec10dd30 con 0x7f82ec100860 2024-09-18T12:58:14.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.482+0000 7f82f1288640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec10dbb0 con 0x7f82ec106860 2024-09-18T12:58:14.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82eaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82ec100860 0x7f82ec196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:14.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82eaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82ec100860 0x7f82ec196630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50008/0 (socket says 172.21.15.45:50008) 2024-09-18T12:58:14.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82eaffd640 1 -- 172.21.15.45:0/2613894099 learned_addr learned my addr 172.21.15.45:0/2613894099 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:14.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82ea7fc640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82ec106860 0x7f82ec196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:14.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82eaffd640 1 -- 172.21.15.45:0/2613894099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82ec106860 msgr2=0x7f82ec196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82eaffd640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82ec106860 0x7f82ec196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82eaffd640 1 -- 172.21.15.45:0/2613894099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ec1970b0 con 0x7f82ec100860 2024-09-18T12:58:14.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82eaffd640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82ec100860 0x7f82ec196630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f82dc031460 tx=0x7f82dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:14.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82d3fff640 1 -- 172.21.15.45:0/2613894099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82dc03f070 con 0x7f82ec100860 2024-09-18T12:58:14.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82d3fff640 1 -- 172.21.15.45:0/2613894099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82dc0035f0 con 0x7f82ec100860 2024-09-18T12:58:14.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82f1288640 1 -- 172.21.15.45:0/2613894099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ec197340 con 0x7f82ec100860 2024-09-18T12:58:14.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.483+0000 7f82d3fff640 1 -- 172.21.15.45:0/2613894099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82dc035030 con 0x7f82ec100860 2024-09-18T12:58:14.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.484+0000 7f82f1288640 1 -- 172.21.15.45:0/2613894099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ec1a3e70 con 0x7f82ec100860 2024-09-18T12:58:14.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.485+0000 7f82f1288640 1 -- 172.21.15.45:0/2613894099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ec101fa0 con 0x7f82ec100860 2024-09-18T12:58:14.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.485+0000 7f82d3fff640 1 -- 172.21.15.45:0/2613894099 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f82dc042070 con 0x7f82ec100860 2024-09-18T12:58:14.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.486+0000 7f82d3fff640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f82d407af30 0x7f82d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:14.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.486+0000 7f82ea7fc640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f82d407af30 0x7f82d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:14.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.486+0000 7f82d3fff640 1 -- 172.21.15.45:0/2613894099 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6070+0+0 (secure 0 0 0) 0x7f82dc0be920 con 0x7f82ec100860 2024-09-18T12:58:14.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.487+0000 7f82ea7fc640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f82d407af30 0x7f82d407d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82ec198790 tx=0x7f82e000b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:14.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.490+0000 7f82d3fff640 1 -- 172.21.15.45:0/2613894099 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f82dc089f70 con 0x7f82ec100860 2024-09-18T12:58:14.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.750+0000 7f82f1288640 1 -- 172.21.15.45:0/2613894099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f82ec108dd0 con 0x7f82ec100860 2024-09-18T12:58:14.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.750+0000 7f82d3fff640 1 -- 172.21.15.45:0/2613894099 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f82dc08c490 con 0x7f82ec100860 2024-09-18T12:58:14.752 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:58:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:58:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:58:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:58:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:58:14.752 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3, 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 7, 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:58:14.753 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:58:14.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.752+0000 7f82f1288640 1 -- 172.21.15.45:0/2613894099 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f82d407af30 msgr2=0x7f82d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.752+0000 7f82f1288640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f82d407af30 0x7f82d407d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82ec198790 tx=0x7f82e000b390 comp rx=0 tx=0).stop 2024-09-18T12:58:14.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.752+0000 7f82f1288640 1 -- 172.21.15.45:0/2613894099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82ec100860 msgr2=0x7f82ec196630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.752+0000 7f82f1288640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82ec100860 0x7f82ec196630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f82dc031460 tx=0x7f82dc0045e0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.753+0000 7f82f1288640 1 -- 172.21.15.45:0/2613894099 shutdown_connections 2024-09-18T12:58:14.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.753+0000 7f82f1288640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f82d407af30 0x7f82d407d3f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.753+0000 7f82f1288640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82ec106860 0x7f82ec196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.753+0000 7f82f1288640 1 --2- 172.21.15.45:0/2613894099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82ec100860 0x7f82ec196630 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.753+0000 7f82f1288640 1 -- 172.21.15.45:0/2613894099 >> 172.21.15.45:0/2613894099 conn(0x7f82ec0fc580 msgr2=0x7f82ec0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:14.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.753+0000 7f82f1288640 1 -- 172.21.15.45:0/2613894099 shutdown_connections 2024-09-18T12:58:14.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.753+0000 7f82f1288640 1 -- 172.21.15.45:0/2613894099 wait complete. 2024-09-18T12:58:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.840+0000 7f0851c36640 1 -- 172.21.15.45:0/537845785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f084c107900 msgr2=0x7f084c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.840+0000 7f0851c36640 1 --2- 172.21.15.45:0/537845785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f084c107900 0x7f084c107ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f083c009880 tx=0x7f083c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.840+0000 7f0851c36640 1 -- 172.21.15.45:0/537845785 shutdown_connections 2024-09-18T12:58:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.840+0000 7f0851c36640 1 --2- 172.21.15.45:0/537845785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f084c101900 0x7f084c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.840+0000 7f0851c36640 1 --2- 172.21.15.45:0/537845785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f084c107900 0x7f084c107ce0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.840+0000 7f0851c36640 1 -- 172.21.15.45:0/537845785 >> 172.21.15.45:0/537845785 conn(0x7f084c0fd600 msgr2=0x7f084c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.840+0000 7f0851c36640 1 -- 172.21.15.45:0/537845785 shutdown_connections 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.840+0000 7f0851c36640 1 -- 172.21.15.45:0/537845785 wait complete. 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.840+0000 7f0851c36640 1 Processor -- start 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f0851c36640 1 -- start start 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f0851c36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f084c101900 0x7f084c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f0851c36640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f084c107900 0x7f084c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f0851c36640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f084c10edb0 con 0x7f084c101900 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f0851c36640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f084c10ec30 con 0x7f084c107900 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f084b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f084c101900 0x7f084c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f084b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f084c101900 0x7f084c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50030/0 (socket says 172.21.15.45:50030) 2024-09-18T12:58:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f084b7fe640 1 -- 172.21.15.45:0/188315127 learned_addr learned my addr 172.21.15.45:0/188315127 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:14.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f084affd640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f084c107900 0x7f084c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:14.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f084b7fe640 1 -- 172.21.15.45:0/188315127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f084c107900 msgr2=0x7f084c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:14.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f084b7fe640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f084c107900 0x7f084c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:14.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f084b7fe640 1 -- 172.21.15.45:0/188315127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c1977c0 con 0x7f084c101900 2024-09-18T12:58:14.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.841+0000 7f084affd640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f084c107900 0x7f084c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:58:14.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.842+0000 7f084b7fe640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f084c101900 0x7f084c19d640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f083c031460 tx=0x7f083c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:14.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.842+0000 7f0848ff9640 1 -- 172.21.15.45:0/188315127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f083c03f070 con 0x7f084c101900 2024-09-18T12:58:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.842+0000 7f0851c36640 1 -- 172.21.15.45:0/188315127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084c197a50 con 0x7f084c101900 2024-09-18T12:58:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.842+0000 7f0848ff9640 1 -- 172.21.15.45:0/188315127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f083c0044d0 con 0x7f084c101900 2024-09-18T12:58:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.842+0000 7f0848ff9640 1 -- 172.21.15.45:0/188315127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f083c035030 con 0x7f084c101900 2024-09-18T12:58:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.842+0000 7f0851c36640 1 -- 172.21.15.45:0/188315127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084c197f80 con 0x7f084c101900 2024-09-18T12:58:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.843+0000 7f0851c36640 1 -- 172.21.15.45:0/188315127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f084c103040 con 0x7f084c101900 2024-09-18T12:58:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.844+0000 7f0848ff9640 1 -- 172.21.15.45:0/188315127 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f083c042070 con 0x7f084c101900 2024-09-18T12:58:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.844+0000 7f0848ff9640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f083407af40 0x7f083407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.844+0000 7f0848ff9640 1 -- 172.21.15.45:0/188315127 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6070+0+0 (secure 0 0 0) 0x7f083c0beb20 con 0x7f084c101900 2024-09-18T12:58:14.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.844+0000 7f084affd640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f083407af40 0x7f083407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:14.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.845+0000 7f084affd640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f083407af40 0x7f083407d400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f084c100e00 tx=0x7f0840005d30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:14.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:14.848+0000 7f0848ff9640 1 -- 172.21.15.45:0/188315127 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f083c004cf0 con 0x7f084c101900 2024-09-18T12:58:15.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.076+0000 7f0851c36640 1 -- 172.21.15.45:0/188315127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f084c198d20 con 0x7f084c101900 2024-09-18T12:58:15.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.076+0000 7f0848ff9640 1 -- 172.21.15.45:0/188315127 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2046 (secure 0 0 0) 0x7f084c198d20 con 0x7f084c101900 2024-09-18T12:58:15.078 INFO:teuthology.orchestra.run.smithi045.stdout:e16 2024-09-18T12:58:15.078 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T12:49:30:966010+0000 2024-09-18T12:58:15.078 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:58:15.078 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:58:15.078 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T12:58:15.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:58:15.078 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:58:15.078 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T12:58:15.078 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 14 2024-09-18T12:58:15.078 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T12:49:28.960615+0000 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:58:15.079 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=14566} 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 14566 members: 14566 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:15.080 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:15.081 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:58:15.081 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:58:15.081 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T12:58:15.081 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:58:15.081 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:15.081 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2024-09-18T12:58:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.078+0000 7f0851c36640 1 -- 172.21.15.45:0/188315127 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f083407af40 msgr2=0x7f083407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.078+0000 7f0851c36640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f083407af40 0x7f083407d400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f084c100e00 tx=0x7f0840005d30 comp rx=0 tx=0).stop 2024-09-18T12:58:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.078+0000 7f0851c36640 1 -- 172.21.15.45:0/188315127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f084c101900 msgr2=0x7f084c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.078+0000 7f0851c36640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f084c101900 0x7f084c19d640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f083c031460 tx=0x7f083c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.078+0000 7f0851c36640 1 -- 172.21.15.45:0/188315127 shutdown_connections 2024-09-18T12:58:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.078+0000 7f0851c36640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f083407af40 0x7f083407d400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.078+0000 7f0851c36640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f084c107900 0x7f084c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.078+0000 7f0851c36640 1 --2- 172.21.15.45:0/188315127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f084c101900 0x7f084c19d640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.079+0000 7f0851c36640 1 -- 172.21.15.45:0/188315127 >> 172.21.15.45:0/188315127 conn(0x7f084c0fd600 msgr2=0x7f084c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:15.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.079+0000 7f0851c36640 1 -- 172.21.15.45:0/188315127 shutdown_connections 2024-09-18T12:58:15.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.079+0000 7f0851c36640 1 -- 172.21.15.45:0/188315127 wait complete. 2024-09-18T12:58:15.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.164+0000 7ff98ddb5640 1 -- 172.21.15.45:0/3626833379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9881033e0 msgr2=0x7ff98810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:15.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.164+0000 7ff98ddb5640 1 --2- 172.21.15.45:0/3626833379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9881033e0 0x7ff98810b8d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009880 tx=0x7ff97c02a530 comp rx=0 tx=0).stop 2024-09-18T12:58:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.165+0000 7ff98ddb5640 1 -- 172.21.15.45:0/3626833379 shutdown_connections 2024-09-18T12:58:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.165+0000 7ff98ddb5640 1 --2- 172.21.15.45:0/3626833379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9881033e0 0x7ff98810b8d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.165+0000 7ff98ddb5640 1 --2- 172.21.15.45:0/3626833379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988102ac0 0x7ff988102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.165+0000 7ff98ddb5640 1 -- 172.21.15.45:0/3626833379 >> 172.21.15.45:0/3626833379 conn(0x7ff9880fc520 msgr2=0x7ff9880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.165+0000 7ff98ddb5640 1 -- 172.21.15.45:0/3626833379 shutdown_connections 2024-09-18T12:58:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.165+0000 7ff98ddb5640 1 -- 172.21.15.45:0/3626833379 wait complete. 2024-09-18T12:58:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.165+0000 7ff98ddb5640 1 Processor -- start 2024-09-18T12:58:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.165+0000 7ff98ddb5640 1 -- start start 2024-09-18T12:58:15.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff98ddb5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988102ac0 0x7ff98819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:15.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff98ddb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9881033e0 0x7ff98819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:15.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff98ddb5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff98810edf0 con 0x7ff9881033e0 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff98ddb5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff98810ec70 con 0x7ff988102ac0 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff986ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9881033e0 0x7ff98819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff986ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9881033e0 0x7ff98819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50056/0 (socket says 172.21.15.45:50056) 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff986ffd640 1 -- 172.21.15.45:0/1331826616 learned_addr learned my addr 172.21.15.45:0/1331826616 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff9877fe640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988102ac0 0x7ff98819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff986ffd640 1 -- 172.21.15.45:0/1331826616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988102ac0 msgr2=0x7ff98819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff986ffd640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988102ac0 0x7ff98819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff986ffd640 1 -- 172.21.15.45:0/1331826616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff988197820 con 0x7ff9881033e0 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff986ffd640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9881033e0 0x7ff98819dbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff97c031460 tx=0x7ff97c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff984ff9640 1 -- 172.21.15.45:0/1331826616 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff97c03f070 con 0x7ff9881033e0 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff984ff9640 1 -- 172.21.15.45:0/1331826616 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff97c004a90 con 0x7ff9881033e0 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff98ddb5640 1 -- 172.21.15.45:0/1331826616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff988197ab0 con 0x7ff9881033e0 2024-09-18T12:58:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.166+0000 7ff984ff9640 1 -- 172.21.15.45:0/1331826616 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff97c035030 con 0x7ff9881033e0 2024-09-18T12:58:15.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.167+0000 7ff98ddb5640 1 -- 172.21.15.45:0/1331826616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff988197fe0 con 0x7ff9881033e0 2024-09-18T12:58:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.167+0000 7ff98ddb5640 1 -- 172.21.15.45:0/1331826616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98806aa90 con 0x7ff9881033e0 2024-09-18T12:58:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.168+0000 7ff984ff9640 1 -- 172.21.15.45:0/1331826616 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7ff97c042070 con 0x7ff9881033e0 2024-09-18T12:58:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.169+0000 7ff984ff9640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff97007af90 0x7ff97007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.169+0000 7ff984ff9640 1 -- 172.21.15.45:0/1331826616 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6070+0+0 (secure 0 0 0) 0x7ff97c0be980 con 0x7ff9881033e0 2024-09-18T12:58:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.169+0000 7ff9877fe640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff97007af90 0x7ff97007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.169+0000 7ff9877fe640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff97007af90 0x7ff97007d450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff978005fd0 tx=0x7ff97800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.173+0000 7ff984ff9640 1 -- 172.21.15.45:0/1331826616 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff97c08a050 con 0x7ff9881033e0 2024-09-18T12:58:15.342 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate[128318]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:58:15.342 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 bash[128302]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:58:15.342 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate[128318]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:58:15.342 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 bash[128302]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:58:15.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.384+0000 7ff98ddb5640 1 -- 172.21.15.45:0/1331826616 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff988198350 con 0x7ff97007af90 2024-09-18T12:58:15.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.385+0000 7ff984ff9640 1 -- 172.21.15.45:0/1331826616 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7ff988198350 con 0x7ff97007af90 2024-09-18T12:58:15.386 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr", 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: "mon", 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: "crash" 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "8/23 daemons upgraded", 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:58:15.387 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:58:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.388+0000 7ff98ddb5640 1 -- 172.21.15.45:0/1331826616 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff97007af90 msgr2=0x7ff97007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.388+0000 7ff98ddb5640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff97007af90 0x7ff97007d450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff978005fd0 tx=0x7ff97800b390 comp rx=0 tx=0).stop 2024-09-18T12:58:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.388+0000 7ff98ddb5640 1 -- 172.21.15.45:0/1331826616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9881033e0 msgr2=0x7ff98819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.388+0000 7ff98ddb5640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9881033e0 0x7ff98819dbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff97c031460 tx=0x7ff97c004530 comp rx=0 tx=0).stop 2024-09-18T12:58:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.388+0000 7ff98ddb5640 1 -- 172.21.15.45:0/1331826616 shutdown_connections 2024-09-18T12:58:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.388+0000 7ff98ddb5640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff97007af90 0x7ff97007d450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.388+0000 7ff98ddb5640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9881033e0 0x7ff98819dbe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.388+0000 7ff98ddb5640 1 --2- 172.21.15.45:0/1331826616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff988102ac0 0x7ff98819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.388+0000 7ff98ddb5640 1 -- 172.21.15.45:0/1331826616 >> 172.21.15.45:0/1331826616 conn(0x7ff9880fc520 msgr2=0x7ff988108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.389+0000 7ff98ddb5640 1 -- 172.21.15.45:0/1331826616 shutdown_connections 2024-09-18T12:58:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.389+0000 7ff98ddb5640 1 -- 172.21.15.45:0/1331826616 wait complete. 2024-09-18T12:58:15.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.477+0000 7f2b7d246640 1 -- 172.21.15.45:0/2643369194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b78101900 msgr2=0x7f2b78101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:15.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.477+0000 7f2b7d246640 1 --2- 172.21.15.45:0/2643369194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b78101900 0x7f2b78101d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009880 tx=0x7f2b6c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.477+0000 7f2b7d246640 1 -- 172.21.15.45:0/2643369194 shutdown_connections 2024-09-18T12:58:15.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.477+0000 7f2b7d246640 1 --2- 172.21.15.45:0/2643369194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b78101900 0x7f2b78101d60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.477+0000 7f2b7d246640 1 --2- 172.21.15.45:0/2643369194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78107900 0x7f2b78107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.477+0000 7f2b7d246640 1 -- 172.21.15.45:0/2643369194 >> 172.21.15.45:0/2643369194 conn(0x7f2b780fd600 msgr2=0x7f2b780ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:15.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.477+0000 7f2b7d246640 1 -- 172.21.15.45:0/2643369194 shutdown_connections 2024-09-18T12:58:15.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.477+0000 7f2b7d246640 1 -- 172.21.15.45:0/2643369194 wait complete. 2024-09-18T12:58:15.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.478+0000 7f2b7d246640 1 Processor -- start 2024-09-18T12:58:15.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.478+0000 7f2b7d246640 1 -- start start 2024-09-18T12:58:15.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.478+0000 7f2b7d246640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78101900 0x7f2b7819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:15.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.478+0000 7f2b7d246640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b78107900 0x7f2b7819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:15.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.478+0000 7f2b7d246640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7810edd0 con 0x7f2b78107900 2024-09-18T12:58:15.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.478+0000 7f2b7d246640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7810ec50 con 0x7f2b78101900 2024-09-18T12:58:15.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.478+0000 7f2b7659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b78107900 0x7f2b7819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:15.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.478+0000 7f2b7659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b78107900 0x7f2b7819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50078/0 (socket says 172.21.15.45:50078) 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.478+0000 7f2b7659c640 1 -- 172.21.15.45:0/4250220960 learned_addr learned my addr 172.21.15.45:0/4250220960 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b76d9d640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78101900 0x7f2b7819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b7659c640 1 -- 172.21.15.45:0/4250220960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78101900 msgr2=0x7f2b7819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b7659c640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78101900 0x7f2b7819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b7659c640 1 -- 172.21.15.45:0/4250220960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b78197800 con 0x7f2b78107900 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b76d9d640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78101900 0x7f2b7819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b7659c640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b78107900 0x7f2b7819dbc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c031460 tx=0x7f2b6c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b5ffff640 1 -- 172.21.15.45:0/4250220960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b6c03f070 con 0x7f2b78107900 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b5ffff640 1 -- 172.21.15.45:0/4250220960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b6c004cf0 con 0x7f2b78107900 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b7d246640 1 -- 172.21.15.45:0/4250220960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b78197a90 con 0x7f2b78107900 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b5ffff640 1 -- 172.21.15.45:0/4250220960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b6c035030 con 0x7f2b78107900 2024-09-18T12:58:15.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.479+0000 7f2b7d246640 1 -- 172.21.15.45:0/4250220960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b78197fc0 con 0x7f2b78107900 2024-09-18T12:58:15.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.480+0000 7f2b7d246640 1 -- 172.21.15.45:0/4250220960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b78103040 con 0x7f2b78107900 2024-09-18T12:58:15.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.481+0000 7f2b5ffff640 1 -- 172.21.15.45:0/4250220960 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f2b6c042070 con 0x7f2b78107900 2024-09-18T12:58:15.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.481+0000 7f2b5ffff640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2b6007af30 0x7f2b6007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:15.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.481+0000 7f2b5ffff640 1 -- 172.21.15.45:0/4250220960 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6070+0+0 (secure 0 0 0) 0x7f2b6c0beb70 con 0x7f2b78107900 2024-09-18T12:58:15.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.482+0000 7f2b76d9d640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2b6007af30 0x7f2b6007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:15.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.482+0000 7f2b76d9d640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2b6007af30 0x7f2b6007d3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b68005c40 tx=0x7f2b6800a410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:15.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.486+0000 7f2b5ffff640 1 -- 172.21.15.45:0/4250220960 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2b6c08a120 con 0x7f2b78107900 2024-09-18T12:58:15.675 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-mon[109129]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:15.675 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-mon[109129]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:15.676 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-mon[109129]: pgmap v176: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/255 objects degraded (12.941%) 2024-09-18T12:58:15.676 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-mon[109129]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:15.676 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2613894099' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:15.676 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/188315127' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:58:15.676 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate[128318]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:58:15.676 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 bash[128302]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:58:15.676 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate[128318]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:58:15.676 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 bash[128302]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:58:15.676 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate[128318]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-18T12:58:15.676 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 bash[128302]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-18T12:58:15.677 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate[128318]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:58:15.677 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 bash[128302]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:58:15.677 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate[128318]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-18T12:58:15.677 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 bash[128302]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-18T12:58:15.677 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 podman[128302]: 2024-09-18 12:58:15.377312422 +0000 UTC m=+3.212874648 container died cc3cbf1f8dc37fd0de9758345713ffc56c1d53951b3cef2c7e812fa8e1820e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-18T12:58:15.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.748+0000 7f2b7d246640 1 -- 172.21.15.45:0/4250220960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2b78198d30 con 0x7f2b78107900 2024-09-18T12:58:15.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.748+0000 7f2b5ffff640 1 -- 172.21.15.45:0/4250220960 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1130 (secure 0 0 0) 0x7f2b6c08efd0 con 0x7f2b78107900 2024-09-18T12:58:15.750 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 33/255 objects degraded (12.941%), 12 pgs degraded 2024-09-18T12:58:15.750 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:58:15.750 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:58:15.750 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-18T12:58:15.750 INFO:teuthology.orchestra.run.smithi045.stdout: osd.2 (root=default,host=smithi045) is down 2024-09-18T12:58:15.750 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 33/255 objects degraded (12.941%), 12 pgs degraded 2024-09-18T12:58:15.750 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-18T12:58:15.751 INFO:teuthology.orchestra.run.smithi045.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-18T12:58:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.750+0000 7f2b7d246640 1 -- 172.21.15.45:0/4250220960 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2b6007af30 msgr2=0x7f2b6007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.750+0000 7f2b7d246640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2b6007af30 0x7f2b6007d3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b68005c40 tx=0x7f2b6800a410 comp rx=0 tx=0).stop 2024-09-18T12:58:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.750+0000 7f2b7d246640 1 -- 172.21.15.45:0/4250220960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b78107900 msgr2=0x7f2b7819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.750+0000 7f2b7d246640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b78107900 0x7f2b7819dbc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c031460 tx=0x7f2b6c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.750+0000 7f2b7d246640 1 -- 172.21.15.45:0/4250220960 shutdown_connections 2024-09-18T12:58:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.750+0000 7f2b7d246640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2b6007af30 0x7f2b6007d3f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.750+0000 7f2b7d246640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b78107900 0x7f2b7819dbc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.750+0000 7f2b7d246640 1 --2- 172.21.15.45:0/4250220960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b78101900 0x7f2b7819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:15.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.750+0000 7f2b7d246640 1 -- 172.21.15.45:0/4250220960 >> 172.21.15.45:0/4250220960 conn(0x7f2b780fd600 msgr2=0x7f2b780fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:15.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.750+0000 7f2b7d246640 1 -- 172.21.15.45:0/4250220960 shutdown_connections 2024-09-18T12:58:15.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:15.751+0000 7f2b7d246640 1 -- 172.21.15.45:0/4250220960 wait complete. 2024-09-18T12:58:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:15 smithi161 ceph-mon[80292]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:15 smithi161 ceph-mon[80292]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:15 smithi161 ceph-mon[80292]: pgmap v176: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/255 objects degraded (12.941%) 2024-09-18T12:58:15.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:15 smithi161 ceph-mon[80292]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:15.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:15 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2613894099' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:15.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:15 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/188315127' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:58:16.284 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:15 smithi045 podman[128629]: 2024-09-18 12:58:15.958173868 +0000 UTC m=+0.574281453 container remove cc3cbf1f8dc37fd0de9758345713ffc56c1d53951b3cef2c7e812fa8e1820e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:58:16.284 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:16 smithi045 podman[128713]: 2024-09-18 12:58:16.06944937 +0000 UTC m=+0.016248830 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:58:16.285 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:16 smithi045 podman[128713]: 2024-09-18 12:58:16.184390875 +0000 UTC m=+0.131190365 container create 4f620cf3977f4573e737d99fe166410fd9bda84ace9e50ae112f6b82f4761c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-18T12:58:16.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:16 smithi045 ceph-mon[109129]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:16.814 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:16 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/4250220960' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:16.814 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:16 smithi045 podman[128713]: 2024-09-18 12:58:16.40338305 +0000 UTC m=+0.350182505 container init 4f620cf3977f4573e737d99fe166410fd9bda84ace9e50ae112f6b82f4761c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS) 2024-09-18T12:58:16.814 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:16 smithi045 podman[128713]: 2024-09-18 12:58:16.406925853 +0000 UTC m=+0.353725301 container start 4f620cf3977f4573e737d99fe166410fd9bda84ace9e50ae112f6b82f4761c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-18T12:58:16.814 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:16 smithi045 ceph-osd[128733]: -- 172.21.15.45:0/4276881850 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f157f81e0 con 0x558f15788000 2024-09-18T12:58:16.814 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:16 smithi045 bash[128713]: 4f620cf3977f4573e737d99fe166410fd9bda84ace9e50ae112f6b82f4761c7a 2024-09-18T12:58:16.814 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:16 smithi045 systemd[1]: Started Ceph osd.2 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:58:16.815 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:16 smithi161 ceph-mon[80292]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:16.815 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:16 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/4250220960' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:17 smithi161 ceph-mon[80292]: pgmap v177: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/255 objects degraded (12.941%) 2024-09-18T12:58:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:17 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:17 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:17 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:17.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:17 smithi045 ceph-mon[109129]: pgmap v177: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/255 objects degraded (12.941%) 2024-09-18T12:58:17.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:17 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:17.793 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:17 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:17.794 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:17 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:18.460 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:18 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[128729]: 2024-09-18T12:58:18.287+0000 7f18c033f640 -1 Falling back to public interface 2024-09-18T12:58:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:19 smithi161 ceph-mon[80292]: pgmap v178: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/255 objects degraded (12.941%) 2024-09-18T12:58:19.995 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:19 smithi045 ceph-mon[109129]: pgmap v178: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/255 objects degraded (12.941%) 2024-09-18T12:58:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:21 smithi045 ceph-mon[109129]: pgmap v179: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/255 objects degraded (12.941%) 2024-09-18T12:58:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:21 smithi045 ceph-mon[109129]: Health check update: Degraded data redundancy: 33/255 objects degraded (12.941%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:21 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:21 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:21 smithi161 ceph-mon[80292]: pgmap v179: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/255 objects degraded (12.941%) 2024-09-18T12:58:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:21 smithi161 ceph-mon[80292]: Health check update: Degraded data redundancy: 33/255 objects degraded (12.941%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:21 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:21 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:23.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:22 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:23.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:22 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:23.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:22 smithi045 ceph-mon[109129]: pgmap v180: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/255 objects degraded (12.941%) 2024-09-18T12:58:23.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:22 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:23.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:22 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:23.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:22 smithi161 ceph-mon[80292]: pgmap v180: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/255 objects degraded (12.941%) 2024-09-18T12:58:23.902 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:23 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[128729]: 2024-09-18T12:58:23.577+0000 7f18c033f640 -1 osd.2 56 log_to_monitors true 2024-09-18T12:58:24.285 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 12:58:24 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[128729]: 2024-09-18T12:58:24.029+0000 7f18b80e9640 -1 osd.2 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:58:24.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:24 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:24.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:24 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:24.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:24 smithi045 ceph-mon[109129]: from='osd.2 [v2:172.21.15.45:6818/460629222,v1:172.21.15.45:6819/460629222]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-18T12:58:24.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:24 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:24.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:24 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:24.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:24 smithi161 ceph-mon[80292]: from='osd.2 [v2:172.21.15.45:6818/460629222,v1:172.21.15.45:6819/460629222]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-18T12:58:25.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:25 smithi045 ceph-mon[109129]: from='osd.2 [v2:172.21.15.45:6818/460629222,v1:172.21.15.45:6819/460629222]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:58:25.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:25 smithi045 ceph-mon[109129]: osdmap e59: 6 total, 5 up, 6 in 2024-09-18T12:58:25.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:25 smithi045 ceph-mon[109129]: from='osd.2 [v2:172.21.15.45:6818/460629222,v1:172.21.15.45:6819/460629222]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi045", "root=default"]} : dispatch 2024-09-18T12:58:25.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:25 smithi045 ceph-mon[109129]: pgmap v182: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 33/255 objects degraded (12.941%) 2024-09-18T12:58:25.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:25 smithi161 ceph-mon[80292]: from='osd.2 [v2:172.21.15.45:6818/460629222,v1:172.21.15.45:6819/460629222]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T12:58:25.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:25 smithi161 ceph-mon[80292]: osdmap e59: 6 total, 5 up, 6 in 2024-09-18T12:58:25.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:25 smithi161 ceph-mon[80292]: from='osd.2 [v2:172.21.15.45:6818/460629222,v1:172.21.15.45:6819/460629222]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi045", "root=default"]} : dispatch 2024-09-18T12:58:25.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:25 smithi161 ceph-mon[80292]: pgmap v182: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 33/255 objects degraded (12.941%) 2024-09-18T12:58:26.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:58:26.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: osd.2 [v2:172.21.15.45:6818/460629222,v1:172.21.15.45:6819/460629222] boot 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: osdmap e60: 6 total, 6 up, 6 in 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:26.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:58:26.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:58:26.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T12:58:26.286 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:26 smithi045 ceph-mon[109129]: osdmap e61: 6 total, 6 up, 6 in 2024-09-18T12:58:26.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:58:26.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: osd.2 [v2:172.21.15.45:6818/460629222,v1:172.21.15.45:6819/460629222] boot 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: osdmap e60: 6 total, 6 up, 6 in 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:58:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T12:58:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:26 smithi161 ceph-mon[80292]: osdmap e61: 6 total, 6 up, 6 in 2024-09-18T12:58:27.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:27 smithi045 ceph-mon[109129]: pgmap v185: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 33/255 objects degraded (12.941%) 2024-09-18T12:58:27.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:27 smithi161 ceph-mon[80292]: pgmap v185: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 33/255 objects degraded (12.941%) 2024-09-18T12:58:28.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:28 smithi045 ceph-mon[109129]: Health check update: Degraded data redundancy: 17/255 objects degraded (6.667%), 5 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:28 smithi161 ceph-mon[80292]: Health check update: Degraded data redundancy: 17/255 objects degraded (6.667%), 5 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:29 smithi045 ceph-mon[109129]: pgmap v186: 65 pgs: 4 active+undersized, 5 active+undersized+degraded, 56 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 17/255 objects degraded (6.667%) 2024-09-18T12:58:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:29 smithi161 ceph-mon[80292]: pgmap v186: 65 pgs: 4 active+undersized, 5 active+undersized+degraded, 56 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 17/255 objects degraded (6.667%) 2024-09-18T12:58:30.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:30 smithi045 ceph-mon[109129]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/255 objects degraded (6.667%), 5 pgs degraded) 2024-09-18T12:58:30.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:30 smithi161 ceph-mon[80292]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/255 objects degraded (6.667%), 5 pgs degraded) 2024-09-18T12:58:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:31 smithi045 ceph-mon[109129]: pgmap v187: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 657 B/s rd, 1 op/s 2024-09-18T12:58:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:31 smithi161 ceph-mon[80292]: pgmap v187: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 657 B/s rd, 1 op/s 2024-09-18T12:58:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:33 smithi045 ceph-mon[109129]: pgmap v188: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-18T12:58:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:33 smithi161 ceph-mon[80292]: pgmap v188: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-18T12:58:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:35 smithi045 ceph-mon[109129]: pgmap v189: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 998 B/s rd, 1 op/s 2024-09-18T12:58:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:35 smithi161 ceph-mon[80292]: pgmap v189: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 998 B/s rd, 1 op/s 2024-09-18T12:58:37.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:37 smithi045 ceph-mon[109129]: pgmap v190: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 901 B/s rd, 1 op/s 2024-09-18T12:58:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:37 smithi161 ceph-mon[80292]: pgmap v190: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 901 B/s rd, 1 op/s 2024-09-18T12:58:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:39 smithi045 ceph-mon[109129]: pgmap v191: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:58:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:39 smithi161 ceph-mon[80292]: pgmap v191: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:58:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:41 smithi161 ceph-mon[80292]: pgmap v192: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:58:41.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:58:41.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:41 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:58:41.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:41 smithi161 ceph-mon[80292]: Upgrade: osd.3 is safe to restart 2024-09-18T12:58:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:41 smithi045 ceph-mon[109129]: pgmap v192: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:58:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-18T12:58:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:41 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T12:58:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:41 smithi045 ceph-mon[109129]: Upgrade: osd.3 is safe to restart 2024-09-18T12:58:43.241 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:42 smithi161 ceph-mon[80292]: Upgrade: Updating osd.3 2024-09-18T12:58:43.241 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:42 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:43.241 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:42 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-18T12:58:43.241 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:42 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:43.241 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:42 smithi161 ceph-mon[80292]: Deploying daemon osd.3 on smithi161 2024-09-18T12:58:43.241 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:42 smithi161 ceph-mon[80292]: pgmap v193: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:58:43.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:42 smithi045 ceph-mon[109129]: Upgrade: Updating osd.3 2024-09-18T12:58:43.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:42 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:43.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:42 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-18T12:58:43.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:42 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:43.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:42 smithi045 ceph-mon[109129]: Deploying daemon osd.3 on smithi161 2024-09-18T12:58:43.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:42 smithi045 ceph-mon[109129]: pgmap v193: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:58:45.042 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:44 smithi161 systemd[1]: Stopping Ceph osd.3 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:58:45.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:45 smithi161 ceph-mon[80292]: pgmap v194: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:58:45.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:45 smithi161 ceph-mon[80292]: osd.3 marked itself down and dead 2024-09-18T12:58:45.542 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:45 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[41738]: 2024-09-18T12:58:45.111+0000 7fdb1c426640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:58:45.542 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:45 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[41738]: 2024-09-18T12:58:45.111+0000 7fdb1c426640 -1 osd.3 61 *** Got signal Terminated *** 2024-09-18T12:58:45.543 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:45 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[41738]: 2024-09-18T12:58:45.111+0000 7fdb1c426640 -1 osd.3 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:58:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:45 smithi045 ceph-mon[109129]: pgmap v194: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:58:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:45 smithi045 ceph-mon[109129]: osd.3 marked itself down and dead 2024-09-18T12:58:45.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.850+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3285517516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4074620 msgr2=0x7f39c4074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:45.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.850+0000 7f39c9b6e640 1 --2- 172.21.15.45:0/3285517516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4074620 0x7f39c4074a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009c20 tx=0x7f39b402aa00 comp rx=0 tx=0).stop 2024-09-18T12:58:45.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.850+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3285517516 shutdown_connections 2024-09-18T12:58:45.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.850+0000 7f39c9b6e640 1 --2- 172.21.15.45:0/3285517516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39c4074f40 0x7f39c410dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.850+0000 7f39c9b6e640 1 --2- 172.21.15.45:0/3285517516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4074620 0x7f39c4074a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.850+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3285517516 >> 172.21.15.45:0/3285517516 conn(0x7f39c40fd600 msgr2=0x7f39c40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.850+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3285517516 shutdown_connections 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.850+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3285517516 wait complete. 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.851+0000 7f39c9b6e640 1 Processor -- start 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.851+0000 7f39c9b6e640 1 -- start start 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c9b6e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39c4074620 0x7f39c419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c9b6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4074f40 0x7f39c419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c9b6e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f39c4110ff0 con 0x7f39c4074f40 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c9b6e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f39c4110e70 con 0x7f39c4074620 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39c4074620 0x7f39c419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4074f40 0x7f39c419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39c4074620 0x7f39c419f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:55584/0 (socket says 172.21.15.45:55584) 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c37fe640 1 -- 172.21.15.45:0/3599463326 learned_addr learned my addr 172.21.15.45:0/3599463326 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c2ffd640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4074f40 0x7f39c419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48376/0 (socket says 172.21.15.45:48376) 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c37fe640 1 -- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4074f40 msgr2=0x7f39c419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c37fe640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4074f40 0x7f39c419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c37fe640 1 -- 172.21.15.45:0/3599463326 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c41999c0 con 0x7f39c4074620 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c2ffd640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4074f40 0x7f39c419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.852+0000 7f39c37fe640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39c4074620 0x7f39c419f800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f39b4006010 tx=0x7f39b402ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.853+0000 7f39c0ff9640 1 -- 172.21.15.45:0/3599463326 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39b4047070 con 0x7f39c4074620 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.853+0000 7f39c0ff9640 1 -- 172.21.15.45:0/3599463326 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39b4003e30 con 0x7f39c4074620 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.853+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3599463326 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c4199c50 con 0x7f39c4074620 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.853+0000 7f39c0ff9640 1 -- 172.21.15.45:0/3599463326 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39b4033050 con 0x7f39c4074620 2024-09-18T12:58:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.853+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3599463326 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c419a180 con 0x7f39c4074620 2024-09-18T12:58:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.854+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3599463326 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c4075cd0 con 0x7f39c4074620 2024-09-18T12:58:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.854+0000 7f39c0ff9640 1 -- 172.21.15.45:0/3599463326 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f39b404a070 con 0x7f39c4074620 2024-09-18T12:58:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.855+0000 7f39c0ff9640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f39ac07af40 0x7f39ac07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:45.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.855+0000 7f39c0ff9640 1 -- 172.21.15.45:0/3599463326 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f39b403e030 con 0x7f39c4074620 2024-09-18T12:58:45.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.855+0000 7f39c2ffd640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f39ac07af40 0x7f39ac07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:45.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.856+0000 7f39c2ffd640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f39ac07af40 0x7f39ac07d400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39c410ac30 tx=0x7f39b8005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:45.860+0000 7f39c0ff9640 1 -- 172.21.15.45:0/3599463326 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f39b40c3070 con 0x7f39c4074620 2024-09-18T12:58:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.062+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3599463326 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f39c419aef0 con 0x7f39ac07af40 2024-09-18T12:58:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.064+0000 7f39c0ff9640 1 -- 172.21.15.45:0/3599463326 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f39c419aef0 con 0x7f39ac07af40 2024-09-18T12:58:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f39ac07af40 msgr2=0x7f39ac07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f39ac07af40 0x7f39ac07d400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39c410ac30 tx=0x7f39b8005f90 comp rx=0 tx=0).stop 2024-09-18T12:58:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3599463326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39c4074620 msgr2=0x7f39c419f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39c4074620 0x7f39c419f800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f39b4006010 tx=0x7f39b402ed20 comp rx=0 tx=0).stop 2024-09-18T12:58:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3599463326 shutdown_connections 2024-09-18T12:58:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f39ac07af40 0x7f39ac07d400 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4074f40 0x7f39c419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 --2- 172.21.15.45:0/3599463326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39c4074620 0x7f39c419f800 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3599463326 >> 172.21.15.45:0/3599463326 conn(0x7f39c40fd600 msgr2=0x7f39c410b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3599463326 shutdown_connections 2024-09-18T12:58:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.066+0000 7f39c9b6e640 1 -- 172.21.15.45:0/3599463326 wait complete. 2024-09-18T12:58:46.076 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:58:46.105 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:45 smithi161 podman[87810]: 2024-09-18 12:58:45.824099468 +0000 UTC m=+0.875034089 container died 41557e656aaa6cc5e87e6fbe4e103f9ffb1296cc15a5df78a0ee089c00dc6851 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-18T12:58:46.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.151+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/3050532949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a44103480 msgr2=0x7f6a4410b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.151+0000 7f6a4bbb2640 1 --2- 172.21.15.45:0/3050532949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a44103480 0x7f6a4410b970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009880 tx=0x7f6a3402a530 comp rx=0 tx=0).stop 2024-09-18T12:58:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.152+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/3050532949 shutdown_connections 2024-09-18T12:58:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.152+0000 7f6a4bbb2640 1 --2- 172.21.15.45:0/3050532949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a44103480 0x7f6a4410b970 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.152+0000 7f6a4bbb2640 1 --2- 172.21.15.45:0/3050532949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a44102b60 0x7f6a44102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.152+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/3050532949 >> 172.21.15.45:0/3050532949 conn(0x7f6a440fc520 msgr2=0x7f6a440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.152+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/3050532949 shutdown_connections 2024-09-18T12:58:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.152+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/3050532949 wait complete. 2024-09-18T12:58:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.152+0000 7f6a4bbb2640 1 Processor -- start 2024-09-18T12:58:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.152+0000 7f6a4bbb2640 1 -- start start 2024-09-18T12:58:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4bbb2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a44102b60 0x7f6a441007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4bbb2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a44103480 0x7f6a44100d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4bbb2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4410edf0 con 0x7f6a44103480 2024-09-18T12:58:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4bbb2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4410ec70 con 0x7f6a44102b60 2024-09-18T12:58:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4914d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a44103480 0x7f6a44100d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4914d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a44103480 0x7f6a44100d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48400/0 (socket says 172.21.15.45:48400) 2024-09-18T12:58:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4914d640 1 -- 172.21.15.45:0/2710291724 learned_addr learned my addr 172.21.15.45:0/2710291724 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4994e640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a44102b60 0x7f6a441007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4914d640 1 -- 172.21.15.45:0/2710291724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a44102b60 msgr2=0x7f6a441007c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4914d640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a44102b60 0x7f6a441007c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4914d640 1 -- 172.21.15.45:0/2710291724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a44101240 con 0x7f6a44103480 2024-09-18T12:58:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.153+0000 7f6a4914d640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a44103480 0x7f6a44100d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6a34004f90 tx=0x7f6a340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.154+0000 7f6a3affd640 1 -- 172.21.15.45:0/2710291724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a3403f070 con 0x7f6a44103480 2024-09-18T12:58:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.154+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/2710291724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a441014d0 con 0x7f6a44103480 2024-09-18T12:58:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.154+0000 7f6a3affd640 1 -- 172.21.15.45:0/2710291724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a34004c70 con 0x7f6a44103480 2024-09-18T12:58:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.154+0000 7f6a3affd640 1 -- 172.21.15.45:0/2710291724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a34035030 con 0x7f6a44103480 2024-09-18T12:58:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.154+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/2710291724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a441a3e60 con 0x7f6a44103480 2024-09-18T12:58:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.155+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/2710291724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4406a9f0 con 0x7f6a44103480 2024-09-18T12:58:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.156+0000 7f6a3affd640 1 -- 172.21.15.45:0/2710291724 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f6a34042070 con 0x7f6a44103480 2024-09-18T12:58:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.156+0000 7f6a3affd640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6a3007af80 0x7f6a3007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.156+0000 7f6a3affd640 1 -- 172.21.15.45:0/2710291724 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6070+0+0 (secure 0 0 0) 0x7f6a340be8f0 con 0x7f6a44103480 2024-09-18T12:58:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.156+0000 7f6a4994e640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6a3007af80 0x7f6a3007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.157+0000 7f6a4994e640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6a3007af80 0x7f6a3007d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005fd0 tx=0x7f6a40005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.161+0000 7f6a3affd640 1 -- 172.21.15.45:0/2710291724 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6a34089fc0 con 0x7f6a44103480 2024-09-18T12:58:46.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.379+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/2710291724 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6a44062630 con 0x7f6a3007af80 2024-09-18T12:58:46.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.380+0000 7f6a3affd640 1 -- 172.21.15.45:0/2710291724 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f6a44062630 con 0x7f6a3007af80 2024-09-18T12:58:46.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/2710291724 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6a3007af80 msgr2=0x7f6a3007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6a3007af80 0x7f6a3007d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005fd0 tx=0x7f6a40005850 comp rx=0 tx=0).stop 2024-09-18T12:58:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/2710291724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a44103480 msgr2=0x7f6a44100d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a44103480 0x7f6a44100d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6a34004f90 tx=0x7f6a340048f0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/2710291724 shutdown_connections 2024-09-18T12:58:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6a3007af80 0x7f6a3007d440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a44103480 0x7f6a44100d00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 --2- 172.21.15.45:0/2710291724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a44102b60 0x7f6a441007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/2710291724 >> 172.21.15.45:0/2710291724 conn(0x7f6a440fc520 msgr2=0x7f6a44103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/2710291724 shutdown_connections 2024-09-18T12:58:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.382+0000 7f6a4bbb2640 1 -- 172.21.15.45:0/2710291724 wait complete. 2024-09-18T12:58:46.447 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:46 smithi161 ceph-mon[80292]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:58:46.447 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:46 smithi161 ceph-mon[80292]: osdmap e62: 6 total, 5 up, 6 in 2024-09-18T12:58:46.447 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:46 smithi161 podman[87810]: 2024-09-18 12:58:46.195694739 +0000 UTC m=+1.246629409 container cleanup 41557e656aaa6cc5e87e6fbe4e103f9ffb1296cc15a5df78a0ee089c00dc6851 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-09-18T12:58:46.448 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:46 smithi161 bash[87810]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3 2024-09-18T12:58:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.466+0000 7ff74605a640 1 -- 172.21.15.45:0/621837096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff740107910 msgr2=0x7ff740107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.466+0000 7ff74605a640 1 --2- 172.21.15.45:0/621837096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff740107910 0x7ff740107cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff730009880 tx=0x7ff73002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.466+0000 7ff74605a640 1 -- 172.21.15.45:0/621837096 shutdown_connections 2024-09-18T12:58:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.466+0000 7ff74605a640 1 --2- 172.21.15.45:0/621837096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff740101910 0x7ff740101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.466+0000 7ff74605a640 1 --2- 172.21.15.45:0/621837096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff740107910 0x7ff740107cf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.466+0000 7ff74605a640 1 -- 172.21.15.45:0/621837096 >> 172.21.15.45:0/621837096 conn(0x7ff7400fd630 msgr2=0x7ff7400ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:46.468 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:46 smithi045 ceph-mon[109129]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:58:46.468 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:46 smithi045 ceph-mon[109129]: osdmap e62: 6 total, 5 up, 6 in 2024-09-18T12:58:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.467+0000 7ff74605a640 1 -- 172.21.15.45:0/621837096 shutdown_connections 2024-09-18T12:58:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.467+0000 7ff74605a640 1 -- 172.21.15.45:0/621837096 wait complete. 2024-09-18T12:58:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.467+0000 7ff74605a640 1 Processor -- start 2024-09-18T12:58:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.467+0000 7ff74605a640 1 -- start start 2024-09-18T12:58:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff74605a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff740101910 0x7ff7400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff74605a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff740107910 0x7ff740074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff74605a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff74010ede0 con 0x7ff740107910 2024-09-18T12:58:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff74605a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7ff74010ec60 con 0x7ff740101910 2024-09-18T12:58:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff73effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff740107910 0x7ff740074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff73f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff740101910 0x7ff7400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff73effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff740107910 0x7ff740074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48420/0 (socket says 172.21.15.45:48420) 2024-09-18T12:58:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff73effd640 1 -- 172.21.15.45:0/3741500375 learned_addr learned my addr 172.21.15.45:0/3741500375 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff73effd640 1 -- 172.21.15.45:0/3741500375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff740101910 msgr2=0x7ff7400744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff73effd640 1 --2- 172.21.15.45:0/3741500375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff740101910 0x7ff7400744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff73effd640 1 -- 172.21.15.45:0/3741500375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff740074f70 con 0x7ff740107910 2024-09-18T12:58:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.468+0000 7ff73effd640 1 --2- 172.21.15.45:0/3741500375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff740107910 0x7ff740074a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff73400e970 tx=0x7ff73400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.469+0000 7ff73cff9640 1 -- 172.21.15.45:0/3741500375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff73400cac0 con 0x7ff740107910 2024-09-18T12:58:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.469+0000 7ff74605a640 1 -- 172.21.15.45:0/3741500375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff740075260 con 0x7ff740107910 2024-09-18T12:58:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.469+0000 7ff73cff9640 1 -- 172.21.15.45:0/3741500375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7340054e0 con 0x7ff740107910 2024-09-18T12:58:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.469+0000 7ff73cff9640 1 -- 172.21.15.45:0/3741500375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff734010430 con 0x7ff740107910 2024-09-18T12:58:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.469+0000 7ff74605a640 1 -- 172.21.15.45:0/3741500375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7401a3e00 con 0x7ff740107910 2024-09-18T12:58:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.470+0000 7ff74605a640 1 -- 172.21.15.45:0/3741500375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff740103050 con 0x7ff740107910 2024-09-18T12:58:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.471+0000 7ff73cff9640 1 -- 172.21.15.45:0/3741500375 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7ff734004e80 con 0x7ff740107910 2024-09-18T12:58:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.471+0000 7ff73cff9640 1 --2- 172.21.15.45:0/3741500375 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff72807af30 0x7ff72807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.471+0000 7ff73cff9640 1 -- 172.21.15.45:0/3741500375 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6070+0+0 (secure 0 0 0) 0x7ff73409e600 con 0x7ff740107910 2024-09-18T12:58:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.471+0000 7ff73f7fe640 1 --2- 172.21.15.45:0/3741500375 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff72807af30 0x7ff72807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.472+0000 7ff73f7fe640 1 --2- 172.21.15.45:0/3741500375 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff72807af30 0x7ff72807d3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff7300096c0 tx=0x7ff730031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:46.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.476+0000 7ff73cff9640 1 -- 172.21.15.45:0/3741500375 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff734069c50 con 0x7ff740107910 2024-09-18T12:58:46.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.672+0000 7ff74605a640 1 -- 172.21.15.45:0/3741500375 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff740062630 con 0x7ff72807af30 2024-09-18T12:58:46.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.682+0000 7ff73cff9640 1 -- 172.21.15.45:0/3741500375 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7ff740062630 con 0x7ff72807af30 2024-09-18T12:58:46.683 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:58:46.684 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (3m) 25s ago 14m 20.0M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T12:58:46.684 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (6m) 25s ago 14m 8975k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:58:46.684 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (6m) 2m ago 14m 8346k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:58:46.684 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (2m) 25s ago 14m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T12:58:46.684 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (2m) 2m ago 14m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T12:58:46.684 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (3m) 25s ago 14m 79.3M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T12:58:46.684 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (9m) 25s ago 9m 92.1M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:58:46.684 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (9m) 25s ago 9m 148M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:58:46.684 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (9m) 2m ago 9m 17.4M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:58:46.684 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (9m) 2m ago 9m 15.9M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (6m) 25s ago 16m 524M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (5m) 2m ago 13m 457M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (2m) 25s ago 16m 42.6M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (2m) 2m ago 13m 25.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (4m) 25s ago 14m 11.3M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (4m) 2m ago 13m 11.1M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (103s) 25s ago 12m 84.1M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (67s) 25s ago 12m 89.2M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 7d4cd0351725 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (30s) 25s ago 11m 12.2M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4f620cf3977f 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (11m) 2m ago 11m 243M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 41557e656aaa 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (10m) 2m ago 10m 215M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:58:46.685 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (10m) 2m ago 10m 200M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:58:46.686 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (4m) 25s ago 14m 54.1M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:58:46.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 -- 172.21.15.45:0/3741500375 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff72807af30 msgr2=0x7ff72807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 --2- 172.21.15.45:0/3741500375 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff72807af30 0x7ff72807d3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff7300096c0 tx=0x7ff730031400 comp rx=0 tx=0).stop 2024-09-18T12:58:46.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 -- 172.21.15.45:0/3741500375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff740107910 msgr2=0x7ff740074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 --2- 172.21.15.45:0/3741500375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff740107910 0x7ff740074a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff73400e970 tx=0x7ff73400ed70 comp rx=0 tx=0).stop 2024-09-18T12:58:46.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 -- 172.21.15.45:0/3741500375 shutdown_connections 2024-09-18T12:58:46.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 --2- 172.21.15.45:0/3741500375 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7ff72807af30 0x7ff72807d3f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 --2- 172.21.15.45:0/3741500375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff740107910 0x7ff740074a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 --2- 172.21.15.45:0/3741500375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff740101910 0x7ff7400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 -- 172.21.15.45:0/3741500375 >> 172.21.15.45:0/3741500375 conn(0x7ff7400fd630 msgr2=0x7ff7400fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:46.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 -- 172.21.15.45:0/3741500375 shutdown_connections 2024-09-18T12:58:46.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.685+0000 7ff74605a640 1 -- 172.21.15.45:0/3741500375 wait complete. 2024-09-18T12:58:46.757 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:46 smithi161 podman[87837]: 2024-09-18 12:58:46.446991287 +0000 UTC m=+0.625846998 container remove 41557e656aaa6cc5e87e6fbe4e103f9ffb1296cc15a5df78a0ee089c00dc6851 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-18T12:58:46.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.769+0000 7f043e919640 1 -- 172.21.15.45:0/1765195396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0438101900 msgr2=0x7f0438101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.769+0000 7f043e919640 1 --2- 172.21.15.45:0/1765195396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0438101900 0x7f0438101d60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f042c009880 tx=0x7f042c02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.769+0000 7f043e919640 1 -- 172.21.15.45:0/1765195396 shutdown_connections 2024-09-18T12:58:46.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.769+0000 7f043e919640 1 --2- 172.21.15.45:0/1765195396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0438101900 0x7f0438101d60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.769+0000 7f043e919640 1 --2- 172.21.15.45:0/1765195396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0438107900 0x7f0438107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.769+0000 7f043e919640 1 -- 172.21.15.45:0/1765195396 >> 172.21.15.45:0/1765195396 conn(0x7f04380fd5e0 msgr2=0x7f04380ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:46.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.769+0000 7f043e919640 1 -- 172.21.15.45:0/1765195396 shutdown_connections 2024-09-18T12:58:46.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.769+0000 7f043e919640 1 -- 172.21.15.45:0/1765195396 wait complete. 2024-09-18T12:58:46.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.769+0000 7f043e919640 1 Processor -- start 2024-09-18T12:58:46.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.769+0000 7f043e919640 1 -- start start 2024-09-18T12:58:46.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f043e919640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0438101900 0x7f04380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:46.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f043e919640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0438107900 0x7f0438074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:46.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f043e919640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f043810edd0 con 0x7f0438107900 2024-09-18T12:58:46.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f043e919640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f043810ec50 con 0x7f0438101900 2024-09-18T12:58:46.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f04377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0438107900 0x7f0438074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:46.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f04377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0438107900 0x7f0438074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48434/0 (socket says 172.21.15.45:48434) 2024-09-18T12:58:46.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f04377fe640 1 -- 172.21.15.45:0/1331677639 learned_addr learned my addr 172.21.15.45:0/1331677639 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f0437fff640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0438101900 0x7f04380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f04377fe640 1 -- 172.21.15.45:0/1331677639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0438101900 msgr2=0x7f04380744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f04377fe640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0438101900 0x7f04380744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f04377fe640 1 -- 172.21.15.45:0/1331677639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0438074f70 con 0x7f0438107900 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.770+0000 7f0437fff640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0438101900 0x7f04380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.771+0000 7f04377fe640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0438107900 0x7f0438074a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f042c031460 tx=0x7f042c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.771+0000 7f04357fa640 1 -- 172.21.15.45:0/1331677639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f042c03f070 con 0x7f0438107900 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.771+0000 7f04357fa640 1 -- 172.21.15.45:0/1331677639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f042c0035f0 con 0x7f0438107900 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.771+0000 7f043e919640 1 -- 172.21.15.45:0/1331677639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0438075200 con 0x7f0438107900 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.771+0000 7f043e919640 1 -- 172.21.15.45:0/1331677639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04381a3d60 con 0x7f0438107900 2024-09-18T12:58:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.771+0000 7f04357fa640 1 -- 172.21.15.45:0/1331677639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f042c035030 con 0x7f0438107900 2024-09-18T12:58:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.772+0000 7f043e919640 1 -- 172.21.15.45:0/1331677639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0438103040 con 0x7f0438107900 2024-09-18T12:58:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.773+0000 7f04357fa640 1 -- 172.21.15.45:0/1331677639 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f042c042070 con 0x7f0438107900 2024-09-18T12:58:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.773+0000 7f04357fa640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f042007af30 0x7f042007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.773+0000 7f0437fff640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f042007af30 0x7f042007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.773+0000 7f04357fa640 1 -- 172.21.15.45:0/1331677639 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6070+0+0 (secure 0 0 0) 0x7f042c0be890 con 0x7f0438107900 2024-09-18T12:58:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.774+0000 7f0437fff640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f042007af30 0x7f042007d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0428009fc0 tx=0x7f0428005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:46.778+0000 7f04357fa640 1 -- 172.21.15.45:0/1331677639 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f042c089ee0 con 0x7f0438107900 2024-09-18T12:58:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.037+0000 7f043e919640 1 -- 172.21.15.45:0/1331677639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0438109e70 con 0x7f0438107900 2024-09-18T12:58:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.038+0000 7f04357fa640 1 -- 172.21.15.45:0/1331677639 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f042c08c400 con 0x7f0438107900 2024-09-18T12:58:47.039 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2, 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 3 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:58:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:58:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:58:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6, 2024-09-18T12:58:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 7 2024-09-18T12:58:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:58:47.041 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:58:47.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.040+0000 7f043e919640 1 -- 172.21.15.45:0/1331677639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f042007af30 msgr2=0x7f042007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.040+0000 7f043e919640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f042007af30 0x7f042007d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0428009fc0 tx=0x7f0428005f90 comp rx=0 tx=0).stop 2024-09-18T12:58:47.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.040+0000 7f043e919640 1 -- 172.21.15.45:0/1331677639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0438107900 msgr2=0x7f0438074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.040+0000 7f043e919640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0438107900 0x7f0438074a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f042c031460 tx=0x7f042c004530 comp rx=0 tx=0).stop 2024-09-18T12:58:47.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.041+0000 7f043e919640 1 -- 172.21.15.45:0/1331677639 shutdown_connections 2024-09-18T12:58:47.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.041+0000 7f043e919640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f042007af30 0x7f042007d3f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.041+0000 7f043e919640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0438107900 0x7f0438074a30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.041+0000 7f043e919640 1 --2- 172.21.15.45:0/1331677639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0438101900 0x7f04380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.041+0000 7f043e919640 1 -- 172.21.15.45:0/1331677639 >> 172.21.15.45:0/1331677639 conn(0x7f04380fd5e0 msgr2=0x7f04380fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:47.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.041+0000 7f043e919640 1 -- 172.21.15.45:0/1331677639 shutdown_connections 2024-09-18T12:58:47.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.041+0000 7f043e919640 1 -- 172.21.15.45:0/1331677639 wait complete. 2024-09-18T12:58:47.043 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:46 smithi161 podman[87925]: 2024-09-18 12:58:46.659423617 +0000 UTC m=+0.015737604 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:58:47.043 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:46 smithi161 podman[87925]: 2024-09-18 12:58:46.813719497 +0000 UTC m=+0.170033477 container create 821638ecdbe84fe79a40cb6b3a79d58c142dce0d130e85bee5b30a264fa3a287 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-18T12:58:47.043 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:47 smithi161 podman[87925]: 2024-09-18 12:58:47.042108669 +0000 UTC m=+0.398422656 container init 821638ecdbe84fe79a40cb6b3a79d58c142dce0d130e85bee5b30a264fa3a287 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:58:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.124+0000 7f75d6c1b640 1 -- 172.21.15.45:0/965079508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d01007f0 msgr2=0x7f75d0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.124+0000 7f75d6c1b640 1 --2- 172.21.15.45:0/965079508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d01007f0 0x7f75d0100c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009880 tx=0x7f75bc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 -- 172.21.15.45:0/965079508 shutdown_connections 2024-09-18T12:58:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 --2- 172.21.15.45:0/965079508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d01007f0 0x7f75d0100c50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 --2- 172.21.15.45:0/965079508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d01067f0 0x7f75d0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 -- 172.21.15.45:0/965079508 >> 172.21.15.45:0/965079508 conn(0x7f75d00fc550 msgr2=0x7f75d00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 -- 172.21.15.45:0/965079508 shutdown_connections 2024-09-18T12:58:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 -- 172.21.15.45:0/965079508 wait complete. 2024-09-18T12:58:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 Processor -- start 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 -- start start 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d01007f0 0x7f75d019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d01067f0 0x7f75d019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f75d010dca0 con 0x7f75d01007f0 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.125+0000 7f75d6c1b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f75d010db20 con 0x7f75d01067f0 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75d49b7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d01007f0 0x7f75d019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75d49b7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d01007f0 0x7f75d019d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48458/0 (socket says 172.21.15.45:48458) 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75d49b7640 1 -- 172.21.15.45:0/3882945805 learned_addr learned my addr 172.21.15.45:0/3882945805 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75cffff640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d01067f0 0x7f75d019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75d49b7640 1 -- 172.21.15.45:0/3882945805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d01067f0 msgr2=0x7f75d019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75d49b7640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d01067f0 0x7f75d019db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75d49b7640 1 -- 172.21.15.45:0/3882945805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d0197780 con 0x7f75d01007f0 2024-09-18T12:58:47.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75d49b7640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d01007f0 0x7f75d019d600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f75c400d8d0 tx=0x7f75c400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:47.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75cdffb640 1 -- 172.21.15.45:0/3882945805 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75c4017070 con 0x7f75d01007f0 2024-09-18T12:58:47.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75cdffb640 1 -- 172.21.15.45:0/3882945805 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75c4010460 con 0x7f75d01007f0 2024-09-18T12:58:47.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75d6c1b640 1 -- 172.21.15.45:0/3882945805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d0197a70 con 0x7f75d01007f0 2024-09-18T12:58:47.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.126+0000 7f75cdffb640 1 -- 172.21.15.45:0/3882945805 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75c400f5f0 con 0x7f75d01007f0 2024-09-18T12:58:47.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.127+0000 7f75d6c1b640 1 -- 172.21.15.45:0/3882945805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d0197fd0 con 0x7f75d01007f0 2024-09-18T12:58:47.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.127+0000 7f75d6c1b640 1 -- 172.21.15.45:0/3882945805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d0101f30 con 0x7f75d01007f0 2024-09-18T12:58:47.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.128+0000 7f75cdffb640 1 -- 172.21.15.45:0/3882945805 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f75c4009a30 con 0x7f75d01007f0 2024-09-18T12:58:47.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.129+0000 7f75cdffb640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f75c007af90 0x7f75c007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.129+0000 7f75cffff640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f75c007af90 0x7f75c007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.129+0000 7f75cdffb640 1 -- 172.21.15.45:0/3882945805 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6070+0+0 (secure 0 0 0) 0x7f75c409dcf0 con 0x7f75d01007f0 2024-09-18T12:58:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.129+0000 7f75cffff640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f75c007af90 0x7f75c007d450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f75d0198ad0 tx=0x7f75bc031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:47.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.133+0000 7f75cdffb640 1 -- 172.21.15.45:0/3882945805 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f75c40693c0 con 0x7f75d01007f0 2024-09-18T12:58:47.309 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:47 smithi161 podman[87925]: 2024-09-18 12:58:47.045362934 +0000 UTC m=+0.401676920 container start 821638ecdbe84fe79a40cb6b3a79d58c142dce0d130e85bee5b30a264fa3a287 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:58:47.309 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:47 smithi161 podman[87925]: 2024-09-18 12:58:47.142055347 +0000 UTC m=+0.498369339 container attach 821638ecdbe84fe79a40cb6b3a79d58c142dce0d130e85bee5b30a264fa3a287 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-18T12:58:47.309 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:47 smithi161 podman[87925]: 2024-09-18 12:58:47.23550929 +0000 UTC m=+0.591823276 container died 821638ecdbe84fe79a40cb6b3a79d58c142dce0d130e85bee5b30a264fa3a287 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-18T12:58:47.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.358+0000 7f75d6c1b640 1 -- 172.21.15.45:0/3882945805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f75d0109d90 con 0x7f75d01007f0 2024-09-18T12:58:47.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.358+0000 7f75cdffb640 1 -- 172.21.15.45:0/3882945805 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2046 (secure 0 0 0) 0x7f75c406e270 con 0x7f75d01007f0 2024-09-18T12:58:47.360 INFO:teuthology.orchestra.run.smithi045.stdout:e16 2024-09-18T12:58:47.360 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T12:49:30:966010+0000 2024-09-18T12:58:47.360 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:58:47.360 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:58:47.360 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T12:58:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:58:47.360 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 14 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T12:49:28.960615+0000 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T12:58:47.361 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=14566} 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T12:58:47.362 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T12:58:47.363 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T12:58:47.363 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 14566 members: 14566 2024-09-18T12:58:47.363 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:47.363 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:58:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:58:47.363 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T12:58:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:58:47.363 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:47.363 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:58:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2024-09-18T12:58:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 -- 172.21.15.45:0/3882945805 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f75c007af90 msgr2=0x7f75c007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f75c007af90 0x7f75c007d450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f75d0198ad0 tx=0x7f75bc031400 comp rx=0 tx=0).stop 2024-09-18T12:58:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 -- 172.21.15.45:0/3882945805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d01007f0 msgr2=0x7f75d019d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d01007f0 0x7f75d019d600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f75c400d8d0 tx=0x7f75c400dd90 comp rx=0 tx=0).stop 2024-09-18T12:58:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 -- 172.21.15.45:0/3882945805 shutdown_connections 2024-09-18T12:58:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f75c007af90 0x7f75c007d450 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d01067f0 0x7f75d019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 --2- 172.21.15.45:0/3882945805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d01007f0 0x7f75d019d600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 -- 172.21.15.45:0/3882945805 >> 172.21.15.45:0/3882945805 conn(0x7f75d00fc550 msgr2=0x7f75d0069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 -- 172.21.15.45:0/3882945805 shutdown_connections 2024-09-18T12:58:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.361+0000 7f75d6c1b640 1 -- 172.21.15.45:0/3882945805 wait complete. 2024-09-18T12:58:47.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.447+0000 7f6d07651640 1 -- 172.21.15.45:0/2584892236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d000ffdc0 msgr2=0x7f6d00100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.447+0000 7f6d07651640 1 --2- 172.21.15.45:0/2584892236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d000ffdc0 0x7f6d00100220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009880 tx=0x7f6cf002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.447+0000 7f6d07651640 1 -- 172.21.15.45:0/2584892236 shutdown_connections 2024-09-18T12:58:47.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.447+0000 7f6d07651640 1 --2- 172.21.15.45:0/2584892236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d000ffdc0 0x7f6d00100220 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.447+0000 7f6d07651640 1 --2- 172.21.15.45:0/2584892236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d001069a0 0x7f6d00106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.447+0000 7f6d07651640 1 -- 172.21.15.45:0/2584892236 >> 172.21.15.45:0/2584892236 conn(0x7f6d000fbc90 msgr2=0x7f6d000fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:47.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.447+0000 7f6d07651640 1 -- 172.21.15.45:0/2584892236 shutdown_connections 2024-09-18T12:58:47.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.447+0000 7f6d07651640 1 -- 172.21.15.45:0/2584892236 wait complete. 2024-09-18T12:58:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.447+0000 7f6d07651640 1 Processor -- start 2024-09-18T12:58:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d07651640 1 -- start start 2024-09-18T12:58:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d07651640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d000ffdc0 0x7f6d0019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d07651640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d001069a0 0x7f6d0019dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d07651640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0010ef40 con 0x7f6d001069a0 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d07651640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0010edc0 con 0x7f6d000ffdc0 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d04bec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d001069a0 0x7f6d0019dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d04bec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d001069a0 0x7f6d0019dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48474/0 (socket says 172.21.15.45:48474) 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d04bec640 1 -- 172.21.15.45:0/1717554378 learned_addr learned my addr 172.21.15.45:0/1717554378 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d053ed640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d000ffdc0 0x7f6d0019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d04bec640 1 -- 172.21.15.45:0/1717554378 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d000ffdc0 msgr2=0x7f6d0019d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d04bec640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d000ffdc0 0x7f6d0019d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d04bec640 1 -- 172.21.15.45:0/1717554378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d001978d0 con 0x7f6d001069a0 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.448+0000 7f6d04bec640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d001069a0 0x7f6d0019dc50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0031460 tx=0x7f6cf00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.449+0000 7f6cf67fc640 1 -- 172.21.15.45:0/1717554378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6cf003f070 con 0x7f6d001069a0 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.449+0000 7f6cf67fc640 1 -- 172.21.15.45:0/1717554378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6cf00035f0 con 0x7f6d001069a0 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.449+0000 7f6d07651640 1 -- 172.21.15.45:0/1717554378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d00197b60 con 0x7f6d001069a0 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.449+0000 7f6cf67fc640 1 -- 172.21.15.45:0/1717554378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6cf0035030 con 0x7f6d001069a0 2024-09-18T12:58:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.449+0000 7f6d07651640 1 -- 172.21.15.45:0/1717554378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d00198090 con 0x7f6d001069a0 2024-09-18T12:58:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.450+0000 7f6d07651640 1 -- 172.21.15.45:0/1717554378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d001030e0 con 0x7f6d001069a0 2024-09-18T12:58:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.451+0000 7f6cf67fc640 1 -- 172.21.15.45:0/1717554378 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f6cf0042070 con 0x7f6d001069a0 2024-09-18T12:58:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.451+0000 7f6cf67fc640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cec07af30 0x7f6cec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:47.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.451+0000 7f6cf67fc640 1 -- 172.21.15.45:0/1717554378 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6070+0+0 (secure 0 0 0) 0x7f6cf00be920 con 0x7f6d001069a0 2024-09-18T12:58:47.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.451+0000 7f6d053ed640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cec07af30 0x7f6cec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:47.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.452+0000 7f6d053ed640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cec07af30 0x7f6cec07d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6d00198a10 tx=0x7f6cfc00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.456+0000 7f6cf67fc640 1 -- 172.21.15.45:0/1717554378 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6cf0089f70 con 0x7f6d001069a0 2024-09-18T12:58:47.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.657+0000 7f6d07651640 1 -- 172.21.15.45:0/1717554378 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6d00198e00 con 0x7f6cec07af30 2024-09-18T12:58:47.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:47 smithi045 ceph-mon[109129]: from='client.44195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:47.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:47 smithi045 ceph-mon[109129]: pgmap v196: 65 pgs: 16 stale+active+clean, 49 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-18T12:58:47.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:47 smithi045 ceph-mon[109129]: osdmap e63: 6 total, 5 up, 6 in 2024-09-18T12:58:47.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:47 smithi045 ceph-mon[109129]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:47.660 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:47 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1331677639' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:47.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.659+0000 7f6cf67fc640 1 -- 172.21.15.45:0/1717554378 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f6d00198e00 con 0x7f6cec07af30 2024-09-18T12:58:47.660 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr", 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "mon", 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "crash" 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "9/23 daemons upgraded", 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:58:47.661 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:58:47.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 -- 172.21.15.45:0/1717554378 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cec07af30 msgr2=0x7f6cec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cec07af30 0x7f6cec07d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6d00198a10 tx=0x7f6cfc00b390 comp rx=0 tx=0).stop 2024-09-18T12:58:47.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 -- 172.21.15.45:0/1717554378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d001069a0 msgr2=0x7f6d0019dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d001069a0 0x7f6d0019dc50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0031460 tx=0x7f6cf00045e0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 -- 172.21.15.45:0/1717554378 shutdown_connections 2024-09-18T12:58:47.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cec07af30 0x7f6cec07d3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d001069a0 0x7f6d0019dc50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 --2- 172.21.15.45:0/1717554378 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d000ffdc0 0x7f6d0019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 -- 172.21.15.45:0/1717554378 >> 172.21.15.45:0/1717554378 conn(0x7f6d000fbc90 msgr2=0x7f6d000fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:47.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 -- 172.21.15.45:0/1717554378 shutdown_connections 2024-09-18T12:58:47.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.661+0000 7f6d07651640 1 -- 172.21.15.45:0/1717554378 wait complete. 2024-09-18T12:58:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.751+0000 7f992018f640 1 -- 172.21.15.45:0/1801364805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99181007f0 msgr2=0x7f9918100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.751+0000 7f992018f640 1 --2- 172.21.15.45:0/1801364805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99181007f0 0x7f9918100c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9908009880 tx=0x7f990802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.751+0000 7f992018f640 1 -- 172.21.15.45:0/1801364805 shutdown_connections 2024-09-18T12:58:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.751+0000 7f992018f640 1 --2- 172.21.15.45:0/1801364805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99181007f0 0x7f9918100c50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.752+0000 7f992018f640 1 --2- 172.21.15.45:0/1801364805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99181067f0 0x7f9918106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.752+0000 7f992018f640 1 -- 172.21.15.45:0/1801364805 >> 172.21.15.45:0/1801364805 conn(0x7f99180fc550 msgr2=0x7f99180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.752+0000 7f992018f640 1 -- 172.21.15.45:0/1801364805 shutdown_connections 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.752+0000 7f992018f640 1 -- 172.21.15.45:0/1801364805 wait complete. 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.752+0000 7f992018f640 1 Processor -- start 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.752+0000 7f992018f640 1 -- start start 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f992018f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99181007f0 0x7f99180fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f992018f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99181067f0 0x7f99180fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f992018f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f991810dcc0 con 0x7f99181067f0 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f992018f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f991810db40 con 0x7f99181007f0 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f991d72a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99181067f0 0x7f99180fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f991d72a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99181067f0 0x7f99180fd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48506/0 (socket says 172.21.15.45:48506) 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f991d72a640 1 -- 172.21.15.45:0/1156931845 learned_addr learned my addr 172.21.15.45:0/1156931845 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:58:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f991df2b640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99181007f0 0x7f99180fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f991d72a640 1 -- 172.21.15.45:0/1156931845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99181007f0 msgr2=0x7f99180fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f991d72a640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99181007f0 0x7f99180fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f991d72a640 1 -- 172.21.15.45:0/1156931845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99180fd750 con 0x7f99181067f0 2024-09-18T12:58:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f991d72a640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99181067f0 0x7f99180fd210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9908031460 tx=0x7f99080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f990effd640 1 -- 172.21.15.45:0/1156931845 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f990803f070 con 0x7f99181067f0 2024-09-18T12:58:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f990effd640 1 -- 172.21.15.45:0/1156931845 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f99080035f0 con 0x7f99181067f0 2024-09-18T12:58:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.753+0000 7f992018f640 1 -- 172.21.15.45:0/1156931845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99180fd9e0 con 0x7f99181067f0 2024-09-18T12:58:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.754+0000 7f990effd640 1 -- 172.21.15.45:0/1156931845 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9908035030 con 0x7f99181067f0 2024-09-18T12:58:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.754+0000 7f992018f640 1 -- 172.21.15.45:0/1156931845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99181a3da0 con 0x7f99181067f0 2024-09-18T12:58:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.755+0000 7f992018f640 1 -- 172.21.15.45:0/1156931845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9918101f30 con 0x7f99181067f0 2024-09-18T12:58:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.755+0000 7f990effd640 1 -- 172.21.15.45:0/1156931845 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f9908042070 con 0x7f99181067f0 2024-09-18T12:58:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.756+0000 7f990effd640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f990407af80 0x7f990407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:58:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.756+0000 7f990effd640 1 -- 172.21.15.45:0/1156931845 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6070+0+0 (secure 0 0 0) 0x7f99080be8b0 con 0x7f99181067f0 2024-09-18T12:58:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.756+0000 7f991df2b640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f990407af80 0x7f990407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:58:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.757+0000 7f991df2b640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f990407af80 0x7f990407d440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9914005fd0 tx=0x7f991400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:58:47.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:47.760+0000 7f990effd640 1 -- 172.21.15.45:0/1156931845 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9908089ee0 con 0x7f99181067f0 2024-09-18T12:58:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:47 smithi161 ceph-mon[80292]: from='client.44195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:47 smithi161 ceph-mon[80292]: pgmap v196: 65 pgs: 16 stale+active+clean, 49 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-18T12:58:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:47 smithi161 ceph-mon[80292]: osdmap e63: 6 total, 5 up, 6 in 2024-09-18T12:58:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:47 smithi161 ceph-mon[80292]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:47 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1331677639' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:48.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.020+0000 7f992018f640 1 -- 172.21.15.45:0/1156931845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9918109d70 con 0x7f99181067f0 2024-09-18T12:58:48.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.021+0000 7f990effd640 1 -- 172.21.15.45:0/1156931845 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+290 (secure 0 0 0) 0x7f990808ed90 con 0x7f99181067f0 2024-09-18T12:58:48.022 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-09-18T12:58:48.022 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:58:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:58:48.023 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-18T12:58:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: osd.3 (root=default,host=smithi161) is down 2024-09-18T12:58:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.023+0000 7f992018f640 1 -- 172.21.15.45:0/1156931845 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f990407af80 msgr2=0x7f990407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.023+0000 7f992018f640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f990407af80 0x7f990407d440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9914005fd0 tx=0x7f991400b390 comp rx=0 tx=0).stop 2024-09-18T12:58:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.023+0000 7f992018f640 1 -- 172.21.15.45:0/1156931845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99181067f0 msgr2=0x7f99180fd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:58:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.023+0000 7f992018f640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99181067f0 0x7f99180fd210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9908031460 tx=0x7f99080045e0 comp rx=0 tx=0).stop 2024-09-18T12:58:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.023+0000 7f992018f640 1 -- 172.21.15.45:0/1156931845 shutdown_connections 2024-09-18T12:58:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.023+0000 7f992018f640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f990407af80 0x7f990407d440 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.023+0000 7f992018f640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99181067f0 0x7f99180fd210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.023+0000 7f992018f640 1 --2- 172.21.15.45:0/1156931845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99181007f0 0x7f99180fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:58:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.024+0000 7f992018f640 1 -- 172.21.15.45:0/1156931845 >> 172.21.15.45:0/1156931845 conn(0x7f99180fc550 msgr2=0x7f9918069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:58:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.024+0000 7f992018f640 1 -- 172.21.15.45:0/1156931845 shutdown_connections 2024-09-18T12:58:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:58:48.024+0000 7f992018f640 1 -- 172.21.15.45:0/1156931845 wait complete. 2024-09-18T12:58:48.292 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:47 smithi161 podman[87948]: 2024-09-18 12:58:47.896508583 +0000 UTC m=+0.654497511 container remove 821638ecdbe84fe79a40cb6b3a79d58c142dce0d130e85bee5b30a264fa3a287 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-18T12:58:48.292 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:47 smithi161 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-18T12:58:48.292 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:47 smithi161 systemd[1]: Stopped Ceph osd.3 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:58:48.293 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:47 smithi161 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 2.520s CPU time. 2024-09-18T12:58:48.293 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:48 smithi161 systemd[1]: Starting Ceph osd.3 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:58:48.635 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:48 smithi161 ceph-mon[80292]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:48.636 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:48 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3882945805' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:58:48.636 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:48 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1156931845' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:48.636 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:48 smithi161 podman[88049]: 2024-09-18 12:58:48.233255711 +0000 UTC m=+0.016345214 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:58:48.636 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:48 smithi161 podman[88049]: 2024-09-18 12:58:48.390490282 +0000 UTC m=+0.173579775 container create 87e26d4e55c18a0668bb60decc7299d87946de734c9d186248263b05302b2274 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:58:48.636 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:48 smithi161 podman[88049]: 2024-09-18 12:58:48.635574602 +0000 UTC m=+0.418664108 container init 87e26d4e55c18a0668bb60decc7299d87946de734c9d186248263b05302b2274 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-18T12:58:48.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:48 smithi045 ceph-mon[109129]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:48.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:48 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3882945805' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:58:48.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:48 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1156931845' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:58:49.042 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:48 smithi161 podman[88049]: 2024-09-18 12:58:48.639179518 +0000 UTC m=+0.422269014 container start 87e26d4e55c18a0668bb60decc7299d87946de734c9d186248263b05302b2274 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-18T12:58:49.042 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:48 smithi161 podman[88049]: 2024-09-18 12:58:48.711667286 +0000 UTC m=+0.494756931 container attach 87e26d4e55c18a0668bb60decc7299d87946de734c9d186248263b05302b2274 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:58:49.042 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:48 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate[88064]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:58:49.043 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:48 smithi161 bash[88049]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:58:49.043 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:48 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate[88064]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:58:49.043 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:48 smithi161 bash[88049]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:58:49.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:49 smithi161 ceph-mon[80292]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:49.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:49 smithi161 ceph-mon[80292]: pgmap v198: 65 pgs: 15 active+undersized, 7 peering, 1 stale+active+clean, 12 active+undersized+degraded, 30 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 44/255 objects degraded (17.255%) 2024-09-18T12:58:49.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:49 smithi161 ceph-mon[80292]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-18T12:58:49.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:49 smithi161 ceph-mon[80292]: Health check failed: Degraded data redundancy: 44/255 objects degraded (17.255%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:49 smithi045 ceph-mon[109129]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:58:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:49 smithi045 ceph-mon[109129]: pgmap v198: 65 pgs: 15 active+undersized, 7 peering, 1 stale+active+clean, 12 active+undersized+degraded, 30 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 44/255 objects degraded (17.255%) 2024-09-18T12:58:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:49 smithi045 ceph-mon[109129]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-18T12:58:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:49 smithi045 ceph-mon[109129]: Health check failed: Degraded data redundancy: 44/255 objects degraded (17.255%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:51.366 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:51 smithi161 ceph-mon[80292]: pgmap v199: 65 pgs: 17 active+undersized, 7 peering, 14 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/255 objects degraded (18.824%) 2024-09-18T12:58:51.367 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate[88064]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:58:51.367 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 bash[88049]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:58:51.367 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate[88064]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:58:51.367 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 bash[88049]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T12:58:51.716 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate[88064]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:58:51.716 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 bash[88049]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T12:58:51.716 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate[88064]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:58:51.716 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 bash[88049]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T12:58:51.716 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate[88064]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-18T12:58:51.716 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 bash[88049]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-18T12:58:51.717 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate[88064]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:58:51.717 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 bash[88049]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:58:51.717 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate[88064]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-18T12:58:51.717 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 bash[88049]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-18T12:58:51.717 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:51 smithi161 podman[88049]: 2024-09-18 12:58:51.429916872 +0000 UTC m=+3.213006382 container died 87e26d4e55c18a0668bb60decc7299d87946de734c9d186248263b05302b2274 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2) 2024-09-18T12:58:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:51 smithi045 ceph-mon[109129]: pgmap v199: 65 pgs: 17 active+undersized, 7 peering, 14 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 48/255 objects degraded (18.824%) 2024-09-18T12:58:52.372 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:52 smithi161 podman[88221]: 2024-09-18 12:58:52.082393333 +0000 UTC m=+0.645441087 container remove 87e26d4e55c18a0668bb60decc7299d87946de734c9d186248263b05302b2274 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-activate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-18T12:58:52.372 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:52 smithi161 podman[88281]: 2024-09-18 12:58:52.199704881 +0000 UTC m=+0.016184831 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:58:52.372 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:52 smithi161 podman[88281]: 2024-09-18 12:58:52.316338296 +0000 UTC m=+0.132818231 container create 1fbe6c224b87465d4b9bb77fb9815e922b86781b8e058bff1db2fba912d509c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-18T12:58:52.628 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:52 smithi161 ceph-mon[80292]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-18T12:58:52.628 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:52 smithi161 podman[88281]: 2024-09-18 12:58:52.602046939 +0000 UTC m=+0.418526876 container init 1fbe6c224b87465d4b9bb77fb9815e922b86781b8e058bff1db2fba912d509c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2) 2024-09-18T12:58:52.628 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:52 smithi161 podman[88281]: 2024-09-18 12:58:52.605400727 +0000 UTC m=+0.421880663 container start 1fbe6c224b87465d4b9bb77fb9815e922b86781b8e058bff1db2fba912d509c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:58:52.766 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:52 smithi045 ceph-mon[109129]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-18T12:58:53.042 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:52 smithi161 ceph-osd[88300]: -- 172.21.15.161:0/1019206899 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5624a34c21e0 con 0x5624a2661c00 2024-09-18T12:58:53.042 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:52 smithi161 bash[88281]: 1fbe6c224b87465d4b9bb77fb9815e922b86781b8e058bff1db2fba912d509c1 2024-09-18T12:58:53.042 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:52 smithi161 systemd[1]: Started Ceph osd.3 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:58:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:53 smithi045 ceph-mon[109129]: pgmap v200: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 57/255 objects degraded (22.353%) 2024-09-18T12:58:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:53.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:53.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:53 smithi161 ceph-mon[80292]: pgmap v200: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 57/255 objects degraded (22.353%) 2024-09-18T12:58:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:53.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:53.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:58:54.792 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:58:54 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[88296]: 2024-09-18T12:58:54.495+0000 7fa43be92640 -1 Falling back to public interface 2024-09-18T12:58:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:55 smithi045 ceph-mon[109129]: pgmap v201: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 57/255 objects degraded (22.353%) 2024-09-18T12:58:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:55 smithi161 ceph-mon[80292]: pgmap v201: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 57/255 objects degraded (22.353%) 2024-09-18T12:58:56.642 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:56 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:56.642 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:56 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:56.642 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:56 smithi161 ceph-mon[80292]: Health check update: Degraded data redundancy: 57/255 objects degraded (22.353%), 17 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:56.642 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:56 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:56.642 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:56 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:56.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:56 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:56.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:56 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:56.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:56 smithi045 ceph-mon[109129]: Health check update: Degraded data redundancy: 57/255 objects degraded (22.353%), 17 pgs degraded (PG_DEGRADED) 2024-09-18T12:58:56.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:56 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:56.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:56 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:57.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:57 smithi161 ceph-mon[80292]: pgmap v202: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 57/255 objects degraded (22.353%) 2024-09-18T12:58:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:57 smithi045 ceph-mon[109129]: pgmap v202: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 57/255 objects degraded (22.353%) 2024-09-18T12:58:59.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: pgmap v203: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 57/255 objects degraded (22.353%) 2024-09-18T12:58:59.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:59.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:59.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:59.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:59.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:59.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:59.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:59.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:59.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:59.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:58:59 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:58:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: pgmap v203: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 57/255 objects degraded (22.353%) 2024-09-18T12:58:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:58:59.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:58:59.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:58:59.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:58:59.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:59.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:59.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:58:59.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:58:59 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:59:00.542 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:59:00 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[88296]: 2024-09-18T12:59:00.212+0000 7fa43be92640 -1 osd.3 61 log_to_monitors true 2024-09-18T12:59:00.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:00 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:59:00.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:00 smithi161 ceph-mon[80292]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-18T12:59:00.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:00 smithi161 ceph-mon[80292]: from='osd.3 [v2:172.21.15.161:6800/3321492272,v1:172.21.15.161:6801/3321492272]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:59:00.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:00 smithi161 ceph-mon[80292]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:59:00.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:00 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:59:00.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:00 smithi045 ceph-mon[109129]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-18T12:59:00.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:00 smithi045 ceph-mon[109129]: from='osd.3 [v2:172.21.15.161:6800/3321492272,v1:172.21.15.161:6801/3321492272]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:59:00.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:00 smithi045 ceph-mon[109129]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-18T12:59:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:01 smithi045 ceph-mon[109129]: pgmap v204: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 57/255 objects degraded (22.353%) 2024-09-18T12:59:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:01 smithi045 ceph-mon[109129]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:59:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:01 smithi045 ceph-mon[109129]: from='osd.3 [v2:172.21.15.161:6800/3321492272,v1:172.21.15.161:6801/3321492272]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T12:59:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:01 smithi045 ceph-mon[109129]: osdmap e64: 6 total, 5 up, 6 in 2024-09-18T12:59:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:01 smithi045 ceph-mon[109129]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T12:59:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:01 smithi045 ceph-mon[109129]: from='osd.3 ' entity='osd.3' 2024-09-18T12:59:01.792 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 12:59:01 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[88296]: 2024-09-18T12:59:01.335+0000 7fa42fc34640 -1 osd.3 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:59:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:01 smithi161 ceph-mon[80292]: pgmap v204: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 57/255 objects degraded (22.353%) 2024-09-18T12:59:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:01 smithi161 ceph-mon[80292]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T12:59:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:01 smithi161 ceph-mon[80292]: from='osd.3 [v2:172.21.15.161:6800/3321492272,v1:172.21.15.161:6801/3321492272]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T12:59:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:01 smithi161 ceph-mon[80292]: osdmap e64: 6 total, 5 up, 6 in 2024-09-18T12:59:01.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:01 smithi161 ceph-mon[80292]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T12:59:01.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:01 smithi161 ceph-mon[80292]: from='osd.3 ' entity='osd.3' 2024-09-18T12:59:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:02 smithi045 ceph-mon[109129]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:59:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:02 smithi045 ceph-mon[109129]: osd.3 [v2:172.21.15.161:6800/3321492272,v1:172.21.15.161:6801/3321492272] boot 2024-09-18T12:59:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:02 smithi045 ceph-mon[109129]: osdmap e65: 6 total, 6 up, 6 in 2024-09-18T12:59:02.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:02 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-18T12:59:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:02 smithi161 ceph-mon[80292]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:59:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:02 smithi161 ceph-mon[80292]: osd.3 [v2:172.21.15.161:6800/3321492272,v1:172.21.15.161:6801/3321492272] boot 2024-09-18T12:59:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:02 smithi161 ceph-mon[80292]: osdmap e65: 6 total, 6 up, 6 in 2024-09-18T12:59:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:02 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-18T12:59:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:03 smithi045 ceph-mon[109129]: pgmap v206: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 57/255 objects degraded (22.353%) 2024-09-18T12:59:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:03 smithi045 ceph-mon[109129]: osdmap e66: 6 total, 6 up, 6 in 2024-09-18T12:59:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:03 smithi161 ceph-mon[80292]: pgmap v206: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 57/255 objects degraded (22.353%) 2024-09-18T12:59:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:03 smithi161 ceph-mon[80292]: osdmap e66: 6 total, 6 up, 6 in 2024-09-18T12:59:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:04 smithi045 ceph-mon[109129]: Health check update: Degraded data redundancy: 31/255 objects degraded (12.157%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T12:59:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:04 smithi161 ceph-mon[80292]: Health check update: Degraded data redundancy: 31/255 objects degraded (12.157%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T12:59:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:05 smithi045 ceph-mon[109129]: pgmap v209: 65 pgs: 15 peering, 11 active+undersized, 9 active+undersized+degraded, 30 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/255 objects degraded (12.157%) 2024-09-18T12:59:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:05 smithi161 ceph-mon[80292]: pgmap v209: 65 pgs: 15 peering, 11 active+undersized, 9 active+undersized+degraded, 30 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/255 objects degraded (12.157%) 2024-09-18T12:59:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:07 smithi045 ceph-mon[109129]: pgmap v210: 65 pgs: 15 peering, 3 active+undersized, 1 active+undersized+degraded, 46 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 3/255 objects degraded (1.176%) 2024-09-18T12:59:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:07 smithi161 ceph-mon[80292]: pgmap v210: 65 pgs: 15 peering, 3 active+undersized, 1 active+undersized+degraded, 46 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 3/255 objects degraded (1.176%) 2024-09-18T12:59:09.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:09.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:09.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:09 smithi045 ceph-mon[109129]: pgmap v211: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 913 B/s rd, 1 op/s 2024-09-18T12:59:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:09.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:09 smithi161 ceph-mon[80292]: pgmap v211: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 913 B/s rd, 1 op/s 2024-09-18T12:59:10.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:10 smithi045 ceph-mon[109129]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/255 objects degraded (1.176%), 1 pg degraded) 2024-09-18T12:59:10.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:10 smithi161 ceph-mon[80292]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/255 objects degraded (1.176%), 1 pg degraded) 2024-09-18T12:59:11.020 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:11 smithi161 ceph-mon[80292]: pgmap v212: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-09-18T12:59:11.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:11 smithi045 ceph-mon[109129]: pgmap v212: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-09-18T12:59:13.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:13 smithi045 ceph-mon[109129]: pgmap v213: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:59:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:13 smithi161 ceph-mon[80292]: pgmap v213: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:59:14.645 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:14 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:59:14.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:14 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-18T12:59:15.681 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:15 smithi161 ceph-mon[80292]: pgmap v214: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-18T12:59:15.681 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:15 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:59:15.681 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:15 smithi161 ceph-mon[80292]: Upgrade: osd.4 is safe to restart 2024-09-18T12:59:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:15 smithi045 ceph-mon[109129]: pgmap v214: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-18T12:59:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:15 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T12:59:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:15 smithi045 ceph-mon[109129]: Upgrade: osd.4 is safe to restart 2024-09-18T12:59:17.002 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:16 smithi161 ceph-mon[80292]: Upgrade: Updating osd.4 2024-09-18T12:59:17.002 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:17.002 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-18T12:59:17.003 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:17.003 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:16 smithi161 ceph-mon[80292]: Deploying daemon osd.4 on smithi161 2024-09-18T12:59:17.003 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:16 smithi161 ceph-mon[80292]: pgmap v215: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-18T12:59:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:16 smithi045 ceph-mon[109129]: Upgrade: Updating osd.4 2024-09-18T12:59:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-18T12:59:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:16 smithi045 ceph-mon[109129]: Deploying daemon osd.4 on smithi161 2024-09-18T12:59:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:16 smithi045 ceph-mon[109129]: pgmap v215: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-18T12:59:18.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.125+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/1456705103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b68100800 msgr2=0x7f0b68100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.125+0000 7f0b6e3e1640 1 --2- 172.21.15.45:0/1456705103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b68100800 0x7f0b68100c60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009880 tx=0x7f0b5002a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.125+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/1456705103 shutdown_connections 2024-09-18T12:59:18.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.125+0000 7f0b6e3e1640 1 --2- 172.21.15.45:0/1456705103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b68100800 0x7f0b68100c60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.125+0000 7f0b6e3e1640 1 --2- 172.21.15.45:0/1456705103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b68106800 0x7f0b68106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.125+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/1456705103 >> 172.21.15.45:0/1456705103 conn(0x7f0b680fc520 msgr2=0x7f0b680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:18.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.125+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/1456705103 shutdown_connections 2024-09-18T12:59:18.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.125+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/1456705103 wait complete. 2024-09-18T12:59:18.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.125+0000 7f0b6e3e1640 1 Processor -- start 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.125+0000 7f0b6e3e1640 1 -- start start 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b6e3e1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b68100800 0x7f0b680fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b6e3e1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b68106800 0x7f0b680fd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b6e3e1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6810dcd0 con 0x7f0b68106800 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b6e3e1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6810db50 con 0x7f0b68100800 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b5ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b68106800 0x7f0b680fd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b67fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b68100800 0x7f0b680fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b5ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b68106800 0x7f0b680fd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52940/0 (socket says 172.21.15.45:52940) 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b5ffff640 1 -- 172.21.15.45:0/872365429 learned_addr learned my addr 172.21.15.45:0/872365429 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b67fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b68100800 0x7f0b680fcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:49390/0 (socket says 172.21.15.45:49390) 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b67fff640 1 -- 172.21.15.45:0/872365429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b68106800 msgr2=0x7f0b680fd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b67fff640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b68106800 0x7f0b680fd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b67fff640 1 -- 172.21.15.45:0/872365429 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b680fd630 con 0x7f0b68100800 2024-09-18T12:59:18.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.126+0000 7f0b5ffff640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b68106800 0x7f0b680fd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T12:59:18.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.127+0000 7f0b67fff640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b68100800 0x7f0b680fcbb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e970 tx=0x7f0b5800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:18.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.127+0000 7f0b65ffb640 1 -- 172.21.15.45:0/872365429 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b5800cac0 con 0x7f0b68100800 2024-09-18T12:59:18.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.127+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/872365429 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b680fd920 con 0x7f0b68100800 2024-09-18T12:59:18.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.127+0000 7f0b65ffb640 1 -- 172.21.15.45:0/872365429 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b5800cc60 con 0x7f0b68100800 2024-09-18T12:59:18.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.127+0000 7f0b65ffb640 1 -- 172.21.15.45:0/872365429 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b580047a0 con 0x7f0b68100800 2024-09-18T12:59:18.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.127+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/872365429 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b681a3e70 con 0x7f0b68100800 2024-09-18T12:59:18.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.128+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/872365429 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b68101f40 con 0x7f0b68100800 2024-09-18T12:59:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.129+0000 7f0b65ffb640 1 -- 172.21.15.45:0/872365429 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f0b58004030 con 0x7f0b68100800 2024-09-18T12:59:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.129+0000 7f0b65ffb640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0b5407af30 0x7f0b5407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.129+0000 7f0b65ffb640 1 -- 172.21.15.45:0/872365429 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6070+0+0 (secure 0 0 0) 0x7f0b5809e470 con 0x7f0b68100800 2024-09-18T12:59:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.129+0000 7f0b5ffff640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0b5407af30 0x7f0b5407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.130+0000 7f0b5ffff640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0b5407af30 0x7f0b5407d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b680fe640 tx=0x7f0b500058d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.134+0000 7f0b65ffb640 1 -- 172.21.15.45:0/872365429 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0b58069a60 con 0x7f0b68100800 2024-09-18T12:59:18.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.343+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/872365429 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0b68062630 con 0x7f0b5407af30 2024-09-18T12:59:18.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.344+0000 7f0b65ffb640 1 -- 172.21.15.45:0/872365429 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f0b68062630 con 0x7f0b5407af30 2024-09-18T12:59:18.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/872365429 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0b5407af30 msgr2=0x7f0b5407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0b5407af30 0x7f0b5407d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b680fe640 tx=0x7f0b500058d0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/872365429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b68100800 msgr2=0x7f0b680fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b68100800 0x7f0b680fcbb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e970 tx=0x7f0b5800ee30 comp rx=0 tx=0).stop 2024-09-18T12:59:18.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/872365429 shutdown_connections 2024-09-18T12:59:18.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0b5407af30 0x7f0b5407d3f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b68106800 0x7f0b680fd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 --2- 172.21.15.45:0/872365429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b68100800 0x7f0b680fcbb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/872365429 >> 172.21.15.45:0/872365429 conn(0x7f0b680fc520 msgr2=0x7f0b6806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:18.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/872365429 shutdown_connections 2024-09-18T12:59:18.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.346+0000 7f0b6e3e1640 1 -- 172.21.15.45:0/872365429 wait complete. 2024-09-18T12:59:18.357 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:59:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.432+0000 7f2be85ff640 1 -- 172.21.15.45:0/2029615986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2be0107900 msgr2=0x7f2be0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.432+0000 7f2be85ff640 1 --2- 172.21.15.45:0/2029615986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2be0107900 0x7f2be0107ce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009880 tx=0x7f2bdc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.432+0000 7f2be85ff640 1 -- 172.21.15.45:0/2029615986 shutdown_connections 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.432+0000 7f2be85ff640 1 --2- 172.21.15.45:0/2029615986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2be0101900 0x7f2be0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.432+0000 7f2be85ff640 1 --2- 172.21.15.45:0/2029615986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2be0107900 0x7f2be0107ce0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.432+0000 7f2be85ff640 1 -- 172.21.15.45:0/2029615986 >> 172.21.15.45:0/2029615986 conn(0x7f2be00fd600 msgr2=0x7f2be00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.432+0000 7f2be85ff640 1 -- 172.21.15.45:0/2029615986 shutdown_connections 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.432+0000 7f2be85ff640 1 -- 172.21.15.45:0/2029615986 wait complete. 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.433+0000 7f2be85ff640 1 Processor -- start 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.433+0000 7f2be85ff640 1 -- start start 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.433+0000 7f2be85ff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2be0101900 0x7f2be019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.433+0000 7f2be85ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2be0107900 0x7f2be019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.433+0000 7f2be85ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2be010edd0 con 0x7f2be0107900 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.433+0000 7f2be85ff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2be010ec50 con 0x7f2be0101900 2024-09-18T12:59:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.433+0000 7f2be5b9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2be0107900 0x7f2be019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.433+0000 7f2be5b9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2be0107900 0x7f2be019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52954/0 (socket says 172.21.15.45:52954) 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.433+0000 7f2be5b9a640 1 -- 172.21.15.45:0/2446897125 learned_addr learned my addr 172.21.15.45:0/2446897125 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.434+0000 7f2be639b640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2be0101900 0x7f2be019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.434+0000 7f2be5b9a640 1 -- 172.21.15.45:0/2446897125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2be0101900 msgr2=0x7f2be019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.434+0000 7f2be5b9a640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2be0101900 0x7f2be019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.434+0000 7f2be5b9a640 1 -- 172.21.15.45:0/2446897125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be01977c0 con 0x7f2be0107900 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.434+0000 7f2be5b9a640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2be0107900 0x7f2be019db80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000e970 tx=0x7f2bd000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.434+0000 7f2bd77fe640 1 -- 172.21.15.45:0/2446897125 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bd000cac0 con 0x7f2be0107900 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.434+0000 7f2bd77fe640 1 -- 172.21.15.45:0/2446897125 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bd00054e0 con 0x7f2be0107900 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.434+0000 7f2be85ff640 1 -- 172.21.15.45:0/2446897125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be0197ab0 con 0x7f2be0107900 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.434+0000 7f2bd77fe640 1 -- 172.21.15.45:0/2446897125 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bd0010430 con 0x7f2be0107900 2024-09-18T12:59:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.434+0000 7f2be85ff640 1 -- 172.21.15.45:0/2446897125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be0198040 con 0x7f2be0107900 2024-09-18T12:59:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.435+0000 7f2be85ff640 1 -- 172.21.15.45:0/2446897125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be0103040 con 0x7f2be0107900 2024-09-18T12:59:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.436+0000 7f2bd77fe640 1 -- 172.21.15.45:0/2446897125 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f2bd0004f00 con 0x7f2be0107900 2024-09-18T12:59:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.437+0000 7f2bd77fe640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2bcc07af80 0x7f2bcc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.437+0000 7f2bd77fe640 1 -- 172.21.15.45:0/2446897125 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6070+0+0 (secure 0 0 0) 0x7f2bd009e550 con 0x7f2be0107900 2024-09-18T12:59:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.437+0000 7f2be639b640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2bcc07af80 0x7f2bcc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.437+0000 7f2be639b640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2bcc07af80 0x7f2bcc07d440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0096c0 tx=0x7f2bdc031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.441+0000 7f2bd77fe640 1 -- 172.21.15.45:0/2446897125 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2bd0069c20 con 0x7f2be0107900 2024-09-18T12:59:18.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.645+0000 7f2be85ff640 1 -- 172.21.15.45:0/2446897125 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2be01983b0 con 0x7f2bcc07af80 2024-09-18T12:59:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.646+0000 7f2bd77fe640 1 -- 172.21.15.45:0/2446897125 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f2be01983b0 con 0x7f2bcc07af80 2024-09-18T12:59:18.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 -- 172.21.15.45:0/2446897125 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2bcc07af80 msgr2=0x7f2bcc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2bcc07af80 0x7f2bcc07d440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0096c0 tx=0x7f2bdc031400 comp rx=0 tx=0).stop 2024-09-18T12:59:18.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 -- 172.21.15.45:0/2446897125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2be0107900 msgr2=0x7f2be019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2be0107900 0x7f2be019db80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000e970 tx=0x7f2bd000ed70 comp rx=0 tx=0).stop 2024-09-18T12:59:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 -- 172.21.15.45:0/2446897125 shutdown_connections 2024-09-18T12:59:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2bcc07af80 0x7f2bcc07d440 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2be0107900 0x7f2be019db80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 --2- 172.21.15.45:0/2446897125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2be0101900 0x7f2be019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 -- 172.21.15.45:0/2446897125 >> 172.21.15.45:0/2446897125 conn(0x7f2be00fd600 msgr2=0x7f2be00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 -- 172.21.15.45:0/2446897125 shutdown_connections 2024-09-18T12:59:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.648+0000 7f2be85ff640 1 -- 172.21.15.45:0/2446897125 wait complete. 2024-09-18T12:59:18.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.733+0000 7f687e57c640 1 -- 172.21.15.45:0/971043584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6878100650 msgr2=0x7f6878100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.733+0000 7f687e57c640 1 --2- 172.21.15.45:0/971043584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6878100650 0x7f6878100a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6868009880 tx=0x7f686802a490 comp rx=0 tx=0).stop 2024-09-18T12:59:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.733+0000 7f687e57c640 1 -- 172.21.15.45:0/971043584 shutdown_connections 2024-09-18T12:59:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.733+0000 7f687e57c640 1 --2- 172.21.15.45:0/971043584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6878101000 0x7f687810dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.733+0000 7f687e57c640 1 --2- 172.21.15.45:0/971043584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6878100650 0x7f6878100a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.733+0000 7f687e57c640 1 -- 172.21.15.45:0/971043584 >> 172.21.15.45:0/971043584 conn(0x7f68780fc520 msgr2=0x7f68780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.733+0000 7f687e57c640 1 -- 172.21.15.45:0/971043584 shutdown_connections 2024-09-18T12:59:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.733+0000 7f687e57c640 1 -- 172.21.15.45:0/971043584 wait complete. 2024-09-18T12:59:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.733+0000 7f687e57c640 1 Processor -- start 2024-09-18T12:59:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.733+0000 7f687e57c640 1 -- start start 2024-09-18T12:59:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f687e57c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6878100650 0x7f687819f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f687e57c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6878101000 0x7f687819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f687e57c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6878110f90 con 0x7f6878101000 2024-09-18T12:59:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f687e57c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6878110e10 con 0x7f6878100650 2024-09-18T12:59:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f686ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6878101000 0x7f687819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f686ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6878101000 0x7f687819fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52960/0 (socket says 172.21.15.45:52960) 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f6877fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6878100650 0x7f687819f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f686ffff640 1 -- 172.21.15.45:0/3479155190 learned_addr learned my addr 172.21.15.45:0/3479155190 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f686ffff640 1 -- 172.21.15.45:0/3479155190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6878100650 msgr2=0x7f687819f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f686ffff640 1 --2- 172.21.15.45:0/3479155190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6878100650 0x7f687819f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f686ffff640 1 -- 172.21.15.45:0/3479155190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6878199980 con 0x7f6878101000 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f686ffff640 1 --2- 172.21.15.45:0/3479155190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6878101000 0x7f687819fd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f686000d8d0 tx=0x7f686000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.734+0000 7f6875ffb640 1 -- 172.21.15.45:0/3479155190 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6860017030 con 0x7f6878101000 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.735+0000 7f6875ffb640 1 -- 172.21.15.45:0/3479155190 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6860004020 con 0x7f6878101000 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.735+0000 7f687e57c640 1 -- 172.21.15.45:0/3479155190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6878199c70 con 0x7f6878101000 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.735+0000 7f6875ffb640 1 -- 172.21.15.45:0/3479155190 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68600047a0 con 0x7f6878101000 2024-09-18T12:59:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.735+0000 7f687e57c640 1 -- 172.21.15.45:0/3479155190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f687819a200 con 0x7f6878101000 2024-09-18T12:59:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.736+0000 7f687e57c640 1 -- 172.21.15.45:0/3479155190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f687806aa90 con 0x7f6878101000 2024-09-18T12:59:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.737+0000 7f6875ffb640 1 -- 172.21.15.45:0/3479155190 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f68600041d0 con 0x7f6878101000 2024-09-18T12:59:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.737+0000 7f6875ffb640 1 --2- 172.21.15.45:0/3479155190 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f686407af80 0x7f686407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.737+0000 7f6875ffb640 1 -- 172.21.15.45:0/3479155190 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6070+0+0 (secure 0 0 0) 0x7f6860018070 con 0x7f6878101000 2024-09-18T12:59:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.737+0000 7f6877fff640 1 --2- 172.21.15.45:0/3479155190 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f686407af80 0x7f686407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.738+0000 7f6877fff640 1 --2- 172.21.15.45:0/3479155190 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f686407af80 0x7f686407d440 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6868000c00 tx=0x7f6868031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:18.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.742+0000 7f6875ffb640 1 -- 172.21.15.45:0/3479155190 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6860069370 con 0x7f6878101000 2024-09-18T12:59:18.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.935+0000 7f687e57c640 1 -- 172.21.15.45:0/3479155190 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f687819aeb0 con 0x7f686407af80 2024-09-18T12:59:18.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.945+0000 7f6875ffb640 1 -- 172.21.15.45:0/3479155190 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f687819aeb0 con 0x7f686407af80 2024-09-18T12:59:18.946 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:59:18.946 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (4m) 57s ago 15m 20.0M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T12:59:18.946 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (7m) 57s ago 15m 8975k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:59:18.946 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (6m) 23s ago 14m 8530k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:59:18.946 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (2m) 57s ago 15m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T12:59:18.946 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (2m) 23s ago 14m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T12:59:18.946 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (4m) 57s ago 15m 79.3M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T12:59:18.946 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (9m) 57s ago 9m 92.1M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (10m) 57s ago 10m 148M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (9m) 23s ago 9m 18.2M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (9m) 23s ago 9m 16.8M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (6m) 57s ago 16m 524M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (5m) 23s ago 14m 458M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (3m) 57s ago 16m 42.6M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (2m) 23s ago 14m 36.4M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (5m) 57s ago 15m 11.3M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (5m) 23s ago 14m 10.7M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (2m) 57s ago 13m 84.1M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (99s) 57s ago 12m 89.2M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 7d4cd0351725 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (62s) 57s ago 12m 12.2M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4f620cf3977f 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (26s) 23s ago 11m 11.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1fbe6c224b87 2024-09-18T12:59:18.947 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (11m) 23s ago 11m 218M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 53ec1c4a77a8 2024-09-18T12:59:18.948 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (10m) 23s ago 10m 201M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:59:18.948 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (4m) 57s ago 14m 54.1M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.947+0000 7f687e57c640 1 -- 172.21.15.45:0/3479155190 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f686407af80 msgr2=0x7f686407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.947+0000 7f687e57c640 1 --2- 172.21.15.45:0/3479155190 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f686407af80 0x7f686407d440 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6868000c00 tx=0x7f6868031400 comp rx=0 tx=0).stop 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.947+0000 7f687e57c640 1 -- 172.21.15.45:0/3479155190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6878101000 msgr2=0x7f687819fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.947+0000 7f687e57c640 1 --2- 172.21.15.45:0/3479155190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6878101000 0x7f687819fd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f686000d8d0 tx=0x7f686000dd90 comp rx=0 tx=0).stop 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.947+0000 7f687e57c640 1 -- 172.21.15.45:0/3479155190 shutdown_connections 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.947+0000 7f687e57c640 1 --2- 172.21.15.45:0/3479155190 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f686407af80 0x7f686407d440 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.947+0000 7f687e57c640 1 --2- 172.21.15.45:0/3479155190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6878101000 0x7f687819fd00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.947+0000 7f687e57c640 1 --2- 172.21.15.45:0/3479155190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6878100650 0x7f687819f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.947+0000 7f687e57c640 1 -- 172.21.15.45:0/3479155190 >> 172.21.15.45:0/3479155190 conn(0x7f68780fc520 msgr2=0x7f68780fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.948+0000 7f687e57c640 1 -- 172.21.15.45:0/3479155190 shutdown_connections 2024-09-18T12:59:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:18.948+0000 7f687e57c640 1 -- 172.21.15.45:0/3479155190 wait complete. 2024-09-18T12:59:19.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.031+0000 7fc34ccac640 1 -- 172.21.15.45:0/1436172331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348106800 msgr2=0x7fc348106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.031+0000 7fc34ccac640 1 --2- 172.21.15.45:0/1436172331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348106800 0x7fc348106be0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc338009880 tx=0x7fc33802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.031+0000 7fc34ccac640 1 -- 172.21.15.45:0/1436172331 shutdown_connections 2024-09-18T12:59:19.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.031+0000 7fc34ccac640 1 --2- 172.21.15.45:0/1436172331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348100800 0x7fc348100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.031+0000 7fc34ccac640 1 --2- 172.21.15.45:0/1436172331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348106800 0x7fc348106be0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.031+0000 7fc34ccac640 1 -- 172.21.15.45:0/1436172331 >> 172.21.15.45:0/1436172331 conn(0x7fc3480fc520 msgr2=0x7fc3480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:19.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.031+0000 7fc34ccac640 1 -- 172.21.15.45:0/1436172331 shutdown_connections 2024-09-18T12:59:19.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.031+0000 7fc34ccac640 1 -- 172.21.15.45:0/1436172331 wait complete. 2024-09-18T12:59:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.032+0000 7fc34ccac640 1 Processor -- start 2024-09-18T12:59:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.032+0000 7fc34ccac640 1 -- start start 2024-09-18T12:59:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.032+0000 7fc34ccac640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348100800 0x7fc348107c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc34ccac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348106800 0x7fc348108140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc34ccac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc34810dcb0 con 0x7fc348106800 2024-09-18T12:59:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc34ccac640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc34810db30 con 0x7fc348100800 2024-09-18T12:59:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc345d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348106800 0x7fc348108140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc345d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348106800 0x7fc348108140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52978/0 (socket says 172.21.15.45:52978) 2024-09-18T12:59:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc345d9b640 1 -- 172.21.15.45:0/2510689717 learned_addr learned my addr 172.21.15.45:0/2510689717 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc34659c640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348100800 0x7fc348107c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc345d9b640 1 -- 172.21.15.45:0/2510689717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348100800 msgr2=0x7fc348107c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc345d9b640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348100800 0x7fc348107c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc345d9b640 1 -- 172.21.15.45:0/2510689717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc348108680 con 0x7fc348106800 2024-09-18T12:59:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc34659c640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348100800 0x7fc348107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T12:59:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc345d9b640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348106800 0x7fc348108140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00ea30 tx=0x7fc33c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.033+0000 7fc3377fe640 1 -- 172.21.15.45:0/2510689717 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc33c00cbe0 con 0x7fc348106800 2024-09-18T12:59:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.034+0000 7fc3377fe640 1 -- 172.21.15.45:0/2510689717 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc33c00cd80 con 0x7fc348106800 2024-09-18T12:59:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.034+0000 7fc3377fe640 1 -- 172.21.15.45:0/2510689717 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc33c01a920 con 0x7fc348106800 2024-09-18T12:59:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.034+0000 7fc34ccac640 1 -- 172.21.15.45:0/2510689717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc348108970 con 0x7fc348106800 2024-09-18T12:59:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.034+0000 7fc34ccac640 1 -- 172.21.15.45:0/2510689717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3481a3e20 con 0x7fc348106800 2024-09-18T12:59:19.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.035+0000 7fc34ccac640 1 -- 172.21.15.45:0/2510689717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc348101f40 con 0x7fc348106800 2024-09-18T12:59:19.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.036+0000 7fc3377fe640 1 -- 172.21.15.45:0/2510689717 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fc33c01abd0 con 0x7fc348106800 2024-09-18T12:59:19.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.037+0000 7fc3377fe640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc33007af30 0x7fc33007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.037+0000 7fc3377fe640 1 -- 172.21.15.45:0/2510689717 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6070+0+0 (secure 0 0 0) 0x7fc33c09e680 con 0x7fc348106800 2024-09-18T12:59:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.037+0000 7fc34659c640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc33007af30 0x7fc33007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.037+0000 7fc34659c640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc33007af30 0x7fc33007d3f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc338000c00 tx=0x7fc338031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:19.042 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:18 smithi161 systemd[1]: Stopping Ceph osd.4 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:59:19.042 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:19 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[48586]: 2024-09-18T12:59:19.014+0000 7f893682b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:59:19.042 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:19 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[48586]: 2024-09-18T12:59:19.014+0000 7f893682b640 -1 osd.4 66 *** Got signal Terminated *** 2024-09-18T12:59:19.042 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:19 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[48586]: 2024-09-18T12:59:19.014+0000 7f893682b640 -1 osd.4 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:59:19.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.042+0000 7fc3377fe640 1 -- 172.21.15.45:0/2510689717 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc33c016030 con 0x7fc348106800 2024-09-18T12:59:19.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:19 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:19.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:19 smithi045 ceph-mon[109129]: pgmap v216: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:59:19.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:19 smithi045 ceph-mon[109129]: from='client.44227 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:19.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:19 smithi045 ceph-mon[109129]: osd.4 marked itself down and dead 2024-09-18T12:59:19.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.308+0000 7fc34ccac640 1 -- 172.21.15.45:0/2510689717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc3481a4190 con 0x7fc348106800 2024-09-18T12:59:19.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.309+0000 7fc3377fe640 1 -- 172.21.15.45:0/2510689717 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fc33c069cd0 con 0x7fc348106800 2024-09-18T12:59:19.310 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:59:19.310 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:59:19.310 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:19.310 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:59:19.310 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:59:19.310 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5, 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 8 2024-09-18T12:59:19.311 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:59:19.312 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:59:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.311+0000 7fc34ccac640 1 -- 172.21.15.45:0/2510689717 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc33007af30 msgr2=0x7fc33007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.311+0000 7fc34ccac640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc33007af30 0x7fc33007d3f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc338000c00 tx=0x7fc338031400 comp rx=0 tx=0).stop 2024-09-18T12:59:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.311+0000 7fc34ccac640 1 -- 172.21.15.45:0/2510689717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348106800 msgr2=0x7fc348108140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.311+0000 7fc34ccac640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348106800 0x7fc348108140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00ea30 tx=0x7fc33c00eef0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.311+0000 7fc34ccac640 1 -- 172.21.15.45:0/2510689717 shutdown_connections 2024-09-18T12:59:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.311+0000 7fc34ccac640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc33007af30 0x7fc33007d3f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.311+0000 7fc34ccac640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348106800 0x7fc348108140 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.311+0000 7fc34ccac640 1 --2- 172.21.15.45:0/2510689717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc348100800 0x7fc348107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.311+0000 7fc34ccac640 1 -- 172.21.15.45:0/2510689717 >> 172.21.15.45:0/2510689717 conn(0x7fc3480fc520 msgr2=0x7fc348109e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.312+0000 7fc34ccac640 1 -- 172.21.15.45:0/2510689717 shutdown_connections 2024-09-18T12:59:19.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.312+0000 7fc34ccac640 1 -- 172.21.15.45:0/2510689717 wait complete. 2024-09-18T12:59:19.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.398+0000 7f8639555640 1 -- 172.21.15.45:0/1422133317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634107900 msgr2=0x7f8634107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.398+0000 7f8639555640 1 --2- 172.21.15.45:0/1422133317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634107900 0x7f8634107ce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8624009880 tx=0x7f862402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.398+0000 7f8639555640 1 -- 172.21.15.45:0/1422133317 shutdown_connections 2024-09-18T12:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.398+0000 7f8639555640 1 --2- 172.21.15.45:0/1422133317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8634101900 0x7f8634101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.398+0000 7f8639555640 1 --2- 172.21.15.45:0/1422133317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634107900 0x7f8634107ce0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.398+0000 7f8639555640 1 -- 172.21.15.45:0/1422133317 >> 172.21.15.45:0/1422133317 conn(0x7f86340fd600 msgr2=0x7f86340ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.398+0000 7f8639555640 1 -- 172.21.15.45:0/1422133317 shutdown_connections 2024-09-18T12:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.398+0000 7f8639555640 1 -- 172.21.15.45:0/1422133317 wait complete. 2024-09-18T12:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.398+0000 7f8639555640 1 Processor -- start 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8639555640 1 -- start start 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8639555640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634101900 0x7f863419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8639555640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8634107900 0x7f863419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8639555640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f863410edb0 con 0x7f8634101900 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8639555640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f863410ec30 con 0x7f8634107900 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8632ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634101900 0x7f863419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8632ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634101900 0x7f863419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53008/0 (socket says 172.21.15.45:53008) 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8632ffd640 1 -- 172.21.15.45:0/3998607019 learned_addr learned my addr 172.21.15.45:0/3998607019 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f86327fc640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8634107900 0x7f863419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8632ffd640 1 -- 172.21.15.45:0/3998607019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8634107900 msgr2=0x7f863419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8632ffd640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8634107900 0x7f863419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f8632ffd640 1 -- 172.21.15.45:0/3998607019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86341977c0 con 0x7f8634101900 2024-09-18T12:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.399+0000 7f86327fc640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8634107900 0x7f863419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T12:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.400+0000 7f8632ffd640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634101900 0x7f863419d640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8624031460 tx=0x7f86240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.400+0000 7f861bfff640 1 -- 172.21.15.45:0/3998607019 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f862403f070 con 0x7f8634101900 2024-09-18T12:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.400+0000 7f861bfff640 1 -- 172.21.15.45:0/3998607019 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8624004cf0 con 0x7f8634101900 2024-09-18T12:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.400+0000 7f8639555640 1 -- 172.21.15.45:0/3998607019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8634197a50 con 0x7f8634101900 2024-09-18T12:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.400+0000 7f861bfff640 1 -- 172.21.15.45:0/3998607019 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8624035030 con 0x7f8634101900 2024-09-18T12:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.400+0000 7f8639555640 1 -- 172.21.15.45:0/3998607019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8634197f80 con 0x7f8634101900 2024-09-18T12:59:19.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.401+0000 7f8639555640 1 -- 172.21.15.45:0/3998607019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8634103040 con 0x7f8634101900 2024-09-18T12:59:19.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.402+0000 7f861bfff640 1 -- 172.21.15.45:0/3998607019 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f8624042070 con 0x7f8634101900 2024-09-18T12:59:19.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.402+0000 7f861bfff640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f861c07af30 0x7f861c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:19.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.402+0000 7f861bfff640 1 -- 172.21.15.45:0/3998607019 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7f86240bea70 con 0x7f8634101900 2024-09-18T12:59:19.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.402+0000 7f86327fc640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f861c07af30 0x7f861c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:19.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.403+0000 7f86327fc640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f861c07af30 0x7f861c07d3f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8634100e00 tx=0x7f8628005d30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:19.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.407+0000 7f861bfff640 1 -- 172.21.15.45:0/3998607019 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f862408a0c0 con 0x7f8634101900 2024-09-18T12:59:19.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:19 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:19.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:19 smithi161 ceph-mon[80292]: pgmap v216: 65 pgs: 65 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:59:19.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:19 smithi161 ceph-mon[80292]: from='client.44227 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:19.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:19 smithi161 ceph-mon[80292]: osd.4 marked itself down and dead 2024-09-18T12:59:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.631+0000 7f8639555640 1 -- 172.21.15.45:0/3998607019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8634198cf0 con 0x7f8634101900 2024-09-18T12:59:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.631+0000 7f861bfff640 1 -- 172.21.15.45:0/3998607019 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2046 (secure 0 0 0) 0x7f862408ef70 con 0x7f8634101900 2024-09-18T12:59:19.633 INFO:teuthology.orchestra.run.smithi045.stdout:e16 2024-09-18T12:59:19.633 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T12:49:30:966010+0000 2024-09-18T12:59:19.633 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 14 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T12:49:28.960615+0000 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T12:59:19.634 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=14566} 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T12:59:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 14566 members: 14566 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:59:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:19.637 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2024-09-18T12:59:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 -- 172.21.15.45:0/3998607019 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f861c07af30 msgr2=0x7f861c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f861c07af30 0x7f861c07d3f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8634100e00 tx=0x7f8628005d30 comp rx=0 tx=0).stop 2024-09-18T12:59:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 -- 172.21.15.45:0/3998607019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634101900 msgr2=0x7f863419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634101900 0x7f863419d640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8624031460 tx=0x7f86240048f0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 -- 172.21.15.45:0/3998607019 shutdown_connections 2024-09-18T12:59:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f861c07af30 0x7f861c07d3f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8634107900 0x7f863419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 --2- 172.21.15.45:0/3998607019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634101900 0x7f863419d640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 -- 172.21.15.45:0/3998607019 >> 172.21.15.45:0/3998607019 conn(0x7f86340fd600 msgr2=0x7f86340ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 -- 172.21.15.45:0/3998607019 shutdown_connections 2024-09-18T12:59:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.634+0000 7f8639555640 1 -- 172.21.15.45:0/3998607019 wait complete. 2024-09-18T12:59:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.720+0000 7fac869e0640 1 -- 172.21.15.45:0/3185878569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac80100800 msgr2=0x7fac80100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.720+0000 7fac869e0640 1 --2- 172.21.15.45:0/3185878569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac80100800 0x7fac80100c60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fac74009880 tx=0x7fac7402a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.720+0000 7fac869e0640 1 -- 172.21.15.45:0/3185878569 shutdown_connections 2024-09-18T12:59:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.720+0000 7fac869e0640 1 --2- 172.21.15.45:0/3185878569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac80100800 0x7fac80100c60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.720+0000 7fac869e0640 1 --2- 172.21.15.45:0/3185878569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac80106800 0x7fac80106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.720+0000 7fac869e0640 1 -- 172.21.15.45:0/3185878569 >> 172.21.15.45:0/3185878569 conn(0x7fac800fc520 msgr2=0x7fac800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.721+0000 7fac869e0640 1 -- 172.21.15.45:0/3185878569 shutdown_connections 2024-09-18T12:59:19.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.721+0000 7fac869e0640 1 -- 172.21.15.45:0/3185878569 wait complete. 2024-09-18T12:59:19.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.721+0000 7fac869e0640 1 Processor -- start 2024-09-18T12:59:19.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.721+0000 7fac869e0640 1 -- start start 2024-09-18T12:59:19.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac869e0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac80100800 0x7fac800fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:19.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac869e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac80106800 0x7fac800fd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:19.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac869e0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fac8010dcd0 con 0x7fac80106800 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac869e0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fac8010db50 con 0x7fac80100800 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac80106800 0x7fac800fd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac80106800 0x7fac800fd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53026/0 (socket says 172.21.15.45:53026) 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac7f7fe640 1 -- 172.21.15.45:0/2774200670 learned_addr learned my addr 172.21.15.45:0/2774200670 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac7ffff640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac80100800 0x7fac800fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac7f7fe640 1 -- 172.21.15.45:0/2774200670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac80100800 msgr2=0x7fac800fcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac7f7fe640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac80100800 0x7fac800fcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac7f7fe640 1 -- 172.21.15.45:0/2774200670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac800fd630 con 0x7fac80106800 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac7f7fe640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac80106800 0x7fac800fd0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac74031460 tx=0x7fac740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.722+0000 7fac7d7fa640 1 -- 172.21.15.45:0/2774200670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac7403f070 con 0x7fac80106800 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.723+0000 7fac869e0640 1 -- 172.21.15.45:0/2774200670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac800fd8c0 con 0x7fac80106800 2024-09-18T12:59:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.723+0000 7fac7d7fa640 1 -- 172.21.15.45:0/2774200670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac740035f0 con 0x7fac80106800 2024-09-18T12:59:19.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.723+0000 7fac7d7fa640 1 -- 172.21.15.45:0/2774200670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac74035030 con 0x7fac80106800 2024-09-18T12:59:19.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.723+0000 7fac869e0640 1 -- 172.21.15.45:0/2774200670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac801a3db0 con 0x7fac80106800 2024-09-18T12:59:19.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.724+0000 7fac869e0640 1 -- 172.21.15.45:0/2774200670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac80101f40 con 0x7fac80106800 2024-09-18T12:59:19.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.724+0000 7fac7d7fa640 1 -- 172.21.15.45:0/2774200670 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fac74042070 con 0x7fac80106800 2024-09-18T12:59:19.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.725+0000 7fac7d7fa640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fac6807af30 0x7fac6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:19.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.725+0000 7fac7d7fa640 1 -- 172.21.15.45:0/2774200670 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7fac740be920 con 0x7fac80106800 2024-09-18T12:59:19.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.725+0000 7fac7ffff640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fac6807af30 0x7fac6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:19.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.725+0000 7fac7ffff640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fac6807af30 0x7fac6807d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fac70005fd0 tx=0x7fac7000b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:19.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.729+0000 7fac7d7fa640 1 -- 172.21.15.45:0/2774200670 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fac74089f70 con 0x7fac80106800 2024-09-18T12:59:19.908 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:19 smithi161 podman[92906]: 2024-09-18 12:59:19.637282797 +0000 UTC m=+0.718398811 container died 53ec1c4a77a8e7282b96d6ff4871b67c5136331a0e9fa51f8d0c4d0042d85936 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-18T12:59:19.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.935+0000 7fac869e0640 1 -- 172.21.15.45:0/2774200670 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fac80062630 con 0x7fac6807af30 2024-09-18T12:59:19.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.936+0000 7fac7d7fa640 1 -- 172.21.15.45:0/2774200670 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fac80062630 con 0x7fac6807af30 2024-09-18T12:59:19.937 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:59:19.937 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr", 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout: "mon", 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout: "crash" 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "10/23 daemons upgraded", 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:59:19.938 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:59:19.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 -- 172.21.15.45:0/2774200670 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fac6807af30 msgr2=0x7fac6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fac6807af30 0x7fac6807d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fac70005fd0 tx=0x7fac7000b390 comp rx=0 tx=0).stop 2024-09-18T12:59:19.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 -- 172.21.15.45:0/2774200670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac80106800 msgr2=0x7fac800fd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:19.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac80106800 0x7fac800fd0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac74031460 tx=0x7fac740045e0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 -- 172.21.15.45:0/2774200670 shutdown_connections 2024-09-18T12:59:19.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fac6807af30 0x7fac6807d3f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac80106800 0x7fac800fd0f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 --2- 172.21.15.45:0/2774200670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac80100800 0x7fac800fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:19.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 -- 172.21.15.45:0/2774200670 >> 172.21.15.45:0/2774200670 conn(0x7fac800fc520 msgr2=0x7fac8006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:19.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 -- 172.21.15.45:0/2774200670 shutdown_connections 2024-09-18T12:59:19.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:19.938+0000 7fac869e0640 1 -- 172.21.15.45:0/2774200670 wait complete. 2024-09-18T12:59:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.022+0000 7f64bcdb7640 1 -- 172.21.15.45:0/3505371471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b8106800 msgr2=0x7f64b8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.023+0000 7f64bcdb7640 1 --2- 172.21.15.45:0/3505371471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b8106800 0x7f64b8106be0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f64a8009880 tx=0x7f64a802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.023+0000 7f64bcdb7640 1 -- 172.21.15.45:0/3505371471 shutdown_connections 2024-09-18T12:59:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.023+0000 7f64bcdb7640 1 --2- 172.21.15.45:0/3505371471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64b8100800 0x7f64b8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.023+0000 7f64bcdb7640 1 --2- 172.21.15.45:0/3505371471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b8106800 0x7f64b8106be0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.023+0000 7f64bcdb7640 1 -- 172.21.15.45:0/3505371471 >> 172.21.15.45:0/3505371471 conn(0x7f64b80fc520 msgr2=0x7f64b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.023+0000 7f64bcdb7640 1 -- 172.21.15.45:0/3505371471 shutdown_connections 2024-09-18T12:59:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.023+0000 7f64bcdb7640 1 -- 172.21.15.45:0/3505371471 wait complete. 2024-09-18T12:59:20.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.023+0000 7f64bcdb7640 1 Processor -- start 2024-09-18T12:59:20.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64bcdb7640 1 -- start start 2024-09-18T12:59:20.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64bcdb7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b8100800 0x7f64b819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64bcdb7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64b8106800 0x7f64b819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64bcdb7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f64b810edf0 con 0x7f64b8100800 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64bcdb7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f64b810ec70 con 0x7f64b8106800 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64b659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b8100800 0x7f64b819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64b659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b8100800 0x7f64b819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53038/0 (socket says 172.21.15.45:53038) 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64b659c640 1 -- 172.21.15.45:0/1483844007 learned_addr learned my addr 172.21.15.45:0/1483844007 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64b5d9b640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64b8106800 0x7f64b819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64b659c640 1 -- 172.21.15.45:0/1483844007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64b8106800 msgr2=0x7f64b819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64b659c640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64b8106800 0x7f64b819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64b659c640 1 -- 172.21.15.45:0/1483844007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b81977f0 con 0x7f64b8100800 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.024+0000 7f64b659c640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b8100800 0x7f64b819d670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f64a8031460 tx=0x7f64a80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.025+0000 7f64a77fe640 1 -- 172.21.15.45:0/1483844007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64a803f070 con 0x7f64b8100800 2024-09-18T12:59:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.025+0000 7f64a77fe640 1 -- 172.21.15.45:0/1483844007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64a80035f0 con 0x7f64b8100800 2024-09-18T12:59:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.025+0000 7f64bcdb7640 1 -- 172.21.15.45:0/1483844007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b8197a80 con 0x7f64b8100800 2024-09-18T12:59:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.025+0000 7f64a77fe640 1 -- 172.21.15.45:0/1483844007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64a8035030 con 0x7f64b8100800 2024-09-18T12:59:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.025+0000 7f64bcdb7640 1 -- 172.21.15.45:0/1483844007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b8197fb0 con 0x7f64b8100800 2024-09-18T12:59:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.026+0000 7f64bcdb7640 1 -- 172.21.15.45:0/1483844007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b8101f40 con 0x7f64b8100800 2024-09-18T12:59:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.026+0000 7f64a77fe640 1 -- 172.21.15.45:0/1483844007 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f64a8042070 con 0x7f64b8100800 2024-09-18T12:59:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.027+0000 7f64a77fe640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f64a007af80 0x7f64a007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.027+0000 7f64a77fe640 1 -- 172.21.15.45:0/1483844007 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6070+0+0 (secure 0 0 0) 0x7f64a80be800 con 0x7f64b8100800 2024-09-18T12:59:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.027+0000 7f64b5d9b640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f64a007af80 0x7f64a007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.027+0000 7f64b5d9b640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f64a007af80 0x7f64a007d440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f64b80fead0 tx=0x7f64ac00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.031+0000 7f64a77fe640 1 -- 172.21.15.45:0/1483844007 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f64a8089ed0 con 0x7f64b8100800 2024-09-18T12:59:20.275 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:19 smithi161 podman[92906]: 2024-09-18 12:59:19.998150886 +0000 UTC m=+1.079266902 container cleanup 53ec1c4a77a8e7282b96d6ff4871b67c5136331a0e9fa51f8d0c4d0042d85936 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-18T12:59:20.275 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:19 smithi161 bash[92906]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4 2024-09-18T12:59:20.275 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:20 smithi161 ceph-mon[80292]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:20.275 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:20 smithi161 ceph-mon[80292]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:20.275 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:20 smithi161 ceph-mon[80292]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:59:20.275 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:20 smithi161 ceph-mon[80292]: osdmap e67: 6 total, 5 up, 6 in 2024-09-18T12:59:20.275 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:20 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2510689717' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:20.275 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:20 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3998607019' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:20.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:20 smithi045 ceph-mon[109129]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:20.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:20 smithi045 ceph-mon[109129]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:20.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:20 smithi045 ceph-mon[109129]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:59:20.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:20 smithi045 ceph-mon[109129]: osdmap e67: 6 total, 5 up, 6 in 2024-09-18T12:59:20.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:20 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2510689717' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:20.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:20 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3998607019' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.306+0000 7f64bcdb7640 1 -- 172.21.15.45:0/1483844007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f64b8108d70 con 0x7f64b8100800 2024-09-18T12:59:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.306+0000 7f64a77fe640 1 -- 172.21.15.45:0/1483844007 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+290 (secure 0 0 0) 0x7f64a808ed80 con 0x7f64b8100800 2024-09-18T12:59:20.308 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-09-18T12:59:20.308 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:59:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:59:20.308 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-18T12:59:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: osd.4 (root=default,host=smithi161) is down 2024-09-18T12:59:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 -- 172.21.15.45:0/1483844007 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f64a007af80 msgr2=0x7f64a007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f64a007af80 0x7f64a007d440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f64b80fead0 tx=0x7f64ac00b390 comp rx=0 tx=0).stop 2024-09-18T12:59:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 -- 172.21.15.45:0/1483844007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b8100800 msgr2=0x7f64b819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b8100800 0x7f64b819d670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f64a8031460 tx=0x7f64a80045e0 comp rx=0 tx=0).stop 2024-09-18T12:59:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 -- 172.21.15.45:0/1483844007 shutdown_connections 2024-09-18T12:59:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f64a007af80 0x7f64a007d440 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64b8106800 0x7f64b819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 --2- 172.21.15.45:0/1483844007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b8100800 0x7f64b819d670 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 -- 172.21.15.45:0/1483844007 >> 172.21.15.45:0/1483844007 conn(0x7f64b80fc520 msgr2=0x7f64b80fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 -- 172.21.15.45:0/1483844007 shutdown_connections 2024-09-18T12:59:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:20.309+0000 7f64bcdb7640 1 -- 172.21.15.45:0/1483844007 wait complete. 2024-09-18T12:59:20.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:20 smithi161 podman[92923]: 2024-09-18 12:59:20.274622598 +0000 UTC m=+0.638862119 container remove 53ec1c4a77a8e7282b96d6ff4871b67c5136331a0e9fa51f8d0c4d0042d85936 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-18T12:59:20.887 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:20 smithi161 podman[93011]: 2024-09-18 12:59:20.517858138 +0000 UTC m=+0.016087362 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:59:20.887 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:20 smithi161 podman[93011]: 2024-09-18 12:59:20.642212896 +0000 UTC m=+0.140442118 container create d6f63b351f2a0c166677a941a9360f539da19d8931657fae6cad6026c9386115 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-18T12:59:20.888 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:20 smithi161 podman[93011]: 2024-09-18 12:59:20.886320797 +0000 UTC m=+0.384550017 container init d6f63b351f2a0c166677a941a9360f539da19d8931657fae6cad6026c9386115 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:59:21.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:21 smithi161 ceph-mon[80292]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:21.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:21 smithi161 ceph-mon[80292]: osdmap e68: 6 total, 5 up, 6 in 2024-09-18T12:59:21.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:21 smithi161 ceph-mon[80292]: pgmap v219: 65 pgs: 6 stale+active+clean, 59 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-18T12:59:21.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:21 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1483844007' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:21.292 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:20 smithi161 podman[93011]: 2024-09-18 12:59:20.889968392 +0000 UTC m=+0.388197614 container start d6f63b351f2a0c166677a941a9360f539da19d8931657fae6cad6026c9386115 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:59:21.293 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:20 smithi161 podman[93011]: 2024-09-18 12:59:20.98632013 +0000 UTC m=+0.484549368 container attach d6f63b351f2a0c166677a941a9360f539da19d8931657fae6cad6026c9386115 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-18T12:59:21.293 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:21 smithi161 podman[93011]: 2024-09-18 12:59:21.079288133 +0000 UTC m=+0.577517366 container died d6f63b351f2a0c166677a941a9360f539da19d8931657fae6cad6026c9386115 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T12:59:21.461 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:21 smithi045 ceph-mon[109129]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:21.461 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:21 smithi045 ceph-mon[109129]: osdmap e68: 6 total, 5 up, 6 in 2024-09-18T12:59:21.461 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:21 smithi045 ceph-mon[109129]: pgmap v219: 65 pgs: 6 stale+active+clean, 59 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-18T12:59:21.461 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:21 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1483844007' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:22.042 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:21 smithi161 podman[93034]: 2024-09-18 12:59:21.665135582 +0000 UTC m=+0.575311408 container remove d6f63b351f2a0c166677a941a9360f539da19d8931657fae6cad6026c9386115 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-18T12:59:22.042 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:21 smithi161 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-18T12:59:22.043 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:21 smithi161 systemd[1]: Stopped Ceph osd.4 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:59:22.043 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:21 smithi161 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.4.service: Consumed 52.752s CPU time. 2024-09-18T12:59:22.043 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:21 smithi161 systemd[1]: Starting Ceph osd.4 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:59:22.357 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:22 smithi161 podman[93135]: 2024-09-18 12:59:22.006433855 +0000 UTC m=+0.016213253 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:59:22.358 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:22 smithi161 podman[93135]: 2024-09-18 12:59:22.14152236 +0000 UTC m=+0.151301758 container create 047e4bd0a2161b3c1e05cf4da27fd170957d2f36e12fad2e27e2ed226dfebc86 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-18T12:59:22.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:22 smithi045 ceph-mon[109129]: Health check failed: Degraded data redundancy: 31/255 objects degraded (12.157%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T12:59:22.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:22 smithi161 ceph-mon[80292]: Health check failed: Degraded data redundancy: 31/255 objects degraded (12.157%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T12:59:22.792 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:22 smithi161 podman[93135]: 2024-09-18 12:59:22.410599049 +0000 UTC m=+0.420378452 container init 047e4bd0a2161b3c1e05cf4da27fd170957d2f36e12fad2e27e2ed226dfebc86 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-18T12:59:22.792 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:22 smithi161 podman[93135]: 2024-09-18 12:59:22.414288357 +0000 UTC m=+0.424067756 container start 047e4bd0a2161b3c1e05cf4da27fd170957d2f36e12fad2e27e2ed226dfebc86 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-18T12:59:22.792 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:22 smithi161 podman[93135]: 2024-09-18 12:59:22.502268827 +0000 UTC m=+0.512048230 container attach 047e4bd0a2161b3c1e05cf4da27fd170957d2f36e12fad2e27e2ed226dfebc86 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:59:22.793 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:22 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate[93151]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:59:22.793 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:22 smithi161 bash[93135]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:59:22.793 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:22 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate[93151]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:59:22.793 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:22 smithi161 bash[93135]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:59:23.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:23 smithi161 ceph-mon[80292]: pgmap v220: 65 pgs: 10 active+undersized, 3 stale+active+clean, 9 active+undersized+degraded, 43 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 31/255 objects degraded (12.157%) 2024-09-18T12:59:23.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:23.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:23 smithi045 ceph-mon[109129]: pgmap v220: 65 pgs: 10 active+undersized, 3 stale+active+clean, 9 active+undersized+degraded, 43 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 31/255 objects degraded (12.157%) 2024-09-18T12:59:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:25.217 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:24 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate[93151]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:59:25.217 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:24 smithi161 bash[93135]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:59:25.217 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:24 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate[93151]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:59:25.217 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:24 smithi161 bash[93135]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T12:59:25.217 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate[93151]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:59:25.217 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 bash[93135]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T12:59:25.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:25 smithi161 ceph-mon[80292]: pgmap v221: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 44/255 objects degraded (17.255%) 2024-09-18T12:59:25.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate[93151]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:59:25.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 bash[93135]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T12:59:25.543 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate[93151]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-18T12:59:25.543 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 bash[93135]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-18T12:59:25.543 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate[93151]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:59:25.543 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 bash[93135]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:59:25.543 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate[93151]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-18T12:59:25.543 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 bash[93135]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-18T12:59:25.543 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 podman[93135]: 2024-09-18 12:59:25.244723729 +0000 UTC m=+3.254503128 container died 047e4bd0a2161b3c1e05cf4da27fd170957d2f36e12fad2e27e2ed226dfebc86 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T12:59:25.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:25 smithi045 ceph-mon[109129]: pgmap v221: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 44/255 objects degraded (17.255%) 2024-09-18T12:59:26.200 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:25 smithi161 podman[93325]: 2024-09-18 12:59:25.881187421 +0000 UTC m=+0.629825710 container remove 047e4bd0a2161b3c1e05cf4da27fd170957d2f36e12fad2e27e2ed226dfebc86 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-18T12:59:26.201 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:26 smithi161 podman[93385]: 2024-09-18 12:59:25.996089625 +0000 UTC m=+0.016389459 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:59:26.201 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:26 smithi161 podman[93385]: 2024-09-18 12:59:26.106868528 +0000 UTC m=+0.127168367 container create b3c49339a90c33d022f2f6ba637a505bff690d2b87185295c458a746f64a6700 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-18T12:59:26.792 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:26 smithi161 podman[93385]: 2024-09-18 12:59:26.309240523 +0000 UTC m=+0.329540368 container init b3c49339a90c33d022f2f6ba637a505bff690d2b87185295c458a746f64a6700 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-18T12:59:26.792 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:26 smithi161 podman[93385]: 2024-09-18 12:59:26.312457422 +0000 UTC m=+0.332757252 container start b3c49339a90c33d022f2f6ba637a505bff690d2b87185295c458a746f64a6700 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-18T12:59:26.792 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:26 smithi161 ceph-osd[93405]: -- 172.21.15.161:0/2286360549 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fbb67861e0 con 0x55fbb5925c00 2024-09-18T12:59:26.792 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:26 smithi161 bash[93385]: b3c49339a90c33d022f2f6ba637a505bff690d2b87185295c458a746f64a6700 2024-09-18T12:59:26.792 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:26 smithi161 systemd[1]: Started Ceph osd.4 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:59:27.727 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:27 smithi161 ceph-mon[80292]: pgmap v222: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 44/255 objects degraded (17.255%) 2024-09-18T12:59:27.728 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:27 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:27.728 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:27 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:27.728 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:27 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:27 smithi045 ceph-mon[109129]: pgmap v222: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 44/255 objects degraded (17.255%) 2024-09-18T12:59:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:27 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:27 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:27 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:28.042 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:27 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T12:59:27.948+0000 7face59bb640 -1 Falling back to public interface 2024-09-18T12:59:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:29 smithi045 ceph-mon[109129]: pgmap v223: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 111 B/s rd, 0 op/s; 44/255 objects degraded (17.255%) 2024-09-18T12:59:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:29.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:29 smithi161 ceph-mon[80292]: pgmap v223: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 111 B/s rd, 0 op/s; 44/255 objects degraded (17.255%) 2024-09-18T12:59:29.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:29.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:30.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:30 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:30.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:30 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:30.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:30 smithi045 ceph-mon[109129]: pgmap v224: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 100 B/s rd, 0 op/s; 44/255 objects degraded (17.255%) 2024-09-18T12:59:30.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:30 smithi045 ceph-mon[109129]: Health check update: Degraded data redundancy: 44/255 objects degraded (17.255%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T12:59:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:30 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:30 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:30 smithi161 ceph-mon[80292]: pgmap v224: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 100 B/s rd, 0 op/s; 44/255 objects degraded (17.255%) 2024-09-18T12:59:31.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:30 smithi161 ceph-mon[80292]: Health check update: Degraded data redundancy: 44/255 objects degraded (17.255%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T12:59:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: pgmap v225: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 44/255 objects degraded (17.255%) 2024-09-18T12:59:33.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:33.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:33.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:33.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:59:33.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:33.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:33.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:33.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:33.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:33.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:59:33.792 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T12:59:33.454+0000 7face59bb640 -1 osd.4 66 log_to_monitors true 2024-09-18T12:59:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: pgmap v225: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 44/255 objects degraded (17.255%) 2024-09-18T12:59:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T12:59:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T12:59:33.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:33.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:33.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:33.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:59:34.776 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 12:59:34 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T12:59:34.339+0000 7facdd765640 -1 osd.4 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:59:34.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:34 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:59:34.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:34 smithi161 ceph-mon[80292]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T12:59:34.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:34 smithi161 ceph-mon[80292]: from='osd.4 [v2:172.21.15.161:6808/1509001433,v1:172.21.15.161:6809/1509001433]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:59:34.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:34 smithi161 ceph-mon[80292]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:59:34.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:34 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:59:34.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:34 smithi045 ceph-mon[109129]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T12:59:34.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:34 smithi045 ceph-mon[109129]: from='osd.4 [v2:172.21.15.161:6808/1509001433,v1:172.21.15.161:6809/1509001433]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:59:34.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:34 smithi045 ceph-mon[109129]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-18T12:59:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:35 smithi045 ceph-mon[109129]: pgmap v226: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 44/255 objects degraded (17.255%) 2024-09-18T12:59:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:35 smithi045 ceph-mon[109129]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:59:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:35 smithi045 ceph-mon[109129]: osdmap e69: 6 total, 5 up, 6 in 2024-09-18T12:59:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:35 smithi045 ceph-mon[109129]: from='osd.4 [v2:172.21.15.161:6808/1509001433,v1:172.21.15.161:6809/1509001433]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T12:59:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:35 smithi045 ceph-mon[109129]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T12:59:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:35 smithi161 ceph-mon[80292]: pgmap v226: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 244 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 44/255 objects degraded (17.255%) 2024-09-18T12:59:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:35 smithi161 ceph-mon[80292]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T12:59:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:35 smithi161 ceph-mon[80292]: osdmap e69: 6 total, 5 up, 6 in 2024-09-18T12:59:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:35 smithi161 ceph-mon[80292]: from='osd.4 [v2:172.21.15.161:6808/1509001433,v1:172.21.15.161:6809/1509001433]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T12:59:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:35 smithi161 ceph-mon[80292]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T12:59:36.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:36 smithi045 ceph-mon[109129]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:59:36.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:36 smithi045 ceph-mon[109129]: osd.4 [v2:172.21.15.161:6808/1509001433,v1:172.21.15.161:6809/1509001433] boot 2024-09-18T12:59:36.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:36 smithi045 ceph-mon[109129]: osdmap e70: 6 total, 6 up, 6 in 2024-09-18T12:59:36.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:36 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-18T12:59:36.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:36 smithi045 ceph-mon[109129]: osdmap e71: 6 total, 6 up, 6 in 2024-09-18T12:59:36.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:36 smithi161 ceph-mon[80292]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T12:59:36.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:36 smithi161 ceph-mon[80292]: osd.4 [v2:172.21.15.161:6808/1509001433,v1:172.21.15.161:6809/1509001433] boot 2024-09-18T12:59:36.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:36 smithi161 ceph-mon[80292]: osdmap e70: 6 total, 6 up, 6 in 2024-09-18T12:59:36.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:36 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-18T12:59:36.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:36 smithi161 ceph-mon[80292]: osdmap e71: 6 total, 6 up, 6 in 2024-09-18T12:59:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:37 smithi045 ceph-mon[109129]: pgmap v229: 65 pgs: 10 peering, 14 active+undersized, 10 active+undersized+degraded, 31 active+clean; 244 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 22/255 objects degraded (8.627%) 2024-09-18T12:59:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:37 smithi045 ceph-mon[109129]: Health check update: Degraded data redundancy: 22/255 objects degraded (8.627%), 10 pgs degraded (PG_DEGRADED) 2024-09-18T12:59:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:37 smithi161 ceph-mon[80292]: pgmap v229: 65 pgs: 10 peering, 14 active+undersized, 10 active+undersized+degraded, 31 active+clean; 244 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 22/255 objects degraded (8.627%) 2024-09-18T12:59:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:37 smithi161 ceph-mon[80292]: Health check update: Degraded data redundancy: 22/255 objects degraded (8.627%), 10 pgs degraded (PG_DEGRADED) 2024-09-18T12:59:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:39 smithi045 ceph-mon[109129]: pgmap v231: 65 pgs: 16 peering, 5 active+undersized, 2 active+undersized+degraded, 42 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 5/255 objects degraded (1.961%) 2024-09-18T12:59:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:39 smithi161 ceph-mon[80292]: pgmap v231: 65 pgs: 16 peering, 5 active+undersized, 2 active+undersized+degraded, 42 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 5/255 objects degraded (1.961%) 2024-09-18T12:59:40.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:40 smithi045 ceph-mon[109129]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/255 objects degraded (1.961%), 2 pgs degraded) 2024-09-18T12:59:40.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:40 smithi161 ceph-mon[80292]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/255 objects degraded (1.961%), 2 pgs degraded) 2024-09-18T12:59:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:41 smithi045 ceph-mon[109129]: pgmap v232: 65 pgs: 16 peering, 49 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2024-09-18T12:59:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:41 smithi161 ceph-mon[80292]: pgmap v232: 65 pgs: 16 peering, 49 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2024-09-18T12:59:43.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:43 smithi045 ceph-mon[109129]: pgmap v233: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-18T12:59:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:43 smithi161 ceph-mon[80292]: pgmap v233: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-18T12:59:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:45 smithi045 ceph-mon[109129]: pgmap v234: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-18T12:59:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:45 smithi161 ceph-mon[80292]: pgmap v234: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-18T12:59:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:47 smithi045 ceph-mon[109129]: pgmap v235: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-18T12:59:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:47 smithi161 ceph-mon[80292]: pgmap v235: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-18T12:59:48.629 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:48 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:59:48.630 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:48 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:48.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:48 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-18T12:59:48.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:48 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:49.695 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:49 smithi161 ceph-mon[80292]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:59:49.695 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:49 smithi161 ceph-mon[80292]: Upgrade: osd.5 is safe to restart 2024-09-18T12:59:49.695 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:49 smithi161 ceph-mon[80292]: pgmap v236: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 857 B/s rd, 1 op/s 2024-09-18T12:59:49.695 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:49.695 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-18T12:59:49.695 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:49 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:49 smithi045 ceph-mon[109129]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T12:59:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:49 smithi045 ceph-mon[109129]: Upgrade: osd.5 is safe to restart 2024-09-18T12:59:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:49 smithi045 ceph-mon[109129]: pgmap v236: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 857 B/s rd, 1 op/s 2024-09-18T12:59:49.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:49.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-18T12:59:49.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:49 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T12:59:50.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.407+0000 7fda18d65640 1 -- 172.21.15.45:0/3635387536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda14106800 msgr2=0x7fda14106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.407+0000 7fda18d65640 1 --2- 172.21.15.45:0/3635387536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda14106800 0x7fda14106be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fda040097e0 tx=0x7fda0402a3f0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.407+0000 7fda18d65640 1 -- 172.21.15.45:0/3635387536 shutdown_connections 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.407+0000 7fda18d65640 1 --2- 172.21.15.45:0/3635387536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda14100800 0x7fda14100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.407+0000 7fda18d65640 1 --2- 172.21.15.45:0/3635387536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda14106800 0x7fda14106be0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.407+0000 7fda18d65640 1 -- 172.21.15.45:0/3635387536 >> 172.21.15.45:0/3635387536 conn(0x7fda140fc520 msgr2=0x7fda140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.407+0000 7fda18d65640 1 -- 172.21.15.45:0/3635387536 shutdown_connections 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.407+0000 7fda18d65640 1 -- 172.21.15.45:0/3635387536 wait complete. 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.408+0000 7fda18d65640 1 Processor -- start 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.408+0000 7fda18d65640 1 -- start start 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda18d65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda14100800 0x7fda14107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:50.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda18d65640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda14106800 0x7fda14107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:50.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda18d65640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fda1410dcb0 con 0x7fda14100800 2024-09-18T12:59:50.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda18d65640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fda1410db30 con 0x7fda14106800 2024-09-18T12:59:50.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda1259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda14100800 0x7fda14107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:50.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda1259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda14100800 0x7fda14107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39914/0 (socket says 172.21.15.45:39914) 2024-09-18T12:59:50.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda1259c640 1 -- 172.21.15.45:0/2477875515 learned_addr learned my addr 172.21.15.45:0/2477875515 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:50.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda11d9b640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda14106800 0x7fda14107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:50.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda1259c640 1 -- 172.21.15.45:0/2477875515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda14106800 msgr2=0x7fda14107c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:50.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda1259c640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda14106800 0x7fda14107c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda1259c640 1 -- 172.21.15.45:0/2477875515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda141081b0 con 0x7fda14100800 2024-09-18T12:59:50.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.409+0000 7fda1259c640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda14100800 0x7fda14107730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda0402a910 tx=0x7fda04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:50.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.410+0000 7fda037fe640 1 -- 172.21.15.45:0/2477875515 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda04040070 con 0x7fda14100800 2024-09-18T12:59:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.410+0000 7fda037fe640 1 -- 172.21.15.45:0/2477875515 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda04031400 con 0x7fda14100800 2024-09-18T12:59:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.410+0000 7fda18d65640 1 -- 172.21.15.45:0/2477875515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda14108440 con 0x7fda14100800 2024-09-18T12:59:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.410+0000 7fda037fe640 1 -- 172.21.15.45:0/2477875515 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda04003b10 con 0x7fda14100800 2024-09-18T12:59:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.410+0000 7fda18d65640 1 -- 172.21.15.45:0/2477875515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda141a3dd0 con 0x7fda14100800 2024-09-18T12:59:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.411+0000 7fda18d65640 1 -- 172.21.15.45:0/2477875515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda14101f40 con 0x7fda14100800 2024-09-18T12:59:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.412+0000 7fda037fe640 1 -- 172.21.15.45:0/2477875515 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fda04039040 con 0x7fda14100800 2024-09-18T12:59:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.412+0000 7fda037fe640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd9fc07af40 0x7fd9fc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.412+0000 7fda037fe640 1 -- 172.21.15.45:0/2477875515 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6070+0+0 (secure 0 0 0) 0x7fda040bf300 con 0x7fda14100800 2024-09-18T12:59:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.413+0000 7fda11d9b640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd9fc07af40 0x7fd9fc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:50.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.413+0000 7fda11d9b640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd9fc07af40 0x7fd9fc07d400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fda141091c0 tx=0x7fda08009260 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:50.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.417+0000 7fda037fe640 1 -- 172.21.15.45:0/2477875515 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fda0408a950 con 0x7fda14100800 2024-09-18T12:59:50.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.623+0000 7fda18d65640 1 -- 172.21.15.45:0/2477875515 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fda1406a9c0 con 0x7fd9fc07af40 2024-09-18T12:59:50.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.624+0000 7fda037fe640 1 -- 172.21.15.45:0/2477875515 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fda1406a9c0 con 0x7fd9fc07af40 2024-09-18T12:59:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 -- 172.21.15.45:0/2477875515 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd9fc07af40 msgr2=0x7fd9fc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd9fc07af40 0x7fd9fc07d400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fda141091c0 tx=0x7fda08009260 comp rx=0 tx=0).stop 2024-09-18T12:59:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 -- 172.21.15.45:0/2477875515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda14100800 msgr2=0x7fda14107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda14100800 0x7fda14107730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda0402a910 tx=0x7fda04004270 comp rx=0 tx=0).stop 2024-09-18T12:59:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 -- 172.21.15.45:0/2477875515 shutdown_connections 2024-09-18T12:59:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fd9fc07af40 0x7fd9fc07d400 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda14106800 0x7fda14107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 --2- 172.21.15.45:0/2477875515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda14100800 0x7fda14107730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 -- 172.21.15.45:0/2477875515 >> 172.21.15.45:0/2477875515 conn(0x7fda140fc520 msgr2=0x7fda1406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 -- 172.21.15.45:0/2477875515 shutdown_connections 2024-09-18T12:59:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.626+0000 7fda18d65640 1 -- 172.21.15.45:0/2477875515 wait complete. 2024-09-18T12:59:50.629 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:50 smithi045 ceph-mon[109129]: Upgrade: Updating osd.5 2024-09-18T12:59:50.629 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:50 smithi045 ceph-mon[109129]: Deploying daemon osd.5 on smithi161 2024-09-18T12:59:50.637 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T12:59:50.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:50 smithi161 ceph-mon[80292]: Upgrade: Updating osd.5 2024-09-18T12:59:50.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:50 smithi161 ceph-mon[80292]: Deploying daemon osd.5 on smithi161 2024-09-18T12:59:50.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.712+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/3401197203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f541034a0 msgr2=0x7f3f5410b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:50.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.712+0000 7f3f5a1b3640 1 --2- 172.21.15.45:0/3401197203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f541034a0 0x7f3f5410b990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009880 tx=0x7f3f3c02a530 comp rx=0 tx=0).stop 2024-09-18T12:59:50.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.712+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/3401197203 shutdown_connections 2024-09-18T12:59:50.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.712+0000 7f3f5a1b3640 1 --2- 172.21.15.45:0/3401197203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f541034a0 0x7f3f5410b990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.712+0000 7f3f5a1b3640 1 --2- 172.21.15.45:0/3401197203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54102b80 0x7f3f54102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.712+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/3401197203 >> 172.21.15.45:0/3401197203 conn(0x7f3f540fc520 msgr2=0x7f3f540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:50.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.712+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/3401197203 shutdown_connections 2024-09-18T12:59:50.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.712+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/3401197203 wait complete. 2024-09-18T12:59:50.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.713+0000 7f3f5a1b3640 1 Processor -- start 2024-09-18T12:59:50.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.713+0000 7f3f5a1b3640 1 -- start start 2024-09-18T12:59:50.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.713+0000 7f3f5a1b3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54102b80 0x7f3f5419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:50.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.713+0000 7f3f5a1b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f541034a0 0x7f3f5419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.713+0000 7f3f5a1b3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5410edd0 con 0x7f3f541034a0 2024-09-18T12:59:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.713+0000 7f3f5a1b3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5410ec50 con 0x7f3f54102b80 2024-09-18T12:59:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.713+0000 7f3f52ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f541034a0 0x7f3f5419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.713+0000 7f3f52ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f541034a0 0x7f3f5419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39932/0 (socket says 172.21.15.45:39932) 2024-09-18T12:59:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.713+0000 7f3f52ffd640 1 -- 172.21.15.45:0/712912345 learned_addr learned my addr 172.21.15.45:0/712912345 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.713+0000 7f3f537fe640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54102b80 0x7f3f5419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.714+0000 7f3f52ffd640 1 -- 172.21.15.45:0/712912345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54102b80 msgr2=0x7f3f5419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.714+0000 7f3f52ffd640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54102b80 0x7f3f5419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.714+0000 7f3f52ffd640 1 -- 172.21.15.45:0/712912345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f541977c0 con 0x7f3f541034a0 2024-09-18T12:59:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.714+0000 7f3f52ffd640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f541034a0 0x7f3f5419db80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c004f90 tx=0x7f3f3c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:50.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.714+0000 7f3f50ff9640 1 -- 172.21.15.45:0/712912345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f3c03f070 con 0x7f3f541034a0 2024-09-18T12:59:50.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.714+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/712912345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f54197a50 con 0x7f3f541034a0 2024-09-18T12:59:50.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.714+0000 7f3f50ff9640 1 -- 172.21.15.45:0/712912345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f3c004c70 con 0x7f3f541034a0 2024-09-18T12:59:50.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.714+0000 7f3f50ff9640 1 -- 172.21.15.45:0/712912345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f3c035030 con 0x7f3f541034a0 2024-09-18T12:59:50.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.714+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/712912345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f54197f80 con 0x7f3f541034a0 2024-09-18T12:59:50.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.715+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/712912345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f5406a9d0 con 0x7f3f541034a0 2024-09-18T12:59:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.716+0000 7f3f50ff9640 1 -- 172.21.15.45:0/712912345 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f3f3c042070 con 0x7f3f541034a0 2024-09-18T12:59:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.716+0000 7f3f50ff9640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4007af40 0x7f3f4007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.717+0000 7f3f537fe640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4007af40 0x7f3f4007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.717+0000 7f3f50ff9640 1 -- 172.21.15.45:0/712912345 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6070+0+0 (secure 0 0 0) 0x7f3f3c0be9f0 con 0x7f3f541034a0 2024-09-18T12:59:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.717+0000 7f3f537fe640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4007af40 0x7f3f4007d400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3f44005d00 tx=0x7f3f4400b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:50.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.721+0000 7f3f50ff9640 1 -- 172.21.15.45:0/712912345 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3f3c08a040 con 0x7f3f541034a0 2024-09-18T12:59:50.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.923+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/712912345 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3f54198230 con 0x7f3f4007af40 2024-09-18T12:59:50.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.924+0000 7f3f50ff9640 1 -- 172.21.15.45:0/712912345 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f3f54198230 con 0x7f3f4007af40 2024-09-18T12:59:50.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/712912345 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4007af40 msgr2=0x7f3f4007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:50.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4007af40 0x7f3f4007d400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3f44005d00 tx=0x7f3f4400b410 comp rx=0 tx=0).stop 2024-09-18T12:59:50.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/712912345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f541034a0 msgr2=0x7f3f5419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:50.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f541034a0 0x7f3f5419db80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c004f90 tx=0x7f3f3c0048f0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/712912345 shutdown_connections 2024-09-18T12:59:50.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3f4007af40 0x7f3f4007d400 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f541034a0 0x7f3f5419db80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 --2- 172.21.15.45:0/712912345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f54102b80 0x7f3f5419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:50.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/712912345 >> 172.21.15.45:0/712912345 conn(0x7f3f540fc520 msgr2=0x7f3f54103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:50.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/712912345 shutdown_connections 2024-09-18T12:59:50.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:50.927+0000 7f3f5a1b3640 1 -- 172.21.15.45:0/712912345 wait complete. 2024-09-18T12:59:51.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.011+0000 7fdccaca4640 1 -- 172.21.15.45:0/3908988477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc41033d0 msgr2=0x7fdcc410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.011+0000 7fdccaca4640 1 --2- 172.21.15.45:0/3908988477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc41033d0 0x7fdcc410b8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009c20 tx=0x7fdcb402aa00 comp rx=0 tx=0).stop 2024-09-18T12:59:51.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.011+0000 7fdccaca4640 1 -- 172.21.15.45:0/3908988477 shutdown_connections 2024-09-18T12:59:51.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.011+0000 7fdccaca4640 1 --2- 172.21.15.45:0/3908988477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc41033d0 0x7fdcc410b8c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.011+0000 7fdccaca4640 1 --2- 172.21.15.45:0/3908988477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc4102ab0 0x7fdcc4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.011+0000 7fdccaca4640 1 -- 172.21.15.45:0/3908988477 >> 172.21.15.45:0/3908988477 conn(0x7fdcc40fc550 msgr2=0x7fdcc40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:51.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.011+0000 7fdccaca4640 1 -- 172.21.15.45:0/3908988477 shutdown_connections 2024-09-18T12:59:51.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.011+0000 7fdccaca4640 1 -- 172.21.15.45:0/3908988477 wait complete. 2024-09-18T12:59:51.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.011+0000 7fdccaca4640 1 Processor -- start 2024-09-18T12:59:51.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.011+0000 7fdccaca4640 1 -- start start 2024-09-18T12:59:51.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdccaca4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc4102ab0 0x7fdcc419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdccaca4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc41033d0 0x7fdcc419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdccaca4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc410edc0 con 0x7fdcc4102ab0 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdccaca4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc410ec40 con 0x7fdcc41033d0 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdcc8a40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc4102ab0 0x7fdcc419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdcc8a40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc4102ab0 0x7fdcc419d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39944/0 (socket says 172.21.15.45:39944) 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdcc8a40640 1 -- 172.21.15.45:0/1187544215 learned_addr learned my addr 172.21.15.45:0/1187544215 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdcc3fff640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc41033d0 0x7fdcc419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdcc8a40640 1 -- 172.21.15.45:0/1187544215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc41033d0 msgr2=0x7fdcc419db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdcc8a40640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc41033d0 0x7fdcc419db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdcc8a40640 1 -- 172.21.15.45:0/1187544215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc4197790 con 0x7fdcc4102ab0 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdcc8a40640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc4102ab0 0x7fdcc419d610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00c8a0 tx=0x7fdcac00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.012+0000 7fdcc1ffb640 1 -- 172.21.15.45:0/1187544215 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdcac0079b0 con 0x7fdcc4102ab0 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.013+0000 7fdcc1ffb640 1 -- 172.21.15.45:0/1187544215 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdcac007b50 con 0x7fdcc4102ab0 2024-09-18T12:59:51.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.013+0000 7fdcc1ffb640 1 -- 172.21.15.45:0/1187544215 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdcac018700 con 0x7fdcc4102ab0 2024-09-18T12:59:51.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.013+0000 7fdccaca4640 1 -- 172.21.15.45:0/1187544215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc4197a80 con 0x7fdcc4102ab0 2024-09-18T12:59:51.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.013+0000 7fdccaca4640 1 -- 172.21.15.45:0/1187544215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc4198010 con 0x7fdcc4102ab0 2024-09-18T12:59:51.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.014+0000 7fdccaca4640 1 -- 172.21.15.45:0/1187544215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc406a580 con 0x7fdcc4102ab0 2024-09-18T12:59:51.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.014+0000 7fdcc1ffb640 1 -- 172.21.15.45:0/1187544215 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fdcac007d00 con 0x7fdcc4102ab0 2024-09-18T12:59:51.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.015+0000 7fdcc1ffb640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdcb007af40 0x7fdcb007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.015+0000 7fdcc3fff640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdcb007af40 0x7fdcb007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.015+0000 7fdcc1ffb640 1 -- 172.21.15.45:0/1187544215 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6070+0+0 (secure 0 0 0) 0x7fdcac09e1d0 con 0x7fdcc4102ab0 2024-09-18T12:59:51.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.016+0000 7fdcc3fff640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdcb007af40 0x7fdcb007d400 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdcc41088c0 tx=0x7fdcb403a040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:51.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.019+0000 7fdcc1ffb640 1 -- 172.21.15.45:0/1187544215 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fdcac014030 con 0x7fdcc4102ab0 2024-09-18T12:59:51.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.211+0000 7fdccaca4640 1 -- 172.21.15.45:0/1187544215 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdcc4198320 con 0x7fdcb007af40 2024-09-18T12:59:51.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.220+0000 7fdcc1ffb640 1 -- 172.21.15.45:0/1187544215 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fdcc4198320 con 0x7fdcb007af40 2024-09-18T12:59:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T12:59:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (4m) 89s ago 15m 20.0M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T12:59:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (8m) 89s ago 16m 8975k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T12:59:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (7m) 22s ago 15m 8572k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T12:59:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (3m) 89s ago 15m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T12:59:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (3m) 22s ago 15m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T12:59:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (4m) 89s ago 15m 79.3M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T12:59:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (10m) 89s ago 10m 92.1M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T12:59:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (10m) 89s ago 10m 148M - 19.1.1-330-gc2ddf972 ebb0615149de a7ddc7b09b82 2024-09-18T12:59:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (10m) 22s ago 10m 18.5M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (10m) 22s ago 10m 17.0M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (7m) 89s ago 17m 524M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (6m) 22s ago 15m 458M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (3m) 89s ago 17m 42.6M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (3m) 22s ago 14m 36.9M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (5m) 89s ago 15m 11.3M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (5m) 22s ago 15m 11.4M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (2m) 89s ago 13m 84.1M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (2m) 89s ago 13m 89.2M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 7d4cd0351725 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (95s) 89s ago 12m 12.2M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4f620cf3977f 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (59s) 22s ago 12m 97.5M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1fbe6c224b87 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (25s) 22s ago 11m 12.2M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b3c49339a90c 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (11m) 22s ago 11m 202M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 87cb190cb0bf 2024-09-18T12:59:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (5m) 89s ago 15m 54.1M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T12:59:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.222+0000 7fdccaca4640 1 -- 172.21.15.45:0/1187544215 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdcb007af40 msgr2=0x7fdcb007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.222+0000 7fdccaca4640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdcb007af40 0x7fdcb007d400 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdcc41088c0 tx=0x7fdcb403a040 comp rx=0 tx=0).stop 2024-09-18T12:59:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.222+0000 7fdccaca4640 1 -- 172.21.15.45:0/1187544215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc4102ab0 msgr2=0x7fdcc419d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.222+0000 7fdccaca4640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc4102ab0 0x7fdcc419d610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00c8a0 tx=0x7fdcac00cd60 comp rx=0 tx=0).stop 2024-09-18T12:59:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.223+0000 7fdccaca4640 1 -- 172.21.15.45:0/1187544215 shutdown_connections 2024-09-18T12:59:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.223+0000 7fdccaca4640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdcb007af40 0x7fdcb007d400 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.223+0000 7fdccaca4640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc41033d0 0x7fdcc419db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.223+0000 7fdccaca4640 1 --2- 172.21.15.45:0/1187544215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc4102ab0 0x7fdcc419d610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.223+0000 7fdccaca4640 1 -- 172.21.15.45:0/1187544215 >> 172.21.15.45:0/1187544215 conn(0x7fdcc40fc550 msgr2=0x7fdcc410aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.223+0000 7fdccaca4640 1 -- 172.21.15.45:0/1187544215 shutdown_connections 2024-09-18T12:59:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.223+0000 7fdccaca4640 1 -- 172.21.15.45:0/1187544215 wait complete. 2024-09-18T12:59:51.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.306+0000 7f8c4a517640 1 -- 172.21.15.45:0/3816964814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c44101900 msgr2=0x7f8c44101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.306+0000 7f8c4a517640 1 --2- 172.21.15.45:0/3816964814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c44101900 0x7f8c44101d60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009880 tx=0x7f8c3802a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.306+0000 7f8c4a517640 1 -- 172.21.15.45:0/3816964814 shutdown_connections 2024-09-18T12:59:51.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.306+0000 7f8c4a517640 1 --2- 172.21.15.45:0/3816964814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c44101900 0x7f8c44101d60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.306+0000 7f8c4a517640 1 --2- 172.21.15.45:0/3816964814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c44107900 0x7f8c44107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.306+0000 7f8c4a517640 1 -- 172.21.15.45:0/3816964814 >> 172.21.15.45:0/3816964814 conn(0x7f8c440fd600 msgr2=0x7f8c440ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:51.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.306+0000 7f8c4a517640 1 -- 172.21.15.45:0/3816964814 shutdown_connections 2024-09-18T12:59:51.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.306+0000 7f8c4a517640 1 -- 172.21.15.45:0/3816964814 wait complete. 2024-09-18T12:59:51.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.306+0000 7f8c4a517640 1 Processor -- start 2024-09-18T12:59:51.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.306+0000 7f8c4a517640 1 -- start start 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c4a517640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c44101900 0x7f8c440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c4a517640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c44107900 0x7f8c44074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c4a517640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4410edb0 con 0x7f8c44101900 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c4a517640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4410ec30 con 0x7f8c44107900 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c43fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c44101900 0x7f8c440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c43fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c44101900 0x7f8c440744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39974/0 (socket says 172.21.15.45:39974) 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c43fff640 1 -- 172.21.15.45:0/3341362461 learned_addr learned my addr 172.21.15.45:0/3341362461 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c437fe640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c44107900 0x7f8c44074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c43fff640 1 -- 172.21.15.45:0/3341362461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c44107900 msgr2=0x7f8c44074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c43fff640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c44107900 0x7f8c44074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.307+0000 7f8c43fff640 1 -- 172.21.15.45:0/3341362461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c44074f70 con 0x7f8c44101900 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.308+0000 7f8c43fff640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c44101900 0x7f8c440744f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400e970 tx=0x7f8c3400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:51.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.308+0000 7f8c417fa640 1 -- 172.21.15.45:0/3341362461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c3400cac0 con 0x7f8c44101900 2024-09-18T12:59:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.308+0000 7f8c417fa640 1 -- 172.21.15.45:0/3341362461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c3400cc60 con 0x7f8c44101900 2024-09-18T12:59:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.308+0000 7f8c4a517640 1 -- 172.21.15.45:0/3341362461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c44075260 con 0x7f8c44101900 2024-09-18T12:59:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.308+0000 7f8c417fa640 1 -- 172.21.15.45:0/3341362461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c34018720 con 0x7f8c44101900 2024-09-18T12:59:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.308+0000 7f8c4a517640 1 -- 172.21.15.45:0/3341362461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c441a3e80 con 0x7f8c44101900 2024-09-18T12:59:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.309+0000 7f8c4a517640 1 -- 172.21.15.45:0/3341362461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c44103040 con 0x7f8c44101900 2024-09-18T12:59:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.310+0000 7f8c417fa640 1 -- 172.21.15.45:0/3341362461 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f8c34010430 con 0x7f8c44101900 2024-09-18T12:59:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.310+0000 7f8c417fa640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8c2c07af80 0x7f8c2c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.310+0000 7f8c437fe640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8c2c07af80 0x7f8c2c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.310+0000 7f8c417fa640 1 -- 172.21.15.45:0/3341362461 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6070+0+0 (secure 0 0 0) 0x7f8c3409e500 con 0x7f8c44101900 2024-09-18T12:59:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.311+0000 7f8c437fe640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8c2c07af80 0x7f8c2c07d440 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c44075f80 tx=0x7f8c38031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:51.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.315+0000 7f8c417fa640 1 -- 172.21.15.45:0/3341362461 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8c34069bd0 con 0x7f8c44101900 2024-09-18T12:59:51.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.575+0000 7f8c4a517640 1 -- 172.21.15.45:0/3341362461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8c44109e90 con 0x7f8c44101900 2024-09-18T12:59:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.576+0000 7f8c417fa640 1 -- 172.21.15.45:0/3341362461 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f8c3406ea80 con 0x7f8c44101900 2024-09-18T12:59:51.577 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:59:51.577 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T12:59:51.577 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:51.577 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:59:51.577 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 5 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5, 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 9 2024-09-18T12:59:51.578 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T12:59:51.579 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:59:51.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 -- 172.21.15.45:0/3341362461 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8c2c07af80 msgr2=0x7f8c2c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8c2c07af80 0x7f8c2c07d440 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c44075f80 tx=0x7f8c38031400 comp rx=0 tx=0).stop 2024-09-18T12:59:51.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 -- 172.21.15.45:0/3341362461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c44101900 msgr2=0x7f8c440744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c44101900 0x7f8c440744f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400e970 tx=0x7f8c3400ee30 comp rx=0 tx=0).stop 2024-09-18T12:59:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 -- 172.21.15.45:0/3341362461 shutdown_connections 2024-09-18T12:59:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8c2c07af80 0x7f8c2c07d440 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c44107900 0x7f8c44074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 --2- 172.21.15.45:0/3341362461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c44101900 0x7f8c440744f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 -- 172.21.15.45:0/3341362461 >> 172.21.15.45:0/3341362461 conn(0x7f8c440fd600 msgr2=0x7f8c440fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 -- 172.21.15.45:0/3341362461 shutdown_connections 2024-09-18T12:59:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.578+0000 7f8c4a517640 1 -- 172.21.15.45:0/3341362461 wait complete. 2024-09-18T12:59:51.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.663+0000 7f9f7ef38640 1 -- 172.21.15.45:0/997991010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f781011d0 msgr2=0x7f9f781056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.663+0000 7f9f7ef38640 1 --2- 172.21.15.45:0/997991010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f781011d0 0x7f9f781056a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009880 tx=0x7f9f6402a530 comp rx=0 tx=0).stop 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.663+0000 7f9f7ef38640 1 -- 172.21.15.45:0/997991010 shutdown_connections 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.663+0000 7f9f7ef38640 1 --2- 172.21.15.45:0/997991010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f781011d0 0x7f9f781056a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.663+0000 7f9f7ef38640 1 --2- 172.21.15.45:0/997991010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f781008b0 0x7f9f78100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.663+0000 7f9f7ef38640 1 -- 172.21.15.45:0/997991010 >> 172.21.15.45:0/997991010 conn(0x7f9f780fc520 msgr2=0x7f9f780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.663+0000 7f9f7ef38640 1 -- 172.21.15.45:0/997991010 shutdown_connections 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.663+0000 7f9f7ef38640 1 -- 172.21.15.45:0/997991010 wait complete. 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.664+0000 7f9f7ef38640 1 Processor -- start 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.664+0000 7f9f7ef38640 1 -- start start 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.664+0000 7f9f7ef38640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f781008b0 0x7f9f7819dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.664+0000 7f9f7ef38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f781011d0 0x7f9f7819e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.664+0000 7f9f7ef38640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9f781153d0 con 0x7f9f781011d0 2024-09-18T12:59:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.664+0000 7f9f7ef38640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9f78115250 con 0x7f9f781008b0 2024-09-18T12:59:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.664+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f781011d0 0x7f9f7819e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.664+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f781011d0 0x7f9f7819e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39994/0 (socket says 172.21.15.45:39994) 2024-09-18T12:59:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.664+0000 7f9f77fff640 1 -- 172.21.15.45:0/2464422135 learned_addr learned my addr 172.21.15.45:0/2464422135 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.664+0000 7f9f7ccd4640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f781008b0 0x7f9f7819dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.665+0000 7f9f77fff640 1 -- 172.21.15.45:0/2464422135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f781008b0 msgr2=0x7f9f7819dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.665+0000 7f9f77fff640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f781008b0 0x7f9f7819dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.665+0000 7f9f77fff640 1 -- 172.21.15.45:0/2464422135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f781a2880 con 0x7f9f781011d0 2024-09-18T12:59:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.665+0000 7f9f77fff640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f781011d0 0x7f9f7819e4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f64031460 tx=0x7f9f64004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.665+0000 7f9f75ffb640 1 -- 172.21.15.45:0/2464422135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f6403f070 con 0x7f9f781011d0 2024-09-18T12:59:51.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.665+0000 7f9f7ef38640 1 -- 172.21.15.45:0/2464422135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f781a2b10 con 0x7f9f781011d0 2024-09-18T12:59:51.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.665+0000 7f9f75ffb640 1 -- 172.21.15.45:0/2464422135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f640035f0 con 0x7f9f781011d0 2024-09-18T12:59:51.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.665+0000 7f9f75ffb640 1 -- 172.21.15.45:0/2464422135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f64035030 con 0x7f9f781011d0 2024-09-18T12:59:51.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.665+0000 7f9f7ef38640 1 -- 172.21.15.45:0/2464422135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f781a3040 con 0x7f9f781011d0 2024-09-18T12:59:51.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.666+0000 7f9f7ef38640 1 -- 172.21.15.45:0/2464422135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7806aa90 con 0x7f9f781011d0 2024-09-18T12:59:51.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.667+0000 7f9f75ffb640 1 -- 172.21.15.45:0/2464422135 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f9f64042070 con 0x7f9f781011d0 2024-09-18T12:59:51.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.667+0000 7f9f75ffb640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f6807af30 0x7f9f6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.668+0000 7f9f75ffb640 1 -- 172.21.15.45:0/2464422135 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6070+0+0 (secure 0 0 0) 0x7f9f640be8b0 con 0x7f9f781011d0 2024-09-18T12:59:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.668+0000 7f9f7ccd4640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f6807af30 0x7f9f6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.668+0000 7f9f7ccd4640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f6807af30 0x7f9f6807d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c005d00 tx=0x7f9f6c00b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.672+0000 7f9f75ffb640 1 -- 172.21.15.45:0/2464422135 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9f64089f00 con 0x7f9f781011d0 2024-09-18T12:59:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:51 smithi045 ceph-mon[109129]: pgmap v237: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:59:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:51 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3341362461' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.893+0000 7f9f7ef38640 1 -- 172.21.15.45:0/2464422135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9f7819f310 con 0x7f9f781011d0 2024-09-18T12:59:51.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.894+0000 7f9f75ffb640 1 -- 172.21.15.45:0/2464422135 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2046 (secure 0 0 0) 0x7f9f6408edb0 con 0x7f9f781011d0 2024-09-18T12:59:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:e16 2024-09-18T12:59:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T12:49:30:966010+0000 2024-09-18T12:59:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T12:59:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:59:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 14 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T12:49:28.960615+0000 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T12:59:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=14566} 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T12:59:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 14566 members: 14566 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:14566} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.45:6826/2456430948,v1:172.21.15.45:6827/2456430948] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{0:14580} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.45:6828/1739021663,v1:172.21.15.45:6829/1739021663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{-1:24321} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T12:59:51.899 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2024-09-18T12:59:51.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 -- 172.21.15.45:0/2464422135 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f6807af30 msgr2=0x7f9f6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f6807af30 0x7f9f6807d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c005d00 tx=0x7f9f6c00b410 comp rx=0 tx=0).stop 2024-09-18T12:59:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 -- 172.21.15.45:0/2464422135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f781011d0 msgr2=0x7f9f7819e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f781011d0 0x7f9f7819e4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f64031460 tx=0x7f9f64004530 comp rx=0 tx=0).stop 2024-09-18T12:59:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 -- 172.21.15.45:0/2464422135 shutdown_connections 2024-09-18T12:59:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f6807af30 0x7f9f6807d3f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f781011d0 0x7f9f7819e4f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 --2- 172.21.15.45:0/2464422135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f781008b0 0x7f9f7819dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 -- 172.21.15.45:0/2464422135 >> 172.21.15.45:0/2464422135 conn(0x7f9f780fc520 msgr2=0x7f9f78112c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 -- 172.21.15.45:0/2464422135 shutdown_connections 2024-09-18T12:59:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.896+0000 7f9f7ef38640 1 -- 172.21.15.45:0/2464422135 wait complete. 2024-09-18T12:59:51.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:51 smithi161 ceph-mon[80292]: pgmap v237: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T12:59:51.947 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:51 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3341362461' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T12:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.981+0000 7f7d05710640 1 -- 172.21.15.45:0/1402914578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d00107900 msgr2=0x7f7d00107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.981+0000 7f7d05710640 1 --2- 172.21.15.45:0/1402914578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d00107900 0x7f7d00107ce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009c20 tx=0x7f7cf002a970 comp rx=0 tx=0).stop 2024-09-18T12:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.981+0000 7f7d05710640 1 -- 172.21.15.45:0/1402914578 shutdown_connections 2024-09-18T12:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.981+0000 7f7d05710640 1 --2- 172.21.15.45:0/1402914578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d00101900 0x7f7d00101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.981+0000 7f7d05710640 1 --2- 172.21.15.45:0/1402914578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d00107900 0x7f7d00107ce0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.981+0000 7f7d05710640 1 -- 172.21.15.45:0/1402914578 >> 172.21.15.45:0/1402914578 conn(0x7f7d000fd600 msgr2=0x7f7d000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.981+0000 7f7d05710640 1 -- 172.21.15.45:0/1402914578 shutdown_connections 2024-09-18T12:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.981+0000 7f7d05710640 1 -- 172.21.15.45:0/1402914578 wait complete. 2024-09-18T12:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.982+0000 7f7d05710640 1 Processor -- start 2024-09-18T12:59:51.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.982+0000 7f7d05710640 1 -- start start 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.982+0000 7f7d05710640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d00101900 0x7f7d0019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.982+0000 7f7d05710640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d00107900 0x7f7d0019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.982+0000 7f7d05710640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0010edb0 con 0x7f7d00101900 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.982+0000 7f7d05710640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0010ec30 con 0x7f7d00107900 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.982+0000 7f7cfeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d00101900 0x7f7d0019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.982+0000 7f7cfeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d00101900 0x7f7d0019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40006/0 (socket says 172.21.15.45:40006) 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.982+0000 7f7cfeffd640 1 -- 172.21.15.45:0/2828125451 learned_addr learned my addr 172.21.15.45:0/2828125451 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.983+0000 7f7cfe7fc640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d00107900 0x7f7d0019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.983+0000 7f7cfeffd640 1 -- 172.21.15.45:0/2828125451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d00107900 msgr2=0x7f7d0019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.983+0000 7f7cfeffd640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d00107900 0x7f7d0019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.983+0000 7f7cfeffd640 1 -- 172.21.15.45:0/2828125451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d001977e0 con 0x7f7d00101900 2024-09-18T12:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.983+0000 7f7cfeffd640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d00101900 0x7f7d0019d660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7cf002ae90 tx=0x7f7cf002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.983+0000 7f7cf7fff640 1 -- 172.21.15.45:0/2828125451 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cf0047070 con 0x7f7d00101900 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.983+0000 7f7cf7fff640 1 -- 172.21.15.45:0/2828125451 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7cf002f7e0 con 0x7f7d00101900 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.983+0000 7f7d05710640 1 -- 172.21.15.45:0/2828125451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d00197a70 con 0x7f7d00101900 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.983+0000 7f7cf7fff640 1 -- 172.21.15.45:0/2828125451 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cf0034070 con 0x7f7d00101900 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.983+0000 7f7d05710640 1 -- 172.21.15.45:0/2828125451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d00197fa0 con 0x7f7d00101900 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.984+0000 7f7d05710640 1 -- 172.21.15.45:0/2828125451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d00103040 con 0x7f7d00101900 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.985+0000 7f7cf7fff640 1 -- 172.21.15.45:0/2828125451 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f7cf004a070 con 0x7f7d00101900 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.985+0000 7f7cf7fff640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7cec07af30 0x7f7cec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.986+0000 7f7cf7fff640 1 -- 172.21.15.45:0/2828125451 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6070+0+0 (secure 0 0 0) 0x7f7cf00beca0 con 0x7f7d00101900 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.986+0000 7f7cfe7fc640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7cec07af30 0x7f7cec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.986+0000 7f7cfe7fc640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7cec07af30 0x7f7cec07d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7d00100d10 tx=0x7f7ce800b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:51.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:51.990+0000 7f7cf7fff640 1 -- 172.21.15.45:0/2828125451 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7cf00c3070 con 0x7f7d00101900 2024-09-18T12:59:52.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.194+0000 7f7d05710640 1 -- 172.21.15.45:0/2828125451 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7d00198250 con 0x7f7cec07af30 2024-09-18T12:59:52.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.195+0000 7f7cf7fff640 1 -- 172.21.15.45:0/2828125451 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f7d00198250 con 0x7f7cec07af30 2024-09-18T12:59:52.196 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr", 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: "mon", 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: "crash" 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "11/23 daemons upgraded", 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T12:59:52.197 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T12:59:52.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 -- 172.21.15.45:0/2828125451 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7cec07af30 msgr2=0x7f7cec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:52.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7cec07af30 0x7f7cec07d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7d00100d10 tx=0x7f7ce800b410 comp rx=0 tx=0).stop 2024-09-18T12:59:52.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 -- 172.21.15.45:0/2828125451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d00101900 msgr2=0x7f7d0019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:52.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d00101900 0x7f7d0019d660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7cf002ae90 tx=0x7f7cf002f5f0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 -- 172.21.15.45:0/2828125451 shutdown_connections 2024-09-18T12:59:52.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7cec07af30 0x7f7cec07d3f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d00107900 0x7f7d0019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 --2- 172.21.15.45:0/2828125451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d00101900 0x7f7d0019d660 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 -- 172.21.15.45:0/2828125451 >> 172.21.15.45:0/2828125451 conn(0x7f7d000fd600 msgr2=0x7f7d000fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:52.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 -- 172.21.15.45:0/2828125451 shutdown_connections 2024-09-18T12:59:52.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.198+0000 7f7d05710640 1 -- 172.21.15.45:0/2828125451 wait complete. 2024-09-18T12:59:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.282+0000 7fe9e75e7640 1 -- 172.21.15.45:0/164185681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9e0107900 msgr2=0x7fe9e0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.282+0000 7fe9e75e7640 1 --2- 172.21.15.45:0/164185681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9e0107900 0x7fe9e0107ce0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009880 tx=0x7fe9dc02a4a0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.282+0000 7fe9e75e7640 1 -- 172.21.15.45:0/164185681 shutdown_connections 2024-09-18T12:59:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.282+0000 7fe9e75e7640 1 --2- 172.21.15.45:0/164185681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e0101900 0x7fe9e0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.282+0000 7fe9e75e7640 1 --2- 172.21.15.45:0/164185681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9e0107900 0x7fe9e0107ce0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.282+0000 7fe9e75e7640 1 -- 172.21.15.45:0/164185681 >> 172.21.15.45:0/164185681 conn(0x7fe9e00fd600 msgr2=0x7fe9e00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.282+0000 7fe9e75e7640 1 -- 172.21.15.45:0/164185681 shutdown_connections 2024-09-18T12:59:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.282+0000 7fe9e75e7640 1 -- 172.21.15.45:0/164185681 wait complete. 2024-09-18T12:59:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.283+0000 7fe9e75e7640 1 Processor -- start 2024-09-18T12:59:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.283+0000 7fe9e75e7640 1 -- start start 2024-09-18T12:59:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.283+0000 7fe9e75e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9e0101900 0x7fe9e019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.283+0000 7fe9e75e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e0107900 0x7fe9e019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.283+0000 7fe9e75e7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e010edd0 con 0x7fe9e0101900 2024-09-18T12:59:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.283+0000 7fe9e75e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e010ec50 con 0x7fe9e0107900 2024-09-18T12:59:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.283+0000 7fe9e5383640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9e0101900 0x7fe9e019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9e5383640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9e0101900 0x7fe9e019d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40014/0 (socket says 172.21.15.45:40014) 2024-09-18T12:59:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9e5383640 1 -- 172.21.15.45:0/2319620357 learned_addr learned my addr 172.21.15.45:0/2319620357 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T12:59:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9e4b82640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e0107900 0x7fe9e019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9e5383640 1 -- 172.21.15.45:0/2319620357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e0107900 msgr2=0x7fe9e019db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9e5383640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e0107900 0x7fe9e019db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9e5383640 1 -- 172.21.15.45:0/2319620357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e01977a0 con 0x7fe9e0101900 2024-09-18T12:59:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9e5383640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9e0101900 0x7fe9e019d620 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc031460 tx=0x7fe9dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9d67fc640 1 -- 172.21.15.45:0/2319620357 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe9dc03f070 con 0x7fe9e0101900 2024-09-18T12:59:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9d67fc640 1 -- 172.21.15.45:0/2319620357 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9dc0035f0 con 0x7fe9e0101900 2024-09-18T12:59:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9d67fc640 1 -- 172.21.15.45:0/2319620357 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe9dc035030 con 0x7fe9e0101900 2024-09-18T12:59:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9e75e7640 1 -- 172.21.15.45:0/2319620357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e0197a30 con 0x7fe9e0101900 2024-09-18T12:59:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.284+0000 7fe9e75e7640 1 -- 172.21.15.45:0/2319620357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e0197f60 con 0x7fe9e0101900 2024-09-18T12:59:52.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.285+0000 7fe9e75e7640 1 -- 172.21.15.45:0/2319620357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e0103040 con 0x7fe9e0101900 2024-09-18T12:59:52.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.286+0000 7fe9d67fc640 1 -- 172.21.15.45:0/2319620357 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fe9dc042070 con 0x7fe9e0101900 2024-09-18T12:59:52.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.287+0000 7fe9d67fc640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe9cc07af80 0x7fe9cc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T12:59:52.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.287+0000 7fe9d67fc640 1 -- 172.21.15.45:0/2319620357 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6070+0+0 (secure 0 0 0) 0x7fe9dc0be8b0 con 0x7fe9e0101900 2024-09-18T12:59:52.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.287+0000 7fe9e4b82640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe9cc07af80 0x7fe9cc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T12:59:52.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.287+0000 7fe9e4b82640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe9cc07af80 0x7fe9cc07d440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00ffc20 tx=0x7fe9d000b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T12:59:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.291+0000 7fe9d67fc640 1 -- 172.21.15.45:0/2319620357 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe9dc089ee0 con 0x7fe9e0101900 2024-09-18T12:59:52.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:52 smithi161 systemd[1]: Stopping Ceph osd.5 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:59:52.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.554+0000 7fe9e75e7640 1 -- 172.21.15.45:0/2319620357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe9e0109e70 con 0x7fe9e0101900 2024-09-18T12:59:52.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.554+0000 7fe9d67fc640 1 -- 172.21.15.45:0/2319620357 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fe9dc08ed90 con 0x7fe9e0101900 2024-09-18T12:59:52.555 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T12:59:52.555 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T12:59:52.556 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 -- 172.21.15.45:0/2319620357 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe9cc07af80 msgr2=0x7fe9cc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe9cc07af80 0x7fe9cc07d440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00ffc20 tx=0x7fe9d000b390 comp rx=0 tx=0).stop 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 -- 172.21.15.45:0/2319620357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9e0101900 msgr2=0x7fe9e019d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9e0101900 0x7fe9e019d620 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc031460 tx=0x7fe9dc0045e0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 -- 172.21.15.45:0/2319620357 shutdown_connections 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fe9cc07af80 0x7fe9cc07d440 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9e0107900 0x7fe9e019db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 --2- 172.21.15.45:0/2319620357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9e0101900 0x7fe9e019d620 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 -- 172.21.15.45:0/2319620357 >> 172.21.15.45:0/2319620357 conn(0x7fe9e00fd600 msgr2=0x7fe9e00fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 -- 172.21.15.45:0/2319620357 shutdown_connections 2024-09-18T12:59:52.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T12:59:52.556+0000 7fe9e75e7640 1 -- 172.21.15.45:0/2319620357 wait complete. 2024-09-18T12:59:53.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:52 smithi045 ceph-mon[109129]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:53.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:52 smithi045 ceph-mon[109129]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:53.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:52 smithi045 ceph-mon[109129]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:53.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:52 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2464422135' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:53.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:52 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2319620357' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:53.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:52 smithi161 ceph-mon[80292]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:53.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:52 smithi161 ceph-mon[80292]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:53.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:52 smithi161 ceph-mon[80292]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:53.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:52 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2464422135' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T12:59:53.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:52 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2319620357' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T12:59:53.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:52 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[55425]: 2024-09-18T12:59:52.608+0000 7f469d18a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T12:59:53.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:52 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[55425]: 2024-09-18T12:59:52.608+0000 7f469d18a640 -1 osd.5 71 *** Got signal Terminated *** 2024-09-18T12:59:53.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:52 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[55425]: 2024-09-18T12:59:52.608+0000 7f469d18a640 -1 osd.5 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T12:59:53.897 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:53 smithi045 ceph-mon[109129]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:53.897 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:53 smithi045 ceph-mon[109129]: pgmap v238: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:59:53.898 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:53 smithi045 ceph-mon[109129]: osd.5 marked itself down and dead 2024-09-18T12:59:53.898 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:53.898 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:53 smithi161 ceph-mon[80292]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T12:59:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:53 smithi161 ceph-mon[80292]: pgmap v238: 65 pgs: 65 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T12:59:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:53 smithi161 ceph-mon[80292]: osd.5 marked itself down and dead 2024-09-18T12:59:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T12:59:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T12:59:54.360 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:54 smithi161 podman[97912]: 2024-09-18 12:59:54.10029057 +0000 UTC m=+1.611711683 container died 87cb190cb0bf55f25429961cb7f1b4c4f9959809aea25905d7dfe6f877bc21d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-18T12:59:54.628 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:54 smithi161 podman[97912]: 2024-09-18 12:59:54.459362744 +0000 UTC m=+1.970783858 container cleanup 87cb190cb0bf55f25429961cb7f1b4c4f9959809aea25905d7dfe6f877bc21d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-18T12:59:54.629 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:54 smithi161 bash[97912]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5 2024-09-18T12:59:54.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:54 smithi045 ceph-mon[109129]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:59:54.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:54 smithi045 ceph-mon[109129]: osdmap e72: 6 total, 5 up, 6 in 2024-09-18T12:59:54.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:54 smithi045 ceph-mon[109129]: pgmap v240: 65 pgs: 5 peering, 10 stale+active+clean, 50 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-18T12:59:54.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:54 smithi045 ceph-mon[109129]: osdmap e73: 6 total, 5 up, 6 in 2024-09-18T12:59:55.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:54 smithi161 ceph-mon[80292]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T12:59:55.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:54 smithi161 ceph-mon[80292]: osdmap e72: 6 total, 5 up, 6 in 2024-09-18T12:59:55.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:54 smithi161 ceph-mon[80292]: pgmap v240: 65 pgs: 5 peering, 10 stale+active+clean, 50 active+clean; 244 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-18T12:59:55.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:54 smithi161 ceph-mon[80292]: osdmap e73: 6 total, 5 up, 6 in 2024-09-18T12:59:55.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:54 smithi161 podman[97929]: 2024-09-18 12:59:54.727605706 +0000 UTC m=+0.628354107 container remove 87cb190cb0bf55f25429961cb7f1b4c4f9959809aea25905d7dfe6f877bc21d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-18T12:59:55.381 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:55 smithi161 podman[98013]: 2024-09-18 12:59:54.980162626 +0000 UTC m=+0.015924525 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:59:55.381 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:55 smithi161 podman[98013]: 2024-09-18 12:59:55.086691215 +0000 UTC m=+0.122453111 container create cf4f9d870775e3bd5302f8da6d6146a7f47901da17716385b0b6ad2a852f6c9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-18T12:59:55.381 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:55 smithi161 podman[98013]: 2024-09-18 12:59:55.297625712 +0000 UTC m=+0.333387610 container init cf4f9d870775e3bd5302f8da6d6146a7f47901da17716385b0b6ad2a852f6c9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T12:59:55.381 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:55 smithi161 podman[98013]: 2024-09-18 12:59:55.300987509 +0000 UTC m=+0.336749417 container start cf4f9d870775e3bd5302f8da6d6146a7f47901da17716385b0b6ad2a852f6c9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-18T12:59:55.381 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:55 smithi161 podman[98013]: 2024-09-18 12:59:55.380746568 +0000 UTC m=+0.416508484 container attach cf4f9d870775e3bd5302f8da6d6146a7f47901da17716385b0b6ad2a852f6c9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-18T12:59:55.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:55 smithi161 ceph-mon[80292]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-18T12:59:55.784 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:55 smithi161 podman[98013]: 2024-09-18 12:59:55.488499512 +0000 UTC m=+0.524261410 container died cf4f9d870775e3bd5302f8da6d6146a7f47901da17716385b0b6ad2a852f6c9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-18T12:59:56.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:55 smithi045 ceph-mon[109129]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-18T12:59:56.503 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 podman[98036]: 2024-09-18 12:59:56.059189185 +0000 UTC m=+0.564831780 container remove cf4f9d870775e3bd5302f8da6d6146a7f47901da17716385b0b6ad2a852f6c9f (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:59:56.504 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-18T12:59:56.504 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 systemd[1]: Stopped Ceph osd.5 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T12:59:56.504 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 systemd[1]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.5.service: Consumed 53.121s CPU time. 2024-09-18T12:59:56.504 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 systemd[1]: Starting Ceph osd.5 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T12:59:56.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:56 smithi161 ceph-mon[80292]: pgmap v242: 65 pgs: 8 active+undersized, 12 peering, 1 stale+active+clean, 5 active+undersized+degraded, 39 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 23/255 objects degraded (9.020%) 2024-09-18T12:59:56.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 podman[98136]: 2024-09-18 12:59:56.405721912 +0000 UTC m=+0.016172254 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T12:59:56.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 podman[98136]: 2024-09-18 12:59:56.510223689 +0000 UTC m=+0.120674026 container create 8f8993f3f4846f2a49873ca929d26e23e0044e8db3a15772fed46e1ebfa57575 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_BRANCH=HEAD) 2024-09-18T12:59:56.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 podman[98136]: 2024-09-18 12:59:56.746363977 +0000 UTC m=+0.356814317 container init 8f8993f3f4846f2a49873ca929d26e23e0044e8db3a15772fed46e1ebfa57575 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-18T12:59:56.793 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 podman[98136]: 2024-09-18 12:59:56.74981371 +0000 UTC m=+0.360264052 container start 8f8993f3f4846f2a49873ca929d26e23e0044e8db3a15772fed46e1ebfa57575 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T12:59:57.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:56 smithi045 ceph-mon[109129]: pgmap v242: 65 pgs: 8 active+undersized, 12 peering, 1 stale+active+clean, 5 active+undersized+degraded, 39 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 23/255 objects degraded (9.020%) 2024-09-18T12:59:57.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 podman[98136]: 2024-09-18 12:59:56.864369824 +0000 UTC m=+0.474820176 container attach 8f8993f3f4846f2a49873ca929d26e23e0044e8db3a15772fed46e1ebfa57575 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-18T12:59:57.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate[98151]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:59:57.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 bash[98136]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:59:57.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate[98151]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:59:57.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:56 smithi161 bash[98136]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T12:59:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:57 smithi045 ceph-mon[109129]: Health check failed: Degraded data redundancy: 23/255 objects degraded (9.020%), 5 pgs degraded (PG_DEGRADED) 2024-09-18T12:59:58.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:57 smithi161 ceph-mon[80292]: Health check failed: Degraded data redundancy: 23/255 objects degraded (9.020%), 5 pgs degraded (PG_DEGRADED) 2024-09-18T12:59:58.991 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 12:59:58 smithi045 ceph-mon[109129]: pgmap v243: 65 pgs: 9 active+undersized, 12 peering, 7 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 26/255 objects degraded (10.196%) 2024-09-18T12:59:59.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 12:59:58 smithi161 ceph-mon[80292]: pgmap v243: 65 pgs: 9 active+undersized, 12 peering, 7 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 26/255 objects degraded (10.196%) 2024-09-18T12:59:59.508 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate[98151]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:59:59.508 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 bash[98136]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:59:59.509 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate[98151]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:59:59.509 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 bash[98136]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T12:59:59.509 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate[98151]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:59:59.509 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 bash[98136]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T12:59:59.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate[98151]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:59:59.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 bash[98136]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T12:59:59.793 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate[98151]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-18T12:59:59.793 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 bash[98136]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-18T12:59:59.793 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate[98151]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:59:59.793 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 bash[98136]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:59:59.793 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate[98151]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-18T12:59:59.793 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 bash[98136]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-18T12:59:59.793 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 12:59:59 smithi161 podman[98136]: 2024-09-18 12:59:59.543977068 +0000 UTC m=+3.154427406 container died 8f8993f3f4846f2a49873ca929d26e23e0044e8db3a15772fed46e1ebfa57575 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-18T13:00:00.125 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 7 pgs peering; Degraded data redundancy: 26/255 objects degraded (10.196%), 7 pgs degraded 2024-09-18T13:00:00.125 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:00.125 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: [WRN] OSD_DOWN: 1 osds down 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: osd.5 (root=default,host=smithi161) is down 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: [WRN] PG_AVAILABILITY: Reduced data availability: 7 pgs peering 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 2.3 is stuck peering for 6m, current state peering, last acting [2,1] 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 2.17 is stuck peering for 6m, current state peering, last acting [2,1] 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 2.18 is stuck peering for 5m, current state peering, last acting [4,3] 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 3.5 is stuck peering for 5m, current state peering, last acting [2,3] 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 3.e is stuck peering for 5m, current state peering, last acting [4,1] 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 3.1c is stuck peering for 5m, current state peering, last acting [4,1] 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 3.1d is stuck peering for 5m, current state peering, last acting [4,1] 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: [WRN] PG_DEGRADED: Degraded data redundancy: 26/255 objects degraded (10.196%), 7 pgs degraded 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-18T13:00:00.126 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-18T13:00:00.127 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-18T13:00:00.127 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-18T13:00:00.127 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-mon[80292]: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-18T13:00:00.463 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 7 pgs peering; Degraded data redundancy: 26/255 objects degraded (10.196%), 7 pgs degraded 2024-09-18T13:00:00.463 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:00.463 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:00:00.463 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: [WRN] OSD_DOWN: 1 osds down 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: osd.5 (root=default,host=smithi161) is down 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: [WRN] PG_AVAILABILITY: Reduced data availability: 7 pgs peering 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 2.3 is stuck peering for 6m, current state peering, last acting [2,1] 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 2.17 is stuck peering for 6m, current state peering, last acting [2,1] 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 2.18 is stuck peering for 5m, current state peering, last acting [4,3] 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 3.5 is stuck peering for 5m, current state peering, last acting [2,3] 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 3.e is stuck peering for 5m, current state peering, last acting [4,1] 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 3.1c is stuck peering for 5m, current state peering, last acting [4,1] 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 3.1d is stuck peering for 5m, current state peering, last acting [4,1] 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: [WRN] PG_DEGRADED: Degraded data redundancy: 26/255 objects degraded (10.196%), 7 pgs degraded 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-18T13:00:00.464 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-18T13:00:00.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-18T13:00:00.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-18T13:00:00.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-18T13:00:00.465 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:00 smithi045 ceph-mon[109129]: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-18T13:00:00.465 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:00 smithi161 podman[98318]: 2024-09-18 13:00:00.124861405 +0000 UTC m=+0.570510073 container remove 8f8993f3f4846f2a49873ca929d26e23e0044e8db3a15772fed46e1ebfa57575 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731) 2024-09-18T13:00:00.465 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:00 smithi161 podman[98377]: 2024-09-18 13:00:00.244486269 +0000 UTC m=+0.015858644 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:00:00.465 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:00 smithi161 podman[98377]: 2024-09-18 13:00:00.342365861 +0000 UTC m=+0.113738224 container create 035aa0efadd6b269811e3ced9e0eb777f1fa294d3943d8de10ac032101deed15 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:00:00.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:00 smithi161 podman[98377]: 2024-09-18 13:00:00.57038644 +0000 UTC m=+0.341758803 container init 035aa0efadd6b269811e3ced9e0eb777f1fa294d3943d8de10ac032101deed15 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T13:00:00.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:00 smithi161 podman[98377]: 2024-09-18 13:00:00.573658396 +0000 UTC m=+0.345030762 container start 035aa0efadd6b269811e3ced9e0eb777f1fa294d3943d8de10ac032101deed15 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-18T13:00:00.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:00 smithi161 ceph-osd[98396]: -- 172.21.15.161:0/3996865114 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559be36a61e0 con 0x559be2845c00 2024-09-18T13:00:00.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:00 smithi161 bash[98377]: 035aa0efadd6b269811e3ced9e0eb777f1fa294d3943d8de10ac032101deed15 2024-09-18T13:00:00.792 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:00 smithi161 systemd[1]: Started Ceph osd.5 for 53bb6910-75bb-11ef-bceb-c7b262605968. 2024-09-18T13:00:01.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:01 smithi161 ceph-mon[80292]: pgmap v244: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:01.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:01 smithi161 ceph-mon[80292]: Health check update: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-09-18T13:00:01.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:01.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:01.429 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:01 smithi045 ceph-mon[109129]: pgmap v244: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:01 smithi045 ceph-mon[109129]: Health check update: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-09-18T13:00:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:01.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:02.326 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:02 smithi161 ceph-mon[80292]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-09-18T13:00:02.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:02 smithi045 ceph-mon[109129]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-09-18T13:00:02.730 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:02 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:00:02.450+0000 7fd9f7ae6640 -1 Falling back to public interface 2024-09-18T13:00:03.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:03 smithi161 ceph-mon[80292]: pgmap v245: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 828 B/s rd, 1 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:03.472 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:03 smithi045 ceph-mon[109129]: pgmap v245: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 828 B/s rd, 1 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:04.743 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:04 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:04.743 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:04 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:04.743 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:04 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:04.743 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:04 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:04 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:04 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:04 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:04 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:05.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:05 smithi161 ceph-mon[80292]: pgmap v246: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:05 smithi045 ceph-mon[109129]: pgmap v246: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:06.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:06 smithi045 ceph-mon[109129]: Health check update: Degraded data redundancy: 39/255 objects degraded (15.294%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T13:00:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:06 smithi161 ceph-mon[80292]: Health check update: Degraded data redundancy: 39/255 objects degraded (15.294%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T13:00:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: pgmap v247: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:07.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:07.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-18T13:00:07.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-18T13:00:07.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-18T13:00:07.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-18T13:00:07.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-18T13:00:07.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-18T13:00:07.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-18T13:00:07.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-18T13:00:07.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-18T13:00:07.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-18T13:00:07.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-18T13:00:07.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-18T13:00:07.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:07.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:07 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-18T13:00:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: pgmap v247: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-18T13:00:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-18T13:00:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-18T13:00:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-18T13:00:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-18T13:00:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-18T13:00:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-18T13:00:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-18T13:00:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-18T13:00:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:07 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-18T13:00:08.544 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:00:08.237+0000 7fd9f7ae6640 -1 osd.5 71 log_to_monitors true 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: Upgrade: Setting container_image for all osd 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: osdmap e74: 6 total, 5 up, 6 in 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: from='osd.5 [v2:172.21.15.161:6816/4224620550,v1:172.21.15.161:6817/4224620550]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 2 up:standby 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:08.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:08.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: Upgrade: Setting container_image for all osd 2024-09-18T13:00:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-18T13:00:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: osdmap e74: 6 total, 5 up, 6 in 2024-09-18T13:00:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: from='osd.5 [v2:172.21.15.161:6816/4224620550,v1:172.21.15.161:6817/4224620550]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T13:00:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-18T13:00:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-18T13:00:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 2 up:standby 2024-09-18T13:00:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:08.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:09.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:00:09.029+0000 7fd9ef890640 -1 osd.5 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T13:00:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: pgmap v249: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: from='osd.5 [v2:172.21.15.161:6816/4224620550,v1:172.21.15.161:6817/4224620550]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: osdmap e75: 6 total, 5 up, 6 in 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.45:6828/743768893,v1:172.21.15.45:6829/743768893] up:boot 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 3 up:standby 2024-09-18T13:00:09.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"} : dispatch 2024-09-18T13:00:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: pgmap v249: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 1008 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T13:00:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: from='osd.5 [v2:172.21.15.161:6816/4224620550,v1:172.21.15.161:6817/4224620550]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T13:00:09.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: osdmap e75: 6 total, 5 up, 6 in 2024-09-18T13:00:09.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]} : dispatch 2024-09-18T13:00:09.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.45:6828/743768893,v1:172.21.15.45:6829/743768893] up:boot 2024-09-18T13:00:09.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 3 up:standby 2024-09-18T13:00:09.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"} : dispatch 2024-09-18T13:00:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:10 smithi161 ceph-mon[80292]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T13:00:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:10 smithi161 ceph-mon[80292]: osd.5 [v2:172.21.15.161:6816/4224620550,v1:172.21.15.161:6817/4224620550] boot 2024-09-18T13:00:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:10 smithi161 ceph-mon[80292]: osdmap e76: 6 total, 6 up, 6 in 2024-09-18T13:00:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:10 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-18T13:00:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:10 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:10.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:10 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.gzqgyu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T13:00:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:10 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:10.689 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:10 smithi045 ceph-mon[109129]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T13:00:10.689 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:10 smithi045 ceph-mon[109129]: osd.5 [v2:172.21.15.161:6816/4224620550,v1:172.21.15.161:6817/4224620550] boot 2024-09-18T13:00:10.689 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:10 smithi045 ceph-mon[109129]: osdmap e76: 6 total, 6 up, 6 in 2024-09-18T13:00:10.689 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:10 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-18T13:00:10.689 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:10 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:10.690 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:10 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.gzqgyu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T13:00:10.690 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:10 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:11.607 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:11 smithi045 ceph-mon[109129]: Upgrade: Updating mds.cephfs.smithi045.gzqgyu 2024-09-18T13:00:11.608 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:11 smithi045 ceph-mon[109129]: Deploying daemon mds.cephfs.smithi045.gzqgyu on smithi045 2024-09-18T13:00:11.608 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:11 smithi045 ceph-mon[109129]: pgmap v252: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:11.608 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:11 smithi045 ceph-mon[109129]: osdmap e77: 6 total, 6 up, 6 in 2024-09-18T13:00:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:11 smithi161 ceph-mon[80292]: Upgrade: Updating mds.cephfs.smithi045.gzqgyu 2024-09-18T13:00:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:11 smithi161 ceph-mon[80292]: Deploying daemon mds.cephfs.smithi045.gzqgyu on smithi045 2024-09-18T13:00:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:11 smithi161 ceph-mon[80292]: pgmap v252: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 39/255 objects degraded (15.294%) 2024-09-18T13:00:11.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:11 smithi161 ceph-mon[80292]: osdmap e77: 6 total, 6 up, 6 in 2024-09-18T13:00:12.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:11 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045[109124]: 2024-09-18T13:00:11.863+0000 7f3891e6d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T13:00:12.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:12 smithi045 ceph-mon[109129]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T13:00:12.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:12 smithi045 ceph-mon[109129]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T13:00:12.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:12 smithi045 ceph-mon[109129]: osdmap e78: 6 total, 6 up, 6 in 2024-09-18T13:00:12.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:12 smithi045 ceph-mon[109129]: Standby daemon mds.cephfs.smithi161.maxdew assigned to filesystem cephfs as rank 0 2024-09-18T13:00:12.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:12 smithi045 ceph-mon[109129]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T13:00:12.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:12 smithi045 ceph-mon[109129]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T13:00:12.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:12 smithi045 ceph-mon[109129]: fsmap cephfs:1/1 {0=cephfs.smithi161.maxdew=up:replay} 2 up:standby 2024-09-18T13:00:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:12 smithi161 ceph-mon[80292]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T13:00:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:12 smithi161 ceph-mon[80292]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T13:00:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:12 smithi161 ceph-mon[80292]: osdmap e78: 6 total, 6 up, 6 in 2024-09-18T13:00:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:12 smithi161 ceph-mon[80292]: Standby daemon mds.cephfs.smithi161.maxdew assigned to filesystem cephfs as rank 0 2024-09-18T13:00:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:12 smithi161 ceph-mon[80292]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T13:00:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:12 smithi161 ceph-mon[80292]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T13:00:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:12 smithi161 ceph-mon[80292]: fsmap cephfs:1/1 {0=cephfs.smithi161.maxdew=up:replay} 2 up:standby 2024-09-18T13:00:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:13 smithi045 ceph-mon[109129]: pgmap v255: 65 pgs: 7 peering, 12 active+undersized, 8 active+undersized+degraded, 38 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 20/255 objects degraded (7.843%) 2024-09-18T13:00:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:13 smithi045 ceph-mon[109129]: Health check update: Degraded data redundancy: 20/255 objects degraded (7.843%), 8 pgs degraded (PG_DEGRADED) 2024-09-18T13:00:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:13 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi045.gzqgyu"} : dispatch 2024-09-18T13:00:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:13 smithi161 ceph-mon[80292]: pgmap v255: 65 pgs: 7 peering, 12 active+undersized, 8 active+undersized+degraded, 38 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 20/255 objects degraded (7.843%) 2024-09-18T13:00:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:13 smithi161 ceph-mon[80292]: Health check update: Degraded data redundancy: 20/255 objects degraded (7.843%), 8 pgs degraded (PG_DEGRADED) 2024-09-18T13:00:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:13 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi045.gzqgyu"} : dispatch 2024-09-18T13:00:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:15 smithi045 ceph-mon[109129]: pgmap v256: 65 pgs: 7 peering, 1 active+undersized, 2 active+undersized+degraded, 55 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 8.3 MiB/s rd, 4 op/s; 5/255 objects degraded (1.961%) 2024-09-18T13:00:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:15 smithi161 ceph-mon[80292]: pgmap v256: 65 pgs: 7 peering, 1 active+undersized, 2 active+undersized+degraded, 55 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 8.3 MiB/s rd, 4 op/s; 5/255 objects degraded (1.961%) 2024-09-18T13:00:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:16 smithi045 ceph-mon[109129]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/255 objects degraded (1.961%), 2 pgs degraded) 2024-09-18T13:00:17.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:16 smithi161 ceph-mon[80292]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/255 objects degraded (1.961%), 2 pgs degraded) 2024-09-18T13:00:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:17 smithi045 ceph-mon[109129]: pgmap v257: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 7 op/s 2024-09-18T13:00:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:17 smithi161 ceph-mon[80292]: pgmap v257: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 7 op/s 2024-09-18T13:00:19.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:19 smithi045 ceph-mon[109129]: pgmap v258: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 7 op/s 2024-09-18T13:00:20.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:19 smithi161 ceph-mon[80292]: pgmap v258: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 7 op/s 2024-09-18T13:00:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:21 smithi045 ceph-mon[109129]: pgmap v259: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-18T13:00:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:21 smithi045 ceph-mon[109129]: reconnect by client.24347 192.168.0.1:0/3439559536 after 0 2024-09-18T13:00:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:21 smithi045 ceph-mon[109129]: reconnect by client.14612 192.168.0.1:0/2420928100 after 0.000999978 2024-09-18T13:00:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:21 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] up:reconnect 2024-09-18T13:00:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:21 smithi045 ceph-mon[109129]: fsmap cephfs:1/1 {0=cephfs.smithi161.maxdew=up:reconnect} 2 up:standby 2024-09-18T13:00:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:21 smithi161 ceph-mon[80292]: pgmap v259: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-18T13:00:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:21 smithi161 ceph-mon[80292]: reconnect by client.24347 192.168.0.1:0/3439559536 after 0 2024-09-18T13:00:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:21 smithi161 ceph-mon[80292]: reconnect by client.14612 192.168.0.1:0/2420928100 after 0.000999978 2024-09-18T13:00:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:21 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] up:reconnect 2024-09-18T13:00:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:21 smithi161 ceph-mon[80292]: fsmap cephfs:1/1 {0=cephfs.smithi161.maxdew=up:reconnect} 2 up:standby 2024-09-18T13:00:22.570 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:22 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] up:rejoin 2024-09-18T13:00:22.571 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:22 smithi045 ceph-mon[109129]: fsmap cephfs:1/1 {0=cephfs.smithi161.maxdew=up:rejoin} 2 up:standby 2024-09-18T13:00:22.571 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:22 smithi045 ceph-mon[109129]: daemon mds.cephfs.smithi161.maxdew is now active in filesystem cephfs as rank 0 2024-09-18T13:00:22.571 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:22 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:22.571 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:22 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:22.571 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:22 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:22.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.648+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/3493463227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f74107900 msgr2=0x7f1f74107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:22.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.649+0000 7f1f7c6e7640 1 --2- 172.21.15.45:0/3493463227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f74107900 0x7f1f74107ce0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009880 tx=0x7f1f7002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.649+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/3493463227 shutdown_connections 2024-09-18T13:00:22.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.649+0000 7f1f7c6e7640 1 --2- 172.21.15.45:0/3493463227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74101900 0x7f1f74101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.649+0000 7f1f7c6e7640 1 --2- 172.21.15.45:0/3493463227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f74107900 0x7f1f74107ce0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.649+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/3493463227 >> 172.21.15.45:0/3493463227 conn(0x7f1f740fd5e0 msgr2=0x7f1f740ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:22.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.649+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/3493463227 shutdown_connections 2024-09-18T13:00:22.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.649+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/3493463227 wait complete. 2024-09-18T13:00:22.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.649+0000 7f1f7c6e7640 1 Processor -- start 2024-09-18T13:00:22.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.649+0000 7f1f7c6e7640 1 -- start start 2024-09-18T13:00:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7c6e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f74101900 0x7f1f740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7c6e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74107900 0x7f1f74074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7c6e7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7410edd0 con 0x7f1f74101900 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7c6e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7410ec50 con 0x7f1f74107900 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7a483640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f74101900 0x7f1f740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7a483640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f74101900 0x7f1f740744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48522/0 (socket says 172.21.15.45:48522) 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7a483640 1 -- 172.21.15.45:0/1937410277 learned_addr learned my addr 172.21.15.45:0/1937410277 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f79c82640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74107900 0x7f1f74074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7a483640 1 -- 172.21.15.45:0/1937410277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74107900 msgr2=0x7f1f74074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7a483640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74107900 0x7f1f74074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7a483640 1 -- 172.21.15.45:0/1937410277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f74074f70 con 0x7f1f74101900 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.650+0000 7f1f7a483640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f74101900 0x7f1f740744f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f70031460 tx=0x7f1f700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.651+0000 7f1f6b7fe640 1 -- 172.21.15.45:0/1937410277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f7003f070 con 0x7f1f74101900 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.651+0000 7f1f6b7fe640 1 -- 172.21.15.45:0/1937410277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1f70004b10 con 0x7f1f74101900 2024-09-18T13:00:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.651+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/1937410277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f74075200 con 0x7f1f74101900 2024-09-18T13:00:22.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.651+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/1937410277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f741a3d80 con 0x7f1f74101900 2024-09-18T13:00:22.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.651+0000 7f1f6b7fe640 1 -- 172.21.15.45:0/1937410277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f70035030 con 0x7f1f74101900 2024-09-18T13:00:22.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.652+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/1937410277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f74103040 con 0x7f1f74101900 2024-09-18T13:00:22.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.653+0000 7f1f6b7fe640 1 -- 172.21.15.45:0/1937410277 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f1f70042070 con 0x7f1f74101900 2024-09-18T13:00:22.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.653+0000 7f1f6b7fe640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1f6007af90 0x7f1f6007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:22.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.653+0000 7f1f6b7fe640 1 -- 172.21.15.45:0/1937410277 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f1f700be9e0 con 0x7f1f74101900 2024-09-18T13:00:22.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.653+0000 7f1f79c82640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1f6007af90 0x7f1f6007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:22.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.654+0000 7f1f79c82640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1f6007af90 0x7f1f6007d450 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f74075f80 tx=0x7f1f6400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.658+0000 7f1f6b7fe640 1 -- 172.21.15.45:0/1937410277 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1f7008a060 con 0x7f1f74101900 2024-09-18T13:00:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.876+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/1937410277 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1f74062630 con 0x7f1f6007af90 2024-09-18T13:00:22.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.877+0000 7f1f6b7fe640 1 -- 172.21.15.45:0/1937410277 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1f74062630 con 0x7f1f6007af90 2024-09-18T13:00:22.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/1937410277 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1f6007af90 msgr2=0x7f1f6007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:22.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1f6007af90 0x7f1f6007d450 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f74075f80 tx=0x7f1f6400b390 comp rx=0 tx=0).stop 2024-09-18T13:00:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/1937410277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f74101900 msgr2=0x7f1f740744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f74101900 0x7f1f740744f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f70031460 tx=0x7f1f700045e0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/1937410277 shutdown_connections 2024-09-18T13:00:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1f6007af90 0x7f1f6007d450 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f74107900 0x7f1f74074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 --2- 172.21.15.45:0/1937410277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f74101900 0x7f1f740744f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/1937410277 >> 172.21.15.45:0/1937410277 conn(0x7f1f740fd5e0 msgr2=0x7f1f740fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/1937410277 shutdown_connections 2024-09-18T13:00:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.879+0000 7f1f7c6e7640 1 -- 172.21.15.45:0/1937410277 wait complete. 2024-09-18T13:00:22.889 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T13:00:22.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:22 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] up:rejoin 2024-09-18T13:00:22.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:22 smithi161 ceph-mon[80292]: fsmap cephfs:1/1 {0=cephfs.smithi161.maxdew=up:rejoin} 2 up:standby 2024-09-18T13:00:22.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:22 smithi161 ceph-mon[80292]: daemon mds.cephfs.smithi161.maxdew is now active in filesystem cephfs as rank 0 2024-09-18T13:00:22.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:22 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:22.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:22 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:22.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:22 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:22.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.965+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1821387993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88ac100250 msgr2=0x7f88ac100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:22.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.965+0000 7f88b3c8c640 1 --2- 172.21.15.45:0/1821387993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88ac100250 0x7f88ac100630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009880 tx=0x7f88a802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.965+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1821387993 shutdown_connections 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.965+0000 7f88b3c8c640 1 --2- 172.21.15.45:0/1821387993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ac100c00 0x7f88ac104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.965+0000 7f88b3c8c640 1 --2- 172.21.15.45:0/1821387993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88ac100250 0x7f88ac100630 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.965+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1821387993 >> 172.21.15.45:0/1821387993 conn(0x7f88ac0fbc90 msgr2=0x7f88ac0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.965+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1821387993 shutdown_connections 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.965+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1821387993 wait complete. 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b3c8c640 1 Processor -- start 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b3c8c640 1 -- start start 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b3c8c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ac100250 0x7f88ac101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b3c8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88ac100c00 0x7f88ac102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b3c8c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac10dd50 con 0x7f88ac100c00 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b3c8c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac10dbd0 con 0x7f88ac100250 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b1227640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88ac100c00 0x7f88ac102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b1227640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88ac100c00 0x7f88ac102230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48544/0 (socket says 172.21.15.45:48544) 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b1227640 1 -- 172.21.15.45:0/1777180354 learned_addr learned my addr 172.21.15.45:0/1777180354 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b1a28640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ac100250 0x7f88ac101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b1227640 1 -- 172.21.15.45:0/1777180354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ac100250 msgr2=0x7f88ac101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b1227640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ac100250 0x7f88ac101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.966+0000 7f88b1227640 1 -- 172.21.15.45:0/1777180354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac102770 con 0x7f88ac100c00 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.967+0000 7f88b1227640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88ac100c00 0x7f88ac102230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f889c00e970 tx=0x7f889c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.967+0000 7f88a2ffd640 1 -- 172.21.15.45:0/1777180354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f889c00cac0 con 0x7f88ac100c00 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.967+0000 7f88a2ffd640 1 -- 172.21.15.45:0/1777180354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f889c0054e0 con 0x7f88ac100c00 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.967+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1777180354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac102a60 con 0x7f88ac100c00 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.967+0000 7f88a2ffd640 1 -- 172.21.15.45:0/1777180354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f889c010430 con 0x7f88ac100c00 2024-09-18T13:00:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.967+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1777180354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac1a3e90 con 0x7f88ac100c00 2024-09-18T13:00:22.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.968+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1777180354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac101730 con 0x7f88ac100c00 2024-09-18T13:00:22.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.969+0000 7f88a2ffd640 1 -- 172.21.15.45:0/1777180354 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f889c004ee0 con 0x7f88ac100c00 2024-09-18T13:00:22.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.969+0000 7f88a2ffd640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f889807af30 0x7f889807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:22.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.969+0000 7f88b1a28640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f889807af30 0x7f889807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:22.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.970+0000 7f88a2ffd640 1 -- 172.21.15.45:0/1777180354 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f889c09e6e0 con 0x7f88ac100c00 2024-09-18T13:00:22.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.970+0000 7f88b1a28640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f889807af30 0x7f889807d3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88a80096c0 tx=0x7f88a8031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:22.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:22.974+0000 7f88a2ffd640 1 -- 172.21.15.45:0/1777180354 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f889c069ce0 con 0x7f88ac100c00 2024-09-18T13:00:23.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.192+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1777180354 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f88ac062630 con 0x7f889807af30 2024-09-18T13:00:23.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.193+0000 7f88a2ffd640 1 -- 172.21.15.45:0/1777180354 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f88ac062630 con 0x7f889807af30 2024-09-18T13:00:23.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1777180354 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f889807af30 msgr2=0x7f889807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f889807af30 0x7f889807d3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88a80096c0 tx=0x7f88a8031400 comp rx=0 tx=0).stop 2024-09-18T13:00:23.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1777180354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88ac100c00 msgr2=0x7f88ac102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88ac100c00 0x7f88ac102230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f889c00e970 tx=0x7f889c00ed70 comp rx=0 tx=0).stop 2024-09-18T13:00:23.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1777180354 shutdown_connections 2024-09-18T13:00:23.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f889807af30 0x7f889807d3f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88ac100c00 0x7f88ac102230 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 --2- 172.21.15.45:0/1777180354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ac100250 0x7f88ac101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1777180354 >> 172.21.15.45:0/1777180354 conn(0x7f88ac0fbc90 msgr2=0x7f88ac0fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:23.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1777180354 shutdown_connections 2024-09-18T13:00:23.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.196+0000 7f88b3c8c640 1 -- 172.21.15.45:0/1777180354 wait complete. 2024-09-18T13:00:23.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.280+0000 7f2f48292640 1 -- 172.21.15.45:0/2619120790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f40100800 msgr2=0x7f2f40100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.280+0000 7f2f48292640 1 --2- 172.21.15.45:0/2619120790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f40100800 0x7f2f40100c60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009880 tx=0x7f2f3002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.280+0000 7f2f48292640 1 -- 172.21.15.45:0/2619120790 shutdown_connections 2024-09-18T13:00:23.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.280+0000 7f2f48292640 1 --2- 172.21.15.45:0/2619120790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f40100800 0x7f2f40100c60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.280+0000 7f2f48292640 1 --2- 172.21.15.45:0/2619120790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f40106800 0x7f2f40106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.280+0000 7f2f48292640 1 -- 172.21.15.45:0/2619120790 >> 172.21.15.45:0/2619120790 conn(0x7f2f400fc520 msgr2=0x7f2f400fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.280+0000 7f2f48292640 1 -- 172.21.15.45:0/2619120790 shutdown_connections 2024-09-18T13:00:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.280+0000 7f2f48292640 1 -- 172.21.15.45:0/2619120790 wait complete. 2024-09-18T13:00:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.281+0000 7f2f48292640 1 Processor -- start 2024-09-18T13:00:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.281+0000 7f2f48292640 1 -- start start 2024-09-18T13:00:23.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.281+0000 7f2f48292640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f40100800 0x7f2f40198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:23.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.281+0000 7f2f48292640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f40106800 0x7f2f40198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.281+0000 7f2f48292640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4010dcb0 con 0x7f2f40100800 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.281+0000 7f2f48292640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4010db30 con 0x7f2f40106800 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f4602e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f40100800 0x7f2f40198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f4602e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f40100800 0x7f2f40198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48572/0 (socket says 172.21.15.45:48572) 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f4602e640 1 -- 172.21.15.45:0/119441758 learned_addr learned my addr 172.21.15.45:0/119441758 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f4582d640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f40106800 0x7f2f40198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f4602e640 1 -- 172.21.15.45:0/119441758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f40106800 msgr2=0x7f2f40198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f4602e640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f40106800 0x7f2f40198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f4602e640 1 -- 172.21.15.45:0/119441758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f40199340 con 0x7f2f40100800 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f4602e640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f40100800 0x7f2f40198800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00d8d0 tx=0x7f2f3c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f377fe640 1 -- 172.21.15.45:0/119441758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f3c017030 con 0x7f2f40100800 2024-09-18T13:00:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f48292640 1 -- 172.21.15.45:0/119441758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f40199630 con 0x7f2f40100800 2024-09-18T13:00:23.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f377fe640 1 -- 172.21.15.45:0/119441758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f3c004020 con 0x7f2f40100800 2024-09-18T13:00:23.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f377fe640 1 -- 172.21.15.45:0/119441758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f3c0047a0 con 0x7f2f40100800 2024-09-18T13:00:23.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.282+0000 7f2f48292640 1 -- 172.21.15.45:0/119441758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f401a1c30 con 0x7f2f40100800 2024-09-18T13:00:23.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.283+0000 7f2f48292640 1 -- 172.21.15.45:0/119441758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f40101f40 con 0x7f2f40100800 2024-09-18T13:00:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.284+0000 7f2f377fe640 1 -- 172.21.15.45:0/119441758 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f2f3c0041d0 con 0x7f2f40100800 2024-09-18T13:00:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.285+0000 7f2f377fe640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f2c07af30 0x7f2f2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.285+0000 7f2f377fe640 1 -- 172.21.15.45:0/119441758 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f2f3c018070 con 0x7f2f40100800 2024-09-18T13:00:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.285+0000 7f2f4582d640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f2c07af30 0x7f2f2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.285+0000 7f2f4582d640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f2c07af30 0x7f2f2c07d3f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f4006ad00 tx=0x7f2f30031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.290+0000 7f2f377fe640 1 -- 172.21.15.45:0/119441758 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2f40199630 con 0x7f2f40100800 2024-09-18T13:00:23.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.484+0000 7f2f48292640 1 -- 172.21.15.45:0/119441758 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2f40062630 con 0x7f2f2c07af30 2024-09-18T13:00:23.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.503+0000 7f2f377fe640 1 -- 172.21.15.45:0/119441758 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2f40062630 con 0x7f2f2c07af30 2024-09-18T13:00:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:00:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (5m) 2m ago 16m 20.0M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T13:00:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (8m) 2m ago 16m 8975k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T13:00:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (8m) 20s ago 15m 8623k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T13:00:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (3m) 2m ago 16m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T13:00:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (3m) 20s ago 15m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T13:00:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (5m) 2m ago 16m 79.3M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T13:00:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (10m) 2m ago 10m 92.1M - 19.1.1-330-gc2ddf972 ebb0615149de fe70f4b0307b 2024-09-18T13:00:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 starting - - - - 2024-09-18T13:00:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (10m) 20s ago 10m 18.7M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (11m) 20s ago 11m 17.2M - 19.1.1-330-gc2ddf972 ebb0615149de 5f45b4462af3 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (7m) 2m ago 17m 524M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (6m) 20s ago 15m 458M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (4m) 2m ago 17m 42.6M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (3m) 20s ago 15m 37.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (6m) 2m ago 16m 11.3M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (6m) 20s ago 15m 11.0M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (3m) 2m ago 14m 84.1M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (2m) 2m ago 13m 89.2M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 7d4cd0351725 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (2m) 2m ago 13m 12.2M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4f620cf3977f 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (91s) 20s ago 12m 99.1M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1fbe6c224b87 2024-09-18T13:00:23.506 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (57s) 20s ago 12m 86.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b3c49339a90c 2024-09-18T13:00:23.507 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (23s) 20s ago 12m 11.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 035aa0efadd6 2024-09-18T13:00:23.507 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (5m) 2m ago 15m 54.1M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T13:00:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 -- 172.21.15.45:0/119441758 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f2c07af30 msgr2=0x7f2f2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f2c07af30 0x7f2f2c07d3f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f4006ad00 tx=0x7f2f30031400 comp rx=0 tx=0).stop 2024-09-18T13:00:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 -- 172.21.15.45:0/119441758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f40100800 msgr2=0x7f2f40198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f40100800 0x7f2f40198800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00d8d0 tx=0x7f2f3c00dd90 comp rx=0 tx=0).stop 2024-09-18T13:00:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 -- 172.21.15.45:0/119441758 shutdown_connections 2024-09-18T13:00:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f2f2c07af30 0x7f2f2c07d3f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f40106800 0x7f2f40198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 --2- 172.21.15.45:0/119441758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f40100800 0x7f2f40198800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 -- 172.21.15.45:0/119441758 >> 172.21.15.45:0/119441758 conn(0x7f2f400fc520 msgr2=0x7f2f400fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 -- 172.21.15.45:0/119441758 shutdown_connections 2024-09-18T13:00:23.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.506+0000 7f2f48292640 1 -- 172.21.15.45:0/119441758 wait complete. 2024-09-18T13:00:23.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.593+0000 7f9fae913640 1 -- 172.21.15.45:0/115730393 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fa81033d0 msgr2=0x7f9fa810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.593+0000 7f9fae913640 1 --2- 172.21.15.45:0/115730393 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fa81033d0 0x7f9fa810b8c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009880 tx=0x7f9f9c02a530 comp rx=0 tx=0).stop 2024-09-18T13:00:23.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.593+0000 7f9fae913640 1 -- 172.21.15.45:0/115730393 shutdown_connections 2024-09-18T13:00:23.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.593+0000 7f9fae913640 1 --2- 172.21.15.45:0/115730393 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fa81033d0 0x7f9fa810b8c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.593+0000 7f9fae913640 1 --2- 172.21.15.45:0/115730393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa8102ab0 0x7f9fa8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.593+0000 7f9fae913640 1 -- 172.21.15.45:0/115730393 >> 172.21.15.45:0/115730393 conn(0x7f9fa80fc550 msgr2=0x7f9fa80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.594+0000 7f9fae913640 1 -- 172.21.15.45:0/115730393 shutdown_connections 2024-09-18T13:00:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.594+0000 7f9fae913640 1 -- 172.21.15.45:0/115730393 wait complete. 2024-09-18T13:00:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.594+0000 7f9fae913640 1 Processor -- start 2024-09-18T13:00:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.594+0000 7f9fae913640 1 -- start start 2024-09-18T13:00:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fae913640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa8102ab0 0x7f9fa819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fae913640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fa81033d0 0x7f9fa819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fae913640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa810ede0 con 0x7f9fa81033d0 2024-09-18T13:00:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fae913640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa810ec60 con 0x7f9fa8102ab0 2024-09-18T13:00:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fa81033d0 0x7f9fa819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fa81033d0 0x7f9fa819fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48576/0 (socket says 172.21.15.45:48576) 2024-09-18T13:00:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fa77fe640 1 -- 172.21.15.45:0/1319578443 learned_addr learned my addr 172.21.15.45:0/1319578443 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:23.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fa7fff640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa8102ab0 0x7f9fa819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:23.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fa77fe640 1 -- 172.21.15.45:0/1319578443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa8102ab0 msgr2=0x7f9fa819f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fa77fe640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa8102ab0 0x7f9fa819f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fa77fe640 1 -- 172.21.15.45:0/1319578443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa81999e0 con 0x7f9fa81033d0 2024-09-18T13:00:23.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fa77fe640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fa81033d0 0x7f9fa819fd60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c031460 tx=0x7f9f9c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:23.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.595+0000 7f9fa57fa640 1 -- 172.21.15.45:0/1319578443 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f9c03f070 con 0x7f9fa81033d0 2024-09-18T13:00:23.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.596+0000 7f9fa57fa640 1 -- 172.21.15.45:0/1319578443 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f9c0035f0 con 0x7f9fa81033d0 2024-09-18T13:00:23.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.596+0000 7f9fa57fa640 1 -- 172.21.15.45:0/1319578443 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f9c035030 con 0x7f9fa81033d0 2024-09-18T13:00:23.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.596+0000 7f9fae913640 1 -- 172.21.15.45:0/1319578443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa8199c70 con 0x7f9fa81033d0 2024-09-18T13:00:23.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.596+0000 7f9fae913640 1 -- 172.21.15.45:0/1319578443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa819a1a0 con 0x7f9fa81033d0 2024-09-18T13:00:23.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.597+0000 7f9fae913640 1 -- 172.21.15.45:0/1319578443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa806a580 con 0x7f9fa81033d0 2024-09-18T13:00:23.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.598+0000 7f9fa57fa640 1 -- 172.21.15.45:0/1319578443 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f9f9c042070 con 0x7f9fa81033d0 2024-09-18T13:00:23.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.599+0000 7f9fa57fa640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f9007af30 0x7f9f9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:23.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.599+0000 7f9fa57fa640 1 -- 172.21.15.45:0/1319578443 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f9f9c0be840 con 0x7f9fa81033d0 2024-09-18T13:00:23.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.599+0000 7f9fa7fff640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f9007af30 0x7f9f9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:23.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.599+0000 7f9fa7fff640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f9007af30 0x7f9f9007d3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fa819ab20 tx=0x7f9f98005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:23.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.603+0000 7f9fa57fa640 1 -- 172.21.15.45:0/1319578443 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9f9c089e40 con 0x7f9fa81033d0 2024-09-18T13:00:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:23 smithi045 ceph-mon[109129]: pgmap v260: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-18T13:00:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:23 smithi045 ceph-mon[109129]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T13:00:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:23 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] up:active 2024-09-18T13:00:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:23 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] up:boot 2024-09-18T13:00:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:23 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi161.maxdew=up:active} 3 up:standby 2024-09-18T13:00:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi045.gzqgyu"} : dispatch 2024-09-18T13:00:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:23.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:23.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:23.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.865+0000 7f9fae913640 1 -- 172.21.15.45:0/1319578443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9fa8102e90 con 0x7f9fa81033d0 2024-09-18T13:00:23.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.866+0000 7f9fa57fa640 1 -- 172.21.15.45:0/1319578443 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f9f9c08ecf0 con 0x7f9fa81033d0 2024-09-18T13:00:23.867 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T13:00:23.867 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T13:00:23.867 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:23.867 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3, 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 1 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T13:00:23.868 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3, 2024-09-18T13:00:23.869 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 11 2024-09-18T13:00:23.869 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T13:00:23.869 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T13:00:23.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 -- 172.21.15.45:0/1319578443 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f9007af30 msgr2=0x7f9f9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f9007af30 0x7f9f9007d3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fa819ab20 tx=0x7f9f98005f90 comp rx=0 tx=0).stop 2024-09-18T13:00:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 -- 172.21.15.45:0/1319578443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fa81033d0 msgr2=0x7f9fa819fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fa81033d0 0x7f9fa819fd60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c031460 tx=0x7f9f9c0045c0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 -- 172.21.15.45:0/1319578443 shutdown_connections 2024-09-18T13:00:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9f9007af30 0x7f9f9007d3f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fa81033d0 0x7f9fa819fd60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 --2- 172.21.15.45:0/1319578443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fa8102ab0 0x7f9fa819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 -- 172.21.15.45:0/1319578443 >> 172.21.15.45:0/1319578443 conn(0x7f9fa80fc550 msgr2=0x7f9fa8100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 -- 172.21.15.45:0/1319578443 shutdown_connections 2024-09-18T13:00:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.868+0000 7f9fae913640 1 -- 172.21.15.45:0/1319578443 wait complete. 2024-09-18T13:00:23.935 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:23 smithi161 ceph-mon[80292]: pgmap v260: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-18T13:00:23.936 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:23 smithi161 ceph-mon[80292]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T13:00:23.936 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:23 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] up:active 2024-09-18T13:00:23.936 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:23 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] up:boot 2024-09-18T13:00:23.936 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:23 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi161.maxdew=up:active} 3 up:standby 2024-09-18T13:00:23.936 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi045.gzqgyu"} : dispatch 2024-09-18T13:00:23.936 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:23.936 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:23.936 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:23.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.967+0000 7fc70a8e7640 1 -- 172.21.15.45:0/3342739027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7040ffdc0 msgr2=0x7fc704100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.967+0000 7fc70a8e7640 1 --2- 172.21.15.45:0/3342739027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7040ffdc0 0x7fc704100220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009880 tx=0x7fc6f802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.967+0000 7fc70a8e7640 1 -- 172.21.15.45:0/3342739027 shutdown_connections 2024-09-18T13:00:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.967+0000 7fc70a8e7640 1 --2- 172.21.15.45:0/3342739027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7040ffdc0 0x7fc704100220 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.967+0000 7fc70a8e7640 1 --2- 172.21.15.45:0/3342739027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7041069a0 0x7fc704106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.967+0000 7fc70a8e7640 1 -- 172.21.15.45:0/3342739027 >> 172.21.15.45:0/3342739027 conn(0x7fc7040fbc90 msgr2=0x7fc7040fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.967+0000 7fc70a8e7640 1 -- 172.21.15.45:0/3342739027 shutdown_connections 2024-09-18T13:00:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.967+0000 7fc70a8e7640 1 -- 172.21.15.45:0/3342739027 wait complete. 2024-09-18T13:00:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.968+0000 7fc70a8e7640 1 Processor -- start 2024-09-18T13:00:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.968+0000 7fc70a8e7640 1 -- start start 2024-09-18T13:00:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.968+0000 7fc70a8e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7040ffdc0 0x7fc70419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.968+0000 7fc70a8e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7041069a0 0x7fc70419dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.968+0000 7fc70a8e7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc70410ef40 con 0x7fc7041069a0 2024-09-18T13:00:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.968+0000 7fc70a8e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc70410edc0 con 0x7fc7040ffdc0 2024-09-18T13:00:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.969+0000 7fc703fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7040ffdc0 0x7fc70419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.969+0000 7fc703fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7040ffdc0 0x7fc70419d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:33396/0 (socket says 172.21.15.45:33396) 2024-09-18T13:00:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.969+0000 7fc703fff640 1 -- 172.21.15.45:0/474614543 learned_addr learned my addr 172.21.15.45:0/474614543 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.969+0000 7fc7037fe640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7041069a0 0x7fc70419dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.969+0000 7fc703fff640 1 -- 172.21.15.45:0/474614543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7041069a0 msgr2=0x7fc70419dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.969+0000 7fc703fff640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7041069a0 0x7fc70419dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.969+0000 7fc703fff640 1 -- 172.21.15.45:0/474614543 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7041978f0 con 0x7fc7040ffdc0 2024-09-18T13:00:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.970+0000 7fc703fff640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7040ffdc0 0x7fc70419d730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400e970 tx=0x7fc6f400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.970+0000 7fc7017fa640 1 -- 172.21.15.45:0/474614543 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6f400cac0 con 0x7fc7040ffdc0 2024-09-18T13:00:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.970+0000 7fc70a8e7640 1 -- 172.21.15.45:0/474614543 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc704197be0 con 0x7fc7040ffdc0 2024-09-18T13:00:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.970+0000 7fc7017fa640 1 -- 172.21.15.45:0/474614543 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6f40054e0 con 0x7fc7040ffdc0 2024-09-18T13:00:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.970+0000 7fc70a8e7640 1 -- 172.21.15.45:0/474614543 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc704198140 con 0x7fc7040ffdc0 2024-09-18T13:00:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.970+0000 7fc7017fa640 1 -- 172.21.15.45:0/474614543 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6f4010430 con 0x7fc7040ffdc0 2024-09-18T13:00:23.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.971+0000 7fc70a8e7640 1 -- 172.21.15.45:0/474614543 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7041030e0 con 0x7fc7040ffdc0 2024-09-18T13:00:23.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.972+0000 7fc7017fa640 1 -- 172.21.15.45:0/474614543 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fc6f40106e0 con 0x7fc7040ffdc0 2024-09-18T13:00:23.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.973+0000 7fc7017fa640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6ec07af30 0x7fc6ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:23.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.973+0000 7fc7017fa640 1 -- 172.21.15.45:0/474614543 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7fc6f409e6e0 con 0x7fc7040ffdc0 2024-09-18T13:00:23.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.973+0000 7fc7037fe640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6ec07af30 0x7fc6ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:23.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.973+0000 7fc7037fe640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6ec07af30 0x7fc6ec07d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc7041990e0 tx=0x7fc6f8031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:23.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:23.977+0000 7fc7017fa640 1 -- 172.21.15.45:0/474614543 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc6f4069c40 con 0x7fc7040ffdc0 2024-09-18T13:00:24.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.209+0000 7fc70a8e7640 1 -- 172.21.15.45:0/474614543 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc704198e20 con 0x7fc7040ffdc0 2024-09-18T13:00:24.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.210+0000 7fc7017fa640 1 -- 172.21.15.45:0/474614543 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+2018 (secure 0 0 0) 0x7fc6f406eaf0 con 0x7fc7040ffdc0 2024-09-18T13:00:24.211 INFO:teuthology.orchestra.run.smithi045.stdout:e23 2024-09-18T13:00:24.211 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T13:00:22:563633+0000 2024-09-18T13:00:24.211 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:00:24.211 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 23 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T13:00:22.563621+0000 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T13:00:24.212 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 78 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=24321} 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T13:00:24.213 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 24321 members: 24321 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{0:24321} state up:active seq 167 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:24329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/3263862050,v1:172.21.15.161:6825/3263862050] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{-1:34314} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.45:6828/743768893,v1:172.21.15.45:6829/743768893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:24.214 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2024-09-18T13:00:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 -- 172.21.15.45:0/474614543 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6ec07af30 msgr2=0x7fc6ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6ec07af30 0x7fc6ec07d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc7041990e0 tx=0x7fc6f8031400 comp rx=0 tx=0).stop 2024-09-18T13:00:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 -- 172.21.15.45:0/474614543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7040ffdc0 msgr2=0x7fc70419d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7040ffdc0 0x7fc70419d730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400e970 tx=0x7fc6f400ed70 comp rx=0 tx=0).stop 2024-09-18T13:00:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 -- 172.21.15.45:0/474614543 shutdown_connections 2024-09-18T13:00:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6ec07af30 0x7fc6ec07d3f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7041069a0 0x7fc70419dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 --2- 172.21.15.45:0/474614543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7040ffdc0 0x7fc70419d730 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 -- 172.21.15.45:0/474614543 >> 172.21.15.45:0/474614543 conn(0x7fc7040fbc90 msgr2=0x7fc7040fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 -- 172.21.15.45:0/474614543 shutdown_connections 2024-09-18T13:00:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.213+0000 7fc70a8e7640 1 -- 172.21.15.45:0/474614543 wait complete. 2024-09-18T13:00:24.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.306+0000 7f774d8aa640 1 -- 172.21.15.45:0/3349730032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7748102ab0 msgr2=0x7f7748102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:24.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.306+0000 7f774d8aa640 1 --2- 172.21.15.45:0/3349730032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7748102ab0 0x7f7748102e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7738009880 tx=0x7f773802a530 comp rx=0 tx=0).stop 2024-09-18T13:00:24.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.306+0000 7f774d8aa640 1 -- 172.21.15.45:0/3349730032 shutdown_connections 2024-09-18T13:00:24.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.306+0000 7f774d8aa640 1 --2- 172.21.15.45:0/3349730032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77481033d0 0x7f774810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.306+0000 7f774d8aa640 1 --2- 172.21.15.45:0/3349730032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7748102ab0 0x7f7748102e90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.306+0000 7f774d8aa640 1 -- 172.21.15.45:0/3349730032 >> 172.21.15.45:0/3349730032 conn(0x7f77480fc550 msgr2=0x7f77480fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:24.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.306+0000 7f774d8aa640 1 -- 172.21.15.45:0/3349730032 shutdown_connections 2024-09-18T13:00:24.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.306+0000 7f774d8aa640 1 -- 172.21.15.45:0/3349730032 wait complete. 2024-09-18T13:00:24.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.307+0000 7f774d8aa640 1 Processor -- start 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.307+0000 7f774d8aa640 1 -- start start 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.307+0000 7f774d8aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7748102ab0 0x7f774819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.307+0000 7f774d8aa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77481033d0 0x7f774819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.307+0000 7f774d8aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f774810ede0 con 0x7f7748102ab0 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.307+0000 7f774d8aa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f774810ec60 con 0x7f77481033d0 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.307+0000 7f7746ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7748102ab0 0x7f774819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.307+0000 7f7746ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7748102ab0 0x7f774819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48614/0 (socket says 172.21.15.45:48614) 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.307+0000 7f7746ffd640 1 -- 172.21.15.45:0/2208633452 learned_addr learned my addr 172.21.15.45:0/2208633452 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f7746ffd640 1 -- 172.21.15.45:0/2208633452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77481033d0 msgr2=0x7f774819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f773ffff640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77481033d0 0x7f774819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f7746ffd640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77481033d0 0x7f774819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f7746ffd640 1 -- 172.21.15.45:0/2208633452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77481977b0 con 0x7f7748102ab0 2024-09-18T13:00:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f773ffff640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77481033d0 0x7f774819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:00:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f7746ffd640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7748102ab0 0x7f774819d630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7738031460 tx=0x7f77380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f774c8a8640 1 -- 172.21.15.45:0/2208633452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f773803f070 con 0x7f7748102ab0 2024-09-18T13:00:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f774c8a8640 1 -- 172.21.15.45:0/2208633452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77380035f0 con 0x7f7748102ab0 2024-09-18T13:00:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f774c8a8640 1 -- 172.21.15.45:0/2208633452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7738035030 con 0x7f7748102ab0 2024-09-18T13:00:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f774d8aa640 1 -- 172.21.15.45:0/2208633452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7748197a40 con 0x7f7748102ab0 2024-09-18T13:00:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.308+0000 7f774d8aa640 1 -- 172.21.15.45:0/2208633452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7748197f70 con 0x7f7748102ab0 2024-09-18T13:00:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.309+0000 7f774d8aa640 1 -- 172.21.15.45:0/2208633452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774806a580 con 0x7f7748102ab0 2024-09-18T13:00:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.311+0000 7f774c8a8640 1 -- 172.21.15.45:0/2208633452 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f7738042070 con 0x7f7748102ab0 2024-09-18T13:00:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.311+0000 7f774c8a8640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f773407af80 0x7f773407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.311+0000 7f774c8a8640 1 -- 172.21.15.45:0/2208633452 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f77380be910 con 0x7f7748102ab0 2024-09-18T13:00:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.311+0000 7f773ffff640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f773407af80 0x7f773407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.312+0000 7f773ffff640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f773407af80 0x7f773407d440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f77481088f0 tx=0x7f7730009670 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.319+0000 7f774c8a8640 1 -- 172.21.15.45:0/2208633452 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7738089f90 con 0x7f7748102ab0 2024-09-18T13:00:24.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.532+0000 7f774d8aa640 1 -- 172.21.15.45:0/2208633452 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7748198220 con 0x7f773407af80 2024-09-18T13:00:24.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.533+0000 7f774c8a8640 1 -- 172.21.15.45:0/2208633452 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f7748198220 con 0x7f773407af80 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout: "osd", 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr", 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout: "mon", 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout: "crash" 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T13:00:24.535 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "12/23 daemons upgraded", 2024-09-18T13:00:24.536 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:00:24.536 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T13:00:24.536 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T13:00:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.535+0000 7f774d8aa640 1 -- 172.21.15.45:0/2208633452 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f773407af80 msgr2=0x7f773407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.535+0000 7f774d8aa640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f773407af80 0x7f773407d440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f77481088f0 tx=0x7f7730009670 comp rx=0 tx=0).stop 2024-09-18T13:00:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.535+0000 7f774d8aa640 1 -- 172.21.15.45:0/2208633452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7748102ab0 msgr2=0x7f774819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.535+0000 7f774d8aa640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7748102ab0 0x7f774819d630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7738031460 tx=0x7f77380045e0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.536+0000 7f774d8aa640 1 -- 172.21.15.45:0/2208633452 shutdown_connections 2024-09-18T13:00:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.536+0000 7f774d8aa640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f773407af80 0x7f773407d440 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.536+0000 7f774d8aa640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77481033d0 0x7f774819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.536+0000 7f774d8aa640 1 --2- 172.21.15.45:0/2208633452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7748102ab0 0x7f774819d630 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.536+0000 7f774d8aa640 1 -- 172.21.15.45:0/2208633452 >> 172.21.15.45:0/2208633452 conn(0x7f77480fc550 msgr2=0x7f774810aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:24.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.536+0000 7f774d8aa640 1 -- 172.21.15.45:0/2208633452 shutdown_connections 2024-09-18T13:00:24.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.536+0000 7f774d8aa640 1 -- 172.21.15.45:0/2208633452 wait complete. 2024-09-18T13:00:24.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.623+0000 7f4019749640 1 -- 172.21.15.45:0/4257112528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014102b70 msgr2=0x7f4014102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:24.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.623+0000 7f4019749640 1 --2- 172.21.15.45:0/4257112528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014102b70 0x7f4014102f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4004009880 tx=0x7f400402a530 comp rx=0 tx=0).stop 2024-09-18T13:00:24.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.623+0000 7f4019749640 1 -- 172.21.15.45:0/4257112528 shutdown_connections 2024-09-18T13:00:24.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.623+0000 7f4019749640 1 --2- 172.21.15.45:0/4257112528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4014103490 0x7f401410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.623+0000 7f4019749640 1 --2- 172.21.15.45:0/4257112528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014102b70 0x7f4014102f50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.623+0000 7f4019749640 1 -- 172.21.15.45:0/4257112528 >> 172.21.15.45:0/4257112528 conn(0x7f40140fc510 msgr2=0x7f40140fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:24.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.623+0000 7f4019749640 1 -- 172.21.15.45:0/4257112528 shutdown_connections 2024-09-18T13:00:24.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.623+0000 7f4019749640 1 -- 172.21.15.45:0/4257112528 wait complete. 2024-09-18T13:00:24.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.624+0000 7f4019749640 1 Processor -- start 2024-09-18T13:00:24.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.624+0000 7f4019749640 1 -- start start 2024-09-18T13:00:24.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.624+0000 7f4019749640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4014102b70 0x7f40141007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:24.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.624+0000 7f4019749640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014103490 0x7f4014100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:24.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.624+0000 7f4019749640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f401410ee60 con 0x7f4014103490 2024-09-18T13:00:24.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.624+0000 7f4019749640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f401410ece0 con 0x7f4014102b70 2024-09-18T13:00:24.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.624+0000 7f40127fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014103490 0x7f4014100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f40127fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014103490 0x7f4014100d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48628/0 (socket says 172.21.15.45:48628) 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f40127fc640 1 -- 172.21.15.45:0/157059323 learned_addr learned my addr 172.21.15.45:0/157059323 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f4012ffd640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4014102b70 0x7f40141007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f40127fc640 1 -- 172.21.15.45:0/157059323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4014102b70 msgr2=0x7f40141007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f40127fc640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4014102b70 0x7f40141007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f40127fc640 1 -- 172.21.15.45:0/157059323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4014101250 con 0x7f4014103490 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f40127fc640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014103490 0x7f4014100d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f400800b420 tx=0x7f400800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f3ffbfff640 1 -- 172.21.15.45:0/157059323 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4008011630 con 0x7f4014103490 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f3ffbfff640 1 -- 172.21.15.45:0/157059323 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4008016070 con 0x7f4014103490 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f4019749640 1 -- 172.21.15.45:0/157059323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4014101540 con 0x7f4014103490 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f3ffbfff640 1 -- 172.21.15.45:0/157059323 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4008010d40 con 0x7f4014103490 2024-09-18T13:00:24.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.625+0000 7f4019749640 1 -- 172.21.15.45:0/157059323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40141a3f30 con 0x7f4014103490 2024-09-18T13:00:24.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.627+0000 7f4019749640 1 -- 172.21.15.45:0/157059323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f401406ad00 con 0x7f4014103490 2024-09-18T13:00:24.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.627+0000 7f3ffbfff640 1 -- 172.21.15.45:0/157059323 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f400801b460 con 0x7f4014103490 2024-09-18T13:00:24.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.628+0000 7f3ffbfff640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3ffc07af30 0x7f3ffc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:24.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.628+0000 7f3ffbfff640 1 -- 172.21.15.45:0/157059323 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f400809d790 con 0x7f4014103490 2024-09-18T13:00:24.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.628+0000 7f4012ffd640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3ffc07af30 0x7f3ffc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:24.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.628+0000 7f4012ffd640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3ffc07af30 0x7f3ffc07d3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40040096c0 tx=0x7f4004004f30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:24.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.632+0000 7f3ffbfff640 1 -- 172.21.15.45:0/157059323 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4008068cf0 con 0x7f4014103490 2024-09-18T13:00:24.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:24 smithi045 ceph-mon[109129]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:24.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:24 smithi045 ceph-mon[109129]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:24.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:24 smithi045 ceph-mon[109129]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:24.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:24 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1319578443' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:24.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:24 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/474614543' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:24.898 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:24.898 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:24.898 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:00:24.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.896+0000 7f4019749640 1 -- 172.21.15.45:0/157059323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4014105fd0 con 0x7f4014103490 2024-09-18T13:00:24.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.896+0000 7f3ffbfff640 1 -- 172.21.15.45:0/157059323 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f400806dba0 con 0x7f4014103490 2024-09-18T13:00:24.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 -- 172.21.15.45:0/157059323 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3ffc07af30 msgr2=0x7f3ffc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:24.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3ffc07af30 0x7f3ffc07d3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40040096c0 tx=0x7f4004004f30 comp rx=0 tx=0).stop 2024-09-18T13:00:24.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 -- 172.21.15.45:0/157059323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014103490 msgr2=0x7f4014100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:24.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014103490 0x7f4014100d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f400800b420 tx=0x7f400800b8e0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 -- 172.21.15.45:0/157059323 shutdown_connections 2024-09-18T13:00:24.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3ffc07af30 0x7f3ffc07d3f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014103490 0x7f4014100d10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 --2- 172.21.15.45:0/157059323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4014102b70 0x7f40141007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 -- 172.21.15.45:0/157059323 >> 172.21.15.45:0/157059323 conn(0x7f40140fc510 msgr2=0x7f4014108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 -- 172.21.15.45:0/157059323 shutdown_connections 2024-09-18T13:00:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:24.899+0000 7f4019749640 1 -- 172.21.15.45:0/157059323 wait complete. 2024-09-18T13:00:25.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:24 smithi161 ceph-mon[80292]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:25.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:24 smithi161 ceph-mon[80292]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:25.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:24 smithi161 ceph-mon[80292]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:25.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:24 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1319578443' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:25.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:24 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/474614543' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:25 smithi161 ceph-mon[80292]: pgmap v261: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-09-18T13:00:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:25 smithi161 ceph-mon[80292]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:25 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/157059323' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:25.830 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:25 smithi045 ceph-mon[109129]: pgmap v261: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-09-18T13:00:25.830 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:25 smithi045 ceph-mon[109129]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:25.830 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:25 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/157059323' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:27 smithi045 ceph-mon[109129]: pgmap v262: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-18T13:00:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:27 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:27 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:28.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:27 smithi161 ceph-mon[80292]: pgmap v262: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-18T13:00:28.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:27 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:28.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:27 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:28.934 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:28 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:28.934 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:28 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:28 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:28 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:29 smithi045 ceph-mon[109129]: pgmap v263: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T13:00:30.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:29 smithi161 ceph-mon[80292]: pgmap v263: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T13:00:31.715 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: pgmap v264: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 7.0 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-18T13:00:31.715 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:31.715 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:31.715 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:31.715 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:31.716 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:31.716 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:31.716 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:31.716 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:31.716 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:31.716 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: pgmap v264: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 7.0 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-18T13:00:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:33.309 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:33 smithi045 ceph-mon[109129]: Upgrade: Updating mds.cephfs.smithi045.favmzs 2024-09-18T13:00:33.309 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:33.309 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.favmzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T13:00:33.309 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:33.309 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:33 smithi045 ceph-mon[109129]: Deploying daemon mds.cephfs.smithi045.favmzs on smithi045 2024-09-18T13:00:33.309 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:33 smithi045 ceph-mon[109129]: pgmap v265: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-18T13:00:33.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:33 smithi161 ceph-mon[80292]: Upgrade: Updating mds.cephfs.smithi045.favmzs 2024-09-18T13:00:33.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:33.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi045.favmzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T13:00:33.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:33.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:33 smithi161 ceph-mon[80292]: Deploying daemon mds.cephfs.smithi045.favmzs on smithi045 2024-09-18T13:00:33.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:33 smithi161 ceph-mon[80292]: pgmap v265: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-18T13:00:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:35 smithi045 ceph-mon[109129]: osdmap e79: 6 total, 6 up, 6 in 2024-09-18T13:00:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:35 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi161.maxdew=up:active} 2 up:standby 2024-09-18T13:00:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:35 smithi045 ceph-mon[109129]: pgmap v267: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.8 KiB/s wr, 4 op/s 2024-09-18T13:00:35.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:35 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"} : dispatch 2024-09-18T13:00:35.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:35 smithi161 ceph-mon[80292]: osdmap e79: 6 total, 6 up, 6 in 2024-09-18T13:00:35.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:35 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi161.maxdew=up:active} 2 up:standby 2024-09-18T13:00:35.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:35 smithi161 ceph-mon[80292]: pgmap v267: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.8 KiB/s wr, 4 op/s 2024-09-18T13:00:35.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:35 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"} : dispatch 2024-09-18T13:00:37.624 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:37 smithi045 ceph-mon[109129]: pgmap v268: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s wr, 2 op/s 2024-09-18T13:00:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:37 smithi161 ceph-mon[80292]: pgmap v268: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s wr, 2 op/s 2024-09-18T13:00:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:39.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:38 smithi045 ceph-mon[109129]: pgmap v269: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s wr, 2 op/s 2024-09-18T13:00:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:38 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.45:6828/3858768927,v1:172.21.15.45:6829/3858768927] up:boot 2024-09-18T13:00:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:38 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi161.maxdew=up:active} 3 up:standby 2024-09-18T13:00:39.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"} : dispatch 2024-09-18T13:00:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:38 smithi161 ceph-mon[80292]: pgmap v269: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s wr, 2 op/s 2024-09-18T13:00:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:38 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.45:6828/3858768927,v1:172.21.15.45:6829/3858768927] up:boot 2024-09-18T13:00:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:38 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi161.maxdew=up:active} 3 up:standby 2024-09-18T13:00:39.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi045.favmzs"} : dispatch 2024-09-18T13:00:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:41 smithi045 ceph-mon[109129]: pgmap v270: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s wr, 2 op/s 2024-09-18T13:00:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:41 smithi161 ceph-mon[80292]: pgmap v270: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s wr, 2 op/s 2024-09-18T13:00:43.645 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:43 smithi045 ceph-mon[109129]: pgmap v271: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:43.645 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:43 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:43.645 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:43 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:43.645 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:43 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:43.645 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:43 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:43 smithi161 ceph-mon[80292]: pgmap v271: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:43 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:43 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:43 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:43 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:45.732 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:45 smithi045 ceph-mon[109129]: pgmap v272: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:45 smithi161 ceph-mon[80292]: pgmap v272: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: pgmap v273: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:47.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:47.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:47.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:47.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:47.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:47.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:47 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: pgmap v273: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:00:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:47.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:47.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:47.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:47.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:47.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:47 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:49.165 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:48 smithi161 ceph-mon[80292]: Upgrade: Updating mds.cephfs.smithi161.xoxpyp 2024-09-18T13:00:49.165 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:48 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:49.165 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:48 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.xoxpyp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T13:00:49.165 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:48 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:49.166 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:48 smithi161 ceph-mon[80292]: Deploying daemon mds.cephfs.smithi161.xoxpyp on smithi161 2024-09-18T13:00:49.166 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:48 smithi161 ceph-mon[80292]: pgmap v274: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:49.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:48 smithi045 ceph-mon[109129]: Upgrade: Updating mds.cephfs.smithi161.xoxpyp 2024-09-18T13:00:49.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:48 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:49.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:48 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.xoxpyp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T13:00:49.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:48 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:00:49.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:48 smithi045 ceph-mon[109129]: Deploying daemon mds.cephfs.smithi161.xoxpyp on smithi161 2024-09-18T13:00:49.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:48 smithi045 ceph-mon[109129]: pgmap v274: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:51.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:50 smithi045 ceph-mon[109129]: osdmap e80: 6 total, 6 up, 6 in 2024-09-18T13:00:51.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:50 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi161.maxdew=up:active} 2 up:standby 2024-09-18T13:00:51.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:50 smithi045 ceph-mon[109129]: pgmap v276: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:51.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:50 smithi161 ceph-mon[80292]: osdmap e80: 6 total, 6 up, 6 in 2024-09-18T13:00:51.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:50 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi161.maxdew=up:active} 2 up:standby 2024-09-18T13:00:51.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:50 smithi161 ceph-mon[80292]: pgmap v276: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:53 smithi045 ceph-mon[109129]: pgmap v277: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:53 smithi161 ceph-mon[80292]: pgmap v277: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:00:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.002+0000 7f26947af640 1 -- 172.21.15.45:0/139642192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f268c107900 msgr2=0x7f268c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.002+0000 7f26947af640 1 --2- 172.21.15.45:0/139642192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f268c107900 0x7f268c107ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2688009880 tx=0x7f268802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.002+0000 7f26947af640 1 -- 172.21.15.45:0/139642192 shutdown_connections 2024-09-18T13:00:55.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.002+0000 7f26947af640 1 --2- 172.21.15.45:0/139642192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f268c101900 0x7f268c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.002+0000 7f26947af640 1 --2- 172.21.15.45:0/139642192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f268c107900 0x7f268c107ce0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.002+0000 7f26947af640 1 -- 172.21.15.45:0/139642192 >> 172.21.15.45:0/139642192 conn(0x7f268c0fd600 msgr2=0x7f268c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:55.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.002+0000 7f26947af640 1 -- 172.21.15.45:0/139642192 shutdown_connections 2024-09-18T13:00:55.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.002+0000 7f26947af640 1 -- 172.21.15.45:0/139642192 wait complete. 2024-09-18T13:00:55.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f26947af640 1 Processor -- start 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f26947af640 1 -- start start 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f26947af640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f268c101900 0x7f268c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f26947af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f268c107900 0x7f268c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f26947af640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f268c10edd0 con 0x7f268c107900 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f26947af640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f268c10ec50 con 0x7f268c101900 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f2691d4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f268c107900 0x7f268c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f2691d4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f268c107900 0x7f268c19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40218/0 (socket says 172.21.15.45:40218) 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f2691d4a640 1 -- 172.21.15.45:0/1980253667 learned_addr learned my addr 172.21.15.45:0/1980253667 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f269254b640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f268c101900 0x7f268c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f2691d4a640 1 -- 172.21.15.45:0/1980253667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f268c101900 msgr2=0x7f268c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f2691d4a640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f268c101900 0x7f268c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.003+0000 7f2691d4a640 1 -- 172.21.15.45:0/1980253667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c1977c0 con 0x7f268c107900 2024-09-18T13:00:55.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.004+0000 7f2691d4a640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f268c107900 0x7f268c19db80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f268000eb10 tx=0x7f268000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:55.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.004+0000 7f267f7fe640 1 -- 172.21.15.45:0/1980253667 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f268000cce0 con 0x7f268c107900 2024-09-18T13:00:55.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.004+0000 7f267f7fe640 1 -- 172.21.15.45:0/1980253667 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2680005020 con 0x7f268c107900 2024-09-18T13:00:55.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.004+0000 7f26947af640 1 -- 172.21.15.45:0/1980253667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268c197ab0 con 0x7f268c107900 2024-09-18T13:00:55.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.004+0000 7f267f7fe640 1 -- 172.21.15.45:0/1980253667 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2680010660 con 0x7f268c107900 2024-09-18T13:00:55.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.004+0000 7f26947af640 1 -- 172.21.15.45:0/1980253667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268c198040 con 0x7f268c107900 2024-09-18T13:00:55.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.005+0000 7f26947af640 1 -- 172.21.15.45:0/1980253667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f268c103040 con 0x7f268c107900 2024-09-18T13:00:55.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.006+0000 7f267f7fe640 1 -- 172.21.15.45:0/1980253667 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f26800051d0 con 0x7f268c107900 2024-09-18T13:00:55.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.006+0000 7f267f7fe640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f267807af80 0x7f267807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.006+0000 7f267f7fe640 1 -- 172.21.15.45:0/1980253667 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f268009e740 con 0x7f268c107900 2024-09-18T13:00:55.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.006+0000 7f269254b640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f267807af80 0x7f267807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.007+0000 7f269254b640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f267807af80 0x7f267807d440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f26880096c0 tx=0x7f2688031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:55.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.011+0000 7f267f7fe640 1 -- 172.21.15.45:0/1980253667 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2680069dc0 con 0x7f268c107900 2024-09-18T13:00:55.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.218+0000 7f26947af640 1 -- 172.21.15.45:0/1980253667 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f268c198350 con 0x7f267807af80 2024-09-18T13:00:55.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.219+0000 7f267f7fe640 1 -- 172.21.15.45:0/1980253667 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f268c198350 con 0x7f267807af80 2024-09-18T13:00:55.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.221+0000 7f26947af640 1 -- 172.21.15.45:0/1980253667 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f267807af80 msgr2=0x7f267807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.221+0000 7f26947af640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f267807af80 0x7f267807d440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f26880096c0 tx=0x7f2688031400 comp rx=0 tx=0).stop 2024-09-18T13:00:55.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.221+0000 7f26947af640 1 -- 172.21.15.45:0/1980253667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f268c107900 msgr2=0x7f268c19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.221+0000 7f26947af640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f268c107900 0x7f268c19db80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f268000eb10 tx=0x7f268000c2d0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.222+0000 7f26947af640 1 -- 172.21.15.45:0/1980253667 shutdown_connections 2024-09-18T13:00:55.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.222+0000 7f26947af640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f267807af80 0x7f267807d440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.222+0000 7f26947af640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f268c107900 0x7f268c19db80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.222+0000 7f26947af640 1 --2- 172.21.15.45:0/1980253667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f268c101900 0x7f268c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.222+0000 7f26947af640 1 -- 172.21.15.45:0/1980253667 >> 172.21.15.45:0/1980253667 conn(0x7f268c0fd600 msgr2=0x7f268c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:55.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.222+0000 7f26947af640 1 -- 172.21.15.45:0/1980253667 shutdown_connections 2024-09-18T13:00:55.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.222+0000 7f26947af640 1 -- 172.21.15.45:0/1980253667 wait complete. 2024-09-18T13:00:55.233 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T13:00:55.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.309+0000 7fa37f8ed640 1 -- 172.21.15.45:0/706945728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3781007f0 msgr2=0x7fa378100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.309+0000 7fa37f8ed640 1 --2- 172.21.15.45:0/706945728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3781007f0 0x7fa378100c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa368009880 tx=0x7fa36802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.309+0000 7fa37f8ed640 1 -- 172.21.15.45:0/706945728 shutdown_connections 2024-09-18T13:00:55.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.309+0000 7fa37f8ed640 1 --2- 172.21.15.45:0/706945728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3781007f0 0x7fa378100c50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.309+0000 7fa37f8ed640 1 --2- 172.21.15.45:0/706945728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3781067f0 0x7fa378106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.309+0000 7fa37f8ed640 1 -- 172.21.15.45:0/706945728 >> 172.21.15.45:0/706945728 conn(0x7fa3780fc550 msgr2=0x7fa3780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:55.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.310+0000 7fa37f8ed640 1 -- 172.21.15.45:0/706945728 shutdown_connections 2024-09-18T13:00:55.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.310+0000 7fa37f8ed640 1 -- 172.21.15.45:0/706945728 wait complete. 2024-09-18T13:00:55.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.310+0000 7fa37f8ed640 1 Processor -- start 2024-09-18T13:00:55.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.310+0000 7fa37f8ed640 1 -- start start 2024-09-18T13:00:55.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37f8ed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3781007f0 0x7fa37819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37f8ed640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3781067f0 0x7fa37819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37f8ed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa37810dca0 con 0x7fa3781007f0 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37f8ed640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa37810db20 con 0x7fa3781067f0 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37d689640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3781007f0 0x7fa37819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37d689640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3781007f0 0x7fa37819f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40240/0 (socket says 172.21.15.45:40240) 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37d689640 1 -- 172.21.15.45:0/3773071081 learned_addr learned my addr 172.21.15.45:0/3773071081 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37ce88640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3781067f0 0x7fa37819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37d689640 1 -- 172.21.15.45:0/3773071081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3781067f0 msgr2=0x7fa37819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37d689640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3781067f0 0x7fa37819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37d689640 1 -- 172.21.15.45:0/3773071081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa378199990 con 0x7fa3781007f0 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37d689640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3781007f0 0x7fa37819f7d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa37400d8d0 tx=0x7fa37400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa36e7fc640 1 -- 172.21.15.45:0/3773071081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa374017030 con 0x7fa3781007f0 2024-09-18T13:00:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.311+0000 7fa37f8ed640 1 -- 172.21.15.45:0/3773071081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa378199c80 con 0x7fa3781007f0 2024-09-18T13:00:55.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.312+0000 7fa36e7fc640 1 -- 172.21.15.45:0/3773071081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa374004020 con 0x7fa3781007f0 2024-09-18T13:00:55.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.312+0000 7fa37f8ed640 1 -- 172.21.15.45:0/3773071081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37819a1e0 con 0x7fa3781007f0 2024-09-18T13:00:55.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.312+0000 7fa36e7fc640 1 -- 172.21.15.45:0/3773071081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3740054b0 con 0x7fa3781007f0 2024-09-18T13:00:55.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.313+0000 7fa37f8ed640 1 -- 172.21.15.45:0/3773071081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa378101f30 con 0x7fa3781007f0 2024-09-18T13:00:55.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.313+0000 7fa36e7fc640 1 -- 172.21.15.45:0/3773071081 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fa3740041d0 con 0x7fa3781007f0 2024-09-18T13:00:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.314+0000 7fa36e7fc640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa36407af30 0x7fa36407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.314+0000 7fa36e7fc640 1 -- 172.21.15.45:0/3773071081 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fa374018070 con 0x7fa3781007f0 2024-09-18T13:00:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.314+0000 7fa37ce88640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa36407af30 0x7fa36407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.315+0000 7fa37ce88640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa36407af30 0x7fa36407d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa37819b180 tx=0x7fa368031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.319+0000 7fa36e7fc640 1 -- 172.21.15.45:0/3773071081 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa374069190 con 0x7fa3781007f0 2024-09-18T13:00:55.496 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:55 smithi045 ceph-mon[109129]: pgmap v278: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:55.496 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:55 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:55.496 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:55 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:55.496 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:55 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:55.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.526+0000 7fa37f8ed640 1 -- 172.21.15.45:0/3773071081 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa37819a550 con 0x7fa36407af30 2024-09-18T13:00:55.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.527+0000 7fa36e7fc640 1 -- 172.21.15.45:0/3773071081 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa37819a550 con 0x7fa36407af30 2024-09-18T13:00:55.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 -- 172.21.15.45:0/3773071081 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa36407af30 msgr2=0x7fa36407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa36407af30 0x7fa36407d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa37819b180 tx=0x7fa368031400 comp rx=0 tx=0).stop 2024-09-18T13:00:55.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 -- 172.21.15.45:0/3773071081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3781007f0 msgr2=0x7fa37819f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3781007f0 0x7fa37819f7d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa37400d8d0 tx=0x7fa37400dd90 comp rx=0 tx=0).stop 2024-09-18T13:00:55.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 -- 172.21.15.45:0/3773071081 shutdown_connections 2024-09-18T13:00:55.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa36407af30 0x7fa36407d3f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3781067f0 0x7fa37819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 --2- 172.21.15.45:0/3773071081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3781007f0 0x7fa37819f7d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 -- 172.21.15.45:0/3773071081 >> 172.21.15.45:0/3773071081 conn(0x7fa3780fc550 msgr2=0x7fa378069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:55.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 -- 172.21.15.45:0/3773071081 shutdown_connections 2024-09-18T13:00:55.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.530+0000 7fa37f8ed640 1 -- 172.21.15.45:0/3773071081 wait complete. 2024-09-18T13:00:55.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.615+0000 7f777cd41640 1 -- 172.21.15.45:0/1687857567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778102b10 msgr2=0x7f7778102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.615+0000 7f777cd41640 1 --2- 172.21.15.45:0/1687857567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778102b10 0x7f7778102ef0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f77680098b0 tx=0x7f776802a560 comp rx=0 tx=0).stop 2024-09-18T13:00:55.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.615+0000 7f777cd41640 1 -- 172.21.15.45:0/1687857567 shutdown_connections 2024-09-18T13:00:55.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.615+0000 7f777cd41640 1 --2- 172.21.15.45:0/1687857567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7778103430 0x7f777810b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.615+0000 7f777cd41640 1 --2- 172.21.15.45:0/1687857567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778102b10 0x7f7778102ef0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.615+0000 7f777cd41640 1 -- 172.21.15.45:0/1687857567 >> 172.21.15.45:0/1687857567 conn(0x7f77780fc550 msgr2=0x7f77780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:55.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.616+0000 7f777cd41640 1 -- 172.21.15.45:0/1687857567 shutdown_connections 2024-09-18T13:00:55.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.616+0000 7f777cd41640 1 -- 172.21.15.45:0/1687857567 wait complete. 2024-09-18T13:00:55.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.616+0000 7f777cd41640 1 Processor -- start 2024-09-18T13:00:55.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.616+0000 7f777cd41640 1 -- start start 2024-09-18T13:00:55.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f777cd41640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7778102b10 0x7f777819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f777cd41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778103430 0x7f777819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f777cd41640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f777810edc0 con 0x7f7778103430 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f777cd41640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f777810ec40 con 0x7f7778102b10 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f7775d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778103430 0x7f777819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f7775d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778103430 0x7f777819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40246/0 (socket says 172.21.15.45:40246) 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f7775d9b640 1 -- 172.21.15.45:0/3002783550 learned_addr learned my addr 172.21.15.45:0/3002783550 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f777659c640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7778102b10 0x7f777819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f7775d9b640 1 -- 172.21.15.45:0/3002783550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7778102b10 msgr2=0x7f777819f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f7775d9b640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7778102b10 0x7f777819f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f7775d9b640 1 -- 172.21.15.45:0/3002783550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77781999d0 con 0x7f7778103430 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.617+0000 7f777659c640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7778102b10 0x7f777819f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:00:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.618+0000 7f7775d9b640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778103430 0x7f777819fd50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f776c00d8d0 tx=0x7f776c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.618+0000 7f77677fe640 1 -- 172.21.15.45:0/3002783550 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f776c017070 con 0x7f7778103430 2024-09-18T13:00:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.618+0000 7f77677fe640 1 -- 172.21.15.45:0/3002783550 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f776c010460 con 0x7f7778103430 2024-09-18T13:00:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.618+0000 7f77677fe640 1 -- 172.21.15.45:0/3002783550 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f776c00f5f0 con 0x7f7778103430 2024-09-18T13:00:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.618+0000 7f777cd41640 1 -- 172.21.15.45:0/3002783550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7778199cc0 con 0x7f7778103430 2024-09-18T13:00:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.618+0000 7f777cd41640 1 -- 172.21.15.45:0/3002783550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777819a250 con 0x7f7778103430 2024-09-18T13:00:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.619+0000 7f777cd41640 1 -- 172.21.15.45:0/3002783550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777806a520 con 0x7f7778103430 2024-09-18T13:00:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.620+0000 7f77677fe640 1 -- 172.21.15.45:0/3002783550 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f776c009a30 con 0x7f7778103430 2024-09-18T13:00:55.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.621+0000 7f77677fe640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f776007af30 0x7f776007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.621+0000 7f77677fe640 1 -- 172.21.15.45:0/3002783550 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f776c09dec0 con 0x7f7778103430 2024-09-18T13:00:55.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.621+0000 7f777659c640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f776007af30 0x7f776007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.622+0000 7f777659c640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f776007af30 0x7f776007d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7768009230 tx=0x7f7768031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:55.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.626+0000 7f77677fe640 1 -- 172.21.15.45:0/3002783550 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f776c0694c0 con 0x7f7778103430 2024-09-18T13:00:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:55 smithi161 ceph-mon[80292]: pgmap v278: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:55 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:55 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:55 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:00:55.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.842+0000 7f777cd41640 1 -- 172.21.15.45:0/3002783550 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f777819af00 con 0x7f776007af30 2024-09-18T13:00:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.852+0000 7f77677fe640 1 -- 172.21.15.45:0/3002783550 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f777819af00 con 0x7f776007af30 2024-09-18T13:00:55.853 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:00:55.853 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (6m) 13s ago 16m 20.1M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T13:00:55.853 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (9m) 13s ago 17m 9248k - 19.1.1-330-gc2ddf972 ebb0615149de 81e2a1a8eea1 2024-09-18T13:00:55.853 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (8m) 52s ago 16m 8623k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T13:00:55.853 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (4m) 13s ago 17m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T13:00:55.853 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (4m) 52s ago 16m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (5m) 13s ago 16m 77.6M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (18s) 13s ago 11m 11.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9bf29d5aa6b6 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (34s) 13s ago 11m 16.0M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e7c39085fb8d 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (11m) 52s ago 11m 18.7M - 19.1.1-330-gc2ddf972 ebb0615149de 765d73e19f5a 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 starting - - - - 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (8m) 13s ago 18m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (7m) 52s ago 16m 458M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (4m) 13s ago 18m 49.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (4m) 52s ago 16m 37.1M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (6m) 13s ago 16m 11.8M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (6m) 52s ago 16m 11.0M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (3m) 13s ago 14m 92.5M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T13:00:55.854 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (3m) 13s ago 14m 100M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 7d4cd0351725 2024-09-18T13:00:55.855 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (2m) 13s ago 13m 87.0M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4f620cf3977f 2024-09-18T13:00:55.855 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (2m) 52s ago 13m 99.1M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1fbe6c224b87 2024-09-18T13:00:55.855 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (89s) 52s ago 13m 86.7M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b3c49339a90c 2024-09-18T13:00:55.855 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (55s) 52s ago 12m 11.8M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 035aa0efadd6 2024-09-18T13:00:55.855 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (6m) 13s ago 16m 54.2M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T13:00:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 -- 172.21.15.45:0/3002783550 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f776007af30 msgr2=0x7f776007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f776007af30 0x7f776007d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7768009230 tx=0x7f7768031400 comp rx=0 tx=0).stop 2024-09-18T13:00:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 -- 172.21.15.45:0/3002783550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778103430 msgr2=0x7f777819fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778103430 0x7f777819fd50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f776c00d8d0 tx=0x7f776c00dd90 comp rx=0 tx=0).stop 2024-09-18T13:00:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 -- 172.21.15.45:0/3002783550 shutdown_connections 2024-09-18T13:00:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f776007af30 0x7f776007d3f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7778103430 0x7f777819fd50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 --2- 172.21.15.45:0/3002783550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7778102b10 0x7f777819f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 -- 172.21.15.45:0/3002783550 >> 172.21.15.45:0/3002783550 conn(0x7f77780fc550 msgr2=0x7f7778100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 -- 172.21.15.45:0/3002783550 shutdown_connections 2024-09-18T13:00:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.854+0000 7f777cd41640 1 -- 172.21.15.45:0/3002783550 wait complete. 2024-09-18T13:00:55.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.939+0000 7f5da359e640 1 -- 172.21.15.45:0/2700554277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da41017b0 msgr2=0x7f5da4101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.939+0000 7f5da359e640 1 --2- 172.21.15.45:0/2700554277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da41017b0 0x7f5da4101c10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009880 tx=0x7f5d9802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.939+0000 7f5da359e640 1 -- 172.21.15.45:0/2700554277 shutdown_connections 2024-09-18T13:00:55.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.939+0000 7f5da359e640 1 --2- 172.21.15.45:0/2700554277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da41017b0 0x7f5da4101c10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.939+0000 7f5da359e640 1 --2- 172.21.15.45:0/2700554277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5da41077b0 0x7f5da4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.939+0000 7f5da359e640 1 -- 172.21.15.45:0/2700554277 >> 172.21.15.45:0/2700554277 conn(0x7f5da40fd4b0 msgr2=0x7f5da40ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:55.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.939+0000 7f5da359e640 1 -- 172.21.15.45:0/2700554277 shutdown_connections 2024-09-18T13:00:55.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.939+0000 7f5da359e640 1 -- 172.21.15.45:0/2700554277 wait complete. 2024-09-18T13:00:55.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.939+0000 7f5da359e640 1 Processor -- start 2024-09-18T13:00:55.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da359e640 1 -- start start 2024-09-18T13:00:55.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5da41017b0 0x7f5da419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da41077b0 0x7f5da419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da359e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5da410ec60 con 0x7f5da41077b0 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da359e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f5da410eae0 con 0x7f5da41017b0 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da41077b0 0x7f5da419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da41077b0 0x7f5da419db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40274/0 (socket says 172.21.15.45:40274) 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da1d9b640 1 -- 172.21.15.45:0/523299200 learned_addr learned my addr 172.21.15.45:0/523299200 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da259c640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5da41017b0 0x7f5da419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da1d9b640 1 -- 172.21.15.45:0/523299200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5da41017b0 msgr2=0x7f5da419d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da1d9b640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5da41017b0 0x7f5da419d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.940+0000 7f5da1d9b640 1 -- 172.21.15.45:0/523299200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da41976b0 con 0x7f5da41077b0 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.941+0000 7f5da1d9b640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da41077b0 0x7f5da419db20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d98031460 tx=0x7f5d980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.941+0000 7f5d937fe640 1 -- 172.21.15.45:0/523299200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d9803f070 con 0x7f5da41077b0 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.941+0000 7f5d937fe640 1 -- 172.21.15.45:0/523299200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d98004b10 con 0x7f5da41077b0 2024-09-18T13:00:55.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.941+0000 7f5da359e640 1 -- 172.21.15.45:0/523299200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da4197940 con 0x7f5da41077b0 2024-09-18T13:00:55.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.941+0000 7f5d937fe640 1 -- 172.21.15.45:0/523299200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d98035030 con 0x7f5da41077b0 2024-09-18T13:00:55.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.941+0000 7f5da359e640 1 -- 172.21.15.45:0/523299200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da4197e40 con 0x7f5da41077b0 2024-09-18T13:00:55.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.942+0000 7f5da359e640 1 -- 172.21.15.45:0/523299200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da4102ef0 con 0x7f5da41077b0 2024-09-18T13:00:55.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.943+0000 7f5d937fe640 1 -- 172.21.15.45:0/523299200 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f5d98042070 con 0x7f5da41077b0 2024-09-18T13:00:55.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.943+0000 7f5d937fe640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5d8c07af40 0x7f5d8c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:55.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.943+0000 7f5d937fe640 1 -- 172.21.15.45:0/523299200 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f5d980beaa0 con 0x7f5da41077b0 2024-09-18T13:00:55.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.943+0000 7f5da259c640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5d8c07af40 0x7f5d8c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:55.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.944+0000 7f5da259c640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5d8c07af40 0x7f5d8c07d400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5d94005d00 tx=0x7f5d9400b410 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:55.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:55.948+0000 7f5d937fe640 1 -- 172.21.15.45:0/523299200 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5d9808a0a0 con 0x7f5da41077b0 2024-09-18T13:00:56.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.207+0000 7f5da359e640 1 -- 172.21.15.45:0/523299200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5da4198be0 con 0x7f5da41077b0 2024-09-18T13:00:56.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.208+0000 7f5d937fe640 1 -- 172.21.15.45:0/523299200 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f5d9808c5c0 con 0x7f5da41077b0 2024-09-18T13:00:56.209 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T13:00:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T13:00:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:00:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T13:00:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:00:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 3 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 13 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T13:00:56.210 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T13:00:56.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 -- 172.21.15.45:0/523299200 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5d8c07af40 msgr2=0x7f5d8c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5d8c07af40 0x7f5d8c07d400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5d94005d00 tx=0x7f5d9400b410 comp rx=0 tx=0).stop 2024-09-18T13:00:56.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 -- 172.21.15.45:0/523299200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da41077b0 msgr2=0x7f5da419db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da41077b0 0x7f5da419db20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d98031460 tx=0x7f5d980045e0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 -- 172.21.15.45:0/523299200 shutdown_connections 2024-09-18T13:00:56.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f5d8c07af40 0x7f5d8c07d400 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da41077b0 0x7f5da419db20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 --2- 172.21.15.45:0/523299200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5da41017b0 0x7f5da419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 -- 172.21.15.45:0/523299200 >> 172.21.15.45:0/523299200 conn(0x7f5da40fd4b0 msgr2=0x7f5da40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:56.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 -- 172.21.15.45:0/523299200 shutdown_connections 2024-09-18T13:00:56.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.210+0000 7f5da359e640 1 -- 172.21.15.45:0/523299200 wait complete. 2024-09-18T13:00:56.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.295+0000 7f2737f49640 1 -- 172.21.15.45:0/1998710798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27301067f0 msgr2=0x7f2730106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.295+0000 7f2737f49640 1 --2- 172.21.15.45:0/1998710798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27301067f0 0x7f2730106bd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f272c009880 tx=0x7f272c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.295+0000 7f2737f49640 1 -- 172.21.15.45:0/1998710798 shutdown_connections 2024-09-18T13:00:56.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.295+0000 7f2737f49640 1 --2- 172.21.15.45:0/1998710798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27301007f0 0x7f2730100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.295+0000 7f2737f49640 1 --2- 172.21.15.45:0/1998710798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27301067f0 0x7f2730106bd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.295+0000 7f2737f49640 1 -- 172.21.15.45:0/1998710798 >> 172.21.15.45:0/1998710798 conn(0x7f27300fc550 msgr2=0x7f27300fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:56.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.296+0000 7f2737f49640 1 -- 172.21.15.45:0/1998710798 shutdown_connections 2024-09-18T13:00:56.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.296+0000 7f2737f49640 1 -- 172.21.15.45:0/1998710798 wait complete. 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.296+0000 7f2737f49640 1 Processor -- start 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.296+0000 7f2737f49640 1 -- start start 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.296+0000 7f2737f49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27301007f0 0x7f27300fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.296+0000 7f2737f49640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27301067f0 0x7f27300fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.296+0000 7f2737f49640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f273010dcc0 con 0x7f27301007f0 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.296+0000 7f2737f49640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f273010db40 con 0x7f27301067f0 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2735ce5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27301007f0 0x7f27300fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2735ce5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27301007f0 0x7f27300fcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40290/0 (socket says 172.21.15.45:40290) 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2735ce5640 1 -- 172.21.15.45:0/447202140 learned_addr learned my addr 172.21.15.45:0/447202140 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f27354e4640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27301067f0 0x7f27300fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:56.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2735ce5640 1 -- 172.21.15.45:0/447202140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27301067f0 msgr2=0x7f27300fd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2735ce5640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27301067f0 0x7f27300fd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2735ce5640 1 -- 172.21.15.45:0/447202140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27300fd7b0 con 0x7f27301007f0 2024-09-18T13:00:56.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f27354e4640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27301067f0 0x7f27300fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T13:00:56.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2735ce5640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27301007f0 0x7f27300fcd30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f272c031460 tx=0x7f272c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:56.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2726ffd640 1 -- 172.21.15.45:0/447202140 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f272c03f070 con 0x7f27301007f0 2024-09-18T13:00:56.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2737f49640 1 -- 172.21.15.45:0/447202140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27300fda40 con 0x7f27301007f0 2024-09-18T13:00:56.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2726ffd640 1 -- 172.21.15.45:0/447202140 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f272c0035f0 con 0x7f27301007f0 2024-09-18T13:00:56.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2726ffd640 1 -- 172.21.15.45:0/447202140 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f272c035030 con 0x7f27301007f0 2024-09-18T13:00:56.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.297+0000 7f2737f49640 1 -- 172.21.15.45:0/447202140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27301a3d70 con 0x7f27301007f0 2024-09-18T13:00:56.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.298+0000 7f2737f49640 1 -- 172.21.15.45:0/447202140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2730101f30 con 0x7f27301007f0 2024-09-18T13:00:56.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.299+0000 7f2726ffd640 1 -- 172.21.15.45:0/447202140 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f272c042070 con 0x7f27301007f0 2024-09-18T13:00:56.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.300+0000 7f2726ffd640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f271c07af30 0x7f271c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:56.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.300+0000 7f2726ffd640 1 -- 172.21.15.45:0/447202140 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f272c0be900 con 0x7f27301007f0 2024-09-18T13:00:56.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.300+0000 7f27354e4640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f271c07af30 0x7f271c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:56.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.300+0000 7f27354e4640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f271c07af30 0x7f271c07d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f27300fe7c0 tx=0x7f2720005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:56.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.304+0000 7f2726ffd640 1 -- 172.21.15.45:0/447202140 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f272c089f00 con 0x7f27301007f0 2024-09-18T13:00:56.523 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:56 smithi045 ceph-mon[109129]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:56.523 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:56 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.161:6824/1172047502,v1:172.21.15.161:6825/1172047502] up:boot 2024-09-18T13:00:56.523 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:56 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi161.maxdew=up:active} 3 up:standby 2024-09-18T13:00:56.523 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:56 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi161.xoxpyp"} : dispatch 2024-09-18T13:00:56.523 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:56 smithi045 ceph-mon[109129]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:56.523 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:56 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/523299200' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:56.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.546+0000 7f2737f49640 1 -- 172.21.15.45:0/447202140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f273002d7c0 con 0x7f27301007f0 2024-09-18T13:00:56.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.547+0000 7f2726ffd640 1 -- 172.21.15.45:0/447202140 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+2020 (secure 0 0 0) 0x7f272c08edb0 con 0x7f27301007f0 2024-09-18T13:00:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:e27 2024-09-18T13:00:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T13:00:55:333753+0000 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 23 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T13:00:22.563621+0000 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T13:00:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 78 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=24321} 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T13:00:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 24321 members: 24321 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{0:24321} state up:active seq 167 join_fscid=1 addr [v2:172.21.15.161:6826/3769095439,v1:172.21.15.161:6827/3769095439] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{-1:34350} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.45:6828/3858768927,v1:172.21.15.45:6829/3858768927] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1172047502,v1:172.21.15.161:6825/1172047502] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:00:56.552 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 27 2024-09-18T13:00:56.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 -- 172.21.15.45:0/447202140 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f271c07af30 msgr2=0x7f271c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f271c07af30 0x7f271c07d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f27300fe7c0 tx=0x7f2720005f90 comp rx=0 tx=0).stop 2024-09-18T13:00:56.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 -- 172.21.15.45:0/447202140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27301007f0 msgr2=0x7f27300fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27301007f0 0x7f27300fcd30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f272c031460 tx=0x7f272c004530 comp rx=0 tx=0).stop 2024-09-18T13:00:56.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 -- 172.21.15.45:0/447202140 shutdown_connections 2024-09-18T13:00:56.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f271c07af30 0x7f271c07d3f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27301067f0 0x7f27300fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 --2- 172.21.15.45:0/447202140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27301007f0 0x7f27300fcd30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 -- 172.21.15.45:0/447202140 >> 172.21.15.45:0/447202140 conn(0x7f27300fc550 msgr2=0x7f2730069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:56.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 -- 172.21.15.45:0/447202140 shutdown_connections 2024-09-18T13:00:56.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.549+0000 7f2737f49640 1 -- 172.21.15.45:0/447202140 wait complete. 2024-09-18T13:00:56.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.634+0000 7fea3e74e640 1 -- 172.21.15.45:0/4159103316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea38100800 msgr2=0x7fea38100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.634+0000 7fea3e74e640 1 --2- 172.21.15.45:0/4159103316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea38100800 0x7fea38100c60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea20009880 tx=0x7fea2002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.634+0000 7fea3e74e640 1 -- 172.21.15.45:0/4159103316 shutdown_connections 2024-09-18T13:00:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.634+0000 7fea3e74e640 1 --2- 172.21.15.45:0/4159103316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea38100800 0x7fea38100c60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.634+0000 7fea3e74e640 1 --2- 172.21.15.45:0/4159103316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea38106800 0x7fea38106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.634+0000 7fea3e74e640 1 -- 172.21.15.45:0/4159103316 >> 172.21.15.45:0/4159103316 conn(0x7fea380fc520 msgr2=0x7fea380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.634+0000 7fea3e74e640 1 -- 172.21.15.45:0/4159103316 shutdown_connections 2024-09-18T13:00:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.634+0000 7fea3e74e640 1 -- 172.21.15.45:0/4159103316 wait complete. 2024-09-18T13:00:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.635+0000 7fea3e74e640 1 Processor -- start 2024-09-18T13:00:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.635+0000 7fea3e74e640 1 -- start start 2024-09-18T13:00:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.635+0000 7fea3e74e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea38100800 0x7fea3819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.635+0000 7fea3e74e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea38106800 0x7fea3819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.635+0000 7fea3e74e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea3810dcb0 con 0x7fea38106800 2024-09-18T13:00:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.635+0000 7fea3e74e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fea3810db30 con 0x7fea38100800 2024-09-18T13:00:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.635+0000 7fea377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea38106800 0x7fea3819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.635+0000 7fea377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea38106800 0x7fea3819db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40322/0 (socket says 172.21.15.45:40322) 2024-09-18T13:00:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.635+0000 7fea377fe640 1 -- 172.21.15.45:0/3901875896 learned_addr learned my addr 172.21.15.45:0/3901875896 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.636+0000 7fea37fff640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea38100800 0x7fea3819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.636+0000 7fea377fe640 1 -- 172.21.15.45:0/3901875896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea38100800 msgr2=0x7fea3819d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.636+0000 7fea377fe640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea38100800 0x7fea3819d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.636+0000 7fea377fe640 1 -- 172.21.15.45:0/3901875896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea381977d0 con 0x7fea38106800 2024-09-18T13:00:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.636+0000 7fea377fe640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea38106800 0x7fea3819db90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea20031460 tx=0x7fea200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.636+0000 7fea357fa640 1 -- 172.21.15.45:0/3901875896 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea2003f070 con 0x7fea38106800 2024-09-18T13:00:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.636+0000 7fea3e74e640 1 -- 172.21.15.45:0/3901875896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea38197a60 con 0x7fea38106800 2024-09-18T13:00:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.636+0000 7fea357fa640 1 -- 172.21.15.45:0/3901875896 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea20004b10 con 0x7fea38106800 2024-09-18T13:00:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.636+0000 7fea357fa640 1 -- 172.21.15.45:0/3901875896 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea20035030 con 0x7fea38106800 2024-09-18T13:00:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.636+0000 7fea3e74e640 1 -- 172.21.15.45:0/3901875896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea38197f90 con 0x7fea38106800 2024-09-18T13:00:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.637+0000 7fea3e74e640 1 -- 172.21.15.45:0/3901875896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea38101f40 con 0x7fea38106800 2024-09-18T13:00:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.638+0000 7fea357fa640 1 -- 172.21.15.45:0/3901875896 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fea20042070 con 0x7fea38106800 2024-09-18T13:00:56.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.639+0000 7fea357fa640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fea2407af40 0x7fea2407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:56.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.639+0000 7fea357fa640 1 -- 172.21.15.45:0/3901875896 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fea200beaa0 con 0x7fea38106800 2024-09-18T13:00:56.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.639+0000 7fea37fff640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fea2407af40 0x7fea2407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:56.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.639+0000 7fea37fff640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fea2407af40 0x7fea2407d400 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fea2800bbe0 tx=0x7fea2800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:56.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.643+0000 7fea357fa640 1 -- 172.21.15.45:0/3901875896 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fea2008a0a0 con 0x7fea38106800 2024-09-18T13:00:56.725 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:56 smithi161 ceph-mon[80292]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:56.726 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:56 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.161:6824/1172047502,v1:172.21.15.161:6825/1172047502] up:boot 2024-09-18T13:00:56.726 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:56 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi161.maxdew=up:active} 3 up:standby 2024-09-18T13:00:56.726 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:56 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi161.xoxpyp"} : dispatch 2024-09-18T13:00:56.726 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:56 smithi161 ceph-mon[80292]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:56.726 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:56 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/523299200' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:00:56.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.850+0000 7fea3e74e640 1 -- 172.21.15.45:0/3901875896 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fea38198300 con 0x7fea2407af40 2024-09-18T13:00:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.852+0000 7fea357fa640 1 -- 172.21.15.45:0/3901875896 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fea38198300 con 0x7fea2407af40 2024-09-18T13:00:56.853 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T13:00:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:00:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T13:00:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:00:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T13:00:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "osd", 2024-09-18T13:00:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr", 2024-09-18T13:00:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "mon", 2024-09-18T13:00:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "crash" 2024-09-18T13:00:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T13:00:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "14/23 daemons upgraded", 2024-09-18T13:00:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T13:00:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T13:00:56.854 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T13:00:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 -- 172.21.15.45:0/3901875896 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fea2407af40 msgr2=0x7fea2407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fea2407af40 0x7fea2407d400 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fea2800bbe0 tx=0x7fea2800b390 comp rx=0 tx=0).stop 2024-09-18T13:00:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 -- 172.21.15.45:0/3901875896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea38106800 msgr2=0x7fea3819db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea38106800 0x7fea3819db90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea20031460 tx=0x7fea200045e0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 -- 172.21.15.45:0/3901875896 shutdown_connections 2024-09-18T13:00:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fea2407af40 0x7fea2407d400 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea38106800 0x7fea3819db90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 --2- 172.21.15.45:0/3901875896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea38100800 0x7fea3819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 -- 172.21.15.45:0/3901875896 >> 172.21.15.45:0/3901875896 conn(0x7fea380fc520 msgr2=0x7fea3806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:56.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 -- 172.21.15.45:0/3901875896 shutdown_connections 2024-09-18T13:00:56.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.854+0000 7fea3e74e640 1 -- 172.21.15.45:0/3901875896 wait complete. 2024-09-18T13:00:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.938+0000 7f7c11d3c640 1 -- 172.21.15.45:0/3724741655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c0c103470 msgr2=0x7f7c0c10b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.938+0000 7f7c11d3c640 1 --2- 172.21.15.45:0/3724741655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c0c103470 0x7f7c0c10b960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009c20 tx=0x7f7c0002aa00 comp rx=0 tx=0).stop 2024-09-18T13:00:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.938+0000 7f7c11d3c640 1 -- 172.21.15.45:0/3724741655 shutdown_connections 2024-09-18T13:00:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.938+0000 7f7c11d3c640 1 --2- 172.21.15.45:0/3724741655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c0c103470 0x7f7c0c10b960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.938+0000 7f7c11d3c640 1 --2- 172.21.15.45:0/3724741655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c0c102b50 0x7f7c0c102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.938+0000 7f7c11d3c640 1 -- 172.21.15.45:0/3724741655 >> 172.21.15.45:0/3724741655 conn(0x7f7c0c0fc550 msgr2=0x7f7c0c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:56.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.938+0000 7f7c11d3c640 1 -- 172.21.15.45:0/3724741655 shutdown_connections 2024-09-18T13:00:56.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.938+0000 7f7c11d3c640 1 -- 172.21.15.45:0/3724741655 wait complete. 2024-09-18T13:00:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.938+0000 7f7c11d3c640 1 Processor -- start 2024-09-18T13:00:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c11d3c640 1 -- start start 2024-09-18T13:00:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c11d3c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c0c102b50 0x7f7c0c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c11d3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c0c103470 0x7f7c0c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c11d3c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c10ede0 con 0x7f7c0c103470 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c11d3c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c10ec60 con 0x7f7c0c102b50 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c0affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c0c103470 0x7f7c0c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c0affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c0c103470 0x7f7c0c19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40336/0 (socket says 172.21.15.45:40336) 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c0affd640 1 -- 172.21.15.45:0/2164400996 learned_addr learned my addr 172.21.15.45:0/2164400996 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c0b7fe640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c0c102b50 0x7f7c0c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c0affd640 1 -- 172.21.15.45:0/2164400996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c0c102b50 msgr2=0x7f7c0c19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c0affd640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c0c102b50 0x7f7c0c19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c0affd640 1 -- 172.21.15.45:0/2164400996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c1999c0 con 0x7f7c0c103470 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.939+0000 7f7c0affd640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c0c103470 0x7f7c0c19fd40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7c0002af20 tx=0x7f7c0002ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.940+0000 7f7c08ff9640 1 -- 172.21.15.45:0/2164400996 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c00047070 con 0x7f7c0c103470 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.940+0000 7f7c08ff9640 1 -- 172.21.15.45:0/2164400996 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c00003e30 con 0x7f7c0c103470 2024-09-18T13:00:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.940+0000 7f7c11d3c640 1 -- 172.21.15.45:0/2164400996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c199c50 con 0x7f7c0c103470 2024-09-18T13:00:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.940+0000 7f7c08ff9640 1 -- 172.21.15.45:0/2164400996 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c00033050 con 0x7f7c0c103470 2024-09-18T13:00:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.940+0000 7f7c11d3c640 1 -- 172.21.15.45:0/2164400996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0c19a180 con 0x7f7c0c103470 2024-09-18T13:00:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.941+0000 7f7c11d3c640 1 -- 172.21.15.45:0/2164400996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0c06a4e0 con 0x7f7c0c103470 2024-09-18T13:00:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.941+0000 7f7c08ff9640 1 -- 172.21.15.45:0/2164400996 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f7c0004a070 con 0x7f7c0c103470 2024-09-18T13:00:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.942+0000 7f7c08ff9640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7bf407af30 0x7f7bf407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:00:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.942+0000 7f7c08ff9640 1 -- 172.21.15.45:0/2164400996 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f7c0003e030 con 0x7f7c0c103470 2024-09-18T13:00:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.942+0000 7f7c0b7fe640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7bf407af30 0x7f7bf407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:00:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.942+0000 7f7c0b7fe640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7bf407af30 0x7f7bf407d3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c19ab00 tx=0x7f7bfc00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:00:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:56.946+0000 7f7c08ff9640 1 -- 172.21.15.45:0/2164400996 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7c0008a740 con 0x7f7c0c103470 2024-09-18T13:00:57.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.202+0000 7f7c11d3c640 1 -- 172.21.15.45:0/2164400996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7c0c19aef0 con 0x7f7c0c103470 2024-09-18T13:00:57.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.202+0000 7f7c08ff9640 1 -- 172.21.15.45:0/2164400996 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f7c0008f5f0 con 0x7f7c0c103470 2024-09-18T13:00:57.204 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:57.204 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:00:57.204 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:00:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 -- 172.21.15.45:0/2164400996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7bf407af30 msgr2=0x7f7bf407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7bf407af30 0x7f7bf407d3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c19ab00 tx=0x7f7bfc00b390 comp rx=0 tx=0).stop 2024-09-18T13:00:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 -- 172.21.15.45:0/2164400996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c0c103470 msgr2=0x7f7c0c19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:00:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c0c103470 0x7f7c0c19fd40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7c0002af20 tx=0x7f7c0002ee50 comp rx=0 tx=0).stop 2024-09-18T13:00:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 -- 172.21.15.45:0/2164400996 shutdown_connections 2024-09-18T13:00:57.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7bf407af30 0x7f7bf407d3f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:57.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c0c103470 0x7f7c0c19fd40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:57.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 --2- 172.21.15.45:0/2164400996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c0c102b50 0x7f7c0c19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:00:57.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 -- 172.21.15.45:0/2164400996 >> 172.21.15.45:0/2164400996 conn(0x7f7c0c0fc550 msgr2=0x7f7c0c100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:00:57.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 -- 172.21.15.45:0/2164400996 shutdown_connections 2024-09-18T13:00:57.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:00:57.205+0000 7f7c11d3c640 1 -- 172.21.15.45:0/2164400996 wait complete. 2024-09-18T13:00:57.469 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:57 smithi045 ceph-mon[109129]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:57.470 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:57 smithi045 ceph-mon[109129]: pgmap v279: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:57.470 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:57 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/447202140' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:57.470 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:57 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2164400996' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:57 smithi161 ceph-mon[80292]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:57 smithi161 ceph-mon[80292]: pgmap v279: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:57 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/447202140' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:00:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:57 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2164400996' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:00:58.696 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:58 smithi161 ceph-mon[80292]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:58.696 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:58 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:58.696 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:58 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:58.696 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:58 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:58.696 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:58 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:58.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:58 smithi045 ceph-mon[109129]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:00:58.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:58 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:58.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:58 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:58.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:58 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:58.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:58 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:00:59.770 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:00:59 smithi161 ceph-mon[80292]: pgmap v280: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:00:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:00:59 smithi045 ceph-mon[109129]: pgmap v280: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:01.732 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: pgmap v281: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:01.733 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:01.733 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:01.733 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:01.733 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:01.733 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:01.733 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:01.733 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:01.733 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:01.733 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:01.733 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:01 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: pgmap v281: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:01.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:01 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:03 smithi045 ceph-mon[109129]: pgmap v282: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:03 smithi045 ceph-mon[109129]: Upgrade: Updating mds.cephfs.smithi161.maxdew 2024-09-18T13:01:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:03 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:03 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.maxdew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T13:01:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:03 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:03 smithi045 ceph-mon[109129]: Deploying daemon mds.cephfs.smithi161.maxdew on smithi161 2024-09-18T13:01:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:03 smithi161 ceph-mon[80292]: pgmap v282: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:03 smithi161 ceph-mon[80292]: Upgrade: Updating mds.cephfs.smithi161.maxdew 2024-09-18T13:01:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:03 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:03 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.maxdew", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-18T13:01:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:03 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:03 smithi161 ceph-mon[80292]: Deploying daemon mds.cephfs.smithi161.maxdew on smithi161 2024-09-18T13:01:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:04 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045[109124]: 2024-09-18T13:01:04.451+0000 7f3891e6d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T13:01:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:04 smithi045 ceph-mon[109129]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T13:01:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:04 smithi045 ceph-mon[109129]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T13:01:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:04 smithi045 ceph-mon[109129]: osdmap e81: 6 total, 6 up, 6 in 2024-09-18T13:01:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:04 smithi045 ceph-mon[109129]: Standby daemon mds.cephfs.smithi045.gzqgyu assigned to filesystem cephfs as rank 0 2024-09-18T13:01:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:04 smithi045 ceph-mon[109129]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T13:01:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:04 smithi045 ceph-mon[109129]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T13:01:04.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:04 smithi045 ceph-mon[109129]: fsmap cephfs:1/1 {0=cephfs.smithi045.gzqgyu=up:replay} 2 up:standby 2024-09-18T13:01:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:04 smithi161 ceph-mon[80292]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T13:01:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:04 smithi161 ceph-mon[80292]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T13:01:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:04 smithi161 ceph-mon[80292]: osdmap e81: 6 total, 6 up, 6 in 2024-09-18T13:01:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:04 smithi161 ceph-mon[80292]: Standby daemon mds.cephfs.smithi045.gzqgyu assigned to filesystem cephfs as rank 0 2024-09-18T13:01:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:04 smithi161 ceph-mon[80292]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T13:01:04.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:04 smithi161 ceph-mon[80292]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T13:01:04.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:04 smithi161 ceph-mon[80292]: fsmap cephfs:1/1 {0=cephfs.smithi045.gzqgyu=up:replay} 2 up:standby 2024-09-18T13:01:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:05 smithi045 ceph-mon[109129]: pgmap v283: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:05 smithi161 ceph-mon[80292]: pgmap v283: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail 2024-09-18T13:01:08.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:07 smithi045 ceph-mon[109129]: pgmap v285: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-09-18T13:01:08.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:07 smithi161 ceph-mon[80292]: pgmap v285: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-09-18T13:01:09.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:09.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:09 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:09.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:09 smithi161 ceph-mon[80292]: pgmap v286: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 2 op/s 2024-09-18T13:01:09.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:09.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:09 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:09.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:09 smithi045 ceph-mon[109129]: pgmap v286: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 2 op/s 2024-09-18T13:01:10.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:10 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:10.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:10 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:10.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:10 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:10.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:10 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.161:6826/781506559,v1:172.21.15.161:6827/781506559] up:boot 2024-09-18T13:01:10.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:10 smithi045 ceph-mon[109129]: fsmap cephfs:1/1 {0=cephfs.smithi045.gzqgyu=up:replay} 3 up:standby 2024-09-18T13:01:10.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:10 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi161.maxdew"} : dispatch 2024-09-18T13:01:10.686 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:10 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:10.686 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:10 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:10.686 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:10 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:10.686 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:10 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.161:6826/781506559,v1:172.21.15.161:6827/781506559] up:boot 2024-09-18T13:01:10.687 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:10 smithi161 ceph-mon[80292]: fsmap cephfs:1/1 {0=cephfs.smithi045.gzqgyu=up:replay} 3 up:standby 2024-09-18T13:01:10.687 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:10 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi161.maxdew"} : dispatch 2024-09-18T13:01:11.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:11 smithi161 ceph-mon[80292]: pgmap v287: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-18T13:01:11.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:11 smithi045 ceph-mon[109129]: pgmap v287: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-18T13:01:13.245 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:12 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:13.245 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:12 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:13.245 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:12 smithi161 ceph-mon[80292]: pgmap v288: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-18T13:01:13.245 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:12 smithi161 ceph-mon[80292]: reconnect by client.14612 192.168.0.1:0/2420928100 after 0.000999983 2024-09-18T13:01:13.245 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:12 smithi161 ceph-mon[80292]: reconnect by client.24347 192.168.0.1:0/3439559536 after 0.00199997 2024-09-18T13:01:13.245 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:12 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] up:reconnect 2024-09-18T13:01:13.246 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:12 smithi161 ceph-mon[80292]: fsmap cephfs:1/1 {0=cephfs.smithi045.gzqgyu=up:reconnect} 3 up:standby 2024-09-18T13:01:13.246 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:12 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:13.246 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:12 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:13.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:12 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:13.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:12 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:13.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:12 smithi045 ceph-mon[109129]: pgmap v288: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-18T13:01:13.284 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:12 smithi045 ceph-mon[109129]: reconnect by client.14612 192.168.0.1:0/2420928100 after 0.000999983 2024-09-18T13:01:13.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:12 smithi045 ceph-mon[109129]: reconnect by client.24347 192.168.0.1:0/3439559536 after 0.00199997 2024-09-18T13:01:13.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:12 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] up:reconnect 2024-09-18T13:01:13.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:12 smithi045 ceph-mon[109129]: fsmap cephfs:1/1 {0=cephfs.smithi045.gzqgyu=up:reconnect} 3 up:standby 2024-09-18T13:01:13.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:12 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:13.285 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:12 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:14.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:14 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] up:rejoin 2024-09-18T13:01:14.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:14 smithi161 ceph-mon[80292]: fsmap cephfs:1/1 {0=cephfs.smithi045.gzqgyu=up:rejoin} 3 up:standby 2024-09-18T13:01:14.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:14 smithi161 ceph-mon[80292]: daemon mds.cephfs.smithi045.gzqgyu is now active in filesystem cephfs as rank 0 2024-09-18T13:01:14.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:14 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] up:rejoin 2024-09-18T13:01:14.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:14 smithi045 ceph-mon[109129]: fsmap cephfs:1/1 {0=cephfs.smithi045.gzqgyu=up:rejoin} 3 up:standby 2024-09-18T13:01:14.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:14 smithi045 ceph-mon[109129]: daemon mds.cephfs.smithi045.gzqgyu is now active in filesystem cephfs as rank 0 2024-09-18T13:01:15.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:15 smithi161 ceph-mon[80292]: pgmap v289: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-18T13:01:15.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:15 smithi161 ceph-mon[80292]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T13:01:15.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:15 smithi161 ceph-mon[80292]: mds.? [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] up:active 2024-09-18T13:01:15.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:15 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 3 up:standby 2024-09-18T13:01:15.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:15 smithi045 ceph-mon[109129]: pgmap v289: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-18T13:01:15.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:15 smithi045 ceph-mon[109129]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T13:01:15.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:15 smithi045 ceph-mon[109129]: mds.? [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] up:active 2024-09-18T13:01:15.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:15 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 3 up:standby 2024-09-18T13:01:16.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:16.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:16.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi045.favmzs"} : dispatch 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi045.favmzs"}]': finished 2024-09-18T13:01:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi045.gzqgyu"} : dispatch 2024-09-18T13:01:16.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi045.gzqgyu"}]': finished 2024-09-18T13:01:16.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.maxdew"} : dispatch 2024-09-18T13:01:16.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.maxdew"}]': finished 2024-09-18T13:01:16.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.xoxpyp"} : dispatch 2024-09-18T13:01:16.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.xoxpyp"}]': finished 2024-09-18T13:01:16.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:16 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-18T13:01:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:17.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi045.favmzs"} : dispatch 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi045.favmzs"}]': finished 2024-09-18T13:01:17.035 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi045.gzqgyu"} : dispatch 2024-09-18T13:01:17.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi045.gzqgyu"}]': finished 2024-09-18T13:01:17.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.maxdew"} : dispatch 2024-09-18T13:01:17.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.maxdew"}]': finished 2024-09-18T13:01:17.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.xoxpyp"} : dispatch 2024-09-18T13:01:17.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.xoxpyp"}]': finished 2024-09-18T13:01:17.036 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:16 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-18T13:01:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:17 smithi045 ceph-mon[109129]: Upgrade: Setting container_image for all mds 2024-09-18T13:01:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:17 smithi045 ceph-mon[109129]: Upgrade: Setting filesystem cephfs Joinable 2024-09-18T13:01:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:17 smithi045 ceph-mon[109129]: pgmap v290: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 173 B/s wr, 7 op/s 2024-09-18T13:01:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:17 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-18T13:01:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:17 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 3 up:standby 2024-09-18T13:01:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:17 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-18T13:01:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:17 smithi161 ceph-mon[80292]: Upgrade: Setting container_image for all mds 2024-09-18T13:01:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:17 smithi161 ceph-mon[80292]: Upgrade: Setting filesystem cephfs Joinable 2024-09-18T13:01:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:17 smithi161 ceph-mon[80292]: pgmap v290: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 173 B/s wr, 7 op/s 2024-09-18T13:01:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:17 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-18T13:01:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:17 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 3 up:standby 2024-09-18T13:01:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:17 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-18T13:01:18.729 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:18 smithi045 ceph-mon[109129]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-18T13:01:18.729 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:18 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-18T13:01:18.729 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:18 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 3 up:standby 2024-09-18T13:01:18.730 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:18 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T13:01:18.730 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:18 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:18.730 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:18 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:18.730 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:18 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:18.730 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:18 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:18.730 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:18 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:18.730 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:18 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:18 smithi161 ceph-mon[80292]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-18T13:01:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:18 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-18T13:01:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:18 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 3 up:standby 2024-09-18T13:01:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:18 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T13:01:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:18 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:19.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:18 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:18 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:19.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:18 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:19.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:18 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:19.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:18 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:20.009 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:19 smithi045 ceph-mon[109129]: Upgrade: Setting container_image for all rgw 2024-09-18T13:01:20.009 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:19 smithi045 ceph-mon[109129]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T13:01:20.010 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:19 smithi045 ceph-mon[109129]: pgmap v291: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T13:01:20.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:19 smithi161 ceph-mon[80292]: Upgrade: Setting container_image for all rgw 2024-09-18T13:01:20.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:19 smithi161 ceph-mon[80292]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T13:01:20.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:19 smithi161 ceph-mon[80292]: pgmap v291: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T13:01:21.451 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:21 smithi161 ceph-mon[80292]: Upgrade: Updating ceph-exporter.smithi045 (1/2) 2024-09-18T13:01:21.452 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:21 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:21.452 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:21 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi045", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T13:01:21.452 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:21 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:21.452 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:21 smithi161 ceph-mon[80292]: Deploying daemon ceph-exporter.smithi045 on smithi045 2024-09-18T13:01:21.452 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:21 smithi161 ceph-mon[80292]: pgmap v292: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-18T13:01:21.477 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:21 smithi045 ceph-mon[109129]: Upgrade: Updating ceph-exporter.smithi045 (1/2) 2024-09-18T13:01:21.478 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:21 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:21.478 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:21 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi045", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T13:01:21.478 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:21 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:21.478 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:21 smithi045 ceph-mon[109129]: Deploying daemon ceph-exporter.smithi045 on smithi045 2024-09-18T13:01:21.478 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:21 smithi045 ceph-mon[109129]: pgmap v292: 65 pgs: 65 active+clean; 244 MiB data, 962 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-18T13:01:23.426 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:23 smithi045 ceph-mon[109129]: pgmap v293: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-18T13:01:23.426 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:23.426 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:23 smithi161 ceph-mon[80292]: pgmap v293: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-18T13:01:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:25.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:24 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:25.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:24 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:25.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:24 smithi045 ceph-mon[109129]: pgmap v294: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-09-18T13:01:25.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:24 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:25.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:24 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:25.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:24 smithi161 ceph-mon[80292]: pgmap v294: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.0 KiB/s wr, 11 op/s 2024-09-18T13:01:26.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:26 smithi045 ceph-mon[109129]: Upgrade: Updating ceph-exporter.smithi161 (2/2) 2024-09-18T13:01:26.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:26.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T13:01:26.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:26 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:26.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:26 smithi045 ceph-mon[109129]: Deploying daemon ceph-exporter.smithi161 on smithi161 2024-09-18T13:01:26.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:26 smithi161 ceph-mon[80292]: Upgrade: Updating ceph-exporter.smithi161 (2/2) 2024-09-18T13:01:26.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:26.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi161", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-18T13:01:26.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:26 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:26.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:26 smithi161 ceph-mon[80292]: Deploying daemon ceph-exporter.smithi161 on smithi161 2024-09-18T13:01:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.299+0000 7f076cfbe640 1 -- 172.21.15.45:0/1304904074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768102b70 msgr2=0x7f0768102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.299+0000 7f076cfbe640 1 --2- 172.21.15.45:0/1304904074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768102b70 0x7f0768102f50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0758009c20 tx=0x7f075802aa00 comp rx=0 tx=0).stop 2024-09-18T13:01:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.299+0000 7f076cfbe640 1 -- 172.21.15.45:0/1304904074 shutdown_connections 2024-09-18T13:01:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.299+0000 7f076cfbe640 1 --2- 172.21.15.45:0/1304904074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768103490 0x7f076810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.299+0000 7f076cfbe640 1 --2- 172.21.15.45:0/1304904074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768102b70 0x7f0768102f50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.299+0000 7f076cfbe640 1 -- 172.21.15.45:0/1304904074 >> 172.21.15.45:0/1304904074 conn(0x7f07680fc550 msgr2=0x7f07680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.299+0000 7f076cfbe640 1 -- 172.21.15.45:0/1304904074 shutdown_connections 2024-09-18T13:01:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.299+0000 7f076cfbe640 1 -- 172.21.15.45:0/1304904074 wait complete. 2024-09-18T13:01:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.300+0000 7f076cfbe640 1 Processor -- start 2024-09-18T13:01:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.300+0000 7f076cfbe640 1 -- start start 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.300+0000 7f076cfbe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768102b70 0x7f076819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.300+0000 7f076cfbe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768103490 0x7f076819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.300+0000 7f076cfbe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f076810ede0 con 0x7f0768103490 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.300+0000 7f076cfbe640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f076810ec60 con 0x7f0768102b70 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f0765d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768103490 0x7f076819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f076659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768102b70 0x7f076819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f0765d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768103490 0x7f076819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44422/0 (socket says 172.21.15.45:44422) 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f0765d9b640 1 -- 172.21.15.45:0/3773495639 learned_addr learned my addr 172.21.15.45:0/3773495639 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f076659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768102b70 0x7f076819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:47678/0 (socket says 172.21.15.45:47678) 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f0765d9b640 1 -- 172.21.15.45:0/3773495639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768102b70 msgr2=0x7f076819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f0765d9b640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768102b70 0x7f076819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f0765d9b640 1 -- 172.21.15.45:0/3773495639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07681977b0 con 0x7f0768103490 2024-09-18T13:01:27.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f076659c640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768102b70 0x7f076819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T13:01:27.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f0765d9b640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768103490 0x7f076819db70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f075c00e970 tx=0x7f075c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:27.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f07577fe640 1 -- 172.21.15.45:0/3773495639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f075c00cac0 con 0x7f0768103490 2024-09-18T13:01:27.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f076cfbe640 1 -- 172.21.15.45:0/3773495639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0768197aa0 con 0x7f0768103490 2024-09-18T13:01:27.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f07577fe640 1 -- 172.21.15.45:0/3773495639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f075c0054e0 con 0x7f0768103490 2024-09-18T13:01:27.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.301+0000 7f07577fe640 1 -- 172.21.15.45:0/3773495639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f075c010430 con 0x7f0768103490 2024-09-18T13:01:27.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.302+0000 7f076cfbe640 1 -- 172.21.15.45:0/3773495639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0768198030 con 0x7f0768103490 2024-09-18T13:01:27.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.302+0000 7f076cfbe640 1 -- 172.21.15.45:0/3773495639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076806a4c0 con 0x7f0768103490 2024-09-18T13:01:27.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.303+0000 7f07577fe640 1 -- 172.21.15.45:0/3773495639 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f075c004e80 con 0x7f0768103490 2024-09-18T13:01:27.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.304+0000 7f07577fe640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f075007af30 0x7f075007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:27.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.304+0000 7f07577fe640 1 -- 172.21.15.45:0/3773495639 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f075c09e690 con 0x7f0768103490 2024-09-18T13:01:27.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.304+0000 7f076659c640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f075007af30 0x7f075007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:27.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.304+0000 7f076659c640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f075007af30 0x7f075007d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0758000f80 tx=0x7f075803a040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:27.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.308+0000 7f07577fe640 1 -- 172.21.15.45:0/3773495639 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f075c069c30 con 0x7f0768103490 2024-09-18T13:01:27.309 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:27 smithi045 ceph-mon[109129]: pgmap v295: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 4.0 KiB/s wr, 10 op/s 2024-09-18T13:01:27.397 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:27 smithi161 ceph-mon[80292]: pgmap v295: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 4.0 KiB/s wr, 10 op/s 2024-09-18T13:01:27.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.514+0000 7f076cfbe640 1 -- 172.21.15.45:0/3773495639 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0768198340 con 0x7f075007af30 2024-09-18T13:01:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.516+0000 7f07577fe640 1 -- 172.21.15.45:0/3773495639 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f0768198340 con 0x7f075007af30 2024-09-18T13:01:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 -- 172.21.15.45:0/3773495639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f075007af30 msgr2=0x7f075007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f075007af30 0x7f075007d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0758000f80 tx=0x7f075803a040 comp rx=0 tx=0).stop 2024-09-18T13:01:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 -- 172.21.15.45:0/3773495639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768103490 msgr2=0x7f076819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768103490 0x7f076819db70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f075c00e970 tx=0x7f075c00ed70 comp rx=0 tx=0).stop 2024-09-18T13:01:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 -- 172.21.15.45:0/3773495639 shutdown_connections 2024-09-18T13:01:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f075007af30 0x7f075007d3f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0768103490 0x7f076819db70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 --2- 172.21.15.45:0/3773495639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0768102b70 0x7f076819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 -- 172.21.15.45:0/3773495639 >> 172.21.15.45:0/3773495639 conn(0x7f07680fc550 msgr2=0x7f0768108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 -- 172.21.15.45:0/3773495639 shutdown_connections 2024-09-18T13:01:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.518+0000 7f076cfbe640 1 -- 172.21.15.45:0/3773495639 wait complete. 2024-09-18T13:01:27.528 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.603+0000 7f4810f52640 1 -- 172.21.15.45:0/1306060852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480c106800 msgr2=0x7f480c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.603+0000 7f4810f52640 1 --2- 172.21.15.45:0/1306060852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480c106800 0x7f480c106be0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009880 tx=0x7f47fc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.603+0000 7f4810f52640 1 -- 172.21.15.45:0/1306060852 shutdown_connections 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.603+0000 7f4810f52640 1 --2- 172.21.15.45:0/1306060852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f480c100800 0x7f480c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.603+0000 7f4810f52640 1 --2- 172.21.15.45:0/1306060852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480c106800 0x7f480c106be0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.603+0000 7f4810f52640 1 -- 172.21.15.45:0/1306060852 >> 172.21.15.45:0/1306060852 conn(0x7f480c0fc520 msgr2=0x7f480c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.603+0000 7f4810f52640 1 -- 172.21.15.45:0/1306060852 shutdown_connections 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.603+0000 7f4810f52640 1 -- 172.21.15.45:0/1306060852 wait complete. 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.604+0000 7f4810f52640 1 Processor -- start 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.604+0000 7f4810f52640 1 -- start start 2024-09-18T13:01:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.604+0000 7f4810f52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480c100800 0x7f480c0fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.604+0000 7f4810f52640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f480c106800 0x7f480c0fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.604+0000 7f4810f52640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f480c10dd30 con 0x7f480c100800 2024-09-18T13:01:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.604+0000 7f4810f52640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f480c10dbb0 con 0x7f480c106800 2024-09-18T13:01:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f480a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480c100800 0x7f480c0fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f480a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480c100800 0x7f480c0fcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44438/0 (socket says 172.21.15.45:44438) 2024-09-18T13:01:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f480a59c640 1 -- 172.21.15.45:0/651342744 learned_addr learned my addr 172.21.15.45:0/651342744 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:01:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f4809d9b640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f480c106800 0x7f480c0fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f480a59c640 1 -- 172.21.15.45:0/651342744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f480c106800 msgr2=0x7f480c0fd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f480a59c640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f480c106800 0x7f480c0fd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f480a59c640 1 -- 172.21.15.45:0/651342744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480c0fd6d0 con 0x7f480c100800 2024-09-18T13:01:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f480a59c640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480c100800 0x7f480c0fcc50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47fc031460 tx=0x7f47fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f47fb7fe640 1 -- 172.21.15.45:0/651342744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47fc03f070 con 0x7f480c100800 2024-09-18T13:01:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f47fb7fe640 1 -- 172.21.15.45:0/651342744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47fc004cf0 con 0x7f480c100800 2024-09-18T13:01:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f4810f52640 1 -- 172.21.15.45:0/651342744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f480c0fd960 con 0x7f480c100800 2024-09-18T13:01:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f47fb7fe640 1 -- 172.21.15.45:0/651342744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47fc035030 con 0x7f480c100800 2024-09-18T13:01:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.605+0000 7f4810f52640 1 -- 172.21.15.45:0/651342744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f480c1a3de0 con 0x7f480c100800 2024-09-18T13:01:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.606+0000 7f4810f52640 1 -- 172.21.15.45:0/651342744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f480c101f40 con 0x7f480c100800 2024-09-18T13:01:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.607+0000 7f47fb7fe640 1 -- 172.21.15.45:0/651342744 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f47fc042070 con 0x7f480c100800 2024-09-18T13:01:27.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.608+0000 7f47fb7fe640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f47f407af80 0x7f47f407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:27.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.608+0000 7f47fb7fe640 1 -- 172.21.15.45:0/651342744 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f47fc0bea00 con 0x7f480c100800 2024-09-18T13:01:27.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.608+0000 7f4809d9b640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f47f407af80 0x7f47f407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:27.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.608+0000 7f4809d9b640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f47f407af80 0x7f47f407d440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f480c0fe6e0 tx=0x7f4800009110 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.612+0000 7f47fb7fe640 1 -- 172.21.15.45:0/651342744 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f47fc08a020 con 0x7f480c100800 2024-09-18T13:01:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.814+0000 7f4810f52640 1 -- 172.21.15.45:0/651342744 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f480c062630 con 0x7f47f407af80 2024-09-18T13:01:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.815+0000 7f47fb7fe640 1 -- 172.21.15.45:0/651342744 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f480c062630 con 0x7f47f407af80 2024-09-18T13:01:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.817+0000 7f4810f52640 1 -- 172.21.15.45:0/651342744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f47f407af80 msgr2=0x7f47f407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.817+0000 7f4810f52640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f47f407af80 0x7f47f407d440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f480c0fe6e0 tx=0x7f4800009110 comp rx=0 tx=0).stop 2024-09-18T13:01:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.817+0000 7f4810f52640 1 -- 172.21.15.45:0/651342744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480c100800 msgr2=0x7f480c0fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.817+0000 7f4810f52640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480c100800 0x7f480c0fcc50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47fc031460 tx=0x7f47fc0048f0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.817+0000 7f4810f52640 1 -- 172.21.15.45:0/651342744 shutdown_connections 2024-09-18T13:01:27.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.817+0000 7f4810f52640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f47f407af80 0x7f47f407d440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.817+0000 7f4810f52640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f480c106800 0x7f480c0fd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.817+0000 7f4810f52640 1 --2- 172.21.15.45:0/651342744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480c100800 0x7f480c0fcc50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.817+0000 7f4810f52640 1 -- 172.21.15.45:0/651342744 >> 172.21.15.45:0/651342744 conn(0x7f480c0fc520 msgr2=0x7f480c06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:27.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.818+0000 7f4810f52640 1 -- 172.21.15.45:0/651342744 shutdown_connections 2024-09-18T13:01:27.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.818+0000 7f4810f52640 1 -- 172.21.15.45:0/651342744 wait complete. 2024-09-18T13:01:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.902+0000 7f13dae7c640 1 -- 172.21.15.45:0/3421516577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13d4101900 msgr2=0x7f13d4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.902+0000 7f13dae7c640 1 --2- 172.21.15.45:0/3421516577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13d4101900 0x7f13d4101d60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009880 tx=0x7f13c402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.902+0000 7f13dae7c640 1 -- 172.21.15.45:0/3421516577 shutdown_connections 2024-09-18T13:01:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.902+0000 7f13dae7c640 1 --2- 172.21.15.45:0/3421516577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13d4101900 0x7f13d4101d60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.902+0000 7f13dae7c640 1 --2- 172.21.15.45:0/3421516577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13d4107900 0x7f13d4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.902+0000 7f13dae7c640 1 -- 172.21.15.45:0/3421516577 >> 172.21.15.45:0/3421516577 conn(0x7f13d40fd600 msgr2=0x7f13d40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.902+0000 7f13dae7c640 1 -- 172.21.15.45:0/3421516577 shutdown_connections 2024-09-18T13:01:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.902+0000 7f13dae7c640 1 -- 172.21.15.45:0/3421516577 wait complete. 2024-09-18T13:01:27.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.903+0000 7f13dae7c640 1 Processor -- start 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.903+0000 7f13dae7c640 1 -- start start 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.903+0000 7f13dae7c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13d4101900 0x7f13d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.903+0000 7f13dae7c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13d4107900 0x7f13d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.903+0000 7f13dae7c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f13d410edd0 con 0x7f13d4107900 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.903+0000 7f13dae7c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f13d410ec50 con 0x7f13d4101900 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.903+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13d4107900 0x7f13d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.903+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13d4107900 0x7f13d4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44450/0 (socket says 172.21.15.45:44450) 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.903+0000 7f13cbfff640 1 -- 172.21.15.45:0/1153866432 learned_addr learned my addr 172.21.15.45:0/1153866432 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.903+0000 7f13d8c18640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13d4101900 0x7f13d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.904+0000 7f13cbfff640 1 -- 172.21.15.45:0/1153866432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13d4101900 msgr2=0x7f13d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.904+0000 7f13cbfff640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13d4101900 0x7f13d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.904+0000 7f13cbfff640 1 -- 172.21.15.45:0/1153866432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d4074f70 con 0x7f13d4107900 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.904+0000 7f13cbfff640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13d4107900 0x7f13d4074a30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f13c4031460 tx=0x7f13c4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:27.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.904+0000 7f13c9ffb640 1 -- 172.21.15.45:0/1153866432 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13c403f070 con 0x7f13d4107900 2024-09-18T13:01:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.904+0000 7f13c9ffb640 1 -- 172.21.15.45:0/1153866432 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13c40035f0 con 0x7f13d4107900 2024-09-18T13:01:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.904+0000 7f13dae7c640 1 -- 172.21.15.45:0/1153866432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d4075200 con 0x7f13d4107900 2024-09-18T13:01:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.904+0000 7f13c9ffb640 1 -- 172.21.15.45:0/1153866432 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13c4035030 con 0x7f13d4107900 2024-09-18T13:01:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.904+0000 7f13dae7c640 1 -- 172.21.15.45:0/1153866432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d41a3dc0 con 0x7f13d4107900 2024-09-18T13:01:27.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.905+0000 7f13dae7c640 1 -- 172.21.15.45:0/1153866432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d4103040 con 0x7f13d4107900 2024-09-18T13:01:27.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.906+0000 7f13c9ffb640 1 -- 172.21.15.45:0/1153866432 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f13c4042070 con 0x7f13d4107900 2024-09-18T13:01:27.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.906+0000 7f13c9ffb640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f13bc07af30 0x7f13bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:27.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.907+0000 7f13c9ffb640 1 -- 172.21.15.45:0/1153866432 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f13c40be960 con 0x7f13d4107900 2024-09-18T13:01:27.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.907+0000 7f13d8c18640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f13bc07af30 0x7f13bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:27.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.907+0000 7f13d8c18640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f13bc07af30 0x7f13bc07d3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009bd0 tx=0x7f13d0005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:27.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:27.911+0000 7f13c9ffb640 1 -- 172.21.15.45:0/1153866432 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f13c4089f00 con 0x7f13d4107900 2024-09-18T13:01:28.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.104+0000 7f13dae7c640 1 -- 172.21.15.45:0/1153866432 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f13d4062630 con 0x7f13bc07af30 2024-09-18T13:01:28.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.113+0000 7f13c9ffb640 1 -- 172.21.15.45:0/1153866432 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f13d4062630 con 0x7f13bc07af30 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (6m) 45s ago 17m 20.1M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 starting - - - - 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (9m) 16s ago 16m 8958k - 19.1.1-330-gc2ddf972 ebb0615149de 00647a181ba0 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (4m) 45s ago 17m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (4m) 16s ago 16m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (6m) 45s ago 17m 77.6M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (50s) 45s ago 12m 11.6M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9bf29d5aa6b6 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (66s) 45s ago 12m 16.0M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e7c39085fb8d 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (19s) 16s ago 12m 11.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c446bf8facb6 2024-09-18T13:01:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (33s) 16s ago 12m 16.1M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f511abca950f 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (8m) 45s ago 18m 527M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (7m) 16s ago 16m 459M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (5m) 45s ago 18m 49.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (5m) 16s ago 16m 41.2M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (7m) 45s ago 17m 11.8M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (7m) 16s ago 16m 11.5M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (4m) 45s ago 15m 92.5M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (3m) 45s ago 14m 100M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 7d4cd0351725 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (3m) 45s ago 14m 87.0M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4f620cf3977f 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (2m) 16s ago 14m 109M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1fbe6c224b87 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (2m) 16s ago 13m 91.2M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b3c49339a90c 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (87s) 16s ago 13m 86.5M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 035aa0efadd6 2024-09-18T13:01:28.116 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (6m) 45s ago 17m 54.2M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T13:01:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.115+0000 7f13dae7c640 1 -- 172.21.15.45:0/1153866432 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f13bc07af30 msgr2=0x7f13bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.115+0000 7f13dae7c640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f13bc07af30 0x7f13bc07d3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009bd0 tx=0x7f13d0005f90 comp rx=0 tx=0).stop 2024-09-18T13:01:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.115+0000 7f13dae7c640 1 -- 172.21.15.45:0/1153866432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13d4107900 msgr2=0x7f13d4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.115+0000 7f13dae7c640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13d4107900 0x7f13d4074a30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f13c4031460 tx=0x7f13c4004530 comp rx=0 tx=0).stop 2024-09-18T13:01:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.116+0000 7f13dae7c640 1 -- 172.21.15.45:0/1153866432 shutdown_connections 2024-09-18T13:01:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.116+0000 7f13dae7c640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f13bc07af30 0x7f13bc07d3f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.116+0000 7f13dae7c640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13d4107900 0x7f13d4074a30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.116+0000 7f13dae7c640 1 --2- 172.21.15.45:0/1153866432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13d4101900 0x7f13d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.116+0000 7f13dae7c640 1 -- 172.21.15.45:0/1153866432 >> 172.21.15.45:0/1153866432 conn(0x7f13d40fd600 msgr2=0x7f13d40fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.116+0000 7f13dae7c640 1 -- 172.21.15.45:0/1153866432 shutdown_connections 2024-09-18T13:01:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.116+0000 7f13dae7c640 1 -- 172.21.15.45:0/1153866432 wait complete. 2024-09-18T13:01:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.198+0000 7f54fdb13640 1 -- 172.21.15.45:0/1486931040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f8107900 msgr2=0x7f54f8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.198+0000 7f54fdb13640 1 --2- 172.21.15.45:0/1486931040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f8107900 0x7f54f8107ce0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009880 tx=0x7f54e802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.198+0000 7f54fdb13640 1 -- 172.21.15.45:0/1486931040 shutdown_connections 2024-09-18T13:01:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.198+0000 7f54fdb13640 1 --2- 172.21.15.45:0/1486931040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54f8101900 0x7f54f8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.198+0000 7f54fdb13640 1 --2- 172.21.15.45:0/1486931040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f8107900 0x7f54f8107ce0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.198+0000 7f54fdb13640 1 -- 172.21.15.45:0/1486931040 >> 172.21.15.45:0/1486931040 conn(0x7f54f80fd600 msgr2=0x7f54f80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.198+0000 7f54fdb13640 1 -- 172.21.15.45:0/1486931040 shutdown_connections 2024-09-18T13:01:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.198+0000 7f54fdb13640 1 -- 172.21.15.45:0/1486931040 wait complete. 2024-09-18T13:01:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.199+0000 7f54fdb13640 1 Processor -- start 2024-09-18T13:01:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.199+0000 7f54fdb13640 1 -- start start 2024-09-18T13:01:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.199+0000 7f54fdb13640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54f8101900 0x7f54f819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.199+0000 7f54fdb13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f8107900 0x7f54f819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.199+0000 7f54fdb13640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54f810ee30 con 0x7f54f8107900 2024-09-18T13:01:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.199+0000 7f54fdb13640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f54f810ecb0 con 0x7f54f8101900 2024-09-18T13:01:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.200+0000 7f54f77fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54f8101900 0x7f54f819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.200+0000 7f54eeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f8107900 0x7f54f819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.200+0000 7f54f77fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54f8101900 0x7f54f819f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:47748/0 (socket says 172.21.15.45:47748) 2024-09-18T13:01:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.200+0000 7f54f77fe640 1 -- 172.21.15.45:0/3125838744 learned_addr learned my addr 172.21.15.45:0/3125838744 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:01:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.200+0000 7f54f77fe640 1 -- 172.21.15.45:0/3125838744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f8107900 msgr2=0x7f54f819fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.200+0000 7f54f77fe640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f8107900 0x7f54f819fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.200+0000 7f54f77fe640 1 -- 172.21.15.45:0/3125838744 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f8199a70 con 0x7f54f8101900 2024-09-18T13:01:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.200+0000 7f54eeffd640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f8107900 0x7f54f819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T13:01:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.200+0000 7f54f77fe640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54f8101900 0x7f54f819f8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54e8031460 tx=0x7f54e80048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.201+0000 7f54f57fa640 1 -- 172.21.15.45:0/3125838744 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54e803f070 con 0x7f54f8101900 2024-09-18T13:01:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.201+0000 7f54f57fa640 1 -- 172.21.15.45:0/3125838744 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f54e8004cf0 con 0x7f54f8101900 2024-09-18T13:01:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.201+0000 7f54fdb13640 1 -- 172.21.15.45:0/3125838744 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f8199d00 con 0x7f54f8101900 2024-09-18T13:01:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.201+0000 7f54f57fa640 1 -- 172.21.15.45:0/3125838744 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54e8035030 con 0x7f54f8101900 2024-09-18T13:01:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.201+0000 7f54fdb13640 1 -- 172.21.15.45:0/3125838744 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f819a230 con 0x7f54f8101900 2024-09-18T13:01:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.202+0000 7f54fdb13640 1 -- 172.21.15.45:0/3125838744 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f8103040 con 0x7f54f8101900 2024-09-18T13:01:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.202+0000 7f54f57fa640 1 -- 172.21.15.45:0/3125838744 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f54e8042070 con 0x7f54f8101900 2024-09-18T13:01:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.203+0000 7f54f57fa640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f54e407af30 0x7f54e407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.203+0000 7f54f57fa640 1 -- 172.21.15.45:0/3125838744 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f54e80beb50 con 0x7f54f8101900 2024-09-18T13:01:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.203+0000 7f54eeffd640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f54e407af30 0x7f54e407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:28.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.204+0000 7f54eeffd640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f54e407af30 0x7f54e407d3f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f54f8075790 tx=0x7f54e0009110 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:28.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.208+0000 7f54f57fa640 1 -- 172.21.15.45:0/3125838744 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f54e808a090 con 0x7f54f8101900 2024-09-18T13:01:28.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:28 smithi161 ceph-mon[80292]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.470+0000 7f54fdb13640 1 -- 172.21.15.45:0/3125838744 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f54f819b070 con 0x7f54f8101900 2024-09-18T13:01:28.472 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:28 smithi045 ceph-mon[109129]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.471+0000 7f54f57fa640 1 -- 172.21.15.45:0/3125838744 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f54e808ef40 con 0x7f54f8101900 2024-09-18T13:01:28.472 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:01:28.473 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T13:01:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:01:28.474 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T13:01:28.474 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T13:01:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.473+0000 7f54fdb13640 1 -- 172.21.15.45:0/3125838744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f54e407af30 msgr2=0x7f54e407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.473+0000 7f54fdb13640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f54e407af30 0x7f54e407d3f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f54f8075790 tx=0x7f54e0009110 comp rx=0 tx=0).stop 2024-09-18T13:01:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.473+0000 7f54fdb13640 1 -- 172.21.15.45:0/3125838744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54f8101900 msgr2=0x7f54f819f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.473+0000 7f54fdb13640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54f8101900 0x7f54f819f8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f54e8031460 tx=0x7f54e80048f0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.473+0000 7f54fdb13640 1 -- 172.21.15.45:0/3125838744 shutdown_connections 2024-09-18T13:01:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.473+0000 7f54fdb13640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f54e407af30 0x7f54e407d3f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.473+0000 7f54fdb13640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f8107900 0x7f54f819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.473+0000 7f54fdb13640 1 --2- 172.21.15.45:0/3125838744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54f8101900 0x7f54f819f8b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.474+0000 7f54fdb13640 1 -- 172.21.15.45:0/3125838744 >> 172.21.15.45:0/3125838744 conn(0x7f54f80fd600 msgr2=0x7f54f8074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.474+0000 7f54fdb13640 1 -- 172.21.15.45:0/3125838744 shutdown_connections 2024-09-18T13:01:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.474+0000 7f54fdb13640 1 -- 172.21.15.45:0/3125838744 wait complete. 2024-09-18T13:01:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.557+0000 7fdff3376640 1 -- 172.21.15.45:0/3547096016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec1033e0 msgr2=0x7fdfec10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.557+0000 7fdff3376640 1 --2- 172.21.15.45:0/3547096016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec1033e0 0x7fdfec10b8d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009880 tx=0x7fdfdc02a530 comp rx=0 tx=0).stop 2024-09-18T13:01:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 -- 172.21.15.45:0/3547096016 shutdown_connections 2024-09-18T13:01:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 --2- 172.21.15.45:0/3547096016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec1033e0 0x7fdfec10b8d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 --2- 172.21.15.45:0/3547096016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec102ac0 0x7fdfec102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 -- 172.21.15.45:0/3547096016 >> 172.21.15.45:0/3547096016 conn(0x7fdfec0fc520 msgr2=0x7fdfec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 -- 172.21.15.45:0/3547096016 shutdown_connections 2024-09-18T13:01:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 -- 172.21.15.45:0/3547096016 wait complete. 2024-09-18T13:01:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 Processor -- start 2024-09-18T13:01:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 -- start start 2024-09-18T13:01:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec102ac0 0x7fdfec100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec1033e0 0x7fdfec100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec10edd0 con 0x7fdfec102ac0 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.558+0000 7fdff3376640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec10ec50 con 0x7fdfec1033e0 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdff1112640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec102ac0 0x7fdfec100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdff1112640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec102ac0 0x7fdfec100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44490/0 (socket says 172.21.15.45:44490) 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdff1112640 1 -- 172.21.15.45:0/1583042238 learned_addr learned my addr 172.21.15.45:0/1583042238 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdff0911640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec1033e0 0x7fdfec100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdff1112640 1 -- 172.21.15.45:0/1583042238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec1033e0 msgr2=0x7fdfec100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdff1112640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec1033e0 0x7fdfec100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdff1112640 1 -- 172.21.15.45:0/1583042238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec1011a0 con 0x7fdfec102ac0 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdff1112640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec102ac0 0x7fdfec100720 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800e970 tx=0x7fdfe800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdfe27fc640 1 -- 172.21.15.45:0/1583042238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdfe800cac0 con 0x7fdfec102ac0 2024-09-18T13:01:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdfe27fc640 1 -- 172.21.15.45:0/1583042238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdfe800cc60 con 0x7fdfec102ac0 2024-09-18T13:01:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdff3376640 1 -- 172.21.15.45:0/1583042238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec101490 con 0x7fdfec102ac0 2024-09-18T13:01:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdfe27fc640 1 -- 172.21.15.45:0/1583042238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdfe8018720 con 0x7fdfec102ac0 2024-09-18T13:01:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.559+0000 7fdff3376640 1 -- 172.21.15.45:0/1583042238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec1a3ec0 con 0x7fdfec102ac0 2024-09-18T13:01:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.560+0000 7fdff3376640 1 -- 172.21.15.45:0/1583042238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfec06aa90 con 0x7fdfec102ac0 2024-09-18T13:01:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.561+0000 7fdfe27fc640 1 -- 172.21.15.45:0/1583042238 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fdfe8010430 con 0x7fdfec102ac0 2024-09-18T13:01:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.562+0000 7fdfe27fc640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdfd807af80 0x7fdfd807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.562+0000 7fdfe27fc640 1 -- 172.21.15.45:0/1583042238 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fdfe809e5b0 con 0x7fdfec102ac0 2024-09-18T13:01:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.562+0000 7fdff0911640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdfd807af80 0x7fdfd807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.562+0000 7fdff0911640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdfd807af80 0x7fdfd807d440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdfec1021b0 tx=0x7fdfdc031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:28.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.566+0000 7fdfe27fc640 1 -- 172.21.15.45:0/1583042238 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fdfe8069bd0 con 0x7fdfec102ac0 2024-09-18T13:01:28.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.790+0000 7fdff3376640 1 -- 172.21.15.45:0/1583042238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fdfec104f50 con 0x7fdfec102ac0 2024-09-18T13:01:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.791+0000 7fdfe27fc640 1 -- 172.21.15.45:0/1583042238 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) ==== 76+0+2044 (secure 0 0 0) 0x7fdfe806ea80 con 0x7fdfec102ac0 2024-09-18T13:01:28.792 INFO:teuthology.orchestra.run.smithi045.stdout:e36 2024-09-18T13:01:28.792 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T13:01:17:700606+0000 2024-09-18T13:01:28.792 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:01:28.792 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:01:28.792 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 36 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T13:01:17.700594+0000 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T13:01:28.793 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 81 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=34318} 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T13:01:28.794 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T13:01:28.795 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 34318 members: 34318 2024-09-18T13:01:28.795 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:34318} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:28.795 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{0:34350} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.45:6828/3858768927,v1:172.21.15.45:6829/3858768927] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:01:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:01:28.795 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T13:01:28.795 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:01:28.795 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1172047502,v1:172.21.15.161:6825/1172047502] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:28.795 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/781506559,v1:172.21.15.161:6827/781506559] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:01:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2024-09-18T13:01:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 -- 172.21.15.45:0/1583042238 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdfd807af80 msgr2=0x7fdfd807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdfd807af80 0x7fdfd807d440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdfec1021b0 tx=0x7fdfdc031400 comp rx=0 tx=0).stop 2024-09-18T13:01:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 -- 172.21.15.45:0/1583042238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec102ac0 msgr2=0x7fdfec100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec102ac0 0x7fdfec100720 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800e970 tx=0x7fdfe800ee30 comp rx=0 tx=0).stop 2024-09-18T13:01:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 -- 172.21.15.45:0/1583042238 shutdown_connections 2024-09-18T13:01:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fdfd807af80 0x7fdfd807d440 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfec1033e0 0x7fdfec100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 --2- 172.21.15.45:0/1583042238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec102ac0 0x7fdfec100720 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 -- 172.21.15.45:0/1583042238 >> 172.21.15.45:0/1583042238 conn(0x7fdfec0fc520 msgr2=0x7fdfec107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:28.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 -- 172.21.15.45:0/1583042238 shutdown_connections 2024-09-18T13:01:28.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.793+0000 7fdff3376640 1 -- 172.21.15.45:0/1583042238 wait complete. 2024-09-18T13:01:28.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.880+0000 7f6f06a11640 1 -- 172.21.15.45:0/2504164357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f00102ab0 msgr2=0x7f6f00102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.880+0000 7f6f06a11640 1 --2- 172.21.15.45:0/2504164357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f00102ab0 0x7f6f00102e90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009880 tx=0x7f6ef002a530 comp rx=0 tx=0).stop 2024-09-18T13:01:28.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.881+0000 7f6f06a11640 1 -- 172.21.15.45:0/2504164357 shutdown_connections 2024-09-18T13:01:28.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.881+0000 7f6f06a11640 1 --2- 172.21.15.45:0/2504164357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f001033d0 0x7f6f0010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.881+0000 7f6f06a11640 1 --2- 172.21.15.45:0/2504164357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f00102ab0 0x7f6f00102e90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.881+0000 7f6f06a11640 1 -- 172.21.15.45:0/2504164357 >> 172.21.15.45:0/2504164357 conn(0x7f6f000fc550 msgr2=0x7f6f000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:28.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.881+0000 7f6f06a11640 1 -- 172.21.15.45:0/2504164357 shutdown_connections 2024-09-18T13:01:28.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.881+0000 7f6f06a11640 1 -- 172.21.15.45:0/2504164357 wait complete. 2024-09-18T13:01:28.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.881+0000 7f6f06a11640 1 Processor -- start 2024-09-18T13:01:28.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.881+0000 7f6f06a11640 1 -- start start 2024-09-18T13:01:28.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6f06a11640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f00102ab0 0x7f6f0019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:28.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6f06a11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f001033d0 0x7f6f0019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6f06a11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0010ede0 con 0x7f6f001033d0 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6f06a11640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0010ec60 con 0x7f6f00102ab0 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6eff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f001033d0 0x7f6f0019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6eff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f001033d0 0x7f6f0019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44504/0 (socket says 172.21.15.45:44504) 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6eff7fe640 1 -- 172.21.15.45:0/3293138793 learned_addr learned my addr 172.21.15.45:0/3293138793 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6efffff640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f00102ab0 0x7f6f0019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6eff7fe640 1 -- 172.21.15.45:0/3293138793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f00102ab0 msgr2=0x7f6f0019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6eff7fe640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f00102ab0 0x7f6f0019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.882+0000 7f6eff7fe640 1 -- 172.21.15.45:0/3293138793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f001977b0 con 0x7f6f001033d0 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.883+0000 7f6eff7fe640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f001033d0 0x7f6f0019db70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400e970 tx=0x7f6ef400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.883+0000 7f6efd7fa640 1 -- 172.21.15.45:0/3293138793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ef400cac0 con 0x7f6f001033d0 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.883+0000 7f6efd7fa640 1 -- 172.21.15.45:0/3293138793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ef40054e0 con 0x7f6f001033d0 2024-09-18T13:01:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.883+0000 7f6f06a11640 1 -- 172.21.15.45:0/3293138793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f00197a40 con 0x7f6f001033d0 2024-09-18T13:01:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.883+0000 7f6efd7fa640 1 -- 172.21.15.45:0/3293138793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ef4004dd0 con 0x7f6f001033d0 2024-09-18T13:01:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.883+0000 7f6f06a11640 1 -- 172.21.15.45:0/3293138793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f00197fd0 con 0x7f6f001033d0 2024-09-18T13:01:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.884+0000 7f6f06a11640 1 -- 172.21.15.45:0/3293138793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eec005290 con 0x7f6f001033d0 2024-09-18T13:01:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.885+0000 7f6efd7fa640 1 -- 172.21.15.45:0/3293138793 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f6ef400cc60 con 0x7f6f001033d0 2024-09-18T13:01:28.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.886+0000 7f6efd7fa640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ee807af30 0x7f6ee807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:28.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.886+0000 7f6efd7fa640 1 -- 172.21.15.45:0/3293138793 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f6ef409e4b0 con 0x7f6f001033d0 2024-09-18T13:01:28.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.886+0000 7f6efffff640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ee807af30 0x7f6ee807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:28.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.886+0000 7f6efffff640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ee807af30 0x7f6ee807d3f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00096c0 tx=0x7f6ef0031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:28.890+0000 7f6efd7fa640 1 -- 172.21.15.45:0/3293138793 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6ef4069ad0 con 0x7f6f001033d0 2024-09-18T13:01:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.106+0000 7f6f06a11640 1 -- 172.21.15.45:0/3293138793 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6eec000bc0 con 0x7f6ee807af30 2024-09-18T13:01:29.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.108+0000 7f6efd7fa640 1 -- 172.21.15.45:0/3293138793 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f6eec000bc0 con 0x7f6ee807af30 2024-09-18T13:01:29.109 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T13:01:29.109 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9", 2024-09-18T13:01:29.109 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": true, 2024-09-18T13:01:29.109 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T13:01:29.109 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [ 2024-09-18T13:01:29.109 INFO:teuthology.orchestra.run.smithi045.stdout: "mds", 2024-09-18T13:01:29.109 INFO:teuthology.orchestra.run.smithi045.stdout: "crash", 2024-09-18T13:01:29.109 INFO:teuthology.orchestra.run.smithi045.stdout: "osd", 2024-09-18T13:01:29.110 INFO:teuthology.orchestra.run.smithi045.stdout: "mon", 2024-09-18T13:01:29.110 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr" 2024-09-18T13:01:29.110 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-18T13:01:29.110 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": "16/23 daemons upgraded", 2024-09-18T13:01:29.110 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-18T13:01:29.110 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T13:01:29.110 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T13:01:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 -- 172.21.15.45:0/3293138793 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ee807af30 msgr2=0x7f6ee807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ee807af30 0x7f6ee807d3f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00096c0 tx=0x7f6ef0031400 comp rx=0 tx=0).stop 2024-09-18T13:01:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 -- 172.21.15.45:0/3293138793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f001033d0 msgr2=0x7f6f0019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f001033d0 0x7f6f0019db70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400e970 tx=0x7f6ef400ee30 comp rx=0 tx=0).stop 2024-09-18T13:01:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 -- 172.21.15.45:0/3293138793 shutdown_connections 2024-09-18T13:01:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ee807af30 0x7f6ee807d3f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f001033d0 0x7f6f0019db70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 --2- 172.21.15.45:0/3293138793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f00102ab0 0x7f6f0019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 -- 172.21.15.45:0/3293138793 >> 172.21.15.45:0/3293138793 conn(0x7f6f000fc550 msgr2=0x7f6f0010aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 -- 172.21.15.45:0/3293138793 shutdown_connections 2024-09-18T13:01:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.110+0000 7f6f06a11640 1 -- 172.21.15.45:0/3293138793 wait complete. 2024-09-18T13:01:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.202+0000 7f3521507640 1 -- 172.21.15.45:0/2934621253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351c107900 msgr2=0x7f351c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.202+0000 7f3521507640 1 --2- 172.21.15.45:0/2934621253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351c107900 0x7f351c107ce0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f350c009880 tx=0x7f350c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.202+0000 7f3521507640 1 -- 172.21.15.45:0/2934621253 shutdown_connections 2024-09-18T13:01:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.202+0000 7f3521507640 1 --2- 172.21.15.45:0/2934621253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c101900 0x7f351c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.202+0000 7f3521507640 1 --2- 172.21.15.45:0/2934621253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351c107900 0x7f351c107ce0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.202+0000 7f3521507640 1 -- 172.21.15.45:0/2934621253 >> 172.21.15.45:0/2934621253 conn(0x7f351c0fd600 msgr2=0x7f351c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.202+0000 7f3521507640 1 -- 172.21.15.45:0/2934621253 shutdown_connections 2024-09-18T13:01:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.202+0000 7f3521507640 1 -- 172.21.15.45:0/2934621253 wait complete. 2024-09-18T13:01:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.203+0000 7f3521507640 1 Processor -- start 2024-09-18T13:01:29.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.203+0000 7f3521507640 1 -- start start 2024-09-18T13:01:29.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.203+0000 7f3521507640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351c101900 0x7f351c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:29.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.203+0000 7f3521507640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c107900 0x7f351c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.203+0000 7f3521507640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f351c10ee30 con 0x7f351c101900 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.203+0000 7f3521507640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f351c10ecb0 con 0x7f351c107900 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.203+0000 7f351affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351c101900 0x7f351c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.203+0000 7f351affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351c101900 0x7f351c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44532/0 (socket says 172.21.15.45:44532) 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.203+0000 7f351affd640 1 -- 172.21.15.45:0/2944277036 learned_addr learned my addr 172.21.15.45:0/2944277036 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.203+0000 7f351a7fc640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c107900 0x7f351c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.204+0000 7f351affd640 1 -- 172.21.15.45:0/2944277036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c107900 msgr2=0x7f351c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.204+0000 7f351affd640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c107900 0x7f351c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.204+0000 7f351affd640 1 -- 172.21.15.45:0/2944277036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351c197860 con 0x7f351c101900 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.204+0000 7f351affd640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351c101900 0x7f351c19d6a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f350c031460 tx=0x7f350c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.204+0000 7f3503fff640 1 -- 172.21.15.45:0/2944277036 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f350c03f070 con 0x7f351c101900 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.204+0000 7f3503fff640 1 -- 172.21.15.45:0/2944277036 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f350c0044d0 con 0x7f351c101900 2024-09-18T13:01:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.204+0000 7f3521507640 1 -- 172.21.15.45:0/2944277036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351c197af0 con 0x7f351c101900 2024-09-18T13:01:29.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.204+0000 7f3503fff640 1 -- 172.21.15.45:0/2944277036 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f350c035030 con 0x7f351c101900 2024-09-18T13:01:29.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.204+0000 7f3521507640 1 -- 172.21.15.45:0/2944277036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f351c198020 con 0x7f351c101900 2024-09-18T13:01:29.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.205+0000 7f3521507640 1 -- 172.21.15.45:0/2944277036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f351c103040 con 0x7f351c101900 2024-09-18T13:01:29.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.206+0000 7f3503fff640 1 -- 172.21.15.45:0/2944277036 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f350c042070 con 0x7f351c101900 2024-09-18T13:01:29.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.207+0000 7f3503fff640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f350407af90 0x7f350407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:29.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.207+0000 7f3503fff640 1 -- 172.21.15.45:0/2944277036 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f350c0beab0 con 0x7f351c101900 2024-09-18T13:01:29.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.207+0000 7f351a7fc640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f350407af90 0x7f350407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:29.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.207+0000 7f351a7fc640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f350407af90 0x7f350407d450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f351c0ffc20 tx=0x7f3510009110 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:29.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.211+0000 7f3503fff640 1 -- 172.21.15.45:0/2944277036 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f350c004cf0 con 0x7f351c101900 2024-09-18T13:01:29.447 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:29 smithi045 ceph-mon[109129]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:29.448 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:29 smithi045 ceph-mon[109129]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:29.448 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:29 smithi045 ceph-mon[109129]: pgmap v296: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-18T13:01:29.448 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:29 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3125838744' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:29.448 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:29.448 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:29.448 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:29 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:29.448 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:29 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1583042238' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:01:29.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.476+0000 7f3521507640 1 -- 172.21.15.45:0/2944277036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f351c198d90 con 0x7f351c101900 2024-09-18T13:01:29.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.476+0000 7f3503fff640 1 -- 172.21.15.45:0/2944277036 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f350c08a0d0 con 0x7f351c101900 2024-09-18T13:01:29.478 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T13:01:29.478 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:01:29.478 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:01:29.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 -- 172.21.15.45:0/2944277036 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f350407af90 msgr2=0x7f350407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:29.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f350407af90 0x7f350407d450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f351c0ffc20 tx=0x7f3510009110 comp rx=0 tx=0).stop 2024-09-18T13:01:29.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 -- 172.21.15.45:0/2944277036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351c101900 msgr2=0x7f351c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:29.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351c101900 0x7f351c19d6a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f350c031460 tx=0x7f350c0048f0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 -- 172.21.15.45:0/2944277036 shutdown_connections 2024-09-18T13:01:29.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f350407af90 0x7f350407d450 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c107900 0x7f351c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 --2- 172.21.15.45:0/2944277036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351c101900 0x7f351c19d6a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:29.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 -- 172.21.15.45:0/2944277036 >> 172.21.15.45:0/2944277036 conn(0x7f351c0fd600 msgr2=0x7f351c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:29.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 -- 172.21.15.45:0/2944277036 shutdown_connections 2024-09-18T13:01:29.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:29.479+0000 7f3521507640 1 -- 172.21.15.45:0/2944277036 wait complete. 2024-09-18T13:01:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:29 smithi161 ceph-mon[80292]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:29 smithi161 ceph-mon[80292]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:29 smithi161 ceph-mon[80292]: pgmap v296: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-18T13:01:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:29 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3125838744' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:29 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:29.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:29 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1583042238' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:01:30.467 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:30 smithi045 ceph-mon[109129]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:30.467 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:30 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2944277036' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:01:30.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:30 smithi161 ceph-mon[80292]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:01:30.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:30 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2944277036' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:01:31.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:31 smithi045 ceph-mon[109129]: pgmap v297: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-18T13:01:31.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:31.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:31 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:31.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:31 smithi161 ceph-mon[80292]: pgmap v297: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-18T13:01:31.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:31.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:31 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:32.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:32 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:32.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:32 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:32 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:32.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:32 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:33.698 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:33 smithi161 ceph-mon[80292]: pgmap v298: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 3.8 KiB/s wr, 7 op/s 2024-09-18T13:01:33.698 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:33.698 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:33 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:33 smithi045 ceph-mon[109129]: pgmap v298: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 3.8 KiB/s wr, 7 op/s 2024-09-18T13:01:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:33 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:35.006 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:34 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:35.006 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:34 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:35.006 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:34 smithi045 ceph-mon[109129]: pgmap v299: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2024-09-18T13:01:35.007 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:34 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:35.007 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:34 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:34 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:34 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:34 smithi161 ceph-mon[80292]: pgmap v299: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2024-09-18T13:01:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:34 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:34 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:37.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: pgmap v300: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s rd, 2 op/s 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:37.535 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:37 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-18T13:01:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: pgmap v300: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s rd, 2 op/s 2024-09-18T13:01:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:37.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:37.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:37.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:37.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:37.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:37.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:37.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:37.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:37 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-18T13:01:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: Upgrade: Setting filesystem cephfs Joinable 2024-09-18T13:01:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-18T13:01:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T13:01:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi045"} : dispatch 2024-09-18T13:01:38.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi045"}]': finished 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi161"} : dispatch 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi161"}]': finished 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.786 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T13:01:38.787 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.788 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:38.789 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: Upgrade: Setting filesystem cephfs Joinable 2024-09-18T13:01:38.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-18T13:01:38.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: fsmap cephfs:1 {0=cephfs.smithi045.gzqgyu=up:active} 1 up:standby-replay 2 up:standby 2024-09-18T13:01:38.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi045"} : dispatch 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi045"}]': finished 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi161"} : dispatch 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi161"}]': finished 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-18T13:01:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-18T13:01:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:01:38.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:01:38.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:01:38.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:38.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:38.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:01:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:39 smithi045 ceph-mon[109129]: Upgrade: Setting container_image for all ceph-exporter 2024-09-18T13:01:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:39 smithi045 ceph-mon[109129]: Upgrade: Setting container_image for all iscsi 2024-09-18T13:01:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:39 smithi045 ceph-mon[109129]: Upgrade: Setting container_image for all nfs 2024-09-18T13:01:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:39 smithi045 ceph-mon[109129]: Upgrade: Setting container_image for all nvmeof 2024-09-18T13:01:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:39 smithi045 ceph-mon[109129]: Upgrade: Finalizing container_image settings 2024-09-18T13:01:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:39 smithi045 ceph-mon[109129]: Upgrade: Complete! 2024-09-18T13:01:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:39 smithi045 ceph-mon[109129]: pgmap v301: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1 op/s 2024-09-18T13:01:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:39 smithi161 ceph-mon[80292]: Upgrade: Setting container_image for all ceph-exporter 2024-09-18T13:01:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:39 smithi161 ceph-mon[80292]: Upgrade: Setting container_image for all iscsi 2024-09-18T13:01:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:39 smithi161 ceph-mon[80292]: Upgrade: Setting container_image for all nfs 2024-09-18T13:01:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:39 smithi161 ceph-mon[80292]: Upgrade: Setting container_image for all nvmeof 2024-09-18T13:01:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:39 smithi161 ceph-mon[80292]: Upgrade: Finalizing container_image settings 2024-09-18T13:01:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:39 smithi161 ceph-mon[80292]: Upgrade: Complete! 2024-09-18T13:01:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:39 smithi161 ceph-mon[80292]: pgmap v301: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1 op/s 2024-09-18T13:01:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:41 smithi045 ceph-mon[109129]: pgmap v302: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-09-18T13:01:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:41 smithi161 ceph-mon[80292]: pgmap v302: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-09-18T13:01:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:43 smithi045 ceph-mon[109129]: pgmap v303: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:01:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:43 smithi161 ceph-mon[80292]: pgmap v303: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:01:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:45 smithi045 ceph-mon[109129]: pgmap v304: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:01:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:45 smithi161 ceph-mon[80292]: pgmap v304: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:01:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:47 smithi045 ceph-mon[109129]: pgmap v305: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:01:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:47 smithi161 ceph-mon[80292]: pgmap v305: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:01:49.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:49 smithi045 ceph-mon[109129]: pgmap v306: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:01:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:49 smithi161 ceph-mon[80292]: pgmap v306: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:01:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:51 smithi045 ceph-mon[109129]: pgmap v307: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:01:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:51 smithi161 ceph-mon[80292]: pgmap v307: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:01:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:53 smithi045 ceph-mon[109129]: pgmap v308: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:01:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:53 smithi161 ceph-mon[80292]: pgmap v308: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:01:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:01:55.565 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:55 smithi045 ceph-mon[109129]: pgmap v309: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:01:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:55 smithi161 ceph-mon[80292]: pgmap v309: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:01:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:57 smithi045 ceph-mon[109129]: pgmap v310: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:01:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:57 smithi161 ceph-mon[80292]: pgmap v310: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:01:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.570+0000 7f7cb8142640 1 -- 172.21.15.45:0/2075610745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb01033e0 msgr2=0x7f7cb010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.570+0000 7f7cb8142640 1 --2- 172.21.15.45:0/2075610745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb01033e0 0x7f7cb010b8d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009880 tx=0x7f7ca002a530 comp rx=0 tx=0).stop 2024-09-18T13:01:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.570+0000 7f7cb8142640 1 -- 172.21.15.45:0/2075610745 shutdown_connections 2024-09-18T13:01:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.570+0000 7f7cb8142640 1 --2- 172.21.15.45:0/2075610745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb01033e0 0x7f7cb010b8d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.570+0000 7f7cb8142640 1 --2- 172.21.15.45:0/2075610745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb0102ac0 0x7f7cb0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.570+0000 7f7cb8142640 1 -- 172.21.15.45:0/2075610745 >> 172.21.15.45:0/2075610745 conn(0x7f7cb00fc520 msgr2=0x7f7cb00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.570+0000 7f7cb8142640 1 -- 172.21.15.45:0/2075610745 shutdown_connections 2024-09-18T13:01:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.570+0000 7f7cb8142640 1 -- 172.21.15.45:0/2075610745 wait complete. 2024-09-18T13:01:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.570+0000 7f7cb8142640 1 Processor -- start 2024-09-18T13:01:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.570+0000 7f7cb8142640 1 -- start start 2024-09-18T13:01:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb8142640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb0102ac0 0x7f7cb0100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb8142640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb01033e0 0x7f7cb0100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb8142640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb010edf0 con 0x7f7cb0102ac0 2024-09-18T13:01:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb8142640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb010ec70 con 0x7f7cb01033e0 2024-09-18T13:01:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb5ede640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb0102ac0 0x7f7cb0100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb5ede640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb0102ac0 0x7f7cb0100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35462/0 (socket says 172.21.15.45:35462) 2024-09-18T13:01:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb5ede640 1 -- 172.21.15.45:0/3087997097 learned_addr learned my addr 172.21.15.45:0/3087997097 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:01:59.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb56dd640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb01033e0 0x7f7cb0100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:59.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb5ede640 1 -- 172.21.15.45:0/3087997097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb01033e0 msgr2=0x7f7cb0100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:59.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb5ede640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb01033e0 0x7f7cb0100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb5ede640 1 -- 172.21.15.45:0/3087997097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb01024a0 con 0x7f7cb0102ac0 2024-09-18T13:01:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb5ede640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb0102ac0 0x7f7cb0100720 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00d6f0 tx=0x7f7cac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7ca6ffd640 1 -- 172.21.15.45:0/3087997097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cac017070 con 0x7f7cb0102ac0 2024-09-18T13:01:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb8142640 1 -- 172.21.15.45:0/3087997097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb01011a0 con 0x7f7cb0102ac0 2024-09-18T13:01:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.571+0000 7f7cb8142640 1 -- 172.21.15.45:0/3087997097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb01a8390 con 0x7f7cb0102ac0 2024-09-18T13:01:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.572+0000 7f7ca6ffd640 1 -- 172.21.15.45:0/3087997097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7cac00de00 con 0x7f7cb0102ac0 2024-09-18T13:01:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.572+0000 7f7ca6ffd640 1 -- 172.21.15.45:0/3087997097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cac020060 con 0x7f7cb0102ac0 2024-09-18T13:01:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.572+0000 7f7cb8142640 1 -- 172.21.15.45:0/3087997097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c94005290 con 0x7f7cb0102ac0 2024-09-18T13:01:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.573+0000 7f7ca6ffd640 1 -- 172.21.15.45:0/3087997097 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f7cac009a30 con 0x7f7cb0102ac0 2024-09-18T13:01:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.574+0000 7f7ca6ffd640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7c9c07af30 0x7f7c9c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:01:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.574+0000 7f7cb56dd640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7c9c07af30 0x7f7c9c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:01:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.574+0000 7f7ca6ffd640 1 -- 172.21.15.45:0/3087997097 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f7cac09d9c0 con 0x7f7cb0102ac0 2024-09-18T13:01:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.574+0000 7f7cb56dd640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7c9c07af30 0x7f7c9c07d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000c00 tx=0x7f7ca0031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:01:59.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.578+0000 7f7ca6ffd640 1 -- 172.21.15.45:0/3087997097 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7cac068ec0 con 0x7f7cb0102ac0 2024-09-18T13:01:59.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.782+0000 7f7cb8142640 1 -- 172.21.15.45:0/3087997097 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7c94000bc0 con 0x7f7c9c07af30 2024-09-18T13:01:59.783 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:01:59 smithi045 ceph-mon[109129]: pgmap v311: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:01:59.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.783+0000 7f7ca6ffd640 1 -- 172.21.15.45:0/3087997097 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f7c94000bc0 con 0x7f7c9c07af30 2024-09-18T13:01:59.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 -- 172.21.15.45:0/3087997097 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7c9c07af30 msgr2=0x7f7c9c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:59.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7c9c07af30 0x7f7c9c07d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000c00 tx=0x7f7ca0031400 comp rx=0 tx=0).stop 2024-09-18T13:01:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 -- 172.21.15.45:0/3087997097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb0102ac0 msgr2=0x7f7cb0100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:01:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb0102ac0 0x7f7cb0100720 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00d6f0 tx=0x7f7cac00dbb0 comp rx=0 tx=0).stop 2024-09-18T13:01:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 -- 172.21.15.45:0/3087997097 shutdown_connections 2024-09-18T13:01:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7c9c07af30 0x7f7c9c07d3f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb01033e0 0x7f7cb0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 --2- 172.21.15.45:0/3087997097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb0102ac0 0x7f7cb0100720 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:01:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 -- 172.21.15.45:0/3087997097 >> 172.21.15.45:0/3087997097 conn(0x7f7cb00fc520 msgr2=0x7f7cb0108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:01:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 -- 172.21.15.45:0/3087997097 shutdown_connections 2024-09-18T13:01:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:01:59.785+0000 7f7cb8142640 1 -- 172.21.15.45:0/3087997097 wait complete. 2024-09-18T13:01:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:01:59 smithi161 ceph-mon[80292]: pgmap v311: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:00.523 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch ps' 2024-09-18T13:02:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:02:01.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.272+0000 7f30de840640 1 -- 172.21.15.45:0/3750055636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d81033e0 msgr2=0x7f30d810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:01.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.272+0000 7f30de840640 1 --2- 172.21.15.45:0/3750055636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d81033e0 0x7f30d810b8d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009880 tx=0x7f30cc02a540 comp rx=0 tx=0).stop 2024-09-18T13:02:01.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.272+0000 7f30de840640 1 -- 172.21.15.45:0/3750055636 shutdown_connections 2024-09-18T13:02:01.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.272+0000 7f30de840640 1 --2- 172.21.15.45:0/3750055636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d81033e0 0x7f30d810b8d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:01.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.272+0000 7f30de840640 1 --2- 172.21.15.45:0/3750055636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d8102ac0 0x7f30d8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:01.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.272+0000 7f30de840640 1 -- 172.21.15.45:0/3750055636 >> 172.21.15.45:0/3750055636 conn(0x7f30d80fc520 msgr2=0x7f30d80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:01.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.272+0000 7f30de840640 1 -- 172.21.15.45:0/3750055636 shutdown_connections 2024-09-18T13:02:01.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.272+0000 7f30de840640 1 -- 172.21.15.45:0/3750055636 wait complete. 2024-09-18T13:02:01.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.272+0000 7f30de840640 1 Processor -- start 2024-09-18T13:02:01.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.272+0000 7f30de840640 1 -- start start 2024-09-18T13:02:01.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.273+0000 7f30de840640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d8102ac0 0x7f30d8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:01.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.273+0000 7f30de840640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d81033e0 0x7f30d8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.273+0000 7f30de840640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f30d810edf0 con 0x7f30d81033e0 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.273+0000 7f30de840640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f30d810ec70 con 0x7f30d8102ac0 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.273+0000 7f30d77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d81033e0 0x7f30d8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.273+0000 7f30d7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d8102ac0 0x7f30d8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.273+0000 7f30d7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d8102ac0 0x7f30d8100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.45:40180/0 (socket says 172.21.15.45:40180) 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.273+0000 7f30d7fff640 1 -- 172.21.15.45:0/3865133399 learned_addr learned my addr 172.21.15.45:0/3865133399 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.274+0000 7f30d7fff640 1 -- 172.21.15.45:0/3865133399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d81033e0 msgr2=0x7f30d8100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.274+0000 7f30d7fff640 1 --2- 172.21.15.45:0/3865133399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d81033e0 0x7f30d8100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.274+0000 7f30d7fff640 1 -- 172.21.15.45:0/3865133399 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d81011a0 con 0x7f30d8102ac0 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.274+0000 7f30d7fff640 1 --2- 172.21.15.45:0/3865133399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d8102ac0 0x7f30d8100720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f30c800d6f0 tx=0x7f30c800dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.274+0000 7f30d57fa640 1 -- 172.21.15.45:0/3865133399 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30c8017070 con 0x7f30d8102ac0 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.274+0000 7f30d57fa640 1 -- 172.21.15.45:0/3865133399 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f30c800de00 con 0x7f30d8102ac0 2024-09-18T13:02:01.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.274+0000 7f30d57fa640 1 -- 172.21.15.45:0/3865133399 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30c8004bb0 con 0x7f30d8102ac0 2024-09-18T13:02:01.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.274+0000 7f30de840640 1 -- 172.21.15.45:0/3865133399 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d8101490 con 0x7f30d8102ac0 2024-09-18T13:02:01.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.274+0000 7f30de840640 1 -- 172.21.15.45:0/3865133399 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d81a3e80 con 0x7f30d8102ac0 2024-09-18T13:02:01.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.275+0000 7f30de840640 1 -- 172.21.15.45:0/3865133399 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d806aa90 con 0x7f30d8102ac0 2024-09-18T13:02:01.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.276+0000 7f30d57fa640 1 -- 172.21.15.45:0/3865133399 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f30c8004e60 con 0x7f30d8102ac0 2024-09-18T13:02:01.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.277+0000 7f30d57fa640 1 --2- 172.21.15.45:0/3865133399 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f30c007af40 0x7f30c007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:01.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.277+0000 7f30d57fa640 1 -- 172.21.15.45:0/3865133399 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f30c809dbe0 con 0x7f30d8102ac0 2024-09-18T13:02:01.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.277+0000 7f30d77fe640 1 --2- 172.21.15.45:0/3865133399 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f30c007af40 0x7f30c007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:01.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.277+0000 7f30d77fe640 1 --2- 172.21.15.45:0/3865133399 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f30c007af40 0x7f30c007d400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30d81021b0 tx=0x7f30cc031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:01.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.282+0000 7f30d57fa640 1 -- 172.21.15.45:0/3865133399 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f30c8069180 con 0x7f30d8102ac0 2024-09-18T13:02:01.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.479+0000 7f30de840640 1 -- 172.21.15.45:0/3865133399 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f30d8062630 con 0x7f30c007af40 2024-09-18T13:02:01.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.489+0000 7f30d57fa640 1 -- 172.21.15.45:0/3865133399 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f30d8062630 con 0x7f30c007af40 2024-09-18T13:02:01.490 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:02:01.490 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (7m) 28s ago 17m 20.1M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (38s) 28s ago 18m 8262k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 41121987edca 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (33s) 30s ago 17m 7285k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f67d338561b9 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (5m) 28s ago 18m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (5m) 30s ago 17m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (6m) 28s ago 17m 78.1M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (83s) 28s ago 12m 85.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9bf29d5aa6b6 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (99s) 28s ago 12m 87.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e7c39085fb8d 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (52s) 30s ago 12m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c446bf8facb6 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (67s) 30s ago 12m 16.2M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f511abca950f 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (9m) 28s ago 19m 529M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (8m) 30s ago 17m 459M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T13:02:01.491 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (5m) 28s ago 19m 53.6M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T13:02:01.492 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (5m) 30s ago 17m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T13:02:01.492 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (7m) 28s ago 18m 11.6M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T13:02:01.492 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (7m) 30s ago 17m 11.1M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T13:02:01.492 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (4m) 28s ago 16m 94.2M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T13:02:01.492 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (4m) 28s ago 15m 104M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 7d4cd0351725 2024-09-18T13:02:01.492 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (3m) 28s ago 14m 89.6M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4f620cf3977f 2024-09-18T13:02:01.492 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (3m) 30s ago 14m 110M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1fbe6c224b87 2024-09-18T13:02:01.492 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (2m) 30s ago 14m 93.5M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b3c49339a90c 2024-09-18T13:02:01.492 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (2m) 30s ago 13m 88.2M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 035aa0efadd6 2024-09-18T13:02:01.492 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (7m) 28s ago 17m 54.2M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T13:02:01.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.491+0000 7f30de840640 1 -- 172.21.15.45:0/3865133399 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f30c007af40 msgr2=0x7f30c007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:01.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.491+0000 7f30de840640 1 --2- 172.21.15.45:0/3865133399 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f30c007af40 0x7f30c007d400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30d81021b0 tx=0x7f30cc031400 comp rx=0 tx=0).stop 2024-09-18T13:02:01.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.491+0000 7f30de840640 1 -- 172.21.15.45:0/3865133399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d8102ac0 msgr2=0x7f30d8100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:01.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.491+0000 7f30de840640 1 --2- 172.21.15.45:0/3865133399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d8102ac0 0x7f30d8100720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f30c800d6f0 tx=0x7f30c800dbb0 comp rx=0 tx=0).stop 2024-09-18T13:02:01.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.492+0000 7f30de840640 1 -- 172.21.15.45:0/3865133399 shutdown_connections 2024-09-18T13:02:01.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.492+0000 7f30de840640 1 --2- 172.21.15.45:0/3865133399 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f30c007af40 0x7f30c007d400 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:01.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.492+0000 7f30de840640 1 --2- 172.21.15.45:0/3865133399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d81033e0 0x7f30d8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:01.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.492+0000 7f30de840640 1 --2- 172.21.15.45:0/3865133399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d8102ac0 0x7f30d8100720 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:01.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.492+0000 7f30de840640 1 -- 172.21.15.45:0/3865133399 >> 172.21.15.45:0/3865133399 conn(0x7f30d80fc520 msgr2=0x7f30d8108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:01.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.492+0000 7f30de840640 1 -- 172.21.15.45:0/3865133399 shutdown_connections 2024-09-18T13:02:01.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:01.492+0000 7f30de840640 1 -- 172.21.15.45:0/3865133399 wait complete. 2024-09-18T13:02:01.530 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:01 smithi045 ceph-mon[109129]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:01.530 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:01 smithi045 ceph-mon[109129]: pgmap v312: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:01 smithi161 ceph-mon[80292]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:01 smithi161 ceph-mon[80292]: pgmap v312: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:02.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch upgrade status' 2024-09-18T13:02:02.385 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:02:02.633 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:02 smithi045 ceph-mon[109129]: from='client.44383 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:02.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:02 smithi161 ceph-mon[80292]: from='client.44383 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.838+0000 7faa4a367640 1 -- 172.21.15.45:0/3964977810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa44107900 msgr2=0x7faa44107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.838+0000 7faa4a367640 1 --2- 172.21.15.45:0/3964977810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa44107900 0x7faa44107ce0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa34009880 tx=0x7faa3402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:02:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.838+0000 7faa4a367640 1 -- 172.21.15.45:0/3964977810 shutdown_connections 2024-09-18T13:02:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.838+0000 7faa4a367640 1 --2- 172.21.15.45:0/3964977810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa44101900 0x7faa44101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.838+0000 7faa4a367640 1 --2- 172.21.15.45:0/3964977810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa44107900 0x7faa44107ce0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.838+0000 7faa4a367640 1 -- 172.21.15.45:0/3964977810 >> 172.21.15.45:0/3964977810 conn(0x7faa440fd600 msgr2=0x7faa440ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.838+0000 7faa4a367640 1 -- 172.21.15.45:0/3964977810 shutdown_connections 2024-09-18T13:02:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.838+0000 7faa4a367640 1 -- 172.21.15.45:0/3964977810 wait complete. 2024-09-18T13:02:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.839+0000 7faa4a367640 1 Processor -- start 2024-09-18T13:02:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.839+0000 7faa4a367640 1 -- start start 2024-09-18T13:02:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.839+0000 7faa4a367640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa44101900 0x7faa440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.839+0000 7faa4a367640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa44107900 0x7faa44074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.839+0000 7faa4a367640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faa4410edd0 con 0x7faa44101900 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.839+0000 7faa4a367640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7faa4410ec50 con 0x7faa44107900 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.839+0000 7faa43fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa44101900 0x7faa440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.839+0000 7faa43fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa44101900 0x7faa440744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37356/0 (socket says 172.21.15.45:37356) 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.839+0000 7faa43fff640 1 -- 172.21.15.45:0/1189584335 learned_addr learned my addr 172.21.15.45:0/1189584335 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.840+0000 7faa437fe640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa44107900 0x7faa44074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.840+0000 7faa43fff640 1 -- 172.21.15.45:0/1189584335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa44107900 msgr2=0x7faa44074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.840+0000 7faa43fff640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa44107900 0x7faa44074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.840+0000 7faa43fff640 1 -- 172.21.15.45:0/1189584335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa44074f70 con 0x7faa44101900 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.840+0000 7faa43fff640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa44101900 0x7faa440744f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa34031460 tx=0x7faa340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.840+0000 7faa417fa640 1 -- 172.21.15.45:0/1189584335 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa3403f070 con 0x7faa44101900 2024-09-18T13:02:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.840+0000 7faa4a367640 1 -- 172.21.15.45:0/1189584335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa44075200 con 0x7faa44101900 2024-09-18T13:02:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.840+0000 7faa417fa640 1 -- 172.21.15.45:0/1189584335 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa340035f0 con 0x7faa44101900 2024-09-18T13:02:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.840+0000 7faa417fa640 1 -- 172.21.15.45:0/1189584335 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa34035030 con 0x7faa44101900 2024-09-18T13:02:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.840+0000 7faa4a367640 1 -- 172.21.15.45:0/1189584335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa441a3d80 con 0x7faa44101900 2024-09-18T13:02:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.841+0000 7faa4a367640 1 -- 172.21.15.45:0/1189584335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa44103040 con 0x7faa44101900 2024-09-18T13:02:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.842+0000 7faa417fa640 1 -- 172.21.15.45:0/1189584335 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7faa34042070 con 0x7faa44101900 2024-09-18T13:02:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.842+0000 7faa417fa640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7faa2c07af30 0x7faa2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.843+0000 7faa417fa640 1 -- 172.21.15.45:0/1189584335 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7faa340bea50 con 0x7faa44101900 2024-09-18T13:02:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.843+0000 7faa437fe640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7faa2c07af30 0x7faa2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.843+0000 7faa437fe640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7faa2c07af30 0x7faa2c07d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa44075f80 tx=0x7faa3800b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:02.847+0000 7faa417fa640 1 -- 172.21.15.45:0/1189584335 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7faa34089f50 con 0x7faa44101900 2024-09-18T13:02:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.051+0000 7faa4a367640 1 -- 172.21.15.45:0/1189584335 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faa44062630 con 0x7faa2c07af30 2024-09-18T13:02:03.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.052+0000 7faa417fa640 1 -- 172.21.15.45:0/1189584335 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7faa44062630 con 0x7faa2c07af30 2024-09-18T13:02:03.053 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T13:02:03.054 INFO:teuthology.orchestra.run.smithi045.stdout: "target_image": null, 2024-09-18T13:02:03.054 INFO:teuthology.orchestra.run.smithi045.stdout: "in_progress": false, 2024-09-18T13:02:03.054 INFO:teuthology.orchestra.run.smithi045.stdout: "which": "", 2024-09-18T13:02:03.054 INFO:teuthology.orchestra.run.smithi045.stdout: "services_complete": [], 2024-09-18T13:02:03.054 INFO:teuthology.orchestra.run.smithi045.stdout: "progress": null, 2024-09-18T13:02:03.054 INFO:teuthology.orchestra.run.smithi045.stdout: "message": "", 2024-09-18T13:02:03.054 INFO:teuthology.orchestra.run.smithi045.stdout: "is_paused": false 2024-09-18T13:02:03.054 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.054+0000 7faa4a367640 1 -- 172.21.15.45:0/1189584335 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7faa2c07af30 msgr2=0x7faa2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.054+0000 7faa4a367640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7faa2c07af30 0x7faa2c07d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa44075f80 tx=0x7faa3800b390 comp rx=0 tx=0).stop 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.054+0000 7faa4a367640 1 -- 172.21.15.45:0/1189584335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa44101900 msgr2=0x7faa440744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.054+0000 7faa4a367640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa44101900 0x7faa440744f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa34031460 tx=0x7faa340045e0 comp rx=0 tx=0).stop 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.054+0000 7faa4a367640 1 -- 172.21.15.45:0/1189584335 shutdown_connections 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.054+0000 7faa4a367640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7faa2c07af30 0x7faa2c07d3f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.054+0000 7faa4a367640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa44107900 0x7faa44074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.054+0000 7faa4a367640 1 --2- 172.21.15.45:0/1189584335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa44101900 0x7faa440744f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.054+0000 7faa4a367640 1 -- 172.21.15.45:0/1189584335 >> 172.21.15.45:0/1189584335 conn(0x7faa440fd600 msgr2=0x7faa440fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.055+0000 7faa4a367640 1 -- 172.21.15.45:0/1189584335 shutdown_connections 2024-09-18T13:02:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:03.055+0000 7faa4a367640 1 -- 172.21.15.45:0/1189584335 wait complete. 2024-09-18T13:02:03.725 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:03 smithi045 ceph-mon[109129]: pgmap v313: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:03.755 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph health detail' 2024-09-18T13:02:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:03 smithi161 ceph-mon[80292]: pgmap v313: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:02:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.444+0000 7f0ed6762640 1 -- 172.21.15.45:0/971821314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed0101900 msgr2=0x7f0ed0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.444+0000 7f0ed6762640 1 --2- 172.21.15.45:0/971821314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed0101900 0x7f0ed0101d60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009880 tx=0x7f0ec402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:02:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.444+0000 7f0ed6762640 1 -- 172.21.15.45:0/971821314 shutdown_connections 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.444+0000 7f0ed6762640 1 --2- 172.21.15.45:0/971821314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed0101900 0x7f0ed0101d60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.444+0000 7f0ed6762640 1 --2- 172.21.15.45:0/971821314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ed0107900 0x7f0ed0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.444+0000 7f0ed6762640 1 -- 172.21.15.45:0/971821314 >> 172.21.15.45:0/971821314 conn(0x7f0ed00fd600 msgr2=0x7f0ed00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.444+0000 7f0ed6762640 1 -- 172.21.15.45:0/971821314 shutdown_connections 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.444+0000 7f0ed6762640 1 -- 172.21.15.45:0/971821314 wait complete. 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.445+0000 7f0ed6762640 1 Processor -- start 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.445+0000 7f0ed6762640 1 -- start start 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.445+0000 7f0ed6762640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed0101900 0x7f0ed019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.445+0000 7f0ed6762640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ed0107900 0x7f0ed019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.445+0000 7f0ed6762640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed010edb0 con 0x7f0ed0101900 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.445+0000 7f0ed6762640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed010ec30 con 0x7f0ed0107900 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed0101900 0x7f0ed019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed0101900 0x7f0ed019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37368/0 (socket says 172.21.15.45:37368) 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecffff640 1 -- 172.21.15.45:0/1079102040 learned_addr learned my addr 172.21.15.45:0/1079102040 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecf7fe640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ed0107900 0x7f0ed019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecffff640 1 -- 172.21.15.45:0/1079102040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ed0107900 msgr2=0x7f0ed019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecffff640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ed0107900 0x7f0ed019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecffff640 1 -- 172.21.15.45:0/1079102040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed01977e0 con 0x7f0ed0101900 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecffff640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed0101900 0x7f0ed019d660 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000d8d0 tx=0x7f0ec000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecd7fa640 1 -- 172.21.15.45:0/1079102040 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ec0017030 con 0x7f0ed0101900 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ed6762640 1 -- 172.21.15.45:0/1079102040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed0197ad0 con 0x7f0ed0101900 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecd7fa640 1 -- 172.21.15.45:0/1079102040 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ec0004020 con 0x7f0ed0101900 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ecd7fa640 1 -- 172.21.15.45:0/1079102040 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ec00047a0 con 0x7f0ed0101900 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.446+0000 7f0ed6762640 1 -- 172.21.15.45:0/1079102040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed0198030 con 0x7f0ed0101900 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.447+0000 7f0ed6762640 1 -- 172.21.15.45:0/1079102040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed0103040 con 0x7f0ed0101900 2024-09-18T13:02:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.448+0000 7f0ecd7fa640 1 -- 172.21.15.45:0/1079102040 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f0ec00041d0 con 0x7f0ed0101900 2024-09-18T13:02:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.449+0000 7f0ecd7fa640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0eb807af30 0x7f0eb807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.449+0000 7f0ecd7fa640 1 -- 172.21.15.45:0/1079102040 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f0ec0018070 con 0x7f0ed0101900 2024-09-18T13:02:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.449+0000 7f0ecf7fe640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0eb807af30 0x7f0eb807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.449+0000 7f0ecf7fe640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0eb807af30 0x7f0eb807d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0198b30 tx=0x7f0ec4031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.453+0000 7f0ecd7fa640 1 -- 172.21.15.45:0/1079102040 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0ec0069420 con 0x7f0ed0101900 2024-09-18T13:02:04.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:04 smithi161 ceph-mon[80292]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.719+0000 7f0ed6762640 1 -- 172.21.15.45:0/1079102040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0ed0109e90 con 0x7f0ed0101900 2024-09-18T13:02:04.720 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:04 smithi045 ceph-mon[109129]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:02:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.719+0000 7f0ecd7fa640 1 -- 172.21.15.45:0/1079102040 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f0ec006e2d0 con 0x7f0ed0101900 2024-09-18T13:02:04.721 INFO:teuthology.orchestra.run.smithi045.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-18T13:02:04.721 INFO:teuthology.orchestra.run.smithi045.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-18T13:02:04.721 INFO:teuthology.orchestra.run.smithi045.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-18T13:02:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 -- 172.21.15.45:0/1079102040 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0eb807af30 msgr2=0x7f0eb807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0eb807af30 0x7f0eb807d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0198b30 tx=0x7f0ec4031400 comp rx=0 tx=0).stop 2024-09-18T13:02:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 -- 172.21.15.45:0/1079102040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed0101900 msgr2=0x7f0ed019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed0101900 0x7f0ed019d660 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000d8d0 tx=0x7f0ec000dd90 comp rx=0 tx=0).stop 2024-09-18T13:02:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 -- 172.21.15.45:0/1079102040 shutdown_connections 2024-09-18T13:02:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f0eb807af30 0x7f0eb807d3f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ed0107900 0x7f0ed019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 --2- 172.21.15.45:0/1079102040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed0101900 0x7f0ed019d660 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 -- 172.21.15.45:0/1079102040 >> 172.21.15.45:0/1079102040 conn(0x7f0ed00fd600 msgr2=0x7f0ed00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 -- 172.21.15.45:0/1079102040 shutdown_connections 2024-09-18T13:02:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:04.721+0000 7f0ed6762640 1 -- 172.21.15.45:0/1079102040 wait complete. 2024-09-18T13:02:05.288 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions' 2024-09-18T13:02:05.549 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:02:05.670 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:05 smithi045 ceph-mon[109129]: pgmap v314: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:05.670 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:05 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1079102040' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:02:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:05 smithi161 ceph-mon[80292]: pgmap v314: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:05 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1079102040' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-18T13:02:06.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.017+0000 7fef34054640 1 -- 172.21.15.45:0/1427833558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef2c107900 msgr2=0x7fef2c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:06.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.017+0000 7fef34054640 1 --2- 172.21.15.45:0/1427833558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef2c107900 0x7fef2c107ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef28009880 tx=0x7fef2802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:02:06.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.018+0000 7fef34054640 1 -- 172.21.15.45:0/1427833558 shutdown_connections 2024-09-18T13:02:06.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.018+0000 7fef34054640 1 --2- 172.21.15.45:0/1427833558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef2c101900 0x7fef2c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:06.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.018+0000 7fef34054640 1 --2- 172.21.15.45:0/1427833558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef2c107900 0x7fef2c107ce0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:06.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.018+0000 7fef34054640 1 -- 172.21.15.45:0/1427833558 >> 172.21.15.45:0/1427833558 conn(0x7fef2c0fd600 msgr2=0x7fef2c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:06.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.018+0000 7fef34054640 1 -- 172.21.15.45:0/1427833558 shutdown_connections 2024-09-18T13:02:06.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.018+0000 7fef34054640 1 -- 172.21.15.45:0/1427833558 wait complete. 2024-09-18T13:02:06.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.018+0000 7fef34054640 1 Processor -- start 2024-09-18T13:02:06.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.018+0000 7fef34054640 1 -- start start 2024-09-18T13:02:06.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef34054640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef2c101900 0x7fef2c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:06.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef34054640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef2c107900 0x7fef2c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef34054640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c10edd0 con 0x7fef2c107900 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef34054640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c10ec50 con 0x7fef2c101900 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef315ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef2c107900 0x7fef2c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef315ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef2c107900 0x7fef2c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37382/0 (socket says 172.21.15.45:37382) 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef315ef640 1 -- 172.21.15.45:0/1740753417 learned_addr learned my addr 172.21.15.45:0/1740753417 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef31df0640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef2c101900 0x7fef2c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef315ef640 1 -- 172.21.15.45:0/1740753417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef2c101900 msgr2=0x7fef2c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef315ef640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef2c101900 0x7fef2c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef315ef640 1 -- 172.21.15.45:0/1740753417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2c074f70 con 0x7fef2c107900 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef315ef640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef2c107900 0x7fef2c074a30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00e970 tx=0x7fef1c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef22ffd640 1 -- 172.21.15.45:0/1740753417 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef1c00cac0 con 0x7fef2c107900 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef34054640 1 -- 172.21.15.45:0/1740753417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2c075260 con 0x7fef2c107900 2024-09-18T13:02:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.019+0000 7fef22ffd640 1 -- 172.21.15.45:0/1740753417 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef1c0054e0 con 0x7fef2c107900 2024-09-18T13:02:06.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.020+0000 7fef22ffd640 1 -- 172.21.15.45:0/1740753417 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef1c010430 con 0x7fef2c107900 2024-09-18T13:02:06.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.020+0000 7fef34054640 1 -- 172.21.15.45:0/1740753417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef2c1a3e20 con 0x7fef2c107900 2024-09-18T13:02:06.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.020+0000 7fef34054640 1 -- 172.21.15.45:0/1740753417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef2c103040 con 0x7fef2c107900 2024-09-18T13:02:06.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.021+0000 7fef22ffd640 1 -- 172.21.15.45:0/1740753417 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fef1c004e80 con 0x7fef2c107900 2024-09-18T13:02:06.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.022+0000 7fef22ffd640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fef1807af30 0x7fef1807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:02:06.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.022+0000 7fef22ffd640 1 -- 172.21.15.45:0/1740753417 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fef1c09e6b0 con 0x7fef2c107900 2024-09-18T13:02:06.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.022+0000 7fef31df0640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fef1807af30 0x7fef1807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:02:06.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.022+0000 7fef31df0640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fef1807af30 0x7fef1807d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fef280096c0 tx=0x7fef28031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:02:06.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.026+0000 7fef22ffd640 1 -- 172.21.15.45:0/1740753417 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fef1c069c50 con 0x7fef2c107900 2024-09-18T13:02:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.287+0000 7fef34054640 1 -- 172.21.15.45:0/1740753417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fef2c109e70 con 0x7fef2c107900 2024-09-18T13:02:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.288+0000 7fef22ffd640 1 -- 172.21.15.45:0/1740753417 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fef1c06eb00 con 0x7fef2c107900 2024-09-18T13:02:06.289 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T13:02:06.289 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T13:02:06.289 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:02:06.289 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:02:06.289 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T13:02:06.290 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T13:02:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 -- 172.21.15.45:0/1740753417 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fef1807af30 msgr2=0x7fef1807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fef1807af30 0x7fef1807d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fef280096c0 tx=0x7fef28031400 comp rx=0 tx=0).stop 2024-09-18T13:02:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 -- 172.21.15.45:0/1740753417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef2c107900 msgr2=0x7fef2c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:02:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef2c107900 0x7fef2c074a30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00e970 tx=0x7fef1c00ed70 comp rx=0 tx=0).stop 2024-09-18T13:02:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 -- 172.21.15.45:0/1740753417 shutdown_connections 2024-09-18T13:02:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fef1807af30 0x7fef1807d3f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef2c107900 0x7fef2c074a30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 --2- 172.21.15.45:0/1740753417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef2c101900 0x7fef2c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:02:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 -- 172.21.15.45:0/1740753417 >> 172.21.15.45:0/1740753417 conn(0x7fef2c0fd600 msgr2=0x7fef2c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:02:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 -- 172.21.15.45:0/1740753417 shutdown_connections 2024-09-18T13:02:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:02:06.291+0000 7fef34054640 1 -- 172.21.15.45:0/1740753417 wait complete. 2024-09-18T13:02:06.677 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:06 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1740753417' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:02:06.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:06 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1740753417' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:02:06.914 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-18T13:02:07.175 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:02:07.548 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:07 smithi045 ceph-mon[109129]: pgmap v315: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:07.644 INFO:teuthology.orchestra.run.smithi045.stdout:wait for servicemap items w/ changing names to refresh 2024-09-18T13:02:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:07 smithi161 ceph-mon[80292]: pgmap v315: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:08.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'sleep 60' 2024-09-18T13:02:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:02:08.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:09.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:09 smithi161 ceph-mon[80292]: pgmap v316: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:09 smithi045 ceph-mon[109129]: pgmap v316: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:11.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:11 smithi045 ceph-mon[109129]: pgmap v317: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:11 smithi161 ceph-mon[80292]: pgmap v317: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:13 smithi045 ceph-mon[109129]: pgmap v318: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:13 smithi161 ceph-mon[80292]: pgmap v318: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:15 smithi045 ceph-mon[109129]: pgmap v319: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:15 smithi161 ceph-mon[80292]: pgmap v319: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:17 smithi045 ceph-mon[109129]: pgmap v320: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:17 smithi161 ceph-mon[80292]: pgmap v320: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:19.762 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:19 smithi045 ceph-mon[109129]: pgmap v321: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:19 smithi161 ceph-mon[80292]: pgmap v321: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:21 smithi045 ceph-mon[109129]: pgmap v322: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:21 smithi161 ceph-mon[80292]: pgmap v322: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:23 smithi045 ceph-mon[109129]: pgmap v323: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:23 smithi161 ceph-mon[80292]: pgmap v323: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:25.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:25 smithi045 ceph-mon[109129]: pgmap v324: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:25 smithi161 ceph-mon[80292]: pgmap v324: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:27 smithi045 ceph-mon[109129]: pgmap v325: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:27 smithi161 ceph-mon[80292]: pgmap v325: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:29 smithi045 ceph-mon[109129]: pgmap v326: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:29 smithi161 ceph-mon[80292]: pgmap v326: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:31 smithi045 ceph-mon[109129]: pgmap v327: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:31 smithi161 ceph-mon[80292]: pgmap v327: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:33 smithi045 ceph-mon[109129]: pgmap v328: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:33 smithi161 ceph-mon[80292]: pgmap v328: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:35 smithi045 ceph-mon[109129]: pgmap v329: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:35 smithi161 ceph-mon[80292]: pgmap v329: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:37 smithi045 ceph-mon[109129]: pgmap v330: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:37 smithi161 ceph-mon[80292]: pgmap v330: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:02:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:02:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:02:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:02:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:02:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:02:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:02:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:02:39.718 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:39 smithi161 ceph-mon[80292]: pgmap v331: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:39 smithi045 ceph-mon[109129]: pgmap v331: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:41 smithi045 ceph-mon[109129]: pgmap v332: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:41 smithi161 ceph-mon[80292]: pgmap v332: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:43 smithi045 ceph-mon[109129]: pgmap v333: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:43 smithi161 ceph-mon[80292]: pgmap v333: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:45.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:45 smithi045 ceph-mon[109129]: pgmap v334: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:45 smithi161 ceph-mon[80292]: pgmap v334: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:47 smithi045 ceph-mon[109129]: pgmap v335: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:47 smithi161 ceph-mon[80292]: pgmap v335: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:49 smithi045 ceph-mon[109129]: pgmap v336: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:49 smithi161 ceph-mon[80292]: pgmap v336: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:51 smithi045 ceph-mon[109129]: pgmap v337: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:51 smithi161 ceph-mon[80292]: pgmap v337: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:53 smithi045 ceph-mon[109129]: pgmap v338: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:53 smithi161 ceph-mon[80292]: pgmap v338: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:02:55.576 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:55 smithi045 ceph-mon[109129]: pgmap v339: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:55 smithi161 ceph-mon[80292]: pgmap v339: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:57 smithi045 ceph-mon[109129]: pgmap v340: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:57 smithi161 ceph-mon[80292]: pgmap v340: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:02:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:02:59 smithi045 ceph-mon[109129]: pgmap v341: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:02:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:02:59 smithi161 ceph-mon[80292]: pgmap v341: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:01 smithi045 ceph-mon[109129]: pgmap v342: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:01 smithi161 ceph-mon[80292]: pgmap v342: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:03 smithi045 ceph-mon[109129]: pgmap v343: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:03 smithi161 ceph-mon[80292]: pgmap v343: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:05 smithi045 ceph-mon[109129]: pgmap v344: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:05 smithi161 ceph-mon[80292]: pgmap v344: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:07 smithi045 ceph-mon[109129]: pgmap v345: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:07 smithi161 ceph-mon[80292]: pgmap v345: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:09.500 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph orch ps' 2024-09-18T13:03:09.767 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:09.783 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:09 smithi045 ceph-mon[109129]: pgmap v346: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:09 smithi161 ceph-mon[80292]: pgmap v346: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.249+0000 7efecb5c9640 1 -- 172.21.15.45:0/2648651843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efec41011d0 msgr2=0x7efec41056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.249+0000 7efecb5c9640 1 --2- 172.21.15.45:0/2648651843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efec41011d0 0x7efec41056a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009880 tx=0x7efeb402a540 comp rx=0 tx=0).stop 2024-09-18T13:03:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.249+0000 7efecb5c9640 1 -- 172.21.15.45:0/2648651843 shutdown_connections 2024-09-18T13:03:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.249+0000 7efecb5c9640 1 --2- 172.21.15.45:0/2648651843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efec41011d0 0x7efec41056a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.249+0000 7efecb5c9640 1 --2- 172.21.15.45:0/2648651843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec41008b0 0x7efec4100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.249+0000 7efecb5c9640 1 -- 172.21.15.45:0/2648651843 >> 172.21.15.45:0/2648651843 conn(0x7efec40fc520 msgr2=0x7efec40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.250+0000 7efecb5c9640 1 -- 172.21.15.45:0/2648651843 shutdown_connections 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.250+0000 7efecb5c9640 1 -- 172.21.15.45:0/2648651843 wait complete. 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.250+0000 7efecb5c9640 1 Processor -- start 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.250+0000 7efecb5c9640 1 -- start start 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.250+0000 7efecb5c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec41008b0 0x7efec419dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.250+0000 7efecb5c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efec41011d0 0x7efec419e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.250+0000 7efecb5c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efec41153d0 con 0x7efec41011d0 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.250+0000 7efecb5c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7efec4115250 con 0x7efec41008b0 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efec8b64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efec41011d0 0x7efec419e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efec8b64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efec41011d0 0x7efec419e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36760/0 (socket says 172.21.15.45:36760) 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efec8b64640 1 -- 172.21.15.45:0/3653455783 learned_addr learned my addr 172.21.15.45:0/3653455783 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efec9365640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec41008b0 0x7efec419dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efec8b64640 1 -- 172.21.15.45:0/3653455783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec41008b0 msgr2=0x7efec419dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efec8b64640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec41008b0 0x7efec419dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efec8b64640 1 -- 172.21.15.45:0/3653455783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec419eba0 con 0x7efec41011d0 2024-09-18T13:03:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efec8b64640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efec41011d0 0x7efec419e4f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efeb4031460 tx=0x7efeb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:10.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efeba7fc640 1 -- 172.21.15.45:0/3653455783 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efeb403f070 con 0x7efec41011d0 2024-09-18T13:03:10.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efeba7fc640 1 -- 172.21.15.45:0/3653455783 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efeb4004ac0 con 0x7efec41011d0 2024-09-18T13:03:10.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efecb5c9640 1 -- 172.21.15.45:0/3653455783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec41a28e0 con 0x7efec41011d0 2024-09-18T13:03:10.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efeba7fc640 1 -- 172.21.15.45:0/3653455783 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efeb4035030 con 0x7efec41011d0 2024-09-18T13:03:10.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.251+0000 7efecb5c9640 1 -- 172.21.15.45:0/3653455783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec41a2e10 con 0x7efec41011d0 2024-09-18T13:03:10.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.252+0000 7efecb5c9640 1 -- 172.21.15.45:0/3653455783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec406aa90 con 0x7efec41011d0 2024-09-18T13:03:10.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.253+0000 7efeba7fc640 1 -- 172.21.15.45:0/3653455783 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7efeb4042070 con 0x7efec41011d0 2024-09-18T13:03:10.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.253+0000 7efeba7fc640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efeb007af30 0x7efeb007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:10.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.254+0000 7efeba7fc640 1 -- 172.21.15.45:0/3653455783 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7efeb40be9e0 con 0x7efec41011d0 2024-09-18T13:03:10.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.254+0000 7efec9365640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efeb007af30 0x7efeb007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:10.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.254+0000 7efec9365640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efeb007af30 0x7efeb007d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efec000abe0 tx=0x7efec000a2d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:10.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.258+0000 7efeba7fc640 1 -- 172.21.15.45:0/3653455783 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7efeb4089f80 con 0x7efec41011d0 2024-09-18T13:03:10.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.451+0000 7efecb5c9640 1 -- 172.21.15.45:0/3653455783 --> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7efec41a3180 con 0x7efeb007af30 2024-09-18T13:03:10.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.461+0000 7efeba7fc640 1 -- 172.21.15.45:0/3653455783 <== mgr.14774 v2:172.21.15.45:6800/3507386160 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7efec41a3180 con 0x7efeb007af30 2024-09-18T13:03:10.462 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T13:03:10.462 INFO:teuthology.orchestra.run.smithi045.stdout:alertmanager.smithi045 smithi045 *:9093,9094 running (8m) 97s ago 19m 20.1M - 0.27.0 11f11916f8cd 7ed6994be130 2024-09-18T13:03:10.462 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi045 smithi045 running (107s) 97s ago 19m 8262k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 41121987edca 2024-09-18T13:03:10.462 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-exporter.smithi161 smithi161 running (102s) 99s ago 18m 7285k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f67d338561b9 2024-09-18T13:03:10.462 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi045 smithi045 running (6m) 97s ago 19m 6899k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d806e1a2d859 2024-09-18T13:03:10.462 INFO:teuthology.orchestra.run.smithi045.stdout:crash.smithi161 smithi161 running (6m) 99s ago 18m 6891k - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 47bf7b8e9f59 2024-09-18T13:03:10.462 INFO:teuthology.orchestra.run.smithi045.stdout:grafana.smithi045 smithi045 *:3000 running (7m) 97s ago 18m 78.1M - 10.4.0 c8b91775d855 8e9b9a7074d9 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.favmzs smithi045 running (2m) 97s ago 13m 85.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 9bf29d5aa6b6 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi045.gzqgyu smithi045 running (2m) 97s ago 13m 87.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e7c39085fb8d 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.maxdew smithi161 running (2m) 99s ago 13m 13.9M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c446bf8facb6 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:mds.cephfs.smithi161.xoxpyp smithi161 running (2m) 99s ago 13m 16.2M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 f511abca950f 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi045.brvbvl smithi045 *:8443,9283,8765 running (10m) 97s ago 20m 529M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e76b3ea57fc4 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.smithi161.yoflkm smithi161 *:8443,9283,8765 running (9m) 99s ago 18m 459M - 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 c99712e66322 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi045 smithi045 running (7m) 97s ago 20m 53.6M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 d134d17dcc99 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:mon.smithi161 smithi161 running (6m) 99s ago 18m 43.3M 2048M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 e25ec626c055 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi045 smithi045 *:9100 running (9m) 97s ago 19m 11.6M - 1.7.0 72c9c2088986 851d9b923b66 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:node-exporter.smithi161 smithi161 *:9100 running (8m) 99s ago 18m 11.1M - 1.7.0 72c9c2088986 1fe618efb91b 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (6m) 97s ago 17m 94.2M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 33c596ec6ae7 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi045 running (5m) 97s ago 16m 104M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 7d4cd0351725 2024-09-18T13:03:10.463 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi045 running (4m) 97s ago 16m 89.6M 1217M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 4f620cf3977f 2024-09-18T13:03:10.464 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi161 running (4m) 99s ago 15m 110M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 1fbe6c224b87 2024-09-18T13:03:10.464 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi161 running (3m) 99s ago 15m 93.5M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 b3c49339a90c 2024-09-18T13:03:10.464 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi161 running (3m) 99s ago 14m 88.2M 2240M 19.3.0-4983-ge7fb7b56 b22e1e37ddf1 035aa0efadd6 2024-09-18T13:03:10.464 INFO:teuthology.orchestra.run.smithi045.stdout:prometheus.smithi045 smithi045 *:9095 running (8m) 97s ago 18m 54.2M - 2.51.0 1d3b7f56885b bc772c5a610d 2024-09-18T13:03:10.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.463+0000 7efecb5c9640 1 -- 172.21.15.45:0/3653455783 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efeb007af30 msgr2=0x7efeb007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:10.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.463+0000 7efecb5c9640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efeb007af30 0x7efeb007d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efec000abe0 tx=0x7efec000a2d0 comp rx=0 tx=0).stop 2024-09-18T13:03:10.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.463+0000 7efecb5c9640 1 -- 172.21.15.45:0/3653455783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efec41011d0 msgr2=0x7efec419e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:10.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.463+0000 7efecb5c9640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efec41011d0 0x7efec419e4f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efeb4031460 tx=0x7efeb40046c0 comp rx=0 tx=0).stop 2024-09-18T13:03:10.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.464+0000 7efecb5c9640 1 -- 172.21.15.45:0/3653455783 shutdown_connections 2024-09-18T13:03:10.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.464+0000 7efecb5c9640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efeb007af30 0x7efeb007d3f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:10.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.464+0000 7efecb5c9640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efec41011d0 0x7efec419e4f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:10.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.464+0000 7efecb5c9640 1 --2- 172.21.15.45:0/3653455783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efec41008b0 0x7efec419dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:10.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.464+0000 7efecb5c9640 1 -- 172.21.15.45:0/3653455783 >> 172.21.15.45:0/3653455783 conn(0x7efec40fc520 msgr2=0x7efec4112c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:10.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.464+0000 7efecb5c9640 1 -- 172.21.15.45:0/3653455783 shutdown_connections 2024-09-18T13:03:10.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:10.464+0000 7efecb5c9640 1 -- 172.21.15.45:0/3653455783 wait complete. 2024-09-18T13:03:11.116 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions' 2024-09-18T13:03:11.386 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:11.753 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:11 smithi045 ceph-mon[109129]: pgmap v347: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:11.754 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:11 smithi045 ceph-mon[109129]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:11 smithi161 ceph-mon[80292]: pgmap v347: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:11 smithi161 ceph-mon[80292]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.832+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/1066567326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d08100800 msgr2=0x7f6d08100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.832+0000 7f6d0d2bc640 1 --2- 172.21.15.45:0/1066567326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d08100800 0x7f6d08100c60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009880 tx=0x7f6cfc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.832+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/1066567326 shutdown_connections 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.832+0000 7f6d0d2bc640 1 --2- 172.21.15.45:0/1066567326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d08100800 0x7f6d08100c60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.832+0000 7f6d0d2bc640 1 --2- 172.21.15.45:0/1066567326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d08106800 0x7f6d08106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.832+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/1066567326 >> 172.21.15.45:0/1066567326 conn(0x7f6d080fc520 msgr2=0x7f6d080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.832+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/1066567326 shutdown_connections 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.832+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/1066567326 wait complete. 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d0d2bc640 1 Processor -- start 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d0d2bc640 1 -- start start 2024-09-18T13:03:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d0d2bc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d08100800 0x7f6d0819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d0d2bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d08106800 0x7f6d0819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d0d2bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0810dcb0 con 0x7f6d08106800 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d0d2bc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0810db30 con 0x7f6d08100800 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d067fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d08106800 0x7f6d0819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d067fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d08106800 0x7f6d0819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36776/0 (socket says 172.21.15.45:36776) 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d067fc640 1 -- 172.21.15.45:0/2130731887 learned_addr learned my addr 172.21.15.45:0/2130731887 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d06ffd640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d08100800 0x7f6d0819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d067fc640 1 -- 172.21.15.45:0/2130731887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d08100800 msgr2=0x7f6d0819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d067fc640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d08100800 0x7f6d0819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d067fc640 1 -- 172.21.15.45:0/2130731887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d081977f0 con 0x7f6d08106800 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.833+0000 7f6d06ffd640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d08100800 0x7f6d0819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.834+0000 7f6d067fc640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d08106800 0x7f6d0819dbb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc031460 tx=0x7f6cfc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.834+0000 7f6ceffff640 1 -- 172.21.15.45:0/2130731887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6cfc03f070 con 0x7f6d08106800 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.834+0000 7f6ceffff640 1 -- 172.21.15.45:0/2130731887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6cfc004cf0 con 0x7f6d08106800 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.834+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/2130731887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d08197a80 con 0x7f6d08106800 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.834+0000 7f6ceffff640 1 -- 172.21.15.45:0/2130731887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6cfc035030 con 0x7f6d08106800 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.834+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/2130731887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d08197fb0 con 0x7f6d08106800 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.835+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/2130731887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d08101f40 con 0x7f6d08106800 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.836+0000 7f6ceffff640 1 -- 172.21.15.45:0/2130731887 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f6cfc042070 con 0x7f6d08106800 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.836+0000 7f6ceffff640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cf007af30 0x7f6cf007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.836+0000 7f6ceffff640 1 -- 172.21.15.45:0/2130731887 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f6cfc0beb20 con 0x7f6d08106800 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.836+0000 7f6d06ffd640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cf007af30 0x7f6cf007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.837+0000 7f6d06ffd640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cf007af30 0x7f6cf007d3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800baa0 tx=0x7f6cf8005d90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:11.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:11.840+0000 7f6ceffff640 1 -- 172.21.15.45:0/2130731887 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6cfc08a0c0 con 0x7f6d08106800 2024-09-18T13:03:12.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.101+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/2130731887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6d08198d50 con 0x7f6d08106800 2024-09-18T13:03:12.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.101+0000 7f6ceffff640 1 -- 172.21.15.45:0/2130731887 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f6d08198d50 con 0x7f6d08106800 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": { 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": { 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 2 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": { 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 6 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:03:12.103 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-18T13:03:12.104 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 4 2024-09-18T13:03:12.104 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-18T13:03:12.104 INFO:teuthology.orchestra.run.smithi045.stdout: "overall": { 2024-09-18T13:03:12.104 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)": 14 2024-09-18T13:03:12.104 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-18T13:03:12.104 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-18T13:03:12.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/2130731887 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cf007af30 msgr2=0x7f6cf007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:12.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cf007af30 0x7f6cf007d3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800baa0 tx=0x7f6cf8005d90 comp rx=0 tx=0).stop 2024-09-18T13:03:12.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/2130731887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d08106800 msgr2=0x7f6d0819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:12.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d08106800 0x7f6d0819dbb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc031460 tx=0x7f6cfc0048f0 comp rx=0 tx=0).stop 2024-09-18T13:03:12.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/2130731887 shutdown_connections 2024-09-18T13:03:12.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6cf007af30 0x7f6cf007d3f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:12.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d08106800 0x7f6d0819dbb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:12.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 --2- 172.21.15.45:0/2130731887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d08100800 0x7f6d0819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:12.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/2130731887 >> 172.21.15.45:0/2130731887 conn(0x7f6d080fc520 msgr2=0x7f6d0806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:12.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/2130731887 shutdown_connections 2024-09-18T13:03:12.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:12.104+0000 7f6d0d2bc640 1 -- 172.21.15.45:0/2130731887 wait complete. 2024-09-18T13:03:12.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:12 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2130731887' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:12.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:12 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2130731887' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:12.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-18T13:03:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:13.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.465+0000 7f44da621640 1 -- 172.21.15.45:0/2047828748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d4100800 msgr2=0x7f44d4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.465+0000 7f44da621640 1 --2- 172.21.15.45:0/2047828748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d4100800 0x7f44d4100c60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009880 tx=0x7f44c802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.465+0000 7f44da621640 1 -- 172.21.15.45:0/2047828748 shutdown_connections 2024-09-18T13:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.465+0000 7f44da621640 1 --2- 172.21.15.45:0/2047828748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d4100800 0x7f44d4100c60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.465+0000 7f44da621640 1 --2- 172.21.15.45:0/2047828748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44d4106800 0x7f44d4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.465+0000 7f44da621640 1 -- 172.21.15.45:0/2047828748 >> 172.21.15.45:0/2047828748 conn(0x7f44d40fc520 msgr2=0x7f44d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.465+0000 7f44da621640 1 -- 172.21.15.45:0/2047828748 shutdown_connections 2024-09-18T13:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.465+0000 7f44da621640 1 -- 172.21.15.45:0/2047828748 wait complete. 2024-09-18T13:03:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.466+0000 7f44da621640 1 Processor -- start 2024-09-18T13:03:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.466+0000 7f44da621640 1 -- start start 2024-09-18T13:03:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.466+0000 7f44da621640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d4100800 0x7f44d419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.466+0000 7f44da621640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44d4106800 0x7f44d419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.466+0000 7f44da621640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44d410dcb0 con 0x7f44d4100800 2024-09-18T13:03:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.466+0000 7f44da621640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f44d410db30 con 0x7f44d4106800 2024-09-18T13:03:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.466+0000 7f44d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d4100800 0x7f44d419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.466+0000 7f44d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d4100800 0x7f44d419f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56118/0 (socket says 172.21.15.45:56118) 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.466+0000 7f44d3fff640 1 -- 172.21.15.45:0/1430171594 learned_addr learned my addr 172.21.15.45:0/1430171594 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44d37fe640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44d4106800 0x7f44d419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44d3fff640 1 -- 172.21.15.45:0/1430171594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44d4106800 msgr2=0x7f44d419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44d3fff640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44d4106800 0x7f44d419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44d3fff640 1 -- 172.21.15.45:0/1430171594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d41a03f0 con 0x7f44d4100800 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44d37fe640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44d4106800 0x7f44d419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44d3fff640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d4100800 0x7f44d419f800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c8a0 tx=0x7f44c400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44d17fa640 1 -- 172.21.15.45:0/1430171594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44c40079b0 con 0x7f44d4100800 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44d17fa640 1 -- 172.21.15.45:0/1430171594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f44c4007b50 con 0x7f44d4100800 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44da621640 1 -- 172.21.15.45:0/1430171594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d4199ae0 con 0x7f44d4100800 2024-09-18T13:03:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44d17fa640 1 -- 172.21.15.45:0/1430171594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44c4018700 con 0x7f44d4100800 2024-09-18T13:03:13.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.467+0000 7f44da621640 1 -- 172.21.15.45:0/1430171594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d419a040 con 0x7f44d4100800 2024-09-18T13:03:13.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.468+0000 7f44da621640 1 -- 172.21.15.45:0/1430171594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d4101f40 con 0x7f44d4100800 2024-09-18T13:03:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.469+0000 7f44d17fa640 1 -- 172.21.15.45:0/1430171594 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f44c4007d00 con 0x7f44d4100800 2024-09-18T13:03:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.469+0000 7f44d17fa640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f44bc07af30 0x7f44bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.469+0000 7f44d17fa640 1 -- 172.21.15.45:0/1430171594 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f44c409e410 con 0x7f44d4100800 2024-09-18T13:03:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.470+0000 7f44d37fe640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f44bc07af30 0x7f44bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.470+0000 7f44d37fe640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f44bc07af30 0x7f44bc07d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44d419b1b0 tx=0x7f44c8009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.474+0000 7f44d17fa640 1 -- 172.21.15.45:0/1430171594 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f44c4014030 con 0x7f44d4100800 2024-09-18T13:03:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.732+0000 7f44da621640 1 -- 172.21.15.45:0/1430171594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f44d419a320 con 0x7f44d4100800 2024-09-18T13:03:13.734 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:13 smithi045 ceph-mon[109129]: pgmap v348: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:13.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.733+0000 7f44d17fa640 1 -- 172.21.15.45:0/1430171594 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f44c4069910 con 0x7f44d4100800 2024-09-18T13:03:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 -- 172.21.15.45:0/1430171594 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f44bc07af30 msgr2=0x7f44bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f44bc07af30 0x7f44bc07d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44d419b1b0 tx=0x7f44c8009560 comp rx=0 tx=0).stop 2024-09-18T13:03:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 -- 172.21.15.45:0/1430171594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d4100800 msgr2=0x7f44d419f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d4100800 0x7f44d419f800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c8a0 tx=0x7f44c400cd60 comp rx=0 tx=0).stop 2024-09-18T13:03:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 -- 172.21.15.45:0/1430171594 shutdown_connections 2024-09-18T13:03:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f44bc07af30 0x7f44bc07d3f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44d4106800 0x7f44d419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 --2- 172.21.15.45:0/1430171594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d4100800 0x7f44d419f800 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 -- 172.21.15.45:0/1430171594 >> 172.21.15.45:0/1430171594 conn(0x7f44d40fc520 msgr2=0x7f44d40fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 -- 172.21.15.45:0/1430171594 shutdown_connections 2024-09-18T13:03:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:13.735+0000 7f44da621640 1 -- 172.21.15.45:0/1430171594 wait complete. 2024-09-18T13:03:13.745 INFO:teuthology.orchestra.run.smithi045.stdout:true 2024-09-18T13:03:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:13 smithi161 ceph-mon[80292]: pgmap v348: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:14.257 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -e sha1=e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-18T13:03:14.518 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:14.767 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:14 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1430171594' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:14.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:14 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1430171594' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:14.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.929+0000 7f3ba7628640 1 -- 172.21.15.45:0/2900080478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba0107900 msgr2=0x7f3ba0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:14.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.929+0000 7f3ba7628640 1 --2- 172.21.15.45:0/2900080478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba0107900 0x7f3ba0107ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009880 tx=0x7f3b9c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.929+0000 7f3ba7628640 1 -- 172.21.15.45:0/2900080478 shutdown_connections 2024-09-18T13:03:14.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.929+0000 7f3ba7628640 1 --2- 172.21.15.45:0/2900080478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ba0101900 0x7f3ba0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.929+0000 7f3ba7628640 1 --2- 172.21.15.45:0/2900080478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba0107900 0x7f3ba0107ce0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.929+0000 7f3ba7628640 1 -- 172.21.15.45:0/2900080478 >> 172.21.15.45:0/2900080478 conn(0x7f3ba00fd600 msgr2=0x7f3ba00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.929+0000 7f3ba7628640 1 -- 172.21.15.45:0/2900080478 shutdown_connections 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.929+0000 7f3ba7628640 1 -- 172.21.15.45:0/2900080478 wait complete. 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.930+0000 7f3ba7628640 1 Processor -- start 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.930+0000 7f3ba7628640 1 -- start start 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.930+0000 7f3ba7628640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ba0101900 0x7f3ba019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.930+0000 7f3ba7628640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba0107900 0x7f3ba019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.930+0000 7f3ba7628640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba010edd0 con 0x7f3ba0107900 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.930+0000 7f3ba7628640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba010ec50 con 0x7f3ba0101900 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.930+0000 7f3ba4bc3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba0107900 0x7f3ba019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.930+0000 7f3ba4bc3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba0107900 0x7f3ba019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56140/0 (socket says 172.21.15.45:56140) 2024-09-18T13:03:14.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.930+0000 7f3ba4bc3640 1 -- 172.21.15.45:0/1415315053 learned_addr learned my addr 172.21.15.45:0/1415315053 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.930+0000 7f3ba53c4640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ba0101900 0x7f3ba019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.931+0000 7f3ba4bc3640 1 -- 172.21.15.45:0/1415315053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ba0101900 msgr2=0x7f3ba019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.931+0000 7f3ba4bc3640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ba0101900 0x7f3ba019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.931+0000 7f3ba4bc3640 1 -- 172.21.15.45:0/1415315053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba01977a0 con 0x7f3ba0107900 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.931+0000 7f3ba53c4640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ba0101900 0x7f3ba019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.931+0000 7f3ba4bc3640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba0107900 0x7f3ba019db60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000d6f0 tx=0x7f3b9000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.931+0000 7f3b967fc640 1 -- 172.21.15.45:0/1415315053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b90017070 con 0x7f3ba0107900 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.931+0000 7f3b967fc640 1 -- 172.21.15.45:0/1415315053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b9000de00 con 0x7f3ba0107900 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.931+0000 7f3ba7628640 1 -- 172.21.15.45:0/1415315053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba0197a90 con 0x7f3ba0107900 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.931+0000 7f3b967fc640 1 -- 172.21.15.45:0/1415315053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b90004bb0 con 0x7f3ba0107900 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.931+0000 7f3ba7628640 1 -- 172.21.15.45:0/1415315053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba0198020 con 0x7f3ba0107900 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.932+0000 7f3ba7628640 1 -- 172.21.15.45:0/1415315053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba0103040 con 0x7f3ba0107900 2024-09-18T13:03:14.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.933+0000 7f3b967fc640 1 -- 172.21.15.45:0/1415315053 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f3b90004e60 con 0x7f3ba0107900 2024-09-18T13:03:14.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.933+0000 7f3b967fc640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3b8c07af30 0x7f3b8c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:14.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.933+0000 7f3b967fc640 1 -- 172.21.15.45:0/1415315053 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f3b9009dcb0 con 0x7f3ba0107900 2024-09-18T13:03:14.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.933+0000 7f3ba53c4640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3b8c07af30 0x7f3b8c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:14.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.934+0000 7f3ba53c4640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3b8c07af30 0x7f3b8c07d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c006010 tx=0x7f3b9c0095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:14.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:14.938+0000 7f3b967fc640 1 -- 172.21.15.45:0/1415315053 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3b90069250 con 0x7f3ba0107900 2024-09-18T13:03:15.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.202+0000 7f3ba7628640 1 -- 172.21.15.45:0/1415315053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3ba0109e70 con 0x7f3ba0107900 2024-09-18T13:03:15.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.202+0000 7f3b967fc640 1 -- 172.21.15.45:0/1415315053 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3b9006e100 con 0x7f3ba0107900 2024-09-18T13:03:15.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 -- 172.21.15.45:0/1415315053 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3b8c07af30 msgr2=0x7f3b8c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:15.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3b8c07af30 0x7f3b8c07d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c006010 tx=0x7f3b9c0095f0 comp rx=0 tx=0).stop 2024-09-18T13:03:15.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 -- 172.21.15.45:0/1415315053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba0107900 msgr2=0x7f3ba019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:15.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba0107900 0x7f3ba019db60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000d6f0 tx=0x7f3b9000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:03:15.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 -- 172.21.15.45:0/1415315053 shutdown_connections 2024-09-18T13:03:15.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3b8c07af30 0x7f3b8c07d3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:15.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba0107900 0x7f3ba019db60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:15.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 --2- 172.21.15.45:0/1415315053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ba0101900 0x7f3ba019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:15.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 -- 172.21.15.45:0/1415315053 >> 172.21.15.45:0/1415315053 conn(0x7f3ba00fd600 msgr2=0x7f3ba00fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:15.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 -- 172.21.15.45:0/1415315053 shutdown_connections 2024-09-18T13:03:15.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:15.205+0000 7f3ba7628640 1 -- 172.21.15.45:0/1415315053 wait complete. 2024-09-18T13:03:15.214 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph version 19.3.0-4983-ge7fb7b56 (e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e) squid (dev)" 2024-09-18T13:03:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:15 smithi045 ceph-mon[109129]: pgmap v349: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:15 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1415315053' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:15 smithi161 ceph-mon[80292]: pgmap v349: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:15 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1415315053' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-18T13:03:15.885 DEBUG:teuthology.parallel:result is None 2024-09-18T13:03:15.885 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T13:03:15.896 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T13:03:15.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T13:03:16.157 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:16.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.673+0000 7f448d51e640 1 -- 172.21.15.45:0/3478883300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4488102ab0 msgr2=0x7f4488102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:16.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.673+0000 7f448d51e640 1 --2- 172.21.15.45:0/3478883300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4488102ab0 0x7f4488102e90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4478009c20 tx=0x7f447802aa00 comp rx=0 tx=0).stop 2024-09-18T13:03:16.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.673+0000 7f448d51e640 1 -- 172.21.15.45:0/3478883300 shutdown_connections 2024-09-18T13:03:16.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.673+0000 7f448d51e640 1 --2- 172.21.15.45:0/3478883300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44881033d0 0x7f448810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:16.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.673+0000 7f448d51e640 1 --2- 172.21.15.45:0/3478883300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4488102ab0 0x7f4488102e90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:16.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.673+0000 7f448d51e640 1 -- 172.21.15.45:0/3478883300 >> 172.21.15.45:0/3478883300 conn(0x7f44880fc550 msgr2=0x7f44880fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:16.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.673+0000 7f448d51e640 1 -- 172.21.15.45:0/3478883300 shutdown_connections 2024-09-18T13:03:16.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.673+0000 7f448d51e640 1 -- 172.21.15.45:0/3478883300 wait complete. 2024-09-18T13:03:16.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.673+0000 7f448d51e640 1 Processor -- start 2024-09-18T13:03:16.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f448d51e640 1 -- start start 2024-09-18T13:03:16.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f448d51e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4488102ab0 0x7f448819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:16.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f448d51e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881033d0 0x7f448819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f448d51e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f448810ede0 con 0x7f44881033d0 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f448d51e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f448810ec60 con 0x7f4488102ab0 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f44867fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881033d0 0x7f448819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f44867fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881033d0 0x7f448819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56170/0 (socket says 172.21.15.45:56170) 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f44867fc640 1 -- 172.21.15.45:0/906300403 learned_addr learned my addr 172.21.15.45:0/906300403 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f4486ffd640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4488102ab0 0x7f448819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f44867fc640 1 -- 172.21.15.45:0/906300403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4488102ab0 msgr2=0x7f448819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f44867fc640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4488102ab0 0x7f448819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.674+0000 7f44867fc640 1 -- 172.21.15.45:0/906300403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44881977b0 con 0x7f44881033d0 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.675+0000 7f44867fc640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881033d0 0x7f448819db70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f447c00d6d0 tx=0x7f447c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.675+0000 7f446ffff640 1 -- 172.21.15.45:0/906300403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f447c017070 con 0x7f44881033d0 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.675+0000 7f448d51e640 1 -- 172.21.15.45:0/906300403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4488197aa0 con 0x7f44881033d0 2024-09-18T13:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.675+0000 7f446ffff640 1 -- 172.21.15.45:0/906300403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f447c0054e0 con 0x7f44881033d0 2024-09-18T13:03:16.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.675+0000 7f446ffff640 1 -- 172.21.15.45:0/906300403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f447c004ae0 con 0x7f44881033d0 2024-09-18T13:03:16.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.675+0000 7f448d51e640 1 -- 172.21.15.45:0/906300403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4488198030 con 0x7f44881033d0 2024-09-18T13:03:16.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.676+0000 7f448d51e640 1 -- 172.21.15.45:0/906300403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448806a580 con 0x7f44881033d0 2024-09-18T13:03:16.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.677+0000 7f446ffff640 1 -- 172.21.15.45:0/906300403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f447c004de0 con 0x7f44881033d0 2024-09-18T13:03:16.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.677+0000 7f446ffff640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f447007af40 0x7f447007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:16.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.677+0000 7f446ffff640 1 -- 172.21.15.45:0/906300403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f447c09dc50 con 0x7f44881033d0 2024-09-18T13:03:16.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.677+0000 7f4486ffd640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f447007af40 0x7f447007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:16.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.678+0000 7f4486ffd640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f447007af40 0x7f447007d400 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4478000f80 tx=0x7f447803a040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:16.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.681+0000 7f446ffff640 1 -- 172.21.15.45:0/906300403 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f447c0691f0 con 0x7f44881033d0 2024-09-18T13:03:16.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.908+0000 7f448d51e640 1 -- 172.21.15.45:0/906300403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f44881982e0 con 0x7f44881033d0 2024-09-18T13:03:16.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.908+0000 7f446ffff640 1 -- 172.21.15.45:0/906300403 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) ==== 76+0+2044 (secure 0 0 0) 0x7f447c06e0a0 con 0x7f44881033d0 2024-09-18T13:03:16.910 INFO:teuthology.orchestra.run.smithi045.stdout:e37 2024-09-18T13:03:16.910 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-18T13:01:37:707383+0000 2024-09-18T13:03:16.910 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T13:03:16.910 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:03:16.910 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-18T13:03:16.910 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:16.910 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-18T13:03:16.910 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-18T13:03:16.910 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 37 2024-09-18T13:03:16.910 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-18T12:49:15.435246+0000 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-18T13:01:36.799383+0000 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 60 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 81 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T13:03:16.911 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=34318} 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3] 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data enabled 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-18T13:03:16.912 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 1 2024-09-18T13:03:16.913 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 34318 members: 34318 2024-09-18T13:03:16.913 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.gzqgyu{0:34318} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.45:6826/138858473,v1:172.21.15.45:6827/138858473] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:16.913 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi045.favmzs{0:34350} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.45:6828/3858768927,v1:172.21.15.45:6829/3858768927] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:16.913 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-18T13:03:16.913 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:16.913 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.xoxpyp{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1172047502,v1:172.21.15.161:6825/1172047502] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:16.913 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.cephfs.smithi161.maxdew{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/781506559,v1:172.21.15.161:6827/781506559] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T13:03:16.914 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 37 2024-09-18T13:03:16.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.911+0000 7f448d51e640 1 -- 172.21.15.45:0/906300403 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f447007af40 msgr2=0x7f447007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:16.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.911+0000 7f448d51e640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f447007af40 0x7f447007d400 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4478000f80 tx=0x7f447803a040 comp rx=0 tx=0).stop 2024-09-18T13:03:16.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.911+0000 7f448d51e640 1 -- 172.21.15.45:0/906300403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881033d0 msgr2=0x7f448819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:16.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.911+0000 7f448d51e640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881033d0 0x7f448819db70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f447c00d6d0 tx=0x7f447c00db90 comp rx=0 tx=0).stop 2024-09-18T13:03:16.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.911+0000 7f448d51e640 1 -- 172.21.15.45:0/906300403 shutdown_connections 2024-09-18T13:03:16.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.911+0000 7f448d51e640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f447007af40 0x7f447007d400 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:16.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.911+0000 7f448d51e640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44881033d0 0x7f448819db70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:16.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.911+0000 7f448d51e640 1 --2- 172.21.15.45:0/906300403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4488102ab0 0x7f448819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:16.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.911+0000 7f448d51e640 1 -- 172.21.15.45:0/906300403 >> 172.21.15.45:0/906300403 conn(0x7f44880fc550 msgr2=0x7f448810aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:16.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.912+0000 7f448d51e640 1 -- 172.21.15.45:0/906300403 shutdown_connections 2024-09-18T13:03:16.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:16.912+0000 7f448d51e640 1 -- 172.21.15.45:0/906300403 wait complete. 2024-09-18T13:03:17.519 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-18T13:03:17.530 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-18T13:03:17.555 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:17 smithi045 ceph-mon[109129]: pgmap v350: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:17.555 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:17 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/906300403' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:03:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:17 smithi161 ceph-mon[80292]: pgmap v350: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:17 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/906300403' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-18T13:03:17.793 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:18.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.205+0000 7f1baa03c640 1 -- 172.21.15.45:0/1197734546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba4101900 msgr2=0x7f1ba4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:18.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.205+0000 7f1baa03c640 1 --2- 172.21.15.45:0/1197734546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba4101900 0x7f1ba4101d60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c009880 tx=0x7f1b8c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:18.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.205+0000 7f1baa03c640 1 -- 172.21.15.45:0/1197734546 shutdown_connections 2024-09-18T13:03:18.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.205+0000 7f1baa03c640 1 --2- 172.21.15.45:0/1197734546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba4101900 0x7f1ba4101d60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:18.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.205+0000 7f1baa03c640 1 --2- 172.21.15.45:0/1197734546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba4107900 0x7f1ba4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:18.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.205+0000 7f1baa03c640 1 -- 172.21.15.45:0/1197734546 >> 172.21.15.45:0/1197734546 conn(0x7f1ba40fd600 msgr2=0x7f1ba40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:18.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.205+0000 7f1baa03c640 1 -- 172.21.15.45:0/1197734546 shutdown_connections 2024-09-18T13:03:18.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.205+0000 7f1baa03c640 1 -- 172.21.15.45:0/1197734546 wait complete. 2024-09-18T13:03:18.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.205+0000 7f1baa03c640 1 Processor -- start 2024-09-18T13:03:18.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1baa03c640 1 -- start start 2024-09-18T13:03:18.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1baa03c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba4101900 0x7f1ba419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1baa03c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba4107900 0x7f1ba419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1baa03c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba410edd0 con 0x7f1ba4107900 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1baa03c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba410ec50 con 0x7f1ba4101900 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1ba2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba4107900 0x7f1ba419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1ba2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba4107900 0x7f1ba419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56190/0 (socket says 172.21.15.45:56190) 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1ba2ffd640 1 -- 172.21.15.45:0/3675595782 learned_addr learned my addr 172.21.15.45:0/3675595782 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1ba37fe640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba4101900 0x7f1ba419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1ba2ffd640 1 -- 172.21.15.45:0/3675595782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba4101900 msgr2=0x7f1ba419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1ba2ffd640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba4101900 0x7f1ba419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1ba2ffd640 1 -- 172.21.15.45:0/3675595782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba41977c0 con 0x7f1ba4107900 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.206+0000 7f1ba2ffd640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba4107900 0x7f1ba419db80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c031460 tx=0x7f1b8c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.207+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/3675595782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b8c03f070 con 0x7f1ba4107900 2024-09-18T13:03:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.207+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/3675595782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b8c004cf0 con 0x7f1ba4107900 2024-09-18T13:03:18.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.207+0000 7f1baa03c640 1 -- 172.21.15.45:0/3675595782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba4197a50 con 0x7f1ba4107900 2024-09-18T13:03:18.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.207+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/3675595782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b8c035030 con 0x7f1ba4107900 2024-09-18T13:03:18.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.207+0000 7f1baa03c640 1 -- 172.21.15.45:0/3675595782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba4197f80 con 0x7f1ba4107900 2024-09-18T13:03:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.208+0000 7f1baa03c640 1 -- 172.21.15.45:0/3675595782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba4103040 con 0x7f1ba4107900 2024-09-18T13:03:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.208+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/3675595782 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f1b8c042070 con 0x7f1ba4107900 2024-09-18T13:03:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.209+0000 7f1ba0ff9640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1b9007af30 0x7f1b9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.209+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/3675595782 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f1b8c0beb20 con 0x7f1ba4107900 2024-09-18T13:03:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.209+0000 7f1ba37fe640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1b9007af30 0x7f1b9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.210+0000 7f1ba37fe640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1b9007af30 0x7f1b9007d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005c40 tx=0x7f1b9400a390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.213+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/3675595782 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1b8c08a0c0 con 0x7f1ba4107900 2024-09-18T13:03:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.436+0000 7f1baa03c640 1 -- 172.21.15.45:0/3675595782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ba4109e70 con 0x7f1ba4107900 2024-09-18T13:03:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.437+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/3675595782 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5325 (secure 0 0 0) 0x7f1b8c08ef70 con 0x7f1ba4107900 2024-09-18T13:03:18.438 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:18.439 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"btime":"2024-09-18T13:01:37:707383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/781506559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":781506559},{"type":"v1","addr":"172.21.15.161:6827","nonce":781506559}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:01:36.799383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34318":{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34350":{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34318,"qdb_cluster":[34318]},"id":1}]} 2024-09-18T13:03:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 37 2024-09-18T13:03:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 -- 172.21.15.45:0/3675595782 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1b9007af30 msgr2=0x7f1b9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1b9007af30 0x7f1b9007d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005c40 tx=0x7f1b9400a390 comp rx=0 tx=0).stop 2024-09-18T13:03:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 -- 172.21.15.45:0/3675595782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba4107900 msgr2=0x7f1ba419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba4107900 0x7f1ba419db80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c031460 tx=0x7f1b8c0048f0 comp rx=0 tx=0).stop 2024-09-18T13:03:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 -- 172.21.15.45:0/3675595782 shutdown_connections 2024-09-18T13:03:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f1b9007af30 0x7f1b9007d3f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba4107900 0x7f1ba419db80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 --2- 172.21.15.45:0/3675595782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba4101900 0x7f1ba419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 -- 172.21.15.45:0/3675595782 >> 172.21.15.45:0/3675595782 conn(0x7f1ba40fd600 msgr2=0x7f1ba40fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 -- 172.21.15.45:0/3675595782 shutdown_connections 2024-09-18T13:03:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:18.439+0000 7f1baa03c640 1 -- 172.21.15.45:0/3675595782 wait complete. 2024-09-18T13:03:18.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:18 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3675595782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-18T13:03:18.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:18 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3675595782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-18T13:03:19.008 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 50} 2024-09-18T13:03:19.008 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 15 2024-09-18T13:03:19.308 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:19.740 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:19 smithi045 ceph-mon[109129]: pgmap v351: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:19 smithi161 ceph-mon[80292]: pgmap v351: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:19.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.822+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/443172911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee4101900 msgr2=0x7fbee4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:19.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.822+0000 7fbeeb1a8640 1 --2- 172.21.15.45:0/443172911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee4101900 0x7fbee4101d60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009880 tx=0x7fbed002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:19.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.822+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/443172911 shutdown_connections 2024-09-18T13:03:19.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.822+0000 7fbeeb1a8640 1 --2- 172.21.15.45:0/443172911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee4101900 0x7fbee4101d60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:19.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.822+0000 7fbeeb1a8640 1 --2- 172.21.15.45:0/443172911 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee4107900 0x7fbee4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.822+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/443172911 >> 172.21.15.45:0/443172911 conn(0x7fbee40fd600 msgr2=0x7fbee40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.822+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/443172911 shutdown_connections 2024-09-18T13:03:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.822+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/443172911 wait complete. 2024-09-18T13:03:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.823+0000 7fbeeb1a8640 1 Processor -- start 2024-09-18T13:03:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.823+0000 7fbeeb1a8640 1 -- start start 2024-09-18T13:03:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbeeb1a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee4101900 0x7fbee419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbeeb1a8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee4107900 0x7fbee419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbeeb1a8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbee410edd0 con 0x7fbee4101900 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbeeb1a8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fbee410ec50 con 0x7fbee4107900 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbee8f44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee4101900 0x7fbee419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbee8f44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee4101900 0x7fbee419d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56200/0 (socket says 172.21.15.45:56200) 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbee8f44640 1 -- 172.21.15.45:0/1343876541 learned_addr learned my addr 172.21.15.45:0/1343876541 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbee3fff640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee4107900 0x7fbee419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbee8f44640 1 -- 172.21.15.45:0/1343876541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee4107900 msgr2=0x7fbee419db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbee8f44640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee4107900 0x7fbee419db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.824+0000 7fbee8f44640 1 -- 172.21.15.45:0/1343876541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee41977a0 con 0x7fbee4101900 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.825+0000 7fbee8f44640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee4101900 0x7fbee419d620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbed800d6f0 tx=0x7fbed800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.825+0000 7fbee1ffb640 1 -- 172.21.15.45:0/1343876541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbed8017070 con 0x7fbee4101900 2024-09-18T13:03:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.825+0000 7fbee1ffb640 1 -- 172.21.15.45:0/1343876541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbed800de00 con 0x7fbee4101900 2024-09-18T13:03:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.825+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/1343876541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee4197a90 con 0x7fbee4101900 2024-09-18T13:03:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.825+0000 7fbee1ffb640 1 -- 172.21.15.45:0/1343876541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbed8004bb0 con 0x7fbee4101900 2024-09-18T13:03:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.825+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/1343876541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee4197ff0 con 0x7fbee4101900 2024-09-18T13:03:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.826+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/1343876541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee4103040 con 0x7fbee4101900 2024-09-18T13:03:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.826+0000 7fbee1ffb640 1 -- 172.21.15.45:0/1343876541 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fbed8009a30 con 0x7fbee4101900 2024-09-18T13:03:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.827+0000 7fbee1ffb640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbed407af30 0x7fbed407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.827+0000 7fbee1ffb640 1 -- 172.21.15.45:0/1343876541 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fbed809dc10 con 0x7fbee4101900 2024-09-18T13:03:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.827+0000 7fbee3fff640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbed407af30 0x7fbed407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.828+0000 7fbee3fff640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbed407af30 0x7fbed407d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbee4198af0 tx=0x7fbed0031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:19.832+0000 7fbee1ffb640 1 -- 172.21.15.45:0/1343876541 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbed80691b0 con 0x7fbee4101900 2024-09-18T13:03:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.052+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/1343876541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) -- 0x7fbee4109e70 con 0x7fbee4101900 2024-09-18T13:03:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.052+0000 7fbee1ffb640 1 -- 172.21.15.45:0/1343876541 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v37) ==== 107+0+5329 (secure 0 0 0) 0x7fbed806e060 con 0x7fbee4101900 2024-09-18T13:03:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:20.054 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"btime":"2024-09-18T12:49:29:964751+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T12:49:28.960615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14566":{"gid":14566,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6827/2456430948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2456430948},{"type":"v1","addr":"172.21.15.45:6827","nonce":2456430948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14580":{"gid":14580,"name":"cephfs.smithi045.favmzs","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.45:6829/1739021663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1739021663},{"type":"v1","addr":"172.21.15.45:6829","nonce":1739021663}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14566,"qdb_cluster":[14566]},"id":1}]} 2024-09-18T13:03:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 15 2024-09-18T13:03:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/1343876541 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbed407af30 msgr2=0x7fbed407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbed407af30 0x7fbed407d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbee4198af0 tx=0x7fbed0031400 comp rx=0 tx=0).stop 2024-09-18T13:03:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/1343876541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee4101900 msgr2=0x7fbee419d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee4101900 0x7fbee419d620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbed800d6f0 tx=0x7fbed800dbb0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/1343876541 shutdown_connections 2024-09-18T13:03:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fbed407af30 0x7fbed407d3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee4107900 0x7fbee419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 --2- 172.21.15.45:0/1343876541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee4101900 0x7fbee419d620 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/1343876541 >> 172.21.15.45:0/1343876541 conn(0x7fbee40fd600 msgr2=0x7fbee40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/1343876541 shutdown_connections 2024-09-18T13:03:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:20.055+0000 7fbeeb1a8640 1 -- 172.21.15.45:0/1343876541 wait complete. 2024-09-18T13:03:20.580 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 16 2024-09-18T13:03:20.603 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:20 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1343876541' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-09-18T13:03:20.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:20 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1343876541' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-09-18T13:03:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:21.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.257+0000 7f3ca96f9640 1 -- 172.21.15.45:0/3581064288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca41007f0 msgr2=0x7f3ca4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:21.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.257+0000 7f3ca96f9640 1 --2- 172.21.15.45:0/3581064288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca41007f0 0x7f3ca4100c50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009880 tx=0x7f3c8c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:21.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.258+0000 7f3ca96f9640 1 -- 172.21.15.45:0/3581064288 shutdown_connections 2024-09-18T13:03:21.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.258+0000 7f3ca96f9640 1 --2- 172.21.15.45:0/3581064288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca41007f0 0x7f3ca4100c50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:21.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.258+0000 7f3ca96f9640 1 --2- 172.21.15.45:0/3581064288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca41067f0 0x7f3ca4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:21.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.258+0000 7f3ca96f9640 1 -- 172.21.15.45:0/3581064288 >> 172.21.15.45:0/3581064288 conn(0x7f3ca40fc550 msgr2=0x7f3ca40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:21.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.258+0000 7f3ca96f9640 1 -- 172.21.15.45:0/3581064288 shutdown_connections 2024-09-18T13:03:21.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.258+0000 7f3ca96f9640 1 -- 172.21.15.45:0/3581064288 wait complete. 2024-09-18T13:03:21.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.258+0000 7f3ca96f9640 1 Processor -- start 2024-09-18T13:03:21.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.258+0000 7f3ca96f9640 1 -- start start 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca96f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca41007f0 0x7f3ca41987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca96f9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca41067f0 0x7f3ca4198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca96f9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca410dca0 con 0x7f3ca41067f0 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca96f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca410db20 con 0x7f3ca41007f0 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca27fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca41067f0 0x7f3ca4198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca27fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca41067f0 0x7f3ca4198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56208/0 (socket says 172.21.15.45:56208) 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca27fc640 1 -- 172.21.15.45:0/4012683356 learned_addr learned my addr 172.21.15.45:0/4012683356 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca2ffd640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca41007f0 0x7f3ca41987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca27fc640 1 -- 172.21.15.45:0/4012683356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca41007f0 msgr2=0x7f3ca41987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca27fc640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca41007f0 0x7f3ca41987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca27fc640 1 -- 172.21.15.45:0/4012683356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca41992f0 con 0x7f3ca41067f0 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca27fc640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca41067f0 0x7f3ca4198cf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c031460 tx=0x7f3c8c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3c9bfff640 1 -- 172.21.15.45:0/4012683356 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c8c03f070 con 0x7f3ca41067f0 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca96f9640 1 -- 172.21.15.45:0/4012683356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca4199580 con 0x7f3ca41067f0 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3c9bfff640 1 -- 172.21.15.45:0/4012683356 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c8c0035f0 con 0x7f3ca41067f0 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3c9bfff640 1 -- 172.21.15.45:0/4012683356 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c8c035030 con 0x7f3ca41067f0 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.259+0000 7f3ca96f9640 1 -- 172.21.15.45:0/4012683356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca41a1b30 con 0x7f3ca41067f0 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.261+0000 7f3ca96f9640 1 -- 172.21.15.45:0/4012683356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca4101f30 con 0x7f3ca41067f0 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.261+0000 7f3c9bfff640 1 -- 172.21.15.45:0/4012683356 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f3c8c042070 con 0x7f3ca41067f0 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.262+0000 7f3c9bfff640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c9007af30 0x7f3c9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.262+0000 7f3c9bfff640 1 -- 172.21.15.45:0/4012683356 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f3c8c0be9d0 con 0x7f3ca41067f0 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.262+0000 7f3ca2ffd640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c9007af30 0x7f3c9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.262+0000 7f3ca2ffd640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c9007af30 0x7f3c9007d3f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005fd0 tx=0x7f3c94009680 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:21.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.266+0000 7f3c9bfff640 1 -- 172.21.15.45:0/4012683356 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3c8c089f70 con 0x7f3ca41067f0 2024-09-18T13:03:21.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.502+0000 7f3ca96f9640 1 -- 172.21.15.45:0/4012683356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) -- 0x7f3ca41a1de0 con 0x7f3ca41067f0 2024-09-18T13:03:21.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.503+0000 7f3c9bfff640 1 -- 172.21.15.45:0/4012683356 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v37) ==== 107+0+5328 (secure 0 0 0) 0x7f3c8c08ee20 con 0x7f3ca41067f0 2024-09-18T13:03:21.504 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:21.504 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"btime":"2024-09-18T12:49:30:966010+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T12:49:28.960615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14566":{"gid":14566,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6827/2456430948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2456430948},{"type":"v1","addr":"172.21.15.45:6827","nonce":2456430948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14580":{"gid":14580,"name":"cephfs.smithi045.favmzs","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.45:6829/1739021663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1739021663},{"type":"v1","addr":"172.21.15.45:6829","nonce":1739021663}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14566,"qdb_cluster":[14566]},"id":1}]} 2024-09-18T13:03:21.504 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2024-09-18T13:03:21.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 -- 172.21.15.45:0/4012683356 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c9007af30 msgr2=0x7f3c9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:21.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c9007af30 0x7f3c9007d3f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005fd0 tx=0x7f3c94009680 comp rx=0 tx=0).stop 2024-09-18T13:03:21.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 -- 172.21.15.45:0/4012683356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca41067f0 msgr2=0x7f3ca4198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:21.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca41067f0 0x7f3ca4198cf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c031460 tx=0x7f3c8c0045e0 comp rx=0 tx=0).stop 2024-09-18T13:03:21.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 -- 172.21.15.45:0/4012683356 shutdown_connections 2024-09-18T13:03:21.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c9007af30 0x7f3c9007d3f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:21.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca41067f0 0x7f3ca4198cf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:21.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 --2- 172.21.15.45:0/4012683356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca41007f0 0x7f3ca41987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:21.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 -- 172.21.15.45:0/4012683356 >> 172.21.15.45:0/4012683356 conn(0x7f3ca40fc550 msgr2=0x7f3ca40fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:21.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 -- 172.21.15.45:0/4012683356 shutdown_connections 2024-09-18T13:03:21.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:21.505+0000 7f3ca96f9640 1 -- 172.21.15.45:0/4012683356 wait complete. 2024-09-18T13:03:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:21 smithi045 ceph-mon[109129]: pgmap v352: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:21 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/4012683356' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-18T13:03:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:21 smithi161 ceph-mon[80292]: pgmap v352: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:21 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/4012683356' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-18T13:03:22.151 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-18T13:03:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.873+0000 7f7581d37640 1 -- 172.21.15.45:0/2409844761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f757c107900 msgr2=0x7f757c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.873+0000 7f7581d37640 1 --2- 172.21.15.45:0/2409844761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f757c107900 0x7f757c107ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f756c009880 tx=0x7f756c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.873+0000 7f7581d37640 1 -- 172.21.15.45:0/2409844761 shutdown_connections 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.873+0000 7f7581d37640 1 --2- 172.21.15.45:0/2409844761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f757c101900 0x7f757c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.873+0000 7f7581d37640 1 --2- 172.21.15.45:0/2409844761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f757c107900 0x7f757c107ce0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.873+0000 7f7581d37640 1 -- 172.21.15.45:0/2409844761 >> 172.21.15.45:0/2409844761 conn(0x7f757c0fd600 msgr2=0x7f757c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.873+0000 7f7581d37640 1 -- 172.21.15.45:0/2409844761 shutdown_connections 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.873+0000 7f7581d37640 1 -- 172.21.15.45:0/2409844761 wait complete. 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.873+0000 7f7581d37640 1 Processor -- start 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f7581d37640 1 -- start start 2024-09-18T13:03:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f7581d37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f757c101900 0x7f757c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f7581d37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f757c107900 0x7f757c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f7581d37640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f757c10edb0 con 0x7f757c107900 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f7581d37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f757c10ec30 con 0x7f757c101900 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f757affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f757c107900 0x7f757c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f757affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f757c107900 0x7f757c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56006/0 (socket says 172.21.15.45:56006) 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f757affd640 1 -- 172.21.15.45:0/1163476394 learned_addr learned my addr 172.21.15.45:0/1163476394 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f757b7fe640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f757c101900 0x7f757c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f757affd640 1 -- 172.21.15.45:0/1163476394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f757c101900 msgr2=0x7f757c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f757affd640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f757c101900 0x7f757c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f757affd640 1 -- 172.21.15.45:0/1163476394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c074f70 con 0x7f757c107900 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.874+0000 7f757affd640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f757c107900 0x7f757c074a30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f757000c8a0 tx=0x7f757000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.875+0000 7f7578ff9640 1 -- 172.21.15.45:0/1163476394 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75700079b0 con 0x7f757c107900 2024-09-18T13:03:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.875+0000 7f7578ff9640 1 -- 172.21.15.45:0/1163476394 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7570007b50 con 0x7f757c107900 2024-09-18T13:03:22.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.875+0000 7f7578ff9640 1 -- 172.21.15.45:0/1163476394 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7570018700 con 0x7f757c107900 2024-09-18T13:03:22.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.875+0000 7f7581d37640 1 -- 172.21.15.45:0/1163476394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757c075260 con 0x7f757c107900 2024-09-18T13:03:22.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.875+0000 7f7581d37640 1 -- 172.21.15.45:0/1163476394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757c1a3e00 con 0x7f757c107900 2024-09-18T13:03:22.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.876+0000 7f7581d37640 1 -- 172.21.15.45:0/1163476394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757c103040 con 0x7f757c107900 2024-09-18T13:03:22.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.876+0000 7f7578ff9640 1 -- 172.21.15.45:0/1163476394 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f7570007d00 con 0x7f757c107900 2024-09-18T13:03:22.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.877+0000 7f7578ff9640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f756407af30 0x7f756407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:22.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.877+0000 7f7578ff9640 1 -- 172.21.15.45:0/1163476394 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f757009e370 con 0x7f757c107900 2024-09-18T13:03:22.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.877+0000 7f757b7fe640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f756407af30 0x7f756407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:22.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.877+0000 7f757b7fe640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f756407af30 0x7f756407d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f756c031460 tx=0x7f756c009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:22.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:22.881+0000 7f7578ff9640 1 -- 172.21.15.45:0/1163476394 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7570014030 con 0x7f757c107900 2024-09-18T13:03:23.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.104+0000 7f7581d37640 1 -- 172.21.15.45:0/1163476394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7f757c02d7c0 con 0x7f757c107900 2024-09-18T13:03:23.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.105+0000 7f7578ff9640 1 -- 172.21.15.45:0/1163476394 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v37) ==== 107+0+4475 (secure 0 0 0) 0x7f7570069910 con 0x7f757c107900 2024-09-18T13:03:23.106 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:23.106 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"btime":"2024-09-18T13:00:08:404207+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:07.406293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14566":{"gid":14566,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6827/2456430948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2456430948},{"type":"v1","addr":"172.21.15.45:6827","nonce":2456430948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14566,"qdb_cluster":[14566]},"id":1}]} 2024-09-18T13:03:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.108+0000 7f7581d37640 1 -- 172.21.15.45:0/1163476394 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f756407af30 msgr2=0x7f756407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.108+0000 7f7581d37640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f756407af30 0x7f756407d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f756c031460 tx=0x7f756c009560 comp rx=0 tx=0).stop 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.108+0000 7f7581d37640 1 -- 172.21.15.45:0/1163476394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f757c107900 msgr2=0x7f757c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.108+0000 7f7581d37640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f757c107900 0x7f757c074a30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f757000c8a0 tx=0x7f757000cd60 comp rx=0 tx=0).stop 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.108+0000 7f7581d37640 1 -- 172.21.15.45:0/1163476394 shutdown_connections 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.108+0000 7f7581d37640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f756407af30 0x7f756407d3f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.108+0000 7f7581d37640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f757c107900 0x7f757c074a30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.108+0000 7f7581d37640 1 --2- 172.21.15.45:0/1163476394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f757c101900 0x7f757c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.108+0000 7f7581d37640 1 -- 172.21.15.45:0/1163476394 >> 172.21.15.45:0/1163476394 conn(0x7f757c0fd600 msgr2=0x7f757c0fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.109+0000 7f7581d37640 1 -- 172.21.15.45:0/1163476394 shutdown_connections 2024-09-18T13:03:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:23.109+0000 7f7581d37640 1 -- 172.21.15.45:0/1163476394 wait complete. 2024-09-18T13:03:23.760 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-18T13:03:23.760 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-18T13:03:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:23 smithi045 ceph-mon[109129]: pgmap v353: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:23 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1163476394' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-18T13:03:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:23 smithi161 ceph-mon[80292]: pgmap v353: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:23 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1163476394' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-18T13:03:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.497+0000 7f6adee79640 1 -- 172.21.15.45:0/1038766714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad8100800 msgr2=0x7f6ad8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.497+0000 7f6adee79640 1 --2- 172.21.15.45:0/1038766714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad8100800 0x7f6ad8100c60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009c20 tx=0x7f6ac002a970 comp rx=0 tx=0).stop 2024-09-18T13:03:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.497+0000 7f6adee79640 1 -- 172.21.15.45:0/1038766714 shutdown_connections 2024-09-18T13:03:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.497+0000 7f6adee79640 1 --2- 172.21.15.45:0/1038766714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad8100800 0x7f6ad8100c60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.497+0000 7f6adee79640 1 --2- 172.21.15.45:0/1038766714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8106800 0x7f6ad8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.497+0000 7f6adee79640 1 -- 172.21.15.45:0/1038766714 >> 172.21.15.45:0/1038766714 conn(0x7f6ad80fc520 msgr2=0x7f6ad80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.497+0000 7f6adee79640 1 -- 172.21.15.45:0/1038766714 shutdown_connections 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.497+0000 7f6adee79640 1 -- 172.21.15.45:0/1038766714 wait complete. 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.498+0000 7f6adee79640 1 Processor -- start 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.498+0000 7f6adee79640 1 -- start start 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.498+0000 7f6adee79640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad8100800 0x7f6ad819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.498+0000 7f6adee79640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8106800 0x7f6ad819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.498+0000 7f6adee79640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad810dcd0 con 0x7f6ad8100800 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.498+0000 7f6adee79640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad810db50 con 0x7f6ad8106800 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.498+0000 7f6adcc15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad8100800 0x7f6ad819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.498+0000 7f6adcc15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad8100800 0x7f6ad819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56018/0 (socket says 172.21.15.45:56018) 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.498+0000 7f6adcc15640 1 -- 172.21.15.45:0/144312102 learned_addr learned my addr 172.21.15.45:0/144312102 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.499+0000 7f6adcc15640 1 -- 172.21.15.45:0/144312102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8106800 msgr2=0x7f6ad819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.499+0000 7f6ad7fff640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8106800 0x7f6ad819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.499+0000 7f6adcc15640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8106800 0x7f6ad819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.499+0000 7f6adcc15640 1 -- 172.21.15.45:0/144312102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad81977f0 con 0x7f6ad8100800 2024-09-18T13:03:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.499+0000 7f6adcc15640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad8100800 0x7f6ad819d670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800d6f0 tx=0x7f6ac800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.499+0000 7f6ad5ffb640 1 -- 172.21.15.45:0/144312102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ac8017070 con 0x7f6ad8100800 2024-09-18T13:03:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.499+0000 7f6ad5ffb640 1 -- 172.21.15.45:0/144312102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ac800de00 con 0x7f6ad8100800 2024-09-18T13:03:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.499+0000 7f6adee79640 1 -- 172.21.15.45:0/144312102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad8197ae0 con 0x7f6ad8100800 2024-09-18T13:03:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.499+0000 7f6ad5ffb640 1 -- 172.21.15.45:0/144312102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ac8004bb0 con 0x7f6ad8100800 2024-09-18T13:03:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.499+0000 7f6adee79640 1 -- 172.21.15.45:0/144312102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad8198070 con 0x7f6ad8100800 2024-09-18T13:03:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.500+0000 7f6adee79640 1 -- 172.21.15.45:0/144312102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad8101f40 con 0x7f6ad8100800 2024-09-18T13:03:24.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.501+0000 7f6ad5ffb640 1 -- 172.21.15.45:0/144312102 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f6ac8004e60 con 0x7f6ad8100800 2024-09-18T13:03:24.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.501+0000 7f6ad5ffb640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ac407af80 0x7f6ac407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:24.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.501+0000 7f6ad5ffb640 1 -- 172.21.15.45:0/144312102 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f6ac809dd40 con 0x7f6ad8100800 2024-09-18T13:03:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.501+0000 7f6ad7fff640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ac407af80 0x7f6ac407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.502+0000 7f6ad7fff640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ac407af80 0x7f6ac407d440 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0006010 tx=0x7f6ac0009380 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.506+0000 7f6ad5ffb640 1 -- 172.21.15.45:0/144312102 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6ac8069240 con 0x7f6ad8100800 2024-09-18T13:03:24.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.732+0000 7f6adee79640 1 -- 172.21.15.45:0/144312102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7f6ad8109d80 con 0x7f6ad8100800 2024-09-18T13:03:24.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.732+0000 7f6ad5ffb640 1 -- 172.21.15.45:0/144312102 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v37) ==== 107+0+5319 (secure 0 0 0) 0x7f6ac806e0f0 con 0x7f6ad8100800 2024-09-18T13:03:24.734 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:24.734 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":18,"btime":"2024-09-18T13:00:09:416192+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34314,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/743768893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":743768893},{"type":"v1","addr":"172.21.15.45:6829","nonce":743768893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:07.406293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14566":{"gid":14566,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6827/2456430948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":2456430948},{"type":"v1","addr":"172.21.15.45:6827","nonce":2456430948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14566,"qdb_cluster":[14566]},"id":1}]} 2024-09-18T13:03:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 18 2024-09-18T13:03:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.734+0000 7f6adee79640 1 -- 172.21.15.45:0/144312102 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ac407af80 msgr2=0x7f6ac407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.734+0000 7f6adee79640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ac407af80 0x7f6ac407d440 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0006010 tx=0x7f6ac0009380 comp rx=0 tx=0).stop 2024-09-18T13:03:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.734+0000 7f6adee79640 1 -- 172.21.15.45:0/144312102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad8100800 msgr2=0x7f6ad819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.734+0000 7f6adee79640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad8100800 0x7f6ad819d670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800d6f0 tx=0x7f6ac800dbb0 comp rx=0 tx=0).stop 2024-09-18T13:03:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.735+0000 7f6adee79640 1 -- 172.21.15.45:0/144312102 shutdown_connections 2024-09-18T13:03:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.735+0000 7f6adee79640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f6ac407af80 0x7f6ac407d440 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.735+0000 7f6adee79640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8106800 0x7f6ad819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.735+0000 7f6adee79640 1 --2- 172.21.15.45:0/144312102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad8100800 0x7f6ad819d670 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.735+0000 7f6adee79640 1 -- 172.21.15.45:0/144312102 >> 172.21.15.45:0/144312102 conn(0x7f6ad80fc520 msgr2=0x7f6ad806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.735+0000 7f6adee79640 1 -- 172.21.15.45:0/144312102 shutdown_connections 2024-09-18T13:03:24.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:24.735+0000 7f6adee79640 1 -- 172.21.15.45:0/144312102 wait complete. 2024-09-18T13:03:25.411 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-18T13:03:25.411 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-18T13:03:25.718 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:25.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:25 smithi045 ceph-mon[109129]: pgmap v354: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:25.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:25 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/144312102' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-18T13:03:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:25 smithi161 ceph-mon[80292]: pgmap v354: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:25 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/144312102' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-18T13:03:26.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.190+0000 7f47168d4640 1 -- 172.21.15.45:0/1736657522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47101033e0 msgr2=0x7f471010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.190+0000 7f47168d4640 1 --2- 172.21.15.45:0/1736657522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47101033e0 0x7f471010b8d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4704009880 tx=0x7f470402a530 comp rx=0 tx=0).stop 2024-09-18T13:03:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.190+0000 7f47168d4640 1 -- 172.21.15.45:0/1736657522 shutdown_connections 2024-09-18T13:03:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.190+0000 7f47168d4640 1 --2- 172.21.15.45:0/1736657522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47101033e0 0x7f471010b8d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.190+0000 7f47168d4640 1 --2- 172.21.15.45:0/1736657522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4710102ac0 0x7f4710102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.190+0000 7f47168d4640 1 -- 172.21.15.45:0/1736657522 >> 172.21.15.45:0/1736657522 conn(0x7f47100fc520 msgr2=0x7f47100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.190+0000 7f47168d4640 1 -- 172.21.15.45:0/1736657522 shutdown_connections 2024-09-18T13:03:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.190+0000 7f47168d4640 1 -- 172.21.15.45:0/1736657522 wait complete. 2024-09-18T13:03:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f47168d4640 1 Processor -- start 2024-09-18T13:03:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f47168d4640 1 -- start start 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f47168d4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4710102ac0 0x7f4710100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f47168d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47101033e0 0x7f4710100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f47168d4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f471010edf0 con 0x7f47101033e0 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f47168d4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f471010ec70 con 0x7f4710102ac0 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f470f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47101033e0 0x7f4710100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f470f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47101033e0 0x7f4710100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56022/0 (socket says 172.21.15.45:56022) 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f470f7fe640 1 -- 172.21.15.45:0/3549339733 learned_addr learned my addr 172.21.15.45:0/3549339733 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f470ffff640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4710102ac0 0x7f4710100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f470f7fe640 1 -- 172.21.15.45:0/3549339733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4710102ac0 msgr2=0x7f4710100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f470f7fe640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4710102ac0 0x7f4710100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.191+0000 7f470f7fe640 1 -- 172.21.15.45:0/3549339733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47101011a0 con 0x7f47101033e0 2024-09-18T13:03:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.192+0000 7f470ffff640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4710102ac0 0x7f4710100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:03:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.192+0000 7f470f7fe640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47101033e0 0x7f4710100c60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4704031460 tx=0x7f4704004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.192+0000 7f470d7fa640 1 -- 172.21.15.45:0/3549339733 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f470403f070 con 0x7f47101033e0 2024-09-18T13:03:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.192+0000 7f47168d4640 1 -- 172.21.15.45:0/3549339733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4710101430 con 0x7f47101033e0 2024-09-18T13:03:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.192+0000 7f470d7fa640 1 -- 172.21.15.45:0/3549339733 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4704004a90 con 0x7f47101033e0 2024-09-18T13:03:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.192+0000 7f470d7fa640 1 -- 172.21.15.45:0/3549339733 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4704035030 con 0x7f47101033e0 2024-09-18T13:03:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.192+0000 7f47168d4640 1 -- 172.21.15.45:0/3549339733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47101a3de0 con 0x7f47101033e0 2024-09-18T13:03:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.193+0000 7f47168d4640 1 -- 172.21.15.45:0/3549339733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f471006aa90 con 0x7f47101033e0 2024-09-18T13:03:26.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.194+0000 7f470d7fa640 1 -- 172.21.15.45:0/3549339733 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f4704042070 con 0x7f47101033e0 2024-09-18T13:03:26.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.194+0000 7f470d7fa640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f46f807af40 0x7f46f807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:26.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.195+0000 7f470ffff640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f46f807af40 0x7f46f807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:26.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.195+0000 7f470d7fa640 1 -- 172.21.15.45:0/3549339733 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f47040bec00 con 0x7f47101033e0 2024-09-18T13:03:26.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.195+0000 7f470ffff640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f46f807af40 0x7f46f807d400 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4700009b40 tx=0x7f4700005e50 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.199+0000 7f470d7fa640 1 -- 172.21.15.45:0/3549339733 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f470408a100 con 0x7f47101033e0 2024-09-18T13:03:26.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.419+0000 7f47168d4640 1 -- 172.21.15.45:0/3549339733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7f471002d7c0 con 0x7f47101033e0 2024-09-18T13:03:26.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.420+0000 7f470d7fa640 1 -- 172.21.15.45:0/3549339733 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v37) ==== 107+0+4454 (secure 0 0 0) 0x7f470408efb0 con 0x7f47101033e0 2024-09-18T13:03:26.421 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:26.421 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"btime":"2024-09-18T13:00:11:864406+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34314,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/743768893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":743768893},{"type":"v1","addr":"172.21.15.45:6829","nonce":743768893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:11.864403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:26.421 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 19 2024-09-18T13:03:26.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 -- 172.21.15.45:0/3549339733 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f46f807af40 msgr2=0x7f46f807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:26.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f46f807af40 0x7f46f807d400 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4700009b40 tx=0x7f4700005e50 comp rx=0 tx=0).stop 2024-09-18T13:03:26.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 -- 172.21.15.45:0/3549339733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47101033e0 msgr2=0x7f4710100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:26.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47101033e0 0x7f4710100c60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4704031460 tx=0x7f4704004530 comp rx=0 tx=0).stop 2024-09-18T13:03:26.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 -- 172.21.15.45:0/3549339733 shutdown_connections 2024-09-18T13:03:26.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f46f807af40 0x7f46f807d400 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47101033e0 0x7f4710100c60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 --2- 172.21.15.45:0/3549339733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4710102ac0 0x7f4710100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:26.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 -- 172.21.15.45:0/3549339733 >> 172.21.15.45:0/3549339733 conn(0x7f47100fc520 msgr2=0x7f4710108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:26.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 -- 172.21.15.45:0/3549339733 shutdown_connections 2024-09-18T13:03:26.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:26.422+0000 7f47168d4640 1 -- 172.21.15.45:0/3549339733 wait complete. 2024-09-18T13:03:26.710 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:26 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3549339733' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-18T13:03:26.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:26 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3549339733' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-18T13:03:27.072 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-18T13:03:27.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-18T13:03:27.339 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:27.739 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:27 smithi045 ceph-mon[109129]: pgmap v355: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:27 smithi161 ceph-mon[80292]: pgmap v355: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:27.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.802+0000 7f22eede0640 1 -- 172.21.15.45:0/2534212332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22e8103440 msgr2=0x7f22e810b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:27.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.802+0000 7f22eede0640 1 --2- 172.21.15.45:0/2534212332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22e8103440 0x7f22e810b930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009c50 tx=0x7f22d802aa30 comp rx=0 tx=0).stop 2024-09-18T13:03:27.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.802+0000 7f22eede0640 1 -- 172.21.15.45:0/2534212332 shutdown_connections 2024-09-18T13:03:27.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.802+0000 7f22eede0640 1 --2- 172.21.15.45:0/2534212332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22e8103440 0x7f22e810b930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:27.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.802+0000 7f22eede0640 1 --2- 172.21.15.45:0/2534212332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e8102b20 0x7f22e8102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:27.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.802+0000 7f22eede0640 1 -- 172.21.15.45:0/2534212332 >> 172.21.15.45:0/2534212332 conn(0x7f22e80fc520 msgr2=0x7f22e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:27.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.802+0000 7f22eede0640 1 -- 172.21.15.45:0/2534212332 shutdown_connections 2024-09-18T13:03:27.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.802+0000 7f22eede0640 1 -- 172.21.15.45:0/2534212332 wait complete. 2024-09-18T13:03:27.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.803+0000 7f22eede0640 1 Processor -- start 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.803+0000 7f22eede0640 1 -- start start 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.803+0000 7f22eede0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22e8102b20 0x7f22e819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.803+0000 7f22eede0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e8103440 0x7f22e819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.803+0000 7f22eede0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f22e810edf0 con 0x7f22e8102b20 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.803+0000 7f22eede0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f22e810ec70 con 0x7f22e8103440 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.803+0000 7f22ecb7c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22e8102b20 0x7f22e819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22ecb7c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22e8102b20 0x7f22e819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56044/0 (socket says 172.21.15.45:56044) 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22ecb7c640 1 -- 172.21.15.45:0/607072583 learned_addr learned my addr 172.21.15.45:0/607072583 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22e7fff640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e8103440 0x7f22e819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22ecb7c640 1 -- 172.21.15.45:0/607072583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e8103440 msgr2=0x7f22e819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22ecb7c640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e8103440 0x7f22e819dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22ecb7c640 1 -- 172.21.15.45:0/607072583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e8197820 con 0x7f22e8102b20 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22ecb7c640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22e8102b20 0x7f22e819d6a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f22d000d6f0 tx=0x7f22d000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:27.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22e5ffb640 1 -- 172.21.15.45:0/607072583 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f22d0017070 con 0x7f22e8102b20 2024-09-18T13:03:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22e5ffb640 1 -- 172.21.15.45:0/607072583 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f22d000de00 con 0x7f22e8102b20 2024-09-18T13:03:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22eede0640 1 -- 172.21.15.45:0/607072583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e8197b10 con 0x7f22e8102b20 2024-09-18T13:03:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.804+0000 7f22e5ffb640 1 -- 172.21.15.45:0/607072583 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f22d0004bb0 con 0x7f22e8102b20 2024-09-18T13:03:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.805+0000 7f22eede0640 1 -- 172.21.15.45:0/607072583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e8198070 con 0x7f22e8102b20 2024-09-18T13:03:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.805+0000 7f22eede0640 1 -- 172.21.15.45:0/607072583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e806aa30 con 0x7f22e8102b20 2024-09-18T13:03:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.806+0000 7f22e5ffb640 1 -- 172.21.15.45:0/607072583 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f22d0004e60 con 0x7f22e8102b20 2024-09-18T13:03:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.807+0000 7f22e5ffb640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f22d407af30 0x7f22d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.807+0000 7f22e7fff640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f22d407af30 0x7f22d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.807+0000 7f22e5ffb640 1 -- 172.21.15.45:0/607072583 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f22d009dc60 con 0x7f22e8102b20 2024-09-18T13:03:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.807+0000 7f22e7fff640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f22d407af30 0x7f22d407d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22e8198b70 tx=0x7f22d803a040 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:27.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:27.811+0000 7f22e5ffb640 1 -- 172.21.15.45:0/607072583 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f22d00691a0 con 0x7f22e8102b20 2024-09-18T13:03:28.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.033+0000 7f22eede0640 1 -- 172.21.15.45:0/607072583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7f22e8105fb0 con 0x7f22e8102b20 2024-09-18T13:03:28.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.033+0000 7f22e5ffb640 1 -- 172.21.15.45:0/607072583 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v37) ==== 107+0+4465 (secure 0 0 0) 0x7f22d006e050 con 0x7f22e8102b20 2024-09-18T13:03:28.035 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:28.035 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"btime":"2024-09-18T13:00:11:868788+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34314,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/743768893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":743768893},{"type":"v1","addr":"172.21.15.45:6829","nonce":743768893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:11.868777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24321":{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":0,"incarnation":20,"state":"up:replay","state_seq":2,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:28.035 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 20 2024-09-18T13:03:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.035+0000 7f22eede0640 1 -- 172.21.15.45:0/607072583 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f22d407af30 msgr2=0x7f22d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.035+0000 7f22eede0640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f22d407af30 0x7f22d407d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22e8198b70 tx=0x7f22d803a040 comp rx=0 tx=0).stop 2024-09-18T13:03:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.035+0000 7f22eede0640 1 -- 172.21.15.45:0/607072583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22e8102b20 msgr2=0x7f22e819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.035+0000 7f22eede0640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22e8102b20 0x7f22e819d6a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f22d000d6f0 tx=0x7f22d000dbb0 comp rx=0 tx=0).stop 2024-09-18T13:03:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.036+0000 7f22eede0640 1 -- 172.21.15.45:0/607072583 shutdown_connections 2024-09-18T13:03:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.036+0000 7f22eede0640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f22d407af30 0x7f22d407d3f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.036+0000 7f22eede0640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22e8103440 0x7f22e819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.036+0000 7f22eede0640 1 --2- 172.21.15.45:0/607072583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22e8102b20 0x7f22e819d6a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.036+0000 7f22eede0640 1 -- 172.21.15.45:0/607072583 >> 172.21.15.45:0/607072583 conn(0x7f22e80fc520 msgr2=0x7f22e8103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.036+0000 7f22eede0640 1 -- 172.21.15.45:0/607072583 shutdown_connections 2024-09-18T13:03:28.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:28.036+0000 7f22eede0640 1 -- 172.21.15.45:0/607072583 wait complete. 2024-09-18T13:03:28.625 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-18T13:03:28.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-18T13:03:28.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:28 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/607072583' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-18T13:03:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:28.995 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:28 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/607072583' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-18T13:03:29.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.288+0000 7fb93e405640 1 -- 172.21.15.45:0/4154001048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb938101900 msgr2=0x7fb938101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:29.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.288+0000 7fb93e405640 1 --2- 172.21.15.45:0/4154001048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb938101900 0x7fb938101d60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009880 tx=0x7fb92c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.289+0000 7fb93e405640 1 -- 172.21.15.45:0/4154001048 shutdown_connections 2024-09-18T13:03:29.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.289+0000 7fb93e405640 1 --2- 172.21.15.45:0/4154001048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb938101900 0x7fb938101d60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.289+0000 7fb93e405640 1 --2- 172.21.15.45:0/4154001048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb938107900 0x7fb938107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.289+0000 7fb93e405640 1 -- 172.21.15.45:0/4154001048 >> 172.21.15.45:0/4154001048 conn(0x7fb9380fd600 msgr2=0x7fb9380ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:29.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.289+0000 7fb93e405640 1 -- 172.21.15.45:0/4154001048 shutdown_connections 2024-09-18T13:03:29.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.289+0000 7fb93e405640 1 -- 172.21.15.45:0/4154001048 wait complete. 2024-09-18T13:03:29.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.289+0000 7fb93e405640 1 Processor -- start 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.289+0000 7fb93e405640 1 -- start start 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb93e405640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb938101900 0x7fb93819f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb93e405640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb938107900 0x7fb93819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb93e405640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb93810edb0 con 0x7fb938101900 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb93e405640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fb93810ec30 con 0x7fb938107900 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb937fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb938101900 0x7fb93819f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb937fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb938101900 0x7fb93819f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56068/0 (socket says 172.21.15.45:56068) 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb937fff640 1 -- 172.21.15.45:0/2684621710 learned_addr learned my addr 172.21.15.45:0/2684621710 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb9377fe640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb938107900 0x7fb93819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb937fff640 1 -- 172.21.15.45:0/2684621710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb938107900 msgr2=0x7fb93819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb937fff640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb938107900 0x7fb93819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb937fff640 1 -- 172.21.15.45:0/2684621710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9381a0460 con 0x7fb938101900 2024-09-18T13:03:29.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb937fff640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb938101900 0x7fb93819f870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb92800c8a0 tx=0x7fb92800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb9357fa640 1 -- 172.21.15.45:0/2684621710 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9280079b0 con 0x7fb938101900 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb9357fa640 1 -- 172.21.15.45:0/2684621710 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb928007b50 con 0x7fb938101900 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb93e405640 1 -- 172.21.15.45:0/2684621710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb938199b50 con 0x7fb938101900 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.290+0000 7fb9357fa640 1 -- 172.21.15.45:0/2684621710 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb928018700 con 0x7fb938101900 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.291+0000 7fb93e405640 1 -- 172.21.15.45:0/2684621710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93819a0b0 con 0x7fb938101900 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.292+0000 7fb93e405640 1 -- 172.21.15.45:0/2684621710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb938103040 con 0x7fb938101900 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.292+0000 7fb9357fa640 1 -- 172.21.15.45:0/2684621710 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fb928007d00 con 0x7fb938101900 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.293+0000 7fb9357fa640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb92007af90 0x7fb92007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.293+0000 7fb9377fe640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb92007af90 0x7fb92007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.293+0000 7fb9357fa640 1 -- 172.21.15.45:0/2684621710 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fb92809e1e0 con 0x7fb938101900 2024-09-18T13:03:29.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.294+0000 7fb9377fe640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb92007af90 0x7fb92007d450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb93819b220 tx=0x7fb92c031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:29.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.298+0000 7fb9357fa640 1 -- 172.21.15.45:0/2684621710 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb928014030 con 0x7fb938101900 2024-09-18T13:03:29.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.519+0000 7fb93e405640 1 -- 172.21.15.45:0/2684621710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7fb93819a390 con 0x7fb938101900 2024-09-18T13:03:29.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.520+0000 7fb9357fa640 1 -- 172.21.15.45:0/2684621710 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v37) ==== 107+0+4470 (secure 0 0 0) 0x7fb928069800 con 0x7fb938101900 2024-09-18T13:03:29.522 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:29.522 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-18T13:00:20:552865+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34314,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/743768893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":743768893},{"type":"v1","addr":"172.21.15.45:6829","nonce":743768893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:19.707516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24321":{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":165,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.522+0000 7fb93e405640 1 -- 172.21.15.45:0/2684621710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb92007af90 msgr2=0x7fb92007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.522+0000 7fb93e405640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb92007af90 0x7fb92007d450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb93819b220 tx=0x7fb92c031400 comp rx=0 tx=0).stop 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.522+0000 7fb93e405640 1 -- 172.21.15.45:0/2684621710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb938101900 msgr2=0x7fb93819f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.522+0000 7fb93e405640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb938101900 0x7fb93819f870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb92800c8a0 tx=0x7fb92800cd60 comp rx=0 tx=0).stop 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.522+0000 7fb93e405640 1 -- 172.21.15.45:0/2684621710 shutdown_connections 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.523+0000 7fb93e405640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fb92007af90 0x7fb92007d450 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.523+0000 7fb93e405640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb938107900 0x7fb93819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.523+0000 7fb93e405640 1 --2- 172.21.15.45:0/2684621710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb938101900 0x7fb93819f870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.523+0000 7fb93e405640 1 -- 172.21.15.45:0/2684621710 >> 172.21.15.45:0/2684621710 conn(0x7fb9380fd600 msgr2=0x7fb938074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.523+0000 7fb93e405640 1 -- 172.21.15.45:0/2684621710 shutdown_connections 2024-09-18T13:03:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:29.523+0000 7fb93e405640 1 -- 172.21.15.45:0/2684621710 wait complete. 2024-09-18T13:03:29.819 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:29 smithi045 ceph-mon[109129]: pgmap v356: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:29.819 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:29 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2684621710' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-18T13:03:30.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:29 smithi161 ceph-mon[80292]: pgmap v356: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:30.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:29 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2684621710' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-18T13:03:30.126 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-18T13:03:30.126 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-18T13:03:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.812+0000 7f9fd22fb640 1 -- 172.21.15.45:0/1357574189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fcc1067f0 msgr2=0x7f9fcc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.812+0000 7f9fd22fb640 1 --2- 172.21.15.45:0/1357574189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fcc1067f0 0x7f9fcc106bd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009880 tx=0x7f9fbc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.812+0000 7f9fd22fb640 1 -- 172.21.15.45:0/1357574189 shutdown_connections 2024-09-18T13:03:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.812+0000 7f9fd22fb640 1 --2- 172.21.15.45:0/1357574189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fcc1007f0 0x7f9fcc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.812+0000 7f9fd22fb640 1 --2- 172.21.15.45:0/1357574189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fcc1067f0 0x7f9fcc106bd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.812+0000 7f9fd22fb640 1 -- 172.21.15.45:0/1357574189 >> 172.21.15.45:0/1357574189 conn(0x7f9fcc0fc550 msgr2=0x7f9fcc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.812+0000 7f9fd22fb640 1 -- 172.21.15.45:0/1357574189 shutdown_connections 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.812+0000 7f9fd22fb640 1 -- 172.21.15.45:0/1357574189 wait complete. 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.812+0000 7f9fd22fb640 1 Processor -- start 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.812+0000 7f9fd22fb640 1 -- start start 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fd22fb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fcc1007f0 0x7f9fcc19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fd22fb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fcc1067f0 0x7f9fcc19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fd22fb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc10dcc0 con 0x7f9fcc1067f0 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fd22fb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc10db40 con 0x7f9fcc1007f0 2024-09-18T13:03:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fcc1067f0 0x7f9fcc19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fcc1067f0 0x7f9fcc19fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56086/0 (socket says 172.21.15.45:56086) 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fc3fff640 1 -- 172.21.15.45:0/2038765155 learned_addr learned my addr 172.21.15.45:0/2038765155 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fcbfff640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fcc1007f0 0x7f9fcc19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fc3fff640 1 -- 172.21.15.45:0/2038765155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fcc1007f0 msgr2=0x7f9fcc19f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fc3fff640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fcc1007f0 0x7f9fcc19f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fc3fff640 1 -- 172.21.15.45:0/2038765155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc1999d0 con 0x7f9fcc1067f0 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fcbfff640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fcc1007f0 0x7f9fcc19f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fc3fff640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fcc1067f0 0x7f9fcc19fd50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400d6f0 tx=0x7f9fb400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fc9ffb640 1 -- 172.21.15.45:0/2038765155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fb4017070 con 0x7f9fcc1067f0 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fd22fb640 1 -- 172.21.15.45:0/2038765155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fcc199cc0 con 0x7f9fcc1067f0 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fc9ffb640 1 -- 172.21.15.45:0/2038765155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fb400de00 con 0x7f9fcc1067f0 2024-09-18T13:03:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fc9ffb640 1 -- 172.21.15.45:0/2038765155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fb4004bb0 con 0x7f9fcc1067f0 2024-09-18T13:03:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.813+0000 7f9fd22fb640 1 -- 172.21.15.45:0/2038765155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fcc19a250 con 0x7f9fcc1067f0 2024-09-18T13:03:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.814+0000 7f9fd22fb640 1 -- 172.21.15.45:0/2038765155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fcc101f30 con 0x7f9fcc1067f0 2024-09-18T13:03:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.815+0000 7f9fc9ffb640 1 -- 172.21.15.45:0/2038765155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f9fb4004e60 con 0x7f9fcc1067f0 2024-09-18T13:03:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.816+0000 7f9fc9ffb640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9fb807af30 0x7f9fb807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.816+0000 7f9fc9ffb640 1 -- 172.21.15.45:0/2038765155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f9fb409dd50 con 0x7f9fcc1067f0 2024-09-18T13:03:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.816+0000 7f9fcbfff640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9fb807af30 0x7f9fb807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.816+0000 7f9fcbfff640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9fb807af30 0x7f9fb807d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc006010 tx=0x7f9fbc004140 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:30.820+0000 7f9fc9ffb640 1 -- 172.21.15.45:0/2038765155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9fb4069250 con 0x7f9fcc1067f0 2024-09-18T13:03:31.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.042+0000 7f9fd22fb640 1 -- 172.21.15.45:0/2038765155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7f9fcc19af00 con 0x7f9fcc1067f0 2024-09-18T13:03:31.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.043+0000 7f9fc9ffb640 1 -- 172.21.15.45:0/2038765155 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v37) ==== 107+0+4467 (secure 0 0 0) 0x7f9fb406e100 con 0x7f9fcc1067f0 2024-09-18T13:03:31.045 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:31.045 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"btime":"2024-09-18T13:00:21:557639+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34314,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/743768893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":743768893},{"type":"v1","addr":"172.21.15.45:6829","nonce":743768893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:20.559993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24321":{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":166,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:31.045 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2024-09-18T13:03:31.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 -- 172.21.15.45:0/2038765155 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9fb807af30 msgr2=0x7f9fb807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:31.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9fb807af30 0x7f9fb807d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc006010 tx=0x7f9fbc004140 comp rx=0 tx=0).stop 2024-09-18T13:03:31.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 -- 172.21.15.45:0/2038765155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fcc1067f0 msgr2=0x7f9fcc19fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:31.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fcc1067f0 0x7f9fcc19fd50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400d6f0 tx=0x7f9fb400dbb0 comp rx=0 tx=0).stop 2024-09-18T13:03:31.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 -- 172.21.15.45:0/2038765155 shutdown_connections 2024-09-18T13:03:31.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9fb807af30 0x7f9fb807d3f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:31.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fcc1067f0 0x7f9fcc19fd50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:31.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 --2- 172.21.15.45:0/2038765155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fcc1007f0 0x7f9fcc19f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:31.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 -- 172.21.15.45:0/2038765155 >> 172.21.15.45:0/2038765155 conn(0x7f9fcc0fc550 msgr2=0x7f9fcc0fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:31.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 -- 172.21.15.45:0/2038765155 shutdown_connections 2024-09-18T13:03:31.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:31.045+0000 7f9fd22fb640 1 -- 172.21.15.45:0/2038765155 wait complete. 2024-09-18T13:03:31.647 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-18T13:03:31.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-18T13:03:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:31 smithi045 ceph-mon[109129]: pgmap v357: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:31 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2038765155' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-18T13:03:31.908 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:31 smithi161 ceph-mon[80292]: pgmap v357: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:31 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2038765155' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-18T13:03:32.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.354+0000 7f3caa6be640 1 -- 172.21.15.45:0/2625723642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca4100800 msgr2=0x7f3ca4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.354+0000 7f3caa6be640 1 --2- 172.21.15.45:0/2625723642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca4100800 0x7f3ca4100c60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009880 tx=0x7f3c9802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.354+0000 7f3caa6be640 1 -- 172.21.15.45:0/2625723642 shutdown_connections 2024-09-18T13:03:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.354+0000 7f3caa6be640 1 --2- 172.21.15.45:0/2625723642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca4100800 0x7f3ca4100c60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.354+0000 7f3caa6be640 1 --2- 172.21.15.45:0/2625723642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca4106800 0x7f3ca4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.354+0000 7f3caa6be640 1 -- 172.21.15.45:0/2625723642 >> 172.21.15.45:0/2625723642 conn(0x7f3ca40fc520 msgr2=0x7f3ca40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.354+0000 7f3caa6be640 1 -- 172.21.15.45:0/2625723642 shutdown_connections 2024-09-18T13:03:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.354+0000 7f3caa6be640 1 -- 172.21.15.45:0/2625723642 wait complete. 2024-09-18T13:03:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.355+0000 7f3caa6be640 1 Processor -- start 2024-09-18T13:03:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.355+0000 7f3caa6be640 1 -- start start 2024-09-18T13:03:32.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.355+0000 7f3caa6be640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca4100800 0x7f3ca41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.355+0000 7f3caa6be640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca4106800 0x7f3ca4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.355+0000 7f3caa6be640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca410dcd0 con 0x7f3ca4106800 2024-09-18T13:03:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.355+0000 7f3caa6be640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca410db50 con 0x7f3ca4100800 2024-09-18T13:03:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.355+0000 7f3ca37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca4106800 0x7f3ca4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3ca37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca4106800 0x7f3ca4198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56098/0 (socket says 172.21.15.45:56098) 2024-09-18T13:03:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3ca37fe640 1 -- 172.21.15.45:0/2930387762 learned_addr learned my addr 172.21.15.45:0/2930387762 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3ca3fff640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca4100800 0x7f3ca41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3ca37fe640 1 -- 172.21.15.45:0/2930387762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca4100800 msgr2=0x7f3ca41987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3ca37fe640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca4100800 0x7f3ca41987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3ca37fe640 1 -- 172.21.15.45:0/2930387762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca4199320 con 0x7f3ca4106800 2024-09-18T13:03:32.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3ca37fe640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca4106800 0x7f3ca4198d20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3c98031460 tx=0x7f3c980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:32.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3ca17fa640 1 -- 172.21.15.45:0/2930387762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c9803f070 con 0x7f3ca4106800 2024-09-18T13:03:32.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3ca17fa640 1 -- 172.21.15.45:0/2930387762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c980035f0 con 0x7f3ca4106800 2024-09-18T13:03:32.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3caa6be640 1 -- 172.21.15.45:0/2930387762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca41995b0 con 0x7f3ca4106800 2024-09-18T13:03:32.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3ca17fa640 1 -- 172.21.15.45:0/2930387762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c98035030 con 0x7f3ca4106800 2024-09-18T13:03:32.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.356+0000 7f3caa6be640 1 -- 172.21.15.45:0/2930387762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca41a1b60 con 0x7f3ca4106800 2024-09-18T13:03:32.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.357+0000 7f3caa6be640 1 -- 172.21.15.45:0/2930387762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca4101f40 con 0x7f3ca4106800 2024-09-18T13:03:32.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.358+0000 7f3ca17fa640 1 -- 172.21.15.45:0/2930387762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f3c98042070 con 0x7f3ca4106800 2024-09-18T13:03:32.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.358+0000 7f3ca17fa640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c8c07af30 0x7f3c8c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:32.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.359+0000 7f3ca17fa640 1 -- 172.21.15.45:0/2930387762 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f3c980be9d0 con 0x7f3ca4106800 2024-09-18T13:03:32.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.359+0000 7f3ca3fff640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c8c07af30 0x7f3c8c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:32.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.359+0000 7f3ca3fff640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c8c07af30 0x7f3c8c07d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005fd0 tx=0x7f3c9400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:32.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.363+0000 7f3ca17fa640 1 -- 172.21.15.45:0/2930387762 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3c98089f70 con 0x7f3ca4106800 2024-09-18T13:03:32.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.584+0000 7f3caa6be640 1 -- 172.21.15.45:0/2930387762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7f3ca4108d70 con 0x7f3ca4106800 2024-09-18T13:03:32.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.585+0000 7f3ca17fa640 1 -- 172.21.15.45:0/2930387762 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v37) ==== 107+0+5320 (secure 0 0 0) 0x7f3c9808ee20 con 0x7f3ca4106800 2024-09-18T13:03:32.586 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:32.587 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"btime":"2024-09-18T13:00:22:563633+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34314,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/743768893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":743768893},{"type":"v1","addr":"172.21.15.45:6829","nonce":743768893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:22.563621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24321":{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":0,"incarnation":20,"state":"up:active","state_seq":167,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24321,"qdb_cluster":[24321]},"id":1}]} 2024-09-18T13:03:32.587 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2024-09-18T13:03:32.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 -- 172.21.15.45:0/2930387762 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c8c07af30 msgr2=0x7f3c8c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c8c07af30 0x7f3c8c07d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005fd0 tx=0x7f3c9400b390 comp rx=0 tx=0).stop 2024-09-18T13:03:32.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 -- 172.21.15.45:0/2930387762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca4106800 msgr2=0x7f3ca4198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:32.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca4106800 0x7f3ca4198d20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3c98031460 tx=0x7f3c980045e0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 -- 172.21.15.45:0/2930387762 shutdown_connections 2024-09-18T13:03:32.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f3c8c07af30 0x7f3c8c07d3f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ca4106800 0x7f3ca4198d20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 --2- 172.21.15.45:0/2930387762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ca4100800 0x7f3ca41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:32.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 -- 172.21.15.45:0/2930387762 >> 172.21.15.45:0/2930387762 conn(0x7f3ca40fc520 msgr2=0x7f3ca40fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:32.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 -- 172.21.15.45:0/2930387762 shutdown_connections 2024-09-18T13:03:32.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:32.587+0000 7f3caa6be640 1 -- 172.21.15.45:0/2930387762 wait complete. 2024-09-18T13:03:33.188 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-18T13:03:33.188 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-18T13:03:33.447 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:33.762 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:33 smithi045 ceph-mon[109129]: pgmap v358: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:33.762 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:33 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2930387762' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-18T13:03:33.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.844+0000 7f9af133f640 1 -- 172.21.15.45:0/2465459766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aec102ab0 msgr2=0x7f9aec102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.844+0000 7f9af133f640 1 --2- 172.21.15.45:0/2465459766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aec102ab0 0x7f9aec102e90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009880 tx=0x7f9adc02a530 comp rx=0 tx=0).stop 2024-09-18T13:03:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.845+0000 7f9af133f640 1 -- 172.21.15.45:0/2465459766 shutdown_connections 2024-09-18T13:03:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.845+0000 7f9af133f640 1 --2- 172.21.15.45:0/2465459766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9aec1033d0 0x7f9aec10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.845+0000 7f9af133f640 1 --2- 172.21.15.45:0/2465459766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aec102ab0 0x7f9aec102e90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.845+0000 7f9af133f640 1 -- 172.21.15.45:0/2465459766 >> 172.21.15.45:0/2465459766 conn(0x7f9aec0fc550 msgr2=0x7f9aec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.845+0000 7f9af133f640 1 -- 172.21.15.45:0/2465459766 shutdown_connections 2024-09-18T13:03:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.845+0000 7f9af133f640 1 -- 172.21.15.45:0/2465459766 wait complete. 2024-09-18T13:03:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.845+0000 7f9af133f640 1 Processor -- start 2024-09-18T13:03:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.845+0000 7f9af133f640 1 -- start start 2024-09-18T13:03:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9af133f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aec102ab0 0x7f9aec100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9af133f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9aec1033d0 0x7f9aec100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9af133f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec10ede0 con 0x7f9aec102ab0 2024-09-18T13:03:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9af133f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec10ec60 con 0x7f9aec1033d0 2024-09-18T13:03:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9aeaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aec102ab0 0x7f9aec100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9aeaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aec102ab0 0x7f9aec100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58942/0 (socket says 172.21.15.45:58942) 2024-09-18T13:03:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9aeaffd640 1 -- 172.21.15.45:0/755064319 learned_addr learned my addr 172.21.15.45:0/755064319 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9aea7fc640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9aec1033d0 0x7f9aec100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9aeaffd640 1 -- 172.21.15.45:0/755064319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9aec1033d0 msgr2=0x7f9aec100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9aeaffd640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9aec1033d0 0x7f9aec100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9aeaffd640 1 -- 172.21.15.45:0/755064319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aec101190 con 0x7f9aec102ab0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9aeaffd640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aec102ab0 0x7f9aec100710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9adc031460 tx=0x7f9adc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9ad3fff640 1 -- 172.21.15.45:0/755064319 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9adc03f070 con 0x7f9aec102ab0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9ad3fff640 1 -- 172.21.15.45:0/755064319 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9adc0035f0 con 0x7f9aec102ab0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9af133f640 1 -- 172.21.15.45:0/755064319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aec101420 con 0x7f9aec102ab0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9ad3fff640 1 -- 172.21.15.45:0/755064319 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9adc035030 con 0x7f9aec102ab0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.846+0000 7f9af133f640 1 -- 172.21.15.45:0/755064319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aec1a3d70 con 0x7f9aec102ab0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.847+0000 7f9af133f640 1 -- 172.21.15.45:0/755064319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aec06a580 con 0x7f9aec102ab0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.848+0000 7f9ad3fff640 1 -- 172.21.15.45:0/755064319 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f9adc042070 con 0x7f9aec102ab0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.849+0000 7f9ad3fff640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9ad407af30 0x7f9ad407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.849+0000 7f9aea7fc640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9ad407af30 0x7f9ad407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.849+0000 7f9ad3fff640 1 -- 172.21.15.45:0/755064319 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f9adc0bea80 con 0x7f9aec102ab0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.849+0000 7f9aea7fc640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9ad407af30 0x7f9ad407d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9aec1021a0 tx=0x7f9ae0005eb0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:33.853+0000 7f9ad3fff640 1 -- 172.21.15.45:0/755064319 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9adc08a020 con 0x7f9aec102ab0 2024-09-18T13:03:34.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:33 smithi161 ceph-mon[80292]: pgmap v358: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:34.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:33 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2930387762' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-18T13:03:34.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.076+0000 7f9af133f640 1 -- 172.21.15.45:0/755064319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f9aec1a40c0 con 0x7f9aec102ab0 2024-09-18T13:03:34.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.077+0000 7f9ad3fff640 1 -- 172.21.15.45:0/755064319 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v37) ==== 107+0+4476 (secure 0 0 0) 0x7f9adc08c020 con 0x7f9aec102ab0 2024-09-18T13:03:34.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:34.078 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"btime":"2024-09-18T13:00:34:050799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:22.563621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24321":{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":0,"incarnation":20,"state":"up:active","state_seq":167,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24321,"qdb_cluster":[24321]},"id":1}]} 2024-09-18T13:03:34.078 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2024-09-18T13:03:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 -- 172.21.15.45:0/755064319 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9ad407af30 msgr2=0x7f9ad407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9ad407af30 0x7f9ad407d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9aec1021a0 tx=0x7f9ae0005eb0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 -- 172.21.15.45:0/755064319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aec102ab0 msgr2=0x7f9aec100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aec102ab0 0x7f9aec100710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9adc031460 tx=0x7f9adc0045e0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 -- 172.21.15.45:0/755064319 shutdown_connections 2024-09-18T13:03:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f9ad407af30 0x7f9ad407d3f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9aec1033d0 0x7f9aec100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 --2- 172.21.15.45:0/755064319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aec102ab0 0x7f9aec100710 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 -- 172.21.15.45:0/755064319 >> 172.21.15.45:0/755064319 conn(0x7f9aec0fc550 msgr2=0x7f9aec10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 -- 172.21.15.45:0/755064319 shutdown_connections 2024-09-18T13:03:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:34.079+0000 7f9af133f640 1 -- 172.21.15.45:0/755064319 wait complete. 2024-09-18T13:03:34.658 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:34 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/755064319' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-18T13:03:34.689 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-18T13:03:34.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-18T13:03:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:35.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:34 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/755064319' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-18T13:03:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.344+0000 7fafb9090640 1 -- 172.21.15.45:0/1706132187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb4106800 msgr2=0x7fafb4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.344+0000 7fafb9090640 1 --2- 172.21.15.45:0/1706132187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb4106800 0x7fafb4106be0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009900 tx=0x7fafa402c6e0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.344+0000 7fafb9090640 1 -- 172.21.15.45:0/1706132187 shutdown_connections 2024-09-18T13:03:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.344+0000 7fafb9090640 1 --2- 172.21.15.45:0/1706132187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafb4100800 0x7fafb4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.344+0000 7fafb9090640 1 --2- 172.21.15.45:0/1706132187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb4106800 0x7fafb4106be0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.344+0000 7fafb9090640 1 -- 172.21.15.45:0/1706132187 >> 172.21.15.45:0/1706132187 conn(0x7fafb40fc520 msgr2=0x7fafb40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.344+0000 7fafb9090640 1 -- 172.21.15.45:0/1706132187 shutdown_connections 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.344+0000 7fafb9090640 1 -- 172.21.15.45:0/1706132187 wait complete. 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafb9090640 1 Processor -- start 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafb9090640 1 -- start start 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafb9090640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafb4100800 0x7fafb419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafb9090640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb4106800 0x7fafb419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafb9090640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fafb410cbe0 con 0x7fafb4106800 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafb9090640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fafb410ca60 con 0x7fafb4100800 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafabfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb4106800 0x7fafb419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafabfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb4106800 0x7fafb419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58950/0 (socket says 172.21.15.45:58950) 2024-09-18T13:03:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafabfff640 1 -- 172.21.15.45:0/2763762436 learned_addr learned my addr 172.21.15.45:0/2763762436 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafb2d9d640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafb4100800 0x7fafb419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafabfff640 1 -- 172.21.15.45:0/2763762436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafb4100800 msgr2=0x7fafb419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafabfff640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafb4100800 0x7fafb419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.345+0000 7fafabfff640 1 -- 172.21.15.45:0/2763762436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb41999e0 con 0x7fafb4106800 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.346+0000 7fafabfff640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb4106800 0x7fafb419fd60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00d6f0 tx=0x7faf9c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.346+0000 7fafb0d99640 1 -- 172.21.15.45:0/2763762436 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf9c017070 con 0x7fafb4106800 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.346+0000 7fafb0d99640 1 -- 172.21.15.45:0/2763762436 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf9c00de00 con 0x7fafb4106800 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.346+0000 7fafb9090640 1 -- 172.21.15.45:0/2763762436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb4199cd0 con 0x7fafb4106800 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.346+0000 7fafb0d99640 1 -- 172.21.15.45:0/2763762436 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf9c004bb0 con 0x7fafb4106800 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.346+0000 7fafb9090640 1 -- 172.21.15.45:0/2763762436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb419a260 con 0x7fafb4106800 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.347+0000 7fafb9090640 1 -- 172.21.15.45:0/2763762436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb4101f40 con 0x7fafb4106800 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.348+0000 7fafb0d99640 1 -- 172.21.15.45:0/2763762436 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7faf9c009a30 con 0x7fafb4106800 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.348+0000 7fafb0d99640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fafa007af80 0x7fafa007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.348+0000 7fafb2d9d640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fafa007af80 0x7fafa007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.348+0000 7fafb0d99640 1 -- 172.21.15.45:0/2763762436 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7faf9c09db20 con 0x7fafb4106800 2024-09-18T13:03:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.349+0000 7fafb2d9d640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fafa007af80 0x7fafa007d440 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fafa4000c00 tx=0x7fafa4033400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.353+0000 7fafb0d99640 1 -- 172.21.15.45:0/2763762436 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7faf9c069140 con 0x7fafb4106800 2024-09-18T13:03:35.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.574+0000 7fafb9090640 1 -- 172.21.15.45:0/2763762436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7fafb419af10 con 0x7fafb4106800 2024-09-18T13:03:35.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.575+0000 7fafb0d99640 1 -- 172.21.15.45:0/2763762436 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v37) ==== 107+0+5323 (secure 0 0 0) 0x7faf9c06dff0 con 0x7fafb4106800 2024-09-18T13:03:35.577 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:35.577 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"btime":"2024-09-18T13:00:38:327671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24329,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/3263862050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3263862050},{"type":"v1","addr":"172.21.15.161:6825","nonce":3263862050}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:22.563621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24321":{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":0,"incarnation":20,"state":"up:active","state_seq":167,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24321,"qdb_cluster":[24321]},"id":1}]} 2024-09-18T13:03:35.577 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2024-09-18T13:03:35.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 -- 172.21.15.45:0/2763762436 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fafa007af80 msgr2=0x7fafa007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fafa007af80 0x7fafa007d440 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fafa4000c00 tx=0x7fafa4033400 comp rx=0 tx=0).stop 2024-09-18T13:03:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 -- 172.21.15.45:0/2763762436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb4106800 msgr2=0x7fafb419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb4106800 0x7fafb419fd60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00d6f0 tx=0x7faf9c00dbb0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 -- 172.21.15.45:0/2763762436 shutdown_connections 2024-09-18T13:03:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fafa007af80 0x7fafa007d440 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb4106800 0x7fafb419fd60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 --2- 172.21.15.45:0/2763762436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafb4100800 0x7fafb419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 -- 172.21.15.45:0/2763762436 >> 172.21.15.45:0/2763762436 conn(0x7fafb40fc520 msgr2=0x7fafb40fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 -- 172.21.15.45:0/2763762436 shutdown_connections 2024-09-18T13:03:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:35.577+0000 7fafb9090640 1 -- 172.21.15.45:0/2763762436 wait complete. 2024-09-18T13:03:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:35 smithi045 ceph-mon[109129]: pgmap v359: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:36.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:35 smithi161 ceph-mon[80292]: pgmap v359: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:36.153 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-18T13:03:36.154 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-18T13:03:36.423 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:36.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:36 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2763762436' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-18T13:03:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.913+0000 7f261e38a640 1 -- 172.21.15.45:0/4241680575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2618102ab0 msgr2=0x7f2618102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.913+0000 7f261e38a640 1 --2- 172.21.15.45:0/4241680575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2618102ab0 0x7f2618102e90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2608009880 tx=0x7f260802a530 comp rx=0 tx=0).stop 2024-09-18T13:03:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.913+0000 7f261e38a640 1 -- 172.21.15.45:0/4241680575 shutdown_connections 2024-09-18T13:03:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.913+0000 7f261e38a640 1 --2- 172.21.15.45:0/4241680575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26181033d0 0x7f261810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.913+0000 7f261e38a640 1 --2- 172.21.15.45:0/4241680575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2618102ab0 0x7f2618102e90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.913+0000 7f261e38a640 1 -- 172.21.15.45:0/4241680575 >> 172.21.15.45:0/4241680575 conn(0x7f26180fc550 msgr2=0x7f26180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.913+0000 7f261e38a640 1 -- 172.21.15.45:0/4241680575 shutdown_connections 2024-09-18T13:03:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.913+0000 7f261e38a640 1 -- 172.21.15.45:0/4241680575 wait complete. 2024-09-18T13:03:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.913+0000 7f261e38a640 1 Processor -- start 2024-09-18T13:03:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.913+0000 7f261e38a640 1 -- start start 2024-09-18T13:03:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f261e38a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2618102ab0 0x7f261819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f261e38a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26181033d0 0x7f261819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f261e38a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f261810edc0 con 0x7f2618102ab0 2024-09-18T13:03:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f261e38a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f261810ec40 con 0x7f26181033d0 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f2617fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2618102ab0 0x7f261819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f2617fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2618102ab0 0x7f261819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58964/0 (socket says 172.21.15.45:58964) 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f2617fff640 1 -- 172.21.15.45:0/546476256 learned_addr learned my addr 172.21.15.45:0/546476256 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f26177fe640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26181033d0 0x7f261819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f2617fff640 1 -- 172.21.15.45:0/546476256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26181033d0 msgr2=0x7f261819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f2617fff640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26181033d0 0x7f261819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f2617fff640 1 -- 172.21.15.45:0/546476256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26181977b0 con 0x7f2618102ab0 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.914+0000 7f2617fff640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2618102ab0 0x7f261819d630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2608031460 tx=0x7f26080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.915+0000 7f26157fa640 1 -- 172.21.15.45:0/546476256 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f260803f070 con 0x7f2618102ab0 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.915+0000 7f26157fa640 1 -- 172.21.15.45:0/546476256 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2608004cf0 con 0x7f2618102ab0 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.915+0000 7f261e38a640 1 -- 172.21.15.45:0/546476256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2618197a40 con 0x7f2618102ab0 2024-09-18T13:03:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.915+0000 7f26157fa640 1 -- 172.21.15.45:0/546476256 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2608035030 con 0x7f2618102ab0 2024-09-18T13:03:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.915+0000 7f261e38a640 1 -- 172.21.15.45:0/546476256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2618197f70 con 0x7f2618102ab0 2024-09-18T13:03:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.916+0000 7f261e38a640 1 -- 172.21.15.45:0/546476256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f261806a580 con 0x7f2618102ab0 2024-09-18T13:03:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.916+0000 7f26157fa640 1 -- 172.21.15.45:0/546476256 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f2608042070 con 0x7f2618102ab0 2024-09-18T13:03:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.917+0000 7f26157fa640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f260007af30 0x7f260007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.917+0000 7f26177fe640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f260007af30 0x7f260007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:36.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.917+0000 7f26157fa640 1 -- 172.21.15.45:0/546476256 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f26080beb20 con 0x7f2618102ab0 2024-09-18T13:03:36.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.918+0000 7f26177fe640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f260007af30 0x7f260007d3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f260c005fd0 tx=0x7f260c005f60 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:36.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:36.921+0000 7f26157fa640 1 -- 172.21.15.45:0/546476256 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f260808a0c0 con 0x7f2618102ab0 2024-09-18T13:03:37.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:36 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2763762436' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-18T13:03:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.141+0000 7f261e38a640 1 -- 172.21.15.45:0/546476256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7f2618105f80 con 0x7f2618102ab0 2024-09-18T13:03:37.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.142+0000 7f26157fa640 1 -- 172.21.15.45:0/546476256 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v37) ==== 107+0+4473 (secure 0 0 0) 0x7f260808ef70 con 0x7f2618102ab0 2024-09-18T13:03:37.144 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:37.144 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"btime":"2024-09-18T13:00:49:884781+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:22.563621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24321":{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":0,"incarnation":20,"state":"up:active","state_seq":167,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24321,"qdb_cluster":[24321]},"id":1}]} 2024-09-18T13:03:37.145 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 26 2024-09-18T13:03:37.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.144+0000 7f261e38a640 1 -- 172.21.15.45:0/546476256 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f260007af30 msgr2=0x7f260007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.144+0000 7f261e38a640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f260007af30 0x7f260007d3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f260c005fd0 tx=0x7f260c005f60 comp rx=0 tx=0).stop 2024-09-18T13:03:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.144+0000 7f261e38a640 1 -- 172.21.15.45:0/546476256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2618102ab0 msgr2=0x7f261819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.144+0000 7f261e38a640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2618102ab0 0x7f261819d630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2608031460 tx=0x7f26080048f0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.144+0000 7f261e38a640 1 -- 172.21.15.45:0/546476256 shutdown_connections 2024-09-18T13:03:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.144+0000 7f261e38a640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f260007af30 0x7f260007d3f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.144+0000 7f261e38a640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26181033d0 0x7f261819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.144+0000 7f261e38a640 1 --2- 172.21.15.45:0/546476256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2618102ab0 0x7f261819d630 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.144+0000 7f261e38a640 1 -- 172.21.15.45:0/546476256 >> 172.21.15.45:0/546476256 conn(0x7f26180fc550 msgr2=0x7f2618108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.145+0000 7f261e38a640 1 -- 172.21.15.45:0/546476256 shutdown_connections 2024-09-18T13:03:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:37.145+0000 7f261e38a640 1 -- 172.21.15.45:0/546476256 wait complete. 2024-09-18T13:03:37.707 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:37 smithi045 ceph-mon[109129]: pgmap v360: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:37.707 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:37 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/546476256' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-18T13:03:37.735 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-18T13:03:37.735 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-18T13:03:37.996 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:38.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:37 smithi161 ceph-mon[80292]: pgmap v360: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:38.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:37 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/546476256' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-18T13:03:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.458+0000 7f652e907640 1 -- 172.21.15.45:0/1982344963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6528107900 msgr2=0x7f6528107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.458+0000 7f652e907640 1 --2- 172.21.15.45:0/1982344963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6528107900 0x7f6528107ce0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6518009880 tx=0x7f651802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.458+0000 7f652e907640 1 -- 172.21.15.45:0/1982344963 shutdown_connections 2024-09-18T13:03:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.458+0000 7f652e907640 1 --2- 172.21.15.45:0/1982344963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6528101900 0x7f6528101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.458+0000 7f652e907640 1 --2- 172.21.15.45:0/1982344963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6528107900 0x7f6528107ce0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.458+0000 7f652e907640 1 -- 172.21.15.45:0/1982344963 >> 172.21.15.45:0/1982344963 conn(0x7f65280fd600 msgr2=0x7f65280ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.458+0000 7f652e907640 1 -- 172.21.15.45:0/1982344963 shutdown_connections 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.458+0000 7f652e907640 1 -- 172.21.15.45:0/1982344963 wait complete. 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.459+0000 7f652e907640 1 Processor -- start 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.459+0000 7f652e907640 1 -- start start 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.459+0000 7f652e907640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6528101900 0x7f65280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.459+0000 7f652e907640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6528107900 0x7f6528074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.459+0000 7f652e907640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f652810ee30 con 0x7f6528107900 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.459+0000 7f652e907640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f652810ecb0 con 0x7f6528101900 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.459+0000 7f65277fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6528107900 0x7f6528074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.459+0000 7f65277fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6528107900 0x7f6528074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58988/0 (socket says 172.21.15.45:58988) 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.459+0000 7f65277fe640 1 -- 172.21.15.45:0/434865996 learned_addr learned my addr 172.21.15.45:0/434865996 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.460+0000 7f6527fff640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6528101900 0x7f65280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.460+0000 7f65277fe640 1 -- 172.21.15.45:0/434865996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6528101900 msgr2=0x7f65280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.460+0000 7f65277fe640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6528101900 0x7f65280744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.460+0000 7f65277fe640 1 -- 172.21.15.45:0/434865996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6528074f70 con 0x7f6528107900 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.460+0000 7f65277fe640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6528107900 0x7f6528074a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f651c00b420 tx=0x7f651c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.460+0000 7f65257fa640 1 -- 172.21.15.45:0/434865996 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f651c011630 con 0x7f6528107900 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.460+0000 7f65257fa640 1 -- 172.21.15.45:0/434865996 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f651c016070 con 0x7f6528107900 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.460+0000 7f652e907640 1 -- 172.21.15.45:0/434865996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6528075260 con 0x7f6528107900 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.460+0000 7f65257fa640 1 -- 172.21.15.45:0/434865996 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f651c010d40 con 0x7f6528107900 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.460+0000 7f652e907640 1 -- 172.21.15.45:0/434865996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65281a3e90 con 0x7f6528107900 2024-09-18T13:03:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.461+0000 7f652e907640 1 -- 172.21.15.45:0/434865996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6528103040 con 0x7f6528107900 2024-09-18T13:03:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.462+0000 7f65257fa640 1 -- 172.21.15.45:0/434865996 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f651c01b460 con 0x7f6528107900 2024-09-18T13:03:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.462+0000 7f65257fa640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f651007af30 0x7f651007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.463+0000 7f65257fa640 1 -- 172.21.15.45:0/434865996 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f651c09d8b0 con 0x7f6528107900 2024-09-18T13:03:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.463+0000 7f6527fff640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f651007af30 0x7f651007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.463+0000 7f6527fff640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f651007af30 0x7f651007d3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65180096c0 tx=0x7f6518031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.467+0000 7f65257fa640 1 -- 172.21.15.45:0/434865996 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f651c021250 con 0x7f6528107900 2024-09-18T13:03:38.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.691+0000 7f652e907640 1 -- 172.21.15.45:0/434865996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7f6528109e70 con 0x7f6528107900 2024-09-18T13:03:38.694 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:38.694 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:03:38.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.692+0000 7f65257fa640 1 -- 172.21.15.45:0/434865996 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v37) ==== 107+0+5323 (secure 0 0 0) 0x7f651c068db0 con 0x7f6528107900 2024-09-18T13:03:38.695 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:38.695 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"btime":"2024-09-18T13:00:55:333753+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:00:22.563621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24321":{"gid":24321,"name":"cephfs.smithi161.maxdew","rank":0,"incarnation":20,"state":"up:active","state_seq":167,"addr":"172.21.15.161:6827/3769095439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3769095439},{"type":"v1","addr":"172.21.15.161:6827","nonce":3769095439}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24321,"qdb_cluster":[24321]},"id":1}]} 2024-09-18T13:03:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 27 2024-09-18T13:03:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 -- 172.21.15.45:0/434865996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f651007af30 msgr2=0x7f651007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f651007af30 0x7f651007d3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65180096c0 tx=0x7f6518031400 comp rx=0 tx=0).stop 2024-09-18T13:03:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 -- 172.21.15.45:0/434865996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6528107900 msgr2=0x7f6528074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6528107900 0x7f6528074a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f651c00b420 tx=0x7f651c00b8e0 comp rx=0 tx=0).stop 2024-09-18T13:03:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 -- 172.21.15.45:0/434865996 shutdown_connections 2024-09-18T13:03:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f651007af30 0x7f651007d3f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6528107900 0x7f6528074a30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 --2- 172.21.15.45:0/434865996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6528101900 0x7f65280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 -- 172.21.15.45:0/434865996 >> 172.21.15.45:0/434865996 conn(0x7f65280fd600 msgr2=0x7f65280fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 -- 172.21.15.45:0/434865996 shutdown_connections 2024-09-18T13:03:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:38.695+0000 7f652e907640 1 -- 172.21.15.45:0/434865996 wait complete. 2024-09-18T13:03:39.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:39.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:03:39.337 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-18T13:03:39.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-18T13:03:39.597 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:39.838 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:39 smithi045 ceph-mon[109129]: pgmap v361: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:39.838 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:39 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/434865996' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-18T13:03:39.839 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:03:39.839 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:03:39.839 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:03:40.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.001+0000 7fcbe3633640 1 -- 172.21.15.45:0/1312529791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbdc101900 msgr2=0x7fcbdc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:40.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.001+0000 7fcbe3633640 1 --2- 172.21.15.45:0/1312529791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbdc101900 0x7fcbdc101d60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009880 tx=0x7fcbcc02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.001+0000 7fcbe3633640 1 -- 172.21.15.45:0/1312529791 shutdown_connections 2024-09-18T13:03:40.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.001+0000 7fcbe3633640 1 --2- 172.21.15.45:0/1312529791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbdc101900 0x7fcbdc101d60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.001+0000 7fcbe3633640 1 --2- 172.21.15.45:0/1312529791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc107900 0x7fcbdc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.001+0000 7fcbe3633640 1 -- 172.21.15.45:0/1312529791 >> 172.21.15.45:0/1312529791 conn(0x7fcbdc0fd600 msgr2=0x7fcbdc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:40.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.001+0000 7fcbe3633640 1 -- 172.21.15.45:0/1312529791 shutdown_connections 2024-09-18T13:03:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.002+0000 7fcbe3633640 1 -- 172.21.15.45:0/1312529791 wait complete. 2024-09-18T13:03:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.002+0000 7fcbe3633640 1 Processor -- start 2024-09-18T13:03:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.002+0000 7fcbe3633640 1 -- start start 2024-09-18T13:03:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.002+0000 7fcbe3633640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbdc101900 0x7fcbdc19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.002+0000 7fcbe3633640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc107900 0x7fcbdc19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.002+0000 7fcbe3633640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc10ee30 con 0x7fcbdc101900 2024-09-18T13:03:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.002+0000 7fcbe3633640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc10ecb0 con 0x7fcbdc107900 2024-09-18T13:03:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbe13cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbdc101900 0x7fcbdc19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbe13cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbdc101900 0x7fcbdc19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58994/0 (socket says 172.21.15.45:58994) 2024-09-18T13:03:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbe13cf640 1 -- 172.21.15.45:0/2234800588 learned_addr learned my addr 172.21.15.45:0/2234800588 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:40.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbe0bce640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc107900 0x7fcbdc19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:40.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbe13cf640 1 -- 172.21.15.45:0/2234800588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc107900 msgr2=0x7fcbdc19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:40.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbe13cf640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc107900 0x7fcbdc19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbe13cf640 1 -- 172.21.15.45:0/2234800588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbdc197840 con 0x7fcbdc101900 2024-09-18T13:03:40.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbe13cf640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbdc101900 0x7fcbdc19d6c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800b420 tx=0x7fcbd800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbd27fc640 1 -- 172.21.15.45:0/2234800588 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbd8011630 con 0x7fcbdc101900 2024-09-18T13:03:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbd27fc640 1 -- 172.21.15.45:0/2234800588 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcbd8016070 con 0x7fcbdc101900 2024-09-18T13:03:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbe3633640 1 -- 172.21.15.45:0/2234800588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbdc197b30 con 0x7fcbdc101900 2024-09-18T13:03:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbd27fc640 1 -- 172.21.15.45:0/2234800588 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbd8010d40 con 0x7fcbdc101900 2024-09-18T13:03:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.003+0000 7fcbe3633640 1 -- 172.21.15.45:0/2234800588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbdc198090 con 0x7fcbdc101900 2024-09-18T13:03:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.004+0000 7fcbe3633640 1 -- 172.21.15.45:0/2234800588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbdc103040 con 0x7fcbdc101900 2024-09-18T13:03:40.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.005+0000 7fcbd27fc640 1 -- 172.21.15.45:0/2234800588 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fcbd801b460 con 0x7fcbdc101900 2024-09-18T13:03:40.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.006+0000 7fcbd27fc640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fcbc807af30 0x7fcbc807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:40.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.006+0000 7fcbe0bce640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fcbc807af30 0x7fcbc807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:40.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.006+0000 7fcbd27fc640 1 -- 172.21.15.45:0/2234800588 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fcbd809d6f0 con 0x7fcbdc101900 2024-09-18T13:03:40.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.006+0000 7fcbe0bce640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fcbc807af30 0x7fcbc807d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc198b90 tx=0x7fcbcc031400 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:40.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.010+0000 7fcbd27fc640 1 -- 172.21.15.45:0/2234800588 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcbd8068c90 con 0x7fcbdc101900 2024-09-18T13:03:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:39 smithi161 ceph-mon[80292]: pgmap v361: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:39 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/434865996' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-18T13:03:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:03:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:03:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:03:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.233+0000 7fcbe3633640 1 -- 172.21.15.45:0/2234800588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7fcbdc109e90 con 0x7fcbdc101900 2024-09-18T13:03:40.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.234+0000 7fcbd27fc640 1 -- 172.21.15.45:0/2234800588 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v37) ==== 107+0+4451 (secure 0 0 0) 0x7fcbd8069e20 con 0x7fcbdc101900 2024-09-18T13:03:40.235 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:40.235 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"btime":"2024-09-18T13:01:04:452168+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:01:04.452162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:40.235 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 28 2024-09-18T13:03:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 -- 172.21.15.45:0/2234800588 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fcbc807af30 msgr2=0x7fcbc807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fcbc807af30 0x7fcbc807d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc198b90 tx=0x7fcbcc031400 comp rx=0 tx=0).stop 2024-09-18T13:03:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 -- 172.21.15.45:0/2234800588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbdc101900 msgr2=0x7fcbdc19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbdc101900 0x7fcbdc19d6c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800b420 tx=0x7fcbd800b8e0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 -- 172.21.15.45:0/2234800588 shutdown_connections 2024-09-18T13:03:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fcbc807af30 0x7fcbc807d3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc107900 0x7fcbdc19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 --2- 172.21.15.45:0/2234800588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbdc101900 0x7fcbdc19d6c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:40.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 -- 172.21.15.45:0/2234800588 >> 172.21.15.45:0/2234800588 conn(0x7fcbdc0fd600 msgr2=0x7fcbdc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:40.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 -- 172.21.15.45:0/2234800588 shutdown_connections 2024-09-18T13:03:40.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:40.236+0000 7fcbe3633640 1 -- 172.21.15.45:0/2234800588 wait complete. 2024-09-18T13:03:40.840 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:40 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2234800588' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-18T13:03:40.871 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-18T13:03:40.871 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-18T13:03:41.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:40 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2234800588' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-18T13:03:41.130 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.560+0000 7fa2811a0640 1 -- 172.21.15.45:0/1073027676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c106650 msgr2=0x7fa27c106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.560+0000 7fa2811a0640 1 --2- 172.21.15.45:0/1073027676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c106650 0x7fa27c106a30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009880 tx=0x7fa26c02a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.560+0000 7fa2811a0640 1 -- 172.21.15.45:0/1073027676 shutdown_connections 2024-09-18T13:03:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.560+0000 7fa2811a0640 1 --2- 172.21.15.45:0/1073027676 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27c100650 0x7fa27c100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.560+0000 7fa2811a0640 1 --2- 172.21.15.45:0/1073027676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c106650 0x7fa27c106a30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.560+0000 7fa2811a0640 1 -- 172.21.15.45:0/1073027676 >> 172.21.15.45:0/1073027676 conn(0x7fa27c0fc350 msgr2=0x7fa27c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.560+0000 7fa2811a0640 1 -- 172.21.15.45:0/1073027676 shutdown_connections 2024-09-18T13:03:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.560+0000 7fa2811a0640 1 -- 172.21.15.45:0/1073027676 wait complete. 2024-09-18T13:03:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa2811a0640 1 Processor -- start 2024-09-18T13:03:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa2811a0640 1 -- start start 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa2811a0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27c100650 0x7fa27c196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa2811a0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c106650 0x7fa27c196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa2811a0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c10db00 con 0x7fa27c106650 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa2811a0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c10d980 con 0x7fa27c100650 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa27b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c106650 0x7fa27c196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa27b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c106650 0x7fa27c196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59012/0 (socket says 172.21.15.45:59012) 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa27b7fe640 1 -- 172.21.15.45:0/150626900 learned_addr learned my addr 172.21.15.45:0/150626900 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa27bfff640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27c100650 0x7fa27c196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa27b7fe640 1 -- 172.21.15.45:0/150626900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27c100650 msgr2=0x7fa27c196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa27b7fe640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27c100650 0x7fa27c196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.561+0000 7fa27b7fe640 1 -- 172.21.15.45:0/150626900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c19afd0 con 0x7fa27c106650 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.562+0000 7fa27b7fe640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c106650 0x7fa27c196c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c810 tx=0x7fa27000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.562+0000 7fa2797fa640 1 -- 172.21.15.45:0/150626900 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa270004020 con 0x7fa27c106650 2024-09-18T13:03:41.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.562+0000 7fa2797fa640 1 -- 172.21.15.45:0/150626900 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2700041c0 con 0x7fa27c106650 2024-09-18T13:03:41.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.562+0000 7fa2811a0640 1 -- 172.21.15.45:0/150626900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27c19b2c0 con 0x7fa27c106650 2024-09-18T13:03:41.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.562+0000 7fa2797fa640 1 -- 172.21.15.45:0/150626900 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2700047a0 con 0x7fa27c106650 2024-09-18T13:03:41.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.562+0000 7fa2811a0640 1 -- 172.21.15.45:0/150626900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27c19b850 con 0x7fa27c106650 2024-09-18T13:03:41.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.563+0000 7fa2811a0640 1 -- 172.21.15.45:0/150626900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27c101d90 con 0x7fa27c106650 2024-09-18T13:03:41.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.564+0000 7fa2797fa640 1 -- 172.21.15.45:0/150626900 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fa2700079b0 con 0x7fa27c106650 2024-09-18T13:03:41.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.564+0000 7fa2797fa640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa26407af40 0x7fa26407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:41.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.564+0000 7fa27bfff640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa26407af40 0x7fa26407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:41.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.564+0000 7fa2797fa640 1 -- 172.21.15.45:0/150626900 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fa27009dfe0 con 0x7fa27c106650 2024-09-18T13:03:41.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.565+0000 7fa27bfff640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa26407af40 0x7fa26407d400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa26c031460 tx=0x7fa26c009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:41.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.569+0000 7fa2797fa640 1 -- 172.21.15.45:0/150626900 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa270014030 con 0x7fa27c106650 2024-09-18T13:03:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.797+0000 7fa2811a0640 1 -- 172.21.15.45:0/150626900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7fa27c103860 con 0x7fa27c106650 2024-09-18T13:03:41.799 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:41 smithi045 ceph-mon[109129]: pgmap v362: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.798+0000 7fa2797fa640 1 -- 172.21.15.45:0/150626900 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v37) ==== 107+0+4462 (secure 0 0 0) 0x7fa270069500 con 0x7fa27c106650 2024-09-18T13:03:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:41.800 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"btime":"2024-09-18T13:01:04:457706+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:01:04.457687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34318":{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.800+0000 7fa2811a0640 1 -- 172.21.15.45:0/150626900 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa26407af40 msgr2=0x7fa26407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.800+0000 7fa2811a0640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa26407af40 0x7fa26407d400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa26c031460 tx=0x7fa26c009560 comp rx=0 tx=0).stop 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.800+0000 7fa2811a0640 1 -- 172.21.15.45:0/150626900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c106650 msgr2=0x7fa27c196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.800+0000 7fa2811a0640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c106650 0x7fa27c196c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c810 tx=0x7fa27000ccd0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.801+0000 7fa2811a0640 1 -- 172.21.15.45:0/150626900 shutdown_connections 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.801+0000 7fa2811a0640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fa26407af40 0x7fa26407d400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.801+0000 7fa2811a0640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c106650 0x7fa27c196c40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.801+0000 7fa2811a0640 1 --2- 172.21.15.45:0/150626900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27c100650 0x7fa27c196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.801+0000 7fa2811a0640 1 -- 172.21.15.45:0/150626900 >> 172.21.15.45:0/150626900 conn(0x7fa27c0fc350 msgr2=0x7fa27c0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.801+0000 7fa2811a0640 1 -- 172.21.15.45:0/150626900 shutdown_connections 2024-09-18T13:03:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:41.801+0000 7fa2811a0640 1 -- 172.21.15.45:0/150626900 wait complete. 2024-09-18T13:03:42.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:41 smithi161 ceph-mon[80292]: pgmap v362: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:42.386 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-18T13:03:42.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-18T13:03:42.660 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:42.680 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:42 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/150626900' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-18T13:03:43.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:42 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/150626900' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-18T13:03:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.104+0000 7f8f8f063640 1 -- 172.21.15.45:0/2608164362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f881007f0 msgr2=0x7f8f88100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.104+0000 7f8f8f063640 1 --2- 172.21.15.45:0/2608164362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f881007f0 0x7f8f88100c50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009880 tx=0x7f8f7402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.104+0000 7f8f8f063640 1 -- 172.21.15.45:0/2608164362 shutdown_connections 2024-09-18T13:03:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.104+0000 7f8f8f063640 1 --2- 172.21.15.45:0/2608164362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f881007f0 0x7f8f88100c50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.104+0000 7f8f8f063640 1 --2- 172.21.15.45:0/2608164362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f881067f0 0x7f8f88106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.104+0000 7f8f8f063640 1 -- 172.21.15.45:0/2608164362 >> 172.21.15.45:0/2608164362 conn(0x7f8f880fc550 msgr2=0x7f8f880fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.104+0000 7f8f8f063640 1 -- 172.21.15.45:0/2608164362 shutdown_connections 2024-09-18T13:03:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.104+0000 7f8f8f063640 1 -- 172.21.15.45:0/2608164362 wait complete. 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.105+0000 7f8f8f063640 1 Processor -- start 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.105+0000 7f8f8f063640 1 -- start start 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.105+0000 7f8f8f063640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f881007f0 0x7f8f8810b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.105+0000 7f8f8f063640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f881067f0 0x7f8f8810bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.105+0000 7f8f8f063640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8810ede0 con 0x7f8f881067f0 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.105+0000 7f8f8f063640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8810ec60 con 0x7f8f881007f0 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.105+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f881067f0 0x7f8f8810bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.105+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f881067f0 0x7f8f8810bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52692/0 (socket says 172.21.15.45:52692) 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.105+0000 7f8f87fff640 1 -- 172.21.15.45:0/3238703353 learned_addr learned my addr 172.21.15.45:0/3238703353 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.105+0000 7f8f8cdff640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f881007f0 0x7f8f8810b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.106+0000 7f8f87fff640 1 -- 172.21.15.45:0/3238703353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f881007f0 msgr2=0x7f8f8810b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.106+0000 7f8f87fff640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f881007f0 0x7f8f8810b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.106+0000 7f8f87fff640 1 -- 172.21.15.45:0/3238703353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8810c200 con 0x7f8f881067f0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.106+0000 7f8f87fff640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f881067f0 0x7f8f8810bcc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f74031460 tx=0x7f8f740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.106+0000 7f8f85ffb640 1 -- 172.21.15.45:0/3238703353 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f7403f070 con 0x7f8f881067f0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.106+0000 7f8f85ffb640 1 -- 172.21.15.45:0/3238703353 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f740035f0 con 0x7f8f881067f0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.106+0000 7f8f8f063640 1 -- 172.21.15.45:0/3238703353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8810c490 con 0x7f8f881067f0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.106+0000 7f8f85ffb640 1 -- 172.21.15.45:0/3238703353 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f74035030 con 0x7f8f881067f0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.106+0000 7f8f8f063640 1 -- 172.21.15.45:0/3238703353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f881a3d90 con 0x7f8f881067f0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.108+0000 7f8f8f063640 1 -- 172.21.15.45:0/3238703353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f88101f30 con 0x7f8f881067f0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.108+0000 7f8f85ffb640 1 -- 172.21.15.45:0/3238703353 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f8f74042070 con 0x7f8f881067f0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.109+0000 7f8f85ffb640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8f7807af30 0x7f8f7807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.109+0000 7f8f8cdff640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8f7807af30 0x7f8f7807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.109+0000 7f8f85ffb640 1 -- 172.21.15.45:0/3238703353 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f8f740be9d0 con 0x7f8f881067f0 2024-09-18T13:03:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.109+0000 7f8f8cdff640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8f7807af30 0x7f8f7807d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c005fd0 tx=0x7f8f7c00b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:43.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.113+0000 7f8f85ffb640 1 -- 172.21.15.45:0/3238703353 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8f74089f70 con 0x7f8f881067f0 2024-09-18T13:03:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.336+0000 7f8f8f063640 1 -- 172.21.15.45:0/3238703353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7f8f8810ccb0 con 0x7f8f881067f0 2024-09-18T13:03:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.336+0000 7f8f85ffb640 1 -- 172.21.15.45:0/3238703353 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v37) ==== 107+0+5309 (secure 0 0 0) 0x7f8f7408ee20 con 0x7f8f881067f0 2024-09-18T13:03:43.338 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:43.338 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":30,"btime":"2024-09-18T13:01:10:012458+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/781506559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":781506559},{"type":"v1","addr":"172.21.15.161:6827","nonce":781506559}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:01:04.457687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34318":{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 30 2024-09-18T13:03:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 -- 172.21.15.45:0/3238703353 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8f7807af30 msgr2=0x7f8f7807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8f7807af30 0x7f8f7807d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c005fd0 tx=0x7f8f7c00b390 comp rx=0 tx=0).stop 2024-09-18T13:03:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 -- 172.21.15.45:0/3238703353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f881067f0 msgr2=0x7f8f8810bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f881067f0 0x7f8f8810bcc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f74031460 tx=0x7f8f740045e0 comp rx=0 tx=0).stop 2024-09-18T13:03:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 -- 172.21.15.45:0/3238703353 shutdown_connections 2024-09-18T13:03:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f8f7807af30 0x7f8f7807d3f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f881067f0 0x7f8f8810bcc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 --2- 172.21.15.45:0/3238703353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f881007f0 0x7f8f8810b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 -- 172.21.15.45:0/3238703353 >> 172.21.15.45:0/3238703353 conn(0x7f8f880fc550 msgr2=0x7f8f880fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 -- 172.21.15.45:0/3238703353 shutdown_connections 2024-09-18T13:03:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:43.339+0000 7f8f8f063640 1 -- 172.21.15.45:0/3238703353 wait complete. 2024-09-18T13:03:43.672 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:43 smithi045 ceph-mon[109129]: pgmap v363: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:43.673 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:43 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3238703353' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-18T13:03:43.959 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-18T13:03:43.960 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-18T13:03:44.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:43 smithi161 ceph-mon[80292]: pgmap v363: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:44.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:43 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3238703353' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-18T13:03:44.221 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.695+0000 7f0019c29640 1 -- 172.21.15.45:0/3794984206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00141007f0 msgr2=0x7f0014100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.695+0000 7f0019c29640 1 --2- 172.21.15.45:0/3794984206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00141007f0 0x7f0014100c50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0008009880 tx=0x7f000802a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.695+0000 7f0019c29640 1 -- 172.21.15.45:0/3794984206 shutdown_connections 2024-09-18T13:03:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.695+0000 7f0019c29640 1 --2- 172.21.15.45:0/3794984206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00141007f0 0x7f0014100c50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.695+0000 7f0019c29640 1 --2- 172.21.15.45:0/3794984206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00141067f0 0x7f0014106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.695+0000 7f0019c29640 1 -- 172.21.15.45:0/3794984206 >> 172.21.15.45:0/3794984206 conn(0x7f00140fc550 msgr2=0x7f00140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.695+0000 7f0019c29640 1 -- 172.21.15.45:0/3794984206 shutdown_connections 2024-09-18T13:03:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.695+0000 7f0019c29640 1 -- 172.21.15.45:0/3794984206 wait complete. 2024-09-18T13:03:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.696+0000 7f0019c29640 1 Processor -- start 2024-09-18T13:03:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.696+0000 7f0019c29640 1 -- start start 2024-09-18T13:03:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.696+0000 7f0019c29640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00141007f0 0x7f00141987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.696+0000 7f0019c29640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00141067f0 0x7f0014198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.696+0000 7f0019c29640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f001410dca0 con 0x7f00141067f0 2024-09-18T13:03:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.696+0000 7f0019c29640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f001410db20 con 0x7f00141007f0 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.696+0000 7f0012ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00141067f0 0x7f0014198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.696+0000 7f0012ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00141067f0 0x7f0014198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52704/0 (socket says 172.21.15.45:52704) 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.696+0000 7f0012ffd640 1 -- 172.21.15.45:0/2455946333 learned_addr learned my addr 172.21.15.45:0/2455946333 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.696+0000 7f00137fe640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00141007f0 0x7f00141987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.697+0000 7f0012ffd640 1 -- 172.21.15.45:0/2455946333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00141007f0 msgr2=0x7f00141987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.697+0000 7f0012ffd640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00141007f0 0x7f00141987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.697+0000 7f0012ffd640 1 -- 172.21.15.45:0/2455946333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00141992f0 con 0x7f00141067f0 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.697+0000 7f0012ffd640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00141067f0 0x7f0014198cf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0008031460 tx=0x7f00080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.697+0000 7f0010ff9640 1 -- 172.21.15.45:0/2455946333 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f000803f070 con 0x7f00141067f0 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.697+0000 7f0019c29640 1 -- 172.21.15.45:0/2455946333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0014199580 con 0x7f00141067f0 2024-09-18T13:03:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.697+0000 7f0010ff9640 1 -- 172.21.15.45:0/2455946333 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f00080035f0 con 0x7f00141067f0 2024-09-18T13:03:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.697+0000 7f0010ff9640 1 -- 172.21.15.45:0/2455946333 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0008035030 con 0x7f00141067f0 2024-09-18T13:03:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.697+0000 7f0019c29640 1 -- 172.21.15.45:0/2455946333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00141a1b30 con 0x7f00141067f0 2024-09-18T13:03:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.698+0000 7f0019c29640 1 -- 172.21.15.45:0/2455946333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0014101f30 con 0x7f00141067f0 2024-09-18T13:03:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.699+0000 7f0010ff9640 1 -- 172.21.15.45:0/2455946333 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f0008042070 con 0x7f00141067f0 2024-09-18T13:03:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.699+0000 7f0010ff9640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efffc07af30 0x7efffc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.699+0000 7f00137fe640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efffc07af30 0x7efffc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.699+0000 7f0010ff9640 1 -- 172.21.15.45:0/2455946333 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f00080be9d0 con 0x7f00141067f0 2024-09-18T13:03:44.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.700+0000 7f00137fe640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efffc07af30 0x7efffc07d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f000400bbe0 tx=0x7f000400b390 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:44.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.703+0000 7f0010ff9640 1 -- 172.21.15.45:0/2455946333 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0008089f70 con 0x7f00141067f0 2024-09-18T13:03:44.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.927+0000 7f0019c29640 1 -- 172.21.15.45:0/2455946333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7f00141a1e40 con 0x7f00141067f0 2024-09-18T13:03:44.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.927+0000 7f0010ff9640 1 -- 172.21.15.45:0/2455946333 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v37) ==== 107+0+5313 (secure 0 0 0) 0x7f000808ee20 con 0x7f00141067f0 2024-09-18T13:03:44.929 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:44.929 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":31,"btime":"2024-09-18T13:01:12:389079+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/781506559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":781506559},{"type":"v1","addr":"172.21.15.161:6827","nonce":781506559}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:01:11.934660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34318":{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:44.929 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 31 2024-09-18T13:03:44.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 -- 172.21.15.45:0/2455946333 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efffc07af30 msgr2=0x7efffc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:44.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efffc07af30 0x7efffc07d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f000400bbe0 tx=0x7f000400b390 comp rx=0 tx=0).stop 2024-09-18T13:03:44.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 -- 172.21.15.45:0/2455946333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00141067f0 msgr2=0x7f0014198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:44.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00141067f0 0x7f0014198cf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0008031460 tx=0x7f00080045e0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 -- 172.21.15.45:0/2455946333 shutdown_connections 2024-09-18T13:03:44.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7efffc07af30 0x7efffc07d3f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00141067f0 0x7f0014198cf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 --2- 172.21.15.45:0/2455946333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00141007f0 0x7f00141987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:44.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 -- 172.21.15.45:0/2455946333 >> 172.21.15.45:0/2455946333 conn(0x7f00140fc550 msgr2=0x7f00140fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:44.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 -- 172.21.15.45:0/2455946333 shutdown_connections 2024-09-18T13:03:44.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:44.930+0000 7f0019c29640 1 -- 172.21.15.45:0/2455946333 wait complete. 2024-09-18T13:03:45.503 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-18T13:03:45.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-18T13:03:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:45 smithi045 ceph-mon[109129]: pgmap v364: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:45 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2455946333' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-18T13:03:46.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:45 smithi161 ceph-mon[80292]: pgmap v364: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:46.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:45 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2455946333' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-18T13:03:46.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.232+0000 7f7acd953640 1 -- 172.21.15.45:0/3650853915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac8102ac0 msgr2=0x7f7ac8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:46.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.232+0000 7f7acd953640 1 --2- 172.21.15.45:0/3650853915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac8102ac0 0x7f7ac8102ea0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009880 tx=0x7f7ab802a530 comp rx=0 tx=0).stop 2024-09-18T13:03:46.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.232+0000 7f7acd953640 1 -- 172.21.15.45:0/3650853915 shutdown_connections 2024-09-18T13:03:46.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.232+0000 7f7acd953640 1 --2- 172.21.15.45:0/3650853915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ac81033e0 0x7f7ac810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.232+0000 7f7acd953640 1 --2- 172.21.15.45:0/3650853915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac8102ac0 0x7f7ac8102ea0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.232+0000 7f7acd953640 1 -- 172.21.15.45:0/3650853915 >> 172.21.15.45:0/3650853915 conn(0x7f7ac80fc520 msgr2=0x7f7ac80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.233+0000 7f7acd953640 1 -- 172.21.15.45:0/3650853915 shutdown_connections 2024-09-18T13:03:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.233+0000 7f7acd953640 1 -- 172.21.15.45:0/3650853915 wait complete. 2024-09-18T13:03:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.233+0000 7f7acd953640 1 Processor -- start 2024-09-18T13:03:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.233+0000 7f7acd953640 1 -- start start 2024-09-18T13:03:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7acd953640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ac8102ac0 0x7f7ac819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7acd953640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac81033e0 0x7f7ac819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7acd953640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac810edf0 con 0x7f7ac81033e0 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7acd953640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac810ec70 con 0x7f7ac8102ac0 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7abe7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac81033e0 0x7f7ac819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7abe7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac81033e0 0x7f7ac819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52726/0 (socket says 172.21.15.45:52726) 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7abe7fc640 1 -- 172.21.15.45:0/1520745195 learned_addr learned my addr 172.21.15.45:0/1520745195 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7ac6ffd640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ac8102ac0 0x7f7ac819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7abe7fc640 1 -- 172.21.15.45:0/1520745195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ac8102ac0 msgr2=0x7f7ac819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7abe7fc640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ac8102ac0 0x7f7ac819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7abe7fc640 1 -- 172.21.15.45:0/1520745195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac81977c0 con 0x7f7ac81033e0 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7abe7fc640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac81033e0 0x7f7ac819db80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c8f0 tx=0x7f7ab000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7acc951640 1 -- 172.21.15.45:0/1520745195 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ab000ae50 con 0x7f7ac81033e0 2024-09-18T13:03:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7acc951640 1 -- 172.21.15.45:0/1520745195 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ab0005020 con 0x7f7ac81033e0 2024-09-18T13:03:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7acd953640 1 -- 172.21.15.45:0/1520745195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac8197ab0 con 0x7f7ac81033e0 2024-09-18T13:03:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7acc951640 1 -- 172.21.15.45:0/1520745195 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ab0004d70 con 0x7f7ac81033e0 2024-09-18T13:03:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.234+0000 7f7acd953640 1 -- 172.21.15.45:0/1520745195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac8198040 con 0x7f7ac81033e0 2024-09-18T13:03:46.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.235+0000 7f7acd953640 1 -- 172.21.15.45:0/1520745195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac806aa90 con 0x7f7ac81033e0 2024-09-18T13:03:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.236+0000 7f7acc951640 1 -- 172.21.15.45:0/1520745195 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f7ab00051d0 con 0x7f7ac81033e0 2024-09-18T13:03:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.237+0000 7f7acc951640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7ab407b0e0 0x7f7ab407d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.237+0000 7f7acc951640 1 -- 172.21.15.45:0/1520745195 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f7ab009de80 con 0x7f7ac81033e0 2024-09-18T13:03:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.237+0000 7f7ac6ffd640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7ab407b0e0 0x7f7ab407d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:46.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.237+0000 7f7ac6ffd640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7ab407b0e0 0x7f7ab407d5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8031460 tx=0x7f7ab8009560 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:46.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.241+0000 7f7acc951640 1 -- 172.21.15.45:0/1520745195 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7ab0014030 con 0x7f7ac81033e0 2024-09-18T13:03:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.462+0000 7f7acd953640 1 -- 172.21.15.45:0/1520745195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7f7ac8198350 con 0x7f7ac81033e0 2024-09-18T13:03:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.463+0000 7f7acc951640 1 -- 172.21.15.45:0/1520745195 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v37) ==== 107+0+5310 (secure 0 0 0) 0x7f7ab0069420 con 0x7f7ac81033e0 2024-09-18T13:03:46.464 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:46.465 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"btime":"2024-09-18T13:01:13:390512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/781506559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":781506559},{"type":"v1","addr":"172.21.15.161:6827","nonce":781506559}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:01:12.393316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34318":{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":29,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T13:03:46.465 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 32 2024-09-18T13:03:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.465+0000 7f7acd953640 1 -- 172.21.15.45:0/1520745195 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7ab407b0e0 msgr2=0x7f7ab407d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.465+0000 7f7acd953640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7ab407b0e0 0x7f7ab407d5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8031460 tx=0x7f7ab8009560 comp rx=0 tx=0).stop 2024-09-18T13:03:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.465+0000 7f7acd953640 1 -- 172.21.15.45:0/1520745195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac81033e0 msgr2=0x7f7ac819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.465+0000 7f7acd953640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac81033e0 0x7f7ac819db80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c8f0 tx=0x7f7ab000cdb0 comp rx=0 tx=0).stop 2024-09-18T13:03:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.466+0000 7f7acd953640 1 -- 172.21.15.45:0/1520745195 shutdown_connections 2024-09-18T13:03:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.466+0000 7f7acd953640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f7ab407b0e0 0x7f7ab407d5a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.466+0000 7f7acd953640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac81033e0 0x7f7ac819db80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.466+0000 7f7acd953640 1 --2- 172.21.15.45:0/1520745195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ac8102ac0 0x7f7ac819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.466+0000 7f7acd953640 1 -- 172.21.15.45:0/1520745195 >> 172.21.15.45:0/1520745195 conn(0x7f7ac80fc520 msgr2=0x7f7ac810af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.466+0000 7f7acd953640 1 -- 172.21.15.45:0/1520745195 shutdown_connections 2024-09-18T13:03:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:46.466+0000 7f7acd953640 1 -- 172.21.15.45:0/1520745195 wait complete. 2024-09-18T13:03:46.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:46 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/1520745195' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-18T13:03:47.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:46 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/1520745195' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-18T13:03:47.084 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-18T13:03:47.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-18T13:03:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:47.775 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:47 smithi045 ceph-mon[109129]: pgmap v365: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:47.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.774+0000 7f0146496640 1 -- 172.21.15.45:0/4267209098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140106860 msgr2=0x7f0140106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:47.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.774+0000 7f0146496640 1 --2- 172.21.15.45:0/4267209098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140106860 0x7f0140106c40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0130009880 tx=0x7f013002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.774+0000 7f0146496640 1 -- 172.21.15.45:0/4267209098 shutdown_connections 2024-09-18T13:03:47.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.774+0000 7f0146496640 1 --2- 172.21.15.45:0/4267209098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0140100860 0x7f0140100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.774+0000 7f0146496640 1 --2- 172.21.15.45:0/4267209098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140106860 0x7f0140106c40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.774+0000 7f0146496640 1 -- 172.21.15.45:0/4267209098 >> 172.21.15.45:0/4267209098 conn(0x7f01400fc580 msgr2=0x7f01400fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:47.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.774+0000 7f0146496640 1 -- 172.21.15.45:0/4267209098 shutdown_connections 2024-09-18T13:03:47.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.774+0000 7f0146496640 1 -- 172.21.15.45:0/4267209098 wait complete. 2024-09-18T13:03:47.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.774+0000 7f0146496640 1 Processor -- start 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f0146496640 1 -- start start 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f0146496640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140100860 0x7f014019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f0146496640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0140106860 0x7f014019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f0146496640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f014010dd30 con 0x7f0140100860 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f0146496640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f014010dbb0 con 0x7f0140106860 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f013ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140100860 0x7f014019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f013ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140100860 0x7f014019f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52752/0 (socket says 172.21.15.45:52752) 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f013ffff640 1 -- 172.21.15.45:0/645540571 learned_addr learned my addr 172.21.15.45:0/645540571 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f013f7fe640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0140106860 0x7f014019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f013ffff640 1 -- 172.21.15.45:0/645540571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0140106860 msgr2=0x7f014019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f013ffff640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0140106860 0x7f014019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f013ffff640 1 -- 172.21.15.45:0/645540571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0140199a00 con 0x7f0140100860 2024-09-18T13:03:47.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.775+0000 7f013f7fe640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0140106860 0x7f014019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:03:47.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.776+0000 7f013ffff640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140100860 0x7f014019f840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0130031460 tx=0x7f01300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.776+0000 7f013d7fa640 1 -- 172.21.15.45:0/645540571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f013003f070 con 0x7f0140100860 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.776+0000 7f013d7fa640 1 -- 172.21.15.45:0/645540571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0130004cf0 con 0x7f0140100860 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.776+0000 7f0146496640 1 -- 172.21.15.45:0/645540571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0140199c90 con 0x7f0140100860 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.776+0000 7f013d7fa640 1 -- 172.21.15.45:0/645540571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0130035030 con 0x7f0140100860 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.776+0000 7f0146496640 1 -- 172.21.15.45:0/645540571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f014019a1c0 con 0x7f0140100860 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.777+0000 7f0146496640 1 -- 172.21.15.45:0/645540571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0140101fa0 con 0x7f0140100860 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.778+0000 7f013d7fa640 1 -- 172.21.15.45:0/645540571 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f0130042070 con 0x7f0140100860 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.778+0000 7f013d7fa640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f012807af80 0x7f012807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.778+0000 7f013d7fa640 1 -- 172.21.15.45:0/645540571 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f01300bea40 con 0x7f0140100860 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.778+0000 7f013f7fe640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f012807af80 0x7f012807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.779+0000 7f013f7fe640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f012807af80 0x7f012807d440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01400fcea0 tx=0x7f0134005d30 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:47.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:47.783+0000 7f013d7fa640 1 -- 172.21.15.45:0/645540571 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f013008a060 con 0x7f0140100860 2024-09-18T13:03:48.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.003+0000 7f0146496640 1 -- 172.21.15.45:0/645540571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7f014019a470 con 0x7f0140100860 2024-09-18T13:03:48.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.004+0000 7f013d7fa640 1 -- 172.21.15.45:0/645540571 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v37) ==== 107+0+5319 (secure 0 0 0) 0x7f013008ef10 con 0x7f0140100860 2024-09-18T13:03:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:48.005 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"btime":"2024-09-18T13:01:14:392270+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/781506559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":781506559},{"type":"v1","addr":"172.21.15.161:6827","nonce":781506559}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:01:14.392263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34318":{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34318,"qdb_cluster":[34318]},"id":1}]} 2024-09-18T13:03:48.006 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 33 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.006+0000 7f0146496640 1 -- 172.21.15.45:0/645540571 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f012807af80 msgr2=0x7f012807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.006+0000 7f0146496640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f012807af80 0x7f012807d440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01400fcea0 tx=0x7f0134005d30 comp rx=0 tx=0).stop 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.006+0000 7f0146496640 1 -- 172.21.15.45:0/645540571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140100860 msgr2=0x7f014019f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.006+0000 7f0146496640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140100860 0x7f014019f840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0130031460 tx=0x7f01300048f0 comp rx=0 tx=0).stop 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.007+0000 7f0146496640 1 -- 172.21.15.45:0/645540571 shutdown_connections 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.007+0000 7f0146496640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f012807af80 0x7f012807d440 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.007+0000 7f0146496640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0140106860 0x7f014019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.007+0000 7f0146496640 1 --2- 172.21.15.45:0/645540571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0140100860 0x7f014019f840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.007+0000 7f0146496640 1 -- 172.21.15.45:0/645540571 >> 172.21.15.45:0/645540571 conn(0x7f01400fc580 msgr2=0x7f01400fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.007+0000 7f0146496640 1 -- 172.21.15.45:0/645540571 shutdown_connections 2024-09-18T13:03:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:48.007+0000 7f0146496640 1 -- 172.21.15.45:0/645540571 wait complete. 2024-09-18T13:03:48.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:47 smithi161 ceph-mon[80292]: pgmap v365: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:48.614 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-18T13:03:48.614 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-18T13:03:48.877 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:48.998 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:48 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/645540571' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-18T13:03:49.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:48 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/645540571' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-18T13:03:49.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.408+0000 7f9958481640 1 -- 172.21.15.45:0/981501852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99501011d0 msgr2=0x7f99501056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:49.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.408+0000 7f9958481640 1 --2- 172.21.15.45:0/981501852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99501011d0 0x7f99501056a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9940009880 tx=0x7f994002a530 comp rx=0 tx=0).stop 2024-09-18T13:03:49.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.408+0000 7f9958481640 1 -- 172.21.15.45:0/981501852 shutdown_connections 2024-09-18T13:03:49.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.408+0000 7f9958481640 1 --2- 172.21.15.45:0/981501852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99501011d0 0x7f99501056a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:49.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.408+0000 7f9958481640 1 --2- 172.21.15.45:0/981501852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99501008b0 0x7f9950100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:49.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.408+0000 7f9958481640 1 -- 172.21.15.45:0/981501852 >> 172.21.15.45:0/981501852 conn(0x7f99500fc520 msgr2=0x7f99500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:49.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.408+0000 7f9958481640 1 -- 172.21.15.45:0/981501852 shutdown_connections 2024-09-18T13:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.408+0000 7f9958481640 1 -- 172.21.15.45:0/981501852 wait complete. 2024-09-18T13:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.409+0000 7f9958481640 1 Processor -- start 2024-09-18T13:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.409+0000 7f9958481640 1 -- start start 2024-09-18T13:03:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.409+0000 7f9958481640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99501008b0 0x7f995019dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.409+0000 7f9958481640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99501011d0 0x7f995019e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.409+0000 7f9958481640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f99501153d0 con 0x7f99501011d0 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.409+0000 7f9958481640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f9950115250 con 0x7f99501008b0 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f9955a1c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99501011d0 0x7f995019e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f9955a1c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99501011d0 0x7f995019e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52764/0 (socket says 172.21.15.45:52764) 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f9955a1c640 1 -- 172.21.15.45:0/2446914391 learned_addr learned my addr 172.21.15.45:0/2446914391 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f995621d640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99501008b0 0x7f995019dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f9955a1c640 1 -- 172.21.15.45:0/2446914391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99501008b0 msgr2=0x7f995019dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f9955a1c640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99501008b0 0x7f995019dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f9955a1c640 1 -- 172.21.15.45:0/2446914391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995019ebc0 con 0x7f99501011d0 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f9955a1c640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99501011d0 0x7f995019e510 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9940031460 tx=0x7f99400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f99477fe640 1 -- 172.21.15.45:0/2446914391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f994003f070 con 0x7f99501011d0 2024-09-18T13:03:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f99477fe640 1 -- 172.21.15.45:0/2446914391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9940004ac0 con 0x7f99501011d0 2024-09-18T13:03:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f9958481640 1 -- 172.21.15.45:0/2446914391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99501a2900 con 0x7f99501011d0 2024-09-18T13:03:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f99477fe640 1 -- 172.21.15.45:0/2446914391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9940035030 con 0x7f99501011d0 2024-09-18T13:03:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.410+0000 7f9958481640 1 -- 172.21.15.45:0/2446914391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99501a2e30 con 0x7f99501011d0 2024-09-18T13:03:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.411+0000 7f9958481640 1 -- 172.21.15.45:0/2446914391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f995006aa90 con 0x7f99501011d0 2024-09-18T13:03:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.412+0000 7f99477fe640 1 -- 172.21.15.45:0/2446914391 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f9940042070 con 0x7f99501011d0 2024-09-18T13:03:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.412+0000 7f99477fe640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f993c07af30 0x7f993c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.413+0000 7f995621d640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f993c07af30 0x7f993c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.413+0000 7f99477fe640 1 -- 172.21.15.45:0/2446914391 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f99400be9e0 con 0x7f99501011d0 2024-09-18T13:03:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.413+0000 7f995621d640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f993c07af30 0x7f993c07d3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f994c00abe0 tx=0x7f994c00a2d0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:49.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.417+0000 7f99477fe640 1 -- 172.21.15.45:0/2446914391 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9940089f80 con 0x7f99501011d0 2024-09-18T13:03:49.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.637+0000 7f9958481640 1 -- 172.21.15.45:0/2446914391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7f99501027c0 con 0x7f99501011d0 2024-09-18T13:03:49.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.638+0000 7f99477fe640 1 -- 172.21.15.45:0/2446914391 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v37) ==== 107+0+5319 (secure 0 0 0) 0x7f994008ee30 con 0x7f99501011d0 2024-09-18T13:03:49.639 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:49.640 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"btime":"2024-09-18T13:01:16:691710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/781506559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":781506559},{"type":"v1","addr":"172.21.15.161:6827","nonce":781506559}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:01:15.694336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34318":{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34318,"qdb_cluster":[34318]},"id":1}]} 2024-09-18T13:03:49.640 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 34 2024-09-18T13:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.640+0000 7f9958481640 1 -- 172.21.15.45:0/2446914391 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f993c07af30 msgr2=0x7f993c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.640+0000 7f9958481640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f993c07af30 0x7f993c07d3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f994c00abe0 tx=0x7f994c00a2d0 comp rx=0 tx=0).stop 2024-09-18T13:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.640+0000 7f9958481640 1 -- 172.21.15.45:0/2446914391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99501011d0 msgr2=0x7f995019e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.640+0000 7f9958481640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99501011d0 0x7f995019e510 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9940031460 tx=0x7f99400046c0 comp rx=0 tx=0).stop 2024-09-18T13:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.640+0000 7f9958481640 1 -- 172.21.15.45:0/2446914391 shutdown_connections 2024-09-18T13:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.640+0000 7f9958481640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f993c07af30 0x7f993c07d3f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.640+0000 7f9958481640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99501011d0 0x7f995019e510 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.640+0000 7f9958481640 1 --2- 172.21.15.45:0/2446914391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99501008b0 0x7f995019dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.640+0000 7f9958481640 1 -- 172.21.15.45:0/2446914391 >> 172.21.15.45:0/2446914391 conn(0x7f99500fc520 msgr2=0x7f9950112be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.641+0000 7f9958481640 1 -- 172.21.15.45:0/2446914391 shutdown_connections 2024-09-18T13:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:49.641+0000 7f9958481640 1 -- 172.21.15.45:0/2446914391 wait complete. 2024-09-18T13:03:49.989 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:49 smithi045 ceph-mon[109129]: pgmap v366: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:49 smithi161 ceph-mon[80292]: pgmap v366: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:50.277 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-18T13:03:50.277 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-18T13:03:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:50.908 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:50 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/2446914391' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-18T13:03:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.990+0000 7fc7158cd640 1 -- 172.21.15.45:0/1639430740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc710106800 msgr2=0x7fc710106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.990+0000 7fc7158cd640 1 --2- 172.21.15.45:0/1639430740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc710106800 0x7fc710106be0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc700009880 tx=0x7fc70002a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.990+0000 7fc7158cd640 1 -- 172.21.15.45:0/1639430740 shutdown_connections 2024-09-18T13:03:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.990+0000 7fc7158cd640 1 --2- 172.21.15.45:0/1639430740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc710100800 0x7fc710100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.990+0000 7fc7158cd640 1 --2- 172.21.15.45:0/1639430740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc710106800 0x7fc710106be0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.990+0000 7fc7158cd640 1 -- 172.21.15.45:0/1639430740 >> 172.21.15.45:0/1639430740 conn(0x7fc7100fc520 msgr2=0x7fc7100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.990+0000 7fc7158cd640 1 -- 172.21.15.45:0/1639430740 shutdown_connections 2024-09-18T13:03:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.990+0000 7fc7158cd640 1 -- 172.21.15.45:0/1639430740 wait complete. 2024-09-18T13:03:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc7158cd640 1 Processor -- start 2024-09-18T13:03:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc7158cd640 1 -- start start 2024-09-18T13:03:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc7158cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc710100800 0x7fc7101987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc7158cd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc710106800 0x7fc710198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc7158cd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc71010dcd0 con 0x7fc710100800 2024-09-18T13:03:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc7158cd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7fc71010db50 con 0x7fc710106800 2024-09-18T13:03:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc70effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc710100800 0x7fc7101987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc70effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc710100800 0x7fc7101987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52780/0 (socket says 172.21.15.45:52780) 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc70effd640 1 -- 172.21.15.45:0/531128077 learned_addr learned my addr 172.21.15.45:0/531128077 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc70e7fc640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc710106800 0x7fc710198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc70effd640 1 -- 172.21.15.45:0/531128077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc710106800 msgr2=0x7fc710198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc70effd640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc710106800 0x7fc710198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc70effd640 1 -- 172.21.15.45:0/531128077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc710199320 con 0x7fc710100800 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.991+0000 7fc70e7fc640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc710106800 0x7fc710198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.992+0000 7fc70effd640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc710100800 0x7fc7101987e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc700031460 tx=0x7fc700004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.992+0000 7fc7148cb640 1 -- 172.21.15.45:0/531128077 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc70003f070 con 0x7fc710100800 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.992+0000 7fc7148cb640 1 -- 172.21.15.45:0/531128077 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc700004a90 con 0x7fc710100800 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.992+0000 7fc7158cd640 1 -- 172.21.15.45:0/531128077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7101995b0 con 0x7fc710100800 2024-09-18T13:03:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.992+0000 7fc7148cb640 1 -- 172.21.15.45:0/531128077 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc700035030 con 0x7fc710100800 2024-09-18T13:03:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.992+0000 7fc7158cd640 1 -- 172.21.15.45:0/531128077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7101a1b60 con 0x7fc710100800 2024-09-18T13:03:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.993+0000 7fc7158cd640 1 -- 172.21.15.45:0/531128077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc710101f40 con 0x7fc710100800 2024-09-18T13:03:50.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.994+0000 7fc7148cb640 1 -- 172.21.15.45:0/531128077 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7fc700042070 con 0x7fc710100800 2024-09-18T13:03:50.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.994+0000 7fc7148cb640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6f807af40 0x7fc6f807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:50.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.994+0000 7fc7148cb640 1 -- 172.21.15.45:0/531128077 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7fc7000beb60 con 0x7fc710100800 2024-09-18T13:03:50.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.994+0000 7fc70e7fc640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6f807af40 0x7fc6f807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:50.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.995+0000 7fc70e7fc640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6f807af40 0x7fc6f807d400 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc71006ad00 tx=0x7fc704005f90 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:50.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:50.998+0000 7fc7148cb640 1 -- 172.21.15.45:0/531128077 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc70008a100 con 0x7fc710100800 2024-09-18T13:03:51.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:50 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/2446914391' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-18T13:03:51.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.219+0000 7fc7158cd640 1 -- 172.21.15.45:0/531128077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) -- 0x7fc710108d70 con 0x7fc710100800 2024-09-18T13:03:51.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.220+0000 7fc7148cb640 1 -- 172.21.15.45:0/531128077 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v37) ==== 107+0+5318 (secure 0 0 0) 0x7fc70008efb0 con 0x7fc710100800 2024-09-18T13:03:51.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:51.222 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"btime":"2024-09-18T13:01:17:696088+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/781506559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":781506559},{"type":"v1","addr":"172.21.15.161:6827","nonce":781506559}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:01:16.699622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34318":{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34318,"qdb_cluster":[34318]},"id":1}]} 2024-09-18T13:03:51.222 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 35 2024-09-18T13:03:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.222+0000 7fc7158cd640 1 -- 172.21.15.45:0/531128077 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6f807af40 msgr2=0x7fc6f807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.222+0000 7fc7158cd640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6f807af40 0x7fc6f807d400 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc71006ad00 tx=0x7fc704005f90 comp rx=0 tx=0).stop 2024-09-18T13:03:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.222+0000 7fc7158cd640 1 -- 172.21.15.45:0/531128077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc710100800 msgr2=0x7fc7101987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.222+0000 7fc7158cd640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc710100800 0x7fc7101987e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc700031460 tx=0x7fc700004530 comp rx=0 tx=0).stop 2024-09-18T13:03:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.223+0000 7fc7158cd640 1 -- 172.21.15.45:0/531128077 shutdown_connections 2024-09-18T13:03:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.223+0000 7fc7158cd640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7fc6f807af40 0x7fc6f807d400 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.223+0000 7fc7158cd640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc710106800 0x7fc710198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.223+0000 7fc7158cd640 1 --2- 172.21.15.45:0/531128077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc710100800 0x7fc7101987e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.223+0000 7fc7158cd640 1 -- 172.21.15.45:0/531128077 >> 172.21.15.45:0/531128077 conn(0x7fc7100fc520 msgr2=0x7fc7100fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.223+0000 7fc7158cd640 1 -- 172.21.15.45:0/531128077 shutdown_connections 2024-09-18T13:03:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:51.223+0000 7fc7158cd640 1 -- 172.21.15.45:0/531128077 wait complete. 2024-09-18T13:03:51.816 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-18T13:03:51.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:51 smithi161 ceph-mon[80292]: pgmap v367: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:51.943 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:51 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/531128077' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-18T13:03:52.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:51 smithi045 ceph-mon[109129]: pgmap v367: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:52.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:51 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/531128077' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-18T13:03:52.075 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:52.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.525+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3745934274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc41067f0 msgr2=0x7f4bc4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:52.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.525+0000 7f4bcbe2a640 1 --2- 172.21.15.45:0/3745934274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc41067f0 0x7f4bc4106bd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009880 tx=0x7f4bb402a4a0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.525+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3745934274 shutdown_connections 2024-09-18T13:03:52.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.525+0000 7f4bcbe2a640 1 --2- 172.21.15.45:0/3745934274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc41007f0 0x7f4bc4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.525+0000 7f4bcbe2a640 1 --2- 172.21.15.45:0/3745934274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc41067f0 0x7f4bc4106bd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.525+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3745934274 >> 172.21.15.45:0/3745934274 conn(0x7f4bc40fc550 msgr2=0x7f4bc40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.525+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3745934274 shutdown_connections 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.525+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3745934274 wait complete. 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.525+0000 7f4bcbe2a640 1 Processor -- start 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.525+0000 7f4bcbe2a640 1 -- start start 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bcbe2a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc41007f0 0x7f4bc41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bcbe2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc41067f0 0x7f4bc4198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bcbe2a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc410dca0 con 0x7f4bc41067f0 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bcbe2a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc410db20 con 0x7f4bc41007f0 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc93c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc41067f0 0x7f4bc4198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc93c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc41067f0 0x7f4bc4198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55198/0 (socket says 172.21.15.45:55198) 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc93c5640 1 -- 172.21.15.45:0/3684071198 learned_addr learned my addr 172.21.15.45:0/3684071198 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc9bc6640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc41007f0 0x7f4bc41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:52.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc93c5640 1 -- 172.21.15.45:0/3684071198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc41007f0 msgr2=0x7f4bc41988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc93c5640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc41007f0 0x7f4bc41988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc93c5640 1 -- 172.21.15.45:0/3684071198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc4199380 con 0x7f4bc41067f0 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc9bc6640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc41007f0 0x7f4bc41988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc93c5640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc41067f0 0x7f4bc4198e10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800c8a0 tx=0x7f4bb800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc2ffd640 1 -- 172.21.15.45:0/3684071198 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bb80079b0 con 0x7f4bc41067f0 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3684071198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc4199670 con 0x7f4bc41067f0 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc2ffd640 1 -- 172.21.15.45:0/3684071198 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bb8007b50 con 0x7f4bc41067f0 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bc2ffd640 1 -- 172.21.15.45:0/3684071198 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bb8018700 con 0x7f4bc41067f0 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.526+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3684071198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc41a1c70 con 0x7f4bc41067f0 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.527+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3684071198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc4101f30 con 0x7f4bc41067f0 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.528+0000 7f4bc2ffd640 1 -- 172.21.15.45:0/3684071198 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f4bb8007d00 con 0x7f4bc41067f0 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.529+0000 7f4bc2ffd640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4bac07af30 0x7f4bac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:52.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.529+0000 7f4bc2ffd640 1 -- 172.21.15.45:0/3684071198 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f4bb809e350 con 0x7f4bc41067f0 2024-09-18T13:03:52.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.529+0000 7f4bc9bc6640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4bac07af30 0x7f4bac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:52.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.529+0000 7f4bc9bc6640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4bac07af30 0x7f4bac07d3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4006010 tx=0x7f4bb40095f0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:52.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.533+0000 7f4bc2ffd640 1 -- 172.21.15.45:0/3684071198 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4bb8014030 con 0x7f4bc41067f0 2024-09-18T13:03:52.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.753+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3684071198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) -- 0x7f4bc4100c50 con 0x7f4bc41067f0 2024-09-18T13:03:52.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.754+0000 7f4bc2ffd640 1 -- 172.21.15.45:0/3684071198 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v37) ==== 107+0+5325 (secure 0 0 0) 0x7f4bb80698f0 con 0x7f4bc41067f0 2024-09-18T13:03:52.755 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-18T13:03:52.755 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"btime":"2024-09-18T13:01:17:700606+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi161.xoxpyp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1172047502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1172047502},{"type":"v1","addr":"172.21.15.161:6825","nonce":1172047502}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi161.maxdew","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/781506559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":781506559},{"type":"v1","addr":"172.21.15.161:6827","nonce":781506559}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-18T12:49:15.435246+0000","modified":"2024-09-18T13:01:17.700594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34318":{"gid":34318,"name":"cephfs.smithi045.gzqgyu","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.45:6827/138858473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":138858473},{"type":"v1","addr":"172.21.15.45:6827","nonce":138858473}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34350":{"gid":34350,"name":"cephfs.smithi045.favmzs","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6829/3858768927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3858768927},{"type":"v1","addr":"172.21.15.45:6829","nonce":3858768927}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34318,"qdb_cluster":[34318]},"id":1}]} 2024-09-18T13:03:52.756 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2024-09-18T13:03:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.756+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3684071198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4bac07af30 msgr2=0x7f4bac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.756+0000 7f4bcbe2a640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4bac07af30 0x7f4bac07d3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4006010 tx=0x7f4bb40095f0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.756+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3684071198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc41067f0 msgr2=0x7f4bc4198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.756+0000 7f4bcbe2a640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc41067f0 0x7f4bc4198e10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800c8a0 tx=0x7f4bb800cd60 comp rx=0 tx=0).stop 2024-09-18T13:03:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.757+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3684071198 shutdown_connections 2024-09-18T13:03:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.757+0000 7f4bcbe2a640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4bac07af30 0x7f4bac07d3f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.757+0000 7f4bcbe2a640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc41067f0 0x7f4bc4198e10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.757+0000 7f4bcbe2a640 1 --2- 172.21.15.45:0/3684071198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc41007f0 0x7f4bc41988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.757+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3684071198 >> 172.21.15.45:0/3684071198 conn(0x7f4bc40fc550 msgr2=0x7f4bc40fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:52.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.757+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3684071198 shutdown_connections 2024-09-18T13:03:52.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:52.757+0000 7f4bcbe2a640 1 -- 172.21.15.45:0/3684071198 wait complete. 2024-09-18T13:03:53.358 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-18T13:03:53.368 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-18T13:03:53.368 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T13:03:53.369 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T13:03:53.387 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T13:03:53.387 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T13:03:53.444 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-18T13:03:53.746 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:53.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:53 smithi045 ceph-mon[109129]: pgmap v368: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:53.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:53 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3684071198' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-18T13:03:53.868 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:53 smithi161 ceph-mon[80292]: pgmap v368: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:53 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3684071198' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-18T13:03:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:03:54.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.207+0000 7f4af16d0640 1 -- 172.21.15.45:0/1538225772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aec102b30 msgr2=0x7f4aec102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:54.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.207+0000 7f4af16d0640 1 --2- 172.21.15.45:0/1538225772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aec102b30 0x7f4aec102f10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009880 tx=0x7f4adc02a530 comp rx=0 tx=0).stop 2024-09-18T13:03:54.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.207+0000 7f4af16d0640 1 -- 172.21.15.45:0/1538225772 shutdown_connections 2024-09-18T13:03:54.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.207+0000 7f4af16d0640 1 --2- 172.21.15.45:0/1538225772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4aec103450 0x7f4aec10b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:54.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.207+0000 7f4af16d0640 1 --2- 172.21.15.45:0/1538225772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aec102b30 0x7f4aec102f10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:54.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.207+0000 7f4af16d0640 1 -- 172.21.15.45:0/1538225772 >> 172.21.15.45:0/1538225772 conn(0x7f4aec0fc550 msgr2=0x7f4aec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:54.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.207+0000 7f4af16d0640 1 -- 172.21.15.45:0/1538225772 shutdown_connections 2024-09-18T13:03:54.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.207+0000 7f4af16d0640 1 -- 172.21.15.45:0/1538225772 wait complete. 2024-09-18T13:03:54.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4af16d0640 1 Processor -- start 2024-09-18T13:03:54.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4af16d0640 1 -- start start 2024-09-18T13:03:54.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4af16d0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4aec102b30 0x7f4aec100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:54.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4af16d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aec103450 0x7f4aec100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:54.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4af16d0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec10edc0 con 0x7f4aec103450 2024-09-18T13:03:54.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4af16d0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec10ec40 con 0x7f4aec102b30 2024-09-18T13:03:54.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4aea7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aec103450 0x7f4aec100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:54.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4aea7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aec103450 0x7f4aec100cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55218/0 (socket says 172.21.15.45:55218) 2024-09-18T13:03:54.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4aea7fc640 1 -- 172.21.15.45:0/3708025416 learned_addr learned my addr 172.21.15.45:0/3708025416 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:54.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4aea7fc640 1 -- 172.21.15.45:0/3708025416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4aec102b30 msgr2=0x7f4aec100790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:54.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4aea7fc640 1 --2- 172.21.15.45:0/3708025416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4aec102b30 0x7f4aec100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:54.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.208+0000 7f4aea7fc640 1 -- 172.21.15.45:0/3708025416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec101210 con 0x7f4aec103450 2024-09-18T13:03:54.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.209+0000 7f4aea7fc640 1 --2- 172.21.15.45:0/3708025416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aec103450 0x7f4aec100cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000cc60 tx=0x7f4ae000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:54.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.209+0000 7f4ad3fff640 1 -- 172.21.15.45:0/3708025416 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ae000ce10 con 0x7f4aec103450 2024-09-18T13:03:54.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.209+0000 7f4af16d0640 1 -- 172.21.15.45:0/3708025416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec101500 con 0x7f4aec103450 2024-09-18T13:03:54.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.209+0000 7f4ad3fff640 1 -- 172.21.15.45:0/3708025416 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ae000f910 con 0x7f4aec103450 2024-09-18T13:03:54.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.209+0000 7f4ad3fff640 1 -- 172.21.15.45:0/3708025416 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ae0018ae0 con 0x7f4aec103450 2024-09-18T13:03:54.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.209+0000 7f4af16d0640 1 -- 172.21.15.45:0/3708025416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec1a3dd0 con 0x7f4aec103450 2024-09-18T13:03:54.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.210+0000 7f4af16d0640 1 -- 172.21.15.45:0/3708025416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aec06a500 con 0x7f4aec103450 2024-09-18T13:03:54.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.211+0000 7f4ad3fff640 1 -- 172.21.15.45:0/3708025416 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f4ae0018ca0 con 0x7f4aec103450 2024-09-18T13:03:54.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.211+0000 7f4ad3fff640 1 --2- 172.21.15.45:0/3708025416 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4ad407af40 0x7f4ad407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:54.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.211+0000 7f4ad3fff640 1 -- 172.21.15.45:0/3708025416 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f4ae009e760 con 0x7f4aec103450 2024-09-18T13:03:54.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.211+0000 7f4aeaffd640 1 --2- 172.21.15.45:0/3708025416 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4ad407af40 0x7f4ad407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:54.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.212+0000 7f4aeaffd640 1 --2- 172.21.15.45:0/3708025416 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4ad407af40 0x7f4ad407d400 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0096c0 tx=0x7f4adc000bc0 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:54.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.216+0000 7f4ad3fff640 1 -- 172.21.15.45:0/3708025416 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4ae0014030 con 0x7f4aec103450 2024-09-18T13:03:54.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.413+0000 7f4af16d0640 1 -- 172.21.15.45:0/3708025416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4aec02d7c0 con 0x7f4aec103450 2024-09-18T13:03:54.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.413+0000 7f4ad3fff640 1 -- 172.21.15.45:0/3708025416 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 33 entries v81) ==== 81+0+1955 (secure 0 0 0) 0x7f4ae0069d00 con 0x7f4aec103450 2024-09-18T13:03:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6827/2456430948 2024-09-19T13:00:11.864178+0000 2024-09-18T13:03:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/3609874287 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/411006836 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/529444775 2024-09-19T12:44:31.530414+0000 2024-09-18T13:03:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:6827/3769095439 2024-09-19T13:01:04.451766+0000 2024-09-18T13:03:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:6826/3769095439 2024-09-19T13:01:04.451766+0000 2024-09-18T13:03:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/2022818157 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/865557257 2024-09-19T12:43:34.610573+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/4029715284 2024-09-19T12:43:02.441203+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3028834940 2024-09-19T12:43:02.441203+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/4029715284 2024-09-19T12:43:02.441203+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/2556143183 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2571293493 2024-09-19T12:43:34.610573+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/2173101933 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6826/2456430948 2024-09-19T13:00:11.864178+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/928242973 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/1773614817 2024-09-19T12:44:31.530414+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/470767634 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/133299404 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:54.416 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:6828/243368146 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/865557257 2024-09-19T12:43:34.610573+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/1337019523 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3244778815 2024-09-19T12:43:02.441203+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/286550513 2024-09-19T12:43:34.610573+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2407274137 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/4239091440 2024-09-19T12:44:31.530414+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/4239091440 2024-09-19T12:44:31.530414+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3573172920 2024-09-19T12:43:02.441203+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/714422720 2024-09-19T12:44:31.530414+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2088566729 2024-09-19T12:43:34.610573+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:6829/243368146 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/3828746740 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:54.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/3828746740 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:54.418 INFO:teuthology.orchestra.run.smithi045.stderr:listed 33 entries 2024-09-18T13:03:54.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.416+0000 7f4af16d0640 1 -- 172.21.15.45:0/3708025416 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4ad407af40 msgr2=0x7f4ad407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:54.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.416+0000 7f4af16d0640 1 --2- 172.21.15.45:0/3708025416 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4ad407af40 0x7f4ad407d400 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0096c0 tx=0x7f4adc000bc0 comp rx=0 tx=0).stop 2024-09-18T13:03:54.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.416+0000 7f4af16d0640 1 -- 172.21.15.45:0/3708025416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aec103450 msgr2=0x7f4aec100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.416+0000 7f4af16d0640 1 --2- 172.21.15.45:0/3708025416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aec103450 0x7f4aec100cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000cc60 tx=0x7f4ae000a620 comp rx=0 tx=0).stop 2024-09-18T13:03:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.416+0000 7f4af16d0640 1 -- 172.21.15.45:0/3708025416 shutdown_connections 2024-09-18T13:03:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.416+0000 7f4af16d0640 1 --2- 172.21.15.45:0/3708025416 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f4ad407af40 0x7f4ad407d400 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.416+0000 7f4af16d0640 1 --2- 172.21.15.45:0/3708025416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aec103450 0x7f4aec100cd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.416+0000 7f4af16d0640 1 --2- 172.21.15.45:0/3708025416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4aec102b30 0x7f4aec100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.416+0000 7f4af16d0640 1 -- 172.21.15.45:0/3708025416 >> 172.21.15.45:0/3708025416 conn(0x7f4aec0fc550 msgr2=0x7f4aec108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.417+0000 7f4af16d0640 1 -- 172.21.15.45:0/3708025416 shutdown_connections 2024-09-18T13:03:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:54.417+0000 7f4af16d0640 1 -- 172.21.15.45:0/3708025416 wait complete. 2024-09-18T13:03:54.738 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:54 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3708025416' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:03:55.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:54 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3708025416' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:03:55.063 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-18T13:03:55.063 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T13:03:55.083 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-18T13:03:55.389 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/mon.smithi045/config 2024-09-18T13:03:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:55 smithi045 ceph-mon[109129]: pgmap v369: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.830+0000 7f95f2689640 1 -- 172.21.15.45:0/3993060160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ec102ac0 msgr2=0x7f95ec102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.830+0000 7f95f2689640 1 --2- 172.21.15.45:0/3993060160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ec102ac0 0x7f95ec102ea0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009880 tx=0x7f95dc02a530 comp rx=0 tx=0).stop 2024-09-18T13:03:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.831+0000 7f95f2689640 1 -- 172.21.15.45:0/3993060160 shutdown_connections 2024-09-18T13:03:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.831+0000 7f95f2689640 1 --2- 172.21.15.45:0/3993060160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95ec1033e0 0x7f95ec10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.831+0000 7f95f2689640 1 --2- 172.21.15.45:0/3993060160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ec102ac0 0x7f95ec102ea0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.831+0000 7f95f2689640 1 -- 172.21.15.45:0/3993060160 >> 172.21.15.45:0/3993060160 conn(0x7f95ec0fc520 msgr2=0x7f95ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.831+0000 7f95f2689640 1 -- 172.21.15.45:0/3993060160 shutdown_connections 2024-09-18T13:03:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.831+0000 7f95f2689640 1 -- 172.21.15.45:0/3993060160 wait complete. 2024-09-18T13:03:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.831+0000 7f95f2689640 1 Processor -- start 2024-09-18T13:03:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.831+0000 7f95f2689640 1 -- start start 2024-09-18T13:03:55.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95f2689640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ec102ac0 0x7f95ec19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:55.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95f2689640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95ec1033e0 0x7f95ec19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95f2689640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec10edf0 con 0x7f95ec102ac0 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95f2689640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec10ec70 con 0x7f95ec1033e0 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95ebfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ec102ac0 0x7f95ec19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95ebfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ec102ac0 0x7f95ec19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55236/0 (socket says 172.21.15.45:55236) 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95ebfff640 1 -- 172.21.15.45:0/3690514307 learned_addr learned my addr 172.21.15.45:0/3690514307 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95eb7fe640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95ec1033e0 0x7f95ec19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95ebfff640 1 -- 172.21.15.45:0/3690514307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95ec1033e0 msgr2=0x7f95ec19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95ebfff640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95ec1033e0 0x7f95ec19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95ebfff640 1 -- 172.21.15.45:0/3690514307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec1977c0 con 0x7f95ec102ac0 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.832+0000 7f95ebfff640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ec102ac0 0x7f95ec19d640 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f95dc031460 tx=0x7f95dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.833+0000 7f95e97fa640 1 -- 172.21.15.45:0/3690514307 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95dc03f070 con 0x7f95ec102ac0 2024-09-18T13:03:55.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.833+0000 7f95e97fa640 1 -- 172.21.15.45:0/3690514307 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f95dc004b10 con 0x7f95ec102ac0 2024-09-18T13:03:55.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.833+0000 7f95f2689640 1 -- 172.21.15.45:0/3690514307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec197a50 con 0x7f95ec102ac0 2024-09-18T13:03:55.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.833+0000 7f95e97fa640 1 -- 172.21.15.45:0/3690514307 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95dc035030 con 0x7f95ec102ac0 2024-09-18T13:03:55.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.833+0000 7f95f2689640 1 -- 172.21.15.45:0/3690514307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec197f80 con 0x7f95ec102ac0 2024-09-18T13:03:55.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.834+0000 7f95f2689640 1 -- 172.21.15.45:0/3690514307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ec06aa90 con 0x7f95ec102ac0 2024-09-18T13:03:55.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.835+0000 7f95e97fa640 1 -- 172.21.15.45:0/3690514307 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 32) ==== 103320+0+0 (secure 0 0 0) 0x7f95dc042070 con 0x7f95ec102ac0 2024-09-18T13:03:55.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.835+0000 7f95e97fa640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f95d407af90 0x7f95d407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T13:03:55.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.835+0000 7f95e97fa640 1 -- 172.21.15.45:0/3690514307 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6242+0+0 (secure 0 0 0) 0x7f95dc0bead0 con 0x7f95ec102ac0 2024-09-18T13:03:55.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.835+0000 7f95eb7fe640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f95d407af90 0x7f95d407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T13:03:55.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.836+0000 7f95eb7fe640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f95d407af90 0x7f95d407d450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f95e00058c0 tx=0x7f95e0005850 comp rx=0 tx=0).ready entity=mgr.14774 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T13:03:55.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:55.840+0000 7f95e97fa640 1 -- 172.21.15.45:0/3690514307 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f95dc08a0f0 con 0x7f95ec102ac0 2024-09-18T13:03:55.883 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:55 smithi161 ceph-mon[80292]: pgmap v369: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:03:56.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.035+0000 7f95f2689640 1 -- 172.21.15.45:0/3690514307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95ec1982f0 con 0x7f95ec102ac0 2024-09-18T13:03:56.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.036+0000 7f95e97fa640 1 -- 172.21.15.45:0/3690514307 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 33 entries v81) ==== 81+0+1955 (secure 0 0 0) 0x7f95dc08efa0 con 0x7f95ec102ac0 2024-09-18T13:03:56.037 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6827/2456430948 2024-09-19T13:00:11.864178+0000 2024-09-18T13:03:56.037 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/3609874287 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:56.037 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/411006836 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:56.037 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/529444775 2024-09-19T12:44:31.530414+0000 2024-09-18T13:03:56.037 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:6827/3769095439 2024-09-19T13:01:04.451766+0000 2024-09-18T13:03:56.037 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:6826/3769095439 2024-09-19T13:01:04.451766+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/2022818157 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/865557257 2024-09-19T12:43:34.610573+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/4029715284 2024-09-19T12:43:02.441203+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3028834940 2024-09-19T12:43:02.441203+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/4029715284 2024-09-19T12:43:02.441203+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/2556143183 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2571293493 2024-09-19T12:43:34.610573+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/2173101933 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6826/2456430948 2024-09-19T13:00:11.864178+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/928242973 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/1773614817 2024-09-19T12:44:31.530414+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/470767634 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:56.038 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/133299404 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:6828/243368146 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/865557257 2024-09-19T12:43:34.610573+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:0/1337019523 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3244778815 2024-09-19T12:43:02.441203+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/286550513 2024-09-19T12:43:34.610573+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2407274137 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/4239091440 2024-09-19T12:44:31.530414+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/4239091440 2024-09-19T12:44:31.530414+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3573172920 2024-09-19T12:43:02.441203+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/714422720 2024-09-19T12:44:31.530414+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2088566729 2024-09-19T12:43:34.610573+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.161:6829/243368146 2024-09-19T12:52:52.146149+0000 2024-09-18T13:03:56.039 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/3828746740 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:56.040 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/3828746740 2024-09-19T12:51:20.385834+0000 2024-09-18T13:03:56.040 INFO:teuthology.orchestra.run.smithi045.stderr:listed 33 entries 2024-09-18T13:03:56.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 -- 172.21.15.45:0/3690514307 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f95d407af90 msgr2=0x7f95d407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f95d407af90 0x7f95d407d450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f95e00058c0 tx=0x7f95e0005850 comp rx=0 tx=0).stop 2024-09-18T13:03:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 -- 172.21.15.45:0/3690514307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ec102ac0 msgr2=0x7f95ec19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T13:03:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ec102ac0 0x7f95ec19d640 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f95dc031460 tx=0x7f95dc0045e0 comp rx=0 tx=0).stop 2024-09-18T13:03:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 -- 172.21.15.45:0/3690514307 shutdown_connections 2024-09-18T13:03:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.45:6800/3507386160,v1:172.21.15.45:6801/3507386160] conn(0x7f95d407af90 0x7f95d407d450 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95ec1033e0 0x7f95ec19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 --2- 172.21.15.45:0/3690514307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ec102ac0 0x7f95ec19d640 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T13:03:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 -- 172.21.15.45:0/3690514307 >> 172.21.15.45:0/3690514307 conn(0x7f95ec0fc520 msgr2=0x7f95ec10af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T13:03:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 -- 172.21.15.45:0/3690514307 shutdown_connections 2024-09-18T13:03:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-18T13:03:56.038+0000 7f95f2689640 1 -- 172.21.15.45:0/3690514307 wait complete. 2024-09-18T13:03:56.645 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2024-09-18T13:03:56.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T13:03:56.645 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-18T13:03:56.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T13:03:57.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:56 smithi045 ceph-mon[109129]: from='client.? 172.21.15.45:0/3690514307' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:03:57.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:56 smithi161 ceph-mon[80292]: from='client.? 172.21.15.45:0/3690514307' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-18T13:03:58.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:57 smithi045 ceph-mon[109129]: pgmap v370: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:03:58.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:57 smithi161 ceph-mon[80292]: pgmap v370: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:00.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:03:59 smithi045 ceph-mon[109129]: pgmap v371: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:00.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:03:59 smithi161 ceph-mon[80292]: pgmap v371: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:02.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:01 smithi045 ceph-mon[109129]: pgmap v372: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:02.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:01 smithi161 ceph-mon[80292]: pgmap v372: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:03 smithi045 ceph-mon[109129]: pgmap v373: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:04.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:03 smithi161 ceph-mon[80292]: pgmap v373: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:06.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:05 smithi045 ceph-mon[109129]: pgmap v374: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:06.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:05 smithi161 ceph-mon[80292]: pgmap v374: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:07 smithi045 ceph-mon[109129]: pgmap v375: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:08.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:07 smithi161 ceph-mon[80292]: pgmap v375: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:09.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:09.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:09 smithi045 ceph-mon[109129]: pgmap v376: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:10.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:09 smithi161 ceph-mon[80292]: pgmap v376: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:12.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:11 smithi045 ceph-mon[109129]: pgmap v377: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:12.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:11 smithi161 ceph-mon[80292]: pgmap v377: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:14.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:13 smithi045 ceph-mon[109129]: pgmap v378: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:13 smithi161 ceph-mon[80292]: pgmap v378: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:15 smithi045 ceph-mon[109129]: pgmap v379: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:16.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:15 smithi161 ceph-mon[80292]: pgmap v379: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:17 smithi045 ceph-mon[109129]: pgmap v380: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:17 smithi161 ceph-mon[80292]: pgmap v380: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:20.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:19 smithi045 ceph-mon[109129]: pgmap v381: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:20.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:19 smithi161 ceph-mon[80292]: pgmap v381: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:21 smithi045 ceph-mon[109129]: pgmap v382: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:21 smithi161 ceph-mon[80292]: pgmap v382: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:24.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:23 smithi045 ceph-mon[109129]: pgmap v383: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:24.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:24.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:23 smithi161 ceph-mon[80292]: pgmap v383: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:24.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:26.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:25 smithi045 ceph-mon[109129]: pgmap v384: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:26.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:25 smithi161 ceph-mon[80292]: pgmap v384: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:27 smithi045 ceph-mon[109129]: pgmap v385: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:28.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:27 smithi161 ceph-mon[80292]: pgmap v385: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:29.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:28 smithi045 ceph-mon[109129]: pgmap v386: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:28 smithi161 ceph-mon[80292]: pgmap v386: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:31 smithi045 ceph-mon[109129]: pgmap v387: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:31 smithi161 ceph-mon[80292]: pgmap v387: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:33 smithi045 ceph-mon[109129]: pgmap v388: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:33 smithi161 ceph-mon[80292]: pgmap v388: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:35 smithi045 ceph-mon[109129]: pgmap v389: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:35 smithi161 ceph-mon[80292]: pgmap v389: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:38.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:37 smithi045 ceph-mon[109129]: pgmap v390: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:38.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:37 smithi161 ceph-mon[80292]: pgmap v390: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:39.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:39.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:39 smithi045 ceph-mon[109129]: pgmap v391: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:04:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:04:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:04:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:04:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:04:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:04:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:04:39.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:39 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:04:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:39 smithi161 ceph-mon[80292]: pgmap v391: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:04:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:04:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:04:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:04:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:04:40.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:04:40.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:04:40.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:39 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:04:42.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:41 smithi045 ceph-mon[109129]: pgmap v392: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:42.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:41 smithi161 ceph-mon[80292]: pgmap v392: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:44.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:43 smithi045 ceph-mon[109129]: pgmap v393: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:44.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:43 smithi161 ceph-mon[80292]: pgmap v393: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:45.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:44 smithi045 ceph-mon[109129]: pgmap v394: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:45.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:44 smithi161 ceph-mon[80292]: pgmap v394: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:47 smithi045 ceph-mon[109129]: pgmap v395: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:47 smithi161 ceph-mon[80292]: pgmap v395: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:49 smithi045 ceph-mon[109129]: pgmap v396: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:49 smithi161 ceph-mon[80292]: pgmap v396: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:51.745 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:51 smithi161 ceph-mon[80292]: pgmap v397: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:51 smithi045 ceph-mon[109129]: pgmap v397: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:53 smithi045 ceph-mon[109129]: pgmap v398: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:53 smithi161 ceph-mon[80292]: pgmap v398: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:04:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:55 smithi045 ceph-mon[109129]: pgmap v399: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:55 smithi161 ceph-mon[80292]: pgmap v399: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:57.713 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:57 smithi045 ceph-mon[109129]: pgmap v400: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:57 smithi161 ceph-mon[80292]: pgmap v400: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:04:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:04:59 smithi045 ceph-mon[109129]: pgmap v401: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:04:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:04:59 smithi161 ceph-mon[80292]: pgmap v401: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:01 smithi045 ceph-mon[109129]: pgmap v402: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:01 smithi161 ceph-mon[80292]: pgmap v402: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:03 smithi045 ceph-mon[109129]: pgmap v403: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:03 smithi161 ceph-mon[80292]: pgmap v403: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:05 smithi045 ceph-mon[109129]: pgmap v404: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:05 smithi161 ceph-mon[80292]: pgmap v404: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:07 smithi045 ceph-mon[109129]: pgmap v405: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:07 smithi161 ceph-mon[80292]: pgmap v405: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:09 smithi045 ceph-mon[109129]: pgmap v406: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:09 smithi161 ceph-mon[80292]: pgmap v406: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:11.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:11 smithi045 ceph-mon[109129]: pgmap v407: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:11 smithi161 ceph-mon[80292]: pgmap v407: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:13 smithi045 ceph-mon[109129]: pgmap v408: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:13 smithi161 ceph-mon[80292]: pgmap v408: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:15 smithi045 ceph-mon[109129]: pgmap v409: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:15 smithi161 ceph-mon[80292]: pgmap v409: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:17 smithi045 ceph-mon[109129]: pgmap v410: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:17 smithi161 ceph-mon[80292]: pgmap v410: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:19.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:19 smithi045 ceph-mon[109129]: pgmap v411: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:19 smithi161 ceph-mon[80292]: pgmap v411: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:21 smithi045 ceph-mon[109129]: pgmap v412: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:21 smithi161 ceph-mon[80292]: pgmap v412: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:23 smithi045 ceph-mon[109129]: pgmap v413: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:23 smithi161 ceph-mon[80292]: pgmap v413: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:25.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:25 smithi045 ceph-mon[109129]: pgmap v414: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:25 smithi161 ceph-mon[80292]: pgmap v414: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:27 smithi045 ceph-mon[109129]: pgmap v415: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:27 smithi161 ceph-mon[80292]: pgmap v415: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:29 smithi045 ceph-mon[109129]: pgmap v416: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:29 smithi161 ceph-mon[80292]: pgmap v416: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:31 smithi045 ceph-mon[109129]: pgmap v417: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:31 smithi161 ceph-mon[80292]: pgmap v417: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:33 smithi045 ceph-mon[109129]: pgmap v418: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:33 smithi161 ceph-mon[80292]: pgmap v418: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:35 smithi045 ceph-mon[109129]: pgmap v419: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:35 smithi161 ceph-mon[80292]: pgmap v419: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:37 smithi045 ceph-mon[109129]: pgmap v420: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:37 smithi161 ceph-mon[80292]: pgmap v420: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:39 smithi045 ceph-mon[109129]: pgmap v421: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:39 smithi161 ceph-mon[80292]: pgmap v421: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:40.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:40 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:05:40.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:40 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:05:40.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:40 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:05:40.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:40 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:05:40.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:40 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:05:40.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:40 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:05:40.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:40 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:05:40.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:40 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:05:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:41 smithi045 ceph-mon[109129]: pgmap v422: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:41 smithi161 ceph-mon[80292]: pgmap v422: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:43 smithi045 ceph-mon[109129]: pgmap v423: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:43 smithi161 ceph-mon[80292]: pgmap v423: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:45 smithi045 ceph-mon[109129]: pgmap v424: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:45 smithi161 ceph-mon[80292]: pgmap v424: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:47 smithi045 ceph-mon[109129]: pgmap v425: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:47 smithi161 ceph-mon[80292]: pgmap v425: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:49 smithi045 ceph-mon[109129]: pgmap v426: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:49 smithi161 ceph-mon[80292]: pgmap v426: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:51 smithi045 ceph-mon[109129]: pgmap v427: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:51 smithi161 ceph-mon[80292]: pgmap v427: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:53.750 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:53 smithi045 ceph-mon[109129]: pgmap v428: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:53.750 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:53.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:53 smithi161 ceph-mon[80292]: pgmap v428: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:53.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:05:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:55 smithi045 ceph-mon[109129]: pgmap v429: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:55 smithi161 ceph-mon[80292]: pgmap v429: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:57.773 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:57 smithi161 ceph-mon[80292]: pgmap v430: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:57 smithi045 ceph-mon[109129]: pgmap v430: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:05:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:05:59 smithi045 ceph-mon[109129]: pgmap v431: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:05:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:05:59 smithi161 ceph-mon[80292]: pgmap v431: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:01 smithi045 ceph-mon[109129]: pgmap v432: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:01 smithi161 ceph-mon[80292]: pgmap v432: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:03 smithi045 ceph-mon[109129]: pgmap v433: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:03 smithi161 ceph-mon[80292]: pgmap v433: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:05 smithi045 ceph-mon[109129]: pgmap v434: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:05 smithi161 ceph-mon[80292]: pgmap v434: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:07 smithi045 ceph-mon[109129]: pgmap v435: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:07 smithi161 ceph-mon[80292]: pgmap v435: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:09 smithi045 ceph-mon[109129]: pgmap v436: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:09 smithi161 ceph-mon[80292]: pgmap v436: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:11.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:11 smithi045 ceph-mon[109129]: pgmap v437: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:11 smithi161 ceph-mon[80292]: pgmap v437: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:13 smithi045 ceph-mon[109129]: pgmap v438: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:13 smithi161 ceph-mon[80292]: pgmap v438: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:15 smithi045 ceph-mon[109129]: pgmap v439: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:15 smithi161 ceph-mon[80292]: pgmap v439: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:17 smithi161 ceph-mon[80292]: pgmap v440: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:17 smithi045 ceph-mon[109129]: pgmap v440: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:20.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:19 smithi045 ceph-mon[109129]: pgmap v441: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:20.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:19 smithi161 ceph-mon[80292]: pgmap v441: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:21 smithi045 ceph-mon[109129]: pgmap v442: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:21.844 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:21 smithi161 ceph-mon[80292]: pgmap v442: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:24.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:23 smithi045 ceph-mon[109129]: pgmap v443: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:24.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:24.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:23 smithi161 ceph-mon[80292]: pgmap v443: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:24.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:26.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:25 smithi045 ceph-mon[109129]: pgmap v444: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:26.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:25 smithi161 ceph-mon[80292]: pgmap v444: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:27 smithi045 ceph-mon[109129]: pgmap v445: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:28.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:27 smithi161 ceph-mon[80292]: pgmap v445: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:29 smithi045 ceph-mon[109129]: pgmap v446: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:30.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:29 smithi161 ceph-mon[80292]: pgmap v446: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:32.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:31 smithi045 ceph-mon[109129]: pgmap v447: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:31 smithi161 ceph-mon[80292]: pgmap v447: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:33 smithi045 ceph-mon[109129]: pgmap v448: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:33 smithi161 ceph-mon[80292]: pgmap v448: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:36.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:35 smithi045 ceph-mon[109129]: pgmap v449: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:36.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:35 smithi161 ceph-mon[80292]: pgmap v449: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:38.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:37 smithi045 ceph-mon[109129]: pgmap v450: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:38.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:37 smithi161 ceph-mon[80292]: pgmap v450: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:39.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:39 smithi045 ceph-mon[109129]: pgmap v451: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:39 smithi161 ceph-mon[80292]: pgmap v451: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:41.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:40 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:06:41.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:40 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:06:41.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:40 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:06:41.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:40 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:06:41.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:40 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:06:41.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:40 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:06:41.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:40 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:06:41.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:40 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:06:42.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:41 smithi045 ceph-mon[109129]: pgmap v452: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:42.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:41 smithi161 ceph-mon[80292]: pgmap v452: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:43 smithi161 ceph-mon[80292]: pgmap v453: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:44.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:43 smithi045 ceph-mon[109129]: pgmap v453: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:45 smithi045 ceph-mon[109129]: pgmap v454: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:46.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:45 smithi161 ceph-mon[80292]: pgmap v454: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:48.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:47 smithi045 ceph-mon[109129]: pgmap v455: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:48.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:47 smithi161 ceph-mon[80292]: pgmap v455: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:50.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:49 smithi045 ceph-mon[109129]: pgmap v456: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:49 smithi161 ceph-mon[80292]: pgmap v456: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:51 smithi045 ceph-mon[109129]: pgmap v457: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:52.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:51 smithi161 ceph-mon[80292]: pgmap v457: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:53.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:52 smithi045 ceph-mon[109129]: pgmap v458: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:53.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:52 smithi161 ceph-mon[80292]: pgmap v458: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:54.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:06:55.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:54 smithi045 ceph-mon[109129]: pgmap v459: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:55.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:54 smithi161 ceph-mon[80292]: pgmap v459: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:57.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:57 smithi045 ceph-mon[109129]: pgmap v460: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:57 smithi161 ceph-mon[80292]: pgmap v460: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:06:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:06:59 smithi045 ceph-mon[109129]: pgmap v461: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:06:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:06:59 smithi161 ceph-mon[80292]: pgmap v461: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:01 smithi045 ceph-mon[109129]: pgmap v462: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:01 smithi161 ceph-mon[80292]: pgmap v462: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:03 smithi045 ceph-mon[109129]: pgmap v463: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:03 smithi161 ceph-mon[80292]: pgmap v463: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:05.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:05 smithi045 ceph-mon[109129]: pgmap v464: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:05 smithi161 ceph-mon[80292]: pgmap v464: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:07.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:07 smithi045 ceph-mon[109129]: pgmap v465: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:07 smithi161 ceph-mon[80292]: pgmap v465: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:08.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:08.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:09 smithi045 ceph-mon[109129]: pgmap v466: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:09.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:09 smithi161 ceph-mon[80292]: pgmap v466: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:11.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:11 smithi045 ceph-mon[109129]: pgmap v467: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:11.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:11 smithi161 ceph-mon[80292]: pgmap v467: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:13.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:13 smithi045 ceph-mon[109129]: pgmap v468: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:13.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:13 smithi161 ceph-mon[80292]: pgmap v468: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:15.534 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:15 smithi045 ceph-mon[109129]: pgmap v469: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:15.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:15 smithi161 ceph-mon[80292]: pgmap v469: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:17.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:17 smithi045 ceph-mon[109129]: pgmap v470: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:17.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:17 smithi161 ceph-mon[80292]: pgmap v470: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:19.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:19 smithi045 ceph-mon[109129]: pgmap v471: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:19.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:19 smithi161 ceph-mon[80292]: pgmap v471: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:21 smithi045 ceph-mon[109129]: pgmap v472: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:21.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:21 smithi161 ceph-mon[80292]: pgmap v472: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:23 smithi045 ceph-mon[109129]: pgmap v473: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:23.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:23 smithi161 ceph-mon[80292]: pgmap v473: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:23.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:25.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:25 smithi045 ceph-mon[109129]: pgmap v474: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:25 smithi161 ceph-mon[80292]: pgmap v474: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:27 smithi045 ceph-mon[109129]: pgmap v475: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:27.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:27 smithi161 ceph-mon[80292]: pgmap v475: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:29.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:29 smithi045 ceph-mon[109129]: pgmap v476: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:29.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:29 smithi161 ceph-mon[80292]: pgmap v476: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:31.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:31 smithi045 ceph-mon[109129]: pgmap v477: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:31.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:31 smithi161 ceph-mon[80292]: pgmap v477: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:33 smithi045 ceph-mon[109129]: pgmap v478: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:33.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:33 smithi161 ceph-mon[80292]: pgmap v478: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:35.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:35 smithi045 ceph-mon[109129]: pgmap v479: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:35.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:35 smithi161 ceph-mon[80292]: pgmap v479: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:37.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:37 smithi045 ceph-mon[109129]: pgmap v480: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:37.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:37 smithi161 ceph-mon[80292]: pgmap v480: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:38.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:38.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:39 smithi045 ceph-mon[109129]: pgmap v481: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:39.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:39 smithi161 ceph-mon[80292]: pgmap v481: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:41 smithi045 ceph-mon[109129]: pgmap v482: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:07:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:07:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:07:41.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:07:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:41 smithi161 ceph-mon[80292]: pgmap v482: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:07:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:07:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:07:41.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:07:43.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:43 smithi045 ceph-mon[109129]: pgmap v483: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:43.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:43 smithi161 ceph-mon[80292]: pgmap v483: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:45 smithi045 ceph-mon[109129]: pgmap v484: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:45 smithi161 ceph-mon[80292]: pgmap v484: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:47.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:47 smithi045 ceph-mon[109129]: pgmap v485: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:47.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:47 smithi161 ceph-mon[80292]: pgmap v485: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:49.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:49 smithi045 ceph-mon[109129]: pgmap v486: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:49.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:49 smithi161 ceph-mon[80292]: pgmap v486: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:51 smithi045 ceph-mon[109129]: pgmap v487: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:51.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:51 smithi161 ceph-mon[80292]: pgmap v487: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:53 smithi045 ceph-mon[109129]: pgmap v488: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:53.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:53 smithi161 ceph-mon[80292]: pgmap v488: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:53.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:07:55.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:55 smithi045 ceph-mon[109129]: pgmap v489: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:55.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:55 smithi161 ceph-mon[80292]: pgmap v489: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:57.785 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:57 smithi045 ceph-mon[109129]: pgmap v490: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:57.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:57 smithi161 ceph-mon[80292]: pgmap v490: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:07:59.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:07:59 smithi045 ceph-mon[109129]: pgmap v491: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:07:59.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:07:59 smithi161 ceph-mon[80292]: pgmap v491: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:01.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:01 smithi045 ceph-mon[109129]: pgmap v492: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:01.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:01 smithi161 ceph-mon[80292]: pgmap v492: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:03.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:03 smithi045 ceph-mon[109129]: pgmap v493: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:03.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:03 smithi161 ceph-mon[80292]: pgmap v493: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:05.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:05 smithi161 ceph-mon[80292]: pgmap v494: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:06.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:05 smithi045 ceph-mon[109129]: pgmap v494: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:07.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:07 smithi161 ceph-mon[80292]: pgmap v495: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:08.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:07 smithi045 ceph-mon[109129]: pgmap v495: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:09.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:08 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:09.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:08 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:09.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:09 smithi045 ceph-mon[109129]: pgmap v496: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:09.819 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:09 smithi161 ceph-mon[80292]: pgmap v496: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:12.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:11 smithi045 ceph-mon[109129]: pgmap v497: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:12.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:11 smithi161 ceph-mon[80292]: pgmap v497: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:14.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:13 smithi045 ceph-mon[109129]: pgmap v498: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:14.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:13 smithi161 ceph-mon[80292]: pgmap v498: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:15.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:15 smithi045 ceph-mon[109129]: pgmap v499: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:16.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:15 smithi161 ceph-mon[80292]: pgmap v499: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:18.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:17 smithi045 ceph-mon[109129]: pgmap v500: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:18.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:17 smithi161 ceph-mon[80292]: pgmap v500: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:19.975 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:19 smithi161 ceph-mon[80292]: pgmap v501: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:20.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:19 smithi045 ceph-mon[109129]: pgmap v501: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:21.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:21 smithi045 ceph-mon[109129]: pgmap v502: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:22.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:21 smithi161 ceph-mon[80292]: pgmap v502: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:24.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:23 smithi045 ceph-mon[109129]: pgmap v503: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:24.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:23 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:24.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:23 smithi161 ceph-mon[80292]: pgmap v503: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:24.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:23 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:26.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:25 smithi045 ceph-mon[109129]: pgmap v504: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:26.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:25 smithi161 ceph-mon[80292]: pgmap v504: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:27.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:27 smithi045 ceph-mon[109129]: pgmap v505: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:28.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:27 smithi161 ceph-mon[80292]: pgmap v505: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:30.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:29 smithi045 ceph-mon[109129]: pgmap v506: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:30.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:29 smithi161 ceph-mon[80292]: pgmap v506: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:32.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:31 smithi045 ceph-mon[109129]: pgmap v507: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:32.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:31 smithi161 ceph-mon[80292]: pgmap v507: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:33.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:33 smithi045 ceph-mon[109129]: pgmap v508: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:34.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:33 smithi161 ceph-mon[80292]: pgmap v508: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:36.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:35 smithi045 ceph-mon[109129]: pgmap v509: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:36.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:35 smithi161 ceph-mon[80292]: pgmap v509: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:38.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:37 smithi045 ceph-mon[109129]: pgmap v510: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:38.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:37 smithi161 ceph-mon[80292]: pgmap v510: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:39.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:38 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:39.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:38 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:39.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:39 smithi045 ceph-mon[109129]: pgmap v511: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:40.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:39 smithi161 ceph-mon[80292]: pgmap v511: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:41.856 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:41 smithi045 ceph-mon[109129]: pgmap v512: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:41.857 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:08:41.857 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:08:41.857 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:08:41.857 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:41 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:08:42.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:41 smithi161 ceph-mon[80292]: pgmap v512: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:42.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-18T13:08:42.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-18T13:08:42.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-18T13:08:42.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:41 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' 2024-09-18T13:08:44.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:43 smithi045 ceph-mon[109129]: pgmap v513: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:44.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:43 smithi161 ceph-mon[80292]: pgmap v513: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:45.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:45 smithi045 ceph-mon[109129]: pgmap v514: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:45.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:45 smithi161 ceph-mon[80292]: pgmap v514: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:48.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:47 smithi045 ceph-mon[109129]: pgmap v515: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:48.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:47 smithi161 ceph-mon[80292]: pgmap v515: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:50.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:49 smithi045 ceph-mon[109129]: pgmap v516: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:50.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:49 smithi161 ceph-mon[80292]: pgmap v516: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:51.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:51 smithi045 ceph-mon[109129]: pgmap v517: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:52.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:51 smithi161 ceph-mon[80292]: pgmap v517: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:54.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:53 smithi045 ceph-mon[109129]: pgmap v518: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:54.034 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:53 smithi045 ceph-mon[109129]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:53 smithi161 ceph-mon[80292]: pgmap v518: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-18T13:08:54.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:53 smithi161 ceph-mon[80292]: from='mgr.14774 172.21.15.45:0/3145073583' entity='mgr.smithi045.brvbvl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-18T13:08:55.746 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-18T13:08:55.747 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T13:08:55.748 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-18T13:08:56.051 INFO:tasks.cephadm:Teardown begin 2024-09-18T13:08:56.051 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T13:08:56.053 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:08:56.054 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:55 smithi045 ceph-mon[109129]: pgmap v519: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:56.055 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:55 smithi161 ceph-mon[80292]: pgmap v519: 65 pgs: 65 active+clean; 244 MiB data, 963 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-18T13:08:56.088 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:08:56.123 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-18T13:08:56.123 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-18T13:08:56.149 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-18T13:08:56.183 INFO:tasks.cephadm:Stopping all daemons... 2024-09-18T13:08:56.183 INFO:tasks.cephadm.mon.smithi045:Stopping mon.smithi045... 2024-09-18T13:08:56.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi045 2024-09-18T13:08:56.512 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:56 smithi045 systemd[1]: Stopping Ceph mon.smithi045 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:08:56.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:56 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045[109124]: 2024-09-18T13:08:56.510+0000 7f3897678640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi045 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:08:56.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:56 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045[109124]: 2024-09-18T13:08:56.510+0000 7f3897678640 -1 mon.smithi045@0(leader) e2 *** Got Signal Terminated *** 2024-09-18T13:08:56.784 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:56 smithi045 podman[151260]: 2024-09-18 13:08:56.541827355 +0000 UTC m=+0.155275870 container died d134d17dcc9926d60c6d2c78b084f875e9d262a23e4355a2ec72eb6ad6616b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-18T13:08:57.371 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:57 smithi045 podman[151260]: 2024-09-18 13:08:57.086238636 +0000 UTC m=+0.699687190 container cleanup d134d17dcc9926d60c6d2c78b084f875e9d262a23e4355a2ec72eb6ad6616b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-18T13:08:57.371 INFO:journalctl@ceph.mon.smithi045.smithi045.stdout:Sep 18 13:08:57 smithi045 bash[151260]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi045 2024-09-18T13:08:57.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi045.service' 2024-09-18T13:08:57.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:08:57.611 INFO:tasks.cephadm.mon.smithi045:Stopped mon.smithi045 2024-09-18T13:08:57.612 INFO:tasks.cephadm.mon.smithi161:Stopping mon.smithi161... 2024-09-18T13:08:57.612 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi161 2024-09-18T13:08:57.915 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:57 smithi161 systemd[1]: Stopping Ceph mon.smithi161 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:08:58.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:57 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161[80288]: 2024-09-18T13:08:57.913+0000 7fc7ff897640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi161 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:08:58.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:57 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161[80288]: 2024-09-18T13:08:57.913+0000 7fc7ff897640 -1 mon.smithi161@1(peon) e2 *** Got Signal Terminated *** 2024-09-18T13:08:58.292 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:58 smithi161 podman[114299]: 2024-09-18 13:08:58.027300729 +0000 UTC m=+0.211619857 container died e25ec626c0557998d5029369964d18fa99798fc62a83c9caca6cc56453b95bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-18T13:08:58.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:58 smithi161 podman[114299]: 2024-09-18 13:08:58.480921731 +0000 UTC m=+0.665240850 container cleanup e25ec626c0557998d5029369964d18fa99798fc62a83c9caca6cc56453b95bc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-18T13:08:58.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Sep 18 13:08:58 smithi161 bash[114299]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-mon-smithi161 2024-09-18T13:08:58.954 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@mon.smithi161.service' 2024-09-18T13:08:59.009 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:08:59.009 INFO:tasks.cephadm.mon.smithi161:Stopped mon.smithi161 2024-09-18T13:08:59.010 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-18T13:08:59.010 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.0 2024-09-18T13:08:59.325 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:08:59 smithi045 systemd[1]: Stopping Ceph osd.0 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:08:59.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:08:59 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[118168]: 2024-09-18T13:08:59.324+0000 7f351a46e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:08:59.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:08:59 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[118168]: 2024-09-18T13:08:59.324+0000 7f351a46e640 -1 osd.0 81 *** Got signal Terminated *** 2024-09-18T13:08:59.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:08:59 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0[118168]: 2024-09-18T13:08:59.324+0000 7f351a46e640 -1 osd.0 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:09:05.220 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:09:04 smithi045 podman[151392]: 2024-09-18 13:09:04.803989599 +0000 UTC m=+5.593062596 container died 33c596ec6ae7c8bdc4f913689c3228105b8e9ab4195defd66054eddce28cd33c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-18T13:09:05.534 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:09:05 smithi045 podman[151392]: 2024-09-18 13:09:05.342366258 +0000 UTC m=+6.131439244 container cleanup 33c596ec6ae7c8bdc4f913689c3228105b8e9ab4195defd66054eddce28cd33c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:09:05.534 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:09:05 smithi045 bash[151392]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0 2024-09-18T13:09:05.969 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:09:05 smithi045 podman[151408]: 2024-09-18 13:09:05.552415993 +0000 UTC m=+0.749379136 container remove 33c596ec6ae7c8bdc4f913689c3228105b8e9ab4195defd66054eddce28cd33c (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-18T13:09:06.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:09:05 smithi045 podman[151495]: 2024-09-18 13:09:05.872150882 +0000 UTC m=+0.016721608 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:09:06.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:09:05 smithi045 podman[151495]: 2024-09-18 13:09:05.986701497 +0000 UTC m=+0.131272244 container create 40daae91aa15592b2693694853be44ecb6565b43bdd5c203498957676832f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-18T13:09:06.563 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:09:06 smithi045 podman[151495]: 2024-09-18 13:09:06.364858034 +0000 UTC m=+0.509428758 container init 40daae91aa15592b2693694853be44ecb6565b43bdd5c203498957676832f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T13:09:06.563 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:09:06 smithi045 podman[151495]: 2024-09-18 13:09:06.36859795 +0000 UTC m=+0.513168654 container start 40daae91aa15592b2693694853be44ecb6565b43bdd5c203498957676832f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-18T13:09:06.563 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:09:06 smithi045 podman[151495]: 2024-09-18 13:09:06.439669428 +0000 UTC m=+0.584240147 container attach 40daae91aa15592b2693694853be44ecb6565b43bdd5c203498957676832f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-18T13:09:06.937 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 18 13:09:06 smithi045 podman[151495]: 2024-09-18 13:09:06.563510372 +0000 UTC m=+0.708081088 container died 40daae91aa15592b2693694853be44ecb6565b43bdd5c203498957676832f2cb (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-18T13:09:07.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.0.service' 2024-09-18T13:09:07.281 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:09:07.281 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-18T13:09:07.281 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-18T13:09:07.281 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.1 2024-09-18T13:09:07.521 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:07 smithi045 systemd[1]: Stopping Ceph osd.1 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:09:07.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:07 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[123357]: 2024-09-18T13:09:07.613+0000 7f9329643640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:09:07.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:07 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[123357]: 2024-09-18T13:09:07.613+0000 7f9329643640 -1 osd.1 81 *** Got signal Terminated *** 2024-09-18T13:09:07.784 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:07 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1[123357]: 2024-09-18T13:09:07.613+0000 7f9329643640 -1 osd.1 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:09:13.233 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:12 smithi045 podman[151598]: 2024-09-18 13:09:12.960817143 +0000 UTC m=+5.475944925 container died 7d4cd03517258ca543e457fa610a391dc70f672cb26a9253a36f359bdd3f4c10 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-18T13:09:13.534 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:13 smithi045 podman[151598]: 2024-09-18 13:09:13.322708199 +0000 UTC m=+5.837835981 container cleanup 7d4cd03517258ca543e457fa610a391dc70f672cb26a9253a36f359bdd3f4c10 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-18T13:09:13.534 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:13 smithi045 bash[151598]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1 2024-09-18T13:09:13.949 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:13 smithi045 podman[151628]: 2024-09-18 13:09:13.601716709 +0000 UTC m=+0.641437889 container remove 7d4cd03517258ca543e457fa610a391dc70f672cb26a9253a36f359bdd3f4c10 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T13:09:14.239 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:13 smithi045 podman[151715]: 2024-09-18 13:09:13.851740399 +0000 UTC m=+0.016714921 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:09:14.239 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:13 smithi045 podman[151715]: 2024-09-18 13:09:13.952614418 +0000 UTC m=+0.117588929 container create efa17f94ea67662d8a698ffe258fc10aa50a9742c35ff9416cd8aa68aac1dd40 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-18T13:09:14.239 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:14 smithi045 podman[151715]: 2024-09-18 13:09:14.172061702 +0000 UTC m=+0.337036223 container init efa17f94ea67662d8a698ffe258fc10aa50a9742c35ff9416cd8aa68aac1dd40 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T13:09:14.239 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:14 smithi045 podman[151715]: 2024-09-18 13:09:14.176057571 +0000 UTC m=+0.341032083 container start efa17f94ea67662d8a698ffe258fc10aa50a9742c35ff9416cd8aa68aac1dd40 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-18T13:09:14.239 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:14 smithi045 podman[151715]: 2024-09-18 13:09:14.238406358 +0000 UTC m=+0.403380873 container attach efa17f94ea67662d8a698ffe258fc10aa50a9742c35ff9416cd8aa68aac1dd40 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-18T13:09:14.534 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 18 13:09:14 smithi045 podman[151715]: 2024-09-18 13:09:14.366862418 +0000 UTC m=+0.531836941 container died efa17f94ea67662d8a698ffe258fc10aa50a9742c35ff9416cd8aa68aac1dd40 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T13:09:14.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.1.service' 2024-09-18T13:09:15.035 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:09:15.036 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-18T13:09:15.036 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-18T13:09:15.036 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.2 2024-09-18T13:09:15.284 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:15 smithi045 systemd[1]: Stopping Ceph osd.2 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:09:15.784 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[128729]: 2024-09-18T13:09:15.369+0000 7f18bd2d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:09:15.784 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[128729]: 2024-09-18T13:09:15.369+0000 7f18bd2d7640 -1 osd.2 81 *** Got signal Terminated *** 2024-09-18T13:09:15.784 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:15 smithi045 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2[128729]: 2024-09-18T13:09:15.369+0000 7f18bd2d7640 -1 osd.2 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:09:21.106 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:20 smithi045 podman[151818]: 2024-09-18 13:09:20.819465903 +0000 UTC m=+5.551583979 container died 4f620cf3977f4573e737d99fe166410fd9bda84ace9e50ae112f6b82f4761c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-18T13:09:21.439 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:21 smithi045 podman[151818]: 2024-09-18 13:09:21.187606931 +0000 UTC m=+5.919725044 container cleanup 4f620cf3977f4573e737d99fe166410fd9bda84ace9e50ae112f6b82f4761c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-18T13:09:21.439 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:21 smithi045 bash[151818]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2 2024-09-18T13:09:21.773 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:21 smithi045 podman[151835]: 2024-09-18 13:09:21.438840729 +0000 UTC m=+0.617442796 container remove 4f620cf3977f4573e737d99fe166410fd9bda84ace9e50ae112f6b82f4761c7a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-18T13:09:22.034 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:21 smithi045 podman[151925]: 2024-09-18 13:09:21.773078363 +0000 UTC m=+0.111545790 container create dba0b8be77889d7e4afd74542e6733dece056e82f522c58fab0b315536409afa (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-18T13:09:22.034 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:21 smithi045 podman[151925]: 2024-09-18 13:09:21.678930765 +0000 UTC m=+0.017398163 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:09:22.034 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:22 smithi045 podman[151925]: 2024-09-18 13:09:22.017589825 +0000 UTC m=+0.356057218 container init dba0b8be77889d7e4afd74542e6733dece056e82f522c58fab0b315536409afa (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-18T13:09:22.034 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:22 smithi045 podman[151925]: 2024-09-18 13:09:22.021543833 +0000 UTC m=+0.360011220 container start dba0b8be77889d7e4afd74542e6733dece056e82f522c58fab0b315536409afa (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-18T13:09:22.507 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:22 smithi045 podman[151925]: 2024-09-18 13:09:22.126041844 +0000 UTC m=+0.464509249 container attach dba0b8be77889d7e4afd74542e6733dece056e82f522c58fab0b315536409afa (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T13:09:22.508 INFO:journalctl@ceph.osd.2.smithi045.stdout:Sep 18 13:09:22 smithi045 podman[151925]: 2024-09-18 13:09:22.217467476 +0000 UTC m=+0.555934888 container died dba0b8be77889d7e4afd74542e6733dece056e82f522c58fab0b315536409afa (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-18T13:09:22.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.2.service' 2024-09-18T13:09:22.837 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:09:22.837 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-18T13:09:22.837 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-18T13:09:22.837 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.3 2024-09-18T13:09:23.151 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:22 smithi161 systemd[1]: Stopping Ceph osd.3 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:09:23.542 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:23 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[88296]: 2024-09-18T13:09:23.149+0000 7fa438e2a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:09:23.542 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:23 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[88296]: 2024-09-18T13:09:23.149+0000 7fa438e2a640 -1 osd.3 81 *** Got signal Terminated *** 2024-09-18T13:09:23.542 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:23 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[88296]: 2024-09-18T13:09:23.149+0000 7fa438e2a640 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:09:25.792 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:25 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[88296]: 2024-09-18T13:09:25.442+0000 7fa431437640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:03.890383+0000 front 2024-09-18T13:09:03.890363+0000 (oldest deadline 2024-09-18T13:09:24.990174+0000) 2024-09-18T13:09:26.292 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:26 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:26.122+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:26.792 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:26 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[88296]: 2024-09-18T13:09:26.481+0000 7fa431437640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:03.890383+0000 front 2024-09-18T13:09:03.890363+0000 (oldest deadline 2024-09-18T13:09:24.990174+0000) 2024-09-18T13:09:27.465 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:27 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:27.114+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:27.792 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:27 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3[88296]: 2024-09-18T13:09:27.464+0000 7fa431437640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:03.890383+0000 front 2024-09-18T13:09:03.890363+0000 (oldest deadline 2024-09-18T13:09:24.990174+0000) 2024-09-18T13:09:28.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:28 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:28.115+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:28.944 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:28 smithi161 podman[114423]: 2024-09-18 13:09:28.6732793 +0000 UTC m=+5.638429032 container died 1fbe6c224b87465d4b9bb77fb9815e922b86781b8e058bff1db2fba912d509c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-18T13:09:29.292 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:29 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:29.159+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:29.292 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:29 smithi161 podman[114423]: 2024-09-18 13:09:29.025690763 +0000 UTC m=+5.990840493 container cleanup 1fbe6c224b87465d4b9bb77fb9815e922b86781b8e058bff1db2fba912d509c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-18T13:09:29.292 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:29 smithi161 bash[114423]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3 2024-09-18T13:09:29.646 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:29 smithi161 podman[114452]: 2024-09-18 13:09:29.318542846 +0000 UTC m=+0.638999317 container remove 1fbe6c224b87465d4b9bb77fb9815e922b86781b8e058bff1db2fba912d509c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-18T13:09:29.905 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:29 smithi161 podman[114543]: 2024-09-18 13:09:29.548351005 +0000 UTC m=+0.015698894 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:09:29.905 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:29 smithi161 podman[114543]: 2024-09-18 13:09:29.661090051 +0000 UTC m=+0.128438002 container create fcb93971c757a85314872dba6250ad58db35933155cc83075c5138a035de9303 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-18T13:09:29.905 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:29 smithi161 podman[114543]: 2024-09-18 13:09:29.905141073 +0000 UTC m=+0.372488963 container init fcb93971c757a85314872dba6250ad58db35933155cc83075c5138a035de9303 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-18T13:09:30.161 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:29 smithi161 podman[114543]: 2024-09-18 13:09:29.908732518 +0000 UTC m=+0.376080416 container start fcb93971c757a85314872dba6250ad58db35933155cc83075c5138a035de9303 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:09:30.161 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:30 smithi161 podman[114543]: 2024-09-18 13:09:30.005132938 +0000 UTC m=+0.472480830 container attach fcb93971c757a85314872dba6250ad58db35933155cc83075c5138a035de9303 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-18T13:09:30.161 INFO:journalctl@ceph.osd.3.smithi161.stdout:Sep 18 13:09:30 smithi161 podman[114543]: 2024-09-18 13:09:30.096348494 +0000 UTC m=+0.563696383 container died fcb93971c757a85314872dba6250ad58db35933155cc83075c5138a035de9303 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-18T13:09:30.162 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:30 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:30.084+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:30.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:30 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:30.159+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:30.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.3.service' 2024-09-18T13:09:30.768 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:09:30.768 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-18T13:09:30.768 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-18T13:09:30.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.4 2024-09-18T13:09:31.021 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:30 smithi161 systemd[1]: Stopping Ceph osd.4 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:09:31.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:31 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:31.099+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:31.292 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:31 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:31.120+0000 7face2953640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:09:31.292 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:31 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:31.120+0000 7face2953640 -1 osd.4 81 *** Got signal Terminated *** 2024-09-18T13:09:31.293 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:31 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:31.120+0000 7face2953640 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:09:31.293 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:31 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:31.157+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:32.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:32 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:32.139+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:32.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:32 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:32.156+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:33.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:33 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:33.131+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:33.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:33 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:33.112+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:34.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:34 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:34.108+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:34.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:34 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:34.083+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:35.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:35 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:35.073+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:35.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:35 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:35.085+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:36.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:36 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:36.133+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:36.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:36 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:36.091+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:08:59.929290+0000 front 2024-09-18T13:08:59.929388+0000 (oldest deadline 2024-09-18T13:09:25.829343+0000) 2024-09-18T13:09:36.543 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:36 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4[93401]: 2024-09-18T13:09:36.091+0000 7facdef68640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.45:6814 osd.1 since back 2024-09-18T13:09:11.730092+0000 front 2024-09-18T13:09:11.730110+0000 (oldest deadline 2024-09-18T13:09:35.829999+0000) 2024-09-18T13:09:36.922 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:36 smithi161 podman[114648]: 2024-09-18 13:09:36.612256309 +0000 UTC m=+5.623549035 container died b3c49339a90c33d022f2f6ba637a505bff690d2b87185295c458a746f64a6700 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-18T13:09:37.176 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:37 smithi161 podman[114648]: 2024-09-18 13:09:37.020694758 +0000 UTC m=+6.031987471 container cleanup b3c49339a90c33d022f2f6ba637a505bff690d2b87185295c458a746f64a6700 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.schema-version=1.0) 2024-09-18T13:09:37.176 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:37 smithi161 bash[114648]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4 2024-09-18T13:09:37.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:37 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:37.174+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:37.542 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:37 smithi161 podman[114662]: 2024-09-18 13:09:37.280395296 +0000 UTC m=+0.665733285 container remove b3c49339a90c33d022f2f6ba637a505bff690d2b87185295c458a746f64a6700 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=) 2024-09-18T13:09:37.901 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:37 smithi161 podman[114756]: 2024-09-18 13:09:37.495788808 +0000 UTC m=+0.015952278 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:09:37.901 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:37 smithi161 podman[114756]: 2024-09-18 13:09:37.60620882 +0000 UTC m=+0.126372280 container create 18ed6f4679b45a2afeb12d7b95f8d97c35a3b4a04700326894c31d39763812da (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-18T13:09:37.901 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:37 smithi161 podman[114756]: 2024-09-18 13:09:37.816839785 +0000 UTC m=+0.337003247 container init 18ed6f4679b45a2afeb12d7b95f8d97c35a3b4a04700326894c31d39763812da (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-18T13:09:37.901 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:37 smithi161 podman[114756]: 2024-09-18 13:09:37.820123883 +0000 UTC m=+0.340287346 container start 18ed6f4679b45a2afeb12d7b95f8d97c35a3b4a04700326894c31d39763812da (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:09:37.901 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:37 smithi161 podman[114756]: 2024-09-18 13:09:37.900168703 +0000 UTC m=+0.420332161 container attach 18ed6f4679b45a2afeb12d7b95f8d97c35a3b4a04700326894c31d39763812da (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-18T13:09:38.173 INFO:journalctl@ceph.osd.4.smithi161.stdout:Sep 18 13:09:38 smithi161 podman[114756]: 2024-09-18 13:09:38.005492563 +0000 UTC m=+0.525656031 container died 18ed6f4679b45a2afeb12d7b95f8d97c35a3b4a04700326894c31d39763812da (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.vendor=CentOS) 2024-09-18T13:09:38.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:38 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:38.171+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:38.572 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.4.service' 2024-09-18T13:09:38.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:09:38.611 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-18T13:09:38.611 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-18T13:09:38.611 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.5 2024-09-18T13:09:38.960 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:38 smithi161 systemd[1]: Stopping Ceph osd.5 for 53bb6910-75bb-11ef-bceb-c7b262605968... 2024-09-18T13:09:39.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:38 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:38.956+0000 7fd9f4a7e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T13:09:39.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:38 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:38.956+0000 7fd9f4a7e640 -1 osd.5 81 *** Got signal Terminated *** 2024-09-18T13:09:39.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:38 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:38.956+0000 7fd9f4a7e640 -1 osd.5 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T13:09:39.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:39 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:39.150+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:39.292 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:39 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:39.150+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6814 osd.1 since back 2024-09-18T13:09:09.205478+0000 front 2024-09-18T13:09:09.205528+0000 (oldest deadline 2024-09-18T13:09:38.605884+0000) 2024-09-18T13:09:40.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:40 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:40.115+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:40.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:40 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:40.115+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6814 osd.1 since back 2024-09-18T13:09:09.205478+0000 front 2024-09-18T13:09:09.205528+0000 (oldest deadline 2024-09-18T13:09:38.605884+0000) 2024-09-18T13:09:41.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:41 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:41.148+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:41.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:41 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:41.148+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6814 osd.1 since back 2024-09-18T13:09:09.205478+0000 front 2024-09-18T13:09:09.205528+0000 (oldest deadline 2024-09-18T13:09:38.605884+0000) 2024-09-18T13:09:42.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:42 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:42.136+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:42.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:42 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:42.136+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6814 osd.1 since back 2024-09-18T13:09:09.205478+0000 front 2024-09-18T13:09:09.205528+0000 (oldest deadline 2024-09-18T13:09:38.605884+0000) 2024-09-18T13:09:43.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:43 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:43.170+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-18T13:09:02.804595+0000 front 2024-09-18T13:09:02.804538+0000 (oldest deadline 2024-09-18T13:09:29.205048+0000) 2024-09-18T13:09:43.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:43 smithi161 ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5[98392]: 2024-09-18T13:09:43.170+0000 7fd9f1093640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.45:6814 osd.1 since back 2024-09-18T13:09:09.205478+0000 front 2024-09-18T13:09:09.205528+0000 (oldest deadline 2024-09-18T13:09:38.605884+0000) 2024-09-18T13:09:44.574 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:44 smithi161 podman[114859]: 2024-09-18 13:09:44.310503912 +0000 UTC m=+5.472063590 container died 035aa0efadd6b269811e3ced9e0eb777f1fa294d3943d8de10ac032101deed15 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-18T13:09:44.841 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:44 smithi161 podman[114859]: 2024-09-18 13:09:44.656393078 +0000 UTC m=+5.817952758 container cleanup 035aa0efadd6b269811e3ced9e0eb777f1fa294d3943d8de10ac032101deed15 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-18T13:09:44.841 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:44 smithi161 bash[114859]: ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5 2024-09-18T13:09:45.275 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:44 smithi161 podman[114879]: 2024-09-18 13:09:44.840915966 +0000 UTC m=+0.526626023 container remove 035aa0efadd6b269811e3ced9e0eb777f1fa294d3943d8de10ac032101deed15 (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-18T13:09:45.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:45 smithi161 podman[114966]: 2024-09-18 13:09:45.274961562 +0000 UTC m=+0.111988560 container create 9a3455815065f415b2c603041fd108818484d3fa9e719c453f800d597fd0102a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5) 2024-09-18T13:09:45.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:45 smithi161 podman[114966]: 2024-09-18 13:09:45.17890134 +0000 UTC m=+0.015928365 image pull b22e1e37ddf1ca6e22136cd6540a9ab61e7cafb8bfbc7a91a2f20f7f9941bd9a quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9 2024-09-18T13:09:45.542 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:45 smithi161 podman[114966]: 2024-09-18 13:09:45.494147531 +0000 UTC m=+0.331174547 container init 9a3455815065f415b2c603041fd108818484d3fa9e719c453f800d597fd0102a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T13:09:45.543 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:45 smithi161 podman[114966]: 2024-09-18 13:09:45.497484293 +0000 UTC m=+0.334511291 container start 9a3455815065f415b2c603041fd108818484d3fa9e719c453f800d597fd0102a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-18T13:09:46.039 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:45 smithi161 podman[114966]: 2024-09-18 13:09:45.577451918 +0000 UTC m=+0.414478931 container attach 9a3455815065f415b2c603041fd108818484d3fa9e719c453f800d597fd0102a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T13:09:46.039 INFO:journalctl@ceph.osd.5.smithi161.stdout:Sep 18 13:09:45 smithi161 podman[114966]: 2024-09-18 13:09:45.687185248 +0000 UTC m=+0.524212259 container died 9a3455815065f415b2c603041fd108818484d3fa9e719c453f800d597fd0102a (image=quay.ceph.io/ceph-ci/ceph@sha256:1f5b5a3734f665ef333266f39143ac3ef1eb1951b21258f2307e10332e2d7ac9, name=ceph-53bb6910-75bb-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-17-1213-e7fb7b5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-18T13:09:46.353 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-53bb6910-75bb-11ef-bceb-c7b262605968@osd.5.service' 2024-09-18T13:09:46.393 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T13:09:46.393 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-18T13:09:46.393 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-18T13:09:46.607 INFO:teuthology.orchestra.run.smithi045.stdout:Deleting cluster with fsid: 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T13:09:51.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[77042]: fuse finished with error 0 and tester_r 0 2024-09-18T13:10:11.177 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-18T13:10:11.382 INFO:teuthology.orchestra.run.smithi161.stdout:Deleting cluster with fsid: 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T13:10:22.719 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:10:22.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T13:10:22.781 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-18T13:10:22.783 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911385/remote/smithi045/crash 2024-09-18T13:10:22.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/crash -- . 2024-09-18T13:10:22.822 INFO:teuthology.orchestra.run.smithi045.stderr:tar: /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-18T13:10:22.822 INFO:teuthology.orchestra.run.smithi045.stderr:tar: Error is not recoverable: exiting now 2024-09-18T13:10:22.825 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911385/remote/smithi161/crash 2024-09-18T13:10:22.826 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/crash -- . 2024-09-18T13:10:22.850 INFO:teuthology.orchestra.run.smithi161.stderr:tar: /var/lib/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-18T13:10:22.850 INFO:teuthology.orchestra.run.smithi161.stderr:tar: Error is not recoverable: exiting now 2024-09-18T13:10:22.851 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-18T13:10:22.851 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-18T13:10:22.903 INFO:teuthology.orchestra.run.smithi045.stdout:2024-09-18T12:46:52.437107+0000 mon.smithi045 (mon.0) 469 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-18T13:10:22.903 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-18T13:10:22.903 INFO:tasks.cephadm:Compressing logs... 2024-09-18T13:10:22.904 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T13:10:22.947 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T13:10:22.972 INFO:teuthology.orchestra.run.smithi161.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-18T13:10:22.973 INFO:teuthology.orchestra.run.smithi161.stderr:: No such file or directory 2024-09-18T13:10:22.973 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi161.log 2024-09-18T13:10:22.973 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi161.yoflkm.log 2024-09-18T13:10:22.973 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi161.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-18T13:10:22.973 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi161.yoflkm.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-18T13:10:22.973 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-18T13:10:22.975 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi161.maxdew.log 2024-09-18T13:10:22.975 INFO:teuthology.orchestra.run.smithi045.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-18T13:10:22.975 INFO:teuthology.orchestra.run.smithi045.stderr:: No such file or directory 2024-09-18T13:10:22.976 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-18T13:10:22.976 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi045.log 2024-09-18T13:10:22.976 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-18T13:10:22.976 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi045.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-18T13:10:22.979 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi161.log 2024-09-18T13:10:22.979 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi161.maxdew.log: /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi161.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-18T13:10:22.979 INFO:teuthology.orchestra.run.smithi161.stderr: 93.9% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi161.log.gz 2024-09-18T13:10:22.979 INFO:teuthology.orchestra.run.smithi161.stderr: 91.7% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-18T13:10:22.982 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-18T13:10:22.982 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.1.log: /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-18T13:10:22.982 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi045.brvbvl.log 2024-09-18T13:10:22.982 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi045.log 2024-09-18T13:10:22.982 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi045.brvbvl.log: 86.4% 94.0% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi045.log.gz 2024-09-18T13:10:22.982 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-18T13:10:22.982 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-18T13:10:22.982 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi045.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.log 2024-09-18T13:10:22.983 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.5% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-18T13:10:22.983 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi045.gzqgyu.log 2024-09-18T13:10:22.984 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.log: 88.7% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-18T13:10:22.985 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi045.favmzs.log 2024-09-18T13:10:22.987 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi161.xoxpyp.log 2024-09-18T13:10:22.987 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-18T13:10:22.987 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi161.xoxpyp.log: 85.1% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-18T13:10:22.987 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.log 2024-09-18T13:10:22.992 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.5.log: 91.1% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-18T13:10:22.993 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-18T13:10:22.996 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.log: 88.7% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-18T13:10:22.997 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi045.gzqgyu.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-18T13:10:22.997 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-18T13:10:22.998 INFO:teuthology.orchestra.run.smithi161.stderr: 92.9%/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.3.log: -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi161.xoxpyp.log.gz 2024-09-18T13:10:23.000 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-18T13:10:23.002 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi045.favmzs.log: 91.0% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-18T13:10:23.026 INFO:teuthology.orchestra.run.smithi161.stderr: 89.2% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi161.yoflkm.log.gz 2024-09-18T13:10:23.046 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-18T13:10:23.393 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mgr.smithi045.brvbvl.log.gz 2024-09-18T13:10:23.400 INFO:teuthology.orchestra.run.smithi161.stderr: 92.5% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi161.log.gz 2024-09-18T13:10:24.199 INFO:teuthology.orchestra.run.smithi045.stderr: 90.4% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mon.smithi045.log.gz 2024-09-18T13:10:26.685 INFO:teuthology.orchestra.run.smithi161.stderr: 93.8% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-18T13:10:28.233 INFO:teuthology.orchestra.run.smithi045.stderr: 93.8% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-18T13:10:28.686 INFO:teuthology.orchestra.run.smithi045.stderr: 93.8% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-18T13:10:28.774 INFO:teuthology.orchestra.run.smithi161.stderr: 94.8% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi161.maxdew.log.gz 2024-09-18T13:10:28.930 INFO:teuthology.orchestra.run.smithi161.stderr: 93.8% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-18T13:10:29.254 INFO:teuthology.orchestra.run.smithi045.stderr: 93.7% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-18T13:10:29.860 INFO:teuthology.orchestra.run.smithi161.stderr: 93.8% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-18T13:10:36.798 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-18T13:10:36.799 INFO:teuthology.orchestra.run.smithi161.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-18T13:10:36.800 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-09-18T13:10:36.800 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m13.838s 2024-09-18T13:10:36.800 INFO:teuthology.orchestra.run.smithi161.stderr:user 0m35.555s 2024-09-18T13:10:36.800 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m1.077s 2024-09-18T13:10:37.852 INFO:teuthology.orchestra.run.smithi045.stderr: 94.8% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi045.favmzs.log.gz 2024-09-18T13:10:37.912 INFO:teuthology.orchestra.run.smithi045.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-18T13:12:13.204 INFO:teuthology.orchestra.run.smithi045.stderr: 93.0% -- replaced with /var/log/ceph/53bb6910-75bb-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi045.gzqgyu.log.gz 2024-09-18T13:12:13.205 INFO:teuthology.orchestra.run.smithi045.stderr: 2024-09-18T13:12:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:real 1m50.244s 2024-09-18T13:12:13.206 INFO:teuthology.orchestra.run.smithi045.stderr:user 2m34.141s 2024-09-18T13:12:13.206 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m4.499s 2024-09-18T13:12:13.206 INFO:tasks.cephadm:Archiving logs... 2024-09-18T13:12:13.206 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911385/remote/smithi045/log 2024-09-18T13:12:13.207 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T13:12:34.496 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911385/remote/smithi161/log 2024-09-18T13:12:34.497 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T13:12:39.278 INFO:tasks.cephadm:Removing cluster... 2024-09-18T13:12:39.278 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 --force 2024-09-18T13:12:39.492 INFO:teuthology.orchestra.run.smithi045.stdout:Deleting cluster with fsid: 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T13:12:39.918 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 53bb6910-75bb-11ef-bceb-c7b262605968 --force 2024-09-18T13:12:40.121 INFO:teuthology.orchestra.run.smithi161.stdout:Deleting cluster with fsid: 53bb6910-75bb-11ef-bceb-c7b262605968 2024-09-18T13:12:40.414 INFO:tasks.cephadm:Removing cephadm ... 2024-09-18T13:12:40.414 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-18T13:12:40.431 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-18T13:12:40.447 INFO:tasks.cephadm:Teardown complete 2024-09-18T13:12:40.447 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T13:12:40.459 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T13:12:40.460 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T13:12:40.461 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T13:12:40.474 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T13:12:40.564 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T13:12:40.574 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T13:12:40.574 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T13:12:40.577 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T13:12:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2024-09-18T13:12:40.591 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-09-18T13:12:40.595 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T13:12:40.596 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-09-18T13:12:40.596 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 +363us[ +372us] +/- 63ms 2024-09-18T13:12:40.596 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -2251us[-2251us] +/- 81ms 2024-09-18T13:12:40.596 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +1550us[+1559us] +/- 70ms 2024-09-18T13:12:40.596 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T13:12:40.597 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T13:12:40.597 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-09-18T13:12:40.597 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +340us[ +335us] +/- 63ms 2024-09-18T13:12:40.597 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 -2269us[-2269us] +/- 81ms 2024-09-18T13:12:40.597 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +1551us[+1551us] +/- 70ms 2024-09-18T13:12:40.597 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T13:12:40.597 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T13:12:40.610 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T13:12:40.610 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T13:12:40.639 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T13:12:40.723 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T13:12:40.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T13:12:40.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:12:40.825 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-18T13:12:40.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:12:40.853 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T13:12:40.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T13:12:40.930 INFO:teuthology.task.internal:Duration was 2225.258241 seconds 2024-09-18T13:12:40.930 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T13:12:40.961 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T13:12:40.961 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T13:12:40.964 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T13:12:41.002 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T13:12:41.003 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T13:12:41.329 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T13:12:41.329 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2024-09-18T13:12:41.329 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T13:12:41.392 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-09-18T13:12:41.392 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T13:12:41.420 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T13:12:41.420 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T13:12:41.434 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T13:12:41.487 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T13:12:41.487 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T13:12:41.502 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T13:12:42.154 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T13:12:42.166 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T13:12:42.166 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T13:12:42.192 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T13:12:42.218 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T13:12:42.230 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:12:42.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:12:42.255 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2024-09-18T13:12:42.283 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-09-18T13:12:42.311 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:12:42.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:12:42.330 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T13:12:42.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:12:42.367 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T13:12:42.379 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T13:12:42.379 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911385/remote/smithi045 2024-09-18T13:12:42.379 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T13:12:42.428 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-18_12:14:13-orch:cephadm-wip-guits-main-2024-09-17-1213-distro-default-smithi/7911385/remote/smithi161 2024-09-18T13:12:42.428 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T13:12:42.465 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T13:12:42.466 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T13:12:42.468 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T13:12:42.515 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T13:12:42.528 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T13:12:42.528 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T13:12:42.564 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T13:12:42.564 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T13:12:42.566 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T13:12:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 18 13:12 /home/ubuntu/cephtest 2024-09-18T13:12:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: 531132 4 d--------- 2 ubuntu ubuntu 4096 Sep 18 12:49 /home/ubuntu/cephtest/mnt.0 2024-09-18T13:12:42.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T13:12:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-18T13:12:42.581 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-18T13:12:42.581 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_e7fb7b56dbae911c82c9a0310bb8cf8c37e8363e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-18T13:12:42.582 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T13:12:42.611 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T13:12:42.649 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T13:12:42.653 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2225.258240699768 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_gabrioux@teuthology status: fail success: false 2024-09-18T13:12:42.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T13:12:42.755 INFO:teuthology.run:FAIL